Analisi Statistica per le Imprese
|
|
- Alban Matthews
- 6 years ago
- Views:
Transcription
1 , Analisi Statistica per le Imprese Dip. di Economia Politica e Statistica / 33
2 You should be able to:, Underst model building using multiple regression analysis Apply multiple regression analysis to business decision-making situations Analyze interpret the computer output for a multiple regression model Test the signicance of the independent variables in a multiple regression model Incorporate qualitative variables into the regression model by using dummy variables 2 / 33
3 The systematic part, One may need a mathematical model to quantify the existing relationship between a response variable Y k explicative variables X 1,...,X k y = f (X 1,...X k ) The multiple linear regression model species the functional relationship as f (X 1,...X k ) = β 1 X 1 + β 2 X β k X k (1) Geometrically this corresponds to a hyper-plan in k dimensions. The model is extremely useful because: 1 It has an intuitive geometrical interpretation 2 It has a simple estimation of the model's parameters 3 / 33
4 The stochastic part, The model always includes a rom component, that identies the stochastic component. This can be expressed as follows: Y = f (X 1,...X k ) + }{{}}{{} ε systematic stochastic (2) 4 / 33
5 The specication Stard notation: for each statistiocal unit i=1...n, Y i = β 1 X i1 + β 2 X i2 +...β k X ik + ε i (3) Matrix notation Y = Xβ + ε (4) Y : (n 1) vector of n dependent variable observations X : (n k) matrix of k regressors with each n observations β : (k 1) vector of k parameters ε : (n 1) vector of n 5 / 33
6 The Matrices, X 11 X 12 X 1k X 21 X 22 X 2k X = ; β = X n1 X n2 X nk Y 1 ε 1 Y 2 y =. ; ε = ε 2. Y n ε n β 1 β 2 The matrix X will have a unitary rst column if the model is with intercept. In this case the intercept would be β 1 in the multidimensional notation. β k 6 / 33
7 Stard Assumptions, Assumptions The functional relationship must be linear Covariates must have a deterministic nature The X matrix has full rank The error term has a null expected value E [ε i ] = 0 The error term is homosckedastic: Var [ε i ] = σ 2 The error terms are not correlated: Cov[ε i ε j ] i j = 0 7 / 33
8 OLS estimator, The OLS estimator in multiple linear regression is the vector β that minimize the following function of β, where X i is the i-th row of the X matrix. So min n i=1 e 2 i = min ( Y i X i β) 2 (5) ( e = Y X β ) (6) ( ) 1 β = X X X Y β (7) Notice that the matrix X X (cross product matrix) must be of full rank in order to be invertible. 8 / 33
9 OLS estimator properties, β is BLUE (Best Linear Unbiased Estimator) ( ( ) 1 ) One can notice that X X X is a matrix of constant elements, therefore β is a linear transformation of Y. One can prove that β is a correct estimator as follows ( ) 1 ( ) β = X 1 ( ) X X Y = X 1 X X (Xβ + ε) = β + X X X ε (8) ] ( ) 1 E [ β = β + X X X E [ε] = β (9) We could also prove that in the class of the linear unbiased estimator is the one presenting the minimum variance. 9 / 33
10 Variance of the OLS estimator, The variance of the OLS estimator is calculated as follows: ) [ Var ( β = E ( β β )( β ] ) β (10) ) [ ( ) 1 ( ) ] Var ( β = E X 1 X X εε X X X (11) ) ( ) 1 [ Var ( β = X X X E εε ] ( X X X) ( 1 ) 1 ( ) = σ 2 X X X X X X so for each parameter estimator (12) ) Var ( β ( 1 = σ 2 X X) (13) ) ( ) 1 Var ( βj = σ 2 X X jj (14) 10 / 33
11 Empirical example, A distributor of frozen desert pies wants to evaluate factors that inuence dem Dependent variable: y= Pie sales (units per week) Independent variables: x 1 =Price ($) x 2 =Advertising ($100's) Data is collected for 15 weeks The OLS estimates gives the following estimated model: ŷ = x x 2 (15) 11 / 33
12 Interpretation of the estimated coecient, each β j estimates the average value of Y changes by β j units for each 1 unit increase in X j, holding all other independent variables constant example: β1 = 24 then sales (y) are expected to decrease, on average, by 24 pies per week for each $1 increase in selling price (x 1 ), net of the eects due to advertising (x 2 ) β2 = 74 then sales (y) is expected to increase, on example: Intercept average, by 74 pies per week for each $100 increase in advertising (x 2 ), net of the eects due to price (x 1 ) the estimated average value of y when all X variables are zero. 12 / 33
13 Using the model to make predictions, We can calculate the predicted sales per week given the selling price ($5) advertising expenses ($350): ŷ = (5) + 74(3.5) = 445 (16) We predict to sell 445 pies per week. 13 / 33
14 The σ 2 estimator, [ ( e = Y X β ) ] 1 = Xβ + ε X X X X (Xβ + ε) (17) ( ) 1 e = Xβ + ε Xβ X X X X ε (18) ( ( ) 1 ) e = 1 X X X X ε = M x ε (19) M x is a idempotent symmetric matrix. This implies that: M x = M x = M k x; k > 0 (20) 14 / 33
15 Theσ 2 estimator, we can prove that Q = e e = ε M xm x ε = ε M x ε (21) E [Q] = σ 2 (n k) (22) so the unbiased estimator of the parameter σ 2 is [ ] Q E = σ 2 σ 2 = Q n k n k = e e n k (23) 15 / 33
16 ANOVA, Adding to the stard assumptions the following The error term has a normal distribution so:ε i N(0,σ 2 ) Reminding that follows β = β 1 β 2 =. β k ( ) 1 X X X Y (24) Y i = N ( Xβ,σ 2) (25) ( ( ) 1 β i = N β i,σ 2 X X ( β ( ) ) 1 = N β,σ 2 X X ii ) (26) (27) 16 / 33
17 ANOVA, In order to test the meaning of the whole model, we need to test the hypothesis system H 0 : β 1 = β 2 ==...β k = 0 H 1 : almeno un β j 0 the test is F = ESS /(k 1) = R2 /(k 1) F RSS/(n k) (1 R 2 )/n k (k 1,n k) 17 / 33
18 ANOVA, SS d.f. Mean Square (MS) β X y/(k 1) ESS = β X y = y yr 2 k-1 Residual RSS = e e = y y ( 1 R 2) n-k e e/(n k) Total TSS = y y = y 2 i n-1 Table 1: Construct the F statistic F = ESS /(k 1) RSS/(n k) Find the 95 th or the 99 th quantile of the distribution F (k 1),(n k) If F > F (1 α);(k 1),(n k) one rejects 18 / 33
19 R 2, R 2 = R 2 = ESS TSS 0 (28) TSS RSS TSS = 1 e2 i Y 2 i 1 (29) 0 R 2 1 (30) 19 / 33
20 Adjusted R 2, R 2 never decreases when a new X variable is added to the model this can be a disadvantage when comparing dierent models What is the net eect of adding a new variable? we lose a degree of freedom when a new X variable is added did the new X variable add enough explanatory power to oset the loss of one degree of freedom? The adjusted R 2 adjusts for the number of variables (k). R 2 adj = 1 e2 i/(n k) Y 2 i/(n 1) (n 1) ( = R 2 ) (31) (n k) 20 / 33
21 Empirical example: ANOVA, SS d.f. MS Residual Total Table 2: R 2 = 29460/56493 = 0.52 (32) 52% of the variation in pie sales is explained by the variation in price advertising R 2 adj = 0.44 (33) 44% of the variation in pie sales is explained by the variation in price advertising, taking into account the sample size the number of independent variables 21 / 33
22 Empirical example: is the model signicant?, F-test for the overall signicance of the model Shows if there is a linear relationship between all of the X variables considered together Y use F test statistic in the estimated model the empirical value of F is equal to 6.54 the critical value of F 0.05;2,12 is equal to > 3.88 therefore the regression model explains a signicant portion of the variation in pie sales (there is evidence that at least one independent variable aects y) 22 / 33
23 Single parameter t-test, ( ( ) ) 1 β N β,σ 2 X X To test the hypothesis if the individual variable X i has a signicant eect on Y we have to test H 0 :β i =0 (no linear relationship) H 1 :β i 0 (linear relationship does exist between X i Y) if σ 2 is known, under H 0 : (34) β i 0 σ 2 (X X) 1 N (0,1) (35) ii 23 / 33
24 Single parameter t-test, Generally σ 2 is unknown we have to use its estimator σ 2 = e e n k Therefore the Stard Errors of β is (36) se β = σ 2 (X X) 1 (37) 24 / 33
25 Single parameter t-test, under H 0 we have: β i 0 σ 2 (X X) 1 ii e e σ 2 /(n k) = β i se β t n k (38) Find the 95 th or the 99 th quantile of the distribution t (n k) if t > t (1 α/2);(n k) one rejects H 0 25 / 33
26 Empirical example: are individual variables signicant?, coecients Stard Error t Intercept Price Advertising Table 3: At α =0.05 signicant level, the t-value for price is >t (α/2;12) = so we refuse H 0 At α =0.05 signicant level, the t-value for advertising is 2.85 >t (α/2;12) = so we refuse H 0 There is evidence that both Price Advertising aect pie sales at α = / 33
27 , Until now we have assumed that in Y = Xβ + u, X are cardinal variables. One can also use categorial explanatory (i.e. dummy) variables that identify specic factors depending on categories: Temporal eects Spacial eects Qualitative variables We suppose that the Dummies inuence just the model intercept (not the slopes). There will be dierent regression interecepts corresponding to the dierent groups/situations, if the dummy variable is signicant. 27 / 33
28 , Lets assume the following generic model: Ŷ = β 0 + β 1 X 1 + β 2 X 2 (39) Where Y is the pie sale, X 1 is the price X 2 is a holiday indicator function, that will be equal to 1 when a holiday has occurred during the week, equal to 0 when there is no holiday during the week. 28 / 33
29 , Ŷ = β 0 + β 1 X 1 + β 2 (1) = (β 0 + β 2 ) + β 1 X 1 Ŷ = β 0 + β 1 X 1 + β 2 (0) = { (β 0 ) }} { + β 1 {}}{ X 1 different intercept same slope (40) y sales Holiday No Holiday If H 0 : β 2 = 0 is rejected Holiday has a signicant eect on pie sales x 1 price 29 / 33
30 , Example: Sales = (Price) + 15(Holiday) (41) Sales = number of pies sold per week Price = pie price in $ { 1 if holiday has occurred Holiday = 0 if holiday has not occurred As we see the dummy coecient β 2 = 15. This implies that on average 15 more pies were sold in weeks with holidays then in weeks without holidays, given the same price. 30 / 33
31 , The number of dummy variables must always be one less then the number of discriminated levels. Imagine that we are analyzing the house market have three dierent housing levels {ranch, split level, condo}. Example: Ŷ = β 0 + β 1 X 1 + β 2 X 2 + β 3 X 3 (42) Y = house price X 1 = { square meters 1 if ranch X 2 = β 2 impact of ranch vs. condo 0 if not { 1 if split level X 3 = β 3 split level vs. condo 0 if not 31 / 33
32 , Suppose the estimated equation is: The we will have as follows: For a condo (x 2 = x 3 = 0): For a ranch (x 3 = 0): Ŷ = X X X 3 (43) ŷ = X 1 (44) For a split level (x 2 = 0): ŷ = X 1 (45) ŷ = X 1 (46) 32 / 33
33 , Pindyck R. Rubinfeld D., 1998 Econometrics s Economic Forecasts (4-th Ed.) De Luca Amedeo,1996 Marketing Bancario e Metodi Statistici Applicati, vol. 1, Franco Angeli. 33 / 33
Chapter 7 Student Lecture Notes 7-1
Chapter 7 Student Lecture Notes 7- Chapter Goals QM353: Business Statistics Chapter 7 Multiple Regression Analysis and Model Building After completing this chapter, you should be able to: Explain model
More informationChapter 14 Student Lecture Notes 14-1
Chapter 14 Student Lecture Notes 14-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter 14 Multiple Regression Analysis and Model Building Chap 14-1 Chapter Goals After completing this
More informationBasic Business Statistics, 10/e
Chapter 4 4- Basic Business Statistics th Edition Chapter 4 Introduction to Multiple Regression Basic Business Statistics, e 9 Prentice-Hall, Inc. Chap 4- Learning Objectives In this chapter, you learn:
More informationThe Multiple Regression Model
Multiple Regression The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & or more independent variables (X i ) Multiple Regression Model with k Independent Variables:
More informationChapter 14 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics. Chapter 14 Multiple Regression
Chapter 14 Student Lecture Notes 14-1 Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Multiple Regression QMIS 0 Dr. Mohammad Zainal Chapter Goals After completing
More informationChapter 3 Multiple Regression Complete Example
Department of Quantitative Methods & Information Systems ECON 504 Chapter 3 Multiple Regression Complete Example Spring 2013 Dr. Mohammad Zainal Review Goals After completing this lecture, you should be
More informationBusiness Statistics. Tommaso Proietti. Linear Regression. DEF - Università di Roma 'Tor Vergata'
Business Statistics Tommaso Proietti DEF - Università di Roma 'Tor Vergata' Linear Regression Specication Let Y be a univariate quantitative response variable. We model Y as follows: Y = f(x) + ε where
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationLinear Regression. In this problem sheet, we consider the problem of linear regression with p predictors and one intercept,
Linear Regression In this problem sheet, we consider the problem of linear regression with p predictors and one intercept, y = Xβ + ɛ, where y t = (y 1,..., y n ) is the column vector of target values,
More information1: a b c d e 2: a b c d e 3: a b c d e 4: a b c d e 5: a b c d e. 6: a b c d e 7: a b c d e 8: a b c d e 9: a b c d e 10: a b c d e
Economics 102: Analysis of Economic Data Cameron Spring 2016 Department of Economics, U.C.-Davis Final Exam (A) Tuesday June 7 Compulsory. Closed book. Total of 58 points and worth 45% of course grade.
More informationBANA 7046 Data Mining I Lecture 2. Linear Regression, Model Assessment, and Cross-validation 1
BANA 7046 Data Mining I Lecture 2. Linear Regression, Model Assessment, and Cross-validation 1 Shaobo Li University of Cincinnati 1 Partially based on Hastie, et al. (2009) ESL, and James, et al. (2013)
More informationLecture 3: Multiple Regression
Lecture 3: Multiple Regression R.G. Pierse 1 The General Linear Model Suppose that we have k explanatory variables Y i = β 1 + β X i + β 3 X 3i + + β k X ki + u i, i = 1,, n (1.1) or Y i = β j X ji + u
More informationHypothesis testing Goodness of fit Multicollinearity Prediction. Applied Statistics. Lecturer: Serena Arima
Applied Statistics Lecturer: Serena Arima Hypothesis testing for the linear model Under the Gauss-Markov assumptions and the normality of the error terms, we saw that β N(β, σ 2 (X X ) 1 ) and hence s
More informationLinear Regression Models
Linear Regression Models November 13, 2018 1 / 89 1 Basic framework Model specification and assumptions Parameter estimation: least squares method Coefficient of determination R 2 Properties of the least
More informationThe regression model with one fixed regressor cont d
The regression model with one fixed regressor cont d 3150/4150 Lecture 4 Ragnar Nymoen 27 January 2012 The model with transformed variables Regression with transformed variables I References HGL Ch 2.8
More informationQuantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017
Summary of Part II Key Concepts & Formulas Christopher Ting November 11, 2017 christopherting@smu.edu.sg http://www.mysmu.edu/faculty/christophert/ Christopher Ting 1 of 16 Why Regression Analysis? Understand
More informationECON 4230 Intermediate Econometric Theory Exam
ECON 4230 Intermediate Econometric Theory Exam Multiple Choice (20 pts). Circle the best answer. 1. The Classical assumption of mean zero errors is satisfied if the regression model a) is linear in the
More informationIntroduction to Estimation Methods for Time Series models. Lecture 1
Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation
More informationMa 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA
Ma 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA March 6, 2017 KC Border Linear Regression II March 6, 2017 1 / 44 1 OLS estimator 2 Restricted regression 3 Errors in variables 4
More informationEmpirical Economic Research, Part II
Based on the text book by Ramanathan: Introductory Econometrics Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 7, 2011 Outline Introduction
More informationRecent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data
Recent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data July 2012 Bangkok, Thailand Cosimo Beverelli (World Trade Organization) 1 Content a) Classical regression model b)
More informationLecture 1: OLS derivations and inference
Lecture 1: OLS derivations and inference Econometric Methods Warsaw School of Economics (1) OLS 1 / 43 Outline 1 Introduction Course information Econometrics: a reminder Preliminary data exploration 2
More informationMULTIPLE REGRESSION ANALYSIS AND OTHER ISSUES. Business Statistics
MULTIPLE REGRESSION ANALYSIS AND OTHER ISSUES Business Statistics CONTENTS Multiple regression Dummy regressors Assumptions of regression analysis Predicting with regression analysis Old exam question
More informationRegression Analysis. BUS 735: Business Decision Making and Research. Learn how to detect relationships between ordinal and categorical variables.
Regression Analysis BUS 735: Business Decision Making and Research 1 Goals of this section Specific goals Learn how to detect relationships between ordinal and categorical variables. Learn how to estimate
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationMultiple Regression. Peerapat Wongchaiwat, Ph.D.
Peerapat Wongchaiwat, Ph.D. wongchaiwat@hotmail.com The Multiple Regression Model Examine the linear relationship between 1 dependent (Y) & 2 or more independent variables (X i ) Multiple Regression Model
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationRegression Models. Chapter 4. Introduction. Introduction. Introduction
Chapter 4 Regression Models Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna 008 Prentice-Hall, Inc. Introduction Regression analysis is a very valuable tool for a manager
More informationFinding Relationships Among Variables
Finding Relationships Among Variables BUS 230: Business and Economic Research and Communication 1 Goals Specific goals: Re-familiarize ourselves with basic statistics ideas: sampling distributions, hypothesis
More informationEconometrics. 5) Dummy variables
30C00200 Econometrics 5) Dummy variables Timo Kuosmanen Professor, Ph.D. Today s topics Qualitative factors as explanatory variables Binary qualitative factors Dummy variables and their interpretation
More informationChapter 4: Regression Models
Sales volume of company 1 Textbook: pp. 129-164 Chapter 4: Regression Models Money spent on advertising 2 Learning Objectives After completing this chapter, students will be able to: Identify variables,
More informationLECTURE 6. Introduction to Econometrics. Hypothesis testing & Goodness of fit
LECTURE 6 Introduction to Econometrics Hypothesis testing & Goodness of fit October 25, 2016 1 / 23 ON TODAY S LECTURE We will explain how multiple hypotheses are tested in a regression model We will define
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 3 Jakub Mućk Econometrics of Panel Data Meeting # 3 1 / 21 Outline 1 Fixed or Random Hausman Test 2 Between Estimator 3 Coefficient of determination (R 2
More informationRewrap ECON November 18, () Rewrap ECON 4135 November 18, / 35
Rewrap ECON 4135 November 18, 2011 () Rewrap ECON 4135 November 18, 2011 1 / 35 What should you now know? 1 What is econometrics? 2 Fundamental regression analysis 1 Bivariate regression 2 Multivariate
More informationMultiple Regression Analysis
Chapter 4 Multiple Regression Analysis The simple linear regression covered in Chapter 2 can be generalized to include more than one variable. Multiple regression analysis is an extension of the simple
More informationSimple Linear Regression
Simple Linear Regression ST 430/514 Recall: A regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates)
More informationLecture 4: Heteroskedasticity
Lecture 4: Heteroskedasticity Econometric Methods Warsaw School of Economics (4) Heteroskedasticity 1 / 24 Outline 1 What is heteroskedasticity? 2 Testing for heteroskedasticity White Goldfeld-Quandt Breusch-Pagan
More informationLECTURE 5 HYPOTHESIS TESTING
October 25, 2016 LECTURE 5 HYPOTHESIS TESTING Basic concepts In this lecture we continue to discuss the normal classical linear regression defined by Assumptions A1-A5. Let θ Θ R d be a parameter of interest.
More informationSimple Linear Regression
Simple Linear Regression Christopher Ting Christopher Ting : christophert@smu.edu.sg : 688 0364 : LKCSB 5036 January 7, 017 Web Site: http://www.mysmu.edu/faculty/christophert/ Christopher Ting QF 30 Week
More information14 Multiple Linear Regression
B.Sc./Cert./M.Sc. Qualif. - Statistics: Theory and Practice 14 Multiple Linear Regression 14.1 The multiple linear regression model In simple linear regression, the response variable y is expressed in
More informationChapter 4. Regression Models. Learning Objectives
Chapter 4 Regression Models To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian Peterson Learning Objectives After completing
More informationMA 575 Linear Models: Cedric E. Ginestet, Boston University Midterm Review Week 7
MA 575 Linear Models: Cedric E. Ginestet, Boston University Midterm Review Week 7 1 Random Vectors Let a 0 and y be n 1 vectors, and let A be an n n matrix. Here, a 0 and A are non-random, whereas y is
More informationHomoskedasticity. Var (u X) = σ 2. (23)
Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This
More information4 Multiple Linear Regression
4 Multiple Linear Regression 4. The Model Definition 4.. random variable Y fits a Multiple Linear Regression Model, iff there exist β, β,..., β k R so that for all (x, x 2,..., x k ) R k where ε N (, σ
More informationEconometrics Homework 1
Econometrics Homework Due Date: March, 24. by This problem set includes questions for Lecture -4 covered before midterm exam. Question Let z be a random column vector of size 3 : z = @ (a) Write out z
More informationEstadística II Chapter 5. Regression analysis (second part)
Estadística II Chapter 5. Regression analysis (second part) Chapter 5. Regression analysis (second part) Contents Diagnostic: Residual analysis The ANOVA (ANalysis Of VAriance) decomposition Nonlinear
More informationMa 3/103: Lecture 24 Linear Regression I: Estimation
Ma 3/103: Lecture 24 Linear Regression I: Estimation March 3, 2017 KC Border Linear Regression I March 3, 2017 1 / 32 Regression analysis Regression analysis Estimate and test E(Y X) = f (X). f is the
More informationRegression of Time Series
Mahlerʼs Guide to Regression of Time Series CAS Exam S prepared by Howard C. Mahler, FCAS Copyright 2016 by Howard C. Mahler. Study Aid 2016F-S-9Supplement Howard Mahler hmahler@mac.com www.howardmahler.com/teaching
More informationIntermediate Econometrics
Intermediate Econometrics Heteroskedasticity Text: Wooldridge, 8 July 17, 2011 Heteroskedasticity Assumption of homoskedasticity, Var(u i x i1,..., x ik ) = E(u 2 i x i1,..., x ik ) = σ 2. That is, the
More informationThe Standard Linear Model: Hypothesis Testing
Department of Mathematics Ma 3/103 KC Border Introduction to Probability and Statistics Winter 2017 Lecture 25: The Standard Linear Model: Hypothesis Testing Relevant textbook passages: Larsen Marx [4]:
More informationINTRODUCTORY ECONOMETRICS
INTRODUCTORY ECONOMETRICS Lesson 2b Dr Javier Fernández etpfemaj@ehu.es Dpt. of Econometrics & Statistics UPV EHU c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 1/192 GLRM:
More informationInferences for Regression
Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In
More informationStatistics II Exercises Chapter 5
Statistics II Exercises Chapter 5 1. Consider the four datasets provided in the transparencies for Chapter 5 (section 5.1) (a) Check that all four datasets generate exactly the same LS linear regression
More informationThe Hong Kong University of Science & Technology ISOM551 Introductory Statistics for Business Assignment 4 Suggested Solution
8 TUNG, Yik-Man The Hong Kong University of cience & Technology IOM55 Introductory tatistics for Business Assignment 4 uggested olution Note All values of statistics are obtained by Excel Qa Theoretically,
More informationEcon 3790: Statistics Business and Economics. Instructor: Yogesh Uppal
Econ 3790: Statistics Business and Economics Instructor: Yogesh Uppal Email: yuppal@ysu.edu Chapter 14 Covariance and Simple Correlation Coefficient Simple Linear Regression Covariance Covariance between
More informationPanel data can be defined as data that are collected as a cross section but then they are observed periodically.
Panel Data Model Panel data can be defined as data that are collected as a cross section but then they are observed periodically. For example, the economic growths of each province in Indonesia from 1971-2009;
More informationBusiness Statistics. Chapter 14 Introduction to Linear Regression and Correlation Analysis QMIS 220. Dr. Mohammad Zainal
Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Introduction to Linear Regression and Correlation Analysis QMIS 220 Dr. Mohammad Zainal Chapter Goals After completing
More informationBivariate Relationships Between Variables
Bivariate Relationships Between Variables BUS 735: Business Decision Making and Research 1 Goals Specific goals: Detect relationships between variables. Be able to prescribe appropriate statistical methods
More information2 Regression Analysis
FORK 1002 Preparatory Course in Statistics: 2 Regression Analysis Genaro Sucarrat (BI) http://www.sucarrat.net/ Contents: 1 Bivariate Correlation Analysis 2 Simple Regression 3 Estimation and Fit 4 T -Test:
More informationCorrelation Analysis
Simple Regression Correlation Analysis Correlation analysis is used to measure strength of the association (linear relationship) between two variables Correlation is only concerned with strength of the
More informationIntroduction to Linear Regression Analysis
Introduction to Linear Regression Analysis Samuel Nocito Lecture 1 March 2nd, 2018 Econometrics: What is it? Interaction of economic theory, observed data and statistical methods. The science of testing
More informationLeast Squares Estimation-Finite-Sample Properties
Least Squares Estimation-Finite-Sample Properties Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Finite-Sample 1 / 29 Terminology and Assumptions 1 Terminology and Assumptions
More informationMicroeconometria Day # 5 L. Cembalo. Regressione con due variabili e ipotesi dell OLS
Microeconometria Day # 5 L. Cembalo Regressione con due variabili e ipotesi dell OLS Multiple regression model Classical hypothesis of a regression model: Assumption 1: Linear regression model.the regression
More informationMultiple Linear Regression
Multiple Linear Regression ST 430/514 Recall: a regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates).
More informationBNAD 276 Lecture 10 Simple Linear Regression Model
1 / 27 BNAD 276 Lecture 10 Simple Linear Regression Model Phuong Ho May 30, 2017 2 / 27 Outline 1 Introduction 2 3 / 27 Outline 1 Introduction 2 4 / 27 Simple Linear Regression Model Managerial decisions
More informationBasic Business Statistics 6 th Edition
Basic Business Statistics 6 th Edition Chapter 12 Simple Linear Regression Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value of a dependent variable based
More informationIn the bivariate regression model, the original parameterization is. Y i = β 1 + β 2 X2 + β 2 X2. + β 2 (X 2i X 2 ) + ε i (2)
RNy, econ460 autumn 04 Lecture note Orthogonalization and re-parameterization 5..3 and 7.. in HN Orthogonalization of variables, for example X i and X means that variables that are correlated are made
More informationEC4051 Project and Introductory Econometrics
EC4051 Project and Introductory Econometrics Dudley Cooke Trinity College Dublin Dudley Cooke (Trinity College Dublin) Intro to Econometrics 1 / 23 Project Guidelines Each student is required to undertake
More informationx i = 1 yi 2 = 55 with N = 30. Use the above sample information to answer all the following questions. Show explicitly all formulas and calculations.
Exercises for the course of Econometrics Introduction 1. () A researcher is using data for a sample of 30 observations to investigate the relationship between some dependent variable y i and independent
More information3 Multiple Linear Regression
3 Multiple Linear Regression 3.1 The Model Essentially, all models are wrong, but some are useful. Quote by George E.P. Box. Models are supposed to be exact descriptions of the population, but that is
More informationQuestion 1a 1b 1c 1d 1e 2a 2b 2c 2d 2e 2f 3a 3b 3c 3d 3e 3f M ult: choice Points
Economics 102: Analysis of Economic Data Cameron Spring 2016 May 12 Department of Economics, U.C.-Davis Second Midterm Exam (Version A) Compulsory. Closed book. Total of 30 points and worth 22.5% of course
More informationMath 423/533: The Main Theoretical Topics
Math 423/533: The Main Theoretical Topics Notation sample size n, data index i number of predictors, p (p = 2 for simple linear regression) y i : response for individual i x i = (x i1,..., x ip ) (1 p)
More informationSection 3: Simple Linear Regression
Section 3: Simple Linear Regression Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction
More information1: a b c d e 2: a b c d e 3: a b c d e 4: a b c d e 5: a b c d e. 6: a b c d e 7: a b c d e 8: a b c d e 9: a b c d e 10: a b c d e
Economics 102: Analysis of Economic Data Cameron Spring 2015 Department of Economics, U.C.-Davis Final Exam (A) Saturday June 6 Compulsory. Closed book. Total of 56 points and worth 45% of course grade.
More informationLECTURE 10. Introduction to Econometrics. Multicollinearity & Heteroskedasticity
LECTURE 10 Introduction to Econometrics Multicollinearity & Heteroskedasticity November 22, 2016 1 / 23 ON PREVIOUS LECTURES We discussed the specification of a regression equation Specification consists
More informationGeneral Linear Model (Chapter 4)
General Linear Model (Chapter 4) Outcome variable is considered continuous Simple linear regression Scatterplots OLS is BLUE under basic assumptions MSE estimates residual variance testing regression coefficients
More informationSIMPLE REGRESSION ANALYSIS. Business Statistics
SIMPLE REGRESSION ANALYSIS Business Statistics CONTENTS Ordinary least squares (recap for some) Statistical formulation of the regression model Assessing the regression model Testing the regression coefficients
More informationLab 07 Introduction to Econometrics
Lab 07 Introduction to Econometrics Learning outcomes for this lab: Introduce the different typologies of data and the econometric models that can be used Understand the rationale behind econometrics Understand
More information11 Hypothesis Testing
28 11 Hypothesis Testing 111 Introduction Suppose we want to test the hypothesis: H : A q p β p 1 q 1 In terms of the rows of A this can be written as a 1 a q β, ie a i β for each row of A (here a i denotes
More information2. Linear regression with multiple regressors
2. Linear regression with multiple regressors Aim of this section: Introduction of the multiple regression model OLS estimation in multiple regression Measures-of-fit in multiple regression Assumptions
More informationEstimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.
Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.
More informationA discussion on multiple regression models
A discussion on multiple regression models In our previous discussion of simple linear regression, we focused on a model in which one independent or explanatory variable X was used to predict the value
More informationAnalysis of variance. Gilles Guillot. September 30, Gilles Guillot September 30, / 29
Analysis of variance Gilles Guillot gigu@dtu.dk September 30, 2013 Gilles Guillot (gigu@dtu.dk) September 30, 2013 1 / 29 1 Introductory example 2 One-way ANOVA 3 Two-way ANOVA 4 Two-way ANOVA with interactions
More informationChapter 3: Multiple Regression. August 14, 2018
Chapter 3: Multiple Regression August 14, 2018 1 The multiple linear regression model The model y = β 0 +β 1 x 1 + +β k x k +ǫ (1) is called a multiple linear regression model with k regressors. The parametersβ
More informationSo far our focus has been on estimation of the parameter vector β in the. y = Xβ + u
Interval estimation and hypothesis tests So far our focus has been on estimation of the parameter vector β in the linear model y i = β 1 x 1i + β 2 x 2i +... + β K x Ki + u i = x iβ + u i for i = 1, 2,...,
More information(4) 1. Create dummy variables for Town. Name these dummy variables A and B. These 0,1 variables now indicate the location of the house.
Exam 3 Resource Economics 312 Introductory Econometrics Please complete all questions on this exam. The data in the spreadsheet: Exam 3- Home Prices.xls are to be used for all analyses. These data are
More informationFinQuiz Notes
Reading 10 Multiple Regression and Issues in Regression Analysis 2. MULTIPLE LINEAR REGRESSION Multiple linear regression is a method used to model the linear relationship between a dependent variable
More informationPractical Econometrics. for. Finance and Economics. (Econometrics 2)
Practical Econometrics for Finance and Economics (Econometrics 2) Seppo Pynnönen and Bernd Pape Department of Mathematics and Statistics, University of Vaasa 1. Introduction 1.1 Econometrics Econometrics
More informationINTRODUCTION TO BASIC LINEAR REGRESSION MODEL
INTRODUCTION TO BASIC LINEAR REGRESSION MODEL 13 September 2011 Yogyakarta, Indonesia Cosimo Beverelli (World Trade Organization) 1 LINEAR REGRESSION MODEL In general, regression models estimate the effect
More informationEcon 620. Matrix Differentiation. Let a and x are (k 1) vectors and A is an (k k) matrix. ) x. (a x) = a. x = a (x Ax) =(A + A (x Ax) x x =(A + A )
Econ 60 Matrix Differentiation Let a and x are k vectors and A is an k k matrix. a x a x = a = a x Ax =A + A x Ax x =A + A x Ax = xx A We don t want to prove the claim rigorously. But a x = k a i x i i=
More informationCHAPTER 2: Assumptions and Properties of Ordinary Least Squares, and Inference in the Linear Regression Model
CHAPTER 2: Assumptions and Properties of Ordinary Least Squares, and Inference in the Linear Regression Model Prof. Alan Wan 1 / 57 Table of contents 1. Assumptions in the Linear Regression Model 2 / 57
More informationInference for the Regression Coefficient
Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression line. We can shows that b 0 and b 1 are the unbiased estimates
More informationECON 497 Midterm Spring
ECON 497 Midterm Spring 2009 1 ECON 497: Economic Research and Forecasting Name: Spring 2009 Bellas Midterm You have three hours and twenty minutes to complete this exam. Answer all questions and explain
More informationMidterm 2 - Solutions
Ecn 102 - Analysis of Economic Data University of California - Davis February 24, 2010 Instructor: John Parman Midterm 2 - Solutions You have until 10:20am to complete this exam. Please remember to put
More informationRegression Analysis II
Regression Analysis II Measures of Goodness of fit Two measures of Goodness of fit Measure of the absolute fit of the sample points to the sample regression line Standard error of the estimate An index
More informationMBF1923 Econometrics Prepared by Dr Khairul Anuar
MBF1923 Econometrics Prepared by Dr Khairul Anuar L4 Ordinary Least Squares www.notes638.wordpress.com Ordinary Least Squares The bread and butter of regression analysis is the estimation of the coefficient
More informationHypothesis Testing hypothesis testing approach
Hypothesis Testing In this case, we d be trying to form an inference about that neighborhood: Do people there shop more often those people who are members of the larger population To ascertain this, we
More informationFöreläsning /31
1/31 Föreläsning 10 090420 Chapter 13 Econometric Modeling: Model Speci cation and Diagnostic testing 2/31 Types of speci cation errors Consider the following models: Y i = β 1 + β 2 X i + β 3 X 2 i +
More informationLinear Regression with 1 Regressor. Introduction to Econometrics Spring 2012 Ken Simons
Linear Regression with 1 Regressor Introduction to Econometrics Spring 2012 Ken Simons Linear Regression with 1 Regressor 1. The regression equation 2. Estimating the equation 3. Assumptions required for
More information1 Overview. 2 Multiple Regression framework. Effect Coding. Hervé Abdi
In Neil Salkind (Ed.), Encyclopedia of Research Design. Thousand Oaks, CA: Sage. 2010 Effect Coding Hervé Abdi 1 Overview Effect coding is a coding scheme used when an analysis of variance (anova) is performed
More information