Violation of OLS assumption- Multicollinearity
|
|
- Silvester Clark
- 6 years ago
- Views:
Transcription
1 Violation of OLS assumption- Multicollinearity What, why and so what? Lars Forsberg Uppsala University, Department of Statistics October 17, 2014 Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
2 Econometrics - Objectives and exam Violations of assumptions - mulitcollinearity: 1 Explain what multicollinearity is 2 Formulate perfect multicollinearity using formulae 3 Give an empirical example of when two regressors could be highly correlated Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
3 Econometrics - Objectives and exam 1 Tell the consequences of multicollinearity (expectation and variance of OLS estimators) 2 Explain how one can detect multicollinearity 3 Do a t-test of a slope coe cient in the prescence of high (but not perfect) multicollinearity and interpret the result Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
4 Questions to ask ourselves 1 How to spell it? 2 What is multicollinearity? 3 Is it a problem? In what situations? Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
5 Questions to ask ourselves 1 Detection: How do I know if there is a multicollinearity problem? 2 Why: How does multicollinearity come about? 3 Remedy: What can we do about it? Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
6 How to spell it Multicollinearity Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
7 Multicollinearity - What? Also a problem when, for small random ν λ 1 X λ k X k + ν = 0 In practice, it is not a question of IF we have multicollinearity, but of the degree of multicollinearity. Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
8 Multicollinearity - What? How then, do we measure the degree of multicollinearity? When does it become a problem? Consequences: What kind of problem(s) does it cause? Remedy: What can we do about it? Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
9 Multicollinearity - What? Perfect multicollinearity, assume that X 3 = αx 2 (so, X 3 is just a scaled version of X 2, ) and we want to estimate the parameters of Y = β 1 + β 2 X 2 + β 3 X 3 + u (1) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
10 Multicollinearity - What? Substitute: Y = β 1 + β 2 X 2 + β 3 X 3 +u X 3 = αx 2 Y = β 1 + β 2 X 2 + β 3 (αx 2 ) +u Giving Y = β 1 + β 2 X 2 + β 3 αx 2 +u Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
11 Multicollinearity - What? Y = β 1 + β 2 X 2 + β 3 αx 2 +u Y = β 1 + (β 2 + β 3 α) X 2 +u Y = β 1 + γx 2 +u Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
12 Multicollinearity - What? We note that γ = (β 2 + β 3 α) 1 See that β 2, β 3 and α "sticks" togheter. 2 We cannot separate them. 3 Not only is β 2 and β 3 not identi ed - OLS breaks down... 4 If we try to estimate the above model (1), we will not get any numbers out of Eviews... Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
13 Multicollinearity - What? So, it is a matter of degree... If not exact: In the case of multicollinearity - this is the correct variance of the estimator bβ j! V b σ β j = 2 1 (X j X j ) 2 1 Rj 2 R 2 j being the R 2 of the regression of X j on the other regressions. Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
14 Multicollinearity - What? For instance R 2 2 would be the R2 from the regression X 2 = α 1 + α 2 X 3 + u If this R 2 is high: It means that X 3 can explain a lot of the variation in X 2 and that is not a good thing. They should in the "best of regressions" be independent, (orthogonal), or at least uncorrelated. Di erent regressors should explain "di erent parts" of the variation in the dependent variable. Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
15 Multicollinearity - Consequences What happens when we have (high degree of) multicollinearity? 1 OLS estimators still unbiased 2 Large variance, but estimates still BLUE (still the best we can use) 3 To wide CI (function of too large variances, to large standard errors) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
16 Multicollinearity - Consequences What happens when we have (high degree of) multicollinearity? 1 t statistics to small (see above), leads no "no rejection/acceptance" of H 0 : β j = 0 2 but high R 2 (the model explains variation in Y, although some X s explain the same thing...) 3 Estimates sensitive to small changes in data Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
17 Multicollinearity - Why? What could be the reason? (If we knew, we could correct...) 1 Natural constraints on model/data (Rooms in at and Square meters) 2 Model speci cation (polynomial) Y i = β 0 Xi 0 + β 1 Xi 1 + β 2 Xi 2 + β 3 Xi 3 + u i Y i = β 0 + β 1 X i + β 2 Xi 2 + β 3 Xi 3 + u i 3 To many variables in the model 4 Common trends in time series (two variables trending together) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
18 Multicollinearity - Detection How do we know if we have multicollinearity? 1 Using VIF (Variance In ation Factor) (see formula for variance)! VIF j = 1 1 Rj 2 2 Insigni cant t ratios, ) the model "is NO good" 3 but "high" R 2 4 Test of model signi cant ) the model "is good" Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
19 Multicollinearity - Consequences If the variances of the slope-estimators are too big, then what? In terms of t-ratios: bβ j σ b β j σ b β j to BIG + to SMALL + Never Reject H 0 : β j = 0 + Never Signi cance + Think model is "worse" that it actually is Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
20 Multicollinearity - Consequences But the F-test of the model, will still be signi cant... Analysing gives Result Interpretation t-test of parameters Not Signi cant ) Model is (di erent from zero) "NO GOOD" F-Test of model Signi cant ) Model is "OK" (at least one β j 6= 0 Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
21 Multicollinearity - Detection How do we know if we have multicollinearity? 1 Change one observation and see what happens (OLS on borderline to breakdown, should react...) 2 Scatterplot of X s (X 2 vs X 3 to see if there is a strong correlation) 3 Correlation matrix of the regressors (why not the covariance matrix?) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
22 Multicollinearity - Remedy OK, we have (a high degree of) multicollinearity, what should/ can we do? 1 Nothing (Point Prediction only, S.E. being messed up) 2 Add data or another dataset 3 Drop variable(s) 4 Transformation of data, e.g. logs, di erences (will "destroy" linear dependency) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
23 Multicollinearity - Remedy Example, Table 8.8: Model for number of employed, yearly data Variables: Y number of employed X 1 GNP price de ator X 2 GNP X 3 number of unemployed X 4 number in armed forces X 5 noninstitionalized population X 6 year Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
24 Multicollinearity - Example The original data Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
25 Multicollinearity - Example We estimate the model: What do we note? Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
26 Multicollinearity - Example Take a look at the correlation matrix Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
27 Multicollinearity - Example Run the "auxiliary" (help-) regression: X 1 on the other X 0 s (note that the dependent variable now is X 1 ) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
28 Multicollinearity - Example Given the above output, we can calculate the Variance In ation Factor (VIF): VIF 1 = = 1 1 R = This is the "in ation" on the variance of the bβ 1 caused by X 1 being correlated with the other variables. Recall:! V b σ β j = 2 1 (X j X j ) 2 1 Rj 2 Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
29 Multicollinearity - Example We can calculate the variance without multicollinearity (if we did not have it, but now we do, so just for illustration, do not try this at home...)! σ 2 σ = 2 1 bβ j (X j X j ) 2 1 Rj 2 Variance without Multicollinearity (in the case R 2 j = 0) σ 2 bβ j = σ 2 bβ j = σ 2 (X j X j ) 2 σ 2 (X j X j ) Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
30 Multicollinearity - Example SE without Multicollinearity rv With M b β j =! s σ 2 (X j X j ) 2 = v! u t σ 2 1 (X j X j ) 2 1 Rj 2 v V With M b β j u t 1 1 R 2 j Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
31 Multicollinearity - Example σ b β j,without M = v V With M b β j u t 1 1 R 2 j = p = Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
32 Multicollinearity - Example For X 1 where we have σ b β 1,With M = Recall So VIF 1 = R 2 1 = VIF 1 = Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
33 Multicollinearity - Example "Take out" VIF σ b β j,without M = v V With M b β j u t 1 1 R 2 j = p = Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
34 Multicollinearity - Example Comparision Multicollinearity Measure With M. Without M r V b β j t obs H 0 : β 1 = 0 Not reject Reject Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
35 Multicollinearity - Example Change one observation, i.e. rst obs in X 1 X1 Being the original data X11 Being the manipulated data Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
36 Multicollinearity - Example The regression results original data The regression results with the manipulated data: Big di erence in estimates of β 1 thus, we have a problem... Lars Forsberg (Uppsala University) Multi - co - linear -ity October 17, / 36
Violation of OLS assumption - Heteroscedasticity
Violation of OLS assumption - Heteroscedasticity What, why, so what and what to do? Lars Forsberg Uppsala Uppsala University, Department of Statistics October 22, 2014 Lars Forsberg (Uppsala University)
More informationFöreläsning /31
1/31 Föreläsning 10 090420 Chapter 13 Econometric Modeling: Model Speci cation and Diagnostic testing 2/31 Types of speci cation errors Consider the following models: Y i = β 1 + β 2 X i + β 3 X 2 i +
More informationL7: Multicollinearity
L7: Multicollinearity Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Introduction ï Example Whats wrong with it? Assume we have this data Y
More informationMulticollinearity. Filippo Ferroni 1. Course in Econometrics and Data Analysis Ieseg September 22, Banque de France.
Filippo Ferroni 1 1 Business Condition and Macroeconomic Forecasting Directorate, Banque de France Course in Econometrics and Data Analysis Ieseg September 22, 2011 We have multicollinearity when two or
More information1 A Non-technical Introduction to Regression
1 A Non-technical Introduction to Regression Chapters 1 and Chapter 2 of the textbook are reviews of material you should know from your previous study (e.g. in your second year course). They cover, in
More informationCollection of Formulae and Statistical Tables for the B2-Econometrics and B3-Time Series Analysis courses and exams
Collection of Formulae and Statistical Tables for the B2-Econometrics and B3-Time Series Analysis courses and exams Lars Forsberg Uppsala University Spring 2015 Abstract This collection of formulae is
More informationCHAPTER 6: SPECIFICATION VARIABLES
Recall, we had the following six assumptions required for the Gauss-Markov Theorem: 1. The regression model is linear, correctly specified, and has an additive error term. 2. The error term has a zero
More information1 Correlation between an independent variable and the error
Chapter 7 outline, Econometrics Instrumental variables and model estimation 1 Correlation between an independent variable and the error Recall that one of the assumptions that we make when proving the
More informationLECTURE 13: TIME SERIES I
1 LECTURE 13: TIME SERIES I AUTOCORRELATION: Consider y = X + u where y is T 1, X is T K, is K 1 and u is T 1. We are using T and not N for sample size to emphasize that this is a time series. The natural
More informationIntroductory Econometrics
Introductory Econometrics Violation of basic assumptions Heteroskedasticity Barbara Pertold-Gebicka CERGE-EI 16 November 010 OLS assumptions 1. Disturbances are random variables drawn from a normal distribution.
More informationEconometrics Midterm Examination Answers
Econometrics Midterm Examination Answers March 4, 204. Question (35 points) Answer the following short questions. (i) De ne what is an unbiased estimator. Show that X is an unbiased estimator for E(X i
More informationEconometrics Homework 1
Econometrics Homework Due Date: March, 24. by This problem set includes questions for Lecture -4 covered before midterm exam. Question Let z be a random column vector of size 3 : z = @ (a) Write out z
More information1 Regression with Time Series Variables
1 Regression with Time Series Variables With time series regression, Y might not only depend on X, but also lags of Y and lags of X Autoregressive Distributed lag (or ADL(p; q)) model has these features:
More informationEconomics 620, Lecture 13: Time Series I
Economics 620, Lecture 13: Time Series I Nicholas M. Kiefer Cornell University Professor N. M. Kiefer (Cornell University) Lecture 13: Time Series I 1 / 19 AUTOCORRELATION Consider y = X + u where y is
More informationMultiple Regression. Midterm results: AVG = 26.5 (88%) A = 27+ B = C =
Economics 130 Lecture 6 Midterm Review Next Steps for the Class Multiple Regression Review & Issues Model Specification Issues Launching the Projects!!!!! Midterm results: AVG = 26.5 (88%) A = 27+ B =
More information1 The Multiple Regression Model: Freeing Up the Classical Assumptions
1 The Multiple Regression Model: Freeing Up the Classical Assumptions Some or all of classical assumptions were crucial for many of the derivations of the previous chapters. Derivation of the OLS estimator
More information1. The Multivariate Classical Linear Regression Model
Business School, Brunel University MSc. EC550/5509 Modelling Financial Decisions and Markets/Introduction to Quantitative Methods Prof. Menelaos Karanasos (Room SS69, Tel. 08956584) Lecture Notes 5. The
More informationSimple Linear Regression
Simple Linear Regression ST 430/514 Recall: A regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates)
More informationLecture 4: Multivariate Regression, Part 2
Lecture 4: Multivariate Regression, Part 2 Gauss-Markov Assumptions 1) Linear in Parameters: Y X X X i 0 1 1 2 2 k k 2) Random Sampling: we have a random sample from the population that follows the above
More informationMay 2, Why do nonlinear models provide poor. macroeconomic forecasts? Graham Elliott (UCSD) Gray Calhoun (Iowa State) Motivating Problem
(UCSD) Gray with May 2, 2012 The with (a) Typical comments about future of forecasting imply a large role for. (b) Many studies show a limited role in providing forecasts from. (c) Reviews of forecasting
More informationQuantitative Techniques - Lecture 8: Estimation
Quantitative Techniques - Lecture 8: Estimation Key words: Estimation, hypothesis testing, bias, e ciency, least squares Hypothesis testing when the population variance is not known roperties of estimates
More informationLecture 4: Multivariate Regression, Part 2
Lecture 4: Multivariate Regression, Part 2 Gauss-Markov Assumptions 1) Linear in Parameters: Y X X X i 0 1 1 2 2 k k 2) Random Sampling: we have a random sample from the population that follows the above
More information1 Quantitative Techniques in Practice
1 Quantitative Techniques in Practice 1.1 Lecture 2: Stationarity, spurious regression, etc. 1.1.1 Overview In the rst part we shall look at some issues in time series economics. In the second part we
More informationEconomics Introduction to Econometrics - Fall 2007 Final Exam - Answers
Student Name: Economics 4818 - Introduction to Econometrics - Fall 2007 Final Exam - Answers SHOW ALL WORK! Evaluation: Problems: 3, 4C, 5C and 5F are worth 4 points. All other questions are worth 3 points.
More information(c) i) In ation (INFL) is regressed on the unemployment rate (UNR):
BRUNEL UNIVERSITY Master of Science Degree examination Test Exam Paper 005-006 EC500: Modelling Financial Decisions and Markets EC5030: Introduction to Quantitative methods Model Answers. COMPULSORY (a)
More informationNotes 11: OLS Theorems ECO 231W - Undergraduate Econometrics
Notes 11: OLS Theorems ECO 231W - Undergraduate Econometrics Prof. Carolina Caetano For a while we talked about the regression method. Then we talked about the linear model. There were many details, but
More informationApplied Econometrics. Applied Econometrics Second edition. Dimitrios Asteriou and Stephen G. Hall
Applied Econometrics Second edition Dimitrios Asteriou and Stephen G. Hall MULTICOLLINEARITY 1. Perfect Multicollinearity 2. Consequences of Perfect Multicollinearity 3. Imperfect Multicollinearity 4.
More informationECONOMET RICS P RELIM EXAM August 24, 2010 Department of Economics, Michigan State University
ECONOMET RICS P RELIM EXAM August 24, 2010 Department of Economics, Michigan State University Instructions: Answer all four (4) questions. Be sure to show your work or provide su cient justi cation for
More informationApplied Statistics and Econometrics
Applied Statistics and Econometrics Lecture 6 Saul Lach September 2017 Saul Lach () Applied Statistics and Econometrics September 2017 1 / 53 Outline of Lecture 6 1 Omitted variable bias (SW 6.1) 2 Multiple
More informationChapter 2. Dynamic panel data models
Chapter 2. Dynamic panel data models School of Economics and Management - University of Geneva Christophe Hurlin, Université of Orléans University of Orléans April 2018 C. Hurlin (University of Orléans)
More informationi) the probability of type I error; ii) the 95% con dence interval; iii) the p value; iv) the probability of type II error; v) the power of a test.
1. Explain what is: i) the probability of type I error; ii) the 95% con dence interval; iii) the p value; iv) the probability of type II error; v) the power of a test. Answer: i) It is the probability
More informationEnvironmental Econometrics
Environmental Econometrics Syngjoo Choi Fall 2008 Environmental Econometrics (GR03) Fall 2008 1 / 37 Syllabus I This is an introductory econometrics course which assumes no prior knowledge on econometrics;
More informationLecture 1: OLS derivations and inference
Lecture 1: OLS derivations and inference Econometric Methods Warsaw School of Economics (1) OLS 1 / 43 Outline 1 Introduction Course information Econometrics: a reminder Preliminary data exploration 2
More informationEconometrics Review questions for exam
Econometrics Review questions for exam Nathaniel Higgins nhiggins@jhu.edu, 1. Suppose you have a model: y = β 0 x 1 + u You propose the model above and then estimate the model using OLS to obtain: ŷ =
More information2. Linear regression with multiple regressors
2. Linear regression with multiple regressors Aim of this section: Introduction of the multiple regression model OLS estimation in multiple regression Measures-of-fit in multiple regression Assumptions
More informationChapter 6: Endogeneity and Instrumental Variables (IV) estimator
Chapter 6: Endogeneity and Instrumental Variables (IV) estimator Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 15, 2013 Christophe Hurlin (University of Orléans)
More informationECON 497: Lecture 4 Page 1 of 1
ECON 497: Lecture 4 Page 1 of 1 Metropolitan State University ECON 497: Research and Forecasting Lecture Notes 4 The Classical Model: Assumptions and Violations Studenmund Chapter 4 Ordinary least squares
More informationEconomics 326 Methods of Empirical Research in Economics. Lecture 14: Hypothesis testing in the multiple regression model, Part 2
Economics 326 Methods of Empirical Research in Economics Lecture 14: Hypothesis testing in the multiple regression model, Part 2 Vadim Marmer University of British Columbia May 5, 2010 Multiple restrictions
More informationMarkov-Switching Models with Endogenous Explanatory Variables. Chang-Jin Kim 1
Markov-Switching Models with Endogenous Explanatory Variables by Chang-Jin Kim 1 Dept. of Economics, Korea University and Dept. of Economics, University of Washington First draft: August, 2002 This version:
More informationACE 564 Spring Lecture 8. Violations of Basic Assumptions I: Multicollinearity and Non-Sample Information. by Professor Scott H.
ACE 564 Spring 2006 Lecture 8 Violations of Basic Assumptions I: Multicollinearity and Non-Sample Information by Professor Scott H. Irwin Readings: Griffiths, Hill and Judge. "Collinear Economic Variables,
More informationThe linear regression model: functional form and structural breaks
The linear regression model: functional form and structural breaks Ragnar Nymoen Department of Economics, UiO 16 January 2009 Overview Dynamic models A little bit more about dynamics Extending inference
More informationEcon107 Applied Econometrics
Econ107 Applied Econometrics Topics 2-4: discussed under the classical Assumptions 1-6 (or 1-7 when normality is needed for finite-sample inference) Question: what if some of the classical assumptions
More informationstatistical sense, from the distributions of the xs. The model may now be generalized to the case of k regressors:
Wooldridge, Introductory Econometrics, d ed. Chapter 3: Multiple regression analysis: Estimation In multiple regression analysis, we extend the simple (two-variable) regression model to consider the possibility
More informationBusiness Economics BUSINESS ECONOMICS. PAPER No. : 8, FUNDAMENTALS OF ECONOMETRICS MODULE No. : 3, GAUSS MARKOV THEOREM
Subject Business Economics Paper No and Title Module No and Title Module Tag 8, Fundamentals of Econometrics 3, The gauss Markov theorem BSE_P8_M3 1 TABLE OF CONTENTS 1. INTRODUCTION 2. ASSUMPTIONS OF
More informationMultiple Regression Analysis
1 OUTLINE Basic Concept: Multiple Regression MULTICOLLINEARITY AUTOCORRELATION HETEROSCEDASTICITY REASEARCH IN FINANCE 2 BASIC CONCEPTS: Multiple Regression Y i = β 1 + β 2 X 1i + β 3 X 2i + β 4 X 3i +
More informationPanel Data. March 2, () Applied Economoetrics: Topic 6 March 2, / 43
Panel Data March 2, 212 () Applied Economoetrics: Topic March 2, 212 1 / 43 Overview Many economic applications involve panel data. Panel data has both cross-sectional and time series aspects. Regression
More informationIV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors
IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral IAE, Barcelona GSE and University of Gothenburg Gothenburg, May 2015 Roadmap Deviations from the standard
More informationHomoskedasticity. Var (u X) = σ 2. (23)
Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This
More informationHeteroscedasticity 1
Heteroscedasticity 1 Pierre Nguimkeu BUEC 333 Summer 2011 1 Based on P. Lavergne, Lectures notes Outline Pure Versus Impure Heteroscedasticity Consequences and Detection Remedies Pure Heteroscedasticity
More informationx i = 1 yi 2 = 55 with N = 30. Use the above sample information to answer all the following questions. Show explicitly all formulas and calculations.
Exercises for the course of Econometrics Introduction 1. () A researcher is using data for a sample of 30 observations to investigate the relationship between some dependent variable y i and independent
More informationProblem set 1 - Solutions
EMPIRICAL FINANCE AND FINANCIAL ECONOMETRICS - MODULE (8448) Problem set 1 - Solutions Exercise 1 -Solutions 1. The correct answer is (a). In fact, the process generating daily prices is usually assumed
More informationMultivariate Time Series
Multivariate Time Series Fall 2008 Environmental Econometrics (GR03) TSII Fall 2008 1 / 16 More on AR(1) In AR(1) model (Y t = µ + ρy t 1 + u t ) with ρ = 1, the series is said to have a unit root or a
More informationECON 497 Midterm Spring
ECON 497 Midterm Spring 2009 1 ECON 497: Economic Research and Forecasting Name: Spring 2009 Bellas Midterm You have three hours and twenty minutes to complete this exam. Answer all questions and explain
More informationLecture 4: Linear panel models
Lecture 4: Linear panel models Luc Behaghel PSE February 2009 Luc Behaghel (PSE) Lecture 4 February 2009 1 / 47 Introduction Panel = repeated observations of the same individuals (e.g., rms, workers, countries)
More informationMotivation for multiple regression
Motivation for multiple regression 1. Simple regression puts all factors other than X in u, and treats them as unobserved. Effectively the simple regression does not account for other factors. 2. The slope
More informationHypothesis testing Goodness of fit Multicollinearity Prediction. Applied Statistics. Lecturer: Serena Arima
Applied Statistics Lecturer: Serena Arima Hypothesis testing for the linear model Under the Gauss-Markov assumptions and the normality of the error terms, we saw that β N(β, σ 2 (X X ) 1 ) and hence s
More informationSTAT Checking Model Assumptions
STAT 704 --- Checking Model Assumptions Recall we assumed the following in our model: (1) The regression relationship between the response and the predictor(s) specified in the model is appropriate (2)
More informationDepartment of Economics Queen s University. ECON435/835: Development Economics Professor: Huw Lloyd-Ellis
Department of Economics Queen s University ECON435/835: Development Economics Professor: Huw Lloyd-Ellis Assignment # Answer Guide Due Date:.30 a.m., Monday October, 202. (48 percent) Let s see the extent
More informationCointegration Tests Using Instrumental Variables Estimation and the Demand for Money in England
Cointegration Tests Using Instrumental Variables Estimation and the Demand for Money in England Kyung So Im Junsoo Lee Walter Enders June 12, 2005 Abstract In this paper, we propose new cointegration tests
More informationChapter 1. GMM: Basic Concepts
Chapter 1. GMM: Basic Concepts Contents 1 Motivating Examples 1 1.1 Instrumental variable estimator....................... 1 1.2 Estimating parameters in monetary policy rules.............. 2 1.3 Estimating
More informationFinansiell Statistik, GN, 15 hp, VT2008 Lecture 15: Multiple Linear Regression & Correlation
Finansiell Statistik, GN, 5 hp, VT28 Lecture 5: Multiple Linear Regression & Correlation Gebrenegus Ghilagaber, PhD, ssociate Professor May 5, 28 Introduction In the simple linear regression Y i = + X
More informationBirkbeck Economics MSc Economics, PGCert Econometrics MSc Financial Economics Autumn 2009 ECONOMETRICS Ron Smith :
Birkbeck Economics MSc Economics, PGCert Econometrics MSc Financial Economics Autumn 2009 ECONOMETRICS Ron Smith : R.Smith@bbk.ac.uk Contents 1. Background 2. Exercises 3. Advice on Econometric projects
More informationA New Approach to Robust Inference in Cointegration
A New Approach to Robust Inference in Cointegration Sainan Jin Guanghua School of Management, Peking University Peter C. B. Phillips Cowles Foundation, Yale University, University of Auckland & University
More informationMicroeconometria Day # 5 L. Cembalo. Regressione con due variabili e ipotesi dell OLS
Microeconometria Day # 5 L. Cembalo Regressione con due variabili e ipotesi dell OLS Multiple regression model Classical hypothesis of a regression model: Assumption 1: Linear regression model.the regression
More informationREVIEW (MULTIVARIATE LINEAR REGRESSION) Explain/Obtain the LS estimator () of the vector of coe cients (b)
REVIEW (MULTIVARIATE LINEAR REGRESSION) Explain/Obtain the LS estimator () of the vector of coe cients (b) Explain/Obtain the variance-covariance matrix of Both in the bivariate case (two regressors) and
More informationSolving with Absolute Value
Solving with Absolute Value Who knew two little lines could cause so much trouble? Ask someone to solve the equation 3x 2 = 7 and they ll say No problem! Add just two little lines, and ask them to solve
More informationECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Spring 2013 Instructor: Victor Aguirregabiria
ECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Spring 2013 Instructor: Victor Aguirregabiria SOLUTION TO FINAL EXAM Friday, April 12, 2013. From 9:00-12:00 (3 hours) INSTRUCTIONS:
More informationStatistical Inference with Regression Analysis
Introductory Applied Econometrics EEP/IAS 118 Spring 2015 Steven Buck Lecture #13 Statistical Inference with Regression Analysis Next we turn to calculating confidence intervals and hypothesis testing
More informationThe Simple Linear Regression Model
The Simple Linear Regression Model Lesson 3 Ryan Safner 1 1 Department of Economics Hood College ECON 480 - Econometrics Fall 2017 Ryan Safner (Hood College) ECON 480 - Lesson 3 Fall 2017 1 / 77 Bivariate
More informationLinear Regression Models
Linear Regression Models November 13, 2018 1 / 89 1 Basic framework Model specification and assumptions Parameter estimation: least squares method Coefficient of determination R 2 Properties of the least
More informationSTA 302f16 Assignment Five 1
STA 30f16 Assignment Five 1 Except for Problem??, these problems are preparation for the quiz in tutorial on Thursday October 0th, and are not to be handed in As usual, at times you may be asked to prove
More informationLECTURE 10. Introduction to Econometrics. Multicollinearity & Heteroskedasticity
LECTURE 10 Introduction to Econometrics Multicollinearity & Heteroskedasticity November 22, 2016 1 / 23 ON PREVIOUS LECTURES We discussed the specification of a regression equation Specification consists
More informationOLS, MLE and related topics. Primer.
OLS, MLE and related topics. Primer. Katarzyna Bech Week 1 () Week 1 1 / 88 Classical Linear Regression Model (CLRM) The model: y = X β + ɛ, and the assumptions: A1 The true model is y = X β + ɛ. A2 E
More informationWISE International Masters
WISE International Masters ECONOMETRICS Instructor: Brett Graham INSTRUCTIONS TO STUDENTS 1 The time allowed for this examination paper is 2 hours. 2 This examination paper contains 32 questions. You are
More informationLeast Squares Estimation-Finite-Sample Properties
Least Squares Estimation-Finite-Sample Properties Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Finite-Sample 1 / 29 Terminology and Assumptions 1 Terminology and Assumptions
More informationEstimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.
Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.
More informationHomework Set 2, ECO 311, Fall 2014
Homework Set 2, ECO 311, Fall 2014 Due Date: At the beginning of class on October 21, 2014 Instruction: There are twelve questions. Each question is worth 2 points. You need to submit the answers of only
More informationPANEL DATA RANDOM AND FIXED EFFECTS MODEL. Professor Menelaos Karanasos. December Panel Data (Institute) PANEL DATA December / 1
PANEL DATA RANDOM AND FIXED EFFECTS MODEL Professor Menelaos Karanasos December 2011 PANEL DATA Notation y it is the value of the dependent variable for cross-section unit i at time t where i = 1,...,
More informationSolving a Series. Carmen Bruni
A Sample Series Problem Question: Does the following series converge or diverge? n=1 n 3 + 3n 2 + 1 n 5 + 14n 3 + 4n First Attempt First let s think about what this series is - maybe the terms are big
More informationTesting Linear Restrictions: cont.
Testing Linear Restrictions: cont. The F-statistic is closely connected with the R of the regression. In fact, if we are testing q linear restriction, can write the F-stastic as F = (R u R r)=q ( R u)=(n
More informationSimple Linear Regression for the MPG Data
Simple Linear Regression for the MPG Data 2000 2500 3000 3500 15 20 25 30 35 40 45 Wgt MPG What do we do with the data? y i = MPG of i th car x i = Weight of i th car i =1,...,n n = Sample Size Exploratory
More informationEmpirical Application of Simple Regression (Chapter 2)
Empirical Application of Simple Regression (Chapter 2) 1. The data file is House Data, which can be downloaded from my webpage. 2. Use stata menu File Import Excel Spreadsheet to read the data. Don t forget
More informationInstead of using all the sample observations for estimation, the suggested procedure is to divide the data set
Chow forecast test: Instead of using all the sample observations for estimation, the suggested procedure is to divide the data set of N sample observations into N 1 observations to be used for estimation
More informationLecture Notes on Measurement Error
Steve Pischke Spring 2000 Lecture Notes on Measurement Error These notes summarize a variety of simple results on measurement error which I nd useful. They also provide some references where more complete
More informationLinear Regression with Time Series Data
Econometrics 2 Linear Regression with Time Series Data Heino Bohn Nielsen 1of21 Outline (1) The linear regression model, identification and estimation. (2) Assumptions and results: (a) Consistency. (b)
More informationECON 4230 Intermediate Econometric Theory Exam
ECON 4230 Intermediate Econometric Theory Exam Multiple Choice (20 pts). Circle the best answer. 1. The Classical assumption of mean zero errors is satisfied if the regression model a) is linear in the
More informationLecture 5: Omitted Variables, Dummy Variables and Multicollinearity
Lecture 5: Omitted Variables, Dummy Variables and Multicollinearity R.G. Pierse 1 Omitted Variables Suppose that the true model is Y i β 1 + β X i + β 3 X 3i + u i, i 1,, n (1.1) where β 3 0 but that the
More informationInstrumental Variables. Ethan Kaplan
Instrumental Variables Ethan Kaplan 1 Instrumental Variables: Intro. Bias in OLS: Consider a linear model: Y = X + Suppose that then OLS yields: cov (X; ) = ^ OLS = X 0 X 1 X 0 Y = X 0 X 1 X 0 (X + ) =)
More informationRemedial Measures for Multiple Linear Regression Models
Remedial Measures for Multiple Linear Regression Models Yang Feng http://www.stat.columbia.edu/~yangfeng Yang Feng (Columbia University) Remedial Measures for Multiple Linear Regression Models 1 / 25 Outline
More informationBasic Econometrics - rewiev
Basic Econometrics - rewiev Jerzy Mycielski Model Linear equation y i = x 1i β 1 + x 2i β 2 +... + x Ki β K + ε i, dla i = 1,..., N, Elements dependent (endogenous) variable y i independent (exogenous)
More informationECNS 561 Multiple Regression Analysis
ECNS 561 Multiple Regression Analysis Model with Two Independent Variables Consider the following model Crime i = β 0 + β 1 Educ i + β 2 [what else would we like to control for?] + ε i Here, we are taking
More informationFinnancial Development and Growth
Finnancial Development and Growth Econometrics Prof. Menelaos Karanasos Brunel University December 4, 2012 (Institute Annual historical data for Brazil December 4, 2012 1 / 34 Finnancial Development and
More informationExercise sheet 3 The Multiple Regression Model
Exercise sheet 3 The Multiple Regression Model Note: In those problems that include estimations and have a reference to a data set the students should check the outputs obtained with Gretl. 1. Let the
More informationSimple Regression Model. January 24, 2011
Simple Regression Model January 24, 2011 Outline Descriptive Analysis Causal Estimation Forecasting Regression Model We are actually going to derive the linear regression model in 3 very different ways
More informationECO220Y Simple Regression: Testing the Slope
ECO220Y Simple Regression: Testing the Slope Readings: Chapter 18 (Sections 18.3-18.5) Winter 2012 Lecture 19 (Winter 2012) Simple Regression Lecture 19 1 / 32 Simple Regression Model y i = β 0 + β 1 x
More informationIris Wang.
Chapter 10: Multicollinearity Iris Wang iris.wang@kau.se Econometric problems Multicollinearity What does it mean? A high degree of correlation amongst the explanatory variables What are its consequences?
More informationSection 3: Simple Linear Regression
Section 3: Simple Linear Regression Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction
More information405 ECONOMETRICS Chapter # 11: MULTICOLLINEARITY: WHAT HAPPENS IF THE REGRESSORS ARE CORRELATED? Domodar N. Gujarati
405 ECONOMETRICS Chapter # 11: MULTICOLLINEARITY: WHAT HAPPENS IF THE REGRESSORS ARE CORRELATED? Domodar N. Gujarati Prof. M. El-Sakka Dept of Economics Kuwait University In this chapter we take a critical
More informationOrdinary Least Squares Regression Explained: Vartanian
Ordinary Least Squares Regression Explained: Vartanian When to Use Ordinary Least Squares Regression Analysis A. Variable types. When you have an interval/ratio scale dependent variable.. When your independent
More information