ECON 3150/4150, Spring term Lecture 7
|
|
- Meghan Blair
- 5 years ago
- Views:
Transcription
1 ECON 3150/4150, Spring term Lecture 7 The multivariate regression model (I) Ragnar Nymoen University of Oslo 4 February / 23
2 References to Lecture 7 and 8 SW Ch. 6 BN Kap / 23
3 Omitted variable bias I Assume that we estimate a simple regression model Y i = β 0 + β 1 X 1i + ε i (1) by OLS, but that another regression model is Y i = β 0 + β 1X 1i + β 2X 2i + ε i (2) where X 2i is a second regressor and ε i has classical properties conditional on both X 1i and X 2i, in particular: E (ε i X 1i ) = 0 i E (ε i X 2i ) = 0 i 3 / 23
4 Omitted variable bias II and E (Y i X 1i, X 2i ) = β 0 + β 1X 1i + β 2X 2i i.e., linearity of the conditional expectation function. We want to evaluate the OLS estimator ˆβ 1, of (1), in the light of (2). First, show that ˆβ 1 = β 1 + β 2 n i=1(x 1i X 1 )X 2i n i=1(x 1i X 1 ) 2 + n i=1(x 1i X 1 )ε i n i=1(x 1i X 1 ) 2 4 / 23
5 Omitted variable bias III If X 1i and X 2i have a well defined joint probability function (after Y i has been marginalized out from f (Y i, X 1i,X 2i )) we can use plim algebra (Slutsky s theorem in Lecture 2) to show that plim( ˆβ 1 ) = β 1 + β 2τ 12 (3) τ 12 = cov(x 1, X 2 ) σ 2 X 1 = ρ X1 X 2 σ X2 σ X1 (4) i.e. the population regression coefficient between X 2 and X 1! We can also show (with no extra or stronger assumptions) that: E ( ˆβ 1 ) = β 1 + β 2τ 12 (5) 5 / 23
6 Omitted variable bias IV Returning to (3) and (4): These expressions are more precise than eq. (6.1) in SW, because ρ Xu = 0 in a regression model under quite mild assumptions. The point is that although E (ε i X 1i ) = 0, there is nothing in the specification of the simple regression model that implies E (ε i X 2i ) = 0. And it is this possibility: That Y is affected by other variables than X 1, that underlies the omitted variable bias. 6 / 23
7 Omitted variable bias V In summary (assume that causality is settled from theory, to keep that issue out of the way for the time being): With simple regression we are in general not estimating the partial effect of a change in X 1 For that to be true, we must have orthogonal regressors (τ 12 = 0), or that Y is independent of X 2 (β 2 = 0). In general therefore, simple regression gives us the gross (or total ) effect on Y of a change in X 1. 7 / 23
8 Bi- and multivariate regression I In general, the theory of multiple regression covers a large number of regressors, denoted k, some of them random other deterministic. Still, a lot can be learned by studying the case of k = 2 in detail first. We follow that route, and mention the extension to the case of k > 2 at the end, without going into the matrix algebra needed for the general case. 8 / 23
9 Model specification The model can be specified by the linear relationship and the set assumptions: Y i = β 0 + β 1 X 1i + β 2 X 2i + ε i i = 1, 2,..., n (6) a. X ji (j = 1, 2), (i = 1, 2,..., n) can be deterministic or random For a deterministic variable we assume that at least two values of the variables are distinct. For random Xs, we assume var(x ji ) = σx 2 j > 0 (j = 1, 2), ρ 2 X 1 X 2 < 1 and no excess kurtosis in the distributions b. E (ε i ) = 0, i c. var (ε i ) = σ 2, i d. cov (ε i, ε j ) = 0, i = j, e. β 0, β 1 and σ 2 are constant parameters For the purpose of statistical inference for finite n: f. ε i IIN ( 0, σ 2). 9 / 23
10 Comments to specification I a. is formulated to accommodate different data types (random/deterministic, continuous/binary) ρ 2 X 1 X 2 < 1 is a way of saying that the two random variables are truly separate variables. In many presentations, you will find an assumption about absence of exact linear relationships between the variables often called absence of exact collinearity. But this can only occur for the case for deterministic variables, and would be an example of bad model specification, e.g., specifying X 2i as a variables with the number 100 as the value for all i. (An example of the dummy-variable fallacy/pit-fall ). 10 / 23
11 Comments to specification II For random variables, we can of course be unlucky and draw a sample where rx 2 1 X 2 is very high. But this near exact collinearity is a property of the sample, not of the regression model b.-d. and f. These are the same as in the case with one variable. Since we want a model formulation that allows random explanatory variables they should be interpreted as conditional on X 1i = x 1i and X 2i = x 2i. The explicit conditioning has been omitted to save notation. 11 / 23
12 OLS estimation Nothing new here: Choose the estimates that minimize S(β 0,β 1,β 2 ) = n i=1 (Y i β 0 β 1 X 1i β 2 X 2i ) 2 (7) or, equivalently, using the same type of re-specification as with simple regression S(α,β 1,β 2 ) = n i=1 (Y i α β 1 (X 1i X 1 ) β 2 (X 2i X 2 )) 2 where α = β 0 + β 1 X 1 + β 2 X 2 Rest of derivation in class 12 / 23
13 OLS estimates I By solving the 1oc for minimum of S(α,β 1,β 2 ) (or S(β 0,β 1,β 2 ), we obtain, for ˆβ 1 and ˆβ 2 : ˆβ 1 = ˆσ2 X 2 ˆσ Y,X1 ˆσ Y,X2 ˆσ X1,X 2 ˆσ 2 X 1 ˆσ 2 X 2 ˆσ 2 X 1,X 2 (8) ˆβ 2 = ˆσ2 X 1 ˆσ Y,X2 ˆσ Y,X1 ˆσ X1,X 2 ˆσ 2 X 1 ˆσ 2 X 2 ˆσ 2 X 1,X 2 (9) where ˆσ 2 X j (j = 1, 2), ˆσ Y,Xj (j = 1, 2) and ˆσ X1,X 2 are empirical variances and covariances. The estimates for the two versions of the intercepts become: ˆβ 0 = Ȳ + ˆβ 1 X 1 + ˆβ 2 X 2 ˆα = Ȳ 13 / 23
14 Absence of perfect sample collinearity I It is clear that (8) for ˆβ 1 and (9) for ˆβ 2 require M := ˆσ 2 X 1 ˆσ 2 X 2 ˆσ 2 X 1,X 2 = ˆσ 2 X 1 ˆσ 2 X 2 (1 r 2 X 1 X 2 ) > 0 Cannot have perfect empirical correlation between the two regressors. Must have: ˆσ 2 X 1 > 0, and ˆσ 2 X 2 > 0 and r 2 X 1 X 2 < 1 1 < r X1 X 2 < 1 If any one of these conditions should fail, we have exact (or perfect) collinearity. Absence of perfect collinearity is a requirement about the nature of the sample. 14 / 23
15 Absence of perfect sample collinearity II The case of r X1 X 2 = 0 also has a name. It is called perfect orthogonality. It does not create any problems in (8) or (9). In practice, the relevant case is 1 < r X1 X 2 < 1, i.e. a degree of collinearity (not perfect) 15 / 23
16 Unbiasedness Expectation I Conditional on the values of X 1 and X 2, ˆβ 1 is still a random variable because ε i and Y i are random variables. In that interpretation ˆβ 1, ˆβ 2, and ˆβ 0 are estimators and we want to know their expectation, variance, and whether they are consistent or not. Start by considering E ( ˆβ 1 X 1, X 2 ), i.e., conditional on all the values of the two regressors. 16 / 23
17 Unbiasedness Expectation II Write ˆβ 1 as ˆβ 1 = (ˆσ 2 X2 ˆσ Y,X1 ˆσ Y,X2 ˆσ X1,X 2 ) M then E ( ˆβ 1 X 1, X 2 ) becomes E ( ˆβ 1 X 1, X 2 ) = ˆσ2 X 2 M E (ˆσ Y,X 1 X 1, X 2 ) ˆσ X 1,X 2 M E (ˆσ Y,X 2 X 1, X 2 ) (10) Evaluate this in class, in order to show that E ( ˆβ j ) = E [ E ( ˆβ j X 1, X 2 ) ] = β j, j = 1, 2 (11) since E (ε i X 1, X 2 ) = 0 i is generic for the regression model. 17 / 23
18 Variance of ˆβ j Variance I Find that (under the classical assumptions of the model): var( ˆβ j X 1, X 2 ) = σ 2 n ˆσ 2 X j [ 1 r 2 X 1,X 2 ], j = 1, 2 (12) and this also holds unconditionally. The BLUE property of the OLS estimators extends to the multivariate case (will no show) The variance (12) is low in samples that are informative about the separate contributions from X 1 and X 2 : ˆσ 2 X j high r 2 X 1,X 2 low 18 / 23
19 Variance of ˆβ j Variance II var( ˆβ j ) is lowest when r 2 X 1,X 2 = 0, the regressors are orthogonal 19 / 23
20 Covariance between ˆβ 1 and ˆβ 2 Covariance I In many applications need to know cov( ˆβ 1, ˆβ 2 ). It is easiest to find by starting from the second normal equation ˆβ 1 ˆσ 2 X 1 + ˆβ 2 ˆσ X1,X 2 = ˆσ YX1 When we take (conditional) variance on both sides, we get ˆσ 4 X 1 var( ˆβ 1 ) + ˆσ 2 X 1 X 2 var( ˆβ 2 ) + 2ˆσ 2 X 1 ˆσ X1,X 2 cov ( ˆβ 1, ˆβ 2 ) = 1 n 2 var(ˆσ YX 1 ) The rhs we have from before: n 2 2 σ2 var(ˆσ YX1 ) = n n ˆσ2 X 1 = n 1 σ 2 ˆσ X / 23
21 Covariance between ˆβ 1 and ˆβ 2 Covariance II Insertion of expressions for var( ˆβ 1 ) and var( ˆβ 2 ), solving for cov ( ˆβ 1, ˆβ 2 ) gives cov ( ˆβ 1, ˆβ 2 ) = σ 2 n ˆσ X1 X 2 M Algebra details in note on the web-page. 21 / 23
22 Consistency Consistency of estimators I Show for ˆβ 1 plim ( ( ) ) ) (ˆσ 2 ˆβ 1 = plim X2 ˆσ Y,X1 ˆσ Y,X2 ˆσ X1,X 2 M = plim (ˆσ 2 X 2 ) plim(ˆσ Y,X1 ) plim(ˆσ Y,X2 ) plim(ˆσ X1,X 2 ) plim M Based on the assumptions of the regression model: plim(ˆσ 2 X j ) = σ 2 X j j = 1, 2 plim(ˆσ X1,X 2 ) = σ X1 X 2 plim M = σ 2 X 1 σ 2 X 2 σ 2 X 1,X 2 22 / 23
23 Consistency Consistency of estimators II plim(ˆσ Y,X1 ) = β 1 σ 2 X 1 + β 2 σ X1 X 2 + plim = β 1 σ 2 X 1 + β 2 σ X1 X 2 plim(ˆσ Y,X2 ) = β 1 σ X1 X 2 + β 2 σ 2 X 2 [ ] n 1 n ε i (X 1i X 1 ) i=1 plim ( ˆβ 1 ) = σ 2 X 2 [ β1 σ 2 X 1 + β 2 σ X1 X 2 ] [ β1 σ X1 X 2 + β 2 σ 2 X 2 ] σx1,x 2 σ 2 X 1 σ 2 X 2 σ 2 X 1,X 2 = β 1(σ 2 X 2 σ 2 X 1 σ 2 X 1 X 2 ) + β 2 σ 2 X 2 σ X1 X 2 β 2 σ 2 X 2 σ X1,X 2 σ 2 X 1 σ 2 X 2 σ 2 X 1,X 2 = β 1 The OLS estimators ˆβ 0 and ˆβ 2 are also consistent 23 / 23
ECON 3150/4150, Spring term Lecture 6
ECON 3150/4150, Spring term 2013. Lecture 6 Review of theoretical statistics for econometric modelling (II) Ragnar Nymoen University of Oslo 31 January 2013 1 / 25 References to Lecture 3 and 6 Lecture
More informationThe regression model with one stochastic regressor.
The regression model with one stochastic regressor. 3150/4150 Lecture 6 Ragnar Nymoen 30 January 2012 We are now on Lecture topic 4 The main goal in this lecture is to extend the results of the regression
More informationDynamic Regression Models (Lect 15)
Dynamic Regression Models (Lect 15) Ragnar Nymoen University of Oslo 21 March 2013 1 / 17 HGL: Ch 9; BN: Kap 10 The HGL Ch 9 is a long chapter, and the testing for autocorrelation part we have already
More informationECON Introductory Econometrics. Lecture 6: OLS with Multiple Regressors
ECON4150 - Introductory Econometrics Lecture 6: OLS with Multiple Regressors Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 6 Lecture outline 2 Violation of first Least Squares assumption
More informationThe multiple regression model; Indicator variables as regressors
The multiple regression model; Indicator variables as regressors Ragnar Nymoen University of Oslo 28 February 2013 1 / 21 This lecture (#12): Based on the econometric model specification from Lecture 9
More informationECON 3150/4150 spring term 2014: Exercise set for the first seminar and DIY exercises for the first few weeks of the course
ECON 3150/4150 spring term 2014: Exercise set for the first seminar and DIY exercises for the first few weeks of the course Ragnar Nymoen 13 January 2014. Exercise set to seminar 1 (week 6, 3-7 Feb) This
More informationReliability of inference (1 of 2 lectures)
Reliability of inference (1 of 2 lectures) Ragnar Nymoen University of Oslo 5 March 2013 1 / 19 This lecture (#13 and 14): I The optimality of the OLS estimators and tests depend on the assumptions of
More informationThe regression model with one fixed regressor cont d
The regression model with one fixed regressor cont d 3150/4150 Lecture 4 Ragnar Nymoen 27 January 2012 The model with transformed variables Regression with transformed variables I References HGL Ch 2.8
More informationReference: Davidson and MacKinnon Ch 2. In particular page
RNy, econ460 autumn 03 Lecture note Reference: Davidson and MacKinnon Ch. In particular page 57-8. Projection matrices The matrix M I X(X X) X () is often called the residual maker. That nickname is easy
More informationProblem Set #6: OLS. Economics 835: Econometrics. Fall 2012
Problem Set #6: OLS Economics 835: Econometrics Fall 202 A preliminary result Suppose we have a random sample of size n on the scalar random variables (x, y) with finite means, variances, and covariance.
More informationIn the bivariate regression model, the original parameterization is. Y i = β 1 + β 2 X2 + β 2 X2. + β 2 (X 2i X 2 ) + ε i (2)
RNy, econ460 autumn 04 Lecture note Orthogonalization and re-parameterization 5..3 and 7.. in HN Orthogonalization of variables, for example X i and X means that variables that are correlated are made
More informationThe linear regression model: functional form and structural breaks
The linear regression model: functional form and structural breaks Ragnar Nymoen Department of Economics, UiO 16 January 2009 Overview Dynamic models A little bit more about dynamics Extending inference
More informationLecture 6: Dynamic panel models 1
Lecture 6: Dynamic panel models 1 Ragnar Nymoen Department of Economics, UiO 16 February 2010 Main issues and references Pre-determinedness and endogeneity of lagged regressors in FE model, and RE model
More informationECON 4160, Autumn term Lecture 1
ECON 4160, Autumn term 2017. Lecture 1 a) Maximum Likelihood based inference. b) The bivariate normal model Ragnar Nymoen University of Oslo 24 August 2017 1 / 54 Principles of inference I Ordinary least
More informationThe regression model with one stochastic regressor (part II)
The regression model with one stochastic regressor (part II) 3150/4150 Lecture 7 Ragnar Nymoen 6 Feb 2012 We will finish Lecture topic 4: The regression model with stochastic regressor We will first look
More informationApplied Statistics and Econometrics
Applied Statistics and Econometrics Lecture 6 Saul Lach September 2017 Saul Lach () Applied Statistics and Econometrics September 2017 1 / 53 Outline of Lecture 6 1 Omitted variable bias (SW 6.1) 2 Multiple
More informationAnswers to Problem Set #4
Answers to Problem Set #4 Problems. Suppose that, from a sample of 63 observations, the least squares estimates and the corresponding estimated variance covariance matrix are given by: bβ bβ 2 bβ 3 = 2
More informationRegression #3: Properties of OLS Estimator
Regression #3: Properties of OLS Estimator Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #3 1 / 20 Introduction In this lecture, we establish some desirable properties associated with
More informationECON 4160, Spring term 2015 Lecture 7
ECON 4160, Spring term 2015 Lecture 7 Identification and estimation of SEMs (Part 1) Ragnar Nymoen Department of Economics 8 Oct 2015 1 / 55 HN Ch 15 References to Davidson and MacKinnon, Ch 8.1-8.5 Ch
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON3150/ECON4150 Introductory Econometrics Date of exam: Wednesday, May 15, 013 Grades are given: June 6, 013 Time for exam: :30 p.m. 5:30 p.m. The problem
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationFinal Exam. Economics 835: Econometrics. Fall 2010
Final Exam Economics 835: Econometrics Fall 2010 Please answer the question I ask - no more and no less - and remember that the correct answer is often short and simple. 1 Some short questions a) For each
More informationECON Introductory Econometrics. Lecture 4: Linear Regression with One Regressor
ECON4150 - Introductory Econometrics Lecture 4: Linear Regression with One Regressor Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 4 Lecture outline 2 The OLS estimators The effect of
More informationEconometrics I Lecture 3: The Simple Linear Regression Model
Econometrics I Lecture 3: The Simple Linear Regression Model Mohammad Vesal Graduate School of Management and Economics Sharif University of Technology 44716 Fall 1397 1 / 32 Outline Introduction Estimating
More informationECON3150/4150 Spring 2016
ECON3150/4150 Spring 2016 Lecture 6 Multiple regression model Siv-Elisabeth Skjelbred University of Oslo February 5th Last updated: February 3, 2016 1 / 49 Outline Multiple linear regression model and
More informationMultiple Linear Regression
Multiple Linear Regression Asymptotics Asymptotics Multiple Linear Regression: Assumptions Assumption MLR. (Linearity in parameters) Assumption MLR. (Random Sampling from the population) We have a random
More informationApplied Regression. Applied Regression. Chapter 2 Simple Linear Regression. Hongcheng Li. April, 6, 2013
Applied Regression Chapter 2 Simple Linear Regression Hongcheng Li April, 6, 2013 Outline 1 Introduction of simple linear regression 2 Scatter plot 3 Simple linear regression model 4 Test of Hypothesis
More informationLinear Regression. Junhui Qian. October 27, 2014
Linear Regression Junhui Qian October 27, 2014 Outline The Model Estimation Ordinary Least Square Method of Moments Maximum Likelihood Estimation Properties of OLS Estimator Unbiasedness Consistency Efficiency
More informationECON The Simple Regression Model
ECON 351 - The Simple Regression Model Maggie Jones 1 / 41 The Simple Regression Model Our starting point will be the simple regression model where we look at the relationship between two variables In
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 2 Jakub Mućk Econometrics of Panel Data Meeting # 2 1 / 26 Outline 1 Fixed effects model The Least Squares Dummy Variable Estimator The Fixed Effect (Within
More informationProblem Set - Instrumental Variables
Problem Set - Instrumental Variables 1. Consider a simple model to estimate the effect of personal computer (PC) ownership on college grade point average for graduating seniors at a large public university:
More informationSummer School in Statistics for Astronomers V June 1 - June 6, Regression. Mosuk Chow Statistics Department Penn State University.
Summer School in Statistics for Astronomers V June 1 - June 6, 2009 Regression Mosuk Chow Statistics Department Penn State University. Adapted from notes prepared by RL Karandikar Mean and variance Recall
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationEconometrics. Week 8. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague
Econometrics Week 8 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 25 Recommended Reading For the today Instrumental Variables Estimation and Two Stage
More informationHomoskedasticity. Var (u X) = σ 2. (23)
Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This
More informationChapter 2: simple regression model
Chapter 2: simple regression model Goal: understand how to estimate and more importantly interpret the simple regression Reading: chapter 2 of the textbook Advice: this chapter is foundation of econometrics.
More informationECON 4160, Lecture 11 and 12
ECON 4160, 2016. Lecture 11 and 12 Co-integration Ragnar Nymoen Department of Economics 9 November 2017 1 / 43 Introduction I So far we have considered: Stationary VAR ( no unit roots ) Standard inference
More informationMultivariate Regression Analysis
Matrices and vectors The model from the sample is: Y = Xβ +u with n individuals, l response variable, k regressors Y is a n 1 vector or a n l matrix with the notation Y T = (y 1,y 2,...,y n ) 1 x 11 x
More informationECON3150/4150 Spring 2015
ECON3150/4150 Spring 2015 Lecture 3&4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo January 29, 2015 1 / 67 Chapter 4 in S&W Section 17.1 in S&W (extended OLS assumptions) 2
More informationForecasting. Simultaneous equations bias (Lect 16)
Forecasting. Simultaneous equations bias (Lect 16) Ragnar Nymoen University of Oslo 11 April 2013 1 / 20 References Same as to Lecture 15 (as a background to the forecasting part) HGL, Ch 9.7.2 (forecasting
More informationSpecification Errors, Measurement Errors, Confounding
Specification Errors, Measurement Errors, Confounding Kerby Shedden Department of Statistics, University of Michigan October 10, 2018 1 / 32 An unobserved covariate Suppose we have a data generating model
More informationApplied Econometrics (QEM)
Applied Econometrics (QEM) based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #3 1 / 42 Outline 1 2 3 t-test P-value Linear
More informationTopic 12 Overview of Estimation
Topic 12 Overview of Estimation Classical Statistics 1 / 9 Outline Introduction Parameter Estimation Classical Statistics Densities and Likelihoods 2 / 9 Introduction In the simplest possible terms, the
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postponed exam: ECON4160 Econometrics Modeling and systems estimation Date of exam: Wednesday, January 8, 2014 Time for exam: 09:00 a.m. 12:00 noon The problem
More informationProblems. Suppose both models are fitted to the same data. Show that SS Res, A SS Res, B
Simple Linear Regression 35 Problems 1 Consider a set of data (x i, y i ), i =1, 2,,n, and the following two regression models: y i = β 0 + β 1 x i + ε, (i =1, 2,,n), Model A y i = γ 0 + γ 1 x i + γ 2
More informationChapter 12 - Lecture 2 Inferences about regression coefficient
Chapter 12 - Lecture 2 Inferences about regression coefficient April 19th, 2010 Facts about slope Test Statistic Confidence interval Hypothesis testing Test using ANOVA Table Facts about slope In previous
More informationStatistics 910, #5 1. Regression Methods
Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known
More informationGov 2000: 9. Regression with Two Independent Variables
Gov 2000: 9. Regression with Two Independent Variables Matthew Blackwell Fall 2016 1 / 62 1. Why Add Variables to a Regression? 2. Adding a Binary Covariate 3. Adding a Continuous Covariate 4. OLS Mechanics
More informationThe Simple Linear Regression Model
The Simple Linear Regression Model Lesson 3 Ryan Safner 1 1 Department of Economics Hood College ECON 480 - Econometrics Fall 2017 Ryan Safner (Hood College) ECON 480 - Lesson 3 Fall 2017 1 / 77 Bivariate
More informationSimple Linear Regression
Simple Linear Regression In simple linear regression we are concerned about the relationship between two variables, X and Y. There are two components to such a relationship. 1. The strength of the relationship.
More informationLecture 4: Heteroskedasticity
Lecture 4: Heteroskedasticity Econometric Methods Warsaw School of Economics (4) Heteroskedasticity 1 / 24 Outline 1 What is heteroskedasticity? 2 Testing for heteroskedasticity White Goldfeld-Quandt Breusch-Pagan
More informationE 31501/4150 Properties of OLS estimators (Monte Carlo Analysis)
E 31501/4150 Properties of OLS estimators (Monte Carlo Analysis) Ragnar Nymoen 10 February 2011 Repeated sampling Section 2.4.3 of the HGL book is called Repeated sampling The point is that by drawing
More informationECON3150/4150 Spring 2016
ECON3150/4150 Spring 2016 Lecture 4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo Last updated: January 26, 2016 1 / 49 Overview These lecture slides covers: The linear regression
More informationLecture 5: Omitted Variables, Dummy Variables and Multicollinearity
Lecture 5: Omitted Variables, Dummy Variables and Multicollinearity R.G. Pierse 1 Omitted Variables Suppose that the true model is Y i β 1 + β X i + β 3 X 3i + u i, i 1,, n (1.1) where β 3 0 but that the
More informationE 4160 Autumn term Lecture 9: Deterministic trends vs integrated series; Spurious regression; Dickey-Fuller distribution and test
E 4160 Autumn term 2016. Lecture 9: Deterministic trends vs integrated series; Spurious regression; Dickey-Fuller distribution and test Ragnar Nymoen Department of Economics, University of Oslo 24 October
More informationRecitation 1: Regression Review. Christina Patterson
Recitation 1: Regression Review Christina Patterson Outline For Recitation 1. Statistics. Bias, sampling variance and hypothesis testing.. Two important statistical theorems: Law of large numbers (LLN)
More informationBusiness Statistics. Tommaso Proietti. Linear Regression. DEF - Università di Roma 'Tor Vergata'
Business Statistics Tommaso Proietti DEF - Università di Roma 'Tor Vergata' Linear Regression Specication Let Y be a univariate quantitative response variable. We model Y as follows: Y = f(x) + ε where
More informationIntroductory Econometrics
Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 17, 2012 Outline Heteroskedasticity
More informationThe Multiple Regression Model Estimation
Lesson 5 The Multiple Regression Model Estimation Pilar González and Susan Orbe Dpt Applied Econometrics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Lesson 5 Regression model:
More informationCovariance and Correlation
Covariance and Correlation ST 370 The probability distribution of a random variable gives complete information about its behavior, but its mean and variance are useful summaries. Similarly, the joint probability
More informationLecture 13. Simple Linear Regression
1 / 27 Lecture 13 Simple Linear Regression October 28, 2010 2 / 27 Lesson Plan 1. Ordinary Least Squares 2. Interpretation 3 / 27 Motivation Suppose we want to approximate the value of Y with a linear
More informationApplied Econometrics (QEM)
Applied Econometrics (QEM) The Simple Linear Regression Model based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #2 The Simple
More informationLecture 9: Panel Data Model (Chapter 14, Wooldridge Textbook)
Lecture 9: Panel Data Model (Chapter 14, Wooldridge Textbook) 1 2 Panel Data Panel data is obtained by observing the same person, firm, county, etc over several periods. Unlike the pooled cross sections,
More informationReview of Classical Least Squares. James L. Powell Department of Economics University of California, Berkeley
Review of Classical Least Squares James L. Powell Department of Economics University of California, Berkeley The Classical Linear Model The object of least squares regression methods is to model and estimate
More informationEconometrics Problem Set 4
Econometrics Problem Set 4 WISE, Xiamen University Spring 2016-17 Conceptual Questions 1. This question refers to the estimated regressions in shown in Table 1 computed using data for 1988 from the CPS.
More informationThe Simple Regression Model. Part II. The Simple Regression Model
Part II The Simple Regression Model As of Sep 22, 2015 Definition 1 The Simple Regression Model Definition Estimation of the model, OLS OLS Statistics Algebraic properties Goodness-of-Fit, the R-square
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 6 Jakub Mućk Econometrics of Panel Data Meeting # 6 1 / 36 Outline 1 The First-Difference (FD) estimator 2 Dynamic panel data models 3 The Anderson and Hsiao
More informationIntermediate Econometrics
Intermediate Econometrics Markus Haas LMU München Summer term 2011 15. Mai 2011 The Simple Linear Regression Model Considering variables x and y in a specific population (e.g., years of education and wage
More informationReview of Econometrics
Review of Econometrics Zheng Tian June 5th, 2017 1 The Essence of the OLS Estimation Multiple regression model involves the models as follows Y i = β 0 + β 1 X 1i + β 2 X 2i + + β k X ki + u i, i = 1,...,
More informationE 4101/5101 Lecture 9: Non-stationarity
E 4101/5101 Lecture 9: Non-stationarity Ragnar Nymoen 30 March 2011 Introduction I Main references: Hamilton Ch 15,16 and 17. Davidson and MacKinnon Ch 14.3 and 14.4 Also read Ch 2.4 and Ch 2.5 in Davidson
More informationLecture 1: OLS derivations and inference
Lecture 1: OLS derivations and inference Econometric Methods Warsaw School of Economics (1) OLS 1 / 43 Outline 1 Introduction Course information Econometrics: a reminder Preliminary data exploration 2
More informationContest Quiz 3. Question Sheet. In this quiz we will review concepts of linear regression covered in lecture 2.
Updated: November 17, 2011 Lecturer: Thilo Klein Contact: tk375@cam.ac.uk Contest Quiz 3 Question Sheet In this quiz we will review concepts of linear regression covered in lecture 2. NOTE: Please round
More informationInstrumental Variables
Università di Pavia 2010 Instrumental Variables Eduardo Rossi Exogeneity Exogeneity Assumption: the explanatory variables which form the columns of X are exogenous. It implies that any randomness in the
More informationLECTURE 10. Introduction to Econometrics. Multicollinearity & Heteroskedasticity
LECTURE 10 Introduction to Econometrics Multicollinearity & Heteroskedasticity November 22, 2016 1 / 23 ON PREVIOUS LECTURES We discussed the specification of a regression equation Specification consists
More informationRegression diagnostics
Regression diagnostics Kerby Shedden Department of Statistics, University of Michigan November 5, 018 1 / 6 Motivation When working with a linear model with design matrix X, the conventional linear model
More informationIntroductory Econometrics
Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna November 23, 2013 Outline Introduction
More informationECON 4160, Autumn term 2017 Lecture 9
ECON 4160, Autumn term 2017 Lecture 9 Structural VAR (SVAR) Ragnar Nymoen Department of Economics 26 Oct 2017 1 / 14 Parameter of interest: impulse responses I Consider again a partial market equilibrium
More informationLecture 14 Simple Linear Regression
Lecture 4 Simple Linear Regression Ordinary Least Squares (OLS) Consider the following simple linear regression model where, for each unit i, Y i is the dependent variable (response). X i is the independent
More informationECON 4160: Econometrics-Modelling and Systems Estimation Lecture 9: Multiple equation models II
ECON 4160: Econometrics-Modelling and Systems Estimation Lecture 9: Multiple equation models II Ragnar Nymoen Department of Economics University of Oslo 9 October 2018 The reference to this lecture is:
More informationThe Slow Convergence of OLS Estimators of α, β and Portfolio. β and Portfolio Weights under Long Memory Stochastic Volatility
The Slow Convergence of OLS Estimators of α, β and Portfolio Weights under Long Memory Stochastic Volatility New York University Stern School of Business June 21, 2018 Introduction Bivariate long memory
More informationTMA4255 Applied Statistics V2016 (5)
TMA4255 Applied Statistics V2016 (5) Part 2: Regression Simple linear regression [11.1-11.4] Sum of squares [11.5] Anna Marie Holand To be lectured: January 26, 2016 wiki.math.ntnu.no/tma4255/2016v/start
More informationECON 4160: Econometrics-Modelling and Systems Estimation Lecture 7: Single equation models
ECON 4160: Econometrics-Modelling and Systems Estimation Lecture 7: Single equation models Ragnar Nymoen Department of Economics University of Oslo 25 September 2018 The reference to this lecture is: Chapter
More informationRewrap ECON November 18, () Rewrap ECON 4135 November 18, / 35
Rewrap ECON 4135 November 18, 2011 () Rewrap ECON 4135 November 18, 2011 1 / 35 What should you now know? 1 What is econometrics? 2 Fundamental regression analysis 1 Bivariate regression 2 Multivariate
More informationEC3062 ECONOMETRICS. THE MULTIPLE REGRESSION MODEL Consider T realisations of the regression equation. (1) y = β 0 + β 1 x β k x k + ε,
THE MULTIPLE REGRESSION MODEL Consider T realisations of the regression equation (1) y = β 0 + β 1 x 1 + + β k x k + ε, which can be written in the following form: (2) y 1 y 2.. y T = 1 x 11... x 1k 1
More informationEcon 582 Fixed Effects Estimation of Panel Data
Econ 582 Fixed Effects Estimation of Panel Data Eric Zivot May 28, 2012 Panel Data Framework = x 0 β + = 1 (individuals); =1 (time periods) y 1 = X β ( ) ( 1) + ε Main question: Is x uncorrelated with?
More informationFENG CHIA UNIVERSITY ECONOMETRICS I: HOMEWORK 4. Prof. Mei-Yuan Chen Spring 2008
FENG CHIA UNIVERSITY ECONOMETRICS I: HOMEWORK 4 Prof. Mei-Yuan Chen Spring 008. Partition and rearrange the matrix X as [x i X i ]. That is, X i is the matrix X excluding the column x i. Let u i denote
More informationEconometrics. 7) Endogeneity
30C00200 Econometrics 7) Endogeneity Timo Kuosmanen Professor, Ph.D. http://nomepre.net/index.php/timokuosmanen Today s topics Common types of endogeneity Simultaneity Omitted variables Measurement errors
More information1. Stochastic Processes and Stationarity
Massachusetts Institute of Technology Department of Economics Time Series 14.384 Guido Kuersteiner Lecture Note 1 - Introduction This course provides the basic tools needed to analyze data that is observed
More informationEmpirical Application of Simple Regression (Chapter 2)
Empirical Application of Simple Regression (Chapter 2) 1. The data file is House Data, which can be downloaded from my webpage. 2. Use stata menu File Import Excel Spreadsheet to read the data. Don t forget
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationMultivariate Random Variable
Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate
More informationRegression #4: Properties of OLS Estimator (Part 2)
Regression #4: Properties of OLS Estimator (Part 2) Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #4 1 / 24 Introduction In this lecture, we continue investigating properties associated
More informationAGEC 661 Note Fourteen
AGEC 661 Note Fourteen Ximing Wu 1 Selection bias 1.1 Heckman s two-step model Consider the model in Heckman (1979) Y i = X iβ + ε i, D i = I {Z iγ + η i > 0}. For a random sample from the population,
More informationEconometrics Problem Set 11
Econometrics Problem Set WISE, Xiamen University Spring 207 Conceptual Questions. (SW 2.) This question refers to the panel data regressions summarized in the following table: Dependent variable: ln(q
More informationSimple Linear Regression: The Model
Simple Linear Regression: The Model task: quantifying the effect of change X in X on Y, with some constant β 1 : Y = β 1 X, linear relationship between X and Y, however, relationship subject to a random
More informationMotivation for multiple regression
Motivation for multiple regression 1. Simple regression puts all factors other than X in u, and treats them as unobserved. Effectively the simple regression does not account for other factors. 2. The slope
More informationECON 4160, Spring term Lecture 12
ECON 4160, Spring term 2013. Lecture 12 Non-stationarity and co-integration 2/2 Ragnar Nymoen Department of Economics 13 Nov 2013 1 / 53 Introduction I So far we have considered: Stationary VAR, with deterministic
More informationLinear models. Linear models are computationally convenient and remain widely used in. applied econometric research
Linear models Linear models are computationally convenient and remain widely used in applied econometric research Our main focus in these lectures will be on single equation linear models of the form y
More informationEconometrics Review questions for exam
Econometrics Review questions for exam Nathaniel Higgins nhiggins@jhu.edu, 1. Suppose you have a model: y = β 0 x 1 + u You propose the model above and then estimate the model using OLS to obtain: ŷ =
More information