INTRODUCTORY ECONOMETRICS
|
|
- Kellie Fox
- 5 years ago
- Views:
Transcription
1 INTRODUCTORY ECONOMETRICS Lesson 2b Dr Javier Fernández Dpt. of Econometrics & Statistics UPV EHU c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 1/192
2 GLRM: the PRF Recall: model with K explanatory variables: Y t = β 0 + β 1 X 1t + + β K X Kt + u t, Y = Xβ + u (2) 2.3b OLS in the GLRM. is called GLRM. Population Regression Function (PRF): E(u)=0 systematic part or PRF: E(Y t )=β 0 + β 1 X 1t + + β K X Kt E(Y )=Xβ Interpretation of the coefficients: β 0 = E(Y t X 1t = X 2t = = X Kt = 0): Expected value of Y t when all explanatory variables are equal to zero. β k = E(Y t) ΔE(Y t), k = 1...K: Increase in (expected) value Y t when X kt ΔX kt X k one unit (c.p.). c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 61/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 62/192 The Sample Regression Function (SRF) Objective of GLRM: To obtain estimator β =( β 0, β 1..., β K ) of unknown parameter vector in (2). β estimated model, fit or SRF: Notes: Disturbances in PRF: Residuals in SRF: Ŷ t = β 0 + β 1 X 1t + + β K X Kt Ŷ = X β u t = Y t E(Y t )=Y t β 0 β 1 X 1t β K X Kt u = Y E(Y )=Y Xβ û t = Y t Ŷ t = Y t β 0 β 1 X 1t β K X Kt û = Y Ŷ = Y X β Estimation: OLS apply Least-Squares fit to GLRM: Y = Xβ + u, either in observation form: or [ in matrix form: recall: min T β 0...β K t=1 u 2 t where u t = Y t β 0 β 1 X 1t β K X Kt u = ( u 1,u 2,...,u T ) so u u = u u u2 T = T t=1 u2 t that is min β ] u 1 u 2 u =... u T u u where u = Y Xβ Residuals are to the SRF what disturbances are to the PRF. c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 63/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 64/192
3 Note: vector derivatives 1st.o.c. in matrix form Let u = u(β): derivs of cu and cu 2 with respect to β : u (cu)=c c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 65/192 and With vectors and matrices this is quite similar: The derivative of the linear combination with respect to u c (1 n) (n 1) β is: (u c) = u c (k 1) The derivative of the sum of squares u u (1 n) (n 1) u c u2 = 2u u ( = n i=1 c iu i, i.e. scalar!!) u u with respect to β is: (u u) (k 1) ( = n i=1 u2 i, i.e. scalar!!) = 2 u u min u) where u = Y Xβ β First derivatives of SS u u with respect to β : in the minimum: u u = 2 u u = 2 (Y β X ) u = 2X u 1st.o.c.: X (K+1 T) (T 1) c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 66/192 û = 0 K+1 Estimation: Normal equations & LSE of β Estimation: LSE of β (cont) Solving the 1st.o.c. we obtain the normal equations: X (Y X β)=0 X Y = X X β (K+1 1) (K+1 K+1) (K+1 1) (3) where X X is a [K+1 K+1] matrix: X X (K+1 K+1) [recall X & Y? ] T X 1t X 2t... X Kt X 1t X1t 2 X 1t X 2t... X 1t X Kt =... X Kt X Kt X 1t X Kt X 2t... X 2 Kt Whence premultiplying by (X X) 1 we obtain the OLS estimator: β OLS =(X X) 1 X Y and X Y and β are [K+1 1] vectors: X Y (K+1 1) = Y t X 1t Y t... X Kt Y t β (K+1 1) β 0 β 1 =... β K c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 67/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 68/192
4 OLS estimator with centred (demeaned) data An alternative way to obtain the OLS estimator is β OLS =(x x) 1 x y for the model coefficients. 2.4b Properties of the SRF....together with the estimated intercept obtained from the first normal equation β 0 = Y β 1 X 1 β K X K Note: special case with K = 1 identical formulae as in SLRM!! (Prove it!!) c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 69/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 70/192 Properties of residuals and SRF (1) β β β 0 1. residuals add up to zero: û t = 0 Demo: directly from 1st.o.c.: 2. Ŷ = Y } X û = 0 Ŷ = X β û = Y Ŷ T 1 ût T 1 X 1tû t T 1 X 2tû t... T 1 X Ktû t = 3. the SRF passes thru vector (X 1,...X K,Y ): Y = β 0 + β 1 X β K X K Properties of residuals and SRF (2) 4. residuals orthogonal to explanatory v.: X û = 0 Demo: directly from 1st.o.c. (see 1) or, alternatively: X û = X (Y X β)=x Y X X β = X Y X X(X X) 1 X Y = 0 }{{} =I K+1 5. residuals orthogonal to explained part of Y : Ŷ û = 0 Demo: Ŷ û =(X β) û = β }{{} X û = 0 =0 Note: These properties 1 thru 3 are fulfilled if the regression has an intercept; that is, if X has a column of ones. c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 71/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 72/192
5 Goodness of fit: R 2 Revisited Recall (same as before but now we ll do it with vectors): Y Y =(Ŷ + û )(Ŷ + û) 2.5b Goodness of Fit: Coefficient of Determination (R 2 ) & Estimation of the Error Variance. = Ŷ Ŷ + û û + 2Ŷ û = Ŷ Ŷ + û û (from prop 5) Y Y TY 2 = Ŷ Ŷ TŶ 2 + û û (from prop 2) y y ( TSS) = ŷ ŷ ( ESS) + u u ( RSS) R 2 = ESS TSS = 1 RSS TSS 0 R 2 1 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 73/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 74/192 Goodness of fit: R 2 Revisited (cont) Note 1: R 2 measures the proportion of the dependent variable variation explained by the variation of (a linear combination of) the explanatory variables. Note 2: { û t 0, 1st row of 1st.o.c. no intercept Ŷ Y, not validr 2 (Remember!) c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 75/192 Estimation of Var(u t ) σ 2 = Var ( u t ) = E ( u 2 t ) 1 T T t=1 but with residuals, they must satisfy K+1 linear relationships in X û = 0 so we loose K+1 degrees of freedom: σ 2 1 = T K 1 Therefore we propose the following estimator: σ 2 = T ût 2 t=1 RSS T K 1 which clearly is an unbiased estimator: Demo: E ( σ 2) = E( RSS ) ( ) = T K 1 T K 1 T K 1 = σ 2 ( see textbook) c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 76/192 u 2 t
6 Properties of the OLS Estimator (1) The estimator β OLS =(X X) 1 X Y has the following properties: Linear: β OLS is a linear combination of disturbances: β =(X X) 1 X (Xβ + u) 2.6 Finite-sample Properties of the Least-Squares Estimator. The Gauss-Markov Theorem. = (X X) 1 X Xβ +(X X) 1 X u = β +(X X) 1 X u = β + Γ u Unbiased: Since E ( u ) = 0, β OLS is unbiased: E ( β) ( = E β + Γ u ) = β + Γ E ( u ) = β c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 77/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 78/192 Properties of the OLS Estimator (2) Properties of the OLS Estimator (2cont) Variance: Recall: Var ( u ) = σ 2 I T, β = β +(X X) 1 X u, Var ( β) ( = E ( β β)( β β) ) = E ( (X X) 1 X uu X(X X) 1) =(X X) 1 X E ( uu ) X(X X) 1 =(X X) 1 X σ 2 I T X(X X) 1 = σ 2 (X X) 1 X X(X X) 1 Var ( β0 ) Cov ( β0, β ) 1... Cov ( β0, β ) K Var ( β) Cov ( β1, β ) 0 Var ( β1 )... Cov ( β1, β ) K =... Cov ( βk, β ) 0 Cov ( βk, β ) 1... Var ( βk ) a 00 a 00 a a 0K a 10 a 11 a a 1K σ 2 (X X) 1 = σ 2 a 20 a 21 a a 2K... a K0 a K1 a K2... a KK i.e. a kk is the (k + 1,k + 1)-element of matrix (X X) 1 : Var ( β) = σ 2 (X X) 1 Var ( βk ) = σ 2 a kk Cov ( βk, β i ) = σ 2 a ki c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 79/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 80/192
7 The Gauss-Markov Theorem Given the basic assumptions of GLRM, the OLS estimator is that of minimum variance (best) among all the linear and unbiased estimators Demo: β OLS =BLUE = B est L inear U nbiased E stimator Let β be some other linear and unbiased estimator: β =D Y = D (Xβ + u)=d Xβ + D u E ( β) =D Xβ + D E ( u ) = D Xβ = β D X = I K then β = β + D u β β = D u and its variance: Var ( β) [ = E ( β β)( β β) ] = E ( D uu D ) The Gauss-Markov Theorem (cont)...the difference between both covariance matrices is a positive definite matrix: Var ( β) Var ( β) = σ 2 D D σ 2 (X X) 1 = σ 2 [ D D (X X) 1] = σ 2 [ D D D X (X X) 1 X D ] = σ 2 D [ I T X (X X) 1 X ] D }{{} M = σ 2 D (MM)D = σ 2 (D M)(M D)=D D > 0 I.e. in particular all individual variances will be bigger than their OLS counterpart. = D E ( uu ) D = D σ 2 I T D = σ 2 D D c J Fernández (EA3-UPV/EHU), February... 21, 2009 c J Introductory Econometrics - p. 81/192 Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 82/192 Useful expressions for SS 2.3c OLS: Useful expressions & Timeline. TSS= (Y t Y ) 2 = Y 2 t TY 2 = Y Y TY 2 ESS = (Ŷ t Ŷ ) 2 = Ŷ t 2 TŶ 2 = Ŷ t 2 TY 2 = Ŷ Ŷ TY 2 =(X β) (X β) TY 2 = β X X }{{} β TY 2 = β X Y TY 2 X Y RSS = ût 2 = û û = Yt 2 Ŷ t 2 = Y Y β X Y c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 83/192 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 84/192
8 c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 85/192 Main expressions & Timeline Y = Xβ + u (X X) 1 X Y β =(X X) 1 X Y ESS = β X Y TY 2 (needs Y!) TSS= Y Y TY 2 RSS = Y Y β X Y (no Y!) R 2 = ESS TSS = 1 RSS TSS σ 2 = RSS T K 1 Var ( β) = σ 2 (X X) 1
Quantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017
Summary of Part II Key Concepts & Formulas Christopher Ting November 11, 2017 christopherting@smu.edu.sg http://www.mysmu.edu/faculty/christophert/ Christopher Ting 1 of 16 Why Regression Analysis? Understand
More informationMultivariate Regression Analysis
Matrices and vectors The model from the sample is: Y = Xβ +u with n individuals, l response variable, k regressors Y is a n 1 vector or a n l matrix with the notation Y T = (y 1,y 2,...,y n ) 1 x 11 x
More informationThe Multiple Regression Model Estimation
Lesson 5 The Multiple Regression Model Estimation Pilar González and Susan Orbe Dpt Applied Econometrics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Lesson 5 Regression model:
More informationSimple Linear Regression: The Model
Simple Linear Regression: The Model task: quantifying the effect of change X in X on Y, with some constant β 1 : Y = β 1 X, linear relationship between X and Y, however, relationship subject to a random
More informationTwo-Variable Regression Model: The Problem of Estimation
Two-Variable Regression Model: The Problem of Estimation Introducing the Ordinary Least Squares Estimator Jamie Monogan University of Georgia Intermediate Political Methodology Jamie Monogan (UGA) Two-Variable
More informationLinear Regression. In this problem sheet, we consider the problem of linear regression with p predictors and one intercept,
Linear Regression In this problem sheet, we consider the problem of linear regression with p predictors and one intercept, y = Xβ + ɛ, where y t = (y 1,..., y n ) is the column vector of target values,
More informationThe Statistical Property of Ordinary Least Squares
The Statistical Property of Ordinary Least Squares The linear equation, on which we apply the OLS is y t = X t β + u t Then, as we have derived, the OLS estimator is ˆβ = [ X T X] 1 X T y Then, substituting
More informationLinear models. Linear models are computationally convenient and remain widely used in. applied econometric research
Linear models Linear models are computationally convenient and remain widely used in applied econometric research Our main focus in these lectures will be on single equation linear models of the form y
More informationIn order to carry out a study on employees wages, a company collects information from its 500 employees 1 as follows:
INTRODUCTORY ECONOMETRICS Dpt of Econometrics & Statistics (EA3) University of the Basque Country UPV/EHU OCW Self Evaluation answers Time: 21/2 hours SURNAME: NAME: ID#: Specific competences to be evaluated
More informationECON The Simple Regression Model
ECON 351 - The Simple Regression Model Maggie Jones 1 / 41 The Simple Regression Model Our starting point will be the simple regression model where we look at the relationship between two variables In
More informationLecture 3: Multiple Regression
Lecture 3: Multiple Regression R.G. Pierse 1 The General Linear Model Suppose that we have k explanatory variables Y i = β 1 + β X i + β 3 X 3i + + β k X ki + u i, i = 1,, n (1.1) or Y i = β j X ji + u
More informationHomoskedasticity. Var (u X) = σ 2. (23)
Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This
More informationIntroduction to Estimation Methods for Time Series models. Lecture 1
Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation
More informationBasic Econometrics - rewiev
Basic Econometrics - rewiev Jerzy Mycielski Model Linear equation y i = x 1i β 1 + x 2i β 2 +... + x Ki β K + ε i, dla i = 1,..., N, Elements dependent (endogenous) variable y i independent (exogenous)
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationLesson 17: Vector AutoRegressive Models
Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Vector AutoRegressive models The extension of ARMA models into a multivariate framework
More informationEconometric Methods. Prediction / Violation of A-Assumptions. Burcu Erdogan. Universität Trier WS 2011/2012
Econometric Methods Prediction / Violation of A-Assumptions Burcu Erdogan Universität Trier WS 2011/2012 (Universität Trier) Econometric Methods 30.11.2011 1 / 42 Moving on to... 1 Prediction 2 Violation
More informationProperties of the least squares estimates
Properties of the least squares estimates 2019-01-18 Warmup Let a and b be scalar constants, and X be a scalar random variable. Fill in the blanks E ax + b) = Var ax + b) = Goal Recall that the least squares
More informationHeteroskedasticity and Autocorrelation
Lesson 7 Heteroskedasticity and Autocorrelation Pilar González and Susan Orbe Dpt. Applied Economics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Lesson 7. Heteroskedasticity
More informationThe Simple Regression Model. Simple Regression Model 1
The Simple Regression Model Simple Regression Model 1 Simple regression model: Objectives Given the model: - where y is earnings and x years of education - Or y is sales and x is spending in advertising
More informationIn the bivariate regression model, the original parameterization is. Y i = β 1 + β 2 X2 + β 2 X2. + β 2 (X 2i X 2 ) + ε i (2)
RNy, econ460 autumn 04 Lecture note Orthogonalization and re-parameterization 5..3 and 7.. in HN Orthogonalization of variables, for example X i and X means that variables that are correlated are made
More informationMultiple Regression Analysis
Chapter 4 Multiple Regression Analysis The simple linear regression covered in Chapter 2 can be generalized to include more than one variable. Multiple regression analysis is an extension of the simple
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More informationReference: Davidson and MacKinnon Ch 2. In particular page
RNy, econ460 autumn 03 Lecture note Reference: Davidson and MacKinnon Ch. In particular page 57-8. Projection matrices The matrix M I X(X X) X () is often called the residual maker. That nickname is easy
More informationEconometrics A. Simple linear model (2) Keio University, Faculty of Economics. Simon Clinet (Keio University) Econometrics A October 16, / 11
Econometrics A Keio University, Faculty of Economics Simple linear model (2) Simon Clinet (Keio University) Econometrics A October 16, 2018 1 / 11 Estimation of the noise variance σ 2 In practice σ 2 too
More informationIntroductory Econometrics
Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 11, 2012 Outline Heteroskedasticity
More informationMultiple Linear Regression
Multiple Linear Regression Asymptotics Asymptotics Multiple Linear Regression: Assumptions Assumption MLR. (Linearity in parameters) Assumption MLR. (Random Sampling from the population) We have a random
More informationLinear Regression with 1 Regressor. Introduction to Econometrics Spring 2012 Ken Simons
Linear Regression with 1 Regressor Introduction to Econometrics Spring 2012 Ken Simons Linear Regression with 1 Regressor 1. The regression equation 2. Estimating the equation 3. Assumptions required for
More informationEcon 620. Matrix Differentiation. Let a and x are (k 1) vectors and A is an (k k) matrix. ) x. (a x) = a. x = a (x Ax) =(A + A (x Ax) x x =(A + A )
Econ 60 Matrix Differentiation Let a and x are k vectors and A is an k k matrix. a x a x = a = a x Ax =A + A x Ax x =A + A x Ax = xx A We don t want to prove the claim rigorously. But a x = k a i x i i=
More informationReview of Econometrics
Review of Econometrics Zheng Tian June 5th, 2017 1 The Essence of the OLS Estimation Multiple regression model involves the models as follows Y i = β 0 + β 1 X 1i + β 2 X 2i + + β k X ki + u i, i = 1,...,
More informationL2: Two-variable regression model
L2: Two-variable regression model Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Revision: September 4, 2014 What we have learned last time...
More informationEconometrics I Lecture 3: The Simple Linear Regression Model
Econometrics I Lecture 3: The Simple Linear Regression Model Mohammad Vesal Graduate School of Management and Economics Sharif University of Technology 44716 Fall 1397 1 / 32 Outline Introduction Estimating
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationFinancial Econometrics
Material : solution Class : Teacher(s) : zacharias psaradakis, marian vavra Example 1.1: Consider the linear regression model y Xβ + u, (1) where y is a (n 1) vector of observations on the dependent variable,
More informationMultiple Regression Analysis
Multiple Regression Analysis y = 0 + 1 x 1 + x +... k x k + u 6. Heteroskedasticity What is Heteroskedasticity?! Recall the assumption of homoskedasticity implied that conditional on the explanatory variables,
More informationECON3150/4150 Spring 2015
ECON3150/4150 Spring 2015 Lecture 3&4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo January 29, 2015 1 / 67 Chapter 4 in S&W Section 17.1 in S&W (extended OLS assumptions) 2
More informationMa 3/103: Lecture 24 Linear Regression I: Estimation
Ma 3/103: Lecture 24 Linear Regression I: Estimation March 3, 2017 KC Border Linear Regression I March 3, 2017 1 / 32 Regression analysis Regression analysis Estimate and test E(Y X) = f (X). f is the
More informationChapter 2: simple regression model
Chapter 2: simple regression model Goal: understand how to estimate and more importantly interpret the simple regression Reading: chapter 2 of the textbook Advice: this chapter is foundation of econometrics.
More informationMaking sense of Econometrics: Basics
Making sense of Econometrics: Basics Lecture 2: Simple Regression Egypt Scholars Economic Society Happy Eid Eid present! enter classroom at http://b.socrative.com/login/student/ room name c28efb78 Outline
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 3 Jakub Mućk Econometrics of Panel Data Meeting # 3 1 / 21 Outline 1 Fixed or Random Hausman Test 2 Between Estimator 3 Coefficient of determination (R 2
More informationBusiness Economics BUSINESS ECONOMICS. PAPER No. : 8, FUNDAMENTALS OF ECONOMETRICS MODULE No. : 3, GAUSS MARKOV THEOREM
Subject Business Economics Paper No and Title Module No and Title Module Tag 8, Fundamentals of Econometrics 3, The gauss Markov theorem BSE_P8_M3 1 TABLE OF CONTENTS 1. INTRODUCTION 2. ASSUMPTIONS OF
More informationMBF1923 Econometrics Prepared by Dr Khairul Anuar
MBF1923 Econometrics Prepared by Dr Khairul Anuar L4 Ordinary Least Squares www.notes638.wordpress.com Ordinary Least Squares The bread and butter of regression analysis is the estimation of the coefficient
More information1. The Multivariate Classical Linear Regression Model
Business School, Brunel University MSc. EC550/5509 Modelling Financial Decisions and Markets/Introduction to Quantitative Methods Prof. Menelaos Karanasos (Room SS69, Tel. 08956584) Lecture Notes 5. The
More informationLeast Squares Estimation-Finite-Sample Properties
Least Squares Estimation-Finite-Sample Properties Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Finite-Sample 1 / 29 Terminology and Assumptions 1 Terminology and Assumptions
More informationIntermediate Econometrics
Intermediate Econometrics Heteroskedasticity Text: Wooldridge, 8 July 17, 2011 Heteroskedasticity Assumption of homoskedasticity, Var(u i x i1,..., x ik ) = E(u 2 i x i1,..., x ik ) = σ 2. That is, the
More informationEconometrics Multiple Regression Analysis: Heteroskedasticity
Econometrics Multiple Regression Analysis: João Valle e Azevedo Faculdade de Economia Universidade Nova de Lisboa Spring Semester João Valle e Azevedo (FEUNL) Econometrics Lisbon, April 2011 1 / 19 Properties
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 2 Jakub Mućk Econometrics of Panel Data Meeting # 2 1 / 26 Outline 1 Fixed effects model The Least Squares Dummy Variable Estimator The Fixed Effect (Within
More informationMA 575 Linear Models: Cedric E. Ginestet, Boston University Midterm Review Week 7
MA 575 Linear Models: Cedric E. Ginestet, Boston University Midterm Review Week 7 1 Random Vectors Let a 0 and y be n 1 vectors, and let A be an n n matrix. Here, a 0 and A are non-random, whereas y is
More informationRegression Models - Introduction
Regression Models - Introduction In regression models, two types of variables that are studied: A dependent variable, Y, also called response variable. It is modeled as random. An independent variable,
More informationF3: Classical normal linear rgression model distribution, interval estimation and hypothesis testing
F3: Classical normal linear rgression model distribution, interval estimation and hypothesis testing Feng Li Department of Statistics, Stockholm University What we have learned last time... 1 Estimating
More informationFIRST MIDTERM EXAM ECON 7801 SPRING 2001
FIRST MIDTERM EXAM ECON 780 SPRING 200 ECONOMICS DEPARTMENT, UNIVERSITY OF UTAH Problem 2 points Let y be a n-vector (It may be a vector of observations of a random variable y, but it does not matter how
More informationF9 F10: Autocorrelation
F9 F10: Autocorrelation Feng Li Department of Statistics, Stockholm University Introduction In the classic regression model we assume cov(u i, u j x i, x k ) = E(u i, u j ) = 0 What if we break the assumption?
More informationAnalisi Statistica per le Imprese
, Analisi Statistica per le Imprese Dip. di Economia Politica e Statistica 4.3. 1 / 33 You should be able to:, Underst model building using multiple regression analysis Apply multiple regression analysis
More informationREVIEW (MULTIVARIATE LINEAR REGRESSION) Explain/Obtain the LS estimator () of the vector of coe cients (b)
REVIEW (MULTIVARIATE LINEAR REGRESSION) Explain/Obtain the LS estimator () of the vector of coe cients (b) Explain/Obtain the variance-covariance matrix of Both in the bivariate case (two regressors) and
More informationHOW IS GENERALIZED LEAST SQUARES RELATED TO WITHIN AND BETWEEN ESTIMATORS IN UNBALANCED PANEL DATA?
HOW IS GENERALIZED LEAST SQUARES RELATED TO WITHIN AND BETWEEN ESTIMATORS IN UNBALANCED PANEL DATA? ERIK BIØRN Department of Economics University of Oslo P.O. Box 1095 Blindern 0317 Oslo Norway E-mail:
More informationFENG CHIA UNIVERSITY ECONOMETRICS I: HOMEWORK 4. Prof. Mei-Yuan Chen Spring 2008
FENG CHIA UNIVERSITY ECONOMETRICS I: HOMEWORK 4 Prof. Mei-Yuan Chen Spring 008. Partition and rearrange the matrix X as [x i X i ]. That is, X i is the matrix X excluding the column x i. Let u i denote
More informationSimple Linear Regression Estimation and Properties
Simple Linear Regression Estimation and Properties Outline Review of the Reading Estimate parameters using OLS Other features of OLS Numerical Properties of OLS Assumptions of OLS Goodness of Fit Checking
More informationSo far our focus has been on estimation of the parameter vector β in the. y = Xβ + u
Interval estimation and hypothesis tests So far our focus has been on estimation of the parameter vector β in the linear model y i = β 1 x 1i + β 2 x 2i +... + β K x Ki + u i = x iβ + u i for i = 1, 2,...,
More informationThe Gauss-Markov Model. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 61
The Gauss-Markov Model Copyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 61 Recall that Cov(u, v) = E((u E(u))(v E(v))) = E(uv) E(u)E(v) Var(u) = Cov(u, u) = E(u E(u)) 2 = E(u 2
More informationEconometrics I KS. Module 1: Bivariate Linear Regression. Alexander Ahammer. This version: March 12, 2018
Econometrics I KS Module 1: Bivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: March 12, 2018 Alexander Ahammer (JKU) Module 1: Bivariate
More informationLinear Regression. Junhui Qian. October 27, 2014
Linear Regression Junhui Qian October 27, 2014 Outline The Model Estimation Ordinary Least Square Method of Moments Maximum Likelihood Estimation Properties of OLS Estimator Unbiasedness Consistency Efficiency
More informationthe error term could vary over the observations, in ways that are related
Heteroskedasticity We now consider the implications of relaxing the assumption that the conditional variance Var(u i x i ) = σ 2 is common to all observations i = 1,..., n In many applications, we may
More informationSimple Linear Regression Analysis
LINEAR REGRESSION ANALYSIS MODULE II Lecture - 6 Simple Linear Regression Analysis Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Prediction of values of study
More informationFinal Exam. Economics 835: Econometrics. Fall 2010
Final Exam Economics 835: Econometrics Fall 2010 Please answer the question I ask - no more and no less - and remember that the correct answer is often short and simple. 1 Some short questions a) For each
More informationRegression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T,
Regression Analysis The multiple linear regression model with k explanatory variables assumes that the tth observation of the dependent or endogenous variable y t is described by the linear relationship
More informationSummer School in Statistics for Astronomers V June 1 - June 6, Regression. Mosuk Chow Statistics Department Penn State University.
Summer School in Statistics for Astronomers V June 1 - June 6, 2009 Regression Mosuk Chow Statistics Department Penn State University. Adapted from notes prepared by RL Karandikar Mean and variance Recall
More informationIntermediate Econometrics
Intermediate Econometrics Markus Haas LMU München Summer term 2011 15. Mai 2011 The Simple Linear Regression Model Considering variables x and y in a specific population (e.g., years of education and wage
More informationLinear Regression. y» F; Ey = + x Vary = ¾ 2. ) y = + x + u. Eu = 0 Varu = ¾ 2 Exu = 0:
Linear Regression 1 Single Explanatory Variable Assume (y is not necessarily normal) where Examples: y» F; Ey = + x Vary = ¾ 2 ) y = + x + u Eu = 0 Varu = ¾ 2 Exu = 0: 1. School performance as a function
More informationOrdinary Least Squares Regression
Ordinary Least Squares Regression Goals for this unit More on notation and terminology OLS scalar versus matrix derivation Some Preliminaries In this class we will be learning to analyze Cross Section
More informationApplied Econometrics (QEM)
Applied Econometrics (QEM) The Simple Linear Regression Model based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #2 The Simple
More informationRegression. ECO 312 Fall 2013 Chris Sims. January 12, 2014
ECO 312 Fall 2013 Chris Sims Regression January 12, 2014 c 2014 by Christopher A. Sims. This document is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License What
More informationWooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model
Wooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model Most of this course will be concerned with use of a regression model: a structure in which one or more explanatory
More informationMultiple Regression Analysis: Heteroskedasticity
Multiple Regression Analysis: Heteroskedasticity y = β 0 + β 1 x 1 + β x +... β k x k + u Read chapter 8. EE45 -Chaiyuth Punyasavatsut 1 topics 8.1 Heteroskedasticity and OLS 8. Robust estimation 8.3 Testing
More informationIntroduction to Econometrics Midterm Examination Fall 2005 Answer Key
Introduction to Econometrics Midterm Examination Fall 2005 Answer Key Please answer all of the questions and show your work Clearly indicate your final answer to each question If you think a question is
More information4 Multiple Linear Regression
4 Multiple Linear Regression 4. The Model Definition 4.. random variable Y fits a Multiple Linear Regression Model, iff there exist β, β,..., β k R so that for all (x, x 2,..., x k ) R k where ε N (, σ
More informationMotivation for multiple regression
Motivation for multiple regression 1. Simple regression puts all factors other than X in u, and treats them as unobserved. Effectively the simple regression does not account for other factors. 2. The slope
More informationECON 4230 Intermediate Econometric Theory Exam
ECON 4230 Intermediate Econometric Theory Exam Multiple Choice (20 pts). Circle the best answer. 1. The Classical assumption of mean zero errors is satisfied if the regression model a) is linear in the
More informationLecture 13: Simple Linear Regression in Matrix Format. 1 Expectations and Variances with Vectors and Matrices
Lecture 3: Simple Linear Regression in Matrix Format To move beyond simple regression we need to use matrix algebra We ll start by re-expressing simple linear regression in matrix form Linear algebra is
More informationSTAT5044: Regression and Anova. Inyoung Kim
STAT5044: Regression and Anova Inyoung Kim 2 / 47 Outline 1 Regression 2 Simple Linear regression 3 Basic concepts in regression 4 How to estimate unknown parameters 5 Properties of Least Squares Estimators:
More information1. The OLS Estimator. 1.1 Population model and notation
1. The OLS Estimator OLS stands for Ordinary Least Squares. There are 6 assumptions ordinarily made, and the method of fitting a line through data is by least-squares. OLS is a common estimation methodology
More informationVector Auto-Regressive Models
Vector Auto-Regressive Models Laurent Ferrara 1 1 University of Paris Nanterre M2 Oct. 2018 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationVAR Models and Applications
VAR Models and Applications Laurent Ferrara 1 1 University of Paris West M2 EIPMC Oct. 2016 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationXβ is a linear combination of the columns of X: Copyright c 2010 Dan Nettleton (Iowa State University) Statistics / 25 X =
The Gauss-Markov Linear Model y Xβ + ɛ y is an n random vector of responses X is an n p matrix of constants with columns corresponding to explanatory variables X is sometimes referred to as the design
More informationThe cover page of the Encyclopedia of Health Economics (2014) Introduction to Econometric Application in Health Economics
PHPM110062 Teaching Demo The cover page of the Encyclopedia of Health Economics (2014) Introduction to Econometric Application in Health Economics Instructor: Mengcen Qian School of Public Health What
More informationHypothesis testing Goodness of fit Multicollinearity Prediction. Applied Statistics. Lecturer: Serena Arima
Applied Statistics Lecturer: Serena Arima Hypothesis testing for the linear model Under the Gauss-Markov assumptions and the normality of the error terms, we saw that β N(β, σ 2 (X X ) 1 ) and hence s
More informationInverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1
Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is
More informationEconometrics Master in Business and Quantitative Methods
Econometrics Master in Business and Quantitative Methods Helena Veiga Universidad Carlos III de Madrid Models with discrete dependent variables and applications of panel data methods in all fields of economics
More information11 Hypothesis Testing
28 11 Hypothesis Testing 111 Introduction Suppose we want to test the hypothesis: H : A q p β p 1 q 1 In terms of the rows of A this can be written as a 1 a q β, ie a i β for each row of A (here a i denotes
More informationSTAT5044: Regression and Anova
STAT5044: Regression and Anova Inyoung Kim 1 / 25 Outline 1 Multiple Linear Regression 2 / 25 Basic Idea An extra sum of squares: the marginal reduction in the error sum of squares when one or several
More informationLecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16)
Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) 1 2 Model Consider a system of two regressions y 1 = β 1 y 2 + u 1 (1) y 2 = β 2 y 1 + u 2 (2) This is a simultaneous equation model
More informationThe Simple Regression Model. Part II. The Simple Regression Model
Part II The Simple Regression Model As of Sep 22, 2015 Definition 1 The Simple Regression Model Definition Estimation of the model, OLS OLS Statistics Algebraic properties Goodness-of-Fit, the R-square
More informationLecture notes to Stock and Watson chapter 4
Lecture notes to Stock and Watson chapter 4 Introductory linear regression Tore Schweder Sept 2009 TS () LN3 03/09 1 / 15 Regression "Regression" is due to Francis Galton (1822-1911): how is a son s height
More informationHeteroskedasticity. We now consider the implications of relaxing the assumption that the conditional
Heteroskedasticity We now consider the implications of relaxing the assumption that the conditional variance V (u i x i ) = σ 2 is common to all observations i = 1,..., In many applications, we may suspect
More informationPlease discuss each of the 3 problems on a separate sheet of paper, not just on a separate page!
Econometrics - Exam May 11, 2011 1 Exam Please discuss each of the 3 problems on a separate sheet of paper, not just on a separate page! Problem 1: (15 points) A researcher has data for the year 2000 from
More informationFixed Effects Models for Panel Data. December 1, 2014
Fixed Effects Models for Panel Data December 1, 2014 Notation Use the same setup as before, with the linear model Y it = X it β + c i + ɛ it (1) where X it is a 1 K + 1 vector of independent variables.
More informationPeter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8
Contents 1 Linear model 1 2 GLS for multivariate regression 5 3 Covariance estimation for the GLM 8 4 Testing the GLH 11 A reference for some of this material can be found somewhere. 1 Linear model Recall
More informationRegression #2. Econ 671. Purdue University. Justin L. Tobias (Purdue) Regression #2 1 / 24
Regression #2 Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #2 1 / 24 Estimation In this lecture, we address estimation of the linear regression model. There are many objective functions
More informationBusiness Statistics. Tommaso Proietti. Linear Regression. DEF - Università di Roma 'Tor Vergata'
Business Statistics Tommaso Proietti DEF - Università di Roma 'Tor Vergata' Linear Regression Specication Let Y be a univariate quantitative response variable. We model Y as follows: Y = f(x) + ε where
More informationLecture 14 Simple Linear Regression
Lecture 4 Simple Linear Regression Ordinary Least Squares (OLS) Consider the following simple linear regression model where, for each unit i, Y i is the dependent variable (response). X i is the independent
More informationThe multiple regression model; Indicator variables as regressors
The multiple regression model; Indicator variables as regressors Ragnar Nymoen University of Oslo 28 February 2013 1 / 21 This lecture (#12): Based on the econometric model specification from Lecture 9
More information