GMM Method (Single-equation) Pongsa Pornchaiwiseskul Faculty of Economics Chulalongkorn University

Similar documents
Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

e i is a random error

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Primer on High-Order Moment Estimators

Systems of Equations (SUR, GMM, and 3SLS)

Limited Dependent Variables

Chapter 3. Two-Variable Regression Model: The Problem of Estimation

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

Factor models with many assets: strong factors, weak factors, and the two-pass procedure

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Feature Selection: Part 1

T E C O L O T E R E S E A R C H, I N C.

Econometrics of Panel Data

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva

Effects of Ignoring Correlations When Computing Sample Chi-Square. John W. Fowler February 26, 2012

Two-factor model. Statistical Models. Least Squares estimation in LM two-factor model. Rats

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

(c) Pongsa Pornchaiwiseskul, Faculty of Economics, Chulalongkorn University

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

Chapter 11: Simple Linear Regression and Correlation

x i1 =1 for all i (the constant ).

Now we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity

β0 + β1xi. You are interested in estimating the unknown parameters β

Chapter 4: Regression With One Regressor

The Ordinary Least Squares (OLS) Estimator

THE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

Recitation 2. Probits, Logits, and 2SLS. Fall Peter Hull

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.

β0 + β1xi. You are interested in estimating the unknown parameters β

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

a. (All your answers should be in the letter!

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Exam. Econometrics - Exam 1

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Lecture 10 Support Vector Machines II

Statistics for Business and Economics

Economics 130. Lecture 4 Simple Linear Regression Continued

Linear Regression Analysis: Terminology and Notation

Statistics MINITAB - Lab 2

Statistics for Economics & Business

ISQS 6348 Final Open notes, no books. Points out of 100 in parentheses. Y 1 ε 2

Linear Approximation with Regularization and Moving Least Squares

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)

β0 + β1xi and want to estimate the unknown

Estimation: Part 2. Chapter GREG estimation

10-701/ Machine Learning, Fall 2005 Homework 3

Department of Computer Science Artificial Intelligence Research Laboratory. Iowa State University MACHINE LEARNING

Continuous vs. Discrete Goods

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors

Negative Binomial Regression

A Comparative Study for Estimation Parameters in Panel Data Model

Kernel Methods and SVMs Extension

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact

Remote Sensing. Remote sensing is a quasi-linear estimation problem. Equation of radiative transfer: ) T B e τ T(z) (z)e τ. τ(z)

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

First Year Examination Department of Statistics, University of Florida

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

If we apply least squares to the transformed data we obtain. which yields the generalized least squares estimator of β, i.e.,

ECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Winter 2017 Instructor: Victor Aguirregabiria

Let p z be the price of z and p 1 and p 2 be the prices of the goods making up y. In general there is no problem in grouping goods.

Lecture Notes on Linear Regression

Feb 14: Spatial analysis of data fields

Maximum Likelihood Estimation (MLE)

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

1 Definition of Rademacher Complexity

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

Problem 3.1: Error autotocorrelation and heteroskedasticity Standard variance components model:

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

Lecture 19. Endogenous Regressors and Instrumental Variables

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Properties of Least Squares

4DVAR, according to the name, is a four-dimensional variational method.

Lecture 3: Probability Distributions

January Examinations 2015

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

PHYS 705: Classical Mechanics. Calculus of Variations II

Specification -- Assumptions of the Simple Classical Linear Regression Model (CLRM) 1. Introduction

C4B Machine Learning Answers II. = σ(z) (1 σ(z)) 1 1 e z. e z = σ(1 σ) (1 + e z )

Outline. 9. Heteroskedasticity Cross Sectional Analysis. Homoskedastic Case

LECTURE 9 CANONICAL CORRELATION ANALYSIS

Issues To Consider when Estimating Health Care Costs with Generalized Linear Models (GLMs): To Gamma/Log Or Not To Gamma/Log? That Is The New Question

Composite Hypotheses testing

x = , so that calculated

Solutions (mostly for odd-numbered exercises)

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

9. Binary Dependent Variables

Errors for Linear Systems

Polynomial Regression Models

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes

III. Econometric Methodology Regression Analysis

Transcription:

GMM Method (Sngle-equaton Pongsa Pornchawsesul Faculty of Economcs Chulalongorn Unversty Stochastc ( Gven that, for some, s random COV(, ε E(( µ ε E( ε µ E( ε E( ε (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 3 Covered opcs Volaton of C(,ε Instrument Varable ( Method Generalzed Method of Moments (GMM Stochastc ( If some or all s are random, addtonal assumptons about are needed. One of them s E( ε, > ˆ s consstent or C(,ε (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 4

Volaton of C(,ε OLS estmator s nconsstent (nvald. hy? ˆ OLS ( ( ( + ε + ( ε (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 5 Volaton of C(,ε ae condtonal varance on both sdes. ˆ V ( OLS ( V ( ε ( σ ( V ( n ˆ OLS σ n Uncondtonal varance?? (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 7 Volaton of C(,ε ae expectaton on both sdes. ˆ E( OLS + E( ( ε ˆ s based n general OLS Defnton Proxy of s proxy of + ξ, ε > E( f and and E( E( ξ, ξ (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 6 (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 8

Regresson Model w/ volaton + + L+, ε > OLS s nconsstent (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 9 + ε Regresson Model w/o volaton +, ε ε ε + + L+ ξ > OLS s consstent + ε + ξ How to get Proxy of ( Note that t s equvalent to splttng the varable nto parts, one part (γ wth no correlaton wth the orgnal error term(ε and the other part (ξ wth the correlaton. (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty How to get Proxy of ( ssumng that the set of varables are uncorrelated wth ε, we can defne the proxy as follows: γ + ξ γ s a proxy of How to get Proxy of (3 Note that γ wll be a good proxy f t can explan most varaton of. Need hgh R. 3 s called the set (vector of nstrument varables. (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty

Instrument Varables ( Canddates all s whch s non-random or random but uncorrelated wth ε. any varable outsde the regresson model whch s uncorrelated to ε. (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 3 Estmaton ( Steps run OLS regresson for γ + ξ get the ftted values for ˆ γˆ γˆ ( (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 5 Instrument Varables ( Choces of s avalablty of data underlyng theores pure assumpton Estmaton ( 3 use them as the proxy for + ˆ + ε + + L 4 run OLS on the above regresson model to get the estmate for (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 4 (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 6

Estmaton (3 Matrx Notaton Cov + ε Uα + Vδ + ε α [ U V] and δ ( U, ε but V, ε (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 7 Estmaton (5 Estmator ˆ ( ( ( ( ( ( ( + ε Note that + ( ε (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 9 symptootcally zero Proxy of V Estmaton (4 Vˆ γˆ ( Uα + Vδ + ε Note that subset of ( U Uˆ U + ε Uα + Vδ + ε V because U s a (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 8 Estmaton (6 ae varance on both sdes V(ˆ Vˆ (ˆ σ ( σ ( ˆ σ ( ˆ σ n ( ˆ ( (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty ( ˆ

Estmaton (7 Equvalence OLS ˆ EQOLS ( + ε In EVews, method s the same as wo-sage Least Square (SLS s not n Instrument lst have non-zero correlaton wth error terms ˆ (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty Estmaton (9 he model wth proxy or transformed wth matrx may not have one. does not need normalty of the error term. 3 a constant term s also an (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 3 Estmaton (8 Note that SLS estmaton may yeld negatve R-squared even f there s a constant term or equvalent n the orgnal regresson equaton. hy? Estmaton ( 4 If all plus other s from outsde, method s exactly the same as OLS. th ˆ ˆ ˆ ˆ ( ˆ ( ˆ OLS (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 4

eghted SLS ( Unweghted Model and + υ Uα + Vγ + υ υ ε w V, υ or V( υ σ w ˆ Vˆ(ˆ ˆ σ eghted SLS (3 ( ( ˆ σ ( n ( ˆ ( ˆ (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 5 (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 7 eghted SLS ( eghted Model Uα + Vγ + υ w M w O L L O O w n (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 6 M ε GMM ( s an mprovement over estmaton method does not fully utlze the assumpton or nowledge of zero correlaton between and the error term (ε. (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 8

GMM ( method employs only one proxy from the whole set of Instrument Varables. dfferent subset of s can yeld a dfferent proxy. e don t have to use the whole set of s. e can gve dfferent weght to each. (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 9 GMM (4 For each m, t s expected that E( m ε for all m. hat s, E( (- E( (- : E( (- M #of s [,,..., M ] } Moment Condtons (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 3 GMM (3 Concept Gvng dfferent weghts to each s equvalent to mxng dfferent subset of s For each, there wll be assocated matrx. Need at least Instrument Varables (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 3 GMM (5 Sample nalogy ˆ GMM arg mn ( w ( + ( w ( M + ( w M M ( w m weght for m (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 3

GMM (6 More general weghtng ˆ GMM arg mn ( ( MxM symmetrc PD weght matrx for Note that general allows not only own weghts but also cross weghts (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 33 GMM (8 Estmaton Step I (MxM dentty matrx Step Mnmze ( Step 3 Estmate for next teraton Ωˆ n Ω ˆ ( n ( Bac to Step untl convergence occurs ˆ (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 35 GMM (7 Ideal eght matrx Ω Ω Var( [ ] hy? Smlar reason to GLS. (c Pongsa Pornchawsesul, Faculty of Economcs, Chulalongorn Unversty 34