Asymptotics for Nonlinear GMM
|
|
- Egbert Rich
- 5 years ago
- Views:
Transcription
1 Asymptotics for Nonlinear GMM Eric Zivot February 13, 2013
2 Asymptotic Properties of Nonlinear GMM Under standard regularity conditions (to be discussed later), it can be shown that where ˆθ(Ŵ) θ 0 ³ˆθ(Ŵ) θ 0 (0 avar(ˆθ(ŵ))) avar(ˆθ(ŵ)) = 1 (G0 WG) 1 G 0 WSWG(G 0 WG) 1 " # g(w θ G = 0 ) θ 0 For efficient GMM, set W = S 1 and so avar(ˆθ(ŝ 1 )) = 1 (G0 S 1 G) 1
3 Remark Notice that with nonlinear GMM, the expression for avar(ˆθ(ŵ)) is of the same form as in linear GMM except that Σ = [x z 0 ] is replaced by the matrix G = g(w θ 0 ) θ 0 g(w θ 0 ) θ 0 = where = " g(w θ 0 ) g(w θ 0 ) 1 is the Jacobian matrix and 1 (w θ 0 ) (w θ 0 ) 1 # 1 (w θ 0 ) (w θ 0 ) g(w θ 0 )=( 1 (w θ 0 ) (w θ 0 )) 0
4 Consistent estimate of avar(ˆθ(w)) avar(ˆθ(ŵ)) d = 1 (Ĝ0 ŴĜ) 1 ĜŴŜŴĜ(Ĝ 0 ŴĜ) 1 where Ŝ S = avar(ḡ) Ĝ = G (ˆθ(Ŵ)) = 1 X g(w ˆθ(Ŵ)) θ 0 ˆθ(Ŵ) θ 0 G For the efficient GMM estimator, Ŵ = Ŝ 1 and avar(ˆθ(ŝ d 1 )) = 1 (Ĝ0 Ŝ 1 Ĝ) 1
5 Estimation of S If {g (w θ 0 )} is an ergodic stationary MDS then a consistent estimator of S takes the form Ŝ HC = 1 X ˆθ θ 0 g (w ˆθ)g (w ˆθ) 0 If {g (w θ 0 )} is a mean-zero serially correlated ergodic-stationary process then S = LRV = Γ 0 +2 X (Γ + Γ 0 ) Γ = [g (w θ 0 )g (w θ 0 ) 0 ]
6 Consistent estimators of LRV and Γ have the form Ŝ HAC = ˆΓ 0 (ˆθ)+ ˆΓ (ˆθ) = 1 ˆθ θ 0 1 X X = +1 Ã ( )! (ˆΓ (ˆθ)+ˆΓ 0 (ˆθ)) g (w ˆθ)g (w ˆθ) 0
7 Proving Consistency and Asymptotic Normality for Nonlinear GMM Hayashi s Chapter 7 (see also Hall Chapter 3 and the handbook chapter by Newey and McFadden) discusses the techniques for proving consistency and asymptotic normality for a general class of nonlinear extremum estimators. Extremum estimators have the form ˆθ = arg max θ Θ (θ) (θ) = objective function Θ = parameter space
8 GMM as an Extremum Estimator For GMM, define the objective function to be maximized as (θ) = 1 2 (θ Ŵ) = 1 2 g (θ) 0 Ŵg (θ) g (θ) = 1 X g(w θ 0 ) If ˆθ(Ŵ) minimizes (θ Ŵ) then it maximizes (θ) Remark: 1 2 is used in the definition of (θ) to simplify derivations (e.g. remove unnecessary constants)
9 M-Estimators For the class of M-estimators, the objective function to be maximized has the form Three common M-estimators are: X (θ) = 1 (w θ) (w θ) = real valued function (1) maximum likelihood (ML) estimators; (2) nonlinear least squares (NLS) estimators; (3) bounded influence function robust estimators
10 MLE as an M-Estimator Let x ( x ; θ) for =1 with log-likelihood function The MLE solves ln (θ Y X) = ˆθ =argmax θ Then the MLE is an M-estimator with X X ln ( x ; θ) ln ( x ; θ) (w θ) = ln ( x ; θ) (θ) = 1 X ln ( x ; θ)
11 NLS Estimator as an M-Estimator Consider the nonlinear regression The NLS estimator solves = (x θ)+ =1 ˆθ =argminrss(θ) = θ Then NLS estimator is an M-estimator with X (w θ) = ( (x θ)) 2 (θ) = 1 X ( (x θ)) 2 ( (x θ)) 2
12 Robust Regression as an M-estimator Consider the linear regression = x 0 θ + =1 To be robust to potential outliers and/or fat-tail error distributions, Huber defined the robust regression estimator as X ˆθ = argmin ³ x 0 θ θ ( ) is a convex bounded function Then Huber s robust regression estimator is an M-estimator with (w θ) = ³ x 0 θ (θ) = 1 X ³ x 0 θ
13 M-estimators as Method of Moments Estimators The first order conditions (FOCs) for an M-estimator are 0 = (ˆθ) θ = 1 X (w ˆθ) θ = 1 X ψ(w ˆθ) ψ(w θ) = (w θ) θ Therefore, M-estimators can be thought of as method of moment estimators basedonthepopulationmoment [ψ(w θ 0 )] = 0 Note: this is useful for deriving the asymptotic distribution of M-estimators.
14 Example: MLE as Method of Moments Estimator ˆθ = argmax (θ) = 1 θ 0 = (ˆθ) θ = 1 X = 1 ˆψ(w ˆθ) X X ln ( x ; θ) ln ( x ˆθ) θ ˆψ(w ˆθ) = ln ( x ˆθ) = likelihood score θ The population moment is " # ln ( x θ [ψ(w θ 0 )] = 0 ) = 0 θ
15 GMM as an M-estimator GMM can be thought of as an M-estimator. The first order condtions for GMM are 0 = (ˆθ) θ = 1 X = G (ˆθ) 0 Ŵg (ˆθ) = G (ˆθ) 0 Ŵ 1 ˆψ(w ˆθ) ˆψ(w θ) = G (ˆθ) 0 Ŵg(w θ) X g(w ˆθ) The population moment is [ψ(w θ 0 )] = h G 0 Wg(w θ 0 ) i = G 0 W [g(w θ 0 )] = 0 Note: Defined this way, there are = population moments defined by G 0 W [g(w θ 0 )] = 0
16 Consistency of Extremum Estimators Basic Idea: Let ˆθ =argmax θ Θ (θ) If (θ) 0 (θ) uniformly in θ, θ 0 uniquely maximizes 0 (θ) then ˆθ θ
17 Technical requirements 1. Continuity of (θ) and 0 (θ) 2. Uniform convergence of (θ) to 0 (θ) sup (θ) 0 (θ) Θ 0 as 3. Compact parameter space Θ 4. θ 0 uniquely maximizes 0 (θ) Note: See Hall Chapter 3 or Newey and McFaddan (1994) for a formal proof based on and arguments
18 Application to GMM Recall (θ) = 1 2 (θ Ŵ) = 1 2 g (θ) 0 Ŵg (θ) ˆθ = arg max (θ) θ Θ = arg min (θ Ŵ) θ Θ
19 Now 1. (θ) is continuous provided g (θ) is continuous 2. If {w } is ergodic-stationary and [g(w θ)] exists, then g (θ) = 1 X g(w θ) [g(w θ)] (for fixed ) 0 (θ) = 1 2 [g(w θ)] 0 W [g(w θ)] 3. If [g(w θ 0 )] = 0 and [g(w θ)] 6= 0 for any θ 6= θ 0 then 0 (θ 0 ) = 1 2 [g(w θ 0 )] 0 W [g(w θ 0 )] = 0 0 (θ) 0 for θ 6= θ 0 Therefore, 0 (θ) is uniquely maximized at θ 0
20 4. Uniform convergence of (θ) to 0 (θ) requires uniform convergence of g (θ) to [g(w θ)] Hayashi states that a sufficient condition for is sup g (θ) [g(w θ)] Θ 0 as where [sup g(w θ) ] θ Θ g(w θ) = ³ 1 (w θ) (w θ) = Euclidean norm
21 Asymptotic Normality of GMM Recall Assume (θ) = 1 2 (θ Ŵ) = 1 2 g (θ) 0 Ŵg (θ) ˆθ = arg max (θ) θ Θ 1. θ 0 Θ compact 2. g(w θ) is 1 and continuously differentiable in θ for any w 3. [g(w θ 0 )] = 0 and [g(w θ 0 )] 6= 0 for θ 6= θ 0 4. G = [ g(w θ 0 ) θ 0 ] has full column rank
22 5. g (θ 0 ) (0 S) 6. [sup θ Θ g(w θ) ]
23 Basic trick: Apply exact TSE (i.e., Mean Value Theorem) to nonlinear sample moment g (θ) to get a linear function of θ Since ˆθ =argmax θ Θ (θ) the first order condtions (FOC) are 0 = (ˆθ) 1 θ G (θ) = g (θ) θ 0 = = G (ˆθ) 0 Ŵg (ˆθ) " g (θ) 1 g (θ) # Now apply exact TSE to g (ˆθ) about θ 0 g (ˆθ) = g (θ 0 )+G ( θ)(ˆθ θ 0 ) θ = ˆθ +(1 )θ 0 =1 (0 1)
24 Substitute TSE into FOC 0 = G (ˆθ) 0 Ŵ h g (θ 0 )+G ( θ)(ˆθ θ 1 0 ) i = G (ˆθ) 0 Ŵg (θ 0 ) G (ˆθ) 0 ŴG ( θ)(ˆθ θ 0 ) Solve for (ˆθ θ 0 ) (ˆθ θ 0 )= h G (ˆθ) 0 ŴG ( θ) i 1 G (ˆθ) 0 Ŵg (θ 0 ) Multiply both sides by (ˆθ θ 0 )= h G (ˆθ) 0 ŴG ( θ) i 1 G (ˆθ) 0 Ŵ g (θ 0 )
25 Asymptotics Now, By the ergodic theorem Also, we know that G (θ) = g (θ) θ 0 G (θ 0 ) = 1 X " g(w θ 0 ) θ 0 g(w θ) θ 0 # = G ˆθ θ 0 θ = ˆθ +(1 )θ 0 θ 0
26 If G (θ) " g(w θ) θ 0 # uniformly in θ then G (ˆθ) G ( θ) G Asufficient condition for uniform convergence of G (θ) to " sup g(w θ) θ 0 # g(w θ) θ 0 is
27 Finally, by assumption g (θ 0 )= 1 X g(w θ 0 ) (0 S) Therefore, (ˆθ θ 0 ) (G 0 WG) 1 G 0 W (0 S) (0 V) V = (G 0 WG) 1 G 0 WSWG(G 0 WG) 1 Remark: For efficient GMM, W = S 1 and V = avar( (ˆθ θ 0 )) = (G 0 S 1 G) 1
28 Remark The preceeding results imply the following simplifications provided ˆθ is close to θ 0 so that G ( θ) =G (θ 0 )+ (1) : and g (ˆθ) = g (θ 0 )+G ( θ)(ˆθ θ 0 ) = g (θ 0 )+G (θ 0 )(ˆθ θ 0 )+ (1) (ˆθ θ 0 ) = h G (ˆθ) 0 ŴG ( θ) i 1 G (ˆθ) 0 Ŵg (θ 0 ) = h G (θ 0 ) 0 ŴG (θ 0 ) i 1 G (θ 0 ) 0 Ŵg (θ 0 ) + (1) where (1) represents terms that converge in probability to zero. These simplifications will be useful in the following derivations.
29 Remark It is not wise to try to prove consistency by linearizing the FOCs 0 = (ˆθ) 1 θ = G (ˆθ) 0 Ŵg (ˆθ) using the Mean Value Theorem. This is because ˆθ that solves the FOCs may be a local-maximum to (θ) and so ˆθ may not converge to θ 0 Note that the proof of asymptotic normality assumes that ˆθ is consistent for θ so we avoid complications associated with local maximum.
30 Hypothesis Testing in Nonlinear GMM Models The main types of hypothesis tests Overidentification restrictions Coefficient restrictions (linear and nonlinear) Subsets of orthogonality restrictions work the same way in nonlinear GMM as they do with linear GMM.
31 Remarks: 1. One should always first test the overidentifying restrictions before conducting the other tests. If the model specification is rejected, it does not make sense to do the remaining tests. 2. Testing instrument relevance is not straightforward in nonlinear models.
32 Asymptotic Distribution of Sample Moments and J-statistic By assumption, the normalized sample moment evaluated at θ 0 is asymptotically normally distributed g (θ 0 ) = 1 X (w θ 0 ) (0 S) S = avar( g (θ 0 )) As a result, the J-statistic evaluated at θ 0 is asymptotically chi-square distributed with degrees of freedom provided Ŝ S = (θ 0 Ŝ 1 )= g (θ 0 ) 0 Ŝ 1 g (θ 0 ) 2 ( )
33 As with linear GMM, the normalized sample moment evaluated at the efficient GMM estimate ˆθ = ˆθ(Ŝ 1 ) is asymptotically normally distributed Ŝ 1 2 g (ˆθ) (0 (I P )) " P = F(F 0 F) 1 F 0 F = S 1 2 g(w θ G G = 0 ) θ 0 rank (I P )= #
34 To derive this result, combine the TSE of g (ˆθ) about θ 0 with the the F.O.C for the efficient GMM optimization g (ˆθ) = g (θ 0 )+G (θ 0 )(ˆθ θ 0 )+ (1) (ˆθ θ 0 ) = h G (θ 0 ) 0 Ŝ 1 G (θ 0 ) i 1 G (θ 0 ) 0 Ŝ 1 g (θ 0 )+ (1) to give g (ˆθ) =g (θ 0 ) G (θ 0 ) h G (θ 0 ) 0 Ŝ 1 G (θ 0 ) i 1 G (θ 0 ) 0 Ŝ 1 g (θ 0 )+ (1)
35 Let Ŝ 1 = Ŝ 1 20 Ŝ 1 2 Then write the normalized sample moment as Ŝ 1 2 g (ˆθ) = h I P ˆ i Ŝ 1 2 g (θ 0 )+ (1) where ˆF = Ŝ 1 2 G (θ 0 ) P ˆ = ˆF(ˆF 0ˆF) 1ˆF 0 Then by the asymptotic normality of g (θ 0 ) and Slutsky s theorem Ŝ 1 2 g (ˆθ) [I P ] (0 I ) (0 I P ) since I P is idempotent.
36 From the previous result, it follows that the asymptotic distribution of the J- statistic evaluated at the efficient GMM estimate ˆθ(Ŝ 1 ) is chi-square with degrees of freedom (ˆθ(Ŝ 1 ) Ŝ 1 ) = g (ˆθ(Ŝ 1 )) 0 Ŝ 1 g (ˆθ(Ŝ 1 µŝ 1 2 )) = g (ˆθ(Ŝ 1 0 )) µŝ 1 2 g (ˆθ(Ŝ 1 )) 2 ( ) Therefore, we reject the overidentifying restrictions at the 5% level if (ˆθ(Ŝ 1 ) Ŝ 1 ) ( )
37 Testing Restrictions on Parameters: The Trilogy of Tests For ease of exposition, consider testing the simple hypotheses We consider three types of tests 0 : θ : θ 6= θ 0 Wald test GMM-LR test (difference in J-statistics) GMM-LM test (GMM score test)
38 Let ˆθ = ˆθ(Ŝ 1 ) denote the efficient GMM estimator. The three test statistics have the form GMM = (ˆθ θ 0 ) 0 h G (ˆθ) 0 Ŝ 1 G (ˆθ) i (ˆθ θ 0 ) GMM = (θ 0 Ŝ 1 ) (ˆθ Ŝ 1 ) GMM = g (θ 0 ) 0 Ŝ 1 G (θ 0 ) h G (θ 0 ) 0 Ŝ 1 G (θ 0 ) i G (θ 0 ) 0 Ŝ 1 g (θ 0 ) where the same value of Ŝ 1 is used for all statistics. Result: Under 0 : θ = θ 0 GMM GMM GMM 2 ( )
39 Derivation of GMM (score) statistic The score statistic is based on the score of the GMM objective function 0 = (ˆθ) = G (ˆθ) 0 Ŝ 1 g (ˆθ) 1 θ Intuition: if 0 : θ = θ 0 is true then 0 (θ 0 ) = G (θ 0 ) 0 Ŝ 1 g (θ 0 ) 1 θ whereas if 0 : θ = θ 0 is not true then 0 6= (θ 0 ) 1 θ = G (θ 0 ) 0 Ŝ 1 g (θ 0 )
40 Assuming 0 : θ = θ 0 is true (θ 0 ) θ = G (θ 0 ) 0 Ŝ 1 g (θ 0 ) G 0 S 1 (0 S) (0 G 0 S 1 G) Notice that avar à (θ 0 ) θ! = G 0 S 1 G
41 Then, the GMM score statistic is defined as Ã! 0 (θ GMM = 0 ) h G 0 θ (θ 0 )Ŝ 1 G (θ 0 ) i 1 Ã! (θ 0 ) θ = g (θ 0 ) 0 Ŝ 1 G (θ 0 ) h G (θ 0 ) 0 Ŝ 1 G (θ 0 ) i G (θ 0 ) 0 Ŝ 1 g (θ 0 )
42 Then by the asymptotic normality of g (θ 0 ) and Slutsky s theorem GMM (0 G 0 S 1 G) 0 h G 0 S 1 G i 1 (0 G 0 S 1 G) 2 ( )
Nonlinear GMM. Eric Zivot. Winter, 2013
Nonlinear GMM Eric Zivot Winter, 2013 Nonlinear GMM estimation occurs when the GMM moment conditions g(w θ) arenonlinearfunctionsofthe model parameters θ The moment conditions g(w θ) may be nonlinear functions
More informationEcon 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE
Econ 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE Eric Zivot Winter 013 1 Wald, LR and LM statistics based on generalized method of moments estimation Let 1 be an iid sample
More informationSingle Equation Linear GMM
Single Equation Linear GMM Eric Zivot Winter 2013 Single Equation Linear GMM Consider the linear regression model Engodeneity = z 0 δ 0 + =1 z = 1 vector of explanatory variables δ 0 = 1 vector of unknown
More informationFinancial Econometrics and Volatility Models Estimation of Stochastic Volatility Models
Financial Econometrics and Volatility Models Estimation of Stochastic Volatility Models Eric Zivot April 26, 2010 Outline Likehood of SV Models Survey of Estimation Techniques for SV Models GMM Estimation
More informationMultiple Equation GMM with Common Coefficients: Panel Data
Multiple Equation GMM with Common Coefficients: Panel Data Eric Zivot Winter 2013 Multi-equation GMM with common coefficients Example (panel wage equation) 69 = + 69 + + 69 + 1 80 = + 80 + + 80 + 2 Note:
More informationEconomics 583: Econometric Theory I A Primer on Asymptotics
Economics 583: Econometric Theory I A Primer on Asymptotics Eric Zivot January 14, 2013 The two main concepts in asymptotic theory that we will use are Consistency Asymptotic Normality Intuition consistency:
More informationIntroduction Large Sample Testing Composite Hypotheses. Hypothesis Testing. Daniel Schmierer Econ 312. March 30, 2007
Hypothesis Testing Daniel Schmierer Econ 312 March 30, 2007 Basics Parameter of interest: θ Θ Structure of the test: H 0 : θ Θ 0 H 1 : θ Θ 1 for some sets Θ 0, Θ 1 Θ where Θ 0 Θ 1 = (often Θ 1 = Θ Θ 0
More informationA Primer on Asymptotics
A Primer on Asymptotics Eric Zivot Department of Economics University of Washington September 30, 2003 Revised: October 7, 2009 Introduction The two main concepts in asymptotic theory covered in these
More informationAnalogy Principle. Asymptotic Theory Part II. James J. Heckman University of Chicago. Econ 312 This draft, April 5, 2006
Analogy Principle Asymptotic Theory Part II James J. Heckman University of Chicago Econ 312 This draft, April 5, 2006 Consider four methods: 1. Maximum Likelihood Estimation (MLE) 2. (Nonlinear) Least
More informationSlide Set 14 Inference Basded on the GMM Estimator. Econometrics Master in Economics and Finance (MEF) Università degli Studi di Napoli Federico II
Slide Set 14 Inference Basded on the GMM Estimator Pietro Coretto pcoretto@unisa.it Econometrics Master in Economics and Finance (MEF) Università degli Studi di Napoli Federico II Version: Saturday 9 th
More informationEcon 583 Final Exam Fall 2008
Econ 583 Final Exam Fall 2008 Eric Zivot December 11, 2008 Exam is due at 9:00 am in my office on Friday, December 12. 1 Maximum Likelihood Estimation and Asymptotic Theory Let X 1,...,X n be iid random
More informationGreene, Econometric Analysis (6th ed, 2008)
EC771: Econometrics, Spring 2010 Greene, Econometric Analysis (6th ed, 2008) Chapter 17: Maximum Likelihood Estimation The preferred estimator in a wide variety of econometric settings is that derived
More informationChapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools. Joan Llull. Microeconometrics IDEA PhD Program
Chapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools Joan Llull Microeconometrics IDEA PhD Program Maximum Likelihood Chapter 1. A Brief Review of Maximum Likelihood, GMM, and Numerical
More informationCh. 5 Hypothesis Testing
Ch. 5 Hypothesis Testing The current framework of hypothesis testing is largely due to the work of Neyman and Pearson in the late 1920s, early 30s, complementing Fisher s work on estimation. As in estimation,
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationEconomics 582 Random Effects Estimation
Economics 582 Random Effects Estimation Eric Zivot May 29, 2013 Random Effects Model Hence, the model can be re-written as = x 0 β + + [x ] = 0 (no endogeneity) [ x ] = = + x 0 β + + [x ] = 0 [ x ] = 0
More informationSpring 2017 Econ 574 Roger Koenker. Lecture 14 GEE-GMM
University of Illinois Department of Economics Spring 2017 Econ 574 Roger Koenker Lecture 14 GEE-GMM Throughout the course we have emphasized methods of estimation and inference based on the principle
More informationChapter 4. Theory of Tests. 4.1 Introduction
Chapter 4 Theory of Tests 4.1 Introduction Parametric model: (X, B X, P θ ), P θ P = {P θ θ Θ} where Θ = H 0 +H 1 X = K +A : K: critical region = rejection region / A: acceptance region A decision rule
More informationIntroduction to Maximum Likelihood Estimation
Introduction to Maximum Likelihood Estimation Eric Zivot July 26, 2012 The Likelihood Function Let 1 be an iid sample with pdf ( ; ) where is a ( 1) vector of parameters that characterize ( ; ) Example:
More informationIntroduction to Estimation Methods for Time Series models Lecture 2
Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:
More informationEconomic modelling and forecasting
Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation
More informationExponential Tilting with Weak Instruments: Estimation and Testing
Exponential Tilting with Weak Instruments: Estimation and Testing Mehmet Caner North Carolina State University January 2008 Abstract This article analyzes exponential tilting estimator with weak instruments
More informationComposite Hypotheses and Generalized Likelihood Ratio Tests
Composite Hypotheses and Generalized Likelihood Ratio Tests Rebecca Willett, 06 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve
More informationStatistics and econometrics
1 / 36 Slides for the course Statistics and econometrics Part 10: Asymptotic hypothesis testing European University Institute Andrea Ichino September 8, 2014 2 / 36 Outline Why do we need large sample
More informationAGEC 661 Note Eleven Ximing Wu. Exponential regression model: m (x, θ) = exp (xθ) for y 0
AGEC 661 ote Eleven Ximing Wu M-estimator So far we ve focused on linear models, where the estimators have a closed form solution. If the population model is nonlinear, the estimators often do not have
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot November 2, 2011 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationMaximum Likelihood Tests and Quasi-Maximum-Likelihood
Maximum Likelihood Tests and Quasi-Maximum-Likelihood Wendelin Schnedler Department of Economics University of Heidelberg 10. Dezember 2007 Wendelin Schnedler (AWI) Maximum Likelihood Tests and Quasi-Maximum-Likelihood10.
More information(θ θ ), θ θ = 2 L(θ ) θ θ θ θ θ (θ )= H θθ (θ ) 1 d θ (θ )
Setting RHS to be zero, 0= (θ )+ 2 L(θ ) (θ θ ), θ θ = 2 L(θ ) 1 (θ )= H θθ (θ ) 1 d θ (θ ) O =0 θ 1 θ 3 θ 2 θ Figure 1: The Newton-Raphson Algorithm where H is the Hessian matrix, d θ is the derivative
More informationWhat s New in Econometrics. Lecture 15
What s New in Econometrics Lecture 15 Generalized Method of Moments and Empirical Likelihood Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Generalized Method of Moments Estimation
More informationLecture 14 October 13
STAT 383C: Statistical Modeling I Fall 2015 Lecture 14 October 13 Lecturer: Purnamrita Sarkar Scribe: Some one Disclaimer: These scribe notes have been slightly proofread and may have typos etc. Note:
More informationECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Spring 2013 Instructor: Victor Aguirregabiria
ECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Spring 2013 Instructor: Victor Aguirregabiria SOLUTION TO FINAL EXAM Friday, April 12, 2013. From 9:00-12:00 (3 hours) INSTRUCTIONS:
More informationEconometrics II - EXAM Outline Solutions All questions have 25pts Answer each question in separate sheets
Econometrics II - EXAM Outline Solutions All questions hae 5pts Answer each question in separate sheets. Consider the two linear simultaneous equations G with two exogeneous ariables K, y γ + y γ + x δ
More informationLECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test.
Economics 52 Econometrics Professor N.M. Kiefer LECTURE 1: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING NEYMAN-PEARSON LEMMA: Lesson: Good tests are based on the likelihood ratio. The proof is easy in the
More informationGeneralized Method Of Moments (GMM)
Chapter 6 Generalized Method Of Moments GMM) Note: The primary reference text for these notes is Hall 005). Alternative, but less comprehensive, treatments can be found in chapter 14 of Hamilton 1994)
More informationThe generalized method of moments
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna February 2008 Based on the book Generalized Method of Moments by Alastair R. Hall (2005), Oxford
More informationStatistics 612: L p spaces, metrics on spaces of probabilites, and connections to estimation
Statistics 62: L p spaces, metrics on spaces of probabilites, and connections to estimation Moulinath Banerjee December 6, 2006 L p spaces and Hilbert spaces We first formally define L p spaces. Consider
More informationChapter 4: Constrained estimators and tests in the multiple linear regression model (Part III)
Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Florian Pelgrin HEC September-December 2010 Florian Pelgrin (HEC) Constrained estimators September-December
More information8. Hypothesis Testing
FE661 - Statistical Methods for Financial Engineering 8. Hypothesis Testing Jitkomut Songsiri introduction Wald test likelihood-based tests significance test for linear regression 8-1 Introduction elements
More informationThe properties of L p -GMM estimators
The properties of L p -GMM estimators Robert de Jong and Chirok Han Michigan State University February 2000 Abstract This paper considers Generalized Method of Moment-type estimators for which a criterion
More informationLecture 6: Hypothesis Testing
Lecture 6: Hypothesis Testing Mauricio Sarrias Universidad Católica del Norte November 6, 2017 1 Moran s I Statistic Mandatory Reading Moran s I based on Cliff and Ord (1972) Kelijan and Prucha (2001)
More informationTime Series Analysis Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 4.384 Time Series Analysis Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Indirect Inference 4.384 Time
More informationConditional Linear Combination Tests for Weakly Identified Models
Conditional Linear Combination Tests for Weakly Identified Models Isaiah Andrews JOB MARKET PAPER Abstract This paper constructs powerful tests applicable in a wide range of weakly identified contexts,
More informationQuick Review on Linear Multiple Regression
Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,
More informationTesting Overidentifying Restrictions with Many Instruments and Heteroskedasticity
Testing Overidentifying Restrictions with Many Instruments and Heteroskedasticity John C. Chao, Department of Economics, University of Maryland, chao@econ.umd.edu. Jerry A. Hausman, Department of Economics,
More informationMaximum Likelihood (ML) Estimation
Econometrics 2 Fall 2004 Maximum Likelihood (ML) Estimation Heino Bohn Nielsen 1of32 Outline of the Lecture (1) Introduction. (2) ML estimation defined. (3) ExampleI:Binomialtrials. (4) Example II: Linear
More informationAsymptotic distribution of GMM Estimator
Asymptotic distribution of GMM Estimator Eduardo Rossi University of Pavia Econometria finanziaria 2010 Rossi (2010) GMM 2010 1 / 45 Outline 1 Asymptotic Normality of the GMM Estimator 2 Long Run Covariance
More informationGMM - Generalized method of moments
GMM - Generalized method of moments GMM Intuition: Matching moments You want to estimate properties of a data set {x t } T t=1. You assume that x t has a constant mean and variance. x t (µ 0, σ 2 ) Consider
More informationClosest Moment Estimation under General Conditions
Closest Moment Estimation under General Conditions Chirok Han and Robert de Jong January 28, 2002 Abstract This paper considers Closest Moment (CM) estimation with a general distance function, and avoids
More informationFall, 2007 Nonlinear Econometrics. Theory: Consistency for Extremum Estimators. Modeling: Probit, Logit, and Other Links.
14.385 Fall, 2007 Nonlinear Econometrics Lecture 2. Theory: Consistency for Extremum Estimators Modeling: Probit, Logit, and Other Links. 1 Example: Binary Choice Models. The latent outcome is defined
More informationGeneralized Method of Moments (GMM) Estimation
Econometrics 2 Fall 2004 Generalized Method of Moments (GMM) Estimation Heino Bohn Nielsen of29 Outline of the Lecture () Introduction. (2) Moment conditions and methods of moments (MM) estimation. Ordinary
More informationGeneralized Method of Moment
Generalized Method of Moment CHUNG-MING KUAN Department of Finance & CRETA National Taiwan University June 16, 2010 C.-M. Kuan (Finance & CRETA, NTU Generalized Method of Moment June 16, 2010 1 / 32 Lecture
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationChapter 1. GMM: Basic Concepts
Chapter 1. GMM: Basic Concepts Contents 1 Motivating Examples 1 1.1 Instrumental variable estimator....................... 1 1.2 Estimating parameters in monetary policy rules.............. 2 1.3 Estimating
More informationSingle-Equation GMM (II)
Single-Equation GMM (II) Guochang Zhao RIEM, SWUFE Week 12, Fall 2016 December 1, 2016 1 / 26 Guochang Zhao RIEM, SWUFE Single-Equation GMM Overidentification test If the equation is exactly identified,
More informationGMM Estimation and Testing
GMM Estimation and Testing Whitney Newey July 2007 Idea: Estimate parameters by setting sample moments to be close to population counterpart. Definitions: β : p 1 parameter vector, with true value β 0.
More informationGeneralized Method of Moments: I. Chapter 9, R. Davidson and J.G. MacKinnon, Econometric Theory and Methods, 2004, Oxford.
Generalized Method of Moments: I References Chapter 9, R. Davidson and J.G. MacKinnon, Econometric heory and Methods, 2004, Oxford. Chapter 5, B. E. Hansen, Econometrics, 2006. http://www.ssc.wisc.edu/~bhansen/notes/notes.htm
More informationGeneralized Linear Models
Generalized Linear Models Lecture 3. Hypothesis testing. Goodness of Fit. Model diagnostics GLM (Spring, 2018) Lecture 3 1 / 34 Models Let M(X r ) be a model with design matrix X r (with r columns) r n
More informationConfirmatory Factor Analysis: Model comparison, respecification, and more. Psychology 588: Covariance structure and factor models
Confirmatory Factor Analysis: Model comparison, respecification, and more Psychology 588: Covariance structure and factor models Model comparison 2 Essentially all goodness of fit indices are descriptive,
More informationExercises Chapter 4 Statistical Hypothesis Testing
Exercises Chapter 4 Statistical Hypothesis Testing Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 5, 013 Christophe Hurlin (University of Orléans) Advanced Econometrics
More informationTesting and Model Selection
Testing and Model Selection This is another digression on general statistics: see PE App C.8.4. The EViews output for least squares, probit and logit includes some statistics relevant to testing hypotheses
More informationLet us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided
Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or
More informationSpecification testing in panel data models estimated by fixed effects with instrumental variables
Specification testing in panel data models estimated by fixed effects wh instrumental variables Carrie Falls Department of Economics Michigan State Universy Abstract I show that a handful of the regressions
More informationSection 9: Generalized method of moments
1 Section 9: Generalized method of moments In this section, we revisit unbiased estimating functions to study a more general framework for estimating parameters. Let X n =(X 1,...,X n ), where the X i
More informationThe outline for Unit 3
The outline for Unit 3 Unit 1. Introduction: The regression model. Unit 2. Estimation principles. Unit 3: Hypothesis testing principles. 3.1 Wald test. 3.2 Lagrange Multiplier. 3.3 Likelihood Ratio Test.
More informationEconomics 620, Lecture 5: exp
1 Economics 620, Lecture 5: The K-Variable Linear Model II Third assumption (Normality): y; q(x; 2 I N ) 1 ) p(y) = (2 2 ) exp (N=2) 1 2 2(y X)0 (y X) where N is the sample size. The log likelihood function
More informationGeneralized Method of Moments
1 Generalized Method of Moments This is page i Printer: Opaque this 1.1 Introduction This chapter describes generalized method of moments (GMM) estimation for linear and non-linear models with applications
More informationTesting in GMM Models Without Truncation
Testing in GMM Models Without Truncation TimothyJ.Vogelsang Departments of Economics and Statistical Science, Cornell University First Version August, 000; This Version June, 001 Abstract This paper proposes
More informationTopic 5: Generalized Likelihood Ratio Test
CS 885: Advanced Machine Learning Fall 7 Topic 5: Generalized Likelihood Ratio Test Instructor: Daniel L. Pimentel-Alarcón Copyright 7 5. Introduction We already started studying composite hypothesis problems
More informationLikelihood-Based Methods
Likelihood-Based Methods Handbook of Spatial Statistics, Chapter 4 Susheela Singh September 22, 2016 OVERVIEW INTRODUCTION MAXIMUM LIKELIHOOD ESTIMATION (ML) RESTRICTED MAXIMUM LIKELIHOOD ESTIMATION (REML)
More informationEconometric Analysis of Cross Section and Panel Data
Econometric Analysis of Cross Section and Panel Data Jeffrey M. Wooldridge / The MIT Press Cambridge, Massachusetts London, England Contents Preface Acknowledgments xvii xxiii I INTRODUCTION AND BACKGROUND
More informationDiscrete Dependent Variable Models
Discrete Dependent Variable Models James J. Heckman University of Chicago This draft, April 10, 2006 Here s the general approach of this lecture: Economic model Decision rule (e.g. utility maximization)
More informationGeneralized Method of Moments Estimation
Generalized Method of Moments Estimation Lars Peter Hansen March 0, 2007 Introduction Generalized methods of moments (GMM) refers to a class of estimators which are constructed from exploiting the sample
More information1.5 Testing and Model Selection
1.5 Testing and Model Selection The EViews output for least squares, probit and logit includes some statistics relevant to testing hypotheses (e.g. Likelihood Ratio statistic) and to choosing between specifications
More informationEcon 582 Fixed Effects Estimation of Panel Data
Econ 582 Fixed Effects Estimation of Panel Data Eric Zivot May 28, 2012 Panel Data Framework = x 0 β + = 1 (individuals); =1 (time periods) y 1 = X β ( ) ( 1) + ε Main question: Is x uncorrelated with?
More informationECON 4160, Autumn term Lecture 1
ECON 4160, Autumn term 2017. Lecture 1 a) Maximum Likelihood based inference. b) The bivariate normal model Ragnar Nymoen University of Oslo 24 August 2017 1 / 54 Principles of inference I Ordinary least
More informationCherry Blossom run (1) The credit union Cherry Blossom Run is a 10 mile race that takes place every year in D.C. In 2009 there were participants
18.650 Statistics for Applications Chapter 5: Parametric hypothesis testing 1/37 Cherry Blossom run (1) The credit union Cherry Blossom Run is a 10 mile race that takes place every year in D.C. In 2009
More informationGMM and SMM. 1. Hansen, L Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p
GMM and SMM Some useful references: 1. Hansen, L. 1982. Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p. 1029-54. 2. Lee, B.S. and B. Ingram. 1991 Simulation estimation
More information1 Extremum Estimators
FINC 9311-21 Financial Econometrics Handout Jialin Yu 1 Extremum Estimators Let θ 0 be a vector of k 1 unknown arameters. Extremum estimators: estimators obtained by maximizing or minimizing some objective
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2009 Prof. Gesine Reinert Our standard situation is that we have data x = x 1, x 2,..., x n, which we view as realisations of random
More informationLecture 2: Consistency of M-estimators
Lecture 2: Instructor: Deartment of Economics Stanford University Preared by Wenbo Zhou, Renmin University References Takeshi Amemiya, 1985, Advanced Econometrics, Harvard University Press Newey and McFadden,
More informationProofs for Large Sample Properties of Generalized Method of Moments Estimators
Proofs for Large Sample Properties of Generalized Method of Moments Estimators Lars Peter Hansen University of Chicago March 8, 2012 1 Introduction Econometrica did not publish many of the proofs in my
More informationQuantile methods. Class Notes Manuel Arellano December 1, Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be
Quantile methods Class Notes Manuel Arellano December 1, 2009 1 Unconditional quantiles Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be Q τ (Y ) q τ F 1 (τ) =inf{r : F
More informationModel Selection and Geometry
Model Selection and Geometry Pascal Massart Université Paris-Sud, Orsay Leipzig, February Purpose of the talk! Concentration of measure plays a fundamental role in the theory of model selection! Model
More informationAssumptions of classical multiple regression model
ESD: Recitation #7 Assumptions of classical multiple regression model Linearity Full rank Exogeneity of independent variables Homoscedasticity and non autocorrellation Exogenously generated data Normal
More informationMaximum-Likelihood Estimation: Basic Ideas
Sociology 740 John Fox Lecture Notes Maximum-Likelihood Estimation: Basic Ideas Copyright 2014 by John Fox Maximum-Likelihood Estimation: Basic Ideas 1 I The method of maximum likelihood provides estimators
More informationADVANCED FINANCIAL ECONOMETRICS PROF. MASSIMO GUIDOLIN
Massimo Guidolin Massimo.Guidolin@unibocconi.it Dept. of Finance ADVANCED FINANCIAL ECONOMETRICS PROF. MASSIMO GUIDOLIN a.a. 14/15 p. 1 LECTURE 3: REVIEW OF BASIC ESTIMATION METHODS: GMM AND OTHER EXTREMUM
More informationThe Indirect Method: Inference Based on Intermediate Statistics A Synthesis and Examples
The Indirect Method: Inference Based on Intermediate Statistics A Synthesis and Examples Wenxin Jiang and Bruce Turnbull Abstract. This paper presents an exposition and synthesis of the theory and some
More informationSome General Types of Tests
Some General Types of Tests We may not be able to find a UMP or UMPU test in a given situation. In that case, we may use test of some general class of tests that often have good asymptotic properties.
More informationPsychology 282 Lecture #4 Outline Inferences in SLR
Psychology 282 Lecture #4 Outline Inferences in SLR Assumptions To this point we have not had to make any distributional assumptions. Principle of least squares requires no assumptions. Can use correlations
More informationUniversity of Pavia. M Estimators. Eduardo Rossi
University of Pavia M Estimators Eduardo Rossi Criterion Function A basic unifying notion is that most econometric estimators are defined as the minimizers of certain functions constructed from the sample
More informationAdvanced Econometrics
Advanced Econometrics Dr. Andrea Beccarini Center for Quantitative Economics Winter 2013/2014 Andrea Beccarini (CQE) Econometrics Winter 2013/2014 1 / 156 General information Aims and prerequisites Objective:
More informationMore Empirical Process Theory
More Empirical Process heory 4.384 ime Series Analysis, Fall 2008 Recitation by Paul Schrimpf Supplementary to lectures given by Anna Mikusheva October 24, 2008 Recitation 8 More Empirical Process heory
More informationSpatial Regression. 9. Specification Tests (1) Luc Anselin. Copyright 2017 by Luc Anselin, All Rights Reserved
Spatial Regression 9. Specification Tests (1) Luc Anselin http://spatial.uchicago.edu 1 basic concepts types of tests Moran s I classic ML-based tests LM tests 2 Basic Concepts 3 The Logic of Specification
More informationLecture 7 Introduction to Statistical Decision Theory
Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7
More informationAn Introduction to Generalized Method of Moments. Chen,Rong aronge.net
An Introduction to Generalized Method of Moments Chen,Rong http:// aronge.net Asset Pricing, 2012 Section 1 WHY GMM? 2 Empirical Studies 3 Econometric Estimation Strategies 4 5 Maximum Likelihood Estimation
More informationClosest Moment Estimation under General Conditions
Closest Moment Estimation under General Conditions Chirok Han Victoria University of Wellington New Zealand Robert de Jong Ohio State University U.S.A October, 2003 Abstract This paper considers Closest
More informationEstimation, Inference, and Hypothesis Testing
Chapter 2 Estimation, Inference, and Hypothesis Testing Note: The primary reference for these notes is Ch. 7 and 8 of Casella & Berger 2. This text may be challenging if new to this topic and Ch. 7 of
More informationInstrumental Variables Estimation in Stata
Christopher F Baum 1 Faculty Micro Resource Center Boston College March 2007 1 Thanks to Austin Nichols for the use of his material on weak instruments and Mark Schaffer for helpful comments. The standard
More informationδ -method and M-estimation
Econ 2110, fall 2016, Part IVb Asymptotic Theory: δ -method and M-estimation Maximilian Kasy Department of Economics, Harvard University 1 / 40 Example Suppose we estimate the average effect of class size
More informationHypothesis Testing. 1 Definitions of test statistics. CB: chapter 8; section 10.3
Hypothesis Testing CB: chapter 8; section 0.3 Hypothesis: statement about an unknown population parameter Examples: The average age of males in Sweden is 7. (statement about population mean) The lowest
More information