University of Pavia. M Estimators. Eduardo Rossi
|
|
- Julie Walker
- 6 years ago
- Views:
Transcription
1 University of Pavia M Estimators Eduardo Rossi
2 Criterion Function A basic unifying notion is that most econometric estimators are defined as the minimizers of certain functions constructed from the sample data, called criterion functions, C T Parameter Space: Θ R p The true value of the parameter: θ 0 Θ An estimator of θ 0 based on a data set of size T is given by: θ T = arg min θ Θ C T(θ) (1) For instance, the OLS for the MLR model is an M-estimator where C T (θ) = t (y t x t(θ)) 2 Eduardo Rossi - Econometrics 10 2
3 Criterion Function The analysis is centered around the properties of C T and its derivatives. g T (θ) = C T θ = C T θ 1. C T θ p (p 1) (2) Q T (θ) = 2 C T θ θ = 2 C T θ C T θ p θ C T θ 1 θ p. 2 C T θ 2 p (p p) (3) Eduardo Rossi - Econometrics 10 3
4 Criterion Function g T (θ) = C T (4) Q T (θ) = 2 C T (5) All these quantities are random variables and functions on the parameter space. The Criterion Function can be thought of as having the generic form ( ) 1 T C T (θ) = φ ψ t (θ) T t=1 φ( ) is a continuous function of r variables, ψ t (θ) is an r-vector of continuous functions. The factor 1 T ensures that C T is bounded in the limit as T. Eduardo Rossi - Econometrics 10 4
5 Criterion Function OLS GLS Maximum Likelihood Estimator: ψ t is scalar, corresponds to the negative of the log-probability or log-probability density associated with each observation. Method of Moments Estimator: Solution to sets of equations relating data moments and unknown parameters, the moments in question being replaced by sample averages to obtain the estimates. GMM Eduardo Rossi - Econometrics 10 5
6 Asymptotic properties Under regularity conditions, that we have to establish in particular cases, M-estimators satisfy the usual demanded properties of econometric estimators. Let (Ω, F) be a measurable space, and Θ a compact (closed and bounded) subset of R p. Let C : Ω Θ R (6) be a function, such that C(, θ) is F/B measurable for every θ Θ and C(ω, ) is continuous on Θ for every ω F for some F F. Then there exists a F/B p measurable function θ : Ω Θ such that for all ω F, C(ω, θ(ω)) = inf C(ω, θ) (7) θ Θ Eduardo Rossi - Econometrics 10 6
7 Asymptotic properties Random variable: X : Ω R Ω sample space, a σ-field of events F. (R, B, µ), B denotes the Borel Field of R, and µ is a probability measure on R. If for every B B there exists a set of A F such that X(A) = B, the function X( ) is said to be F/B-measurable. A r.v. is a measurable mapping from a probability space to the real line. Measurability of C(, ω) means that this can be treated as a r.v. when the data are random variables, having a well defined distribution. Eduardo Rossi - Econometrics 10 7
8 Asymptotic properties The important conditions are: 1. Continuity of C(ω, ) as a function of θ for given data 2. Compactness of Θ Eduardo Rossi - Econometrics 10 8
9 Asymptotic properties Compactness of Θ Boundedness is an innocuous requirement, large parameter are unreasonable. We cannot exclude points that are closure points. The problem is that the minimum of a function on a set may not exist as a member of the set, unless the set is closed. The asymptotic analysis is only concerned with the behavior of the estimator on a small open neighbourhood of θ 0. Eduardo Rossi - Econometrics 10 9
10 Consistency To analyze the consistency problem we need some new convergence concepts. Let {X t (θ), t = 1, 2,...} be a random sequence whose members are functions of parameters θ, on a domain Θ. Definition If X t (θ) X(θ) for every θ Θ, X t is said to converge in probability to X pointwise on Θ. Definition If sup θ Θ X t (θ) X(θ) probability to X uniformly on Θ. p 0, X t is said to converge in In general, pointwise convergence uniform convergence. Eduardo Rossi - Econometrics 10 10
11 Consistency Theorem 1. Θ is compact 2. C T (θ) p C(θ) (a non-stochastic function of θ) uniformly in Θ 3. θ 0 int(θ) is the unique minimum of C(θ) then θ T p θ0. Condition 2 can also be stated in the form sup C T (θ) C(θ) θ Θ p 0 (8) Eduardo Rossi - Econometrics 10 11
12 Consistency Assumption C T is twice differentiable with respect to θ, at all interior points of Θ, with probability 1. The expectations E(C T ), E(g T ), and E(Q T ) exist, with uniformly in Θ. E(C T ) C E(g T ) g E(Q T ) Q Theorem Given the above assumptions and θ 0 int(θ), if θ 0 is the unique minimum of C then g(θ 0 ) = 0 and Q(θ 0 ) is positive definite. Proof If θ is an interior point of Θ, E[C T (θ)] = E[g T (θ)] (9) 2 E[C T (θ)] = E[Q T (θ)] (10) Eduardo Rossi - Econometrics 10 12
13 Consistency In fact, by the following theorem Theorem If: for fixed real θ, f(θ) is an integrable random variable; for almost all ω in the sample space, f(θ, ω) is a function of θ, differentiable at the point θ 0, with [f(θ 0 + h, ω) f(θ 0, ω)] h d(ω) (11) for all h in an open neighborhood of 0 not depending on ω, where d is an integrable random variable; Eduardo Rossi - Econometrics 10 13
14 Consistency then E ( df dθ θ=θ0 ) = de(f) dθ. (12) θ=θ0 This is called differentiation under the integral sign. E(g T (θ 0 )) = 0 E(Q T (θ 0 )) p.d.m. are necessary and sufficient for identification (unique local minimum of E(C T )). The result follows letting T tend to. Eduardo Rossi - Econometrics 10 14
15 Consistency It depends essentially on the vectors ψ t (θ), for if their average converges uniformly, this property will carry over to C T by Slutsky s Theorem, given that φ( ) is continuous. A sufficient condition on the sequences {ψ it (θ), t = 1, 2,...} for i = 1,...,r is stochastic uniform equicontinuity (ψ it (θ) uniformly continuous, not merely for every finite t, but also in the limit). Eduardo Rossi - Econometrics 10 15
16 Identification Condition 3 is called identification condition, ensuring the problem is properly specified. If condition 3 is satisfied for a given θ 0, this defines the probability limit of the estimator by construction. The basic requirement for a consistent estimator is that the structure can be distinguished from alternative possibilities, given sufficient data. This requirement fails when there is observational equivalence. Eduardo Rossi - Econometrics 10 16
17 Identification Definition. Structures θ 1 and θ 2 are said to be observationally equivalent with respect to C T if for every ε > 0 there exists h ε 1 such that for all T T ε P( C T (θ 1 ) C T (θ 2 ) < ε) > 1 ε (13) The criterion changes by only an arbitrarily small amount between point θ 1 and θ 2 of Θ, with probability close to 1. In almost every sample of size exceeding T ε, it is not possible to distinguish between the two structures using C T. Eduardo Rossi - Econometrics 10 17
18 Identification Definition The true structure θ 0 is said to be globally (locally) identified by C T if no other point in Θ (in an open neighborhood of θ 0 ) is observationally equivalent to θ 0 with respect to C T. Identification by C T is equivalent to condition 3 in the following sense: Theorem Let C T (θ) p C(θ) uniformly in Θ and let θ 0 be a global (local) minimum of C(θ). The minimum is unique (unique in an open neighborhood of θ 0 if and only if θ 0 is asymptotically globally (locally) identified by C T. Eduardo Rossi - Econometrics 10 18
19 Identification Local identification and global identification coincide when C T is qudratic in θ, so that any minimum is known to be unique. Eduardo Rossi - Econometrics 10 19
20 Asymptotic Normality The form of the criterion function, with assumptions on the data series, must be such as to lead to the result L TgT (θ 0 ) N(0,A 0 ) A 0 = lim T TE[g T(θ 0 )g T (θ 0 ) ] while, under the assumption of consistency g T (θ 0 ) p 0 (14) To obtain this CLT the vector in question must have the following generic form g T (θ 0 ) = J T 1 T T t=1 v t (15) Eduardo Rossi - Econometrics 10 20
21 Asymptotic Normality where J T, (p q), is a random matrix J T p J J is a finite limit and E[v t ] = 0 (q 1) The essential step is a quadratic approximation argument based on an application of the mean value theorem. Theorem If TgT (θ 0 ) L N(0,A 0 ) and Q T (θ) p Q(θ) Eduardo Rossi - Econometrics 10 21
22 Asymptotic Normality uniformly in a neighborhood of θ 0, then T( θt θ 0 ) asy Q 0 1 Tg T (θ 0 ) L N(0,V 0 ) where V 0 = Q 0 1 A 0 Q 0 1. Eduardo Rossi - Econometrics 10 22
23 Asymptotic Normality To prove the theorem we need the following Lemma. If Y T (θ) is a stochastic function of θ, Y T (θ) p Y (θ) uniformly in an open neighbourhood of θ 0, and θ T p θ0, then Y T ( θ T ) p Y (θ 0 ) this can be thought of as an extension of Slutsky s Theorem. In this case there is a sequence of stochastic functions (i.e., functions depending on random variables other than θ T ) converging to a limit. Eduardo Rossi - Econometrics 10 23
24 Asymptotic Normality Slutsky s Theorem Let {X T } be a random sequence converging in probability to a constant a, and let g( ) be a function continuous at a. Then g(x T ) p g(a) Cramer s Theorem Let {Y T } and {X T } be random sequences, with Y T d Y and XT p a (a constant). Then 1. X T + Y T d a + Y 2. X T Y T d ay 3. Y T X T d Y a when a 0. Cramér-Wold device If {X T } is a sequence of random vectors, X T D X if and only if for all conformable fixed vectors λ, λ X T D λ X. Eduardo Rossi - Econometrics 10 24
25 Asymptotic Normality Proof Letting g Ti denote the i-th element of g T, and g Ti ( θ T ) = 0 by definition of θ T, the mean value theorem yields g Ti (θ 0 ) + ( g Ti θ=θ Ti ) ( θ T θ 0 ) = 0 i = 1,...,p where the vector θti is θti = θ 0 + λ i ( θ T θ 0 ) for 0 λ i 1 Stacking these equations up to form a column vector g T (θ 0 ) + Q T( θ T θ 0 ) = 0 (p 1) where Q T denotes Q T with row i evaluated at the point θti i. for each Eduardo Rossi - Econometrics 10 25
26 Asymptotic Normality After mulpiplying by T [ ] T g T (θ 0 ) + Q T( θ T θ 0 ) = 0 T( θt θ 0 ) = (Q T) 1 Tg T (θ 0 ) Since θ T θ Ti p θ0 p θ 0 i If follows from Q T (θ) p Q(θ) and the Lemma that Q T p Q(θ 0 ) Finally, from the Cramer s Theorem follows that (Q T) 1 Tg T (θ 0 ) d Q(θ 0 ) 1 W Eduardo Rossi - Econometrics 10 26
27 Asymptotic Normality where W N(0,A 0 ) then T( θt θ 0 ) d N(0,Q(θ 0 ) 1 A 0 Q(θ 0 ) 1 ) noting that Q(θ 0 ) is symmetric. Eduardo Rossi - Econometrics 10 27
28 Estimation of Covariance Matrices To construct confidence intervals and test hypotheses, requires replacing A 0 and Q 0 with consistent estimates. The estimator of Q 0 is Q T ( θ). Assume then A 0 = lim T TE[g T(θ 0 )g T (θ 0 ) ] 1 T T t=1 v t d N(0,B0 ) TgT (θ 0 ) d N(0,JB 0 J ) and A 0 = JB 0 J Eduardo Rossi - Econometrics 10 28
29 Estimation of Covariance Matrices In practice v t (θ) must be replaced by v t ( θ), B = 1 T T E[v t v T s] = 1 T t=1 s=1 T E[v t v t] + 1 T t=1 T E[v t v t 1 + v t 1 v t] + t=2 T E[v t v t 2 + v t 2 v t] t= T E[v Tv 1 + v 1 v T] If v t is an uncorrelated sequence, like vector martingale sequence (e.g. vector white noise) and serially independent series E[v t v s] = 0 t s in this case B T = 1 T T t=1 v t v t Eduardo Rossi - Econometrics 10 29
30 Estimation of Covariance Matrices In incompletely specified dynamic models, the orthogonality of the terms cannot be assumed. We can t use the direct sample counterpart, removing the expected value simply gives 1 T T t=1 T v t v s s=1 which is of rank 1 for any T, and does not converge in probability. B < implies that each of the sequences {E[v t v t m], m = 1, 2, 3,...} is summable. Many of E[v t v t j + v t jv t] are zero or close to. Eduardo Rossi - Econometrics 10 30
31 Estimation of Covariance Matrices Newey and West (1987): B T = 1 T v t v t + T t=1 T 1 j=1 w Tj T t=j+1 ( v t v t j + v t j v t) where w Tj = k(j/m T ) for some function k(x) that is suitably close to 0 for large values of x. m T, called the bandwidth, is a function increasing to infinity with T, although more slowly. Setting 1 x 1 k(x) = 0 otherwise omits terms involving lags larger than m T. Eduardo Rossi - Econometrics 10 31
32 Estimation of Covariance Matrices k( ) is a kernel function. Bartlett 1 x x 1 k(x) = 0 otherwise Parzen k(x) = 1 6x x 3 x 1 2 2(1 x ) x 1 0 otherwise The role of kernel is to taper the contribution of the longer lags smoothly to zero, rather than cutting it off abruptly. The kernel estimators are consistent estimators of B but the estimate may not be positive semidefinite in finite samples. Eduardo Rossi - Econometrics 10 32
Estimation of Dynamic Regression Models
University of Pavia 2007 Estimation of Dynamic Regression Models Eduardo Rossi University of Pavia Factorization of the density DGP: D t (x t χ t 1, d t ; Ψ) x t represent all the variables in the economy.
More informationAsymptotic distribution of GMM Estimator
Asymptotic distribution of GMM Estimator Eduardo Rossi University of Pavia Econometria finanziaria 2010 Rossi (2010) GMM 2010 1 / 45 Outline 1 Asymptotic Normality of the GMM Estimator 2 Long Run Covariance
More informationMaximum Likelihood Asymptotic Theory. Eduardo Rossi University of Pavia
Maximum Likelihood Asymtotic Theory Eduardo Rossi University of Pavia Slutsky s Theorem, Cramer s Theorem Slutsky s Theorem Let {X N } be a random sequence converging in robability to a constant a, and
More informationThe properties of L p -GMM estimators
The properties of L p -GMM estimators Robert de Jong and Chirok Han Michigan State University February 2000 Abstract This paper considers Generalized Method of Moment-type estimators for which a criterion
More informationFollow links for Class Use and other Permissions. For more information send to:
COPYRIGH NOICE: Kenneth J. Singleton: Empirical Dynamic Asset Pricing is published by Princeton University Press and copyrighted, 00, by Princeton University Press. All rights reserved. No part of this
More informationClosest Moment Estimation under General Conditions
Closest Moment Estimation under General Conditions Chirok Han and Robert de Jong January 28, 2002 Abstract This paper considers Closest Moment (CM) estimation with a general distance function, and avoids
More informationThe generalized method of moments
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna February 2008 Based on the book Generalized Method of Moments by Alastair R. Hall (2005), Oxford
More informationChapter 4: Asymptotic Properties of the MLE
Chapter 4: Asymptotic Properties of the MLE Daniel O. Scharfstein 09/19/13 1 / 1 Maximum Likelihood Maximum likelihood is the most powerful tool for estimation. In this part of the course, we will consider
More informationUnderstanding Regressions with Observations Collected at High Frequency over Long Span
Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University
More informationClosest Moment Estimation under General Conditions
Closest Moment Estimation under General Conditions Chirok Han Victoria University of Wellington New Zealand Robert de Jong Ohio State University U.S.A October, 2003 Abstract This paper considers Closest
More informationOnline Appendix. j=1. φ T (ω j ) vec (EI T (ω j ) f θ0 (ω j )). vec (EI T (ω) f θ0 (ω)) = O T β+1/2) = o(1), M 1. M T (s) exp ( isω)
Online Appendix Proof of Lemma A.. he proof uses similar arguments as in Dunsmuir 979), but allowing for weak identification and selecting a subset of frequencies using W ω). It consists of two steps.
More informationLECTURE ON HAC COVARIANCE MATRIX ESTIMATION AND THE KVB APPROACH
LECURE ON HAC COVARIANCE MARIX ESIMAION AND HE KVB APPROACH CHUNG-MING KUAN Institute of Economics Academia Sinica October 20, 2006 ckuan@econ.sinica.edu.tw www.sinica.edu.tw/ ckuan Outline C.-M. Kuan,
More informationSection 8.2. Asymptotic normality
30 Section 8.2. Asymptotic normality We assume that X n =(X 1,...,X n ), where the X i s are i.i.d. with common density p(x; θ 0 ) P= {p(x; θ) :θ Θ}. We assume that θ 0 is identified in the sense that
More informationWeak convergence. Amsterdam, 13 November Leiden University. Limit theorems. Shota Gugushvili. Generalities. Criteria
Weak Leiden University Amsterdam, 13 November 2013 Outline 1 2 3 4 5 6 7 Definition Definition Let µ, µ 1, µ 2,... be probability measures on (R, B). It is said that µ n converges weakly to µ, and we then
More informationAn estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic
Chapter 6 ESTIMATION OF THE LONG-RUN COVARIANCE MATRIX An estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic standard errors for the OLS and linear IV estimators presented
More informationProofs for Large Sample Properties of Generalized Method of Moments Estimators
Proofs for Large Sample Properties of Generalized Method of Moments Estimators Lars Peter Hansen University of Chicago March 8, 2012 1 Introduction Econometrica did not publish many of the proofs in my
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationA Local Generalized Method of Moments Estimator
A Local Generalized Method of Moments Estimator Arthur Lewbel Boston College June 2006 Abstract A local Generalized Method of Moments Estimator is proposed for nonparametrically estimating unknown functions
More informationGMM, HAC estimators, & Standard Errors for Business Cycle Statistics
GMM, HAC estimators, & Standard Errors for Business Cycle Statistics Wouter J. Den Haan London School of Economics c Wouter J. Den Haan Overview Generic GMM problem Estimation Heteroskedastic and Autocorrelation
More informationGMM Estimation and Testing
GMM Estimation and Testing Whitney Newey July 2007 Idea: Estimate parameters by setting sample moments to be close to population counterpart. Definitions: β : p 1 parameter vector, with true value β 0.
More informationEconometrics II - EXAM Outline Solutions All questions have 25pts Answer each question in separate sheets
Econometrics II - EXAM Outline Solutions All questions hae 5pts Answer each question in separate sheets. Consider the two linear simultaneous equations G with two exogeneous ariables K, y γ + y γ + x δ
More informationMaximum Likelihood Estimation
University of Pavia Maximum Likelihood Estimation Eduardo Rossi Likelihood function Choosing parameter values that make what one has observed more likely to occur than any other parameter values do. Assumption(Distribution)
More information2 Statistical Estimation: Basic Concepts
Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 2 Statistical Estimation:
More informationNonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix
Nonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix Yingying Dong and Arthur Lewbel California State University Fullerton and Boston College July 2010 Abstract
More informationGMM - Generalized method of moments
GMM - Generalized method of moments GMM Intuition: Matching moments You want to estimate properties of a data set {x t } T t=1. You assume that x t has a constant mean and variance. x t (µ 0, σ 2 ) Consider
More informationGMM and SMM. 1. Hansen, L Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p
GMM and SMM Some useful references: 1. Hansen, L. 1982. Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p. 1029-54. 2. Lee, B.S. and B. Ingram. 1991 Simulation estimation
More informationThe Uniform Weak Law of Large Numbers and the Consistency of M-Estimators of Cross-Section and Time Series Models
The Uniform Weak Law of Large Numbers and the Consistency of M-Estimators of Cross-Section and Time Series Models Herman J. Bierens Pennsylvania State University September 16, 2005 1. The uniform weak
More informationChapter 3. Point Estimation. 3.1 Introduction
Chapter 3 Point Estimation Let (Ω, A, P θ ), P θ P = {P θ θ Θ}be probability space, X 1, X 2,..., X n : (Ω, A) (IR k, B k ) random variables (X, B X ) sample space γ : Θ IR k measurable function, i.e.
More informationInstrumental Variables
Università di Pavia 2010 Instrumental Variables Eduardo Rossi Exogeneity Exogeneity Assumption: the explanatory variables which form the columns of X are exogenous. It implies that any randomness in the
More informationEconomic modelling and forecasting
Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation
More informationReview of Classical Least Squares. James L. Powell Department of Economics University of California, Berkeley
Review of Classical Least Squares James L. Powell Department of Economics University of California, Berkeley The Classical Linear Model The object of least squares regression methods is to model and estimate
More informationFunctional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...
Functional Analysis Franck Sueur 2018-2019 Contents 1 Metric spaces 1 1.1 Definitions........................................ 1 1.2 Completeness...................................... 3 1.3 Compactness......................................
More informationA GENERAL THEOREM ON APPROXIMATE MAXIMUM LIKELIHOOD ESTIMATION. Miljenko Huzak University of Zagreb,Croatia
GLASNIK MATEMATIČKI Vol. 36(56)(2001), 139 153 A GENERAL THEOREM ON APPROXIMATE MAXIMUM LIKELIHOOD ESTIMATION Miljenko Huzak University of Zagreb,Croatia Abstract. In this paper a version of the general
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationSystem Identification, Lecture 4
System Identification, Lecture 4 Kristiaan Pelckmans (IT/UU, 2338) Course code: 1RT880, Report code: 61800 - Spring 2012 F, FRI Uppsala University, Information Technology 30 Januari 2012 SI-2012 K. Pelckmans
More informationChapter 6. Convergence. Probability Theory. Four different convergence concepts. Four different convergence concepts. Convergence in probability
Probability Theory Chapter 6 Convergence Four different convergence concepts Let X 1, X 2, be a sequence of (usually dependent) random variables Definition 1.1. X n converges almost surely (a.s.), or with
More informationJoint Parameter Estimation of the Ornstein-Uhlenbeck SDE driven by Fractional Brownian Motion
Joint Parameter Estimation of the Ornstein-Uhlenbeck SDE driven by Fractional Brownian Motion Luis Barboza October 23, 2012 Department of Statistics, Purdue University () Probability Seminar 1 / 59 Introduction
More informationSystem Identification, Lecture 4
System Identification, Lecture 4 Kristiaan Pelckmans (IT/UU, 2338) Course code: 1RT880, Report code: 61800 - Spring 2016 F, FRI Uppsala University, Information Technology 13 April 2016 SI-2016 K. Pelckmans
More informationChapter 4. Theory of Tests. 4.1 Introduction
Chapter 4 Theory of Tests 4.1 Introduction Parametric model: (X, B X, P θ ), P θ P = {P θ θ Θ} where Θ = H 0 +H 1 X = K +A : K: critical region = rejection region / A: acceptance region A decision rule
More informationSpring 2017 Econ 574 Roger Koenker. Lecture 14 GEE-GMM
University of Illinois Department of Economics Spring 2017 Econ 574 Roger Koenker Lecture 14 GEE-GMM Throughout the course we have emphasized methods of estimation and inference based on the principle
More informationAnalogy Principle. Asymptotic Theory Part II. James J. Heckman University of Chicago. Econ 312 This draft, April 5, 2006
Analogy Principle Asymptotic Theory Part II James J. Heckman University of Chicago Econ 312 This draft, April 5, 2006 Consider four methods: 1. Maximum Likelihood Estimation (MLE) 2. (Nonlinear) Least
More informationGeneralized Method of Moments Estimation
Generalized Method of Moments Estimation Lars Peter Hansen March 0, 2007 Introduction Generalized methods of moments (GMM) refers to a class of estimators which are constructed from exploiting the sample
More informationEstimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators
Estimation theory Parametric estimation Properties of estimators Minimum variance estimator Cramer-Rao bound Maximum likelihood estimators Confidence intervals Bayesian estimation 1 Random Variables Let
More informationGeneralized Method of Moments (GMM) Estimation
Econometrics 2 Fall 2004 Generalized Method of Moments (GMM) Estimation Heino Bohn Nielsen of29 Outline of the Lecture () Introduction. (2) Moment conditions and methods of moments (MM) estimation. Ordinary
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More informationENEE 621 SPRING 2016 DETECTION AND ESTIMATION THEORY THE PARAMETER ESTIMATION PROBLEM
c 2007-2016 by Armand M. Makowski 1 ENEE 621 SPRING 2016 DETECTION AND ESTIMATION THEORY THE PARAMETER ESTIMATION PROBLEM 1 The basic setting Throughout, p, q and k are positive integers. The setup With
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot November 2, 2011 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationMeasuring the Sensitivity of Parameter Estimates to Estimation Moments
Measuring the Sensitivity of Parameter Estimates to Estimation Moments Isaiah Andrews MIT and NBER Matthew Gentzkow Stanford and NBER Jesse M. Shapiro Brown and NBER March 2017 Online Appendix Contents
More informationComputation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy
Computation Of Asymptotic Distribution For Semiparametric GMM Estimators Hidehiko Ichimura Graduate School of Public Policy and Graduate School of Economics University of Tokyo A Conference in honor of
More informationHigh Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data
High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data Song Xi CHEN Guanghua School of Management and Center for Statistical Science, Peking University Department
More informationAsymptotic distributions of the quadratic GMM estimator in linear dynamic panel data models
Asymptotic distributions of the quadratic GMM estimator in linear dynamic panel data models By Tue Gørgens Chirok Han Sen Xue ANU Working Papers in Economics and Econometrics # 635 May 2016 JEL: C230 ISBN:
More information1 Outline. 1. Motivation. 2. SUR model. 3. Simultaneous equations. 4. Estimation
1 Outline. 1. Motivation 2. SUR model 3. Simultaneous equations 4. Estimation 2 Motivation. In this chapter, we will study simultaneous systems of econometric equations. Systems of simultaneous equations
More informationHölder regularity estimation by Hart Smith and Curvelet transforms
Hölder regularity estimation by Hart Smith and Curvelet transforms Jouni Sampo Lappeenranta University Of Technology Department of Mathematics and Physics Finland 18th September 2007 This research is done
More informationLECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes.
MAY, 0 LECTURE 0 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA In this lecture, we continue to discuss covariance stationary processes. Spectral density Gourieroux and Monfort 990), Ch. 5;
More informationMore Empirical Process Theory
More Empirical Process heory 4.384 ime Series Analysis, Fall 2008 Recitation by Paul Schrimpf Supplementary to lectures given by Anna Mikusheva October 24, 2008 Recitation 8 More Empirical Process heory
More informationDepartment of Economics, Boston University. Department of Economics, Boston University
Supplementary Material Supplement to Identification and frequency domain quasi-maximum likelihood estimation of linearized dynamic stochastic general equilibrium models : Appendix (Quantitative Economics,
More informationExogeneity and Causality
Università di Pavia Exogeneity and Causality Eduardo Rossi University of Pavia Factorization of the density DGP: D t (x t χ t 1, d t ; Ψ) x t represent all the variables in the economy. The econometric
More informationNotes for Functional Analysis
Notes for Functional Analysis Wang Zuoqin (typed by Xiyu Zhai) September 29, 2015 1 Lecture 09 1.1 Equicontinuity First let s recall the conception of equicontinuity for family of functions that we learned
More informationA strong consistency proof for heteroscedasticity and autocorrelation consistent covariance matrix estimators
A strong consistency proof for heteroscedasticity and autocorrelation consistent covariance matrix estimators Robert M. de Jong Department of Economics Michigan State University 215 Marshall Hall East
More informationLasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices
Article Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices Fei Jin 1,2 and Lung-fei Lee 3, * 1 School of Economics, Shanghai University of Finance and Economics,
More informationChapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools. Joan Llull. Microeconometrics IDEA PhD Program
Chapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools Joan Llull Microeconometrics IDEA PhD Program Maximum Likelihood Chapter 1. A Brief Review of Maximum Likelihood, GMM, and Numerical
More informationGARCH Models Estimation and Inference
Università di Pavia GARCH Models Estimation and Inference Eduardo Rossi Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationGARCH Models Estimation and Inference. Eduardo Rossi University of Pavia
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationThe Arzelà-Ascoli Theorem
John Nachbar Washington University March 27, 2016 The Arzelà-Ascoli Theorem The Arzelà-Ascoli Theorem gives sufficient conditions for compactness in certain function spaces. Among other things, it helps
More informationInference for Subsets of Parameters in Partially Identified Models
Inference for Subsets of Parameters in Partially Identified Models Kyoo il Kim University of Minnesota June 2009, updated November 2010 Preliminary and Incomplete Abstract We propose a confidence set for
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationQuantile methods. Class Notes Manuel Arellano December 1, Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be
Quantile methods Class Notes Manuel Arellano December 1, 2009 1 Unconditional quantiles Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be Q τ (Y ) q τ F 1 (τ) =inf{r : F
More informationTesting in GMM Models Without Truncation
Testing in GMM Models Without Truncation TimothyJ.Vogelsang Departments of Economics and Statistical Science, Cornell University First Version August, 000; This Version June, 001 Abstract This paper proposes
More informationFrequentist-Bayesian Model Comparisons: A Simple Example
Frequentist-Bayesian Model Comparisons: A Simple Example Consider data that consist of a signal y with additive noise: Data vector (N elements): D = y + n The additive noise n has zero mean and diagonal
More informationGeneral Notation. Exercises and Problems
Exercises and Problems The text contains both Exercises and Problems. The exercises are incorporated into the development of the theory in each section. Additional Problems appear at the end of most sections.
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 08: Stochastic Convergence
Introduction to Empirical Processes and Semiparametric Inference Lecture 08: Stochastic Convergence Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations
More informationStochastic Convergence, Delta Method & Moment Estimators
Stochastic Convergence, Delta Method & Moment Estimators Seminar on Asymptotic Statistics Daniel Hoffmann University of Kaiserslautern Department of Mathematics February 13, 2015 Daniel Hoffmann (TU KL)
More informationConvex Analysis and Optimization Chapter 2 Solutions
Convex Analysis and Optimization Chapter 2 Solutions Dimitri P. Bertsekas with Angelia Nedić and Asuman E. Ozdaglar Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More informationMultivariate Analysis and Likelihood Inference
Multivariate Analysis and Likelihood Inference Outline 1 Joint Distribution of Random Variables 2 Principal Component Analysis (PCA) 3 Multivariate Normal Distribution 4 Likelihood Inference Joint density
More information1 Background and Review Material
1 Background and Review Material 1.1 Vector Spaces Let V be a nonempty set and consider the following two operations on elements of V : (x,y) x + y maps V V V (addition) (1.1) (α, x) αx maps F V V (scalar
More informationStatistical Inference of Moment Structures
1 Handbook of Computing and Statistics with Applications, Vol. 1 ISSN: 1871-0301 2007 Elsevier B.V. All rights reserved DOI: 10.1016/S1871-0301(06)01011-0 1 Statistical Inference of Moment Structures Alexander
More informationProblem Set 5. 2 n k. Then a nk (x) = 1+( 1)k
Problem Set 5 1. (Folland 2.43) For x [, 1), let 1 a n (x)2 n (a n (x) = or 1) be the base-2 expansion of x. (If x is a dyadic rational, choose the expansion such that a n (x) = for large n.) Then the
More informationLarge Sample Properties of Estimators in the Classical Linear Regression Model
Large Sample Properties of Estimators in the Classical Linear Regression Model 7 October 004 A. Statement of the classical linear regression model The classical linear regression model can be written in
More informationStatistical Properties of Numerical Derivatives
Statistical Properties of Numerical Derivatives Han Hong, Aprajit Mahajan, and Denis Nekipelov Stanford University and UC Berkeley November 2010 1 / 63 Motivation Introduction Many models have objective
More informationProblem Set 2 Solution
Problem Set 2 Solution Aril 22nd, 29 by Yang. More Generalized Slutsky heorem [Simle and Abstract] su L n γ, β n Lγ, β = su L n γ, β n Lγ, β n + Lγ, β n Lγ, β su L n γ, β n Lγ, β n + su Lγ, β n Lγ, β su
More information1 Math 241A-B Homework Problem List for F2015 and W2016
1 Math 241A-B Homework Problem List for F2015 W2016 1.1 Homework 1. Due Wednesday, October 7, 2015 Notation 1.1 Let U be any set, g be a positive function on U, Y be a normed space. For any f : U Y let
More informationMissing dependent variables in panel data models
Missing dependent variables in panel data models Jason Abrevaya Abstract This paper considers estimation of a fixed-effects model in which the dependent variable may be missing. For cross-sectional units
More information1 Extremum Estimators
FINC 9311-21 Financial Econometrics Handout Jialin Yu 1 Extremum Estimators Let θ 0 be a vector of k 1 unknown arameters. Extremum estimators: estimators obtained by maximizing or minimizing some objective
More informationWooldridge, Introductory Econometrics, 4th ed. Appendix C: Fundamentals of mathematical statistics
Wooldridge, Introductory Econometrics, 4th ed. Appendix C: Fundamentals of mathematical statistics A short review of the principles of mathematical statistics (or, what you should have learned in EC 151).
More informationPrinciples of Real Analysis I Fall VII. Sequences of Functions
21-355 Principles of Real Analysis I Fall 2004 VII. Sequences of Functions In Section II, we studied sequences of real numbers. It is very useful to consider extensions of this concept. More generally,
More informationWorking Paper No Maximum score type estimators
Warsaw School of Economics Institute of Econometrics Department of Applied Econometrics Department of Applied Econometrics Working Papers Warsaw School of Economics Al. iepodleglosci 64 02-554 Warszawa,
More informationEC 521 MATHEMATICAL METHODS FOR ECONOMICS. Lecture 1: Preliminaries
EC 521 MATHEMATICAL METHODS FOR ECONOMICS Lecture 1: Preliminaries Murat YILMAZ Boğaziçi University In this lecture we provide some basic facts from both Linear Algebra and Real Analysis, which are going
More informationProblems for Chapter 3.
Problems for Chapter 3. Let A denote a nonempty set of reals. The complement of A, denoted by A, or A C is the set of all points not in A. We say that belongs to the interior of A, Int A, if there eists
More informationMODEL COMPARISON CHRISTOPHER A. SIMS PRINCETON UNIVERSITY
ECO 513 Fall 2008 MODEL COMPARISON CHRISTOPHER A. SIMS PRINCETON UNIVERSITY SIMS@PRINCETON.EDU 1. MODEL COMPARISON AS ESTIMATING A DISCRETE PARAMETER Data Y, models 1 and 2, parameter vectors θ 1, θ 2.
More informationBerge s Maximum Theorem
Berge s Maximum Theorem References: Acemoglu, Appendix A.6 Stokey-Lucas-Prescott, Section 3.3 Ok, Sections E.1-E.3 Claude Berge, Topological Spaces (1963), Chapter 6 Berge s Maximum Theorem So far, we
More informationAsymptotics for Nonlinear GMM
Asymptotics for Nonlinear GMM Eric Zivot February 13, 2013 Asymptotic Properties of Nonlinear GMM Under standard regularity conditions (to be discussed later), it can be shown that where ˆθ(Ŵ) θ 0 ³ˆθ(Ŵ)
More informationStability of Stochastic Differential Equations
Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
More informationNonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1
Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium
More informationIntegration on Measure Spaces
Chapter 3 Integration on Measure Spaces In this chapter we introduce the general notion of a measure on a space X, define the class of measurable functions, and define the integral, first on a class of
More informationLinear models. Linear models are computationally convenient and remain widely used in. applied econometric research
Linear models Linear models are computationally convenient and remain widely used in applied econometric research Our main focus in these lectures will be on single equation linear models of the form y
More informationLECTURE 7. k=1 (, v k)u k. Moreover r
LECTURE 7 Finite rank operators Definition. T is said to be of rank r (r < ) if dim T(H) = r. The class of operators of rank r is denoted by K r and K := r K r. Theorem 1. T K r iff T K r. Proof. Let T
More informationGARCH Models Estimation and Inference
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in
More information