Maximum Likelihood (ML) Estimation
|
|
- Francine Franklin
- 6 years ago
- Views:
Transcription
1 Econometrics 2 Fall 2004 Maximum Likelihood (ML) Estimation Heino Bohn Nielsen 1of32 Outline of the Lecture (1) Introduction. (2) ML estimation defined. (3) ExampleI:Binomialtrials. (4) Example II: Linear regression. (5) Pseudo-ML estimation. (6) Test principles. Wald test. Likelihood ratio (LR) test. Lagrange multiplier (LM) test or score test. 2of32
2 Introduction: GMM and ML Consider stochastic variables (1 1) and ( 1) and the observations µ 12 Assume that we have a conditional model for in mind. GMM derives moment conditions [( )] 0. The sample moments () 1 X ( ) links to the data. The GMM estimator, b, minimizes () 0 (). Maximum likelihood (ML) assumes knowledge of the distribution density() up to unknown parameters,. The ML estimator, b, maximizes the probability of the data given density. 3of32 The Likelihood Principle The probability of observing given is given by the conditional density ( ; ) If the observations are i.i.d., the probability of 1 (given ) is ( 1 2 ; ) Y ( ; ) The likelihood function for the sample is defined as Y Y ( ; ) ( 1 2 ; ) ( ; ) ( ; ) where () is called the likelihood contribution for observation. The ML estimator b is chosen to maximize ( ; ). 4of32
3 The ML Estimator Easier to maximize the log-likelihood function Define the score vector as () ( 1) log () log () X log ( ; ) X where () is the score for each observation. log () X () The first order conditions, the so-called likelihood equations, states ( b log () X ) log () X ( b b )0 b Might be dicult to solve in practice. Use numerical optimization. 5of32 Properties of ML Given correct specification (and weak regularity conditions): The ML estimator is consistent, plim b. The ML estimator is asymptotically normal ³ b (0) where () 1 µ 2 1 log () 0 The negative expected Hessian, (), is called the information matrix. The more curvature of the likelihood function, the more precision. The ML estimator is asymptotically ecient. All other consistent and asymptotically normal estimators will have an asymptotic variance larger than () 1. () 1 is denoted the Cramèr-Rao lower bound. 6of32
4 Asymptotic Inference Asymptotic inference can be based on b where b is a consistent estimate of. µ 1 b One possibility is the sample average of second derivatives à b 1 X ( ) 2 log () 0 b! 1 It can be shown than [ () () 0 ](). An alternative estimator is the outer-product-of-the-scores Ã! 1 b 1 X ( b ) ( b ) 0 7of32 Joint and Conditional Distributions Aboveweconsideredamodelfor corresponding to the conditional distribution, ( ; ). From a statistical point of view a natural alternative would be a model for all the data ( 0 ) 0, corresponding to the joint density, ( ). Recall the factorization ( ) ( ; ) ( ) If the two sets of parameters, and, are not related (and is exogenous in a certain sense), we can estimate in the conditional model ( ; ) ( ) ( ) 8of32
5 Time Series (Non-i.i.d.) Data and Factorization The multiplicative form ( 1 2 ; ) Y ( ; ) follows from the i.i.d. assumption, which cannot be made for many time series. For a time series, the object of interest is often [ 1 1 ]. This can be used to factorize the likelihood function. Recall again that ( 1 2 ) ( 1 1 ; ) ( ) Y ( 1 ) ( 1 1 ; ) Conditioning on the first observation, 1, gives a multiplicative structure 2 ( 2 1 ; ) ( 1 2 ) ( 1 ) Y ( 1 1 ; ) 2 9of32 Example I: Binomial Trials Consider random draws from a pool of red and blue balls. We are interested in the proportion of red balls,. Let ½ 1 if a ball is red 0 if a ball is blue Consideradatasetof draws 1 2 e.g The model implies that prob( 1) and prob( 0)1 The density function for is given by the Binomial ( ) (1 ) (1) 10 of 32
6 Since the draws are independent, the likelihood function is given by Y () ( ) and the log-likelihood function is Y (1 ) (1) X log () [ log()+(1 ) log (1 )] The ML estimator, b, is chosen to maximize this expression. The score for an individual observation is given by () log () of 32 The likelihood equation is given by the first order condition X X () () This implies that P P 1 Ã! X X (1 ) X X X b P 12 of 32
7 The second derivative is 2 log () µ (1 ) 2 Using that [ ], theinformation is given by 2 log () () 1 2 (1 ) (1 ) (1 ) + (1 ) 1 (1 ) 13 of 32 Inference on can be based on b µ 1 b (1 b ) ML estimation can easily be done in PcGive using numerical optimization. Specify actual: fitted: Nothing in this case. loglik: log ( ) log()+(1 ) log (1 ) Initial value for the parameters, denoted &0,&1,...,&k. In our case (where the data series is denoted Bin): actual Bin; fitted 0; loglik actual*log(&0)+(1-actual)*log(1-&0); &0 0.5; 14 of 32
8 Example II: Linear Regression Consider a linear regression model Make the following assumptions [ ] 0 () [ 0 ] 2 () () is a moment condition. The models is the conditional expectation. () excludes heteroscedasticity and autocorrelation. For ML estimation, we have to specify a distribution for.assumethat (0 2 ) This implies that ( 0 2 ) 15 of 32 The probability of observing given the model is the density ( ) ; 2 1 exp 1 ( 0 ) Since the observations are assumed i.i.d. the probability of 1 is 1 2 ; 2 Y ; 2 µ ( ) Y exp 1 ( 0 ) of 32
9 The likelihood function is given by 2 µ ( ) Y exp 1 ( 0 ) The log-likelihood function is log 2 2 log X 2 ( 0 ) 2 The ML estimators b and b 2 are chosen to maximize this expression of 32 The likelihood contributions are log log ( 0 ) 2 The individual scores are given by the first derivatives! Ã 2 2 (+1) Ã log ( 2 ) log ( 2 ) 2 2 ( 0 ) ( 0 ) 2 4! The first order conditions are given by () X Ã P 2 ( 0 ) P ( 0 ) 2 4! µ of 32
10 The first condition: X X X ( 0 ) 0 0 implies à X! 1 X b 0 b Letting b ( 0 b ), the second condition yields 1 2 X b b 2 1 X b 2 which is slightly dierent from the OLS variance. The ML estimator of the variance is biased but consistent. 19 of 32 The second derivatives are given by 2 log ( 2 ) 0 ½ ( 0 ¾ ) 2 2 log ( 2 ) ½ ( 0 ¾ ) 2 2 ( 2 ) 2 log ( 2 ) ( 0 ) log ( 2 ) 2 0 ( ( 0 ) ) 0 2 ( 0 ) ( 0 ) That gives the information matrix à ( 2 ) Note that the information matrix is block diagonal.! µ 2 [ 0 ] of 32
11 Recall that µ b b 2 µµ 2 1 ()1 This implies b µ 2 ([ 0 ]) 1 where the variance can be estimated by b 2 Ã 1! 1 X 0 b 2 Ã X 1! 0 Furthermore b 2 µ of 32 Pseudo-ML Estimation The first order conditions for ML estimation can be seen as a sample counterpart to a moment condition 1 X () 0 corresponds to [ ()] 0 and ML becomes a special case of GMM. b is consistent for weaker assumptions than maintained by ML. The FOC for a normal regression model corresponds to [ ( 0 )] 0 which is weaker than the assumption that the entire distribution is correctly specified. OLS is consistent even if is not normal. A ML estimation that maximizes a likelihood function dierent from the true models likelihood is referred to as a pseudo-ml or a quasi-ml estimator. 22 of 32
12 Three Classical Test Principles Consider a null hypothesis of interest, 0, and an alternative,.e.g. 0 : ( ) against : 6. Let e and b denote the ML estimates under 0 and respectively Wald test. Estimates the model only under, and look at the distance b normalized by the covariance matrix. Likelihood ratio (LR) test. Estimate under 0 and under and look at the loss in likelihood log ( b ) log ( e ). Lagrange multiplier (LM) or score test. Estimate e under 0 and see if the FOCs P ( e )0are significantly violated. The tests are asymptotically equivalent. For the normal regression model in finite samples. 23 of 32 LogL( ) LR { LM { W 0 24 of 32
13 Wald Test Recall, that b 1,sothat b 1 0 If the null hypothesis is true, and a natural test statistic is ³ b 0 ³ b 0 1 ³ b Under the null this is distributed as 2 () An example is the ratio for 0 : 0 p b q 0 ( b ) (0 1) Requires only estimation under the alternative,. 25 of 32 Likelihood Ratio (LR) Test For the LR test we estimate both under 0 and under The LR test statistic is given by à ( 2 log e! ) ( b 2 ) where ( e ) and ( b ) are the two likelihood values. Under the null, this is asymptotically distributed as 2 () ³ log ( e ) log ( b ) The test is insensitive to how the model and restrictions are formulated. Test is only appropriate when the models are nested. 26 of 32
14 Lagrange Multiplier (LM) or Score Test Recall that the average score is zero at the unrestricted estimate If the restriction is true () ( e ) X ( b )0 X ( e ) 0 This can be tested by the quadratic form à X à X!! 1 à X! ( e )!ÃVariance 0 ( e ) ( e ) which under the null is 2 (). 27 of 32 Thevarianceoftheindividualscore, (), is the information matrix, () [ () () 0 ] which can be estimated as b ( e ) 1 X ( e ) ( e ) 0 The estimated variance of P ( b ) is therefore b ( e ) X ( e ) ( e ) 0 AndtheLMtestcanbewrittenas à X!à X! 1 à X ( e ) 0 ( e ) ( e ) 0 which will have a 2 () distribution under the null. ( e )! 28 of 32
15 Note, that the quadratic form is of dimension, but elements are unrestricted and P ( e )0for these elements. Hence a 2 (). Inthecasewherethenullhypothesisis 0 : 2 0,for µ µ 1 1 (), and () 2 2 () the LM statistic only depends on the scores corresponding to 2 : à X à X!! 1 à X! 2 ( e )!ÃVariance 0 2 ( e ) 2 ( e ) Note, however, that to calculate à X Variance 2 ( e )! 1 we need the full score vector, except if the covariance matrix is block-diagonal. 29 of 32 LM Tests by Auxiliary Regressions Define the matrix Then ( ) 1( e ) 0. ( e ) 0 X 0 (1 1) 0 ( 1) and ( 1) ( e ) 1. 1 X 0 ( e ) ( e ) 0 ( ) Therefore, we can write the LM statistic as à X!à X! 1 à X ( e ) 0 ( e ) ( e ) 0 0 ( 0 ) 1 0 ( e )! 30 of 32
16 Now consider the regression model + residual. () The OLS estimator and the predicted values are given by, respectively, b ( 0 ) 1 0 and b b ( 0 ) 1 0 The LM test can the written as 0 ( 0 ) ( 0 ) b0 b 0 ESS TSS 2 The regression () is not always the most convenient. Often, alternative auxiliary regressions are used. 31 of 32 Examples of LM tests in a linear regression based on 2 from auxiliary regressions: Test for omitted variables,.runtheregression b 0 + b 0 + residual, or b residual. Breuch-Godfrey test for no first order autocorrelation. Run the regression b b residual. Breuch-Pagan test for no heteroscedasticity. Run the regression b residual. 32 of 32
Maximum Likelihood Tests and Quasi-Maximum-Likelihood
Maximum Likelihood Tests and Quasi-Maximum-Likelihood Wendelin Schnedler Department of Economics University of Heidelberg 10. Dezember 2007 Wendelin Schnedler (AWI) Maximum Likelihood Tests and Quasi-Maximum-Likelihood10.
More informationIntroduction to Estimation Methods for Time Series models Lecture 2
Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:
More informationEcon 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE
Econ 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE Eric Zivot Winter 013 1 Wald, LR and LM statistics based on generalized method of moments estimation Let 1 be an iid sample
More informationDiscrete Dependent Variable Models
Discrete Dependent Variable Models James J. Heckman University of Chicago This draft, April 10, 2006 Here s the general approach of this lecture: Economic model Decision rule (e.g. utility maximization)
More informationGreene, Econometric Analysis (6th ed, 2008)
EC771: Econometrics, Spring 2010 Greene, Econometric Analysis (6th ed, 2008) Chapter 17: Maximum Likelihood Estimation The preferred estimator in a wide variety of econometric settings is that derived
More informationSpatial Regression. 9. Specification Tests (1) Luc Anselin. Copyright 2017 by Luc Anselin, All Rights Reserved
Spatial Regression 9. Specification Tests (1) Luc Anselin http://spatial.uchicago.edu 1 basic concepts types of tests Moran s I classic ML-based tests LM tests 2 Basic Concepts 3 The Logic of Specification
More informationBusiness Economics BUSINESS ECONOMICS. PAPER No. : 8, FUNDAMENTALS OF ECONOMETRICS MODULE No. : 3, GAUSS MARKOV THEOREM
Subject Business Economics Paper No and Title Module No and Title Module Tag 8, Fundamentals of Econometrics 3, The gauss Markov theorem BSE_P8_M3 1 TABLE OF CONTENTS 1. INTRODUCTION 2. ASSUMPTIONS OF
More informationGeneralized Method of Moments (GMM) Estimation
Econometrics 2 Fall 2004 Generalized Method of Moments (GMM) Estimation Heino Bohn Nielsen of29 Outline of the Lecture () Introduction. (2) Moment conditions and methods of moments (MM) estimation. Ordinary
More informationEksamen på Økonomistudiet 2006-II Econometrics 2 June 9, 2006
Eksamen på Økonomistudiet 2006-II Econometrics 2 June 9, 2006 This is a four hours closed-book exam (uden hjælpemidler). Please answer all questions. As a guiding principle the questions 1 to 4 have equal
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 3 Jakub Mućk Econometrics of Panel Data Meeting # 3 1 / 21 Outline 1 Fixed or Random Hausman Test 2 Between Estimator 3 Coefficient of determination (R 2
More informationLECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test.
Economics 52 Econometrics Professor N.M. Kiefer LECTURE 1: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING NEYMAN-PEARSON LEMMA: Lesson: Good tests are based on the likelihood ratio. The proof is easy in the
More informationMax. Likelihood Estimation. Outline. Econometrics II. Ricardo Mora. Notes. Notes
Maximum Likelihood Estimation Econometrics II Department of Economics Universidad Carlos III de Madrid Máster Universitario en Desarrollo y Crecimiento Económico Outline 1 3 4 General Approaches to Parameter
More informationLarge Sample Properties of Estimators in the Classical Linear Regression Model
Large Sample Properties of Estimators in the Classical Linear Regression Model 7 October 004 A. Statement of the classical linear regression model The classical linear regression model can be written in
More informationLinear Regression with Time Series Data
Econometrics 2 Linear Regression with Time Series Data Heino Bohn Nielsen 1of21 Outline (1) The linear regression model, identification and estimation. (2) Assumptions and results: (a) Consistency. (b)
More informationChapter 4: Constrained estimators and tests in the multiple linear regression model (Part III)
Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Florian Pelgrin HEC September-December 2010 Florian Pelgrin (HEC) Constrained estimators September-December
More informationAdvanced Quantitative Methods: maximum likelihood
Advanced Quantitative Methods: Maximum Likelihood University College Dublin 4 March 2014 1 2 3 4 5 6 Outline 1 2 3 4 5 6 of straight lines y = 1 2 x + 2 dy dx = 1 2 of curves y = x 2 4x + 5 of curves y
More informationTesting Linear Restrictions: cont.
Testing Linear Restrictions: cont. The F-statistic is closely connected with the R of the regression. In fact, if we are testing q linear restriction, can write the F-stastic as F = (R u R r)=q ( R u)=(n
More information1. You have data on years of work experience, EXPER, its square, EXPER2, years of education, EDUC, and the log of hourly wages, LWAGE
1. You have data on years of work experience, EXPER, its square, EXPER, years of education, EDUC, and the log of hourly wages, LWAGE You estimate the following regressions: (1) LWAGE =.00 + 0.05*EDUC +
More informationStatistics and econometrics
1 / 36 Slides for the course Statistics and econometrics Part 10: Asymptotic hypothesis testing European University Institute Andrea Ichino September 8, 2014 2 / 36 Outline Why do we need large sample
More informationIntroductory Econometrics
Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna November 23, 2013 Outline Introduction
More informationEconometrics - 30C00200
Econometrics - 30C00200 Lecture 11: Heteroskedasticity Antti Saastamoinen VATT Institute for Economic Research Fall 2015 30C00200 Lecture 11: Heteroskedasticity 12.10.2015 Aalto University School of Business
More informationFormulary Applied Econometrics
Department of Economics Formulary Applied Econometrics c c Seminar of Statistics University of Fribourg Formulary Applied Econometrics 1 Rescaling With y = cy we have: ˆβ = cˆβ With x = Cx we have: ˆβ
More information1 Outline. 1. Motivation. 2. SUR model. 3. Simultaneous equations. 4. Estimation
1 Outline. 1. Motivation 2. SUR model 3. Simultaneous equations 4. Estimation 2 Motivation. In this chapter, we will study simultaneous systems of econometric equations. Systems of simultaneous equations
More informationA Course in Applied Econometrics Lecture 14: Control Functions and Related Methods. Jeff Wooldridge IRP Lectures, UW Madison, August 2008
A Course in Applied Econometrics Lecture 14: Control Functions and Related Methods Jeff Wooldridge IRP Lectures, UW Madison, August 2008 1. Linear-in-Parameters Models: IV versus Control Functions 2. Correlated
More informationMultiple Linear Regression
Multiple Linear Regression Asymptotics Asymptotics Multiple Linear Regression: Assumptions Assumption MLR. (Linearity in parameters) Assumption MLR. (Random Sampling from the population) We have a random
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationHeteroskedasticity. Part VII. Heteroskedasticity
Part VII Heteroskedasticity As of Oct 15, 2015 1 Heteroskedasticity Consequences Heteroskedasticity-robust inference Testing for Heteroskedasticity Weighted Least Squares (WLS) Feasible generalized Least
More informationExercises Chapter 4 Statistical Hypothesis Testing
Exercises Chapter 4 Statistical Hypothesis Testing Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 5, 013 Christophe Hurlin (University of Orléans) Advanced Econometrics
More informationIntroduction Large Sample Testing Composite Hypotheses. Hypothesis Testing. Daniel Schmierer Econ 312. March 30, 2007
Hypothesis Testing Daniel Schmierer Econ 312 March 30, 2007 Basics Parameter of interest: θ Θ Structure of the test: H 0 : θ Θ 0 H 1 : θ Θ 1 for some sets Θ 0, Θ 1 Θ where Θ 0 Θ 1 = (often Θ 1 = Θ Θ 0
More information1 Appendix A: Matrix Algebra
Appendix A: Matrix Algebra. Definitions Matrix A =[ ]=[A] Symmetric matrix: = for all and Diagonal matrix: 6=0if = but =0if 6= Scalar matrix: the diagonal matrix of = Identity matrix: the scalar matrix
More informationEmpirical Economic Research, Part II
Based on the text book by Ramanathan: Introductory Econometrics Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 7, 2011 Outline Introduction
More informationThe outline for Unit 3
The outline for Unit 3 Unit 1. Introduction: The regression model. Unit 2. Estimation principles. Unit 3: Hypothesis testing principles. 3.1 Wald test. 3.2 Lagrange Multiplier. 3.3 Likelihood Ratio Test.
More informationChapter 1. GMM: Basic Concepts
Chapter 1. GMM: Basic Concepts Contents 1 Motivating Examples 1 1.1 Instrumental variable estimator....................... 1 1.2 Estimating parameters in monetary policy rules.............. 2 1.3 Estimating
More informationCointegration Lecture I: Introduction
1 Cointegration Lecture I: Introduction Julia Giese Nuffield College julia.giese@economics.ox.ac.uk Hilary Term 2008 2 Outline Introduction Estimation of unrestricted VAR Non-stationarity Deterministic
More informationGARCH Models Estimation and Inference
Università di Pavia GARCH Models Estimation and Inference Eduardo Rossi Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationReliability of inference (1 of 2 lectures)
Reliability of inference (1 of 2 lectures) Ragnar Nymoen University of Oslo 5 March 2013 1 / 19 This lecture (#13 and 14): I The optimality of the OLS estimators and tests depend on the assumptions of
More information2. Linear regression with multiple regressors
2. Linear regression with multiple regressors Aim of this section: Introduction of the multiple regression model OLS estimation in multiple regression Measures-of-fit in multiple regression Assumptions
More informationG. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication
G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?
More informationOutline. Possible Reasons. Nature of Heteroscedasticity. Basic Econometrics in Transportation. Heteroscedasticity
1/25 Outline Basic Econometrics in Transportation Heteroscedasticity What is the nature of heteroscedasticity? What are its consequences? How does one detect it? What are the remedial measures? Amir Samimi
More information(θ θ ), θ θ = 2 L(θ ) θ θ θ θ θ (θ )= H θθ (θ ) 1 d θ (θ )
Setting RHS to be zero, 0= (θ )+ 2 L(θ ) (θ θ ), θ θ = 2 L(θ ) 1 (θ )= H θθ (θ ) 1 d θ (θ ) O =0 θ 1 θ 3 θ 2 θ Figure 1: The Newton-Raphson Algorithm where H is the Hessian matrix, d θ is the derivative
More informationTests forspatial Lag Dependence Based onmethodof Moments Estimation
1 Tests forspatial Lag Dependence Based onmethodof Moments Estimation by Luz A. Saavedra* Department of Economics University of South Florida 4202 East Fowler Ave. BSN 3111 Tampa, FL 33620-5524 lsaavedr@coba.usf.edu
More informationØkonomisk Kandidateksamen 2004 (II) Econometrics 2 June 14, 2004
Økonomisk Kandidateksamen 2004 (II) Econometrics 2 June 14, 2004 This is a four hours closed-book exam (uden hjælpemidler). Answer all questions! The questions 1 to 4 have equal weight. Within each question,
More informationAdvanced Quantitative Methods: maximum likelihood
Advanced Quantitative Methods: Maximum Likelihood University College Dublin March 23, 2011 1 Introduction 2 3 4 5 Outline Introduction 1 Introduction 2 3 4 5 Preliminaries Introduction Ordinary least squares
More informationGARCH Models Estimation and Inference
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in
More informationA Course on Advanced Econometrics
A Course on Advanced Econometrics Yongmiao Hong The Ernest S. Liu Professor of Economics & International Studies Cornell University Course Introduction: Modern economies are full of uncertainties and risk.
More informationADVANCED FINANCIAL ECONOMETRICS PROF. MASSIMO GUIDOLIN
Massimo Guidolin Massimo.Guidolin@unibocconi.it Dept. of Finance ADVANCED FINANCIAL ECONOMETRICS PROF. MASSIMO GUIDOLIN a.a. 14/15 p. 1 LECTURE 3: REVIEW OF BASIC ESTIMATION METHODS: GMM AND OTHER EXTREMUM
More informationEconometrics. Week 4. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague
Econometrics Week 4 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 23 Recommended Reading For the today Serial correlation and heteroskedasticity in
More informationContest Quiz 3. Question Sheet. In this quiz we will review concepts of linear regression covered in lecture 2.
Updated: November 17, 2011 Lecturer: Thilo Klein Contact: tk375@cam.ac.uk Contest Quiz 3 Question Sheet In this quiz we will review concepts of linear regression covered in lecture 2. NOTE: Please round
More informationEconomics 536 Lecture 7. Introduction to Specification Testing in Dynamic Econometric Models
University of Illinois Fall 2016 Department of Economics Roger Koenker Economics 536 Lecture 7 Introduction to Specification Testing in Dynamic Econometric Models In this lecture I want to briefly describe
More informationLinear models. Linear models are computationally convenient and remain widely used in. applied econometric research
Linear models Linear models are computationally convenient and remain widely used in applied econometric research Our main focus in these lectures will be on single equation linear models of the form y
More informationEconometrics II - EXAM Answer each question in separate sheets in three hours
Econometrics II - EXAM Answer each question in separate sheets in three hours. Let u and u be jointly Gaussian and independent of z in all the equations. a Investigate the identification of the following
More informationIntroduction to Econometrics. Heteroskedasticity
Introduction to Econometrics Introduction Heteroskedasticity When the variance of the errors changes across segments of the population, where the segments are determined by different values for the explanatory
More informationOutline of GLMs. Definitions
Outline of GLMs Definitions This is a short outline of GLM details, adapted from the book Nonparametric Regression and Generalized Linear Models, by Green and Silverman. The responses Y i have density
More informationF9 F10: Autocorrelation
F9 F10: Autocorrelation Feng Li Department of Statistics, Stockholm University Introduction In the classic regression model we assume cov(u i, u j x i, x k ) = E(u i, u j ) = 0 What if we break the assumption?
More information1. The Multivariate Classical Linear Regression Model
Business School, Brunel University MSc. EC550/5509 Modelling Financial Decisions and Markets/Introduction to Quantitative Methods Prof. Menelaos Karanasos (Room SS69, Tel. 08956584) Lecture Notes 5. The
More informationModels, Testing, and Correction of Heteroskedasticity. James L. Powell Department of Economics University of California, Berkeley
Models, Testing, and Correction of Heteroskedasticity James L. Powell Department of Economics University of California, Berkeley Aitken s GLS and Weighted LS The Generalized Classical Regression Model
More informationAssumptions of classical multiple regression model
ESD: Recitation #7 Assumptions of classical multiple regression model Linearity Full rank Exogeneity of independent variables Homoscedasticity and non autocorrellation Exogenously generated data Normal
More informationMLE and GMM. Li Zhao, SJTU. Spring, Li Zhao MLE and GMM 1 / 22
MLE and GMM Li Zhao, SJTU Spring, 2017 Li Zhao MLE and GMM 1 / 22 Outline 1 MLE 2 GMM 3 Binary Choice Models Li Zhao MLE and GMM 2 / 22 Maximum Likelihood Estimation - Introduction For a linear model y
More informationNon-Stationary Time Series, Cointegration, and Spurious Regression
Econometrics II Non-Stationary Time Series, Cointegration, and Spurious Regression Econometrics II Course Outline: Non-Stationary Time Series, Cointegration and Spurious Regression 1 Regression with Non-Stationarity
More informationAnalogy Principle. Asymptotic Theory Part II. James J. Heckman University of Chicago. Econ 312 This draft, April 5, 2006
Analogy Principle Asymptotic Theory Part II James J. Heckman University of Chicago Econ 312 This draft, April 5, 2006 Consider four methods: 1. Maximum Likelihood Estimation (MLE) 2. (Nonlinear) Least
More informationLecture 6: Hypothesis Testing
Lecture 6: Hypothesis Testing Mauricio Sarrias Universidad Católica del Norte November 6, 2017 1 Moran s I Statistic Mandatory Reading Moran s I based on Cliff and Ord (1972) Kelijan and Prucha (2001)
More informationAdvanced Econometrics
Advanced Econometrics Dr. Andrea Beccarini Center for Quantitative Economics Winter 2013/2014 Andrea Beccarini (CQE) Econometrics Winter 2013/2014 1 / 156 General information Aims and prerequisites Objective:
More informationSize and Power of the RESET Test as Applied to Systems of Equations: A Bootstrap Approach
Size and Power of the RESET Test as Applied to Systems of Equations: A Bootstrap Approach Ghazi Shukur Panagiotis Mantalos International Business School Department of Statistics Jönköping University Lund
More informationLecture 7: Dynamic panel models 2
Lecture 7: Dynamic panel models 2 Ragnar Nymoen Department of Economics, UiO 25 February 2010 Main issues and references The Arellano and Bond method for GMM estimation of dynamic panel data models A stepwise
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 6 Jakub Mućk Econometrics of Panel Data Meeting # 6 1 / 36 Outline 1 The First-Difference (FD) estimator 2 Dynamic panel data models 3 The Anderson and Hsiao
More information(c) i) In ation (INFL) is regressed on the unemployment rate (UNR):
BRUNEL UNIVERSITY Master of Science Degree examination Test Exam Paper 005-006 EC500: Modelling Financial Decisions and Markets EC5030: Introduction to Quantitative methods Model Answers. COMPULSORY (a)
More informationIntroduction to Maximum Likelihood Estimation
Introduction to Maximum Likelihood Estimation Eric Zivot July 26, 2012 The Likelihood Function Let 1 be an iid sample with pdf ( ; ) where is a ( 1) vector of parameters that characterize ( ; ) Example:
More information8. Hypothesis Testing
FE661 - Statistical Methods for Financial Engineering 8. Hypothesis Testing Jitkomut Songsiri introduction Wald test likelihood-based tests significance test for linear regression 8-1 Introduction elements
More informationEconometrics. Week 8. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague
Econometrics Week 8 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 25 Recommended Reading For the today Instrumental Variables Estimation and Two Stage
More informationIntroduction to Eco n o m et rics
2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. Introduction to Eco n o m et rics Third Edition G.S. Maddala Formerly
More informationLECTURE 11. Introduction to Econometrics. Autocorrelation
LECTURE 11 Introduction to Econometrics Autocorrelation November 29, 2016 1 / 24 ON PREVIOUS LECTURES We discussed the specification of a regression equation Specification consists of choosing: 1. correct
More informationECON 5350 Class Notes Nonlinear Regression Models
ECON 5350 Class Notes Nonlinear Regression Models 1 Introduction In this section, we examine regression models that are nonlinear in the parameters and give a brief overview of methods to estimate such
More informationTesting Hypothesis after Probit Estimation
Testing Hypothesis after Probit Estimation Quantitative Microeconomics R. Mora Department of Economics Universidad Carlos III de Madrid Outline Introduction 1 Introduction 2 3 The Probit Model and ML Estimation
More informationFinal Exam. Question 1 (20 points) 2 (25 points) 3 (30 points) 4 (25 points) 5 (10 points) 6 (40 points) Total (150 points) Bonus question (10)
Name Economics 170 Spring 2004 Honor pledge: I have neither given nor received aid on this exam including the preparation of my one page formula list and the preparation of the Stata assignment for the
More information9. Model Selection. statistical models. overview of model selection. information criteria. goodness-of-fit measures
FE661 - Statistical Methods for Financial Engineering 9. Model Selection Jitkomut Songsiri statistical models overview of model selection information criteria goodness-of-fit measures 9-1 Statistical models
More informationFunctional Form. Econometrics. ADEi.
Functional Form Econometrics. ADEi. 1. Introduction We have employed the linear function in our model specification. Why? It is simple and has good mathematical properties. It could be reasonable approximation,
More informationQuick Review on Linear Multiple Regression
Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,
More information13.2 Example: W, LM and LR Tests
13.2 Example: W, LM and LR Tests Date file = cons99.txt (same data as before) Each column denotes year, nominal household expenditures ( 10 billion yen), household disposable income ( 10 billion yen) and
More informationGraduate Econometrics Lecture 4: Heteroskedasticity
Graduate Econometrics Lecture 4: Heteroskedasticity Department of Economics University of Gothenburg November 30, 2014 1/43 and Autocorrelation Consequences for OLS Estimator Begin from the linear model
More informationGMM Based Tests for Locally Misspeci ed Models
GMM Based Tests for Locally Misspeci ed Models Anil K. Bera Department of Economics University of Illinois, USA Walter Sosa Escudero University of San Andr es and National University of La Plata, Argentina
More information13. Time Series Analysis: Asymptotics Weakly Dependent and Random Walk Process. Strict Exogeneity
Outline: Further Issues in Using OLS with Time Series Data 13. Time Series Analysis: Asymptotics Weakly Dependent and Random Walk Process I. Stationary and Weakly Dependent Time Series III. Highly Persistent
More informationGARCH Models Estimation and Inference. Eduardo Rossi University of Pavia
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationEconometric Analysis of Cross Section and Panel Data
Econometric Analysis of Cross Section and Panel Data Jeffrey M. Wooldridge / The MIT Press Cambridge, Massachusetts London, England Contents Preface Acknowledgments xvii xxiii I INTRODUCTION AND BACKGROUND
More informationDepartamento de Economía Universidad de Chile
Departamento de Economía Universidad de Chile GRADUATE COURSE SPATIAL ECONOMETRICS November 14, 16, 17, 20 and 21, 2017 Prof. Henk Folmer University of Groningen Objectives The main objective of the course
More informationThis note analyzes OLS estimation in a linear regression model for time series
LINEAR REGRESSION WITH TIME SERIES DATA Econometrics C LectureNote2 Heino Bohn Nielsen February 6, 2012 This note analyzes OLS estimation in a linear regression model for time series data. We first discuss
More informationHypothesis Testing. Part I. James J. Heckman University of Chicago. Econ 312 This draft, April 20, 2006
Hypothesis Testing Part I James J. Heckman University of Chicago Econ 312 This draft, April 20, 2006 1 1 A Brief Review of Hypothesis Testing and Its Uses values and pure significance tests (R.A. Fisher)
More informationTheory of Maximum Likelihood Estimation. Konstantin Kashin
Gov 2001 Section 5: Theory of Maximum Likelihood Estimation Konstantin Kashin February 28, 2013 Outline Introduction Likelihood Examples of MLE Variance of MLE Asymptotic Properties What is Statistical
More informationGeneralized Linear Models
Generalized Linear Models Lecture 3. Hypothesis testing. Goodness of Fit. Model diagnostics GLM (Spring, 2018) Lecture 3 1 / 34 Models Let M(X r ) be a model with design matrix X r (with r columns) r n
More informationPractical Econometrics. for. Finance and Economics. (Econometrics 2)
Practical Econometrics for Finance and Economics (Econometrics 2) Seppo Pynnönen and Bernd Pape Department of Mathematics and Statistics, University of Vaasa 1. Introduction 1.1 Econometrics Econometrics
More informationPoisson Regression. Ryan Godwin. ECON University of Manitoba
Poisson Regression Ryan Godwin ECON 7010 - University of Manitoba Abstract. These lecture notes introduce Maximum Likelihood Estimation (MLE) of a Poisson regression model. 1 Motivating the Poisson Regression
More informationIntroduction to Estimation Methods for Time Series models. Lecture 1
Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation
More information1 Motivation for Instrumental Variable (IV) Regression
ECON 370: IV & 2SLS 1 Instrumental Variables Estimation and Two Stage Least Squares Econometric Methods, ECON 370 Let s get back to the thiking in terms of cross sectional (or pooled cross sectional) data
More informationNew Developments in Econometrics Lecture 16: Quantile Estimation
New Developments in Econometrics Lecture 16: Quantile Estimation Jeff Wooldridge Cemmap Lectures, UCL, June 2009 1. Review of Means, Medians, and Quantiles 2. Some Useful Asymptotic Results 3. Quantile
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationDynamic Regression Models (Lect 15)
Dynamic Regression Models (Lect 15) Ragnar Nymoen University of Oslo 21 March 2013 1 / 17 HGL: Ch 9; BN: Kap 10 The HGL Ch 9 is a long chapter, and the testing for autocorrelation part we have already
More informationStatistics. Lecture 2 August 7, 2000 Frank Porter Caltech. The Fundamentals; Point Estimation. Maximum Likelihood, Least Squares and All That
Statistics Lecture 2 August 7, 2000 Frank Porter Caltech The plan for these lectures: The Fundamentals; Point Estimation Maximum Likelihood, Least Squares and All That What is a Confidence Interval? Interval
More informationPanel Data Models. Chapter 5. Financial Econometrics. Michael Hauser WS17/18 1 / 63
1 / 63 Panel Data Models Chapter 5 Financial Econometrics Michael Hauser WS17/18 2 / 63 Content Data structures: Times series, cross sectional, panel data, pooled data Static linear panel data models:
More informationA Non-Parametric Approach of Heteroskedasticity Robust Estimation of Vector-Autoregressive (VAR) Models
Journal of Finance and Investment Analysis, vol.1, no.1, 2012, 55-67 ISSN: 2241-0988 (print version), 2241-0996 (online) International Scientific Press, 2012 A Non-Parametric Approach of Heteroskedasticity
More information6. MAXIMUM LIKELIHOOD ESTIMATION
6 MAXIMUM LIKELIHOOD ESIMAION [1] Maximum Likelihood Estimator (1) Cases in which θ (unknown parameter) is scalar Notational Clarification: From now on, we denote the true value of θ as θ o hen, view θ
More information