COV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic.

Similar documents
Recall MLR 5 Homskedasticity error u has the same variance given any values of the explanatory variables Var(u x1,...,xk) = 2 or E(UU ) = 2 I

Simple Linear Regression

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1

Linear Regression with One Regressor

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Summary of the lecture in Biostatistics

Econometric Methods. Review of Estimation

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

Chapter 13 Student Lecture Notes 13-1

Chapter 5 Properties of a Random Sample

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

ENGI 3423 Simple Linear Regression Page 12-01

ECON 5360 Class Notes GMM

residual. (Note that usually in descriptions of regression analysis, upper-case

Special Instructions / Useful Data

Qualifying Exam Statistical Theory Problem Solutions August 2005

Midterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes

ρ < 1 be five real numbers. The

TESTS BASED ON MAXIMUM LIKELIHOOD

Chapter 14 Logistic Regression Models

LINEAR REGRESSION ANALYSIS

ENGI 4421 Propagation of Error Page 8-01

Multivariate Transformation of Variables and Maximum Likelihood Estimation

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

Introduction to Matrices and Matrix Approach to Simple Linear Regression

Midterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes

Quiz 1- Linear Regression Analysis (Based on Lectures 1-14)

Training Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ

2SLS Estimates ECON In this case, begin with the assumption that E[ i

Simple Linear Regression

Simulation Output Analysis

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Lecture 3. Sampling, sampling distributions, and parameter estimation

Answer key to problem set # 2 ECON 342 J. Marcelo Ochoa Spring, 2009

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1

The Mathematics of Portfolio Theory

Objectives of Multiple Regression

X ε ) = 0, or equivalently, lim

Multiple Choice Test. Chapter Adequacy of Models for Regression

Overview. Basic concepts of Bayesian learning. Most probable model given data Coin tosses Linear regression Logistic regression

Lecture Notes Types of economic variables

Example: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger

Lecture 8: Linear Regression

Econometrics. 3) Statistical properties of the OLS estimator

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model

GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA

ESS Line Fitting

The expected value of a sum of random variables,, is the sum of the expected values:

Lecture Note to Rice Chapter 8

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

Simple Linear Regression and Correlation.

Maximum Likelihood Estimation

Lecture 2: Linear Least Squares Regression

Lecture 3 Probability review (cont d)

Fundamentals of Regression Analysis

Functions of Random Variables

Third handout: On the Gini Index

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

1 Solution to Problem 6.40

Chapter 4 Multiple Random Variables

Numerical Analysis Formulae Booklet

PGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation

Lecture Notes Forecasting the process of estimating or predicting unknown situations

Bayes (Naïve or not) Classifiers: Generative Approach

Chapter 8. Inferences about More Than Two Population Central Values

Chapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:

Simple Linear Regression - Scalar Form

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

Handout #8. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1

STK3100 and STK4100 Autumn 2017

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.

Lecture 07: Poles and Zeros

2.160 System Identification, Estimation, and Learning Lecture Notes No. 17 April 24, 2006

STA302/1001-Fall 2008 Midterm Test October 21, 2008

STK4011 and STK9011 Autumn 2016

Chapter 8: Statistical Analysis of Simulated Data

MEASURES OF DISPERSION

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Statistics Review Part 3. Hypothesis Tests, Regression

Probability and. Lecture 13: and Correlation

University of Belgrade. Faculty of Mathematics. Master thesis Regression and Correlation

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Multiple Linear Regression Analysis

STK3100 and STK4100 Autumn 2018

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

3. Models with Random Effects

CHAPTER VI Statistical Analysis of Experimental Data

Lecture 02: Bounding tail distributions of a random variable

Chapter 4 Multiple Random Variables

DISTURBANCE TERMS. is a scalar and x i

Chapter Statistics Background of Regression Analysis


Transcription:

c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty olato of costat varace of s but they are stll depedet. C,, he error term s sad to be heteroscedastc. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 3 What s Heteroscedastcty? Weghted east Square WS ests for arace equato Remedes Geeralzed Heteroscedastcty c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty What happeed to S estmators? > S s stll UE but ot BUE. > arge sample propertes??? Weghted east Square WS w Y Y where w β w + β w +... + β w + w β + β +... + β + ν Y w Y c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 4 k w, k,..., k ν w

atrx form Y Y,, ν c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 5 Explaatory varables observato dex some or all the s codtoal mea of Y gve varable Z s ot the model lagged varables to be dscussed me Seres Aalyss c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 7 Note that Y β + s CNR ad ν s homoscedastc. WS estmator Note that, gve, the estmator s BUE. ν,,..., ν I Y ˆ β c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 6 Detecto squared resdual plots Whte s est ther tests c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 8

squared resduals agast the suspected explaatory varable S test agast oly oe varable at a tme fuctoal forms, e.g., lear, log-l, log-log, quadratc, polyomal, recprocal, etc. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 9 Fuctoal form of the varace equato must be assumed most tests. For example, Breusch-Paga s test assumes a lear fucto of suspected varables Gleser s test sets the form of stadard devato stead of the varace Whte s test adds squared ad cross terms to the varace equato of BP test. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty ˆ ˆ S S ear γ S Recprocal c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty l γ S or log-l γ S Harvey-Godfrey s test assumes a log-l or 3 exp γ S S +.. S 3 P P Note that HG assures postve ftted varaces whle others do ot. Park test assumes double log form. Goldfeld-Quadt does ot assume the form of the varace fucto. Istead, t checks for equalty of the varaces betwee the hgh group ad the low group usg varace rato testf-test. See text. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty

Whte s Geeral Heteroscedastcty est Cocept: he varables that are suspected to cause heteroscedastcty are the s, ther squared terms ad ther cross terms. γ +.... 3 3 + 33 3 34 3 4 +.. 3 3 + c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 3 Accept H > No heteroscedastcty If reect H, o specfc remedy ca be doe. Wthout ay remedy, must be re-calculated sce the old oe s cosstet wrog. Whte s Heteroscedastcty Cosstet Covarace s [ ] ˆ [ ] ˆ β k where s the th observato of. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 5 Ru S o the auxlary regresso of the squared resduals ad all the suspected varables above. Assume for all. Perform the overall F-test or test for the auxlary regresso ru o the followg : γ H H : γ hypothess. γ... γ 3 γ... γ 3 γ γ Eews also provde a quck soluto for Whte s test. γ γ 3 3... γ... γ... γ... γ c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 4 Feasble Geeralzed east Squares FGS Estmate the varace equato usg auxlary regresso of squared resduals o the explaatory varables for the varace equato, e.g., ˆ + ξ γ + ξ S where ξ s the error term for the varace equato c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 6

Calculate the ftted value of squared resduals or estmate ˆ ˆ γ ˆ S Use the weght WS w FGS s based but cosstet. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 7 Example S ˆ S + ξ where s a postve costat. Apply WS wth w S Note that ν for all,, > WS estmator s ubased. No FGS eeded. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 9 arace equato wth sgle parameter, e.g., Example or ˆ + ξ where S S s a postve costat. Apply WS wth w S Note that ν for all,, > WS estmator s ubased. No FGS eeded c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 8 olato of costat varace ad/or depedece of s C, for some,, he error term s sad to be geeralzed heteroscedastc. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty,

S or WS estmators are stll UE but ot BUE. Geeralzed east Square GS Y WY, W, ν W where W s a x symmetrc matrx such that WW c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty If s kow up to a proporto, Ω, where s ukow but Ω matrx s kow., c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 3 Note that Y β + ν s CNR ad ν s homoscedastc., GS estmator ν,..., ν I Y ˆ β Note that f s kow, W ca be calculated. So s. >the estmator s BUE. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty Choose the weghtg matrx W such that WW Ω Defe Y WY, W, ν W Note that Y β + ν s CNR ad ν s homoscedastc or > GS estmator s BUE ν I c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 4

c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty 5 s restrcted parameters. For example,,,, Ρ Ρ