Outline. 9. Heteroskedasticity Cross Sectional Analysis. Homoskedastic Case

Size: px
Start display at page:

Download "Outline. 9. Heteroskedasticity Cross Sectional Analysis. Homoskedastic Case"

Transcription

1 Outlne 9. Heteroskedastcty Cross Sectonal Analyss Read Wooldrdge (013), Chapter 8 I. Consequences of Heteroskedastcty II. Testng for Heteroskedastcty III. Heteroskedastcty Robust Inference IV. Weghted Least Square Estmaton I. Consequences of Heteroskedastcty Homoskedastc Case Motvaton: Consder the model sav = 0 nc + u y = sav =savng x = nc =ncome Constant varances (MLR. 5) Var(u nc ) =, whch mples that Var(sav nc ) = f(y x). y. E(y x) = 0 x =5,000 x =100,000 I. Consequences of Heteroskedastcty 3 I. Consequences of Heteroskedastcty 4

2 Heteroskedastcty Example of Heteroskedastcty Volaton of homoskedastcty: What f the varablty of savngs of the rch s less than that of the lower ncome group? Here we say that the varance of savngs y (or unobserved factors u) ncreases wth ncome VAR(sav nc = 5,000) = 5 (see ) VAR(sav nc = 100,000) = 100 (see x ) f(y x).. E(y x) = 0 x When varances are unequal, ths problem s called heteroskedastcty.. (See Graph) =5,000 x =100,000 x I. Consequences of Heteroskedastcty 5 I. Consequences of Heteroskedastcty 6 MLR.5 volated: Heteroskedastcty Propertes nvald under heteroskedastcty: unequal varances Consder a model y = 0 + x + + k x k + u Heteroskedastcty VAR(u,,x k ) = Propertes unaffected by heteroskedastcty: 1) OLS estmators are stll unbased and consstent. ) The nterpretaton s the same for goodness of ft measures, R and R bar. 1) The estmators of the varances, Var( ), are based. ) t, F and LM statstcs no longer have t, F and LM dstrbutons. 3) OLS s no longer best lnear unbased estmator (BLUE). I. Consequences of Heteroskedastcty 7 I. Consequences of Heteroskedastcty 8

3 II. Testng for Heteroskedastcty Breusch Pagan Test There are many tests for heteroskedastcy, but we wll learn two modern tests: 1) Breusch Pagan Test for Heteroskedastcty ) Whte Test use no cross terms. use cross terms. use ftted values of the LHS varable Gven MLR.1 MLR.4, consder the Model y = 0 + x u Want to test H 0 : whether MLR.5 s true H 0 : VAR(u,, ) =E(u ) = u = 0 + x + + k x k + v These modern tests assume that the varance of the error depends or does not depend upon the explanatory varables. To test whether u s related to x s H 0 : 1 = = = k = 0 II. Testng for Heteroskedastcty 9 II. Testng for Heteroskedastcty 10 Use resduals for u Snce we don t observe u, but we have estmates of resduals. = 0 + x + + k x k + v Use F test or LM test to test the overall sgnfcance H 0 : 1 = = = k = 0 R F (1 R uˆ ) uˆ / k / n k LM = n* ~ k F 1 k,( n k 1) Example: Consder cgarette demand functon ncome: annual ncome n dollars cgprc: state cgarette prce, cents per pack educ: years of schoolng age: age measured n years restaurn =1 f a state has restaurant smokng restrctons =0 f a state has no restaurant smokng restrctons cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u BP Test for heteroskedastcty Step 1: Estmate the above equaton. Step : obtan resduals from the cgs equaton or In Evews, obtan resdual seres resd01 Step 3: Regress on all x s. resd01^ = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u Step 4: Use F and LM Tests for heteroskedastcty. Compute F and LM statstcs and compare to crtcal values of the F k,n-k-1 and k dstrbutons II. Testng for Heteroskedastcty 11 II. Testng for Heteroskedastcty 1

4 LM verson of the Bruesch Pagan Test Step 4: Use F test and LM test 1) F statstc = 5.55 p value = ( ) ) LM statstc = Obs*R squared = 807* = 3.6 Ch square dstrbuton wth 6 DFs c = 1.59 (5% sgnfcance level) c = 16.81(1% sgnfcance level) What can we say about heteroskedastcty? II. Testng for Heteroskedastcty 13 Evews: Step 1: Estmate the cgarette demand equaton Dependent Varable: CIGS Sample: Included observatons: 807 C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 Proc/Make Resdual Seres. Step : name for resdual seres: resd01 II. Testng for Heteroskedastcty 14 Step 3: Regress resd01^ ( ) on all x s Whte Test of Heteroskedastcty Dependent Varable: RESID01^ Sample: C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd 1.06E+08 Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) Consder the three varable model y = 0 + x u H 0 : Var(u, x, ) = Weaker assumpton by Whte (1980) u s uncorrelated wth (, x, ), (, x, ), ( x,, x ) = 0 + x x x x + v H 0 : 1 = = = 9 = 0 Use F and LM Test What are the rejecton rules? II. Testng for Heteroskedastcty 15 II. Testng for Heteroskedastcty 16

5 Intractable: more regressors Easer way to mplement Whte Test Consder the model wth 6 regressors cgs = 0 log(ncome) + (cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u = regressors + v LOG(INCOME), (LOG(INCOME))^, (LOG(INCOME))*(LOG(CIGPRIC)), (LOG(INCOME))*EDUC, (LOG(INCOME))*AGE, (LOG(INCOME))*(AGE^), (LOG(INCOME))*RESTAURN, LOG(CIGPRIC), (LOG(CIGPRIC))^, (LOG(CIGPRIC))*EDUC, (LOG(CIGPRIC))*AGE, (LOG(CIGPRIC))*(AGE^), (LOG(CIGPRIC))*RESTAURN EDUC, EDUC^, EDUC*AGE, EDUC*(AGE^), EDUC*RESTAURN AGE, AGE^, AGE*(AGE^), AGE*RESTAURN, (AGE^)^, (AGE^)*RESTAURN RESTAURN H 0 : 1 = = = 5 = 0 k = 5 n k 1 = n 6 What are the rejecton rules? Idea : use OLS ftted values n a test for heteroskedastcty = + + x + + x k When we square, we get a partcular functon of all the squares and cross products Smpler form of Whte Test = v What are the null hypothess and rejecton rules? II. Testng for Heteroskedastcty 17 II. Testng for Heteroskedastcty 18 Model: cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u Evews: Step 1: Estmate the cgarette demand equaton A Specal case of the Whte Test for heteroskedastcty Step 1: Estmate the above equaton. Step : obtan ftted value from the cgarette equaton. In Evews, obtan resdual seres resd01 (or ) Note that y = + or cgs = + Generatng seres for called cgshat cgshat = cgs resd01 Step 3: Regress on and resd01^ = 0 cgshat + cgshat + v Step 4: Use F and LM Tests for heteroskedastcty. Compute F and LM statstcs and compare to crtcal values of the F,n-3 and dstrbutons Dependent Varable: CIGS Sample: Included observatons: 807 C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 Step : Generatng seres for cgs ^ called cgshat II. Testng for Heteroskedastcty 19 II. Testng for Heteroskedastcty 0

6 Step 3: Regress resd01^ on and ^ Step 4. LM and F test for Whte Test Dependent Varable: RESID01^ Method: Least Squares Sample: Included observatons: 807 C CIGSHAT CIGSHAT^ R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd 1.06E+08 Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) resd01^ = 0 cgshat + cgshat + v H 0 : 1 = = 0 F test F = p value = Could you fnd crtcal values to verfy ths? LM test LM = obs*r squared = 807*.0398 = 6.57 Ch square dstrbuton wth DFs c = 5.99 (5% sgnfcance level) c = 9.1 (1% sgnfcance level) II. Testng for Heteroskedastcty 1 II. Testng for Heteroskedastcty Model: cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u We could follow smlar steps to test for heteroskedastcty usng Whte Tests. 3) Whte Test wth no cross terms = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + 7 [log(ncome)] + 8 [log(cgprc)] + 9 educ 0 [age ] + v 4) Whte Test wth cross terms. = regressors + v Evews: It has commands to fnd F and LM statstcs usng Whte Tests (methods 3 4). In the equaton output wndow, (3) Choose Vew/Resdual Tests/Whte heteroskedastcty (wth no cross terms) (4) Choose Vew/Resdual Tests/Whte heteroskedastct (wth cross terms) for (4) In the Equaton wndow, run the followng regresson. Dependent Varable: CIGS Sample: Included observatons: 807 C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 II. Testng for Heteroskedastcty 3 II. Testng for Heteroskedastcty 4

7 Vew/Resdual Tests/Whte heteroskedastcty (no cross terms) for (3) Whte Heteroskedastcty Test: F-statstc Probablty Obs*R-squared Probablty Dependent Varable: RESID^ Included observatons: 807 C LOG(INCOME) (LOG(INCOME))^ LOG(CIGPRIC) (LOG(CIGPRIC))^ EDUC EDUC^ AGE AGE^ (AGE^)^ 1.9E-05 1.E RESTAURN R-squared Mean dependent var Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) II. Testng for Heteroskedastcty Vew/Resdual Tests/Whte heteroskedastcty (wth cross terms) for (4) Whte Heteroskedastcty Test: F-statstc Probablty Obs*R-squared Probablty Dependent Varable: RESID^ Included observatons: 807 Varable (5 regressors) Coeffcent Std. Error t-statstc Prob. C LOG(INCOME) (LOG(INCOME))^ (LOG(INCOME))*(LOG(CIGPRIC)) RESTAURN R-squared Mean dependent var Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) II. Testng for Heteroskedastcty III. Heteroskedastcty Robust Inference after OLS Estmaton In the presence of heteroskedastcty, Evews can adjust standard errors, t, F, and LM, statstcs so that they are vald. Ths method s called the heteroskedastc robust procedure. Techncally, ths procedure s vald, at least n large samples, whether or not the errors have constant varances. Sketch the procedure Consder the smple regresson model y = 0 x + u Var(u x ) = Steps to fnd robust standard errors: 1) Fnd estmator of 1 ) Under the assumptons MLR.1 MLR.4, the varance can be found. 3) Whte(1980) suggests usng n place of. Thus, we can fnd the estmator of VAR( ) 4) A heteroskedastc robust standard error can be found. Sketch for the general case? III. Heteroskedastcty Robust Inference after OLS Estmaton 7 III. Heteroskedastcty Robust Inference after OLS Estmaton 8

8 Varance wth Heteroskedastcty Varance wth Heteroskedastcty For the smple case, ˆ x x u, so x x 1 1 x x 1 SSTx Var ˆ, where SST x x x For the general multple regresson model, a vald j j estmator of Var ˆ wth heteroskedastcty s ˆˆ ˆ ru Varˆ j, SSR th j A vald estmator for ths when s x x ˆ x u, SST where uˆ are are the OLS resduals where rˆ s the resdual from regressng x on j all other ndependent varables, and SSR j s the sum of squared resduals from ths regresson j III. Heteroskedastcty Robust Inference after OLS Estmaton 9 III. Heteroskedastcty Robust Inference after OLS Estmaton 30 Example: cgs equaton Steps n Evews: Consder the model cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u Fnd the cgs equaton usng heteroskedastc robust procedure. III. Heteroskedastcty Robust Inference after OLS Estmaton 31 Step 1: Estmate the log equaton n usual OLS method. cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u Step : Fnd the log equaton wth heteroskedastcty-robust standard errors. In the Equaton wndow, Choose Estmate. In the Equaton Estmaton box, clck opton button. Then, clck heteroskedastcty consstent coeffcent covarance. clck Whte III. Heteroskedastcty Robust Inference after OLS Estmaton 3

9 Step 1: Estmate the cgs equaton n usual way Step : Whte Heteroskedastcty-Consstent s.e. s Dependent Varable: CIGS Included observatons: 807 C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 Dependent Varable: CIGS Included observatons: 807 Whte Heteroskedastcty-Consstent Standard Errors & Covarance C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 III. Heteroskedastcty Robust Inference after OLS Estmaton 33 III. Heteroskedastcty Robust Inference after OLS Estmaton 34 OLS and Robust estmates: compared Dependent Varable: CIGS Interpretaton: cgs demand equaton cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u Varable Coeffcent s.e s.e (robust) Prob. Prob. (robust) C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ ) In ths applcaton, any varable that s statstcally sgnfcant at 1% level usng the usual t test s stll sgnfcant under the heteroskedastcty robust procedure. varables: educ, age, age and restaurn. ) The robust standard errors are ether larger or smaller than the usual standard error 3) The robust s.e. on log(ncome) becomes smaller, but that on log(cgprce) s larger. 4) How to nterpret the coeffcents of varous varables n the model? RESTAURN III. Heteroskedastcty Robust Inference after OLS Estmaton 35 III. Heteroskedastcty Robust Inference after OLS Estmaton 36

10 Robust F test and Wald Test cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u Want to test the null hypothess: H 0 : 1 = =0 In the equaton wth robust standard errors, we can easly obtan heteroskedastc robust F statstc also called heteroskedastc robust Wald statstc. Step 1. Whte Heteroskedastcty Consstent s.e. s Step. Vew/Coeffcent Tests/Wald Coeffcent Restrctons Step 3. Type n c()=0, c(3)=0 The F statstc s F = ; p value = (ncorrect) robust F statstc = 1.099; p value=.3338 (correct) Snce p value >, we do not reject H 0 and conclude that ncome and prce together do not have an effect on cgarette demand. Step 1: Whte Heteroskedastcty-Consstent s.e. s Dependent Varable: CIGS Included observatons: 807 Whte Heteroskedastcty-Consstent Standard Errors & Covarance C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 III. Heteroskedastcty Robust Inference after OLS Estmaton 37 III. Heteroskedastcty Robust Inference after OLS Estmaton 38 Vew/Coeffcent Tests/Redundant Varables Redundant Varables: LOG(INCOME) LOG(CIGPRIC) F-statstc Probablty Log lkelhood rato Probablty Assume that MLR.1 MLR.4 hold, but MLR.5 does not. Vew/Coeffcent Tests/Wald Coeffcent Restrctons Wald Test: Let xdenote, x,., x k VAR(u x) = (heteroskedastcty) Equaton: Unttled Test Statstc Value df Probablty F-statstc (, 800) Ch-square Let = h(x) VAR(u x) = h(x) h(x) > 0 (snce VAR > 0) Null Hypothess Summary: Normalzed Restrcton (= 0) Value Std. Err. C() Heteroskedastty can be corrected under two cases: 1) = h(x). h(x) s known up to a multplcatve constant ) h(x) has to be estmated feasble GLS C(3) Restrctons are lnear n coeffcents. III. Heteroskedastcty Robust Inference after OLS Estmaton 39 40

11 Case 1: h(x) s known up to a multplcatve constant Weghted Least Squares Consder the model Let y = sav ; x = nc ; h = x y = 0 x + u var(u x ) = h Trck : Dvde the equaton by sqr(h ) y 1 x u 0 1 h h h h (OLS) (heteroskedastc) (IV.1) Show that the errors n (IV.1) are homoskedastc! Weghted least squares obtan the values of j* that makes the weghted SSR as small as possble: n u h 1 1 ( y x... x ) / h * * * k k where each squared resdual s weghted by 1/h. Brng 1/h nsde the squared resdual: GLS s an effcent procedure. n u y 1 x x n n * * 1 * k k 1 h 1 h h h h 41 4 Example: Savng equaton OLS & WLS compared OLS : sav = 0 nc + u VAR(u nc ) = = nc s not constant. and are not BLUE. OLS WLS MLR.1-MLR-4 yes yes GLS : transformed equaton sav /(nc) 1/ = 0 /(nc) 1/ nc /(nc) 1/ + u /(nc) 1/ VAR[u /nc ] = s constant. 0* and 1* are BLUE MLR.5 heteroskedastcty homoskedastcty error varance not constant constant BLUE no yes The GLS estmators after correctng the error for heteroskedastcty s called weghted least squares (WLS) estmators. t and F Dst nvald vald R-squared meanngful not meanngful 43 44

12 OLS and WLS Results: savng equaton Step 1: OLS Regress sav on nc (wth ntercept) OLS: WLS: sav = nc prob {.8493} {0.014} n=100, R =.061 R bar=.056 sav/nc^.5 = 15.0[1/nc^.5] nc^.5 prob {.7955} {.003} n=100, R =.05 R bar=.015 Dependent Varable: SAV Method: Least Squares Sample: Included observatons: 100 C INC Evew Trck: WLS Step 1: Obtan Orgnal output Step : In the [Equaton:..] wndow, Choose Estmate and then optons. clck Weghted LS/TSLS Type n the weght, 1/nc^.5 or 1/sqr(nc) R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd 1.00E+09 Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) WLS: Regress sav/(nc^.5) on 1/nc^.5 and nc^.5 (wth no ntercept) Dependent Varable: SAV Included observatons: 100 Step : Compare to the regresson of sav /(nc )1/ = 0 /(nc ) 1/ nc /(nc ) 1/ + u /(nc ) 1/ Weghtng seres: 1/INC^.5 Dependent Varable: SAV/(INC^.5) Method: Least Squares Sample: Included observatons: 100 C INC Weghted Statstcs R-squared Mean dependent var /(INC^.5) INC^ R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd 6.93E+08 Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood Durbn-Watson stat Unweghted Statstcs R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Sum squared resd 1.00E+09 Durbn-Watson stat

13 WLS: In practce, we rarely know h(x). Consder the model: sav = 0 nc + sze + 3 educ + 4 age + 0 black +u Does the varance depend on age or educaton? Average data at the frm level: contrb 0 earn 1 u Indvdual level data vs. Averages of data There s a case where weghts needed arse naturally. Example: the effect of earnngs on the contrbuton to Prvate Provdent Fund. Indvdual data: contrb,e = 0 earn,e + u,e Assume MLR.1 MLR.4 and Var(u,e ) = : denote a partcular frm e: an employee wthn the frm contrb,e : annual contrbuton earn,e : annual earnngs VAR(u bar) = /m (Heteroskedastc) h =1/m weght = m = m 1/ (n the transformed equaton and Evews) Show the error n the transformed equaton s homoskedastc! WLS: to use wth per capta data A smlar weghtng arses when we use data at the cty, provnce, or country level. In summary, WLS gves us an effcent way to treat averages of data Case : h(x) must be estmated Feasble GLS Estmator, Suppose the heteroskedastcty functon s unknown.e., VAR(u,, x k ) = h(x) where h(x) s unknown and must be estmated;.e., fnd. Assume that VAR(u x) = exp ( k x k ) u = exp( k x k )v log(u ) = k x k + e Usng n GLS transformaton yelds an estmator, called an FGLS estmator. FGLS s no longer unbased but consstent n large samples. FGLS s no longer BLUE but asymptotcally more effcent than OLS. Estmate log( ) = k x k + e = ftted value of log( ) The estmates of h are smply = exp( ) 51 5

14 Propertes: OLS, GLS and FGLS Example: FGLS and cgarette equaton cgs = 0 log(ncome) + log(cgprc) + 3 educ + 4 age + 5 age + 6 restaurn + u y = 0 + x x x x 6 + u Unbasedness yes yes OLS known h : FGLS BLUE no yes t and F dst. no exact t and F dstrbutons no longer unbased but consstent no longer BLUE but asymptotcally more effcent approxmately t and F dstrbutons Usng Breusch Pagan Test or Whte Tests, we found that the varances are nonconstant. Steps n runnng FGLS equaton Step 1: Run the regresson of y on, x,..., x 6 and obtan resduals (called, resd01) n Evews. Step : Run the regresson of log( ) or log(resd01^) on,, x k and obtan resduals (called, lresd0 n Evews) Step 3: From step, obtan and and the ftted values of log( ) (called ) = log(resd01^) lresd0 Snce h ^ = exp(g ^), then n Evew h01 = exp(log(resd01^) lresd0) Step 4: Run the FGLS equaton usng 1/h01 as weghts. (1/ 01 are weghts n Evews) Evews: Step 1: Estmate the cgarette demand equaton Dependent Varable: CIGS Sample: Included observatons: 807 C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood F-statstc Durbn-Watson stat.0185 Prob(F-statstc) 0 Proc/Make Resdual Seres. Then, name for resdual seres: resd01 55 Step : Run the regresson of log( ) or log(resd01^) on,, x k Dependent Varable: LOG(RESID01^) Included observatons: 807 C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) 0 Proc/Make Resdual Seres. Then, name for resdual seres: lresd0 Step 3: Generatng Seres: h01 = exp(log(resd01^)-lresd0) 56

15 Step 4: FGLS equaton wth weghts, 1/sqr(h01) Evew Trck: WLS; In the Equaton wndow, Choose Estmate and then optons. Clck Weghted LS/TSLS. Type n the weght, 1/sqr(h01). Dependent Varable: CIGS Included observatons: 807 Weghtng seres: 1/SQR(H01) C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN Weghted Statstcs R-squared Mean dependent var Log lkelhood F-statstc Durbn-Watson stat Prob(F-statstc) 0 Unweghted Statstcs R-squared Mean dependent var Alternatvely, Step 4: Regress cgs/sqr(h01) on 1/sqr(h01), log(ncome)/sqr(h01), wth no ntercept Dependent Varable: CIGS/SQR(H01) Included observatons: 807 1/SQR(H01) LOG(INCOME)/SQR(H01) LOG(CIGPRIC)/SQR(H01) EDUC/SQR(H01) AGE/SQR(H01) AGE^/SQR(H01) RESTAURN/SQR(H01) R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regresson Akake nfo crteron Sum squared resd Schwarz crteron Log lkelhood Durbn-Watson stat OLS & FGLS Results Compared Dep. Var = cgs OLS FGLS OLS FGLS Varable Coeffcent Coeffcent Prob. Prob. C LOG(INCOME) LOG(CIGPRIC) EDUC AGE AGE^ RESTAURN Interpretaton: 1. Income effect s now statstcally sgnfcant and larger n magntude.. Prce effect s stll statstcally nsgnfcant. 3. Cgarette smokng s negatvely related to schoolng. Recap of Heteroskedastcy Consequences of Heteroskedastcty Testng for Heteroskedastcty Heteroskedastcty Robust Inference Weghted Least Square Estmaton 4. Age has a dmnshng margnal effect on smokng. Smokng ncreases wth age up untl 4.8 years old and then smokng decreases wth age. 5. Cgarette smokng s negatvely affected by restaurant smokng restrctons

Now we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity

Now we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity ECON 48 / WH Hong Heteroskedastcty. Consequences of Heteroskedastcty for OLS Assumpton MLR. 5: Homoskedastcty var ( u x ) = σ Now we relax ths assumpton and allow that the error varance depends on the

More information

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3. Outlne 3. Multple Regresson Analyss: Estmaton I. Motvaton II. Mechancs and Interpretaton of OLS Read Wooldrdge (013), Chapter 3. III. Expected Values of the OLS IV. Varances of the OLS V. The Gauss Markov

More information

a. (All your answers should be in the letter!

a. (All your answers should be in the letter! Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal

More information

Professor Chris Murray. Midterm Exam

Professor Chris Murray. Midterm Exam Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.

More information

CHAPTER 8 SOLUTIONS TO PROBLEMS

CHAPTER 8 SOLUTIONS TO PROBLEMS CHAPTER 8 SOLUTIONS TO PROBLEMS 8.1 Parts () and (). The homoskedastcty assumpton played no role n Chapter 5 n showng that OLS s consstent. But we know that heteroskedastcty causes statstcal nference based

More information

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

CHAPER 11: HETEROSCEDASTICITY: WHAT HAPPENS WHEN ERROR VARIANCE IS NONCONSTANT?

CHAPER 11: HETEROSCEDASTICITY: WHAT HAPPENS WHEN ERROR VARIANCE IS NONCONSTANT? Basc Econometrcs, Gujarat and Porter CHAPER 11: HETEROSCEDASTICITY: WHAT HAPPENS WHEN ERROR VARIANCE IS NONCONSTANT? 11.1 (a) False. The estmators are unbased but are neffcent. (b) True. See Sec. 11.4

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model

More information

Lecture 4 Hypothesis Testing

Lecture 4 Hypothesis Testing Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to

More information

If we apply least squares to the transformed data we obtain. which yields the generalized least squares estimator of β, i.e.,

If we apply least squares to the transformed data we obtain. which yields the generalized least squares estimator of β, i.e., Econ 388 R. Butler 04 revsons lecture 6 WLS I. The Matrx Verson of Heteroskedastcty To llustrate ths n general, consder an error term wth varance-covarance matrx a n-by-n, nxn, matrx denoted as, nstead

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate

More information

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10) I. Defnton and Problems Econ7 Appled Econometrcs Topc 9: Heteroskedastcty (Studenmund, Chapter ) We now relax another classcal assumpton. Ths s a problem that arses often wth cross sectons of ndvduals,

More information

Module Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1

Module Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1 UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PG Examnaton 016-17 ECONOMETRIC METHODS ECO-7000A Tme allowed: hours Answer ALL FOUR Questons. Queston 1 carres a weght of 5%; Queston carres 0%;

More information

Chapter 5: Hypothesis Tests, Confidence Intervals & Gauss-Markov Result

Chapter 5: Hypothesis Tests, Confidence Intervals & Gauss-Markov Result Chapter 5: Hypothess Tests, Confdence Intervals & Gauss-Markov Result 1-1 Outlne 1. The standard error of 2. Hypothess tests concernng β 1 3. Confdence ntervals for β 1 4. Regresson when X s bnary 5. Heteroskedastcty

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

) is violated, so that V( instead. That is, the variance changes for at least some observations.

) is violated, so that V( instead. That is, the variance changes for at least some observations. Econ 388 R. Butler 014 revsons Lecture 15 I. HETEROSKEDASTICITY: both pure and mpure (the mpure verson s due to an omtted regressor that s correlated wth the ncluded regressors n the model) A. heteroskedastcty=when

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

β0 + β1xi and want to estimate the unknown

β0 + β1xi and want to estimate the unknown SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal

More information

ECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees.

ECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees. Model and Data ECON 35* -- NOTE 3 Tests for Coeffcent Dfferences: Examples. Introducton Sample data: A random sample of 534 pad employees. Varable defntons: W hourly wage rate of employee ; lnw the natural

More information

January Examinations 2015

January Examinations 2015 24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes 25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

e i is a random error

e i is a random error Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown

More information

Economics 130. Lecture 4 Simple Linear Regression Continued

Economics 130. Lecture 4 Simple Linear Regression Continued Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson

More information

Question 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%.

Question 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%. UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PGT Examnaton 017-18 FINANCIAL ECONOMETRICS ECO-7009A Tme allowed: HOURS Answer ALL FOUR questons. Queston 1 carres a weght of 5%; queston carres

More information

F8: Heteroscedasticity

F8: Heteroscedasticity F8: Heteroscedastcty Feng L Department of Statstcs, Stockholm Unversty What s so-called heteroscedastcty In a lnear regresson model, we assume the error term has a normal dstrbuton wth mean zero and varance

More information

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students. PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton

More information

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random

More information

Chapter 3. Two-Variable Regression Model: The Problem of Estimation

Chapter 3. Two-Variable Regression Model: The Problem of Estimation Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that

More information

Chapter 15 - Multiple Regression

Chapter 15 - Multiple Regression Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term

More information

CHAPTER 8. Exercise Solutions

CHAPTER 8. Exercise Solutions CHAPTER 8 Exercse Solutons 77 Chapter 8, Exercse Solutons, Prncples of Econometrcs, 3e 78 EXERCISE 8. When = N N N ( x x) ( x x) ( x x) = = = N = = = N N N ( x ) ( ) ( ) ( x x ) x x x x x = = = = Chapter

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

Scatter Plot x

Scatter Plot x Construct a scatter plot usng excel for the gven data. Determne whether there s a postve lnear correlaton, negatve lnear correlaton, or no lnear correlaton. Complete the table and fnd the correlaton coeffcent

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables

More information

Tests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions

Tests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions ECONOMICS 35* -- NOTE ECON 35* -- NOTE Tests of Sngle Lnear Coeffcent Restrctons: t-tests and -tests Basc Rules Tests of a sngle lnear coeffcent restrcton can be performed usng ether a two-taled t-test

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

Properties of Least Squares

Properties of Least Squares Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures

More information

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

Learning Objectives for Chapter 11

Learning Objectives for Chapter 11 Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method

More information

Chapter 15 Student Lecture Notes 15-1

Chapter 15 Student Lecture Notes 15-1 Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Continuous vs. Discrete Goods

Continuous vs. Discrete Goods CE 651 Transportaton Economcs Charsma Choudhury Lecture 3-4 Analyss of Demand Contnuous vs. Dscrete Goods Contnuous Goods Dscrete Goods x auto 1 Indfference u curves 3 u u 1 x 1 0 1 bus Outlne Data Modelng

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Diagnostics in Poisson Regression. Models - Residual Analysis

Diagnostics in Poisson Regression. Models - Residual Analysis Dagnostcs n Posson Regresson Models - Resdual Analyss 1 Outlne Dagnostcs n Posson Regresson Models - Resdual Analyss Example 3: Recall of Stressful Events contnued 2 Resdual Analyss Resduals represent

More information

Exam. Econometrics - Exam 1

Exam. Econometrics - Exam 1 Econometrcs - Exam 1 Exam Problem 1: (15 ponts) Suppose that the classcal regresson model apples but that the true value of the constant s zero. In order to answer the followng questons assume just one

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)

More information

Problem of Estimation. Ordinary Least Squares (OLS) Ordinary Least Squares Method. Basic Econometrics in Transportation. Bivariate Regression Analysis

Problem of Estimation. Ordinary Least Squares (OLS) Ordinary Least Squares Method. Basic Econometrics in Transportation. Bivariate Regression Analysis 1/60 Problem of Estmaton Basc Econometrcs n Transportaton Bvarate Regresson Analyss Amr Samm Cvl Engneerng Department Sharf Unversty of Technology Ordnary Least Squares (OLS) Maxmum Lkelhood (ML) Generally,

More information

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

LOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi

LOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi LOGIT ANALYSIS A.K. VASISHT Indan Agrcultural Statstcs Research Insttute, Lbrary Avenue, New Delh-0 02 amtvassht@asr.res.n. Introducton In dummy regresson varable models, t s assumed mplctly that the dependent

More information

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques

More information

STAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression

STAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression STAT 45 BIOSTATISTICS (Fall 26) Handout 5 Introducton to Logstc Regresson Ths handout covers materal found n Secton 3.7 of your text. You may also want to revew regresson technques n Chapter. In ths handout,

More information

Chapter 5 Multilevel Models

Chapter 5 Multilevel Models Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level

More information

STAT 3008 Applied Regression Analysis

STAT 3008 Applied Regression Analysis STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,

More information

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty

More information

Correlation and Regression

Correlation and Regression Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and

More information

Biostatistics 360 F&t Tests and Intervals in Regression 1

Biostatistics 360 F&t Tests and Intervals in Regression 1 Bostatstcs 360 F&t Tests and Intervals n Regresson ORIGIN Model: Y = X + Corrected Sums of Squares: X X bar where: s the y ntercept of the regresson lne (translaton) s the slope of the regresson lne (scalng

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

REGRESSION ANALYSIS II- MULTICOLLINEARITY

REGRESSION ANALYSIS II- MULTICOLLINEARITY REGRESSION ANALYSIS II- MULTICOLLINEARITY QUESTION 1 Departments of Open Unversty of Cyprus A and B consst of na = 35 and nb = 30 students respectvely. The students of department A acheved an average test

More information

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y) Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,

More information

CDS M Phil Econometrics

CDS M Phil Econometrics 6//9 OLS Volaton of Assmptons an Plla N Assmpton of Sphercal Dstrbances Var( E( T I n E( T E( E( E( n E( E( E( n E( n E( n E( n I n Therefore the reqrement for sphercal dstrbances s ( Var( E(,..., n homoskedastcty

More information

Chapter 4: Regression With One Regressor

Chapter 4: Regression With One Regressor Chapter 4: Regresson Wth One Regressor Copyrght 2011 Pearson Addson-Wesley. All rghts reserved. 1-1 Outlne 1. Fttng a lne to data 2. The ordnary least squares (OLS) lne/regresson 3. Measures of ft 4. Populaton

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

T E C O L O T E R E S E A R C H, I N C.

T E C O L O T E R E S E A R C H, I N C. T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference

More information

Lecture 3 Specification

Lecture 3 Specification Lecture 3 Specfcaton 1 OLS Estmaton - Assumptons CLM Assumptons (A1) DGP: y = X + s correctly specfed. (A) E[ X] = 0 (A3) Var[ X] = σ I T (A4) X has full column rank rank(x)=k-, where T k. Q: What happens

More information

Econometric Analysis of Panel Data. William Greene Department of Economics Stern School of Business

Econometric Analysis of Panel Data. William Greene Department of Economics Stern School of Business Econometrc Analyss of Panel Data Wllam Greene Department of Economcs Stern School of Busness Econometrc Analyss of Panel Data 5. Random Effects Lnear Model The Random Effects Model The random effects model

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan

More information

University of California at Berkeley Fall Introductory Applied Econometrics Final examination

University of California at Berkeley Fall Introductory Applied Econometrics Final examination SID: EEP 118 / IAS 118 Elsabeth Sadoulet and Daley Kutzman Unversty of Calforna at Berkeley Fall 01 Introductory Appled Econometrcs Fnal examnaton Scores add up to 10 ponts Your name: SID: 1. (15 ponts)

More information

Systems of Equations (SUR, GMM, and 3SLS)

Systems of Equations (SUR, GMM, and 3SLS) Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ

More information

First Year Examination Department of Statistics, University of Florida

First Year Examination Department of Statistics, University of Florida Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve

More information

Reminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1

Reminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1 Lecture 9: Interactons, Quadratc terms and Splnes An Manchakul amancha@jhsph.edu 3 Aprl 7 Remnder: Nested models Parent model contans one set of varables Extended model adds one or more new varables to

More information

4.3 Poisson Regression

4.3 Poisson Regression of teratvely reweghted least squares regressons (the IRLS algorthm). We do wthout gvng further detals, but nstead focus on the practcal applcaton. > glm(survval~log(weght)+age, famly="bnomal", data=baby)

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Tests of Exclusion Restrictions on Regression Coefficients: Formulation and Interpretation

Tests of Exclusion Restrictions on Regression Coefficients: Formulation and Interpretation ECONOMICS 5* -- NOTE 6 ECON 5* -- NOTE 6 Tests of Excluson Restrctons on Regresson Coeffcents: Formulaton and Interpretaton The populaton regresson equaton (PRE) for the general multple lnear regresson

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

Statistics MINITAB - Lab 2

Statistics MINITAB - Lab 2 Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that

More information