Generalized Least Squares
|
|
- Amelia Weaver
- 5 years ago
- Views:
Transcription
1 Generalized Leas Squares Augus Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume ha Eεε 0 = Ω T T where Ω is a symmeric, posiive definie marix Why posiive definie? likelihood funcion is ½ f (y X) =(π) T/ Ω 1/ exp 1 ¾ (y Xβ)0 Ω 1 (y Xβ) The We wan (y Xβ) 0 Ω 1 (y Xβ) > 0 so ha densiy does no explode Provide oher, more inuiive reasons for Ω posiive definie: Consider a covariance marix Ω of a random vecor ε (wih Eε =0)haisnoposiivedefinie, ie, c : c 0 Ωc 0 Now consider he linear combinaion c 0 ε (noe ha c 0 ε is a scalar) Then Var(c 0 ε)=ec 0 εε 0 c = c 0 Eεε 0 c = c 0 Ω 0 c 0 Consider he special case where T =and µ σ Ω = 1 ρσ 1 σ ρσ 1 σ σ 1
2 Noe ha ρ = Corr (ε 1, ε ) Examples: 1 Time series wih auocorrelaion Heeroskedasiciy 3 Spacial correlaion Ω posdef σ 1 > 0, σ > 0, σ 1σ ρ σ 1σ > 0 σ 1σ 1 ρ > 0 ρ < 1 4 Random effecs models in panel daa Examples of Covariance Marices 1 Le Then y = Xβ + ε ε = ρε 1 + e e iid 0, σ e Eε =0; Eε = σ ε = E [ρε 1 + e ] = E ρ ε 1 +ρε 1 e + e = ρ σ ε + σ e σ ε = ρ σ ε + σ e σ ε = σ e 1 ρ ; Eε ε 1 = E [(ρε 1 + e ) ε 1 ] = ρσ ε = ρσ e 1 ρ ; Eε ε = E [(ρε 1 + e ) ε ] = E [ρε 1 ε + e ε ] = E [ρ (ρε + e 1 ) ε + e ε ] = ρ σ ε = ρ σ e 1 ρ ;
3 Eε ε k = ρ k σ ε = ρk σ e 1 ρ ; 1 ρ ρ ρ T 1 ρ 1 ρ ρ T Ω = σ e 1 ρ ρ ρ 1 ρ T 3 ρ T 1 ρ T ρ T 3 1 This srucure is called auoregressive of order 1 [AR(1)] y = Xβ + ε ε = ae + be 1 e iid 0, σ e Eε =0; Eε = E [ae + be 1 ] = E a e +abe e 1 + b e 1 = a σ e + b σ e = σ e a + b ; Eε ε 1 = E [(ae + be 1 )(ae 1 + be )] = E a e e 1 + abe e + abe 1 + b e 1 e = abσ e; Eε ε = E [(ae + be 1 )(ae + be 3 )] = 0; Eε ε k = 0 k ; a + b ab 0 0 ab a + b 0 0 Ω = σ e 0 ab a + b a + b This srucure is called moving average of order 1 [MA(1)] 3 y = Xβ + ε ε = ρ 1 ε 1 + ρ ε + e e iid 0, σ e 3
4 Eε =0; Define σ k = Eε ε k k 0 Eε = σ 0 = E [ρ 1 ε 1 + ρ ε + e ] = E ρ 1ε 1 +ρ 1 ρ ε 1 ε +ρ 1 ε 1 e + ρ ε +ρ ε e + e = ρ 1σ 0 +ρ 1 ρ σ 1 + ρ σ 0 + σ e = ρ 1 + ρ σ 0 +ρ 1 ρ σ 1 + σ e = ρ 1ρ σ 1 + σ e 1 (ρ 1 + ρ ) ; () Eε ε 1 = σ 1 = E [(ρ 1 ε 1 + ρ ε + e ) ε 1 ] = ρ 1 σ 0 + ρ σ 1 = ρ 1σ 0 1 ρ (3) Equaions () and (3) are wo equaions in wo unknowns: σ 0, σ 1 These are called Yule-Walker equaions (alhouh usually wrien in a slighly differen way) and can be solved for σ 0, σ 1 Onceweknow σ 0, σ 1,we can solve ieraively for oher auocovariance erms as Eε ε k = σ k = E [(ρ 1 ε 1 + ρ ε + e ) ε k ] = ρ 1 σ k 1 + ρ σ k Thissrucureiscalledauoregressiveoforder[AR()] we mean by an AR(p) process? Whawould 4 y = Xβ + ε ε = ae + be 1 + ce e iid 0, σ e Eε = E [ae + be 1 + ce ] = a σ e + b σ e + c σ e = σ e a + b + c ; Eε ε 1 = E [(ae + be 1 + ce )(ae 1 + be + ce 3 )] = abσ e + bcσ e = σ e (ab + bc); 4
5 Eε ε = E [(ae + be 1 + ce )(ae + be 3 + ce 4 )] = acσ e; Eε ε k =0 k 3 This srucure is called moving average of order [MA()] we mean by an MA(q) process? Wha would 5 y = Xβ + ε px ε = ρ i ε i + i=1 e iid 0, σ e qx a i e 1 This srucure is called an auoregressive moving average of orders p, q [ARMA(p, q)] i=0 6 Ω = σ σ σ T This srucure is called heeroskedasiciy If σ = σ, hen i is called homoskedasiciy 7 8 σ σ 0 Ω = 0 0 σ T σ Xk y i = X i β + u i + ε i ; This is a random effecs model in panel daa Provide some examples Wha do he u i errors represen? Why does his cause deviaions from Ω = σ I? 5
6 3 Implicaions of Generalized Error Covariance Srucure Consider he OLS esimaor, bβ = (X 0 X) 1 X 0 y = β +(X 0 X) 1 X 0 ε Noe ha Eβ b = β relies only on EX 0 ε = 0 So more general covariance srucures have no effec on he unbiasedness of OLS They also do no preven bβ being a consisen esimaor of β However, ³ D bβ = E h(x 0 X) 1 X 0 εε 0 X (X 0 X) 1i = (X 0 X) 1 X 0 Eεε 0 X (X 0 X) 1 = (X 0 X) 1 X 0 ΩX (X 0 X) 1 6= σ (X 0 X) 1 Thus, he generalized covariance srucure affecs he covariance marix of β b and hus inference as well We can correc he inference problem by adjusing formulas For example, if hen H 0 : A k (n+1) H A : Aβ 6= c, Aβ b c N (0,V); V = A (X 0 X) 1 X 0 ΩX (X 0 X) 1 A 0 ; 1 ³ Aβ k b 0 c ha (X 0 X) 1 X 0 ΩX b (X 0 X) 1 A 0i 1 ³ Aβ b c F k,t (n+1) where b Ω is a consisen esimaor of Ω 4 Generalized Leas Squares There is sill an efficiency issue: we can do beer han OLS Le H 0 H = Ω 1 wih H having full rank If Ω is posiive definie, hen here is a coninuum of such marices Using equaion (1), premuliply by H o ge Hy = HXβ + Hε, 6
7 and do OLS on he ransformed equaion: bβ = (HX) 0 (HX) 1 (HX) 0 (Hy) = [X 0 H 0 HX] 1 X 0 H 0 Hy = X 0 Ω 1 X 1 X 0 Ω 1 y If we know Ω (and herefore Ω 1 ) we can esimae β using β b Generalized Leas Squares (GLS) Properies of GLS: Thisiscalled bβ = X 0 Ω 1 X 1 X 0 Ω 1 y = X 0 Ω 1 X 1 X 0 Ω 1 (Xβ + ε) = X 0 Ω 1 X 1 X 0 Ω 1 Xβ + X 0 Ω 1 X 1 X 0 Ω 1 ε = β + X 0 Ω 1 X 1 X 0 Ω 1 ε ³ D bβ Noe ha EHε =0and Eβ b = β + E X 0 Ω 1 X 1 X 0 Ω 1 ε = β + X 0 Ω 1 X 1 X 0 Ω 1 Eε = β + X 0 Ω 1 X 1 X 0 Ω 1 0=β ³bβ = E β ³ bβ β 0 h X = E 0 Ω 1 X 1 X 0 Ω 1 εε 0 Ω 1 X X 0 Ω 1 X i 1 = X 0 Ω 1 X 1 X 0 Ω 1 Eεε 0 Ω 1 X X 0 Ω 1 X 1 = X 0 Ω 1 X 1 X 0 Ω 1 ΩΩ 1 X X 0 Ω 1 X 1 = X 0 Ω 1 X 1 X 0 Ω 1 X X 0 Ω 1 X 1 = X 0 Ω 1 X 1 EHεε 0 H 0 = HEεε 0 H 0 = HΩH 0 = H (H 0 H) 1 H 0 = HH 1 (H 0 ) 1 H 0 = I which saisfies he condiions for OLS Gauss-Markov Theorem: OLS is BLUE when D (ε) =σ I in general Discuss 5 Specifying Ω in Parsimoniously GLS is BLUE In general, Ω is no known So we mus esimae i, and maybe we would wan o es some characerisic of i In general, Ω has T (T +1)/ independen 7
8 elemens (why?), and here are only T observaions So here are oo many elemens o esimae wihou imposing more srucure on Ω Consider each of he examples above: 1 AR(1): ε = ρε 1 + e e iid 0, σ e Ω has wo independen elemens: ρ, σe MA(1): ε = ae + be 1 e iid 0, σ e Ω has hree independen elemens: a, b, σe 3 AR(): ε = ρ 1 ε 1 + ρ ε + e e iid 0, σ e Ω has hree independen elemens: ρ 1, ρ, σe An AR(p) process would have p + 1independen elemens: ρ 1, ρ,, ρ p, σe 4 MA(): ε = ae + be 1 + ce e iid 0, σ e Ω has four independen elemens: a, b, c, σe AnMA(q) process would have q + independen elemens: a 0,a 1,, a q, σe 5 ARMA(p, q): ε = px ρ i ε i + i=1 qx a i e 1 e iid 0, σ e Ω has p + q + independen elemens: {ρ i } p i=1, {a i} q i=0, e σ i=0 6 Heeroskedasiciy 1: σ σ 0 Ω = 0 0 σ T Ω has T independen elemens 8
9 7 Heeroskedasiciy : Ω = σ σ 0 ; 0 0 σ T σ X k Ω has 1 independen elemen: he proporionaliy facor 8 Random Effecs: y i = X i β + u i + ε i Ω has independen elemens: σ u, σ ε In each of hese cases, insead of rying (unsuccessfully) o esimae T (T + 1)/ independen elemens, we esimae only he number of independen parameers 6 Esimaing and Tesing for Serial Correlaion 61 Cochrane-Orcu Consider The goal is o esimae ρ 1 Do OLS: y = Xβ + ε, ε AR (1) bβ =(X 0 X) 1 X 0 y Define residuals as 3 Consruc and bε =(I P x ) y bρ = P bε bε 1 P bε bσ e = 1 T X bε 9
10 Noe ha P bε bε 1 plimbρ = plim P bε = plim 1 P T bε bε 1 plim 1 P T bε 1 P T bε bε 1 = plim P bε = ρσ e σ e 1 T = ρ; plimbσ e = σ e 4 Compue 1 bρ bρ bρ T 1 ³ bρ 1 bρ bρ T bω bρ, bσ e = bσ e bρ bρ 1 bρ T 3 1 bρ bρ T 1 bρ T bρ T 3 1 Noe ha plimω b ³ bρ, bσ e = Ω (why?) 5 Do GLS: bβ = ³ X 0 b Ω 1 X 1 X 0 b Ω 1 y 6 Someimes one consrucs GLS residuals, ³ bε = I X X 0 Ω b 1 1 X X 0 Ω b 1 y ³ = I PΩ,x b y and reurns o sep (3) unil convergence is reached Noe ha ³I P bω,x and PΩ,x b are boh idempoen Someimes his mehod is called feasible GLS for he AR(1) case 6 Durbin-Wason Saisic Define DW = = P (bε bε 1 ) P bε 1 P bε bε bε 1 + bε 1 P bε 1 10
11 Assuming ha ε AR (1), plimdw = plim = plim 1 T P ³ bε bε bε 1 + bε 1 P bε 1 P ³ plim 1 T bε bε bε 1 + bε 1 P bε 1 = σ ε ρσ ε σ =(1 ρ) ε If ρ =0,plimDW =;ifρ > 0, plimdw < ; and if ρ < 0, plimdw > The range of DW is (0, 4) If we are ineresed in esing H 0 : ρ =0vs H 0 : ρ 6= 0, we can compare he DW-saisic o However, in order o urn his ino a proper es, we need o know he criical values for he DW disribuion Mos economerics ex books have DW ables 7 Esimaing Ω in General In general, assuming we have specified Ω in erms of a small number of parameers, we can esimae hose parameers using eiher maximum likelihood esimaion (MLE) or mehod of momens (MOM) Here we discuss MOM ConsiderhecasewhereΩ has m independen parameers The basic idea is o compare m heoreical momens o he appropriae m empirical momens o ge esimaes of he m parameers Examples: 1 AR(1): See Cochrane-Orcu above Noe ha P P 1 bε bε 1 T bε bε 1 plimbρ = plim P bε = plim P bε = plim 1 P T bε bε 1 plim 1 P T bε = ρσ e σ e 1 T = ρ; MA(1): plimbσ e = σ e ε = ae + be 1 e iid 0, σ e Varε = a + b σ e; Cov (ε, ε 1 ) = abσ e 11
12 Noe ha we can no separaely idenify all hree parameers because a, b, σ e has he same srucure as (aσe,bσ e, 1) Thus, wih no loss in generaliy, we can se σ e = 1 and esimae only (a, b) We se 1 X bε = Varε = a + b ; T 1 X bε bε 1 = Cov (ε, ε 1 )=ab T This gives wo equaions in wo unknowns and a unique esimae of (a, b) 3 Heeroskedasiciy :σ Xk σ = σ Xk Run a regression of bε = α 0 + α 1 X k + u Given he model specificaion, α 0 =0andα 1 = σ Why is his MOM? 8 Properies of R in he Presence of Serial Correlaion In models wih significan posiive serial correlaion, R will be arificially high IfonewereocompueR for he ransformed equaion, y = X β + ε ρy 1 = X 1 β + ε 1 y ρy 1 =(X ρx 1 ) β + ε ρε 1 y ρy 1 =(X ρx 1 ) β + e, one would ge a much lower R 1
R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More informationRegression with Time Series Data
Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationLecture 10 Estimating Nonlinear Regression Models
Lecure 0 Esimaing Nonlinear Regression Models References: Greene, Economeric Analysis, Chaper 0 Consider he following regression model: y = f(x, β) + ε =,, x is kx for each, β is an rxconsan vecor, ε is
More informationThe Effect of Nonzero Autocorrelation Coefficients on the Distributions of Durbin-Watson Test Estimator: Three Autoregressive Models
EJ Exper Journal of Economi c s ( 4 ), 85-9 9 4 Th e Au h or. Publi sh ed by Sp rin In v esify. ISS N 3 5 9-7 7 4 Econ omics.e xp erjou rn a ls.com The Effec of Nonzero Auocorrelaion Coefficiens on he
More informationEcon Autocorrelation. Sanjaya DeSilva
Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This
More informationVectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1
Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies
More informationDistribution of Least Squares
Disribuion of Leas Squares In classic regression, if he errors are iid normal, and independen of he regressors, hen he leas squares esimaes have an exac normal disribuion, no jus asympoic his is no rue
More informationTesting the Random Walk Model. i.i.d. ( ) r
he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More information5. NONLINEAR MODELS [1] Nonlinear (NL) Regression Models
5. NONLINEAR MODELS [1] Nonlinear (NL) Regression Models General form of nonlinear or linear regression models: y = h(x,β) + ε, ε iid N(0,σ ). Assume ha he x and ε sochasically independen. his assumpion
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationOutline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests
Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple
More informationStationary Time Series
3-Jul-3 Time Series Analysis Assoc. Prof. Dr. Sevap Kesel July 03 Saionary Time Series Sricly saionary process: If he oin dis. of is he same as he oin dis. of ( X,... X n) ( X h,... X nh) Weakly Saionary
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationDistribution of Estimates
Disribuion of Esimaes From Economerics (40) Linear Regression Model Assume (y,x ) is iid and E(x e )0 Esimaion Consisency y α + βx + he esimaes approach he rue values as he sample size increases Esimaion
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationHow to Deal with Structural Breaks in Practical Cointegration Analysis
How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural
More informationLicenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A
Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In
More information14 Autoregressive Moving Average Models
14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class
More informationWednesday, November 7 Handout: Heteroskedasticity
Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures
More informationDynamic Models, Autocorrelation and Forecasting
ECON 4551 Economerics II Memorial Universiy of Newfoundland Dynamic Models, Auocorrelaion and Forecasing Adaped from Vera Tabakova s noes 9.1 Inroducion 9.2 Lags in he Error Term: Auocorrelaion 9.3 Esimaing
More informationSTAD57 Time Series Analysis. Lecture 14
STAD57 Time Series Analysis Lecure 14 1 Maximum Likelihood AR(p) Esimaion Insead of Yule-Walker (MM) for AR(p) model, can use Maximum Likelihood (ML) esimaion Likelihood is join densiy of daa {x 1,,x n
More informationDEPARTMENT OF STATISTICS
A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School
More informationCointegration and Implications for Forecasting
Coinegraion and Implicaions for Forecasing Two examples (A) Y Y 1 1 1 2 (B) Y 0.3 0.9 1 1 2 Example B: Coinegraion Y and coinegraed wih coinegraing vecor [1, 0.9] because Y 0.9 0.3 is a saionary process
More informationØkonomisk Kandidateksamen 2005(II) Econometrics 2. Solution
Økonomisk Kandidaeksamen 2005(II) Economerics 2 Soluion his is he proposed soluion for he exam in Economerics 2. For compleeness he soluion gives formal answers o mos of he quesions alhough his is no always
More informationProperties of Autocorrelated Processes Economics 30331
Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,
More informationA Specification Test for Linear Dynamic Stochastic General Equilibrium Models
Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models
More information1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions
Business School, Brunel Universiy MSc. EC5501/5509 Modelling Financial Decisions and Markes/Inroducion o Quaniaive Mehods Prof. Menelaos Karanasos (Room SS269, el. 01895265284) Lecure Noes 6 1. Diagnosic
More informationSolutions: Wednesday, November 14
Amhers College Deparmen of Economics Economics 360 Fall 2012 Soluions: Wednesday, November 14 Judicial Daa: Cross secion daa of judicial and economic saisics for he fify saes in 2000. JudExp CrimesAll
More informationLecture 6 - Testing Restrictions on the Disturbance Process (References Sections 2.7 and 2.10, Hayashi)
Lecure 6 - esing Resricions on he Disurbance Process (References Secions 2.7 an 2.0, Hayashi) We have eveloe sufficien coniions for he consisency an asymoic normaliy of he OLS esimaor ha allow for coniionally
More informationComparing Means: t-tests for One Sample & Two Related Samples
Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion
More informationTesting for a Single Factor Model in the Multivariate State Space Framework
esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics
More informationMeasurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X.
Measuremen Error 1: Consequences of Measuremen Error Richard Williams, Universiy of Nore Dame, hps://www3.nd.edu/~rwilliam/ Las revised January 1, 015 Definiions. For wo variables, X and Y, he following
More informationECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates)
ECON 48 / WH Hong Time Series Daa Analysis. The Naure of Time Series Daa Example of ime series daa (inflaion and unemploymen raes) ECON 48 / WH Hong Time Series Daa Analysis The naure of ime series daa
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationWisconsin Unemployment Rate Forecast Revisited
Wisconsin Unemploymen Rae Forecas Revisied Forecas in Lecure Wisconsin unemploymen November 06 was 4.% Forecass Poin Forecas 50% Inerval 80% Inerval Forecas Forecas December 06 4.0% (4.0%, 4.0%) (3.95%,
More informationComputer Simulates the Effect of Internal Restriction on Residuals in Linear Regression Model with First-order Autoregressive Procedures
MPRA Munich Personal RePEc Archive Compuer Simulaes he Effec of Inernal Resricion on Residuals in Linear Regression Model wih Firs-order Auoregressive Procedures Mei-Yu Lee Deparmen of Applied Finance,
More informationUnit Root Time Series. Univariate random walk
Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationChapter 5. Heterocedastic Models. Introduction to time series (2008) 1
Chaper 5 Heerocedasic Models Inroducion o ime series (2008) 1 Chaper 5. Conens. 5.1. The ARCH model. 5.2. The GARCH model. 5.3. The exponenial GARCH model. 5.4. The CHARMA model. 5.5. Random coefficien
More informationModeling and Forecasting Volatility Autoregressive Conditional Heteroskedasticity Models. Economic Forecasting Anthony Tay Slide 1
Modeling and Forecasing Volailiy Auoregressive Condiional Heeroskedasiciy Models Anhony Tay Slide 1 smpl @all line(m) sii dl_sii S TII D L _ S TII 4,000. 3,000.1.0,000 -.1 1,000 -. 0 86 88 90 9 94 96 98
More informationMath 10B: Mock Mid II. April 13, 2016
Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.
More informationACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.
ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models
More informationAffine term structure models
Affine erm srucure models A. Inro o Gaussian affine erm srucure models B. Esimaion by minimum chi square (Hamilon and Wu) C. Esimaion by OLS (Adrian, Moench, and Crump) D. Dynamic Nelson-Siegel model (Chrisensen,
More informationDynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:
Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e
More information4.1 Other Interpretations of Ridge Regression
CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning
More informationNature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.
Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike
More information0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED
0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable
More informationTime series Decomposition method
Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,
More information(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.
January 01 Final Exam Quesions: Mark W. Wason (Poins/Minues are given in Parenheses) (15) 1. Suppose ha y follows he saionary AR(1) process y = y 1 +, where = 0.5 and ~ iid(0,1). Le x = (y + y 1 )/. (11)
More informationCHAPTER 17: DYNAMIC ECONOMETRIC MODELS: AUTOREGRESSIVE AND DISTRIBUTED-LAG MODELS
Basic Economerics, Gujarai and Porer CHAPTER 7: DYNAMIC ECONOMETRIC MODELS: AUTOREGRESSIVE AND DISTRIBUTED-LAG MODELS 7. (a) False. Economeric models are dynamic if hey porray he ime pah of he dependen
More informationLecture 33: November 29
36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure
More informationMaximum Likelihood Estimation of Time-Varying Loadings in High-Dimensional Factor Models. Jakob Guldbæk Mikkelsen, Eric Hillebrand and Giovanni Urga
Maximum Likelihood Esimaion of Time-Varying Loadings in High-Dimensional Facor Models Jakob Guldbæk Mikkelsen, Eric Hillebrand and Giovanni Urga CREATES Research Paper 2015-61 Deparmen of Economics and
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationCointegration in Theory and Practice. A Tribute to Clive Granger. ASSA Meetings January 5, 2010
Coinegraion in heory and Pracice A ribue o Clive Granger ASSA Meeings January 5, 00 James H. Sock Deparmen of Economics, Harvard Universiy and he NBER /4/009 /4/009 Coinegraion: he Hisorical Seing Granger
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More informationChapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1)
Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β+β x (11.1.1) 1 o explain household expendiure on food (y) as a funcion of household income (x).
More informationSolutions to Odd Number Exercises in Chapter 6
1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b
More informationInstitute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler
MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationFinancial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS
Name SOLUTIONS Financial Economerics Jeffrey R. Russell Miderm Winer 009 SOLUTIONS You have 80 minues o complee he exam. Use can use a calculaor and noes. Try o fi all your work in he space provided. If
More informationREVIEW OF MAXIMUM LIKELIHOOD ESTIMATION
REVIEW OF MAXIMUM LIKELIHOOD ESIMAION [] Maximum Likelihood Esimaor () Cases in which θ (unknown parameer) is scalar Noaional Clarificaion: From now on, we denoe he rue alue of θ as θ o hen, iew θ as a
More informationIII. Module 3. Empirical and Theoretical Techniques
III. Module 3. Empirical and Theoreical Techniques Applied Saisical Techniques 3. Auocorrelaion Correcions Persisence affecs sandard errors. The radiional response is o rea he auocorrelaion as a echnical
More informationEmpirical Process Theory
Empirical Process heory 4.384 ime Series Analysis, Fall 27 Reciaion by Paul Schrimpf Supplemenary o lecures given by Anna Mikusheva Ocober 7, 28 Reciaion 7 Empirical Process heory Le x be a real-valued
More informationSolutions to Exercises in Chapter 12
Chaper in Chaper. (a) The leas-squares esimaed equaion is given by (b)!i = 6. + 0.770 Y 0.8 R R = 0.86 (.5) (0.07) (0.6) Boh b and b 3 have he expeced signs; income is expeced o have a posiive effec on
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More information(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.
Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of
More informationChoice of Spectral Density Estimator in Ng-Perron Test: A Comparative Analysis
Inernaional Economeric Review (IER) Choice of Specral Densiy Esimaor in Ng-Perron Tes: A Comparaive Analysis Muhammad Irfan Malik and Aiq-ur-Rehman Inernaional Islamic Universiy Islamabad and Inernaional
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationSection 4 NABE ASTEF 232
Secion 4 NABE ASTEF 3 APPLIED ECONOMETRICS: TIME-SERIES ANALYSIS 33 Inroducion and Review The Naure of Economic Modeling Judgemen calls unavoidable Economerics an ar Componens of Applied Economerics Specificaion
More informationDYNAMIC ECONOMETRIC MODELS vol NICHOLAS COPERNICUS UNIVERSITY - TORUŃ Józef Stawicki and Joanna Górka Nicholas Copernicus University
DYNAMIC ECONOMETRIC MODELS vol.. - NICHOLAS COPERNICUS UNIVERSITY - TORUŃ 996 Józef Sawicki and Joanna Górka Nicholas Copernicus Universiy ARMA represenaion for a sum of auoregressive processes In he ime
More informationACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model
More informationExercise: Building an Error Correction Model of Private Consumption. Part II Testing for Cointegration 1
Bo Sjo 200--24 Exercise: Building an Error Correcion Model of Privae Consumpion. Par II Tesing for Coinegraion Learning objecives: This lab inroduces esing for he order of inegraion and coinegraion. The
More informationForecasting optimally
I) ile: Forecas Evaluaion II) Conens: Evaluaing forecass, properies of opimal forecass, esing properies of opimal forecass, saisical comparison of forecas accuracy III) Documenaion: - Diebold, Francis
More information1. Joint stationarity and long run effects in a simple ADL(1,1) Suppose Xt, Y, also is stationary?
HG Third lecure - 9. Jan. 04. Join saionariy and long run effecs in a simple ADL(,) Suppose X, Y are wo saionary ime series. Does i follow ha he sum, X Y, also is saionary? The answer is NO in general.
More informationAutocorrelation and the AR(1) Process
Jeeshim and KUCC65 (7/18/006) Auocorrelaion and he AR(1) Process: 1 Auocorrelaion and he AR(1) Process Hun Myoung Park This documen discusses auocorrelaion (or serial correlaion) in linear regression models
More informationU( θ, θ), U(θ 1/2, θ + 1/2) and Cauchy (θ) are not exponential families. (The proofs are not easy and require measure theory. See the references.
Lecure 5 Exponenial Families Exponenial families, also called Koopman-Darmois families, include a quie number of well known disribuions. Many nice properies enjoyed by exponenial families allow us o provide
More informationLinear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates
Eliza Buszkowska Universiy of Poznań, Poland Linear Combinaions of Volailiy Forecass for he WIG0 and Polish Exchange Raes Absrak. As is known forecas combinaions may be beer forecass hen forecass obained
More informationCS Homework Week 2 ( 2.25, 3.22, 4.9)
CS3150 - Homework Week 2 ( 2.25, 3.22, 4.9) Dan Li, Xiaohui Kong, Hammad Ibqal and Ihsan A. Qazi Deparmen of Compuer Science, Universiy of Pisburgh, Pisburgh, PA 15260 Inelligen Sysems Program, Universiy
More informationHas the Business Cycle Changed? Evidence and Explanations. Appendix
Has he Business Ccle Changed? Evidence and Explanaions Appendix Augus 2003 James H. Sock Deparmen of Economics, Harvard Universi and he Naional Bureau of Economic Research and Mark W. Wason* Woodrow Wilson
More informationChapter 16. Regression with Time Series Data
Chaper 16 Regression wih Time Series Daa The analysis of ime series daa is of vial ineres o many groups, such as macroeconomiss sudying he behavior of naional and inernaional economies, finance economiss
More informationApplied Time Series Notes White noise: e t mean 0, variance 5 2 uncorrelated Moving Average
Applied Time Series Noes Whie noise: e mean 0, variance 5 uncorrelaed Moving Average Order 1: (Y. ) œ e ) 1e -1 all Order q: (Y. ) œ e ) e â ) e all 1-1 q -q ( 14 ) Infinie order: (Y. ) œ e ) 1e -1 ) e
More informationThe Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form
Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure
More informationNavneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi
Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec
More informationThe General Linear Test in the Ridge Regression
ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge
More informationVector autoregression VAR. Case 1
Vecor auoregression VAR So far we have focused mosl on models where deends onl on as. More generall we migh wan o consider oin models ha involve more han one variable. There are wo reasons: Firs, we migh
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationModeling Economic Time Series with Stochastic Linear Difference Equations
A. Thiemer, SLDG.mcd, 6..6 FH-Kiel Universiy of Applied Sciences Prof. Dr. Andreas Thiemer e-mail: andreas.hiemer@fh-kiel.de Modeling Economic Time Series wih Sochasic Linear Difference Equaions Summary:
More informationWednesday, December 5 Handout: Panel Data and Unobservable Variables
Amhers College Deparmen of Economics Economics 360 Fall 0 Wednesday, December 5 Handou: Panel Daa and Unobservable Variables Preview Taking Sock: Ordinary Leas Squares (OLS) Esimaion Procedure o Sandard
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationY 0.4Y 0.45Y Y to a proper ARMA specification.
HG Jan 04 ECON 50 Exercises II - 0 Feb 04 (wih answers Exercise. Read secion 8 in lecure noes 3 (LN3 on he common facor problem in ARMA-processes. Consider he following process Y 0.4Y 0.45Y 0.5 ( where
More informationHW6: MRI Imaging Pulse Sequences (7 Problems for 100 pts)
HW6: MRI Imaging Pulse Sequences (7 Problems for 100 ps) GOAL The overall goal of HW6 is o beer undersand pulse sequences for MRI image reconsrucion. OBJECTIVES 1) Design a spin echo pulse sequence o image
More informationMathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013
Mahemaical Theory and Modeling ISSN -580 (Paper) ISSN 5-05 (Online) Vol, No., 0 www.iise.org The ffec of Inverse Transformaion on he Uni Mean and Consan Variance Assumpions of a Muliplicaive rror Model
More informationSome Basic Information about M-S-D Systems
Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,
More information