The Multiple Regression Model: Hypothesis Tests and the Use of Nonsample Information

Size: px
Start display at page:

Download "The Multiple Regression Model: Hypothesis Tests and the Use of Nonsample Information"

Transcription

1 Chaper 8 The Muliple Regression Model: Hypohesis Tess and he Use of Nonsample Informaion An imporan new developmen ha we encouner in his chaper is using he F- disribuion o simulaneously es a null hypohesis consising of wo or more hypoheses abou he parameers in he muliple regression model. The heories ha economiss develop also someimes provide nonsample informaion ha can be used along wih he informaion in a sample of daa o esimae he parameers of a regression model. A procedure ha combines hese wo ypes of informaion is called resriced leas squares. Slide 8.1

2 I can be a useful echnique when he daa are no informaion-rich, a condiion called collineariy, and he heoreical informaion is good. The resriced leas squares procedure also plays a useful pracical role when esing hypoheses. In his chaper we adop assumpions MR1-MR6, including normaliy. If he errors are no normal, hen he resuls presened in his chaper will hold approximaely if he sample is large. Wha we discover in his chaper is ha a single null hypohesis ha may involve one or more parameers can be esed via a -es or an F-es. Boh are equivalen. A join null hypohesis, ha involves a se of hypoheses, is esed via an F-es. Slide 8.

3 8.1 The F-Tes The F-es for a se of hypoheses is based on a comparison of he sum of squared errors from he original, unresriced muliple regression model o he sum of squared errors from a regression model in which he null hypohesis is assumed o be rue. Consider he Bay Area Rapid Food hamburger chain example where weekly oal revenue of he chain (r) is a funcion of a price index of all producs sold (p) and weekly expendiure on adverising (a). r = β+β p +β a + e (8.1.1) 1 3 Suppose ha we wish o es he hypohesis ha changes in price have no effec on oal revenue agains he alernaive ha price does have an effec. Slide 8.3

4 The null and alernaive hypoheses are: H 0: β = 0 and H1: β 0. The resriced model, ha assumes he null hypohesis is rue, is r = β+β a + e (8.1.) 1 3 The sum of squared errors from equaion (8.1.) will be larger han ha from equaion (8.1.1). The idea of he F-es is ha if hese sums of squared errors are subsanially differen, hen he assumpion ha he null hypohesis is rue has significanly reduced he abiliy of he model o fi he daa, and hus he daa do no suppor he null hypohesis. If he null hypohesis is rue, we expec ha he daa are compaible wih he condiions placed on he parameers. Thus, we expec lile change in he sum of squared errors when he null hypohesis is rue. We call he sum of squared errors in he model ha assumes a null hypohesis o be rue he resriced sum of squared errors, or SSE R Slide 8.4

5 The sum of squared errors from he original model is he unresriced sum of squared errors, or SSE U. I is always rue ha SSE SSE 0. Le J be he number of hypoheses. R U The general F-saisic is given by F = ( R U) SSE ( T K ) SSE SSE J U (8.1.3) If he null hypohesis is rue, hen he saisic F has an F-disribuion wih J numeraor degrees of freedom and T K denominaor degrees of freedom. We rejec he null hypohesis if he value of he F-es saisic becomes oo large. We compare he value of F o a criical value F c, which leaves a probabiliy α in he upper ail of he F-disribuion wih J and T K degrees of freedom. For he unresriced and resriced models in equaions (8.1.1) and (8.1.), respecively, we find Slide 8.5

6 SSEU = SSE = R The F-es saisic is: ( R U) SSE ( T K ) SSE SSE J F = = = 4.33 U ( ) ( 5 3) For he F(1,49 ) disribuion he α =.05 criical value is F c = Since F = 4.33 F c we rejec he null hypohesis and conclude ha price does have a significan effec on oal revenue. F (1,49) The p-value for his es is p = P[ 4.33] =.047, which is less han α =.05, and hus we rejec he null hypohesis on his basis as well. Slide 8.6

7 The p-value can also be obained using modern sofware. Table 8.1 EViews Oupu for Tesing Price Coefficien Null Hypohesis: C()=0 F-saisic Probabiliy When esing one "equaliy" null hypohesis agains a "no equal o" alernaive hypohesis, eiher a -es or an F-es can be used and he oucomes will be idenical. The reason for his is ha here is an exac relaionship beween he - and F- disribuions. The square of a random variable wih df degrees of freedom is an F random variable wih disribuion F( 1,df ). Slide 8.7

8 8.1.1 The F-Disribuion: Theory An F random variable is formed by he raio of wo independen chi-square random variables ha have been divided by heir degrees of freedom. V If 1 ~ χ( m ) and ( ) 1 V ~ χ m and if V1 and V are independen, hen F = V 1 m 1 V m ~ m m F (8.1.4) (. ) 1 The F-disribuion is said o have numeraor degrees of freedom and m1 m denominaor degrees of freedom. The values of and m deermine he shape of he m1 disribuion, which in general looks like Figure 8.1. The range of he random variable is (0, ) and i has a long ail o he righ. Slide 8.8

9 When you ake courses in economeric heory, you prove ha V V SSE SSE σ R U 1 = ~ SSE = χ σ U ~ ( T K) χ (8.1.5) ( J ) (8.1.6) and ha and V are independen. V1 The resul for requires he relevan null hypohesis o be rue; ha for V does no. V1 σ V1 Noe ha cancels when we ake he raio of o V, yielding V J ( R U) ( ) SSE SSE J 1 F = = V ( T K ) SSE U T K (8.1.7) Slide 8.9

10 8. Tesing he Significance of a Model An imporan applicaion of he F-es is for wha is called "esing he overall significance of a model". Consider again he general muliple regression model wih (K 1) explanaory variables and K unknown coefficiens y = β+ x β+ x β+ + x β + e (8..1) K K To examine wheher we have a viable explanaory model, we se up he following null and alernaive hypoheses H H : β = 0, β = 0,, β = 0 : a leas one of he β is nonzero K k (8..) The null hypohesis has K 1 pars, and i is called a join hypohesis. If his null hypohesis is rue, none of he explanaory variables influence y, and hus our model is of lile or no value. Slide 8.10

11 If he alernaive hypohesis H 1 is rue, hen a leas one of he parameers is no zero. The alernaive hypohesis does no indicae, however, which variables hose migh be. Since we are esing wheher or no we have a viable explanaory model, he es for (8.4.) is someimes referred o as a es of he overall significance of he regression model. To es he join null hypohesis H :β =β = =β = 0, which acually is K hypoheses, we will use a es based on he F-disribuion. If he join null hypohesis H : β = 0, β = 0,, β = 0 is rue, hen he resriced model is 0 3 The leas squares esimaor of β 1 in his resriced model is sample mean of he observaions on he dependen variable. y 1 K K = β+ e (8..3) The resriced sum of squared errors from he hypohesis (8..) is b * 1 y = = T y, which is he Slide 8.11

12 SSE = ( y b ) = ( y y) = SST * R 1 In his one case, in which we are esing he null hypohesis ha all he model parameers are zero excep he inercep, he resriced sum of squared errors is he oal sum of squares (SST) from he full unconsrained model. The unresriced sum of squared errors is he sum of squared errors from he unconsrained model, or SSE U = SSE. The number of hypoheses is J = K 1. Thus o es he overall significance of a model he F-es saisic can be modified as ( SST SSE)/( K 1) F = (8..4) SSE /( T K) The calculaed value of his es saisic is compared o a criical value from he F (K-1,T-K) disribuion. To illusrae, we es he overall significance of he regression used o explain he Bay Area Burger s oal revenue. We wan o es wheher he coefficiens of price and of Slide 8.1

13 adverising expendiure are boh zero, agains he alernaive ha a leas one of he coefficiens is no zero. Thus, in he model we wan o es agains he alernaive r = β+β p +β a + e 1 3 H0: β = 0, β 3 = 0 H1: β 0, or β3 0, or boh are nonzero The ingrediens for his es, and he es saisic value iself, are repored in he Analysis of Variance Table repored by mos regression sofware. The SHAZAM oupu for he Bay Area Rapid Food daa appears in Table 8.. From his able, we see ha SSE = SST = and SSE = SSE = R U Slide 8.13

14 Table 8. ANOVA Table obained using SHAZAM ANALYSIS OF VARIANCE - FROM MEAN SS DF MS F REGRESSION ERROR P-VALUE TOTAL The values of Mean Square are he raios of he Sums of Squares values o he degrees of freedom, DF. In urn, he raio of he Mean Squares is he F-value for he es of overall significance of he model. For he Bay Area Burger daa his calculaion is F ( SST SSE) /( K 1) ( ) / = = = = SSE /( T K) /(5 3) Slide 8.14

15 The 5% criical value for he F saisic wih (, 49) degrees of freedom is F c = Since > 3.187, we rejec H 0 and conclude ha he esimaed relaionship is a significan one. Insead of looking up he criical value, we could have made our conclusion based on he p-value 8.3 An Exended Model We have hypohesized r = β+β p +β a + e (8.3.1) 1 3 As he level of adverising expendiure increases, we would expec diminishing reurns o se in. Slide 8.15

16 One way of allowing for diminishing reurns o adverising is o include he squared value of adverising, a, ino he model as anoher explanaory variable, so r = β+β p +β a +β a + e (8.3.) The response of E(r) o a is ΔEr ( ) Er ( ) = =β 3+ β4a Δa a ( p held consan) (8.3.3) We expec ha β 3 > 0. Also, o achieve diminishing reurns he response mus decline as a increases. Tha is, we expec β 4 < 0. The leas squares esimaes, using he daa in Table 7.1, are r ˆ = p +.948a a (6.58) (3.459) (0.786) (0.0361) (s.e.) (R8.4) Anoher 6 weeks of daa were colleced. Slide 8.16

17 Combining all he daa we obain he following leas squares esimaed equaion r ˆ = p a 0.068a (3.74) (1.58) (0.4) (0.0159) (s.e.) (R8.5) The esimaed coefficien of now has he expeced sign. Is -value of = 1.68 a implies ha b4 is significanly differen from zero, using a one-ailed es and α = Tesing Some Economic Hypoheses The Significance of Adverising Our expanded model is r = β+β p +β a +β a + e (8.4.1) How would we es wheher adverising has an effec upon oal revenue? If eiher β 3 or β 4 are no zero hen adverising has an effec upon revenue. Slide 8.17

18 Based on one-ailed -ess we can conclude ha individually, β 3 and β 4, are no zero, and of he correc sign. The join es will use he F-saisic in (8.1.3) o es H : β = 0, β = Compare he unresriced model in equaion o he resriced model, which assumes he null hypohesis is rue. The resriced model is r = β+β p + e (8.4.) 1 The elemens of he es are: 1. The join null hypohesis H0: β 3 = 0, β 4 = 0. The alernaive hypohesis H1: β3 0, or β4 0, or boh are nonzero Slide 8.18

19 ( SSER SSEU)/ J 3. The es saisic is F = SSE /( T K) U where J=, T=78 and K= 4. SSE U = is he sum of squared errors from (8.4.1). SSE R = is he sum of squared errors from (8.4.) ~ ( JT, K ) 4. If he join null hypohesis is rue, hen F F. The criical value Fc comes from he F (,74) disribuion, and for he α =.05 level of significance i is The value of he F-saisic is F = > F c and we rejec he null hypohesis ha boh β 3 = 0 and β 4 = 0 and conclude ha a leas one of hem is no zero, implying ha adverising has a significan effec upon oal revenue The Opimal Level of Adverising From (8.3.3) he marginal benefi from anoher uni of adverising is he increase in oal revenue: ΔEr ( ) Δa ( p held consan) = β + β a 3 4 Slide 8.19

20 Adverising expendiures should be increased o he poin where he marginal benefi of $1 of adverising falls o $1, or where β + β = 1 3 4a Using he leas squares esimaes for β 3 and β 4 in (R8.5) we can esimae he opimal level of adverising from (.068) ˆ = 1 Solving, we obain a ˆ = , which implies ha he opimal weekly adverising expendiure is $44, Suppose ha he franchise managemen, based on experience in oher ciies, hinks ha $44, is oo high, and ha he opimal level of adverising is acually abou $40,000. a Slide 8.0

21 The null hypohesis we wish o es is H : β + β (40) = 1 agains he alernaive ha H1: β 3+ β4(40) 1. The es saisic is ( b3+ 80 b4) 1 = se( b + 80 b ) 3 4 var( 垐 b + 80 b ) = var( b ) + 80 var( 垐 b ) + (80)cov( b, b ) = Then, he calculaed value of he -saisic is = = The criical value for his wo-ailed es comes from he (74) disribuion. A he α=.05 level of significance c = and hus we canno rejec he null hypohesis ha he opimal level of adverising is $40,000 per week. Slide 8.1

22 ( SSER SSEU)/ J Alernaively, using an F-es, he es saisic is F = SSE /( T K) U where J=1, T=78 and K= 4. SSE U = is he sum of squared errors from he full unresriced model in (8.4.1). SSE R is he sum of squared errors from he resriced model in which i is assumed ha he null hypohesis is rue. The resriced model is Rearranging we have ( r a ) =β +β p + (1 80 β ) a +β a + e ( r a) =β 1+β p +β4( a 80 a) + e Slide 8.

23 Esimaing his model by leas squares yields he resriced sum of squared errors SSE R = The calculaed value of he F-saisic is F = ( ) / / 74 =.0637 The criical value F c comes from he F (1,74) disribuion. For α =.05 he criical value is F c = Slide 8.3

24 8.4.3 The Opimal Level of Adverising and Price Weekly oal revenue is expeced o be $175,000 if adverising is $40,000, and p=$. In he conex of our model, Er ( ) =β +β p+β a+β a =β +β () +β (40) +β (40) = We now formulae he wo join hypoheses H0: β 3 + β 4(40) = 1, β 1+ β + 40β β 4 = 175 Because here are J= hypoheses o es joinly we will use an F-es. Slide 8.4

25 ( SSER SSEU)/ J The es saisic is F =, where J=. The compued value of he F- SSEU /( T K) saisic is F=1.75. The criical value for he es comes from he F (,74) disribuion and is F c = Since F < F c we do no rejec he null hypohesis 8.5 The Use of Nonsample Informaion From he heory of consumer choice in microeconomics, we know ha he demand for a good will depend on he price of ha good, on he prices of oher goods, paricularly subsiues and complemens, and on income. In he case of beer, i is reasonable o relae he quaniy demanded (q) o he price of beer (p B ), he price of oher liquor (p L ), he price of all oher remaining goods and services (p R ), and income (m). We wrie his relaionship as Slide 8.5

26 (,,, ) q= f p p p m (8.5.1) B L R We assume he log-log funcional form is appropriae for his demand relaionship ln q= β +β ln p +β ln p +β ln p +β ln m (8.5.) 1 B 3 L 4 R 5 A relevan piece of nonsample informaion is ha economic agens do no suffer from money illusion. Having all prices and income change by he same proporion is equivalen o muliplying each price and income by a consan λ ( B) ( L) ( R) ( ) p p p m ( ) ln q=β 1+βln λ p +β3ln λ p +β4ln λ p +β5ln λm =β +β ln +β ln +β ln +β ln + β +β +β +β lnλ (8.5.3) 1 B 3 L 4 R Slide 8.6

27 For here o be no change in ln(q) when all prices and income go up by he same proporion, i mus be rue ha β +β 3 +β 4 +β 5 = 0 (8.5.4) To inroduce he nonsample informaion, we solve he parameer resricion β +β 3+β 4 +β 5 = 0 for one of he βk s. β4 = β β3 β 5 (8.5.6) Subsiuing his expression ino he original model gives Slide 8.7

28 ( ) ( ln ln ) ( ln ln ) ( ln ln ) ln q =β +β ln p +β ln p + β β β ln p +β ln m + e 1 B 3 L 3 5 R 5 =β +β p p +β p p +β m p + e (8.5.7) 1 B R 3 L R 5 R p B p L m =β 1+β ln +β 3ln +β 5ln + e pr pr pr To ge resriced leas squares esimaes, we apply he leas squares esimaion o he resriced model p B p L m ln qˆ = ln ln ln pr pr pr (3.714) (0.166) (0.84) (0.47) (R8.8) * Le he resriced leas squares esimaes in equaion be denoed as b k. Slide 8.8

29 b = b b b * * * * = ( 1.994) = The resriced leas squares esimaor is biased, and we impose are exacly rue. * ( k) E b β, unless he consrains The second propery of he resriced leas squares esimaor is ha is variance is smaller han he variance of he leas squares esimaor, wheher he consrains imposed are rue or no. By incorporaing he addiional informaion wih he daa, we usually give up unbiasedness in reurn for reduced variances. k Slide 8.9

30 8.6 Model Specificaion Wha are he imporan consideraions when choosing a model? Wha are he consequences of choosing he wrong model? Are here ways of assessing wheher a model is adequae? Omied and Irrelevan Variables Suppose ha, in a paricular indusry, he wage rae of employees, depends on heir experience E and heir moivaion M, W W = β+β E +β M e (8.6.1) Daa on moivaion are no available. So, insead, we esimae he model W = β+β 1 E + v (8.6.) Slide 8.30

31 By esimaing (8.6.) we are imposing he resricion = 0 when i is no rue. β 3 The leas squares esimaor for β 1 and β will generally be biased, alhough i will have lower variance. The consequences of omiing relevan variables may lead you o hink ha a good sraegy is o include as many variables as possible in your model. However i may inflae he variances of your esimaes because of he presence of irrelevan variables. Suppose ha he correc specificaion is Bu we esimae he model W = β+β E +β M + e (8.6.3) 1 3 W = β+β E +β M +β C + e where C is he number of children of he -h employee, and where, in realiy, β 4= 0. Then, is an irrelevan variable. Including i does no make he leas squares esimaor C biased, bu i does mean he variances of, and b will be greaer han hose obained by esimaing he correc model in (8.6.3). b1 b 3 Slide 8.31

32 8.6.1a Omied Variable Bias: A Proof Suppose he rue model is y = β+β 1 x+β 3 h+ e, y =β +β x+ e omiing h from he model. 1, bu we esimae he model Then we use he esimaor So, b wh ( x x)( y y) ( x x) y = = * ( x x) ( x x) where w = =β +β + x x ( x x) we 3 Eb ( ) =β +β wh β * 3 Taking a closer look, we find ha Slide 8.3

33 wh Consequenly, ( x x) h ( x x)( h h) = = ( x x) ( x x) ( x x)( h h) ( T 1) cov( ˆ x, h) = = cov( ˆ x, h) Eb ( ) =β +β β * 3 var( ˆ x ) ( x ) ( 1) var( ˆ x T x) Knowing he sign of β and he sign of he covariance beween x and h ells us he direcion of he bias. While omiing a variable from he regression usually biases he leas squares esimaor, if he sample covariance, or sample correlaion, beween and he omied variable is zero, hen he leas squares esimaor in he misspecified model is sill unbiased. h x Slide 8.33

34 8.6. Tesing for Model Misspecificaion: The RESET Tes The RESET es (Regression Specificaion Error Tes) is designed o deec omied variables and incorrec funcional form. I proceeds as follows. Suppose ha we have specified and esimaed he regression model Le he prediced values of he y be y = β+β x +β x + e (8.6.4) y = b + b x + b x ˆ (8.6.5) Consider he following wo arificial models y = β+β x +β x +γ y ˆ 3 y = β+β x +β x +γ y垐 +γ y + e e (8.6.6) (8.6.7) In (8.6.6) a es for misspecificaion is a es of H : γ H : γ = 0 agains he alernaive 0 1 Slide 8.34

35 In (8.6.7), esing H0: γ 1 =γ = 0 agains H1: γ1 0 or γ 0 is a es for misspecificaion. Rejecion of implies he original model is inadequae and can be improved. A H 0 failure o rejec says he es has no been able o deec any misspecificaion. H 0 Overall, he general philosophy of he es is: If we can significanly improve he model by arificially including powers of he predicions of he model, hen he original model mus have been inadequae. As an example of he es, consider he beer demand example used in Secion 8.5 o illusrae he inclusion of non-sample informaion. ln( q ) =β +β ln( p ) +β ln( p ) +β ln( p ) +β ln( m ) + e (8.6.8) 1 B 3 L 4 R 5 Esimaing his model, and hen augmening i wih squares of he predicions, and squares and cubes of he predicions, yields he RESET es resuls in he op half of Table 8.5. Slide 8.35

36 The F-values are quie small and heir corresponding p-values of 0.93 and 0.70 are well above he convenional significance level of There is no evidence from he RESET es o sugges he log-log model is inadequae. Table 8.5 RESET Tes Resuls for Beer Demand Example Ramsey RESET Tes: LOGLOG Model F-saisic (1 erm) Probabiliy F-saisic ( erms) Probabiliy Ramsey RESET Tes: LINEAR Model F-saisic (1 erm) Probabiliy F-saisic ( erms) Probabiliy Now, suppose ha we had specified a linear model insead of a log-log model. Slide 8.36

37 q = β 1+β pb +β 3pL +β 4pR +β 5m + e (8.6.9) Augmening his model wih he squares and hen he squares and cubes of he predicions q yields he RESET es resuls in he boom half of Table 8.5. The p- ˆ values of and are below 0.05 suggesing he linear model is inadequae. 8.7 Collinear Economic Variables When daa are he resul of an unconrolled experimen many of he economic variables may move ogeher in sysemaic ways. Such variables are said o be collinear, and he problem is labeled collineariy, or mulicollineariy when several variables are involved. Consider he problem faced by Bay Area Rapid Food. Suppose i has been common pracice o coordinae hese wo adverising devices, so ha a he same ime Slide 8.37

38 adverising appears in he newspapers here are flyers disribued conaining coupons for price reducions on hamburgers. I will be difficul for such daa o reveal he separae effecs of he wo ypes of ads. Because he wo ypes of adverising expendiure move ogeher, i may be difficul o sor ou heir separae effecs on oal revenue. Consider a producion relaionship. There are cerain facors of producion (inpus), such as labor and capial, ha are used in relaively fixed proporions. Proporionae relaionships beween variables are he very sor of sysemaic relaionships ha epiomize collineariy. A relaed problem exiss when he values of an explanaory variable do no vary or change much wihin he sample of daa. When an explanaory variable exhibis lile variaion, hen i is difficul o isolae is impac. Slide 8.38

39 8.7.1 The Saisical Consequences of Collineariy 1. Whenever here are one or more exac linear relaionships among he explanaory variables, hen he condiion of exac collineariy, or exac mulicollineariy, exiss. In his case he leas squares esimaor is no defined.. When nearly exac linear dependencies among he explanaory variables exis, some of he variances, sandard errors and covariances of he leas squares esimaors may be large. 3. When esimaor sandard errors are large, i is likely ha he usual -ess will lead o he conclusion ha parameer esimaes are no significanly differen from zero. This oucome occurs despie possibly high R or F-values indicaing significan explanaory power of he model as a whole. 4. Esimaors may be very sensiive o he addiion or deleion of a few observaions, or he deleion of an apparenly insignifican variable. Slide 8.39

40 5. Despie he difficulies in isolaing he effecs of individual variables from such a sample, accurae forecass may sill be possible Idenifying and Miigaing Collineariy One simple way o deec collinear relaionships is o use sample correlaion coefficiens beween pairs of explanaory variables. A rule of humb is ha a correlaion coefficien beween wo explanaory variables greaer han 0.8 or 0.9 indicaes a srong linear associaion and a poenially harmful collinear relaionship. A second simple and effecive procedure for idenifying he presence of collineariy is o esimae so-called auxiliary regressions. In hese leas squares regressions he lef-hand-side variable is one of he explanaory variables, and he righ-hand-side variables are all he remaining explanaory variables. For example, he auxiliary regression for x is x = a x + a x + L + a x + error K K Slide 8.40

41 If he R from his arificial model is high, above.80, he implicaion is ha a large porion of he variaion in x is explained by variaion in he oher explanaory variables. One soluion is o obain more informaion and include i in he analysis. One form he new informaion can ake is more, and beer, sample daa. We may add srucure o he problem by inroducing nonsample informaion in he form of resricions on he parameers. Slide 8.41

42 8.8 Predicion Consider y = β+ x β+ x β+ e (8.8.1) where he e are uncorrelaed random variables wih mean 0 and variance Given a se of values for he explanaory variables, ( 1 x0 x 03 ), he predicion problem is o predic he value of he dependen variable y 0, which is given by σ. y = β+ x β+ x β+ e (8.8.) The random error e 0 we assume o be uncorrelaed wih each of he sample errors e and o have he same mean, 0, and variance, Under hese assumpions, he bes linear unbiased predicor of y 0 is given by σ. Slide 8.4

43 ŷ = b + x b + x b (8.8.3) This predicor is unbiased in he sense ha he average value of he forecas error is zero. Tha is, if f = ( y yˆ ) 0 is he forecas error hen E( f ) = 0. 0 The predicor is bes in ha for any oher linear and unbiased predicor of y 0, he variance of he forecas error is larger han var( f ) var ( y yˆ ) =. 0 0 var( f ) = var[( β +β x +β x + e ) ( b + b x + b x )] = var( e b b x b x ) = var( e ) + var( b) + x var( b ) + x var( b ) + x cov( b, b ) + x cov( b, b ) x x cov( b, b ) (8.8.4) Slide 8.43

44 Each of hese erms involves σ which we replace wih is esimaor ˆσ o obain he esimaed variance of he forecas error var( ˆ f ). The square roo of his quaniy is he sandard error of he forecas, se( f ) = var( ˆ f ). If he random errors e and e 0 are normally disribued, or if he sample is large, hen f y ˆ 0 y0 = se( f ) var ˆ y yˆ ( ) 0 0 ~ ( T K) (8.8.5) A 100(1 α)% inerval predicor for y 0 is yˆ 0 ± cse( f), where c is a criical value from he (T-K) disribuion. Slide 8.44

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Solutions to Odd Number Exercises in Chapter 6

Solutions to Odd Number Exercises in Chapter 6 1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

Chapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1)

Chapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1) Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β+β x (11.1.1) 1 o explain household expendiure on food (y) as a funcion of household income (x).

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H. ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models

More information

Comparing Means: t-tests for One Sample & Two Related Samples

Comparing Means: t-tests for One Sample & Two Related Samples Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion

More information

Solutions to Exercises in Chapter 12

Solutions to Exercises in Chapter 12 Chaper in Chaper. (a) The leas-squares esimaed equaion is given by (b)!i = 6. + 0.770 Y 0.8 R R = 0.86 (.5) (0.07) (0.6) Boh b and b 3 have he expeced signs; income is expeced o have a posiive effec on

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

y = β 1 + β 2 x (11.1.1)

y = β 1 + β 2 x (11.1.1) Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β 1 + β x (11.1.1) o explain household expendiure on food (y) as a funcion of household income (x).

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions

1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions Business School, Brunel Universiy MSc. EC5501/5509 Modelling Financial Decisions and Markes/Inroducion o Quaniaive Mehods Prof. Menelaos Karanasos (Room SS269, el. 01895265284) Lecure Noes 6 1. Diagnosic

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Econ Autocorrelation. Sanjaya DeSilva

Econ Autocorrelation. Sanjaya DeSilva Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This

More information

Hypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests

Hypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests ECONOMICS 35* -- NOTE 8 M.G. Abbo ECON 35* -- NOTE 8 Hypohesis Tesing in he Classical Normal Linear Regression Model. Componens of Hypohesis Tess. A esable hypohesis, which consiss of wo pars: Par : a

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Regression with Time Series Data

Regression with Time Series Data Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih

More information

Explaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015

Explaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015 Explaining Toal Facor Produciviy Ulrich Kohli Universiy of Geneva December 2015 Needed: A Theory of Toal Facor Produciviy Edward C. Presco (1998) 2 1. Inroducion Toal Facor Produciviy (TFP) has become

More information

Distribution of Estimates

Distribution of Estimates Disribuion of Esimaes From Economerics (40) Linear Regression Model Assume (y,x ) is iid and E(x e )0 Esimaion Consisency y α + βx + he esimaes approach he rue values as he sample size increases Esimaion

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate. Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

Dynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:

Dynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model: Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e

More information

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*)

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*) Soluion 3 x 4x3 x 3 x 0 4x3 x 4x3 x 4x3 x 4x3 x x 3x 3 4x3 x Innova Junior College H Mahemaics JC Preliminary Examinaions Paper Soluions 3x 3 4x 3x 0 4x 3 4x 3 0 (*) 0 0 + + + - 3 3 4 3 3 3 3 Hence x or

More information

Chapter 16. Regression with Time Series Data

Chapter 16. Regression with Time Series Data Chaper 16 Regression wih Time Series Daa The analysis of ime series daa is of vial ineres o many groups, such as macroeconomiss sudying he behavior of naional and inernaional economies, finance economiss

More information

Lecture 4. Classical Linear Regression Model: Overview

Lecture 4. Classical Linear Regression Model: Overview Lecure 4 Classical Linear Regression Model: Overview Regression Regression is probably he single mos imporan ool a he economerician s disposal. Bu wha is regression analysis? I is concerned wih describing

More information

Testing the Random Walk Model. i.i.d. ( ) r

Testing the Random Walk Model. i.i.d. ( ) r he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp

More information

Time series Decomposition method

Time series Decomposition method Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,

More information

Wednesday, November 7 Handout: Heteroskedasticity

Wednesday, November 7 Handout: Heteroskedasticity Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures

More information

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size.

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size. Mehodology. Uni Roo Tess A ime series is inegraed when i has a mean revering propery and a finie variance. I is only emporarily ou of equilibrium and is called saionary in I(0). However a ime series ha

More information

Forecasting optimally

Forecasting optimally I) ile: Forecas Evaluaion II) Conens: Evaluaing forecass, properies of opimal forecass, esing properies of opimal forecass, saisical comparison of forecas accuracy III) Documenaion: - Diebold, Francis

More information

4.1 Other Interpretations of Ridge Regression

4.1 Other Interpretations of Ridge Regression CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Dynamic Models, Autocorrelation and Forecasting

Dynamic Models, Autocorrelation and Forecasting ECON 4551 Economerics II Memorial Universiy of Newfoundland Dynamic Models, Auocorrelaion and Forecasing Adaped from Vera Tabakova s noes 9.1 Inroducion 9.2 Lags in he Error Term: Auocorrelaion 9.3 Esimaing

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Department of Economics East Carolina University Greenville, NC Phone: Fax:

Department of Economics East Carolina University Greenville, NC Phone: Fax: March 3, 999 Time Series Evidence on Wheher Adjusmen o Long-Run Equilibrium is Asymmeric Philip Rohman Eas Carolina Universiy Absrac The Enders and Granger (998) uni-roo es agains saionary alernaives wih

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

How to Deal with Structural Breaks in Practical Cointegration Analysis

How to Deal with Structural Breaks in Practical Cointegration Analysis How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural

More information

DEPARTMENT OF STATISTICS

DEPARTMENT OF STATISTICS A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School

More information

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS Name SOLUTIONS Financial Economerics Jeffrey R. Russell Miderm Winer 009 SOLUTIONS You have 80 minues o complee he exam. Use can use a calculaor and noes. Try o fi all your work in he space provided. If

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In

More information

Math 10B: Mock Mid II. April 13, 2016

Math 10B: Mock Mid II. April 13, 2016 Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

The General Linear Test in the Ridge Regression

The General Linear Test in the Ridge Regression ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Distribution of Least Squares

Distribution of Least Squares Disribuion of Leas Squares In classic regression, if he errors are iid normal, and independen of he regressors, hen he leas squares esimaes have an exac normal disribuion, no jus asympoic his is no rue

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

Biol. 356 Lab 8. Mortality, Recruitment, and Migration Rates

Biol. 356 Lab 8. Mortality, Recruitment, and Migration Rates Biol. 356 Lab 8. Moraliy, Recruimen, and Migraion Raes (modified from Cox, 00, General Ecology Lab Manual, McGraw Hill) Las week we esimaed populaion size hrough several mehods. One assumpion of all hese

More information

Properties of Autocorrelated Processes Economics 30331

Properties of Autocorrelated Processes Economics 30331 Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,

More information

Measurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X.

Measurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X. Measuremen Error 1: Consequences of Measuremen Error Richard Williams, Universiy of Nore Dame, hps://www3.nd.edu/~rwilliam/ Las revised January 1, 015 Definiions. For wo variables, X and Y, he following

More information

Testing for a Single Factor Model in the Multivariate State Space Framework

Testing for a Single Factor Model in the Multivariate State Space Framework esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics

More information

ECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates)

ECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates) ECON 48 / WH Hong Time Series Daa Analysis. The Naure of Time Series Daa Example of ime series daa (inflaion and unemploymen raes) ECON 48 / WH Hong Time Series Daa Analysis The naure of ime series daa

More information

Generalized Least Squares

Generalized Least Squares Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume

More information

CHAPTER 9. Exercise Solutions

CHAPTER 9. Exercise Solutions CHAPTER 9 Exercise Soluions Chaper 9, Exercise Soluions, Principles of Economerics, 3e EXERCISE 9. From he equaion for he AR() error model e = ρ e + v, we have from which we ge and hence ( e ) =ρ ( e )

More information

Chapter 5. Heterocedastic Models. Introduction to time series (2008) 1

Chapter 5. Heterocedastic Models. Introduction to time series (2008) 1 Chaper 5 Heerocedasic Models Inroducion o ime series (2008) 1 Chaper 5. Conens. 5.1. The ARCH model. 5.2. The GARCH model. 5.3. The exponenial GARCH model. 5.4. The CHARMA model. 5.5. Random coefficien

More information

Errata (1 st Edition)

Errata (1 st Edition) P Sandborn, os Analysis of Elecronic Sysems, s Ediion, orld Scienific, Singapore, 03 Erraa ( s Ediion) S K 05D Page 8 Equaion (7) should be, E 05D E Nu e S K he L appearing in he equaion in he book does

More information

FORECASTING WITH REGRESSION

FORECASTING WITH REGRESSION FORECASTING WITH REGRESSION MODELS Overview of basic regression echniques. Daa analysis and forecasing using muliple regression analysis. 106 Visualizaion of Four Differen Daa Ses Daa Se A Daa Se B Daa

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Lecture 33: November 29

Lecture 33: November 29 36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t. Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of

More information

Solutions: Wednesday, November 14

Solutions: Wednesday, November 14 Amhers College Deparmen of Economics Economics 360 Fall 2012 Soluions: Wednesday, November 14 Judicial Daa: Cross secion daa of judicial and economic saisics for he fify saes in 2000. JudExp CrimesAll

More information

CHAPTER 17: DYNAMIC ECONOMETRIC MODELS: AUTOREGRESSIVE AND DISTRIBUTED-LAG MODELS

CHAPTER 17: DYNAMIC ECONOMETRIC MODELS: AUTOREGRESSIVE AND DISTRIBUTED-LAG MODELS Basic Economerics, Gujarai and Porer CHAPTER 7: DYNAMIC ECONOMETRIC MODELS: AUTOREGRESSIVE AND DISTRIBUTED-LAG MODELS 7. (a) False. Economeric models are dynamic if hey porray he ime pah of he dependen

More information

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting Chaper 15 Time Series: Descripive Analyses, Models, and Forecasing Descripive Analysis: Index Numbers Index Number a number ha measures he change in a variable over ime relaive o he value of he variable

More information

) were both constant and we brought them from under the integral.

) were both constant and we brought them from under the integral. YIELD-PER-RECRUIT (coninued The yield-per-recrui model applies o a cohor, bu we saw in he Age Disribuions lecure ha he properies of a cohor do no apply in general o a collecion of cohors, which is wha

More information

Matlab and Python programming: how to get started

Matlab and Python programming: how to get started Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,

More information

T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 2011 EXAMINATION

T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 2011 EXAMINATION ECON 841 T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 211 EXAMINATION This exam has wo pars. Each par has wo quesions. Please answer one of he wo quesions in each par for a

More information

The Brock-Mirman Stochastic Growth Model

The Brock-Mirman Stochastic Growth Model c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner

More information

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Detecting Structural Change and Testing for the Stability of Structural Coefficients

Detecting Structural Change and Testing for the Stability of Structural Coefficients Chaper 10 Deecing Srucural Change and Tesing for he Sabiliy of Srucural Coefficiens Secion 10.1 Inroducion By definiion, srucural change refers o non-consan srucural parameers over ime. In essence, he

More information

ESTIMATION OF DYNAMIC PANEL DATA MODELS WHEN REGRESSION COEFFICIENTS AND INDIVIDUAL EFFECTS ARE TIME-VARYING

ESTIMATION OF DYNAMIC PANEL DATA MODELS WHEN REGRESSION COEFFICIENTS AND INDIVIDUAL EFFECTS ARE TIME-VARYING Inernaional Journal of Social Science and Economic Research Volume:02 Issue:0 ESTIMATION OF DYNAMIC PANEL DATA MODELS WHEN REGRESSION COEFFICIENTS AND INDIVIDUAL EFFECTS ARE TIME-VARYING Chung-ki Min Professor

More information

Granger Causality Among Pre-Crisis East Asian Exchange Rates. (Running Title: Granger Causality Among Pre-Crisis East Asian Exchange Rates)

Granger Causality Among Pre-Crisis East Asian Exchange Rates. (Running Title: Granger Causality Among Pre-Crisis East Asian Exchange Rates) Granger Causaliy Among PreCrisis Eas Asian Exchange Raes (Running Tile: Granger Causaliy Among PreCrisis Eas Asian Exchange Raes) Joseph D. ALBA and Donghyun PARK *, School of Humaniies and Social Sciences

More information

Lecture 3: Exponential Smoothing

Lecture 3: Exponential Smoothing NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure

More information

Advanced time-series analysis (University of Lund, Economic History Department)

Advanced time-series analysis (University of Lund, Economic History Department) Advanced ime-series analysis (Universiy of Lund, Economic Hisory Deparmen) 30 Jan-3 February and 6-30 March 01 Lecure 9 Vecor Auoregression (VAR) echniques: moivaion and applicaions. Esimaion procedure.

More information

Modeling and Forecasting Volatility Autoregressive Conditional Heteroskedasticity Models. Economic Forecasting Anthony Tay Slide 1

Modeling and Forecasting Volatility Autoregressive Conditional Heteroskedasticity Models. Economic Forecasting Anthony Tay Slide 1 Modeling and Forecasing Volailiy Auoregressive Condiional Heeroskedasiciy Models Anhony Tay Slide 1 smpl @all line(m) sii dl_sii S TII D L _ S TII 4,000. 3,000.1.0,000 -.1 1,000 -. 0 86 88 90 9 94 96 98

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Ready for euro? Empirical study of the actual monetary policy independence in Poland VECM modelling

Ready for euro? Empirical study of the actual monetary policy independence in Poland VECM modelling Macroeconomerics Handou 2 Ready for euro? Empirical sudy of he acual moneary policy independence in Poland VECM modelling 1. Inroducion This classes are based on: Łukasz Goczek & Dagmara Mycielska, 2013.

More information

Wisconsin Unemployment Rate Forecast Revisited

Wisconsin Unemployment Rate Forecast Revisited Wisconsin Unemploymen Rae Forecas Revisied Forecas in Lecure Wisconsin unemploymen November 06 was 4.% Forecass Poin Forecas 50% Inerval 80% Inerval Forecas Forecas December 06 4.0% (4.0%, 4.0%) (3.95%,

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Math 333 Problem Set #2 Solution 14 February 2003

Math 333 Problem Set #2 Solution 14 February 2003 Mah 333 Problem Se #2 Soluion 14 February 2003 A1. Solve he iniial value problem dy dx = x2 + e 3x ; 2y 4 y(0) = 1. Soluion: This is separable; we wrie 2y 4 dy = x 2 + e x dx and inegrae o ge The iniial

More information

Y, where. 1 Estimate St.error

Y, where. 1 Estimate St.error 1 HG Feb 2014 ECON 5101 Exercises III - 24 Feb 2014 Exercise 1 In lecure noes 3 (LN3 page 11) we esimaed an ARMA(1,2) for daa) for he period, 1978q2-2013q2 Le Y ln BNP ln BNP (Norwegian Model: Y Y, where

More information

Solutions Problem Set 3 Macro II (14.452)

Solutions Problem Set 3 Macro II (14.452) Soluions Problem Se 3 Macro II (14.452) Francisco A. Gallego 04/27/2005 1 Q heory of invesmen in coninuous ime and no uncerainy Consider he in nie horizon model of a rm facing adjusmen coss o invesmen.

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

DEPARTMENT OF ECONOMICS

DEPARTMENT OF ECONOMICS ISSN 0819-6 ISBN 0 730 609 9 THE UNIVERSITY OF MELBOURNE DEPARTMENT OF ECONOMICS RESEARCH PAPER NUMBER 95 NOVEMBER 005 INTERACTIONS IN REGRESSIONS by Joe Hirschberg & Jenny Lye Deparmen of Economics The

More information

Analyze patterns and relationships. 3. Generate two numerical patterns using AC

Analyze patterns and relationships. 3. Generate two numerical patterns using AC envision ah 2.0 5h Grade ah Curriculum Quarer 1 Quarer 2 Quarer 3 Quarer 4 andards: =ajor =upporing =Addiional Firs 30 Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 andards: Operaions and Algebraic Thinking

More information

Lecture Notes 5: Investment

Lecture Notes 5: Investment Lecure Noes 5: Invesmen Zhiwei Xu (xuzhiwei@sju.edu.cn) Invesmen decisions made by rms are one of he mos imporan behaviors in he economy. As he invesmen deermines how he capials accumulae along he ime,

More information

The Overlapping Data Problem

The Overlapping Data Problem Quaniaive and Qualiaive Analysis in Social Sciences Volume 3, Issue 3, 009, 78-115 ISSN: 175-895 The Overlapping Daa Problem Ardian Harri a Mississipi Sae Universiy B. Wade Brorsen b Oklahoma Sae Universiy

More information

Estimation Uncertainty

Estimation Uncertainty Esimaion Uncerainy The sample mean is an esimae of β = E(y +h ) The esimaion error is = + = T h y T b ( ) = = + = + = = = T T h T h e T y T y T b β β β Esimaion Variance Under classical condiions, where

More information