Hypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests

Size: px
Start display at page:

Download "Hypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests"

Transcription

1 ECONOMICS 35* -- NOTE 8 M.G. Abbo ECON 35* -- NOTE 8 Hypohesis Tesing in he Classical Normal Linear Regression Model. Componens of Hypohesis Tess. A esable hypohesis, which consiss of wo pars: Par : a null hypohesis, H Par 2: an alernaive hypohesis, H 2. A feasible es saisic. Definiion: A es saisic is a random variable whose value for given sample daa deermines wheher he null hypohesis H is rejeced or no rejeced. Definiion: A es saisic is feasible if i saisfies wo condiions: () Is probabiliy disribuion, or sampling disribuion, mus be known compleely when he null hypohesis H is rue, and i mus have some oher disribuion when he null hypohesis is false. (2) Is value can be calculaed from he given sample daa. 3. A decision rule or rejecion rule. Definiion: A decision rule specifies () he rejecion region and (2) he nonrejecion region of he es saisic. () Definiion: The rejecion region is he se, or range, of values of he es saisic for which he null hypohesis H is rejeced i.e., ha have a low probabiliy of occurring when he null hypohesis is rue. (2) Definiion: The nonrejecion region is he se, or range, of values of he es saisic for which he null hypohesis H is no rejeced, or reained. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page of 49 pages

2 ECONOMICS 35* -- NOTE 8 M.G. Abbo Five Basic Seps 2. Procedure for Tesing Hypoheses The procedure for esing hypoheses consiss of five basic seps. Sep : Formulae he null hypohesis H and he alernaive hypohesis H. Sep 2: Specify he es saisic and is disribuion -- specifically is disribuion when he null hypohesis H is rue. The disribuion of he es saisic when he null hypohesis H is rue is known as he null disribuion of he es saisic. Sep 3: Calculae he sample value of he es saisic under he null hypohesis H for he given sample daa. Sep 4: Selec he significance level α, and deermine he corresponding rejecion region and non-rejecion region for he es saisic. Sep 5: Apply he decision rule of he es and sae he inference, or conclusion, implied by he sample value of he es saisic. We illusrae hese five seps for an imporan class of hypohesis ess in applied economerics -- namely ess of equaliy resricions on individual regression coefficiens. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 2 of 49 pages

3 ECONOMICS 35* -- NOTE 8 M.G. Abbo Tess of Equaliy Resricions on Individual Regression Coefficiens These ess assess he probable empirical validiy of saemens or hypoheses of he following form: β j = b j where b j is a specified consan. (j =, ) Such saemens are conjecures abou he populaion values of he regression coefficiens β j (j =, ). Examples β = E( Y X ) X, i.e., X i is unrelaed o E ( ) i i i = β =. E( Y X ) X i i i = β =.8 E( Y X ) X. 8 i i i = β =. E( Y X ) X =. i i i Y i X i Laer we will consider more general hypoheses ha ake he form of linear equaliy resricions on wo or more regression coefficiens β j (j =, ). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 3 of 49 pages

4 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP : Formulaion of he Null and Alernaive Hypoheses Sep : Formulae he null hypohesis H and he alernaive hypohesis H. Componens of a Saisical Tes A saisical hypohesis es consiss of wo opposing saemens or proposiions or conjecures abou he model parameers:. The null hypohesis, denoed by H. H is he proposiion being esed. I specifies our conjecure abou he rue value(s) of he regression coefficien(s). 2. The alernaive hypohesis, denoed by H. H is he couner-proposiion o he null hypohesis H. I specifies he se of alernaive possibiliies which is presumed o conain he ruh if he null hypohesis is false. Purpose of a Saisical Tes A saisical es is designed and consruced so as o provide sample evidence respecing he probable empirical validiy, or ruh, of he null hypohesis H. The es addresses he quesion: Are he sample esimaes of he model parameers -- consisen or inconsisen (compaible or incompaible) wih he ruh of he null hypohesis? Consisency or compaibiliy means sufficienly close o he value(s) specified by H ha we reain (do no rejec) he null hypohesis. A saisical es does no es he empirical validiy, or ruh, of he alernaive hypohesis H. Only he null hypohesis H is being subjeced o es. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 4 of 49 pages

5 ECONOMICS 35* -- NOTE 8 M.G. Abbo Formulaion of H and H : Equaliy Resricions on β The Null Hypohesis H H : β = b where b is a specified consan (such as or.9 or ). The Alernaive Hypohesis H For a null hypohesis of his general form, here are hree possible alernaive hypoheses. () H : β b a wo-sided alernaive hypohesis. Rejecion of he null hypohesis H : β = b implies ha β akes some oher value, and ha his oher value is eiher greaer han or less han b. Tha is, H : β b eiher β > b or β < b. (2) H : β > b a one-sided (righ-sided) alernaive hypohesis. Rejecion of he null hypohesis H : β = b in his case implies ha β akes some oher value ha is greaer han b. This alernaive hypohesis compleely discouns he possibiliy ha β < b. I implies ha values of β less han b are considered o be logically unaccepable alernaives o he null hypohesis, an implicaion ha presumably is based on economic heory. (3) H : β < b a one-sided (lef-sided) alernaive hypohesis. Rejecion of he null hypohesis H : β = b in his case implies ha β akes some oher value ha is less han b. This alernaive hypohesis compleely excludes he possibiliy ha β > b. I implies ha he value of β could no be greaer han b if in fac he null hypohesis H is false. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 5 of 49 pages

6 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP 2: Specify he Tes Saisic and is Null Disribuion Sep 2: Specify he es saisic and is null disribuion when he null hypohesis H is rue. Theoreical Prerequisie Assumpions A-A9 of he CNLRM -- especially he normaliy assumpion A9. Imporan Resuls. Under assumpions A-A9 of he CNLRM, he following -saisics are feasible es saisics for he OLS coefficien esimaors ˆβ and β $ : ˆ ˆ β β β β β (ˆ β ) = = = ~ [N 2] Vâr(ˆ β ) sê(ˆ β) σˆ 2 2 ( x ) ˆ ˆ β β β β β (ˆ β ) = = = ~ [N 2] Vâr(ˆ β ) sê(ˆ β) σˆ 2 i i 2 2 / 2 2 ( X ) N ( x ) i i i i 2. For he rue (bu unknown) values of he populaion regression coefficiens β and β, each of he es saisics ( ˆβ ) and ( β $ ) has he -disribuion wih N 2 degrees of freedom, denoed as [N 2]. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 6 of 49 pages

7 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP 3: Evaluae he Tes Saisic Under H Sep 3: Calculae he sample value of he es saisic under he null hypohesis H for he given sample daa. The null hypohesis is H : β = b where b is a specified consan such as or.9 or -. From Sep 2, he feasible es saisic is he -saisic for he OLS esimaor ˆβ : ˆ β β β (ˆ β ) = = ~ [N 2]. Vâr(ˆ β ) sê(ˆ β) To calculae he sample value of ( ˆβ ) under he null hypohesis H: β = b, simply subsiue in he above formula for ( ˆβ ) he value b for β, since b is he value of β specified by H ; he sample value of ˆβ, he poin esimae of β for he given sample daa; he sample value of sê(ˆ β ) = Vâr(ˆ β), he esimaed sandard error of ˆβ. The sample value of ( ˆ b β b (ˆ β ) = =. Vâr(ˆ β ) sê(ˆ β) ˆβ ) evaluaed under he null hypohesis H is herefore Noe: The subscrip on ( ˆβ ) indicaes he value of ( ˆβ ) under H. The null disribuion of ( ˆβ ), he calculaed sample value of ( ˆβ ), is [N 2], he -disribuion wih N 2 degrees of freedom: ˆ b β b (ˆ β ) = = ~ [N 2] under H : β = b. Vâr(ˆ β ) sê(ˆ β) ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 7 of 49 pages

8 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP 4: Deermine he Rejecion and Non-Rejecion Regions Sep 4: Selec he significance level α, and deermine he corresponding rejecion region and non-rejecion region for he calculaed es saisic. Background: Type I and Type II Errors In performing any hypohesis es i.e., in deciding o rejec or reain a null hypohesis here is always some chance of making misakes. Such misakes arise whenever he decision o reain or rejec H does no reflec he rue bu unknown sae of he world. Decision Reain (do no rejec) H Rejec H H is rue Correc Decision Pr = α Type I Error Pr = α Sae of he World H is false Type II Error Pr = β Correc Decision Pr = β. A correc decision is made if: he null hypohesis H is false and he decision is o rejec i. he null hypohesis H is rue and he decision is o reain (no o rejec) i. 2. An incorrec decision is made if: he null hypohesis H is rue and he decision is o rejec i (a Type I error). he null hypohesis H is false and he decision is o reain (no o rejec) i (a Type II error). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 8 of 49 pages

9 ECONOMICS 35* -- NOTE 8 M.G. Abbo Definiions: Type I error: Type II error: rejecing H when H is rue. no rejecing H when H is false. Probabiliies of Type I and Type II Errors α Pr(Type I Error) = Pr(H is rejeced H is rue) α = Pr(H is no rejeced H is rue) = he confidence level of he es = he probabiliy of making a correc decision when he null hypohesis H is rue. β Pr(Type II Error) = Pr(H is no rejeced H is false) β = Pr(H is rejeced H is false) = he power of he es = he probabiliy of making a correc decision when he null hypohesis H is false. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 9 of 49 pages

10 ECONOMICS 35* -- NOTE 8 M.G. Abbo Analogy Beween Saisical Hypohesis Tess and Criminal Cour Trials Presumpion of Innocence: The accused is presumed innocen unil proven o be guily beyond a reasonable doub. H : he accused is no guily H : he accused is guily as charged The cour mus decide wheher o reain or rejec H on he basis of admissible evidence. Cour s Decision Accused is innocen Sae of he World Accused is guily Acqui (find no guily) Correc Decision Type II Error Convic (find guily) Type I Error Correc Decision. The cour makes a correc decision if: he accused is innocen and he cour s decision is o acqui. he accused is guily and he cour s decision is o convic. 2. The cour makes an incorrec decision if: he accused is innocen and he cour s decision is o convic (he cour has made a Type I error). he accused is guily and he cour s decision is o acqui (he cour has made a Type II error). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page of 49 pages

11 ECONOMICS 35* -- NOTE 8 M.G. Abbo The Significance Level of he Tes Definiion: The significance level of he es is chosen o equal α, he probabiliy of making a Type I error. Significance level of he es = α Pr(Type I Error) = Pr(H is rejeced H is rue). Confidence level of he es = α = Pr(H is no rejeced H is rue). Power of he Tes Definiion: The power of he es is defined o equal β, he probabiliy of making a correc decision when he null hypohesis H is false. Power of he es β = Pr(H is rejeced H is false) = Pr(Type II Error) Relaionship Beween Type I and Type II Errors For any given sample size N, α = Pr(Type I Error) is inversely relaed o Pr(Type II Error) α = Pr(Type I Error) is direcly relaed o he power of he es. Resul: For any given sample size N, here exiss a rade-off beween () α = Pr(Type I Error) = he significance level of he es and (2) β = Pr(Type II Error) ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page of 49 pages

12 ECONOMICS 35* -- NOTE 8 M.G. Abbo Implicaions of Trade-Off Beween α and β By choosing a lower significance level α -- and hereby reducing he Pr(Type I Error) -- we necessarily () increase β = he Pr(Type II Error), and (2) decrease β = he power of he es. Conversely, by choosing a higher significance level α -- and hereby increasing he Pr(Type I Error) -- we necessarily () decrease β = he Pr(Type II Error), and (2) increase β = he power of he es. Commens on Choosing α, he Significance Level of he Tes The value of he significance level α is usually chosen o be small. In pracice, he values mos frequenly chosen are: α =. α =.5 α =. (a % significance level); (a 5% significance level); (a % significance level). Bu he choice of value for α is more or less arbirary. I presumably reflecs he invesigaor s relaive willingness o accep, or relaive aversion o, Type I and Type II errors. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 2 of 49 pages

13 ECONOMICS 35* -- NOTE 8 M.G. Abbo Rejecion and Non-Rejecion Regions for a Tes Saisic Definiion of he Rejecion and Non-Rejecion Regions The rejecion region is he se, or range, of values of he es saisic for which he null hypohesis H is rejeced. Values of he es saisic in he rejecion region have a low probabiliy of occurring when he null hypohesis H is rue. The nonrejecion region is he se, or range, of values of he es saisic for which he null hypohesis H is no rejeced, or reained. Disinguishing Beween he Rejecion and Nonrejecion Regions Quesion: Answer: How are he rejecion and nonrejecion regions delineaed or separaed? By he criical values of he es saisic or more correcly, by he criical values of he null disribuion of he es saisic. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 3 of 49 pages

14 ECONOMICS 35* -- NOTE 8 M.G. Abbo Criical Values of a Tes Saisic Definiion: The criical values of a es saisic are defined as hose values ha separae he rejecion region from he non-rejecion region, ha pariion he sample values of a es saisic ino a rejecion region and a non-rejecion region. Deerminans The criical values of a es saisic are deermined by he following facors:. he null disribuion of he es saisic he probabiliy, or sampling, disribuion of he es saisic when he null hypohesis H is rue; 2. he chosen significance level for he es, α; 3. he naure of he hypohesis es, specifically wheher he es is () a wo-ail, or wo-sided, es or (2) a one-ail, or one-sided, es, of which here are wo ypes, (2.) a lef-ail es (2.2) a righ-ail es. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 4 of 49 pages

15 ECONOMICS 35* -- NOTE 8 M.G. Abbo Two-Tail and One-Tail Tess: Which is i? Imporan Poin: Wheher a wo-ail or one-ail es is appropriae depends on he naure of he alernaive hypohesis H. Definiions A wo-ail es is one for which he alernaive hypohesis H is a wo-sided hypohesis ha incorporaes he no equal condiion. Example: H : β = b where b is a specified consan H : β b is a wo-sided alernaive hypohesis a wo-ail es a wo-ail rejecion region. A one-ail es is one for which he alernaive hypohesis H is a one-sided hypohesis ha incorporaes eiher he less han condiion < or he greaer han condiion >. Case : A lef-ail es is one in which H incorporaes he less han condiion <. Example: H : β = b where b is a specified consan H : β < b is a lef-sided alernaive hypohesis a one-ail es, specifically a lef-ail es. a lef-ail rejecion region. Case 2: A righ-ail es is one in which H incorporaes he greaer han condiion >. Example: H : β = b where b is a specified consan H : β > b is a righ-sided alernaive hypohesis a one-ail es, specifically a righ-ail es. a righ-ail rejecion region. Noe: The form of he alernaive hypohesis H specifically he direcion of he inequaliy in he alernaive hypohesis H deermines wheher a oneail es is a righ-ail es or a lef-ail es. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 5 of 49 pages

16 ECONOMICS 35* -- NOTE 8 M.G. Abbo Deermining Criical Values for Two-Tail Tess Problem: Deermine he criical values for he following wo-ail -es: H : β = b or β b = where b is a specified consan H : β b or β b a wo-sided alernaive hypohesis.. The appropriae es saisic is he -saisic for ˆβ, he OLS esimae of he slope coefficien β: ˆ β β β (ˆ β ) = =. Vâr(ˆ β ) sê(ˆ β) 2. The sample value of he es saisic ( ˆβ ) is calculaed by evaluaing ( ˆβ ) under he null hypohesis H. Tha is, in he expression for ( ˆβ ), se β equal o b, which is he value of β specified by H. The resuling sample value of he es saisic ( ˆβ ) under H is b (ˆ β ) =. sê(ˆ β ) 3. The null disribuion of ( ˆβ ) is [N 2], he -disribuion wih N 2 degrees of freedom. In oher words, if he null hypohesis H: β = b is rue, hen b (ˆ β ) = ~ [N 2] under H : β = b. sê(ˆ β ) ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 6 of 49 pages

17 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion : Wha values of ˆβ and (ˆ β ) would lead us o rejec H agains H? Answer: Examine he numeraor of he calculaed -saisic: Remember: (ˆ β ) = b sê(ˆ β ) ˆβ = he esimaed value of β b = he hypohesized value of β ê(ˆ β ) > ( ê(ˆ β ) is always a posiive number) s s We would rejec H agains H if ˆβ, he esimaed value of β, is very differen from b, he hypohesized value of β. More specifically, we would rejec H agains H in eiher of he following wo cases:. ˆβ >> b ˆβ b >> b (ˆ β ) = >> sê(ˆ β ) Values of ˆβ much greaer han b imply large posiive values of ( ˆβ ); or 2. ˆβ << b ˆβ b << b (ˆ β ) = << sê(ˆ β ) Values of ˆβ much less han b imply large negaive values of ( ˆβ ). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 7 of 49 pages

18 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion 2: How much larger or smaller han zero does he value of o be for us o rejec H in favour of H? β (ˆ ) have Answer: I depends on he significance level we choose for he es and he null disribuion of our es saisic. Le α = he chosen significance level for he es (e.g.,.,.5, or.) = he probabiliy of making a Type I error. Allocae α equally beween large posiive values of and large negaive values of. We herefore have boh an upper criical value and a lower criical value of he null disribuion of our es saisic, which is he [N 2]-disribuion. α 2[N 2] = he upper α/2 criical value of he [N 2]-disribuion; α [N 2] = he lower α/2 criical value of he [N 2]-disribuion. 2 Implicaions: If H : β = b is rue, hen he following wo probabiliy saemens hold. () ( [N 2] β ) [N 2] ) = α Pr α / 2 (ˆ α / 2 () (2) ( (ˆ β ) < [N 2] or (ˆ β ) > [N 2] ) where Pr α / 2 α / 2 = Pr (ˆ β) > α / 2[N 2] = (2) ( ) α (ˆ β ) = he calculaed sample value of he -saisic under H; (ˆ β ) = he absolue value of ( ˆβ ); α 2[N 2] = he upper α/2 criical value of he [N 2]-disribuion; α [N 2] = he lower α/2 criical value of he [N 2]-disribuion; 2 α = he significance level for he es; α = he confidence level for he es. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 8 of 49 pages

19 ECONOMICS 35* -- NOTE 8 M.G. Abbo Deermine he Rejecion and Nonrejecion Regions Two-Tail Tes The non-rejecion region for ( ˆβ ) is defined by he double inequaliy in probabiliy saemen () above. I consiss of all values of ( ˆβ ) such ha 2 α / 2[N 2] (ˆ β) α / [N 2] non-rejecion region for H : β = b. The rejecion region for ( ˆβ ) is he wo-sided region or wo-ail region defined in probabiliy saemen (2) above. I consiss of all values of ( ˆβ ) such ha or (ˆ β ) < α [N 2] or (ˆ β ) > [N 2] / 2 α / 2 / 2 (ˆ β ) > α [N 2] rejecion region for H : β = b is a wo-ail rejecion region. NOTE: For a wo-ail es, he rejecion region is a wo-ail rejecion region consising of wo pars. ) The lower or lef-ail rejecion region ( ˆβ ) < α/2[n 2], which conains unexpecedly small values of ( ˆβ ) under H i.e., values ha we would only expec o obain wih small probabiliy α/2 if he null hypohesis H : β = b is rue. 2) The upper or righ-ail rejecion region ( ˆβ ) > α/2[n 2], which conains unexpecedly large values of ( ˆβ ) under H i.e., values ha we would only expec o obain wih small probabiliy α/2 if he null hypohesis H : β = b is rue. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 9 of 49 pages

20 ECONOMICS 35* -- NOTE 8 M.G. Abbo 3) The rejecion region for a wo-ail es hus consiss of boh he lower lefhand ail and he upper righ-hand ail of he [N 2]-disribuion. The area in each ail under he [N 2]-disribuion is α/2. The sum of hese wo ail area probabiliies equals he significance level α. Thus, for a wo-ail es, he significance level α is allocaed equally beween he lower α/2 rejecion region and he upper α/2 rejecion region. Rejecion and Nonrejecion Regions for a Two-Tail Tes lef-ail rejecion nonrejecion region righ-ail rejecion region region area = α/2 area = α area = α/ α/2 α/2 Pr( < α/2 ) = α/2 Pr( α/2 α/2 ) = α Pr( > α/2 ) = α/2 ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 2 of 49 pages

21 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP 5: Apply he Decision Rule and Sae Inference Sep 5: Apply he decision rule of he es and sae he inference, or conclusion, implied by he sample value of he es saisic.. Formulaion of he Decision Rule for a Two-Tail Tes Formulaion : Deermine if he sample value of he es saisic lies in he rejecion or nonrejecion region a he chosen significance level α. Decision Rule for a Two-Tail Tes Formulaion. If he sample value of he es saisic lies in he rejecion region a he chosen significance level, hen rejec he null hypohesis H. For a wo-ail es: > α [N 2] rejec H a significance level α. / 2 Rejec H in favour of H a significance level α if () > α [N 2] meaning lies in he upper ail rejecion area; or / 2 (2) < α [N 2] meaning lies in he lower ail rejecion area. / 2 Inference: Rejec H in favour of H a significance level α. 2. If he sample value of he es saisic lies in he nonrejecion region a he chosen significance level, hen reain (do no rejec) he null hypohesis H. For a wo-ail es: α [N 2] reain H a significance level α. / 2 Reain H agains H a significance level α if 2 α / 2[N 2] α / [N 2] meaning lies in he nonrejecion area. Inference: Reain H agains H a significance level α. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 2 of 49 pages

22 ECONOMICS 35* -- NOTE 8 M.G. Abbo Examples of Two-Tail Hypohesis Tess The Model: DATA: auo.da (a Saa-forma daa file) MODEL: price i = β + β weigh i + u i (i =,..., N). regress price weigh Source SS df MS Number of obs = F(, 72) = Model Prob > F =. Residual R-squared = Adj R-squared =.282 Toal Roo MSE = price Coef. Sd. Err. P> [95% Conf. Inerval] weigh _cons N = 74 N 2 = 74 2 = 72 ˆβ = 2.44 ê(ˆ β ) = s α =.5 α/2 = α / 2[N 2] =. [72] =.9935 ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 22 of 49 pages

23 ECONOMICS 35* -- NOTE 8 M.G. Abbo Tes : Tes he proposiion ha weigh i is unrelaed o price i a he 5 percen significance level (α =.5). Null and Alernaive Hypoheses H : β = H : β a wo-sided alernaive hypohesis. The feasible es saisic is he -saisic for ˆβ : ˆ β β β (ˆ β ) = = ~ [N 2]. Vâr(ˆ β ) sê(ˆ β) Compue he sample value of ( ˆβ 2 ) under he null hypohesis H: Se ˆβ = 2.44, β = and ê(ˆ ) = in he formula for ( ˆβ ): s β β (ˆ β ) = = = sê(ˆ β ) = The wo-ail criical value of he [N 2] disribuion a he 5 percen significance level (a α =.5) is α / 2[N 2] =. 25[72] = Decision Rule: If > α [N 2] rejec H a significance level α; / 2 / 2[N If α 2] reain H a significance level α. Inference: = >.9935 =. 25 [72] rejec H a significance level α =.5 Rejec H : β = in favour of H : β a he 5 percen significance level. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 23 of 49 pages

24 ECONOMICS 35* -- NOTE 8 M.G. Abbo Tes 2: Tes he proposiion ha a -pound increase in weigh i is associaed wih an increase in average price i of dollar. Use he 5 percen significance level (α =.5). Null and Alernaive Hypoheses H : β = H : β a wo-sided alernaive hypohesis. The feasible es saisic is he -saisic for ˆβ : ˆ β β β (ˆ β ) = = ~ [N 2]. Vâr(ˆ β ) sê(ˆ β) Compue he sample value of ( ˆβ ) under he null hypohesis H: Se ˆβ = 2.44, β = and ê(ˆ ) = in he formula for ( ˆβ ): s β β (ˆ β ) = = = 2.77 sê(ˆ β ) = The wo-ail criical value of he [N 2] disribuion a he 5 percen significance level (a α =.5) is α / 2[N 2] =. 25[72] = Decision Rule: If > α [N 2] rejec H a significance level α; / 2 / 2[N If α 2] reain H a significance level α. Inference: = 2.77 >.9935 =. 25 [72] rejec H a significance level α =.5 Rejec H : β = in favour of H : β a he 5 percen significance level. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 24 of 49 pages

25 ECONOMICS 35* -- NOTE 8 M.G. Abbo Tes 3: Tes he proposiion ha a -pound increase in weigh i is associaed wih an increase in average price i of 2 dollars. Perform he es a he 5 percen significance level (α =.5). Null and Alernaive Hypoheses H : β = 2 H : β 2 a wo-sided alernaive hypohesis. The feasible es saisic is he -saisic for ˆβ : ˆ β β β (ˆ β ) = = ~ [N 2]. Vâr(ˆ β ) sê(ˆ β) Compue he sample value of ( ˆβ ) under he null hypohesis H: Se ˆβ = 2.44, β = 2 and ê(ˆ ) = in he formula for ( ˆβ ): s β β (ˆ β ) = = =.7 sê(ˆ β ) = The wo-ail criical value of he [N 2] disribuion a he 5 percen significance level (a α =.5) is α / 2[N 2] =. 25[72] = Decision Rule: If > α [N 2] rejec H a significance level α; / 2 / 2[N If α 2] reain H a significance level α. Inference: =.7 <.9935 =. 25 [72] reain H a significance level α =.5 Reain H : β = 2 agains H : β 2 a he 5 percen significance level. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 25 of 49 pages

26 ECONOMICS 35* -- NOTE 8 M.G. Abbo How o perform all hree of hese wo-ail hypohesis ess a once Tes : H : β = versus H : β Tes 2: H : β = versus H : β Tes 3: H : β = 2 versus H : β 2 Compue he wo-sided 95 percen confidence inerval for β. = + α [N 2]sê(ˆ ) = = = U 2 β = [N 2]sê( ˆ α ) = = =.293 L 2 β Resul: The wo-sided 95% confidence inerval for β is [.293, 2.795]. Decision Rule: If he hypohesized value of β lies ouside he wo-sided 95 percen confidence inerval for β, rejec he null hypohesis H a he 5 percen significance level. If he hypohesized value of β lies inside he wo-sided 95 percen confidence inerval for β, reain he null hypohesis H a he 5 percen significance level. Tes : Since he value lies ouside he wo-sided 95 percen confidence inerval for β, rejec H : β = in favour of H : β a he 5 percen significance level. Tes 2: Since he value lies ouside he wo-sided 95 percen confidence inerval for β, rejec H : β = in favour of H : β a he 5 percen significance level. Tes 3: Since he value 2 lies inside he wo-sided 95 percen confidence inerval for β, reain H : β = 2 agains H : β 2 a he 5 percen significance level. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 26 of 49 pages

27 ECONOMICS 35* -- NOTE 8 M.G. Abbo Deermining Criical Values for One-Tail Tess CASE A Lef-Tail Tes Problem: Deermine he criical values for he following one-ail -es: H : β = b or β b = H : β < b or β b < where b is a specified consan a lef-sided alernaive hypohesis. a one-ail es, specifically a lef-ail es.. The appropriae es saisic is he -saisic for ˆβ, he OLS esimae of he slope coefficien β: ˆ β β β (ˆ β ) = =. Vâr(ˆ β ) sê(ˆ β) 2. The sample value of he es saisic ( ˆβ ) is calculaed by evaluaing ( ˆβ ) under he null hypohesis H. This involves evaluaing ( ˆβ ) using he equaliy form of he null hypohesis H, which is β = b. Seing β = b in he expression for ( ˆβ ) yields he sample value of he es saisic ( ˆβ ) under H: b (ˆ β ) =. sê(ˆ β ) Noe: The null hypohesis for a lef-ail es is someimes wrien as H : β b raher han H : β = b. Bu he compuaional procedure for esing H : β b agains H : β < b is exacly he same as he procedure for esing H : β = b agains H : β < b. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 27 of 49 pages

28 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion: Why do we use he equaliy form of he null hypohesis, β = b, o calculae he sample value of he es saisic? Answer: A wo-par answer: A es ha akes he null hypohesis as H : β = b is he mos favorable o he null hypohesis, and hence is he leas favorable o he alernaive hypohesis H : β < b. This means ha, a any chosen significance level α, if we rejec H : β = b in favor of he alernaive hypohesis H : β < b, hen we would also rejec H : β = b + c in favor of H : β < b + c, where c > is any posiive consan. Calculaing he value of ( ˆβ ) for all values of β > b would be exremely edious!! (How would you know when you're done?) Moreover, is unnecessary. 3. The null disribuion of ( ˆβ ) is [N 2], he -disribuion wih N 2 degrees of freedom. In oher words, if he null hypohesis H is rue i.e., if β = b, hen b (ˆ β ) = ~ [N 2] under H : β = b. sê(ˆ β ) ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 28 of 49 pages

29 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion : Wha values of ˆβ and (ˆ β ) would lead us o rejec H agains H? H : β = b or β b = H : β < b or β b < a lef-sided alernaive hypohesis. Answer: Examine he numeraor of he calculaed -saisic: Remember: (ˆ β ) = b sê(ˆ β ) ˆβ = he esimaed value of β b = he hypohesized value of β ê(ˆ β ) > ( ê(ˆ β ) is always a posiive number) s s We would rejec H agains H if ˆβ is much less han b, if he esimaed value of β is much less han b, he hypohesized value of β. More specifically, we would rejec H agains H in he following case: ˆβ << b ˆβ b << b (ˆ β ) = << sê(ˆ β ) Values of ˆβ much less han b imply large negaive values of ( ˆβ ). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 29 of 49 pages

30 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion 2: How much less han zero does he value of ( ˆβ ) have o be for us o rejec H in favour of H? Answer: I depends on he significance level we choose for he es and he null disribuion of our es saisic. Le α = he chosen significance level for he es (e.g.,.,.5, or.) = he probabiliy of making a Type I error. Because only large negaive values of favour he alernaive hypohesis, here is only one criical value a lower criical value of he [N 2]-disribuion ha delineaes a lower or lef-ail rejecion area equal o α. α [N 2] = he lower α criical value of he [N 2]-disribuion. Implicaions: If H : β = b is rue, hen he following wo probabiliy saemens hold. () ( β ) α[n 2] ) = α Pr (ˆ () (2) ( β ) < α [N 2] ) = α where Pr (ˆ (2) (ˆ β ) = he calculaed sample value of he -saisic under H; α [N 2] = he lower α-level criical value of he [N 2]-disribuion; α = he significance level for he es; α = he confidence level for he es. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 3 of 49 pages

31 ECONOMICS 35* -- NOTE 8 M.G. Abbo Deermine he Rejecion and Nonrejecion Regions -- Lef-Tail Tes The non-rejecion region for ( ˆβ ) is defined by he inequaliy in probabiliy saemen () above. () ( β ) α[n 2] ) = α Pr (ˆ () I consiss of all values of ( ) such ha ˆβ (ˆ β ) α[n 2] non-rejecion region under H: β = b. The rejecion region for ( ˆβ ) is he se of values defined by he inequaliy in probabiliy saemen (2) above. (2) ( β ) < α [N 2] ) = α Pr (ˆ (2) I consiss of all values of ( NOTE: ) such ha ˆβ (ˆ β ) < α[n 2] rejecion region under H: β = b is a one-ail lef-ail rejecion region. ) For a lef-ail es, he rejecion region ( ˆβ ) < α[n 2] consiss only of he lower lef-hand ail of he -disribuion wih N 2 degrees of freedom. 2) This lef-ail rejecion region conains unexpecedly small values of ( ˆβ ) under H i.e., values ha we would only expec o obain wih small probabiliy α if he null hypohesis H : β = b is rue. 3) The lef ail area under he [N 2]-disribuion in his lower ail equals he significance level α. This area is called he lower α-level (or lower α percen) ail area of he [N 2]-disribuion. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 3 of 49 pages

32 ECONOMICS 35* -- NOTE 8 M.G. Abbo Rejecion and Nonrejecion Regions for a Lef-Tail Tes lef-ail rejecion region nonrejecion region area = α area = α α Pr( < α ) = α Pr( α ) = α ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 32 of 49 pages

33 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP 5: Apply he Decision Rule and Sae Inference Sep 5: Apply he decision rule of he es and sae he inference, or conclusion, implied by he sample value of he es saisic.. Formulaion of he Decision Rule for a Lef-Tail Tes Formulaion : Deermine if he sample value of he es saisic lies in he rejecion or nonrejecion region a he chosen significance level α. Decision Rule for a Lef-Tail Tes -- Formulaion. If he sample value of he es saisic lies in he lef-ail rejecion region a he chosen significance level, hen rejec he null hypohesis H. For a lef-ail es: < α [N 2] rejec H a significance level α. Rejec H in favour of H a significance level α if < α [N 2] meaning lies in he lower lef-ail rejecion area. Inference: Rejec H in favour of H a significance level α. 2. If he sample value of he es saisic lies in he nonrejecion region a he chosen significance level, hen reain (do no rejec) he null hypohesis H. For a lef-ail es: α [N 2] reain H a significance level α. Reain H agains H a significance level α if α [N 2] meaning lies in he nonrejecion area. Inference: Reain H agains H a significance level α. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 33 of 49 pages

34 ECONOMICS 35* -- NOTE 8 M.G. Abbo CASE 2 A Righ-Tail Tes Problem: Deermine he criical values for he following one-ail -es: H : β = b or β b = where b is a specified consan H : β > b or β b > a righ-sided alernaive hypohesis. a one-ail es, specifically a righ-ail es. NOTE: This one-ail es is a righ-ail es because, as we will see, he rejecion region for he es consiss of he upper righ-hand ail of he appropriae -disribuion.. Again, he appropriae es saisic is he -saisic for ˆβ, he OLS esimae of he slope coefficien β: ˆ β β β (ˆ β ) = =. Vâr(ˆ β ) sê(ˆ β) 2. The sample value of he es saisic ( ˆβ ) is calculaed by evaluaing ( ˆβ ) under he null hypohesis H. This involves evaluaing ( ˆβ ) using he equaliy form of he null hypohesis H, which is β = b. Seing β = b in he expression for ( ˆβ ) yields he sample value of he es saisic ( ˆβ ) under H: b (ˆ β ) =. sê(ˆ β ) Noe: The null hypohesis for a righ-ail es can be wrien as H : β b raher han H : β = b. Bu he compuaional procedure for esing H : β b agains H : β > b is exacly he same as he procedure for esing H : β = b agains H : β > b. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 34 of 49 pages

35 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion: Why do we use he equaliy form of he null hypohesis, β = b, o calculae he sample value of he es saisic? Answer: A es ha akes he null hypohesis as H : β = b is he mos favorable o he null hypohesis, and hence is he leas favorable o he alernaive hypohesis H : β > b. This means ha, a any chosen significance level α, if we rejec H : β = b in favor of he alernaive hypohesis H : β > b, hen we would also rejec H : β = b c in favor of H : β > b c, where c > is any posiive consan. 3. The null disribuion of ( ˆβ ) is [N 2], he -disribuion wih N 2 degrees of freedom. In oher words, if he null hypohesis H is rue i.e., if β = b, hen b (ˆ β ) = ~ [N 2] under H : β = b. sê(ˆ β ) ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 35 of 49 pages

36 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion : Wha values of ˆβ and (ˆ β ) would lead us o rejec H agains H? H : β = b or β b = H : β > b or β b > a righ-sided alernaive hypohesis. Answer: Examine he numeraor of he calculaed -saisic: Remember: b ( ) =. sê( ) ˆβ = he esimaed value of β b = he hypohesized value of β ê(ˆ β ) > ( ê(ˆ β ) is always a posiive number) s s We would rejec H agains H if ˆβ is much greaer han b, if he esimaed value of β is much greaer han b, he hypohesized value of β. More specifically, we would rejec H agains H in he following case: ˆβ >> b ˆβ b >> b (ˆ β ) = >> sê(ˆ β ) Values of ˆβ much greaer han b imply large posiive values of ( ˆβ ). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 36 of 49 pages

37 ECONOMICS 35* -- NOTE 8 M.G. Abbo Quesion 2: How much greaer han zero does he value of ( ˆβ ) have o be for us o rejec H in favour of H? Answer: I depends on he significance level we choose for he es and he null disribuion of our es saisic. Le α = he chosen significance level for he es (e.g.,.,.5, or.) = he probabiliy of making a Type I error. Because only large posiive values of favour he alernaive hypohesis, here is only one criical value an upper criical value of he [N 2]-disribuion ha delineaes an upper or righ-ail rejecion area equal o α. α [N 2] = he upper α criical value of he [N 2]-disribuion. Implicaions: If H : β = b is rue, hen he following wo probabiliy saemens hold. () ( β ) α[n 2] ) = α Pr (ˆ () (2) ( β ) > α [N 2] ) = α where Pr (ˆ (2) (ˆ β ) = he calculaed sample value of he -saisic under H ; α [N 2] = he upper α-level criical value of he [N 2]-disribuion; α = he significance level for he es; α = he confidence level for he es. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 37 of 49 pages

38 ECONOMICS 35* -- NOTE 8 M.G. Abbo Deermine he Rejecion and Nonrejecion Regions Righ-Tail Tes The non-rejecion region for ( ˆβ ) is he se of values defined by he inequaliy in probabiliy saemen () above: () ( β ) α[n 2] ) = α Pr (ˆ () I consiss of all values of ( ) such ha ˆβ (ˆ β ) α[n 2] non-rejecion region under H: β = b. The rejecion region for ( ˆβ ) is he se of values defined by he inequaliy in probabiliy saemen (2) above: (2) ( β ) > α [N 2] ) = α Pr (ˆ (2) I consiss of all values of ( NOTE: ) such ha ˆβ (ˆ β ) > α[n 2] rejecion region under H: β = b is a one-ail righ-ail rejecion region. ) For a righ-ail es, he rejecion region ( ˆβ ) > α[n 2] consiss only of he upper righ-hand ail of he -disribuion wih N 2 degrees of freedom. 2) This righ-ail rejecion region conains unexpecedly large values of (β ˆ ) under H i.e., values ha we would only expec o obain wih small probabiliy α if he null hypohesis H : β = b is rue. 3) The righ ail area under he [N 2]-disribuion in his upper ail equals he significance level α. This area is called he upper α-level (or upper α percen) ail area of he [N 2]-disribuion. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 38 of 49 pages

39 ECONOMICS 35* -- NOTE 8 M.G. Abbo Rejecion and Nonrejecion Regions for a Righ-Tail Tes nonrejecion region righ-ail rejecion region area = α area = α α Pr( α ) = α Pr( > α ) = α ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 39 of 49 pages

40 ECONOMICS 35* -- NOTE 8 M.G. Abbo STEP 5: Apply he Decision Rule and Sae Inference Sep 5: Apply he decision rule of he es and sae he inference, or conclusion, implied by he sample value of he es saisic.. Formulaion of he Decision Rule for a Righ-Tail Tes Formulaion : Deermine if he sample value of he es saisic lies in he rejecion or nonrejecion region a he chosen significance level α. Decision Rule for a Righ-Tail Tes -- Formulaion. If he sample value of he es saisic lies in he righ-ail rejecion region a he chosen significance level, hen rejec he null hypohesis H. For a righ-ail es: > α [N 2] rejec H a significance level α. Rejec H in favour of H a significance level α if > α [N 2] meaning lies in he upper righ-ail rejecion area. Inference: Rejec H in favour of H a significance level α. 2. If he sample value of he es saisic lies in he nonrejecion region a he chosen significance level, hen reain (do no rejec) he null hypohesis H. For a righ-ail es: α [N 2] reain H a significance level α. Reain H agains H a significance level α if α [N 2] meaning lies in he nonrejecion area. Inference: Reain H agains H a significance level α. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 4 of 49 pages

41 ECONOMICS 35* -- NOTE 8 M.G. Abbo Examples of One-Tail Hypohesis Tess The Model: DATA: auo.da (a Saa-forma daa file) MODEL: price i = β + β weigh i + u i (i =,..., N). regress price weigh Source SS df MS Number of obs = F(, 72) = Model Prob > F =. Residual R-squared = Adj R-squared =.282 Toal Roo MSE = price Coef. Sd. Err. P> [95% Conf. Inerval] weigh _cons N = 74 N 2 = 74 2 = 72 ˆβ = 2.44 ê(ˆ β ) = s α =.5 α/2 = α / 2[N 2] =. [72] = α [N 2] =. [72] =.6663 ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 4 of 49 pages

42 ECONOMICS 35* -- NOTE 8 M.G. Abbo Tes A Lef-Tail Tes: Tes he proposiion ha weigh i has a negaive effec on price i. Perform he es a he 5 percen significance level (α =.5). Null and Alernaive Hypoheses H : β = H : β < a one-sided lef-sided alernaive hypohesis. The feasible es saisic is he -saisic for ˆβ : ˆ β β β (ˆ β ) = = ~ [N 2]. Vâr(ˆ β ) sê(ˆ β) Compue he sample value of ( ˆβ ) under he null hypohesis H. Se ˆβ = 2.44, β = and ê(ˆ ) = in he formula for ( ˆβ ): s β β (ˆ β ) = = = sê(ˆ β ) = The one-ail criical value of he [N 2] disribuion a he 5 percen significance level (a α =.5) is α [N 2] =. 5[72] = Decision Rule -- Lef-Tail Tes: If < α[n 2] rejec H a significance level α; If α[n 2] reain H a significance level α. Inference: = >.6663 =. 5 [72] reain H a significance level α =.5 Reain H : β = agains H : β < a he 5 percen significance level. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 42 of 49 pages

43 ECONOMICS 35* -- NOTE 8 M.G. Abbo Tes 2 A Righ-Tail Tes: Tes he proposiion ha weigh i has a posiive effec on price i. Perform he es a he 5 percen significance level (α =.5). Null and Alernaive Hypoheses H : β = H : β > a one-sided righ-sided alernaive hypohesis. The feasible es saisic is he -saisic for ˆβ : ˆ β β β (ˆ β ) = = ~ [N 2]. Vâr(ˆ β ) sê(ˆ β) Compue he sample value of ( ˆβ ) under he null hypohesis H. Se ˆβ = 2.44, β = and ê(ˆ ) = in he formula for ( ˆβ ): s β β (ˆ β ) = = = sê(ˆ β ) = The one-ail criical value of he [N 2] disribuion a he 5 percen significance level (a α =.5) is α [N 2] =. 5[72] = Decision Rule -- Righ-Tail Tes: If > α [N 2] rejec H a significance level α; If α [N 2] reain H a significance level α. Inference: = >.6663 =. 5 [72] rejec H a significance level α =.5 Rejec H : β = agains H : β > a he 5 percen significance level. The sample evidence favours he alernaive hypohesis H : β >. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 43 of 49 pages

44 ECONOMICS 35* -- NOTE 8 M.G. Abbo Inerpreaion of he Decision Rules An hypohesis es can lead o only wo possible decisions: eiher () a decision o rejec he null hypohesis H agains he alernaive hypohesis H, in which case he sample evidence favours H over H ; or (2) a decision o reain (no o rejec) he null hypohesis H agains he alernaive hypohesis H, in which case he sample evidence favours H over H. Poins o remember in inerpreing hese alernaive decisions. ) An hypohesis es can never be inerpreed as eiher proving or disproving he ruh of he null hypohesis. Reason: The decision o rejec or reain H on he basis of sample evidence is always subjec -- explicily or implicily -- o some uncerainy, or margin of saisical error. Tha is, here is always some non-zero probabiliy of commiing a Type I or Type II error. 2) A decision o reain (no o rejec) he null hypohesis H should no be inerpreed o mean ha we accep H, or ha H is rue. Reason: Saying we accep H implies ha we are concluding ha he null hypohesis is rue, bu such a conclusion is incorrec. Nonrejecion (or reenion) of H means only ha he sample daa provide insufficien evidence o rejec H ; i does no mean ha H is rue beyond any doub. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 44 of 49 pages

45 ECONOMICS 35* -- NOTE 8 M.G. Abbo Explanaion: see example in Gujarai (23, p. 34). We obain an esimae of he slope coefficien of ˆβ =.59 and a corresponding esimaed sandard error of ê(ˆ β ) =.357. s Firs, we perform a wo-ail es of H : β =.5 agains H : β.5. The sample value of he -saisic under H is calculaed as: β.59.5 (ˆ β ) = = =.25. sê(ˆ β ).357 Bu he sample value.25 is clearly insignifican a, say, he 5% significance level (α =.5). Suppose we accep H and conclude ha he rue value of β is.5. Nex, we perform a wo-ail es of H : β =.48 agains H : β.48. The sample value of he -saisic under his H is calculaed as: β (ˆ β ) = = =.82. sê(ˆ β ).357 Bu he sample value.82 is also clearly insignifican a he 5% significance level (α =.5). Do we now accep his H and conclude ha he rue value of β is.48? Quesion: Do we accep eiher or boh of hese hypohesized values of β as he rue value? The correc answer is NO. We do no know he exac rue value of β. Conclusion: All we can legiimaely conclude from hese wo hypohesis ess is ha he sample evidence is consisen or compaible wih boh he null hypoheses we have esed. Bu he ess provide no reason o conclude ha eiher hypohesized value,.5 or.48, is he rue value of β. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 45 of 49 pages

46 ECONOMICS 35* -- NOTE 8 M.G. Abbo 3) A decision o rejec H on he basis of given sample daa does no imply ha we mus accep he alernaive hypohesis H, or ha H mus be rue, or ha H does in fac conain he ruh. Reason: An hypohesis es is designed only o assess he probable empirical validiy of he null hypohesis H ; i is no designed o es he alernaive hypohesis H. Regardless of wheher a es oucome for some paricular sample daa indicaes rejecion or nonrejecion of H, he se of alernaive possibiliies specified by he alernaive hypohesis H may or may no conain he ruh. I is quie possible for a es of some null hypohesis H agains some alernaive hypohesis H o indicae rejecion of H when H is false ha is, when he alernaive possibiliies specified by H do no conain he ruh. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 46 of 49 pages

47 ECONOMICS 35* -- NOTE 8 M.G. Abbo Formulaion 2 of he Decision Rule: he p-value Rule Formulaion 2: Deermine if he p-value for, he calculaed sample value of he es saisic, is smaller or larger han he chosen significance level α. Definiion: The p-value (or probabiliy value) associaed wih he calculaed sample value of he es saisic is defined as he lowes significance level a which he null hypohesis H can be rejeced, given he calculaed sample value of he es saisic. Inerpreaion The p-value is he probabiliy of obaining a sample value of he es saisic as exreme as he one we compued if he null hypohesis H is rue. P-values serve as inverse measures of he srengh of evidence agains he null hypohesis H. Small p-values p-values close o zero consiue srong evidence agains he null hypohesis H. Large p-values p-values close o one provide only weak evidence agains he null hypohesis H. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 47 of 49 pages

48 ECONOMICS 35* -- NOTE 8 M.G. Abbo Examples of p-values for common ypes of hypohesis ess For a wo-ail -es, le he calculaed sample value of he -saisic for a given null hypohesis be. Then he p-value associaed wih he sample value is he probabiliy ha he null disribuion of he es saisic akes a value greaer han he absolue value of, where he absolue value of is denoed as. Tha is, wo-ail p-value for = Pr( > ) = Pr( > ) + Pr( < ) = 2Pr( > ) if > = Pr( < ) + Pr( > ) = 2Pr( < ) if < Remember: he -disribuion is symmeric abou is mean of zero. For a one-ail -es, le he calculaed sample value of he -saisic for a given null hypohesis be. Then he p-value associaed wih he sample value is depends on wheher he es is a righ-ail or lef-ail es. () For a righ-ail -es, he p-value associaed wih he sample value is he probabiliy ha he null disribuion of he es saisic akes a value greaer han he calculaed sample value i.e., righ-ail p-value for = Pr( ). > (2) For a lef-ail -es, he p-value associaed wih he sample value is he probabiliy ha he null disribuion of he es saisic akes a value less han he calculaed sample value i.e., lef-ail p-value for = Pr( < ). ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 48 of 49 pages

49 ECONOMICS 35* -- NOTE 8 M.G. Abbo For an F-es, le he calculaed sample value of he F-saisic for a given null hypohesis be F. Then he p-value associaed wih he sample value F is he probabiliy ha he null disribuion of he es saisic akes a value greaer han he calculaed sample value F i.e., p-value for F = Pr( F F ). > Noe ha he F-disribuion is defined only over non-negaive values ha are greaer han or equal o zero. Decision Rule -- Formulaion 2. If he p-value for he calculaed sample value of he es saisic is less han he chosen significance level α, rejec he null hypohesis a significance level α. p-value < α rejec H a significance level α. 2. If he p-value for he calculaed sample value of he es saisic is greaer han or equal o he chosen significance level α, reain (i.e., do no rejec) he null hypohesis a significance level α. p-value α reain H a significance level α. ECON 35* -- Noe 8: Hypohesis Tesing in he CNLRM 35noe8.doc Page 49 of 49 pages

Comparing Means: t-tests for One Sample & Two Related Samples

Comparing Means: t-tests for One Sample & Two Related Samples Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion

More information

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H. ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Properties of Autocorrelated Processes Economics 30331

Properties of Autocorrelated Processes Economics 30331 Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,

More information

Math 10B: Mock Mid II. April 13, 2016

Math 10B: Mock Mid II. April 13, 2016 Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum. January 01 Final Exam Quesions: Mark W. Wason (Poins/Minues are given in Parenheses) (15) 1. Suppose ha y follows he saionary AR(1) process y = y 1 +, where = 0.5 and ~ iid(0,1). Le x = (y + y 1 )/. (11)

More information

Solutions to Odd Number Exercises in Chapter 6

Solutions to Odd Number Exercises in Chapter 6 1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

Chapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1)

Chapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1) Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β+β x (11.1.1) 1 o explain household expendiure on food (y) as a funcion of household income (x).

More information

Wednesday, November 7 Handout: Heteroskedasticity

Wednesday, November 7 Handout: Heteroskedasticity Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Lecture 4. Classical Linear Regression Model: Overview

Lecture 4. Classical Linear Regression Model: Overview Lecure 4 Classical Linear Regression Model: Overview Regression Regression is probably he single mos imporan ool a he economerician s disposal. Bu wha is regression analysis? I is concerned wih describing

More information

The Multiple Regression Model: Hypothesis Tests and the Use of Nonsample Information

The Multiple Regression Model: Hypothesis Tests and the Use of Nonsample Information Chaper 8 The Muliple Regression Model: Hypohesis Tess and he Use of Nonsample Informaion An imporan new developmen ha we encouner in his chaper is using he F- disribuion o simulaneously es a null hypohesis

More information

Distribution of Estimates

Distribution of Estimates Disribuion of Esimaes From Economerics (40) Linear Regression Model Assume (y,x ) is iid and E(x e )0 Esimaion Consisency y α + βx + he esimaes approach he rue values as he sample size increases Esimaion

More information

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

The Brock-Mirman Stochastic Growth Model

The Brock-Mirman Stochastic Growth Model c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner

More information

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

y = β 1 + β 2 x (11.1.1)

y = β 1 + β 2 x (11.1.1) Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β 1 + β x (11.1.1) o explain household expendiure on food (y) as a funcion of household income (x).

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Solutions: Wednesday, November 14

Solutions: Wednesday, November 14 Amhers College Deparmen of Economics Economics 360 Fall 2012 Soluions: Wednesday, November 14 Judicial Daa: Cross secion daa of judicial and economic saisics for he fify saes in 2000. JudExp CrimesAll

More information

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t. Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of

More information

Testing the Random Walk Model. i.i.d. ( ) r

Testing the Random Walk Model. i.i.d. ( ) r he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Dynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:

Dynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model: Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e

More information

Notes for Lecture 17-18

Notes for Lecture 17-18 U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up

More information

1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions

1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions Business School, Brunel Universiy MSc. EC5501/5509 Modelling Financial Decisions and Markes/Inroducion o Quaniaive Mehods Prof. Menelaos Karanasos (Room SS269, el. 01895265284) Lecure Noes 6 1. Diagnosic

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

Measurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X.

Measurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X. Measuremen Error 1: Consequences of Measuremen Error Richard Williams, Universiy of Nore Dame, hps://www3.nd.edu/~rwilliam/ Las revised January 1, 015 Definiions. For wo variables, X and Y, he following

More information

The General Linear Test in the Ridge Regression

The General Linear Test in the Ridge Regression ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

Challenge Problems. DIS 203 and 210. March 6, (e 2) k. k(k + 2). k=1. f(x) = k(k + 2) = 1 x k

Challenge Problems. DIS 203 and 210. March 6, (e 2) k. k(k + 2). k=1. f(x) = k(k + 2) = 1 x k Challenge Problems DIS 03 and 0 March 6, 05 Choose one of he following problems, and work on i in your group. Your goal is o convince me ha your answer is correc. Even if your answer isn compleely correc,

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Math 2142 Exam 1 Review Problems. x 2 + f (0) 3! for the 3rd Taylor polynomial at x = 0. To calculate the various quantities:

Math 2142 Exam 1 Review Problems. x 2 + f (0) 3! for the 3rd Taylor polynomial at x = 0. To calculate the various quantities: Mah 4 Eam Review Problems Problem. Calculae he 3rd Taylor polynomial for arcsin a =. Soluion. Le f() = arcsin. For his problem, we use he formula f() + f () + f ()! + f () 3! for he 3rd Taylor polynomial

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Econ Autocorrelation. Sanjaya DeSilva

Econ Autocorrelation. Sanjaya DeSilva Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Explaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015

Explaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015 Explaining Toal Facor Produciviy Ulrich Kohli Universiy of Geneva December 2015 Needed: A Theory of Toal Facor Produciviy Edward C. Presco (1998) 2 1. Inroducion Toal Facor Produciviy (TFP) has become

More information

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*)

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*) Soluion 3 x 4x3 x 3 x 0 4x3 x 4x3 x 4x3 x 4x3 x x 3x 3 4x3 x Innova Junior College H Mahemaics JC Preliminary Examinaions Paper Soluions 3x 3 4x 3x 0 4x 3 4x 3 0 (*) 0 0 + + + - 3 3 4 3 3 3 3 Hence x or

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Chapter 16. Regression with Time Series Data

Chapter 16. Regression with Time Series Data Chaper 16 Regression wih Time Series Daa The analysis of ime series daa is of vial ineres o many groups, such as macroeconomiss sudying he behavior of naional and inernaional economies, finance economiss

More information

Time series Decomposition method

Time series Decomposition method Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

Regression with Time Series Data

Regression with Time Series Data Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih

More information

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

Lecture 12: Multiple Hypothesis Testing

Lecture 12: Multiple Hypothesis Testing ECE 830 Fall 00 Saisical Signal Processing insrucor: R. Nowak, scribe: Xinjue Yu Lecure : Muliple Hypohesis Tesing Inroducion In many applicaions we consider muliple hypohesis es a he same ime. Example

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting Chaper 15 Time Series: Descripive Analyses, Models, and Forecasing Descripive Analysis: Index Numbers Index Number a number ha measures he change in a variable over ime relaive o he value of he variable

More information

( ) a system of differential equations with continuous parametrization ( T = R + These look like, respectively:

( ) a system of differential equations with continuous parametrization ( T = R + These look like, respectively: XIII. DIFFERENCE AND DIFFERENTIAL EQUATIONS Ofen funcions, or a sysem of funcion, are paramerized in erms of some variable, usually denoed as and inerpreed as ime. The variable is wrien as a funcion of

More information

Macroeconometrics. Christophe BOUCHER. Session 2 A brief overview of the classical linear regression model 1

Macroeconometrics. Christophe BOUCHER. Session 2 A brief overview of the classical linear regression model 1 Macroeconomerics Chrisophe BOUCHER Session 2 A brief overview of he classical linear regression model 1 Regression Regression is probably he single mos imporan ool a he economerician s disposal. Bu wha

More information

Chickens vs. Eggs: Replicating Thurman and Fisher (1988) by Arianto A. Patunru Department of Economics, University of Indonesia 2004

Chickens vs. Eggs: Replicating Thurman and Fisher (1988) by Arianto A. Patunru Department of Economics, University of Indonesia 2004 Chicens vs. Eggs: Relicaing Thurman and Fisher (988) by Ariano A. Paunru Dearmen of Economics, Universiy of Indonesia 2004. Inroducion This exercise lays ou he rocedure for esing Granger Causaliy as discussed

More information

Lecture 2 April 04, 2018

Lecture 2 April 04, 2018 Sas 300C: Theory of Saisics Spring 208 Lecure 2 April 04, 208 Prof. Emmanuel Candes Scribe: Paulo Orensein; edied by Sephen Baes, XY Han Ouline Agenda: Global esing. Needle in a Haysack Problem 2. Threshold

More information

Time Series Test of Nonlinear Convergence and Transitional Dynamics. Terence Tai-Leung Chong

Time Series Test of Nonlinear Convergence and Transitional Dynamics. Terence Tai-Leung Chong Time Series Tes of Nonlinear Convergence and Transiional Dynamics Terence Tai-Leung Chong Deparmen of Economics, The Chinese Universiy of Hong Kong Melvin J. Hinich Signal and Informaion Sciences Laboraory

More information

Homework sheet Exercises done during the lecture of March 12, 2014

Homework sheet Exercises done during the lecture of March 12, 2014 EXERCISE SESSION 2A FOR THE COURSE GÉOMÉTRIE EUCLIDIENNE, NON EUCLIDIENNE ET PROJECTIVE MATTEO TOMMASINI Homework shee 3-4 - Exercises done during he lecure of March 2, 204 Exercise 2 Is i rue ha he parameerized

More information

Some Ramsey results for the n-cube

Some Ramsey results for the n-cube Some Ramsey resuls for he n-cube Ron Graham Universiy of California, San Diego Jozsef Solymosi Universiy of Briish Columbia, Vancouver, Canada Absrac In his noe we esablish a Ramsey-ype resul for cerain

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

INCENTIVE COMPATIBILITY AND MECHANISM DESIGN

INCENTIVE COMPATIBILITY AND MECHANISM DESIGN Essenial Microeconomics -- INCENTIVE COMPATIBILITY AND MECHANISM DESIGN Signaling games 2 Incenive Compaibiliy 7 Spence s example: Educaional signaling 9 Single Crossing Propery Mechanism Design 7 Local

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size.

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size. Mehodology. Uni Roo Tess A ime series is inegraed when i has a mean revering propery and a finie variance. I is only emporarily ou of equilibrium and is called saionary in I(0). However a ime series ha

More information

= ( ) ) or a system of differential equations with continuous parametrization (T = R

= ( ) ) or a system of differential equations with continuous parametrization (T = R XIII. DIFFERENCE AND DIFFERENTIAL EQUATIONS Ofen funcions, or a sysem of funcion, are paramerized in erms of some variable, usually denoed as and inerpreed as ime. The variable is wrien as a funcion of

More information

Wisconsin Unemployment Rate Forecast Revisited

Wisconsin Unemployment Rate Forecast Revisited Wisconsin Unemploymen Rae Forecas Revisied Forecas in Lecure Wisconsin unemploymen November 06 was 4.% Forecass Poin Forecas 50% Inerval 80% Inerval Forecas Forecas December 06 4.0% (4.0%, 4.0%) (3.95%,

More information

An Excursion into Set Theory using a Constructivist Approach

An Excursion into Set Theory using a Constructivist Approach An Excursion ino Se Theory using a Consrucivis Approach Miderm Repor Nihil Pail under supervision of Ksenija Simic Fall 2005 Absrac Consrucive logic is an alernaive o he heory of classical logic ha draws

More information

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1. Roboics I April 11, 017 Exercise 1 he kinemaics of a 3R spaial robo is specified by he Denavi-Harenberg parameers in ab 1 i α i d i a i θ i 1 π/ L 1 0 1 0 0 L 3 0 0 L 3 3 able 1: able of DH parameers of

More information

T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 2011 EXAMINATION

T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 2011 EXAMINATION ECON 841 T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 211 EXAMINATION This exam has wo pars. Each par has wo quesions. Please answer one of he wo quesions in each par for a

More information

Solutions from Chapter 9.1 and 9.2

Solutions from Chapter 9.1 and 9.2 Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is

More information

DEPARTMENT OF STATISTICS

DEPARTMENT OF STATISTICS A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School

More information

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS Name SOLUTIONS Financial Economerics Jeffrey R. Russell Miderm Winer 009 SOLUTIONS You have 80 minues o complee he exam. Use can use a calculaor and noes. Try o fi all your work in he space provided. If

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

Biol. 356 Lab 8. Mortality, Recruitment, and Migration Rates

Biol. 356 Lab 8. Mortality, Recruitment, and Migration Rates Biol. 356 Lab 8. Moraliy, Recruimen, and Migraion Raes (modified from Cox, 00, General Ecology Lab Manual, McGraw Hill) Las week we esimaed populaion size hrough several mehods. One assumpion of all hese

More information

A First Course on Kinetics and Reaction Engineering. Class 19 on Unit 18

A First Course on Kinetics and Reaction Engineering. Class 19 on Unit 18 A Firs ourse on Kineics and Reacion Engineering lass 19 on Uni 18 Par I - hemical Reacions Par II - hemical Reacion Kineics Where We re Going Par III - hemical Reacion Engineering A. Ideal Reacors B. Perfecly

More information

Instructor: Barry McQuarrie Page 1 of 5

Instructor: Barry McQuarrie Page 1 of 5 Procedure for Solving radical equaions 1. Algebraically isolae one radical by iself on one side of equal sign. 2. Raise each side of he equaion o an appropriae power o remove he radical. 3. Simplify. 4.

More information

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,

More information

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion

More information

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15.

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15. SMT Calculus Tes Soluions February 5,. Le f() = and le g() =. Compue f ()g (). Answer: 5 Soluion: We noe ha f () = and g () = 6. Then f ()g () =. Plugging in = we ge f ()g () = 6 = 3 5 = 5.. There is a

More information

WEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x

WEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x WEEK-3 Reciaion PHYS 131 Ch. 3: FOC 1, 3, 4, 6, 14. Problems 9, 37, 41 & 71 and Ch. 4: FOC 1, 3, 5, 8. Problems 3, 5 & 16. Feb 8, 018 Ch. 3: FOC 1, 3, 4, 6, 14. 1. (a) The horizonal componen of he projecile

More information

Forecasting optimally

Forecasting optimally I) ile: Forecas Evaluaion II) Conens: Evaluaing forecass, properies of opimal forecass, esing properies of opimal forecass, saisical comparison of forecas accuracy III) Documenaion: - Diebold, Francis

More information

Introduction to Probability and Statistics Slides 4 Chapter 4

Introduction to Probability and Statistics Slides 4 Chapter 4 Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random

More information

Granger Causality Among Pre-Crisis East Asian Exchange Rates. (Running Title: Granger Causality Among Pre-Crisis East Asian Exchange Rates)

Granger Causality Among Pre-Crisis East Asian Exchange Rates. (Running Title: Granger Causality Among Pre-Crisis East Asian Exchange Rates) Granger Causaliy Among PreCrisis Eas Asian Exchange Raes (Running Tile: Granger Causaliy Among PreCrisis Eas Asian Exchange Raes) Joseph D. ALBA and Donghyun PARK *, School of Humaniies and Social Sciences

More information

PET467E-Analysis of Well Pressure Tests/2008 Spring Semester/İTÜ Midterm Examination (Duration 3:00 hours) Solutions

PET467E-Analysis of Well Pressure Tests/2008 Spring Semester/İTÜ Midterm Examination (Duration 3:00 hours) Solutions M. Onur 03.04.008 PET467E-Analysis of Well Pressure Tess/008 Spring Semeser/İTÜ Miderm Examinaion (Duraion 3:00 hours) Soluions Name of he Suden: Insrucions: Before saring he exam, wrie your name clearly

More information

Generalized Least Squares

Generalized Least Squares Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

The general Solow model

The general Solow model The general Solow model Back o a closed economy In he basic Solow model: no growh in GDP per worker in seady sae This conradics he empirics for he Wesern world (sylized fac #5) In he general Solow model:

More information

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,

More information

Cointegration and Implications for Forecasting

Cointegration and Implications for Forecasting Coinegraion and Implicaions for Forecasing Two examples (A) Y Y 1 1 1 2 (B) Y 0.3 0.9 1 1 2 Example B: Coinegraion Y and coinegraed wih coinegraing vecor [1, 0.9] because Y 0.9 0.3 is a saionary process

More information

How to Deal with Structural Breaks in Practical Cointegration Analysis

How to Deal with Structural Breaks in Practical Cointegration Analysis How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural

More information