Double Autocorrelation in Two Way Error Component Models

Size: px
Start display at page:

Download "Double Autocorrelation in Two Way Error Component Models"

Transcription

1 Open Journal of Statstcs o:046/ojs00 Publshe Onlne October 0 ( 85 Double Autocorrelaton n wo Way Error omponent Moels Abstract Jean Marceln osson rou Eugene Kouass Kern O Kymn Department of Economcs Unversty of ocoy Abjan ote- vore Resource Economcs West Vrgna Unversty Morgantown USA Dvson of Fnance an Economcs West Vrgna Unversty Morgantown USA E-mal: kernkymn@malwvueu Receve September 5 0; revse October 6 0; revse October 0 0 n ths paper we exten the works by [-5] accountng for autocorrelaton both n the tme specfc effect as well as the remaner error term Several transformatons are propose to crcumvent the ouble autocorrelaton problem n some specfc cases Estmaton proceures are then erve Keywors: wo Way Ranom Effect Moel Double Autocorrelaton F ntroucton Followng the works of [6] the regresson moel wth error components or varance components has become a popular metho for ealng wth panel ata A summary of the man features of the moel together wth a scusson of some applcatons s avalable n [7-0] among others However relatvely lttle s known about the two way error component moels n the presence of ouble autocorrelaton e autocorrelaton n the tme specfc effect an n the remaner error term as well hs paper extens the works by [-5] on the one-way ranom effect moel n the presence of seral autocorrelaton an by [] on the sngle autocorrelaton two-way approach t nvestgates some potental transformatons to crcumvent the ouble autocorrelaton ssue along wth some estmaton proceures n partcular we erve several transformatons when the two sturbances follow varous structures: from autoregressve an movng-average processes of orer to a general case of ouble seral correlaton We euce several estmators as well as ther asymptotc propertes an prove a F verson he remaner of ths paper s organze as follows: Secton consers smple transformatons on the presence of relatvely manageable ouble autocorrelaton structure n Secton general transformatons are consere when the ouble autocorrelaton s more complex estmators are erve n Secton 4 Asymptotc propertes of the estmators are consere n Secton 5 Secton 6 proves a F counterpart approach Fnally some conclung remarks appear n Secton 7 Smple ransformatons o crcumvent the ouble autocorrelaton ssue we frst nee to transform the moel base on the varance-covarance matrx he general regresson moel consere s yt 0 xt ut ; t 0 s the ntercept an s a k vector of slope coeffcents x t s a k row vector of explanatory varables whch are uncorrelate wth the usual two-way error components sturbances ut t (see [7]) n matrx form we wrte y X u t When the Errors Follow AR() Structures f the tme specfc term follows an AR() structure t t t wth t D0 an the remaner error term also follow an AR() structure t t et wth et D0 e we can efne two transformaton matrces of mensons respectvely an an opyrght 0 ScRes

2 86 J M ROU E AL an snce we have an e e e e () () the transforme errors an follow two fferent MA() processes of parameters an respectvely hus by applyng the approprate transformaton matrces the autoregressve error structure can be change nto a movng-average one he only cost s the loss of the ntal an frst pseuo-fferences whch has no serous consequence for a long tme menson As a result we focus on the MA() error structure When the Errors Follow MA() Structures Here the tme specfc term t follows an MA() structure t t t wth t D 0 whle the remaner error term t also follows an MA () structure t et et wth et D0 e For convergence purpose an assumng normalty the ntal values are efne an 0 0 e 0 0 he varance-covarance matrx of the three components error term s gven by e () an are postve efnte matrces of orer an s efne by xoepltz x x0 0 he exact nverse of such matrces suggeste by [] an [] oes not nvolve the parameters an Followng [] let P be the Pesaran orthogonal matrx whose t-th row s gven by tπ tπ tπ Lt sn sn sn P P ag tπ t cos P P D an tπ D a g t wth t cos Pre-multplyng the moel by Pyels the fol- of u P u lowng varance-covarance matrx D (4) e P General ransformatons We are now n the context of a general case of ouble autocorrelaton ssue an lea to a sutable error covarance matrx smlar to Equaton (4) an ts nverse Frst ransformaton Let P enote the matrx such that PP Such a matrx oes exst for an s a postve-efnte matrx ransformaton of the ntal moel y X u by yels P y P y X u (5) an the varance-covarance of the transforme errors s E u u P P P P hs transformaton has remove the autocorrelaton n the tme-specfc effect t Unfortunately by ong so t has nfecte the s t a n worsene the ntal correlaton n the reman er sturbances An atonal treatment s therefore neee Secon ransformaton (6) We now conser an orthogonal matrx P an a - agonal matrx D such that PPPP D (agonalzaton of P P ) hus appl yng a secon transformaton P yels y P y X u (7) he unerlyng varance-covarance matrx of the errors s E u u P P P P opyrght 0 ScRes

3 J M ROU E AL 87 or P P P P P P (8a) Eu u D PP PP P P P P D f an (8b) Here because of the choce of matrces P an P we en up wth snce P s an orthogonal ma- Generally speakng an D just n ee to have trx zero off-agonal elements e to be agonal matrces he ouble autocorrelaton structure s thus absorbe an one can easly accommoate wth the non-sphercal form of by means of an accurate nverson process omputng the nverse he nverse of s obtane usng the proceure e- one velope by [] After a bt of algebra gets E K E L J S D E J L D J K D L D D S S S 4 S S an S ag s s wth s t t (see the Appenx) 4 Estmaton We begn wth the efnton of the estmator followe by ts nterpretaton an weghte average property (9) 4 he Estmator Proposton : he estmator s X X X y (0) (Straghtforwar) 4 nterpretaton n classcal two-way regresson moels [] prove an nterpretaton of the estmator whch s appealng n vew of the sources of varaton n sample ata n the straght lne of ther work the estmator may be vewe as obtane by poolng three uncorrelate estmators: the covarance estmator (or wthn estmator) the between-nvual estmator an the wthn-nvual estmator hey are the same as those suggeste by [] except for the last one whch was labele between-tme estmator We have ) he covarance estmator A E K AX X X Ay ; ) he between-nvual estmator X A X X A y A J S an ) h e wthn-nvual estmator A E L X AX X A y t s mportant to note that these estmators are obtane from some transformatons of the regresson Equaton (7) e y P y X u he covarance estmator s obtane when Equaton (7) s pre-multple by M E K A; the transformaton annhlates the nvual- an tme-effects as well as the column of ones n the matrx of explanatory varables t s equvalent to the wthn estmator n the classcal two-way error component moel (see [-7]) he between-nvual estmator transformaton of Equaton (7) by the matrx comes from the opyrght 0 ScRes

4 88 J M ROU E AL M hs s equvalent to averagng n- each tme pero vual equatons for he wthn-nvual estmator s erve when Equaton (7) s transforme by M E L A he presence of the empotent matrx E ncates that ths transformaton wpes out the constant term as well as the tme specfc error term t Howe ver the nvual effect remans 4 as a Weghte Average Estmator As n [4] the estmator s a weghte average of the three estmators efne above Proposton : F F F () wth F X X X A X F X X X A X an F X X X A X F F From Equaton (0) t comes that wth X y X X X y X A y X A y an are re- X A y y efnton the estmators spectvely such that an herefore X A y X X A X A y X A X X A y X A X X y X AX X AX X AX Or X X X AX hus X AX X AX X X X AX X X X A X X X X A X F F F wth F F an F efne accorng to Equaton ( ) We shoul also note that the three estmators an are uncorrelate n fact A A EJ KDS 0 an A A E K DL 0 E whle A A 0 because K 0 snce JE 0 As a result cov cov cov 0 () Moreover followng [] the fact that rankmrank MrankM () gves evence on the use of all avalable nformaton from the sample he estmators an together use up the entre set of nformaton to bul the estmator wth no loss at all 5 Asymptotc Propertes Uner regular assumptons the an the three pseuo estmators of the coeffcent vector say an are all consstent an asymptotcally equvalent t s a result smlar to the one obtane n the classcal two-way error component moel (see [5]) 5 Assumptons We assume that the xt s are weakly non-stochastc e o not repeat n repeate samples We also state that the followng matrces exst an are postve efnte: opyrght 0 ScRes

5 J M ROU E AL 89 a X A X X E K X plm plm for the frst transformaton; b X J S X X A X plm plm for the secon transformaton; an plm X A X plm X E L X c for the thr transformaton Furthermore n the straght lne of [] we also assume that X Au X E K u a plm plm 0 for the frst transformaton; X A u b plm X J S u plm 0 for the secon transformaton; X Au X E L u c plm plm 0 for the thr transformaton n aton lm D so that the varance-components quantty D enotes by remans nfnte as he lmts an probabltes are taken as an All along ths secton followng [] we conser the usual assumptons re- garng the error vector u as state n [6] an [7] whch ensures the asymptotc normalty 5 Asym ptotc Prop erty of the ovarance Estmator Proposton : he covarance estmator Snce s consstent X E K X X E K u Hence X E K X plm plm X E K u plm 0 Makng use of assumptons (a) an (a) we establsh the consstency of the covarance estmator plm Proposton 4: he covarance estmator has an asymptotc normal strbuton gven by a X E K X plm Uner the M-transformaton we have E E K u E K E u 0 (4) Moreover ts varance s gven by V E K u E K an ts nverse s equal to E D whle assumpton (a) states the absence of correlaton between regressors an stur- bances uner the M transformaton We have an X E K u X 0 plm E K X (5) X E K X X E K u from whch we euce that X E K X 0 plm hus the asymptotc normalty of the covarance estmator mmeately follows X E a K X plm opyrght 0 ScRes

6 90 J M ROU E AL 5 Asymptotc Property of the etween-me Estmator Proposton 5: he between tme estmator Snce s consstent X AX X Au Hence accorng to assumptons (b) an (b) J X S X plm plm J X S u plm 0 Makng use of assumptons (b) an (b) we establsh the consstency of the between tme estmator plm Proposton 6: he between-tme estmator has an asymptotc normal strbuton gven by X J S X a plm (6) Uner the M -transformaton we get E u E u he varance of ths error term s wrtten as V u S 0 ts nverse s S Agan assumpton (b) states the absence of correlaton between regressors an sturbances uner the M transformaton We get J X S u n aton we have J X S X 0 plm J X S X from whch we euce that J X S u J X S X 0 plm hus the asymptotc normalty of the between-tme estmator mmeately follows X J S X a plm 54 Asymptotc Property of the Wthn-nvual Estmator Proposton 7: he wthn nvual estm ator s a consstent estmator Snce Hence X AX X Au plm plm X E L X X E L u plm 0 opyrght 0 ScRes

7 J M ROU E AL 9 Makng use of assumptons (c) an (c) we establsh the consstency of the covarance estmator plm has an asymp- Proposton 8: he wthn nvual estmator totc normal strbuton gven by h a X E L X plm (7) Uner the M -transformaton we obtan E E L u E L E u e varance of E L u s obtane as V E L u E L 0 he nverse of ths matrx s E L Assumpton (c) states the absence of correlaton between regressors an sturbances uner the M transformaton We have an X E L u X E L X 0 plm from whch we euce that X E L X X E L u X E L X 0 plm hus the asymptotc normalty of the wthn nvual estmator mmeately follows a X E L X plm 55 Asymptotc Property of the Estmator Proposton 9: he estmator s asymptotcally equvalent to the covarance estmator an therefore a X E K X plm From Equaton (0) we get (8) X X X u On the one han we have w X X X E K X X E L X X J S X here D as herefore from assumpton (a) we fn that X E L X 0 when Lke wse X J S X assumpton (a) leas us to 0 when Hence plm X X plm X E K X On the other han we can wrte X u X E K u X E L u X J S u Uner the M an M transformatons we get X E L u plm X J S u plm 0 opyrght 0 ScRes

8 9 J M ROU E AL leang to plm X u plm X E K u As a result e plm X E K X plm X E K u plm plm plm has the same lmtng strbu- hs shows the asymptotc equvalence of the two estmators an We then euce that Fnally ton as a X E KX plm hus the estmator suggeste uner the ouble autocorrelaton error structure has the esre asymptotc propertes 6 F Estmaton n practce the varance-covarance ts etermnaton herefore a F approach s requre he metho matrx s unknown as well as all the parameters nvolve n use conssts n removng the tme specfc effect to obtan a one-way error component moel only t carres the seral correlaton (see [8] an []) hs metho has been rectly apple to AR() an MA() processes n separate subsectons 6 Feasble Double AR() Moel We assume that t t e t t t t et D0 e t D 0 he wthn error term s u E u E E (9) he assocate varance-covarance matrx s E uu E E (0) Snce t follows an AR() process of parameter we efne the matrx as the famlar [9] transformaton matrx wth parameter hs matrx s su ch that e he resultng estmator s gven by W X X X y () y y an X X he covarance matrx of u u trck s usng [0] e E J e E E an J E J () Followng [] another estmator can be erve We label ths estmator the wthn-type estmator an s gven by () W X X X y wth y y an X X n orer to get the estmates of numerous parameters nvolve n the moel we frst nee an estmate of the correlaton coef- fcent he autocorrelaton functon of the error term u s gven by h h E ut u t h for h 0 t We euce from t that 0 (4) t then leas opyrght 0 ScRes

9 J M ROU E AL 9 to a convergent estmator of h h (see [7]) e 0 ut u th wth t th u efne as the OLS resuals o f the wthn equaton y X u Hence we get an (5a) (5b) Furthermore the QU estmate of e s also avalable as u E E u e (6) u beng the OLS estmate of u As a consequence we get an e (7a) 0 We now nee to fn an he autocovarance functon of the ntal error term u s gven h h for h 0 t t comes that h h h (7b) (8) We mmeately euce a convergent estmator of the secon correlaton coeffcent e 0 0 h u ut th wth h th u t (9) e- notng the OLS resuals of y X u he varances e s estmate by e n aton to the estmators mentone n Secton 4 other estmators su ch as the wthn estmator W an the wthn-type estmator W can all be performe as well Actually the knowlege of the AR() parameters an enttles us to bul the matrces nvolve n the etermnato n of say matrces P D K L S an S 6 Feasble Double MA() Moel (0) We now state that t e t e t wth an et D 0 e Agan evatons from nvual means lea to the moel y X u wth u t t he varance-covarance matrx of u Equaton (0) wth now s stll gven by oepltz r 0 0 () Here we set enotng the correlaton correcton matrx as ef ne by [8] n ther orthogonalzng algorthm We then transform the wthn moel by he n ew er ror term u ha s the followng covarance matrx E J E E () ecause of the movng average nature of the process lnear estmaton of the correlaton parameter s not easly obtanable nstea r proves useful he autocorrelaton functon of the wthn error term u t s gven by wth h E ut u t h h () for h 0 t h enotng the autocovarance functon of t As a conseque nce j j an 0 0 for some (4) opyrght 0 ScRes

10 94 J M ROU E AL h h ut u th s the emprcal th autocovarance functon an u t s are the OLS resuals of the wthn equaton We also get for some j r (5) j We then apply the [8] matrx to the ata (for nstance to the wthn transforme epenent vector y ) Moreover wll be apple to the vector of constants to get estm ates of the ts W e have n the straght lne of [8] the followng steps: y Step : ompute y an y t y t r y g t g t t g for t r g t for t g t Step : ompute y y knowng that he estmates of the s are t obtane as an r g t t fo r t g t We then obtan the estmate of as t t he autocovarance functon h Eutu th h h of the ntal composte error term u an ts emprcal counterpart h u t u h th th ( u t beng the OLS resuals of the ntal two-way moel) permt the estmaton of an r an 0 (6a) r r ( 6b) he wthn estmator W an the wthn-type one W are now obtanable However the estmator can be estmate prove the MA() parameters an are known especally uner the contons 4r 0 an 4 r 0 n other wors the estmates r an r shoul b ot h le nse th e open nterval as a pre-requste to a rect estmaton of an 7 Fnal Remarks hs paper has consere a complex but realstc correlaton structure n the two-way error component moel: the ouble autocorrelaton case t ealt wth some parsmonous moels especally the AR() an MA() ones as well as the general framework hrough a precse formula of the varance-covarance matrx of the errors we erve the estmator an relate asymptotc propertes An nvestgaton of the F s also consere n the paper 8 References [] S Revankar Error omponent Moels wth Seral orrelate me Effects Journal of the nan Statstcal Assocaton Vol pp 7-60 [] H altag an Q L A ransformaton that wll rcumvent the Problem of Autocorrelaton n an Error omponent Moel Journal of Econometrc Vol 48 o 99 pp 85-9 o:006/ (9) [] H altag an Q L Precton n the One-Way Er- orrelaton Journal ror omponent Moel wth Seral of Forecastng Vol o 6 99 pp o:000/for [4] H altag an Q L Estmatng Error omponent Moels wth General MA(q) Dsturbances Econometrc heory Vol 0 o 994 pp o:007/s x [5] J W Galbrath an V Zne-Walsh ransformng the Error omponent Moel for Estmaton wth general ARMA Dsturbances Journal of Econometrcs Vol 66 o pp o:006/ (94)06-6 [6] P alestra an M erlove Poolng ross-secton an me-seres Data n the Estmaton of a Dynamc Moel: he Deman for atural Gas Econometrca Vol 4 o 966 pp o:007/90977 [7] H altag Econometrc Analyss of Panel Data r Eton John Wley an Sons ew York 008 [8] Hsao Analyss of Panel Data ambrge Unversty Press ambrge 00 [9] G S Maala Lmte Depenent an Qualtatve Varables n Econometrcs ambrge Unversty Press opyrght 0 ScRes

11 J M ROU E AL 95 ambrge 98 [0] G S Maala he Econometrcs of Panel Data Vols an Ewar Elgar Publshng heltenham 98 [] M H Pesaran Exact Maxmum Lkelhoo Estmaton of a Regresson Equaton wth a Frst Orer Movng Average Errors he Revew of Economc Stues Vol 40 o 4 97 pp [] P A V Swamy an S S Arora he Exact Fnte Sample Propertes of the Estmators of oeffcents n the Error omponents Regresson Mo els Econometrca Vol 40 o 97 pp 6-75 o:007/ [] M erlove A ote on Error omponents Moels Econometrca Vol 9 o 97 pp 8-96 o:007/95 [4] G S Maala he Use of Varance omponents Moels n Poolng ross Secton an me Seres Data Econometrca Vol 9 o 97 pp 4-58 o:007/949 [5] Amemya he Estmaton of the Varances n a Varance-omponents Moel nternatonal Economc Revew Vol o 97 pp - o:007/5549 [6] H hel Prncples of Econometrcs John Wley an Sons ew York 97 [7] D Wallace an A Hussan he Use of Error omponents Moels n ombnng ross-secton an me Seres Data Econometrca Vol 7 o 969 pp 55-7 o:007/90905 [8] A Maury he Use of me Seres Processes to Moel the Error Structure of Earnngs n a Longtunal Data Analyss Journal of Econometrcs Vol 8 o 98 pp 8-4 o:006/ (8) [9] S J Pras an Wnsten ren Estmators an Seral orrelaton Unpublshe owles ommsson Dscusson Paper: Stat o 8 hcago 954 [0] W A Fuller an G E attese Estmaton of Lnear Moels wth ross-error Structure Journal of Econometrcs Vol o 974 pp o:006/ (74)9000-x [] J Wansbeek an A Kapteyn A Smple Way to obtan the Spectral Decomposton of Varance omponents Moels for alance Data ommuncatons n Statstcs Vol o 8 98 pp 05- opyrght 0 ScRes

12 96 J M ROU E AL Appenx: omputng the nverse of We establshe that D w th D ag t an ag ettng S G D we can re- wrte the varance covarance matrx as G J G J J y the means of an upate formula we euce an expresson of the nverse of G G J J G J J G We nee to obtan G an the nverse of the brack- ete expresson On th e one han G D D Let H enote the matrx At th s step the nverse of D D H s requre Let a be a orthogonal matrx hen H D herefore wth H ag t s worth mentonng that D a 0 for an a are fferent columns of the same ag onal matrx t s therefore obvous that H has alreay been agonalze As a consequence the nverse of H s gven by H ag H a a A A ag Snce 0 an we have a a a a a E herefore H E A t then follows that G D E A G D E D S n whch S ags s t wth s t t t On the other han the matrx J G J to be etermne We get J G J E D S or has opyrght 0 ScRes

13 J M ROU E AL 97 hus Hence J G J E D S J G J D E S JG J S D D an J G J a b S D a D an b Snce b a b a a b we euce JG J We are now ntereste n the expresson We have G JJ G J J G G JJG J JG b G JJ G G J J G a a b From the efntons of the matrces G an J we can wrte an so that G J E D S G JJ G G J S 4 E D D S S an lastly t then comes that G J J G S S 4 G JJG J JG 4 E D D 4 S S a a a 4 b 4 a a b n other wors SS S S G J J G J J G E D D a 4 a 4 Fnally the nverse of wth a a b S S can be erve as E D D D J 4 a J S S 4 S a b An alternatve expresson for s avalable Settng L D D D K D L an we get E D L L D D a J S S a b S E K E L D J S opyrght 0 ScRes

14 98 J M ROU E AL e S S S a b 4 4 S S S S S S Hence we fnally get E K E L J S D opyrght 0 ScRes

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

New Liu Estimators for the Poisson Regression Model: Method and Application

New Liu Estimators for the Poisson Regression Model: Method and Application New Lu Estmators for the Posson Regresson Moel: Metho an Applcaton By Krstofer Månsson B. M. Golam Kbra, Pär Sölaner an Ghaz Shukur,3 Department of Economcs, Fnance an Statstcs, Jönköpng Unversty Jönköpng,

More information

Large-Scale Data-Dependent Kernel Approximation Appendix

Large-Scale Data-Dependent Kernel Approximation Appendix Large-Scale Data-Depenent Kernel Approxmaton Appenx Ths appenx presents the atonal etal an proofs assocate wth the man paper [1]. 1 Introucton Let k : R p R p R be a postve efnte translaton nvarant functon

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

A Comparative Study for Estimation Parameters in Panel Data Model

A Comparative Study for Estimation Parameters in Panel Data Model A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate

More information

e i is a random error

e i is a random error Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecture 3 Contnuous Systems an Fels (Chapter 3) Where Are We Now? We ve fnshe all the essentals Fnal wll cover Lectures through Last two lectures: Classcal Fel Theory Start wth wave equatons

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

On a one-parameter family of Riordan arrays and the weight distribution of MDS codes

On a one-parameter family of Riordan arrays and the weight distribution of MDS codes On a one-parameter famly of Roran arrays an the weght strbuton of MDS coes Paul Barry School of Scence Waterfor Insttute of Technology Irelan pbarry@wte Patrck Ftzpatrck Department of Mathematcs Unversty

More information

GENERALISED WALD TYPE TESTS OF NONLINEAR RESTRICTIONS. Zaka Ratsimalahelo

GENERALISED WALD TYPE TESTS OF NONLINEAR RESTRICTIONS. Zaka Ratsimalahelo GENERALISED WALD TYPE TESTS OF NONLINEAR RESTRICTIONS Zaka Ratsmalahelo Unversty of Franche-Comté, U.F.R. Scence Economque, 45D, av. e l Observatore, 5 030 Besançon - France Abstract: Ths paper proposes

More information

On Liu Estimators for the Logit Regression Model

On Liu Estimators for the Logit Regression Model CESIS Electronc Workng Paper Seres Paper No. 59 On Lu Estmators for the Logt Regresson Moel Krstofer Månsson B. M. Golam Kbra October 011 The Royal Insttute of technology Centre of Excellence for Scence

More information

FINITE-SAMPLE PROPERTIES OF THE MAXIMUM LIKELIHOOD ESTIMATOR FOR THE BINARY LOGIT MODEL WITH RANDOM COVARIATES

FINITE-SAMPLE PROPERTIES OF THE MAXIMUM LIKELIHOOD ESTIMATOR FOR THE BINARY LOGIT MODEL WITH RANDOM COVARIATES conometrcs Workng Paper WP0906 ISSN 485-644 Department of conomcs FINIT-SAMPL PROPRTIS OF TH MAIMUM LIKLIHOOD STIMATOR FOR TH BINARY LOGIT MODL WITH RANDOM COVARIATS Qan Chen School of Publc Fnance an

More information

Testing for seasonal unit roots in heterogeneous panels

Testing for seasonal unit roots in heterogeneous panels Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

p(z) = 1 a e z/a 1(z 0) yi a i x (1/a) exp y i a i x a i=1 n i=1 (y i a i x) inf 1 (y Ax) inf Ax y (1 ν) y if A (1 ν) = 0 otherwise

p(z) = 1 a e z/a 1(z 0) yi a i x (1/a) exp y i a i x a i=1 n i=1 (y i a i x) inf 1 (y Ax) inf Ax y (1 ν) y if A (1 ν) = 0 otherwise Dustn Lennon Math 582 Convex Optmzaton Problems from Boy, Chapter 7 Problem 7.1 Solve the MLE problem when the nose s exponentally strbute wth ensty p(z = 1 a e z/a 1(z 0 The MLE s gven by the followng:

More information

Computing MLE Bias Empirically

Computing MLE Bias Empirically Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random

More information

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980 MT07: Multvarate Statstcal Methods Mke Tso: emal mke.tso@manchester.ac.uk Webpage for notes: http://www.maths.manchester.ac.uk/~mkt/new_teachng.htm. Introducton to multvarate data. Books Chat eld, C. and

More information

Explicit bounds for the return probability of simple random walk

Explicit bounds for the return probability of simple random walk Explct bouns for the return probablty of smple ranom walk The runnng hea shoul be the same as the ttle.) Karen Ball Jacob Sterbenz Contact nformaton: Karen Ball IMA Unversty of Mnnesota 4 Ln Hall, 7 Church

More information

High-Order Hamilton s Principle and the Hamilton s Principle of High-Order Lagrangian Function

High-Order Hamilton s Principle and the Hamilton s Principle of High-Order Lagrangian Function Commun. Theor. Phys. Bejng, Chna 49 008 pp. 97 30 c Chnese Physcal Socety Vol. 49, No., February 15, 008 Hgh-Orer Hamlton s Prncple an the Hamlton s Prncple of Hgh-Orer Lagrangan Functon ZHAO Hong-Xa an

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

A Monte Carlo Study for Swamy s Estimate of Random Coefficient Panel Data Model

A Monte Carlo Study for Swamy s Estimate of Random Coefficient Panel Data Model A Monte Carlo Study for Swamy s Estmate of Random Coeffcent Panel Data Model Aman Mousa, Ahmed H. Youssef and Mohamed R. Abonazel Department of Appled Statstcs and Econometrcs, Instute of Statstcal Studes

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Lecture 4 Hypothesis Testing

Lecture 4 Hypothesis Testing Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

A MULTIDIMENSIONAL ANALOGUE OF THE RADEMACHER-GAUSSIAN TAIL COMPARISON

A MULTIDIMENSIONAL ANALOGUE OF THE RADEMACHER-GAUSSIAN TAIL COMPARISON A MULTIDIMENSIONAL ANALOGUE OF THE RADEMACHER-GAUSSIAN TAIL COMPARISON PIOTR NAYAR AND TOMASZ TKOCZ Abstract We prove a menson-free tal comparson between the Euclean norms of sums of nepenent ranom vectors

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

Asymptotic Properties of the Jarque-Bera Test for Normality in General Autoregressions with a Deterministic Term

Asymptotic Properties of the Jarque-Bera Test for Normality in General Autoregressions with a Deterministic Term Asymptotc Propertes of the Jarque-Bera est for Normalty n General Autoregressons wth a Determnstc erm Carlos Caceres Nuffeld College, Unversty of Oxford May 2006 Abstract he am of ths paper s to analyse

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models

More information

Non-negative Matrices and Distributed Control

Non-negative Matrices and Distributed Control Non-negatve Matrces an Dstrbute Control Yln Mo July 2, 2015 We moel a network compose of m agents as a graph G = {V, E}. V = {1, 2,..., m} s the set of vertces representng the agents. E V V s the set of

More information

Analytical classical dynamics

Analytical classical dynamics Analytcal classcal ynamcs by Youun Hu Insttute of plasma physcs, Chnese Acaemy of Scences Emal: yhu@pp.cas.cn Abstract These notes were ntally wrtten when I rea tzpatrck s book[] an were later revse to

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede Fall Analyss of Expermental Measurements B. Esensten/rev. S. Erree Hypothess Testng, Lkelhoo Functons an Parameter Estmaton: We conser estmaton of (one or more parameters to be the expermental etermnaton

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

A MULTIDIMENSIONAL ANALOGUE OF THE RADEMACHER-GAUSSIAN TAIL COMPARISON

A MULTIDIMENSIONAL ANALOGUE OF THE RADEMACHER-GAUSSIAN TAIL COMPARISON A MULTIDIMENSIONAL ANALOGUE OF THE RADEMACHER-GAUSSIAN TAIL COMPARISON PIOTR NAYAR AND TOMASZ TKOCZ Abstract We prove a menson-free tal comparson between the Euclean norms of sums of nepenent ranom vectors

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Factor models with many assets: strong factors, weak factors, and the two-pass procedure

Factor models with many assets: strong factors, weak factors, and the two-pass procedure Factor models wth many assets: strong factors, weak factors, and the two-pass procedure Stanslav Anatolyev 1 Anna Mkusheva 2 1 CERGE-EI and NES 2 MIT December 2017 Stanslav Anatolyev and Anna Mkusheva

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

Chapter 3. Two-Variable Regression Model: The Problem of Estimation

Chapter 3. Two-Variable Regression Model: The Problem of Estimation Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that

More information

III. Econometric Methodology Regression Analysis

III. Econometric Methodology Regression Analysis Page Econ07 Appled Econometrcs Topc : An Overvew of Regresson Analyss (Studenmund, Chapter ) I. The Nature and Scope of Econometrcs. Lot s of defntons of econometrcs. Nobel Prze Commttee Paul Samuelson,

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

LOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi

LOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi LOGIT ANALYSIS A.K. VASISHT Indan Agrcultural Statstcs Research Insttute, Lbrary Avenue, New Delh-0 02 amtvassht@asr.res.n. Introducton In dummy regresson varable models, t s assumed mplctly that the dependent

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact Multcollnearty multcollnearty Ragnar Frsch (934 perfect exact collnearty multcollnearty K exact λ λ λ K K x+ x+ + x 0 0.. λ, λ, λk 0 0.. x perfect ntercorrelated λ λ λ x+ x+ + KxK + v 0 0.. v 3 y β + β

More information

Yukawa Potential and the Propagator Term

Yukawa Potential and the Propagator Term PHY304 Partcle Physcs 4 Dr C N Booth Yukawa Potental an the Propagator Term Conser the electrostatc potental about a charge pont partcle Ths s gven by φ = 0, e whch has the soluton φ = Ths escrbes the

More information

Limited Dependent Variables and Panel Data. Tibor Hanappi

Limited Dependent Variables and Panel Data. Tibor Hanappi Lmted Dependent Varables and Panel Data Tbor Hanapp 30.06.2010 Lmted Dependent Varables Dscrete: Varables that can take onl a countable number of values Censored/Truncated: Data ponts n some specfc range

More information

The Noether theorem. Elisabet Edvardsson. Analytical mechanics - FYGB08 January, 2016

The Noether theorem. Elisabet Edvardsson. Analytical mechanics - FYGB08 January, 2016 The Noether theorem Elsabet Evarsson Analytcal mechancs - FYGB08 January, 2016 1 1 Introucton The Noether theorem concerns the connecton between a certan kn of symmetres an conservaton laws n physcs. It

More information

ECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Winter 2017 Instructor: Victor Aguirregabiria

ECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Winter 2017 Instructor: Victor Aguirregabiria ECOOMETRICS II ECO 40S Unversty of Toronto Department of Economcs Wnter 07 Instructor: Vctor Agurregabra SOLUTIO TO FIAL EXAM Tuesday, Aprl 8, 07 From :00pm-5:00pm 3 hours ISTRUCTIOS: - Ths s a closed-book

More information

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X). 11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e

More information

Rockefeller College University at Albany

Rockefeller College University at Albany Rockefeller College Unverst at Alban PAD 705 Handout: Maxmum Lkelhood Estmaton Orgnal b Davd A. Wse John F. Kenned School of Government, Harvard Unverst Modfcatons b R. Karl Rethemeer Up to ths pont n

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Systems of Equations (SUR, GMM, and 3SLS)

Systems of Equations (SUR, GMM, and 3SLS) Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

The Granular Origins of Aggregate Fluctuations : Supplementary Material

The Granular Origins of Aggregate Fluctuations : Supplementary Material The Granular Orgns of Aggregate Fluctuatons : Supplementary Materal Xaver Gabax October 12, 2010 Ths onlne appendx ( presents some addtonal emprcal robustness checks ( descrbes some econometrc complements

More information

a. (All your answers should be in the letter!

a. (All your answers should be in the letter! Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal

More information

Exam. Econometrics - Exam 1

Exam. Econometrics - Exam 1 Econometrcs - Exam 1 Exam Problem 1: (15 ponts) Suppose that the classcal regresson model apples but that the true value of the constant s zero. In order to answer the followng questons assume just one

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Visualization of 2D Data By Rational Quadratic Functions

Visualization of 2D Data By Rational Quadratic Functions 7659 Englan UK Journal of Informaton an Computng cence Vol. No. 007 pp. 7-6 Vsualzaton of D Data By Ratonal Quaratc Functons Malk Zawwar Hussan + Nausheen Ayub Msbah Irsha Department of Mathematcs Unversty

More information

WHY NOT USE THE ENTROPY METHOD FOR WEIGHT ESTIMATION?

WHY NOT USE THE ENTROPY METHOD FOR WEIGHT ESTIMATION? ISAHP 001, Berne, Swtzerlan, August -4, 001 WHY NOT USE THE ENTROPY METHOD FOR WEIGHT ESTIMATION? Masaak SHINOHARA, Chkako MIYAKE an Kekch Ohsawa Department of Mathematcal Informaton Engneerng College

More information

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model

More information

Properties of Least Squares

Properties of Least Squares Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for

More information

ENTROPIC QUESTIONING

ENTROPIC QUESTIONING ENTROPIC QUESTIONING NACHUM. Introucton Goal. Pck the queston that contrbutes most to fnng a sutable prouct. Iea. Use an nformaton-theoretc measure. Bascs. Entropy (a non-negatve real number) measures

More information

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes 25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton

More information

LECTURE 8-9: THE BAKER-CAMPBELL-HAUSDORFF FORMULA

LECTURE 8-9: THE BAKER-CAMPBELL-HAUSDORFF FORMULA LECTURE 8-9: THE BAKER-CAMPBELL-HAUSDORFF FORMULA As we have seen, 1. Taylor s expanson on Le group, Y ] a(y ). So f G s an abelan group, then c(g) : G G s the entty ap for all g G. As a consequence, a()

More information

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

An efficient method for computing single parameter partial expected value of perfect information

An efficient method for computing single parameter partial expected value of perfect information An effcent metho for computng sngle parameter partal expecte value of perfect nformaton Mark Strong,, Jeremy E. Oakley 2. School of Health an Relate Research ScHARR, Unversty of Sheffel, UK. 2. School

More information

Efficient nonresponse weighting adjustment using estimated response probability

Efficient nonresponse weighting adjustment using estimated response probability Effcent nonresponse weghtng adjustment usng estmated response probablty Jae Kwang Km Department of Appled Statstcs, Yonse Unversty, Seoul, 120-749, KOREA Key Words: Regresson estmator, Propensty score,

More information

Multivariate Ratio Estimator of the Population Total under Stratified Random Sampling

Multivariate Ratio Estimator of the Population Total under Stratified Random Sampling Open Journal of Statstcs, 0,, 300-304 ttp://dx.do.org/0.436/ojs.0.3036 Publsed Onlne July 0 (ttp://www.scrp.org/journal/ojs) Multvarate Rato Estmator of te Populaton Total under Stratfed Random Samplng

More information

be a second-order and mean-value-zero vector-valued process, i.e., for t E

be a second-order and mean-value-zero vector-valued process, i.e., for t E CONFERENCE REPORT 617 DSCUSSON OF TWO PROCEDURES FOR EXPANDNG A VECTOR-VALUED STOCHASTC PROCESS N AN ORTHONORMAL WAY by R. GUTkRREZ and M. J. VALDERRAMA 1. ntroducton Snce K. Karhunen [l] and M. Lo&e [2]

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

SIMPLE LINEAR REGRESSION

SIMPLE LINEAR REGRESSION Smple Lnear Regresson and Correlaton Introducton Prevousl, our attenton has been focused on one varable whch we desgnated b x. Frequentl, t s desrable to learn somethng about the relatonshp between two

More information

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger JAB Chan Long-tal clams development ASTIN - September 2005 B.Verder A. Klnger Outlne Chan Ladder : comments A frst soluton: Munch Chan Ladder JAB Chan Chan Ladder: Comments Black lne: average pad to ncurred

More information

Statistics MINITAB - Lab 2

Statistics MINITAB - Lab 2 Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

0.1 The micro "wage process"

0.1 The micro wage process 0.1 The mcro "wage process" References For estmaton of mcro wage models: John Abowd and Davd Card (1989). "On the Covarance Structure of Earnngs and Hours Changes". Econometrca 57 (2): 411-445. Altonj,

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information