SOME NEW ADJUSTED RIDGE ESTIMATORS OF LINEAR REGRESSION MODEL

Size: px
Start display at page:

Download "SOME NEW ADJUSTED RIDGE ESTIMATORS OF LINEAR REGRESSION MODEL"

Transcription

1 Internatonal Journal of Cvl Engneerng and Technology (IJCIET) Volume 9, Issue 11, November 18, pp , Artcle ID: IJCIET_9_11_84 Avalable onlne at ISSN Prnt: and ISSN Onlne: IAEME Publcaton Scopus Indexed SOME NEW ADJUSTED RIDGE ESTIMATORS OF LINEAR REGRESSION MODEL Kayode Aynde Department of Statstcs, Federal Unversty of Technology, Akure, Ondo State, Ngera. Adewale F. Lukman Department of Mathematcs, Landmark Unversty, Omu-Aran, Kwara State, Ngera. Samuel O. Olarenwaju and Omokova M. Attah Department of Statstcs, Unversty of Abuja, Abuja, Ngera. ABSTRACT The rdge estmator for handlng multcollnearty problem n lnear regresson model requres the use the basng parameter. In ths paper, some new adjusted rdge parameters whch do not requre the basng parameter are proposed. The performances of the proposed Adjusted Rdge Estmators are compared wth a recently proposed Adjusted Rdge Estmator, Generalzed Rdge Regresson Estmator (E), Ordnary Rdge Regresson Estmator (E) and Ordnary Least Square estmator (E) va Monte Carlo study by countng the number of tmes each estmator has smallest Mean Square Error (MSE) n ten thousand (1,) replcatons. The proposed Adjusted Rdge Estmator s most effcent especally when multcollnearty s severe and the error varance s hgh. Keywords: Adjusted Rdge estmator, Generalzed Rdge Estmator, Ordnary Rdge Estmator Cte ths Artcle: Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah, Some New Adjusted Rdge Estmators of Lnear Regresson Model, Internatonal Journal of Cvl Engneerng and Technology, 9(11), 18, pp INTRODUCTION In lnear regresson model, one of the crucal condtons for the applcaton of Ordnary Least Squares () estmator to estmate the model parameters s that the explanatory varables are not strongly or perfectly correlated. Wth strong correlatons or lnear relatonshp among the explanatory varables, multcollnearty problem arses. In practce, ths problem s nherent n edtor@aeme.com

2 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah most economc functons due to the nature of economc varables movng together over tme (Kuotsoyanns, 3). It s therefore common n tme seres data, even though, t mght occur n cross-sectonal data as well. For example n tme seres data, exchange rate and nflaton rate tends to ncrease together as tme ncreases. There s no conclusve evdence as regards the degree of multcollnearty that wll affect the parameter estmates when collnearty s present (Kuotsoyanns, 3). The serousness of ths problem s a functon of the degree of ntercorrelaton. The use of estmator n ths stuaton produces unstable and mprecse parameter estmates, questonable predctons and nvald statstcal nferences about the model parameters (Kuotsoyanns, 3). Varous correctve measures have been dscussed n lterature to handle the problem of multcollnaerty. Brown et al. (1973) suggested that the data dsaggregaton wll reduce the level of multcollnearty. Gujarat (1995) suggested that ncreasng the sample szes wll reduce the degree of multcollnearty. However, n practce, these are not often feasble but the possblty cannot be overlooked. A smple way to handle ths problem s to drop one of the collnear varables. Johnston (197) stated that deletng a relevant varable may lead to specfcaton bas. Based estmaton technques such as prncpal component regresson (Massey, 1965), Sten estmator (Sten, 1956), rdge regresson (Hoerl and Kennard, 197), Lu estmator (Lu, 1993) had been suggested n lterature to handle ths problem. In ths study, rdge regresson estmator proposed by Hoerl and Kennard (197) s consdered whch requres the addton of a postve constant, k, s added to the dagonal elements of the matrx to llcondton the matrx so as to reduce multcollnearty whch n turn makes the mean squared error (MSE) for rdge regresson to be smaller than the MSE of. Dfferent estmators for k have been suggested by dfferent authors at dfferent perod of tmes. These nclude Hoerl and Kennard (197), Hoerl et al. (1975), McDonald and Galarneau (1975), Lawless and Wang (1976), Hockng et al. (1976), Dempster et al. (1977), Wchern and Churchll (1978), Gbbons (1981), Nordberg (198), Saleh and Kbra (1993), Haq and Kbra (1996), Sngh and Tracy (1999), Kbra (3), Khalaf and Shukur (5), Alkhamset al. (6), Alkhams and Shukur (8), Munz and Kbra (9), Dorugade and Kashd (1), Mansson et al. (1), Khalaf (13), Ghadhan and Mohamed (14), Dorugade (14), Lukman and Aynde (16), Adnan et al. (16) and Dorugade (16). Dorugade (16) modfed the Ordnary Rdge Regresson estmator and provded an estmator whch avods computng the rdge parameter, k. The modfed estmator s referred to as adjusted rdge parameter. It s most effcent when multcollnearty s severe. Ths study also provdes some adjusted estmators followng the dea of Dorugade (16). The performances of the proposed estmators wth some exstng ones were compared. Ths artcle s organzed as follows. Secton dscusses the lnear regresson model and ther estmators ncludng the proposed ones. Smulaton study s provded n Secton 3 and ts result dscussed n Secton 4. Fnally, a concludng remark s made n secton 5... MODEL AND ESTIMATORS Consder the multple lnear regresson model: y=xβ+ u (1) Where y s an n 1 vector of response varable, X s an n p full rank matrx of known regressors varables augmented wth a column of ones. β s p 1 vector of the unknown regresson coeffcents and u s the nx1 vector of error terms such that u~(,σ I ) and I s an nxn dentty matrx. The estmator of β s defned as: edtor@aeme.com

3 Some New Adjusted Rdge Estmators of Lnear Regresson Model β =(X X) X y () Assume that the response varable y s centered and the regressors X s are standardzed. Let and T be the matrces of egen values and egen vectors of X X respectvely such that X XT = = dagonal ( λ1, λ, λp), where λ1 represents the th egenvalue of X X and T = =Ip. The equvalent model for equaton (1) s y = Zα + u (3) Where Z = XT such that = and α =T β. The estmator of α s defned as: α = ( Z Z) -1 Z Y = -1 Z Y (4) The relatonshp between the estmator of β and α s gven as: β= Tα. (5) To crcumvent the problem of multcollnearty and mprove the estmator, Hoerl and Kennard (197) suggested the rdge estmator as an alternatve method of parameter estmaton by addng a basng parameter, k, to the dagonal elements of the X X matrx n equaton (). The Generalzed rdge regresson estmator (E) was suggested by them requre varyng rdge parameter to each regressors n the dagonal elements of X X matrx. Stephen and Chrstopher (11), among many others, clamed that the estmator yelds a smaller MSE when compared wth n the presence of multcollnearty. The E of α s defned by Dorugade (16) as: 1 α = ( I K( Λ + K) ) αˆ (6) Where K = dag(k1, k kp),k, = 1,,,p. Hence, E for s ˆ β = ˆ GR Tα GR The mean square error of E s λ k ˆ α σ (8) ) p p = 1 ( λ + k ) = 1 ( λ + k MSE ( ) = ˆ + E reduces to Ordnary Rdge Regresson Estmator (E) by addng a fxed rdge parameter to the dagonal elements of the X X matrx. That s when k1= k =kp = k and k. The mean square error of E becomes λ ˆ α σ (9) k) p p = 1 ( λ + k) = 1 ( λ + MSE (! ) = ˆ + k The MSE of becomes MSE of when k=. The MSE of s gven as: p 1 MSE ( "# ) = ˆ σ (1) λ = 1 Some of the well-known methods of estmatng the rdge parameter are presented as follows. Hoerl and Kennard (197) for the E proposed $ %&' = () * ' ) (11) They also suggested estmatng rdge parameter k by takng the maxmum (Fxed Maxmum) of +. Ths s provded as: (7) 84 edtor@aeme.com

4 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah $, -. %& = () ) (1)./(* ' ) The non-lnear functon of the rdge parameter k s a major drawback of the rdge regresson estmator (Lu, 1993; Dorugade, 16). Ths makes t very dffcult to choose a value for k even though dfferent authors have suggested dfferent technques of estmaton. Dorugade (16) suggested a modfcaton of the Ordnary Rdge Regresson estmator where calculatng the rdge parameter k can be avoded. The proposed estmator was obtaned by addng the dagonal elements of the correlaton coeffcent between X and Y. The adjusted rdge regresson estmator (ARRE) suggested by Dorugade (16) s gven as: 1 α 1 = ( I C( Λ + K) ) αˆ (13) Or 1 α 1 = ( Λ + C) Z Y (14) ˆ Tα AR 1 ( ). 5 dag Z Where C= ' Y The ARRE of s ˆ β = The MSE of ARRE s gven as: MSE( ˆ α ) = p ˆ σ λ + ( ˆ α c ) ( λ c ) = 1 + Whereαˆ, =1,, p s the th element of estmator of α and σ establshed that the MSE (α ) ˆ ) ( ˆ (15) (16) Y Y ˆ α Z Y =. It was n p MSE α f and only f ( λ + ) k ( + k) c.1. Proposed Adjusted Rdge Regresson Estmators Followng Dorugade (16), the followng estmators are proposed: λ. c α 13 = Λ + ) 1 ( C ) Z Y (17) Where C= ' 1/ k dag ( Z Y ) for =1,,3 8. The value of k + s defned as follows: k =, k =p, k 5 =n, k 6 =np, k 7 =p p, k 8 =n p, k 9 =(np) p, k : =(np) p+5 It should be noted that wth k =, the estmator becomes the adjusted rdge estmator proposed by Dorugade (16) and that the k ncreases as ncreases. Thus, C I n as k ; Ths s often the case for = 4, 5, 6, 7 and 8. More so, the addton of 5 to p n k : s a further attempt to force C8 to an dentty matrx. 3.. SIMULATION STUDY The performances of the proposed adjusted rdge estmators are compared wth adjusted rdge estmator proposed by Dorugade (16), E, E by Hoerland Kennard (197) and estmator va Monte Carlo study. Tme seres processor (TSP) software was used to wrte the programme for the smulatons study. The mean square error of the estmators was compared edtor@aeme.com

5 Some New Adjusted Rdge Estmators of Lnear Regresson Model at varyng degree of multcollnearty, sample szes and error varances as recently done by Dorugade (16). To generate the varyng degree of multcollnearty among the regresors, the procedure adopted by McDonald and Galarneau (1975), Wchern and Churchll (1978), Gbbons (1981) and Dorugade (16) was used. X ;3 =(1 ρ )? )Z ;3 +ρz ;A, t=1,, 3 n. =1,, p. (18) Where Z ;3 are ndependent standard pseudo-random numbers, ρ represents the correlaton between any two regressors taken as,,, 5, 9, 99 and 999; p s the number of regressors taken to be ether three (3) or seven (7). The dependent varable for the n observatons are determned usng the model Y + =β B +β X 3 +β X 3 + +β A X 3A +U + t=1,,,n ; (19) WhereU 3 ~N(,σ ). The true values of the parameter when p=3 are β B =14, β =5, β = and β 5 =6. When p=7, the values of β were β =.4, β =.1, β 5 =, β 6 =., β 7 =.5, β 8 =.3, β 9 =.53. Sample szes were vared between 1,, 3, 4, 5 and 1. Ten thousand smulatons are run for dfferent values of σ =.5, 1, 9, 5 and 1. The mean square error of the estmators at each replcaton was computed usng the followng equaton: p ˆ ( β ) MSE( ˆ) β = β = 1 Where the estmator βˆ provdes the th estmate of β; and β s the true value of the parameter prevously mentoned. The number of tmes at whch each estmator has the smallest mean square error, MSE (βˆ ), n ten thousand replcaton s counted. A sample of ths s provded n Table 1 and when n=1 and respectvely. Furthermore, for ease of results presentaton on the performance of the estmators, the followng classfcatons were done. The sample sze (n) was classfed nto small (1 and ), moderate (3, 4 and 5) and hgh (1). The multcollnearty level were classfed nto moderate (N= and ), hgh (N= and 5) and severe (N=9, 99 and 999). Also, the error varances were classfed nto low (O =.5 and 1), moderate (O =9 and 5) and hgh (O =1). The number of tmes each estmator has the hghest number of smallest MSE on the bass of the classfcatons are counted. Thus, the hgher the number the better the estmator. Moreover, each combnaton of classfcaton has ts expected number of counts. For nstance, the expected number of counts wth small sample (1 and ), moderate multcollnearty (N= and ) and low level of error varance (O =.5 and 1) s eght ( =8). 4.. RESULTS AND DISCUSSION The results from the smulaton study are presented pctorally n Fgure 1 to 1. From Fgure 1 to 1, t was observed that as the sample szes, level of autocorrelaton and standard error ncreases the performances of some estmators are affected. Moreover, AR8 and perform well and occasonally. The results of the hghest number of smallest MSE on the bass of the dfferent classfcaton s provded n Table 3. From Table 3, the generalzed rdge regresson () estmator performs consstently well when the multcollnearty level s moderate at the dfferent level of error varance. The proposed estmator, AR8, performs especally when the multcollnearty level s moderate and severe coupled wth both moderate and hgh level of varance. Irrespectve of the sample szes. The performance s not satsfactory when the error varance s small but the adjusted rdge estmator,, proposed by Dorugade () 84 edtor@aeme.com

6 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah (16) perform consstently well under ths condton. Ocassonally, the proposed estmator, AR, competes favourably wth especally when the number of regressors ncreased. and AR8 perform equally especally when the sample sze s low and there s hgh varance. It was also observed that AR7 and AR8 perform equally especally when the sample szes and the number of regressors ncreases. It was observed that ncreasng the multcollnearty level and error varances mproves the performance of adjusted rdge regresson estmator over the exstng ones. Table 1: Number of tmes each estmator has smallest MSE n ten thousand replcatons when n=1 P p=3 p=7 Estmator Q R AR AR AR AR AR AR AR AR AR AR AR edtor@aeme.com

7 Some New Adjusted Rdge Estmators of Lnear Regresson Model AR AR AR AR AR AR AR AR AR AR AR6 4 1 AR AR Table : Number of tmes each estmator has smallest MSE n ten thousand replcatons when n= P p=3 p=7 Estmator Q R AR edtor@aeme.com

8 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah AR6 7 7 AR AR AR AR AR AR AR AR AR AR AR AR AR AR AR edtor@aeme.com

9 Some New Adjusted Rdge Estmators of Lnear Regresson Model AR AR AR AR AR AR AR Table 3: Estmator and the number of tmes each has hghest number of smallest MSE based on the each classfcaton Q R Small Moderate Hgh Small Small sample sze Moderate Sample sze Hgh Sample sze p=3 Multcollnearty level Moderate Hgh Severe Moderate Hgh Severe Moderate Hgh Severe (4) (4) (3) (4) AR8(1) () AR8() (3) (1) () AR8() (1) (7) AR8(8) (1) AR8(3) () AR(4) AR8() (1) (1) (1) () AR8(1) (6) (6) (1) (11) AR8(6) (6) (7) AR(3) AR8() p=7 (6) (4) AR8() Moderate (4) AR8(4) AR8(8) AR8(1) (1) Hgh () AR8() AR8(4) AR8(6) (6) (1) () AR8 (1) (5) AR8 (1) (4) AR(3) AR8(5) (7) AR8(5) (5) AR8(1) (3) (13) AR(1) AR8(1) (4) () () AR8 (18) (4) (4) AR8(9) () () (6) AR(9) AR8(3) AR8(18) NOTE: Estmator wth the hghest number of counts s bolded () (1) AR8(1) (3) AR8(1) (1) () AR8(1) (4) AR8(9) () () () (4) AR8 (6) AR8 (3) () AR(4) AR6() AR8(4) AR8() AR6(1) edtor@aeme.com

10 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah Number of tmes each esmators has smallest MSE Sample Szes and Level of Autocorrelaton AR AR6 Fgure 1: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=3 and Q=S.U Number of tmes each estmators has the smallest MSE Sample szes and Level of Autocorrelaton AR AR6 AR7 AR8 Fgure : Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=3 and Q=V edtor@aeme.com

11 Fgure 4: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=3 Some New Adjusted Rdge Estmators of Lnear Regresson Model Number of tmes each estmators has smallest MSE Sample szes and Level of Autocorrelaton AR AR6 AR7 AR8 Fgure 3: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=3 and Q=W Number of tmes each estmators has smallest MSE Samples Szes and Level of Autocorrelaton AR AR6 AR7

12 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah Number of tmes each estmators has smallest MSE Sample szes and Level of Autocorrelaton AR Fgure 5: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=3 and Q=VS Number of tmes each estmator has smallest MSE Sample szes and Level of Autocorrelaton AR AR6 Fgure 6: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=7 and Q=S.U Number of tmes each estmators has smallest MSE Sample szes and Level of Autocorrelaton AR Fgure 7: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=7 and Q=V edtor@aeme.com

13 Some New Adjusted Rdge Estmators of Lnear Regresson Model Sample szes and Level of Autocorrelaton AR Fgure 8: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=7 and Q=W Number of tmes each estmators has smallest MSE Sample szes and Level of Autocorrelaton AR AR6 Fgure 9: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=7 and Q=U Axs Number of tmes each estmator has smallest MSE Sample szes and level of Autocorrelaton AR Fgure 1: Number of tmes each estmator has smallest MSE n ten thousand replcatons when p=7 and Q=VS 85 edtor@aeme.com

14 Kayode Aynde, Adewale F. Lukman, Samuel O. Olarenwaju and Omokova M. Attah 5.. CONCLUSION The proposed adjusted rdge estmator s superor to other exstng estmators especally when the multcollnearty level s severe and error varance s moderate or hgh provded the sample sze s small, moderate or hgh. Generalzed rdge regresson estmator performs well when there s moderate multcollnearty, moderate and hgh varances provded the sample sze s moderate or hgh. Ocassonally, the proposed compete favourably wth t. Adjusted rdge estmator by Dorugade (16) performs consstently well when the multcollnearty level s severe and the error varance s small provded the sample sze s small. Fnally, under the condton that the multcollnearty level s severe, the rdge regresson estmator that nvolves estmatng the rdge parameter, k, can be avoded and replaced wth the adjusted rdge regresson estmator. REFERENCES [1] Adnan, K., Yasn, A. and Asr, G. (16). Some new modfcatons of Kbra s and Dorugade s methods: An applcaton to Turksh GDP data. Journal of the Assocaton of Arab Unverstes for Basc and Appled Scences,, [] Alkhams, M., Khalaf, G. and Shukur, G. (6). Some modfcatons for choosng rdge parameters. Communcatons n Statstcs - Theory and Methods, 35(11), 5-. [3] Alkhams, M. and Shukur, G. (8). Developng rdge parameters for SUR model.communcatons n Statstcs - Theory and Methods, 37(4), [4] Brown, W.G., Fard, N. and Joe, B. S. (1973). The Oregon Bg Game Resources: An Economc Evaluaton. Oregon Agrcultural Experment Staton Specal Report #379, Corvalls. [5] Dempster, A.P., Schatzoff, M. and Wermuth, N. (1977). A smulaton study of alternatves to Ordnary Least Squares. Journal of the Amercan Statstcal Assocaton, 7, [6] Dorugade, A. V. (14). New rdge parameters for rdge regresson. Journal of the Assocaton of Arab Unverstes for Basc and Appled Scences, 15, [7] Dorugade, A. V. (16). Adjusted rdge estmator and comparson wth Kbra s method n lnear Regresson. Journal of the Assocaton of Arab Unverstes for Basc and Appled Scences, 1, [8] Dorugade, A. V. and Kashd, D. N. (1). Alternatve method for choosng rdge parameter for regresson. Internatonal Journal of Appled Mathematcal Scences, 4(9), [9] Gbbons, D. G. (1981). A smulaton study of some rdge estmators. Journal of the Amercan Statstcal Assocaton, 76, [1] Ghadban, K. and Mohamed, I. (14). Rdge Regresson and Ill-Condtonng. Journal of Modern Appled Statstcal Methods, 13() [11] Gujarat, D. N. ( 1995). Basc Econometrcs, McGraw-Hll, New York. [1] Haq, M. S. and Kbra, B. M. G. (1996). A shrnkage estmator for the restrcted lnear regresson model: Rdge Regresson Approach. Journal of Appled Statstcal Scence,3(4), [13] Hockng, R., Speed, F. M. and Lynn, M. J. (1976). A class of based estmators n lnear regresson. Technometrcs, 18 (4), [14] Hoerl, A.E. and Kennard, R.W. (197). Rdge regresson: based estmaton for nonorthogonal problems. Technometrcs, 1, [15] Hoerl, A. E., Kennard, R. W. and Baldwn, K. F. (1975). Rdge regresson: Some smulaton. Communcatons n Statstcs, 4 (), edtor@aeme.com

15 Some New Adjusted Rdge Estmators of Lnear Regresson Model [16] Johnston, J. (197). Econometrc Methods, nd Ed. McGraw-Hll Book Co., Inc., New York. [17] Koutsoyanns A. (3). Theory of Econometrcs. Palgrave publshers, nd Edton. [18] Khalaf, G. and Shukur, G. (5). Choosng rdge parameters for regresson problems.communcatons n Statstcs - Theory and Methods, 34, [19] Khalaf, G. (13). A Comparson between Based and Unbased Estmators. Journal of Modern Appled Statstcal Methods, 1(), [] Kbra, B. M. G. (3). Performance of some new rdge regresson estmators.communcatons n Statstcs - Smulaton and Computaton, 3, [1] Lawless, J. F. and Wang, P. (1976). A smulaton study of rdge and other regresson estmators. Communcatons n Statstcs A, 5, [] Lu, K. (1993). A new class of based estmate n lnear regresson. Communcatons n Statstcs, (), [3] Lukman, A. F. and Aynde, K. (16). Some Improved Classfcaton-BasedRdge Parameter of Hoerl and Kennard Estmaton Technques. İSTATİSTİK, JOURNAL OF THE TURKISH STATISTICAL ASSOCIATION, 9(3), [4] Mansson, K., Shukur, G. and Kbra, B. M. G. (1). A smulaton study of some rdge regresson estmators under dfferent dstrbutonal assumptons.communcatons n Statstcs - Smulatons and Computatons, 39(8), [5] Massey, W. F. (1965). Prncpal Components Regresson n exploratory statstcal research. J. Am. Stat. Assoc., 6, [6] McDonald, G. C. and Galarneau, D. I. (1975). A Monte Carlo evaluaton of some rdgetype estmators. Journal of the Amercan Statstcal Assocaton, 7, [7] Munz, G. and Kbra, B. M. G. (9). On some rdge regresson estmators: An emprcal comparson. Communcatons n Statstcs-Smulaton and Computaton, 38, [8] Nordberg, L. (198). A procedure for determnaton of a good rdge parameter n lnear regresson. Communcatons n Statstcs A, 11, [9] Saleh, A. K. Md. E. and Kbra, B. M. G. (1993). Performances of some new prelmnary test rdge regresson estmators and ther propertes. Communcatons n Statstcs - Theory and Methods,, [3] Sngh, S. and Tracy, D. S. (1999). Rdge-regresson usng scrambled responses. Metrka, 41(), [31] Sten, C. (1956). Inadmssblty of the usual estmator for the Mean of a multvarte normaldstrbuton. Thrd edton Berkeley;Calforna. [3] Stephen, G. W. and Crstopher, J. P. (1). Generalzed rdge regresson and a generalzaton of the Cp statstc. J. Appl. Stat. 8 (7), [33] Wchern, D. and Churchll, G. (1978). A Comparson of Rdge Estmators. Technometrcs,, edtor@aeme.com

Monte Carlo Study of Some Classification-Based Ridge Parameter Estimators

Monte Carlo Study of Some Classification-Based Ridge Parameter Estimators Journal of Modern Aled Statstcal Volume 6 Issue Artcle 4 5--07 Monte Carlo Study of Some Classfcaton-Based Rdge Parameter Estmators Adewale Folaranm Lukman Ladoke Akntola Unversty of Technology, wale3005@yahoo.com

More information

On Comparison of Some Ridge Parameters in Ridge Regression

On Comparison of Some Ridge Parameters in Ridge Regression Sr Lankan Journal of Aled Statstcs, Vol (15-1) On Comarson of Some Rdge Parameters n Rdge Regresson Ashok V. Dorugade Y C Mahavdyalaya Halkarn, Tal-Chandgad, Kolhaur, Maharashtra, Inda Corresondng Author:

More information

Liu-type Negative Binomial Regression: A Comparison of Recent Estimators and Applications

Liu-type Negative Binomial Regression: A Comparison of Recent Estimators and Applications Lu-type Negatve Bnomal Regresson: A Comparson of Recent Estmators and Applcatons Yasn Asar Department of Mathematcs-Computer Scences, Necmettn Erbaan Unversty, Konya 4090, Turey, yasar@onya.edu.tr, yasnasar@hotmal.com

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

On the Restricted Almost Unbiased Ridge Estimator in Logistic Regression

On the Restricted Almost Unbiased Ridge Estimator in Logistic Regression Open Journal of Statstcs, 06, 6, 076-084 http://www.scrp.org/journal/ojs ISSN Onlne: 6-798 ISSN Prnt: 6-78X On the Restrcted Almost Unbased Rdge Estmator n Logstc Regresson Nagarajah Varathan,, Pushpaanthe

More information

New Liu Estimators for the Poisson Regression Model: Method and Application

New Liu Estimators for the Poisson Regression Model: Method and Application New Lu Estmators for the Posson Regresson Moel: Metho an Applcaton By Krstofer Månsson B. M. Golam Kbra, Pär Sölaner an Ghaz Shukur,3 Department of Economcs, Fnance an Statstcs, Jönköpng Unversty Jönköpng,

More information

Some Robust Ridge Regression for handling Multicollinearity and Outlier

Some Robust Ridge Regression for handling Multicollinearity and Outlier Internatonal Journal of Scences: Basc and Appled Research (IJSBAR) ISSN 307-4531 (Prnt & Onlne) http://gssrr.org/ndex.php?journal=journalofbascandappled ----------------------------------------------------------------------------------------------------------------

More information

Stochastic Restricted Maximum Likelihood Estimator in Logistic Regression Model

Stochastic Restricted Maximum Likelihood Estimator in Logistic Regression Model Open Journal of Statstcs, 05, 5, 837-85 Publshed Onlne December 05 n ScRes. http://www.scrp.org/journal/ojs http://dx.do.org/0.436/ojs.05.5708 Stochastc Restrcted Maxmum Lkelhood Estmator n Logstc Regresson

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Ridge Regression Estimators with the Problem. of Multicollinearity

Ridge Regression Estimators with the Problem. of Multicollinearity Appled Mathematcal Scences, Vol. 7, 2013, no. 50, 2469-2480 HIKARI Ltd, www.m-hkar.com Rdge Regresson Estmators wth the Problem of Multcollnearty Mae M. Kamel Statstc Department, Faculty of Commerce Tanta

More information

Robust Logistic Ridge Regression Estimator in the Presence of High Leverage Multicollinear Observations

Robust Logistic Ridge Regression Estimator in the Presence of High Leverage Multicollinear Observations Mathematcal and Computatonal Methods n Scence and Engneerng Robust Logstc Rdge Regresson Estmator n the Presence of Hgh Leverage Multcollnear Observatons SYAIBA BALQISH ARIFFIN 1 AND HABSHAH MIDI 1, Faculty

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10) I. Defnton and Problems Econ7 Appled Econometrcs Topc 9: Heteroskedastcty (Studenmund, Chapter ) We now relax another classcal assumpton. Ths s a problem that arses often wth cross sectons of ndvduals,

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Statistical Evaluation of WATFLOOD

Statistical Evaluation of WATFLOOD tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth

More information

A Comparative Study for Estimation Parameters in Panel Data Model

A Comparative Study for Estimation Parameters in Panel Data Model A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and

More information

Chapter 15 - Multiple Regression

Chapter 15 - Multiple Regression Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Testing for seasonal unit roots in heterogeneous panels

Testing for seasonal unit roots in heterogeneous panels Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School

More information

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate

More information

On Liu Estimators for the Logit Regression Model

On Liu Estimators for the Logit Regression Model CESIS Electronc Workng Paper Seres Paper No. 59 On Lu Estmators for the Logt Regresson Moel Krstofer Månsson B. M. Golam Kbra October 011 The Royal Insttute of technology Centre of Excellence for Scence

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random

More information

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact Multcollnearty multcollnearty Ragnar Frsch (934 perfect exact collnearty multcollnearty K exact λ λ λ K K x+ x+ + x 0 0.. λ, λ, λk 0 0.. x perfect ntercorrelated λ λ λ x+ x+ + KxK + v 0 0.. v 3 y β + β

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung

More information

Improvement in Estimating the Population Mean Using Exponential Estimator in Simple Random Sampling

Improvement in Estimating the Population Mean Using Exponential Estimator in Simple Random Sampling Bulletn of Statstcs & Economcs Autumn 009; Volume 3; Number A09; Bull. Stat. Econ. ISSN 0973-70; Copyrght 009 by BSE CESER Improvement n Estmatng the Populaton Mean Usng Eponental Estmator n Smple Random

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

An (almost) unbiased estimator for the S-Gini index

An (almost) unbiased estimator for the S-Gini index An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Economics 130. Lecture 4 Simple Linear Regression Continued

Economics 130. Lecture 4 Simple Linear Regression Continued Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Exponential Type Product Estimator for Finite Population Mean with Information on Auxiliary Attribute

Exponential Type Product Estimator for Finite Population Mean with Information on Auxiliary Attribute Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 193-9466 Vol. 10, Issue 1 (June 015), pp. 106-113 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) Exponental Tpe Product Estmator

More information

Chapter 15 Student Lecture Notes 15-1

Chapter 15 Student Lecture Notes 15-1 Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

A Monte Carlo Study for Swamy s Estimate of Random Coefficient Panel Data Model

A Monte Carlo Study for Swamy s Estimate of Random Coefficient Panel Data Model A Monte Carlo Study for Swamy s Estmate of Random Coeffcent Panel Data Model Aman Mousa, Ahmed H. Youssef and Mohamed R. Abonazel Department of Appled Statstcs and Econometrcs, Instute of Statstcal Studes

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

10-701/ Machine Learning, Fall 2005 Homework 3

10-701/ Machine Learning, Fall 2005 Homework 3 10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

III. Econometric Methodology Regression Analysis

III. Econometric Methodology Regression Analysis Page Econ07 Appled Econometrcs Topc : An Overvew of Regresson Analyss (Studenmund, Chapter ) I. The Nature and Scope of Econometrcs. Lot s of defntons of econometrcs. Nobel Prze Commttee Paul Samuelson,

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students. PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton

More information

Chapter 3. Two-Variable Regression Model: The Problem of Estimation

Chapter 3. Two-Variable Regression Model: The Problem of Estimation Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that

More information

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes 25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

Improved Class of Ratio Estimators for Finite Population Variance

Improved Class of Ratio Estimators for Finite Population Variance Global Journal of Scence Fronter Research: F Mathematcs and Decson Scences Volume 6 Issue Verson.0 Year 06 Tpe : Double lnd Peer Revewed Internatonal Research Journal Publsher: Global Journals Inc. (USA)

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables

More information

REGRESSION ANALYSIS II- MULTICOLLINEARITY

REGRESSION ANALYSIS II- MULTICOLLINEARITY REGRESSION ANALYSIS II- MULTICOLLINEARITY QUESTION 1 Departments of Open Unversty of Cyprus A and B consst of na = 35 and nb = 30 students respectvely. The students of department A acheved an average test

More information

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Association for the Chi-square Test

Association for the Chi-square Test Assocaton for the Ch-square Test Davd J Olve Southern Illnos Unversty February 8, 2012 Abstract A problem wth measures of assocaton for the ch-square test s that the measures depend on the number of observatons

More information

Research Article On the Performance of the Measure for Diagnosing Multiple High Leverage Collinearity-Reducing Observations

Research Article On the Performance of the Measure for Diagnosing Multiple High Leverage Collinearity-Reducing Observations Hndaw Publshng Corporaton Mathematcal Problems n Engneerng Volume 212, Artcle ID 53167, 16 pages do:1.1155/212/53167 Research Artcle On the Performance of the Measure for Dagnosng Multple Hgh Leverage

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9 Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,

More information

Comparison among Some Remedial Procedures for Solving. Multicollinearity Problem in Regression Model Using Simulation. Ashraf Noureddin Dawod Ababneh

Comparison among Some Remedial Procedures for Solving. Multicollinearity Problem in Regression Model Using Simulation. Ashraf Noureddin Dawod Ababneh Comparson among Some Remedal Procedures for Solvng Multcollnearty Problem n Regresson Model Usng Smulaton By Ashraf Noureddn Dawod Ababneh Supervsor Prof.Fars M. Al-Athar hs hess was submtted n Partal

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

ERROR RATES STABILITY OF THE HOMOSCEDASTIC DISCRIMINANT FUNCTION

ERROR RATES STABILITY OF THE HOMOSCEDASTIC DISCRIMINANT FUNCTION ISSN - 77-0593 UNAAB 00 Journal of Natural Scences, Engneerng and Technology ERROR RATES STABILITY OF THE HOMOSCEDASTIC DISCRIMINANT FUNCTION A. ADEBANJI, S. NOKOE AND O. IYANIWURA 3 *Department of Mathematcs,

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Modeling and Simulation NETW 707

Modeling and Simulation NETW 707 Modelng and Smulaton NETW 707 Lecture 5 Tests for Random Numbers Course Instructor: Dr.-Ing. Magge Mashaly magge.ezzat@guc.edu.eg C3.220 1 Propertes of Random Numbers Random Number Generators (RNGs) must

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

January Examinations 2015

January Examinations 2015 24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

International Journal of Engineering Research and Modern Education (IJERME) Impact Factor: 7.018, ISSN (Online): (

International Journal of Engineering Research and Modern Education (IJERME) Impact Factor: 7.018, ISSN (Online): ( CONSTRUCTION AND SELECTION OF CHAIN SAMPLING PLAN WITH ZERO INFLATED POISSON DISTRIBUTION A. Palansamy* & M. Latha** * Research Scholar, Department of Statstcs, Government Arts College, Udumalpet, Tamlnadu

More information

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model

More information

Power of Some Tests of Heteroscedasticity: Application to Cobb-Douglas and Exponential Production Function

Power of Some Tests of Heteroscedasticity: Application to Cobb-Douglas and Exponential Production Function Internatonal Journal of Statstcs and Applcatons 07, 7(6): 3-35 DOI: 0.593/j.statstcs.070706.06 Power of Some Tests of Heteroscedastcty: Applcaton to Cobb-Douglas and Exponental Producton Functon Iyabode

More information

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Rockefeller College University at Albany

Rockefeller College University at Albany Rockefeller College Unverst at Alban PAD 705 Handout: Maxmum Lkelhood Estmaton Orgnal b Davd A. Wse John F. Kenned School of Government, Harvard Unverst Modfcatons b R. Karl Rethemeer Up to ths pont n

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3. Outlne 3. Multple Regresson Analyss: Estmaton I. Motvaton II. Mechancs and Interpretaton of OLS Read Wooldrdge (013), Chapter 3. III. Expected Values of the OLS IV. Varances of the OLS V. The Gauss Markov

More information

Assignment 5. Simulation for Logistics. Monti, N.E. Yunita, T.

Assignment 5. Simulation for Logistics. Monti, N.E. Yunita, T. Assgnment 5 Smulaton for Logstcs Mont, N.E. Yunta, T. November 26, 2007 1. Smulaton Desgn The frst objectve of ths assgnment s to derve a 90% two-sded Confdence Interval (CI) for the average watng tme

More information

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces

More information

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =

More information

Influence Diagnostics on Competing Risks Using Cox s Model with Censored Data. Jalan Gombak, 53100, Kuala Lumpur, Malaysia.

Influence Diagnostics on Competing Risks Using Cox s Model with Censored Data. Jalan Gombak, 53100, Kuala Lumpur, Malaysia. Proceedngs of the 8th WSEAS Internatonal Conference on APPLIED MAHEMAICS, enerfe, Span, December 16-18, 5 (pp14-138) Influence Dagnostcs on Competng Rsks Usng Cox s Model wth Censored Data F. A. M. Elfak

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

Question 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%.

Question 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%. UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PGT Examnaton 017-18 FINANCIAL ECONOMETRICS ECO-7009A Tme allowed: HOURS Answer ALL FOUR questons. Queston 1 carres a weght of 5%; queston carres

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

POWER AND SIZE OF NORMAL DISTRIBUTION AND ITS APPLICATIONS

POWER AND SIZE OF NORMAL DISTRIBUTION AND ITS APPLICATIONS Jurnal Ilmah Matematka dan Penddkan Matematka (JMP) Vol. 9 No., Desember 07, hal. -6 ISSN (Cetak) : 085-456; ISSN (Onlne) : 550-04; https://jmpunsoed.com/ POWER AND SIZE OF NORMAL DISTRIBION AND ITS APPLICATIONS

More information

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston

More information