PRE-TEST ESTIMATORS OF THE INTERCEPT FOR A REGRESSION MODEL WITH MULTIVARIATE STUDENT-t ERRORS
|
|
- Augustus Morris
- 5 years ago
- Views:
Transcription
1 PRE-TEST ESTIMATORS OF THE INTERCEPT FOR A REGRESSION MODEL WITH MULTIVARIATE STUDENT-t ERRORS Shahjaha Kha Departmet of Mathematics & Computig Uiversity of Souther Queeslad Toowoomba, Australia ad A.K.Md. Ehsaes Saleh Departmet of Mathematics & Statistics Carleto Uiversity Ottawa, Caada ABSTRACT I presece of a ucertai prior iformatio about the slope parameter, the estimatio of the itercept of a simple regressio model with a multivariate Studett error distributio is ivestigated. The urestricted, restricted ad prelimiary test maximum likelihood estimators are defied. The expressios for the bias ad the mea square error of the three estimators are provided ad the relative efficiecies are aalysed. A maximi criterio is established, ad graphs ad tables are costructed for differet umber of degrees of freedom D.F. as well as sample sizes. These tables of relative efficiecies ca be used to determie a proper choice of the sigificace level of the prelimiary test which i tur determies the choice of the estimator. Key Words ad Phrases: Regressio model, ucertai prior iformatio, prelimiary test estimator, multivariate t-distributio, iverted Gamma ad o-cetral F distributios, icomplete Beta distributio, urestricted ad restricted maximum likelihood estimators, mea square errors, relative efficiecy, maximi rule. AMS 1991 Subject Classificatio: Primary 6F30 ad Secodary 6J05. 1
2 1. INTRODUCTION Ofte i liear regressio aalysis, the distributio of the errors is assumed to be ormal, ad idepedet. I this paper a broader assumptio is made, amely the errors are assumed to follow a family of Studet-t distributios. Thus the joit distributio of the error compoets associated with the resposes is a multivariate Studet-t. The assumptio of a t-model violates two basic assumptios of the ormal model, amely, the ormal distributio ad the idepedece of the sample resposes as uder the t-model the sample resposes are ucorrelated but ot idepedet. The problem at had falls i the realm of the statistical iferece problem with ucertai prior iformatio. I the process of solvig this kid of problems the ucertai prior iformatio that appears i the form of a costrait is treated as the uisace parameter ad removed by usig Fisher s Recipe of testig it out. Such a problem was first addressed by Bacroft 1944 ad the resultig estimator has bee kow i the literature as the prelimiary test PT estimator. Sice the the PT estimator has bee studied by a host of authors, otably, Mosteller 1948, Kitagawa 1963, Ha ad Bacroft 1968, Saleh ad Se 1978, Saleh ad Se 1984, Saleh ad Ha 1990, ad more recetly, Saleh ad Kibria 1993 ad Wa 1994 to metio a few, uder the ormal theory. The icreasig criticism of the ormal theory with its ofte urealistic assumptios of idepedece ad ideticity as well as beig o-robust has led researchers to fid a better alterative amog the class of symmetrical distributios. I may cases, the theoretical advatages ad mathematical coveieces are egligible compared to the price paid i terms of loss of efficiecy ad precisio uder the ormal theory. The cocer was voiced by Fisher 1956, p.133 i the followig words, It is a oteworthy peculiarity of iductive iferece that comparatively slight differeces i the mathematical specificatio of a problem may have logically importat effects o the ifereces possible. Not surprisigly Fisher 1960, p.37 aalysed Darwi s data uder ormal theory ad later p.46 assumig a symmetrical distributio. Fraser ad Fick 1975 aalysed the same data usig a family of Studet-t distributios. Obviously, the family of t-distributios represets a spectrum of symmetric desities ragig from the ormal as the degrees of freedom parameter, ν 0, dow to the Cauchy whe ν 0 = 1, ad to eve thicker tailed sub-cauchy distributios for 0 < ν 0 < 1. Zeller 1976 revealed the fact that depedet but ucorrelated resposes ca be aalysed by a Studet-t model. He discussed the differeces as well as the similarities of the results i both classical ad Bayesia cotext for the ormal ad Studet-t based models.
3 Fraser 1979, p.37 emphasised that the ormal distributio is extremely short tailed ad thus urealistic as a sole distributio for variatio. He also demostrated the robustess of the Studet-t family as opposed to the ormal distributio based o empirical studies ad aalyses. His fidigs suggest that a Studet-t model based aalysis works reasoably well both for the ormal ad the Studet-t model resposes, but the same does ot hold for the commoly ormal based aalysis cf. Fraser, 1979, p.41. I justifyig the appropriateess ad essece of the Studet-t model Prucha ad Kalajia 1984 have poited out that the ormal model based aalysis i is geerally very sesitive to deviatios from its assumptio, ii places too much weight o outliers, iii fails to utilize sample iformatio beyod the first two momets, ad iv appeals to a cetral limit theorem at most approximately, ot exactly, ormal. I this paper, we cosider a liear regressio model, y j = θ + βx j + e j ; j = 1,,, 1.1 where y j is the j th value of the depedet variable correspodig to x j, a give fixed value of the idepedet variable; e j is the error compoet associated with the respose y j ; ad θ ad β are the itercept ad slope parameters respectively of the model. It is assumed that the vector of the errors e = e 1, e,, e is distributed accordig to the multivariate Studet-t law with Ee = o ad Eee = σ e I where σ 1 e is the commo variace of e j s, j = 1,,, ad I is the idetity matrix of order. The class of Studet-t distributios with varyig degrees of freedom ca be expressed as a variace mixture of ormal distributios as follows: fe; σ, ν 0 = 0 f N efτdτ 1. where f N e is the p.d.f. of e whe e N0, τ I ; ad fτ is the p.d.f. of a Iverted Gamma IG distributio with scale parameter σ ad degrees of freedom parameter ν 0, that is, τ IGσ, ν 0. Therefore, we obtia the joit desity of e 1, e,, e as with hν 0 = ν ν0 0 Γ ν 0 + fe; σ, ν 0 = hν 0 σ [ ν σ π Γ ν 0 ad < θ <. e j j=1 ] ν , as the ormalizig costat, σ e = ν 0 ν 0 σ > 0, ν 0 3, It is well kow that the above desity fuctio approaches to the ormal form as ν 0, ad whe ν 0 = 1, it becomes Cauchy. Furthermore, the margial 3
4 distributio of each compoet of e is uivariate Studet-t. Also, for smaller values of ν 0, this distributio has thicker tails tha that uder ormal distributio. Our choice of the Studet-t family thus icludes a class of symmetrical distributios with variable tail thickess. Ulike the ormal distributio, it is capable of hadlig outliers as well as depedet but ucorrelated resposes. Further support for the applicatio of the Studet-t model may be foud i Haq ad Kha 1990, ad Kha ad Haq I this paper, we cosider the problem of estimatig the itercept parameter, θ based o the observed sample observatios y 1, y,, y as specified i the model 1.1 whe a ucertai prior iformatio i the form of a ull hypothesis H 0 : β = β 0 is available. We defie three differet estimators, amely, urestricted, shrikage restricted, ad shrikage prelimiary test estimators of θ ad study their properties based o both the ubiasedess ad mea square error m.s.e. criterio. I the presece of a ucertai prior iformatio the usual procedure is to pre-test H 0 before the actual estimatio of the parameter. The problem of estimatio as well as the samplig properties of the estimators for the liear regressio model whe a ucertai prior iformatio exists have bee widely ivestigated i the literature [see for istace, Judge ad Bock 1978, Griffiths et al. 199 ad the refereces there i] uder the ormal theory. As discussed above, there is a icreasig evidece i the literature that i may cases the set of data may have bee geerated by processes whose distributios have higher kurtosis, that is, heavier tails tha the ormal distributios. Giles 1991 cited a umber of refereces from the commodity ad fiacial markets study where the uderlyig distributios are symmetrical but ot ormal. Several of those authors revealed the fact that i may real life data the Studet-t distributio model fits far better tha the ormal based model. For example, see Praetz 197, ad Blattberg ad Goedes The implicatios of these applied studies resulted i the use of the Studet-t distributio of the error terms i the regressio model by may authors. Recetly, statistical aalyses of the liear regressio model based o the Studet-t distributio have bee pursued by Giles 1991, Kha ad Haq 1994, ad Kha ad Saleh 1995 to metio a few. I the ext sectio we defie three differet estimators of θ. Some useful theorems for the computatio of the m.s.e. of the estimators are give i sectio 3. The expressios for the bias ad the m.s.e. are obtaied i sectio 4, while the relative efficiecy for the estimators are derived i sectio 5. Comparisos amog the estimators ad recommedatios are made i sectio 6. Some cocludig remarks are icluded i sectio 7. 4
5 . Estimators of the Itercept I this sectio, our objective is to defie various estimators of θ based o the sample observatios y 1, y,, y havig the joit desity as give i 1.3 whe it is suspected that the ull hypothesis H 0 : β = β 0 may hold, but ot sure. It is well kow cf. Zeller, 1976 that the maximum likelihood estimators m.l.e. of β, θ ad σ for the simple regressio model with errors havig multivariate Studet-t distributio are j=1 β = x j xy j ȳ j=1 x, j x θ =ȳ β x, σ =s = 1 ad y j θ βx j j=1.1 respectively, where x = 1 j=1 x j ad ȳ = 1 j=1 y j. The estimator θ, as defied above, is a fuctio of the maximum likelihood estimator of β ad will be called the urestricted estimator of θ. If the ull hypothesis is true, the the atural estimator of β is β 0. However, sice we are ot sure about the teability of the ull hypothesis, we make use of the available sample iformatio i the estimatio of θ. Thus takig a covex combiatio of β 0 ad β we defie the followig shrikage restricted sr estimator of β as ˆβ sr = cβ c β, 0 c 1. where we call c as the degree of cofidece i the ull hypothesis. The estimator ˆβ sr is kow as the shrikage restricted estimator of β. Thus for every possible value of c the estimator i. will produce a differet estimator. Obviously, our estimator of β would be 1 β 0 + β if c = 1. Clearly, the shrikage restricted estimator i. is a compromise betwee the two extreme estimators, oe based o the ull hypothesis, totally igorig the sample iformatio, ad the other based o the sample observatios aloe, disregardig the ucertai prior iformatio i the form of the ull hypothesis. Thus we defie shrikage restricted estimator of θ as sr = ȳ [cβ c β ] x..3 I applicatios, usually the ull hypothesis is suspicious. I such a case we follow the Fisher s Recipe to remove the suspicio by testig H 0 out through a appropriate test statistic. Usig Zeller s 1976 idea we cosider the test statistic F = s x β β 0 s e.4 5
6 to test H 0 : β = β 0, where Uder H 0, m =. s x = s e = x j x ad j=1 { y j ȳ β }.5. x j x j=1 F i.4 follows a cetral F -distributio with 1, m D.F. where Thus, for the estimatio of θ whe H 0 : β = β 0 is suspicious, we carry out a F -test ad choose θ sr if H 0 is ot teable ad if H 0 is accepted at a prescribed level of sigificace, say, α 0 < α < 1. The, we have the shrikage prelimiary test spt estimator of θ as follows: spt sr = IF < F α + θ IF F α = θ sr θ IF < F α = θ + c β β 0 xif < F α.6 where I is the idicator fuctio which assumes values either 0 or 1, F α is the 1 α th quatile of a cetral F -distributio with 1, m D.F. If c = 1, we obtai the ordiary prelimiary test pt estimator: pt = θ + β β 0 xif < F α..7 I the foregoig sectio, we have defied three estimators of θ, amely, θ, the urestricted m.l.e.; sr spt, the shrikage restricted m.l.e.; ad, the shrikage prelimiary test m.l.e. To determie the power fuctio of the test statistic uder the alterative hypothesis, H 1 : β β 0 we have some prelimiaries i sectio Some Prelimiaries Theorem 3.1. Suppose Y 1, Y,, Y are idetically ad idepedetly distributed as Nθ, τ with θ = EY j, ad τ follows a Iverted Gamma IG distributio with parameters ν 0, σ give by { }{ fτ ν 0, σ ν0 σ = Γ ν 0 The the joit distributio of Y 1, Y,, Y fy; θ, σ, ν 0 = hν 0 σ [ ν σ 6 } ν 0 τ ν 0+1 e ν 0 σ τ. 3.1 is give by j=1 y j θ ] ν+. 3.
7 Proof: Completig the followig itegratio we get πτ e 1 τ j=1 y j θ fτ ν 0, σdτ 3.3 Theorem 3.. The distributio of g = m F, where F is give by.4 uder H 1 : β β 0 follows the distributio defied by the followig desity fg = { Γr + ν 0 ν 0 r ν 0 Γr + 1Γ ν 0 1 r 0 Γr + Γr Γ gr g 1 + ν 0 } r+ 1 ν 0+r 3.4 where = δ σ i which δ = β β 0 ad σ = ν 0 ν 0 σ. Theorem 3.3. The distributio fuctio d.f. of g is give by G 1 1,m F 0; = { Γr + ν 0 ν 0 Γr + 1Γ ν 0 1 r 0 I u r + 1 ; m } 1 + ν 0 ν 0 r 1 ν 0+r 3.5 where I u r + 1 ; m is the icomplete Beta fuctio with u = F 1,mα m+f 1,m α ad F 0 is the value of the F 1,m variable such that 1 α 100 percet area uder the cetral F 1,m distributio curve is to the left of F 0 for give values of α ad m. The proof follows from the straight forward expectatio of the o-cetral F -distributio with respect to the Iverted Gamma distributio with parameters ν 0, σ. Now observe that lim P F F 0 = G 1,m F 0 ; 3.6 ν 0 which is the distributio fuctio d.f. of a o-cetral F -distributio with 1, m D.F. ad o-cetrality parameter = δ σ { Γr + ν 0 lim ν 0 Γr + 1Γ ν 0 1 ad lim ν 0 σ = σ. sice 1 + ν 0 ν 0 r 1 ν 0+r } = r e Γr Therefore, the results obtaied i this paper will remai valid for the ormal based model as a special case whe ν 0. I the ext sectio, the expressios for the bias ad the mea square error of the three estimators, defied i the previous sectio, are provided. 7
8 4. Bias ad M.S.E. of Estimators The bias ad the m.s.e. of the urestricted estimator of θ are B 1 θ = E{ θ θ} = 0, ad M 1 θ = E{ θ θ} = ν 0 ν 0 σ 1 + x s x 4.1 respectively. Similarly, for the shrikage restricted estimator of θ the expressios for the bias ad the m.s.e. are B sr = E{ sr θ} = cδ, ad M sr = E{ sr θ} = ν 0 ν 0 σ[ c x s x + c x ] 4. respectively, where = ν δ 0 i which δ = β β 0. ν 0 σ Fially, the expressios of the bias ad the m.s.e. of the shrikage prelimiary test spt estimator of θ are B 3 spt = E{ spt θ} = cδg 1 3,m l α;, ad M 3 spt = E{ spt θ} = ν 0 ν 0 σ[ 1 + x x + c s x s x x c c s x G 3,m l α; { G 1 3,m l α; cg 1 5,m l α; }] 4.3 respectively, where l α = 1 3 F 1,mα, l α = 1 5 F 1,mα, ad G 1 3,m l α; = ν 0 i which u 1 = 3l α m+3l α, G 1 5,m l α; = ν 0 i which u = 5l α m+5l α, ad G 3,m l α; = ν 0 4 { Γr + ν 0 r 0 Γr + 1Γ ν 0 1 I u1 r + 3 ; m } { Γr + ν 0 r 0 Γr + 1Γ ν 0 1 I u r + 5 ; m } { Γr 1 + ν 0 r 0 Γr + 1Γ ν 0 I u1 r + 3 ; m } 1 + ν 0 ν 0 r 1 + ν 0 1 ν 0+r ν 0 r 1 + ν 0 1 ν 0+r ν 0 r 1 ν 0+r
9 i which u 1 = 3l α m+3l α. With the results obtaied i this sectio, we provide the relative efficiecies of the estimators i the ext sectio. The relative efficiecy R.E. of expressio 5. Relative Efficiecy Expressios sr with respect to θ is give by the followig E 1 c, = 1 + [1 x + 1 c x + c x ] 1, 0 c 1, 5.1 s x ad that of spt with respect to θ by where φ = 1 + x s x 1 [ c x c E c, α, = s x x s x s x [ 1 + φ ] 1 5. { G 1 3,m l α; G 1 5,m l α; } ] c cg 3,m l α; sr Fially, the expressio for the relative efficiecy R.E. of is foud to be spt with respect to E 3 c, α, = [1 + 1 c x + c x ] 1 + x where φ is the same as defied i 5.3. s x s x 1 [ 1 + φ ] Based o the relative efficiecy of the estimators, comparisos ad recommedatios are made i the followig subsectio. 6. Comparisos ad Recommedatios First, we preset the domiace picture of the three estimators uder the ull hypothesis i the followig theorem. Theorem 6.1. Uder the H 0 : β = β 0 the domiace picture of the estimators is sr spt θ. 6.1 Proof: Cosider the m.s.e. differeces 9
10 i ii iii M 1 M = ν 0 ν 0 σ x [ s 1 1 c ] > 0 6. x that is, sr is better tha θ uder H 0. M 1 M 3 = ν 0 ν 0 σ x [ ] s c cg 3,m l α; 0 > x that is, spt is better tha θ uder H 0. that is, sr Compariso M 3 M = ν 0 ν 0 σ x [ { }] s c c 1 G 3,m l α; 0 > x is better tha Betwee sr spt uder H 0. ad θ First, ote that for a give set of x -values, both x ad s x are kow ad fixed. Cosider the relative efficiecy expressio E 1 c,. For a fixed c, it is a decreasig fuctio of. At = 0, E 1 c, 0 = 1 + [1 x + 1 c x ] 1, 0 c 1, 6.5 s x which becomes 1 whe c = 0 ad 1 + x s x s x [ 1 + 1, E 1 c, 0 for c 0. However, for 0 c c better tha θ. For c = 1, c c tha θ. If c = 1, the rage of rage tha the ordiary PT estimator, pt θ performs better. Compariso Betwee spt x s x = 3, thus for 0 3, sr is 0 to 1. Thus ad θ sr ] 1 whe c = 1. As, sr performs performs better has a wider performace for small c values. Outside this rage Oce agai, cosider the R.E. expressio, E c, α, as give i 5.. For a fixed c, it is a fuctio of α,. The fuctio has its maximum at = 0 with the value Ec, α, 0 = E give by [ E = 1 c c 1 + x s x 1G 3,m l α; 0] 1 > The fuctio E c, α, decreases as icreases crossig the lie E c, α, = 1 to a maximum E 0 c, α, at 0 =, the icreases towards 1 as. Now, for = 0 ad α varyig, we have max E c, α, 0 = E c, 0, 0 = [1 c c] α 1 10
11 The value of E c, α, 0 decreases as α icreases. O the other had, whe α = 0 ad varies, the the curves E c, 0, ad E c, 1, = 1 itersect at = c c. For geeral α, the fuctios E c, α 1, ad E c, α, will always itersect i the iterval 0 c c. The value of at the itersectio decreases as α icreases. Therefore, for two differet α, say α 1 ad α, the fuctios E c, α 1, ad E c, α, will ever itersect above E c, 1, = 1. Some graphs are show to illustrate the pheomeo. I order to choose a estimator with maximum relative efficiecy, we adopt the followig rule: If it is kow that [0, c sr c ], the estimator is chose sice E c, α, is largest i this iterval. However, is geerally ukow ad i which case there is o way of choosig a uiformly best estimator. Thus we preassig a prescribed R.E.-value, say, E 0 which is tolerable. The cosider the set A = {α E c, α, E 0 } ad try to choose a estimator which maximises E c, α, over all α A ad all. That is, we solve for α such that max α A mi E c, α, = E Hece we have a maximi rule for the optimum choice of the level of sigificace for the shrikage prelimiary test estimator, spt. Tables of R.E., both maximum E ad miimum E 0, ad the value of at which the miimum occurs 0 for a give α are reported at the ed of this sectio. Discuss a example from the table with ν 0 = 3, 6, 9, 1, CONCLUDING REMARKS I this paper, we have studied the properties of the urestricted, shrikage restricted ad prelimiary test estimators of the itercept parameter of the liear regressio model with a class of Studet-t errors. Sice the Studet-t model with ν 0 D.F. ecompasses a class of symmetrical distributios which icludes the ormal as ν 0 as well as other wider tailed distributios so the proposed estimators i this paper are robust i this class of regressio models. I this study, we fid the behaviour of the estimators similar to those i the case of the ormal model. The differeces i the relative efficiecies of the estimators are show by the graphs for varied values of ν 0. The decisio rule for selectig a optimal α, the level of sigificace is also show usig tabular values of maximum E ad miimum E 0 relative efficiecies for a rage of ν 0 -values. It is expected that the results obtaied i this paper will be preferable to ormal theory results by the practitioers as it icludes the ormal based results as a special case ad may others i the 11
12 family of elliptically symmetric distributios. Moreover, the results obtaied uder the Studet-t model are valid for the ormal model but ot vice-versa. REFERENCES Bacroft, T.A O biases i estimatio due to the use of prelimiary tests of sigificace. A. Math. Statist., 15, Blattberg, R.C. ad Goedes, N.J A compariso of the stable ad Studet distributio as statistical model for stock prices. Joural of Busiess, 47, Fisher, R.A Statistical Methods Scietific Iferece. Oliver ad Boyd, Lodo. Fisher, R.A The Desig of Experimets. 7 th ed. Hafer, New York. Fraser, D.A.S Iferece ad Liear Models. McGrow Hill, New York. Fraser D.A.S. ad Fick, G.H Necessary aalysis ad its implemetatio. Proc. Symposium o Statistics ad Related Topics, A.K.Md.E. Saleh ed., Carleto Uiversity, Caada, Giles, J.A Pre-testig for liear restrictios i a regressio model with spherically symmetric disturbaces. Joural of Ecoometrics, 50, Griffiths, W.E., Lutkepohl, H., ad Bock, M.E Readigs i Ecoometric Theory ad Practice: a volume i hoor of George Judge. ed. North- Hollad, New York. Ha, C.P. ad Bacroft, T.A O poolig meas whe variace is ukow. Jou. Amer. Statist. Assoc., 63, Haq, M.S. ad Kha, S Predictio distributio for liear model with Multivariate Studet-t errors distributio. Commuicatios i Statistics, Theory & Methods, 19, Judge, G.G. ad Bock, M.E Statistical Implicatios of Pre-test ad Stei-rule Estimators i Ecoometrics. North-Hollad, Amsterdam. Kha, S. ad Haq, M.S Predictive iferece for the multiliear model with errors havig multivariate t-distributio ad first order auto-correlatio structure. Sakhya, B, 56, Kha, S. ad Saleh, A.K.Md.E Prelimiary test estimators of the mea for samplig from some Studet-t populatios. Faculty of Scieces Wrokig Paper Series, Uiversity of Souther Queeslad, Australia. Kitagawa, T, Estimatio after prelimiary test of sigificace. Uiversity of Califoria Publicatios i Statistics, Vol. B, Lobato, I. N Testig That a Depedet Process Is Ucorrelated, Joural of the America Statistical Associatio, Volume 96455, Mosteller, F O poolig data. Jou. Amer. Statist. Assoc., 43, Praetz, P.D The distributio of share price chages. Joural of Busiess, 45, Prucha, I.R. ad Kelejia, H.H The structure of simultaeous equatio estimators: A geeralizatio towards o-ormal disturbaces. C, 5,
13 Saleh, A.K.Md.E. ad Se, P.K No-parametric estimatio of locatio parameter after a prelimiary test o regressio. A. Statist., 6, Saleh, A.K.Md.E. ad Kibria, B.M.G Performace of some ew prelimiary test ridge regressio estimators ad their properties. Commuicatios i Statistics, Theory & Methods,, Saleh, A.K.Md.E. ad Ha, C.P Shrikage estimatio i regressio aalysis. Estadistica, 4, Wa, A.T.K The samplig preformace of iequality restricted ad pre-test estimators i a mis-specified liear model. Australia Joural of Statistics, 363, Zeller, A Bayesia ad o-bayesia aalysis of the regressio model with multivariate Studet-t error term. Jou. Amer. Statist. Assoc. 60,
1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationEDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR
Joural of Statistical Research 26, Vol. 37, No. 2, pp. 43-55 Bagladesh ISSN 256-422 X EDGEORTH SIZE CORRECTED, AND TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Zahirul Hoque Departmet of Statistics
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationBayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function
Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationTMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.
Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx
More informationSample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.
ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationGG313 GEOLOGICAL DATA ANALYSIS
GG313 GEOLOGICAL DATA ANALYSIS 1 Testig Hypothesis GG313 GEOLOGICAL DATA ANALYSIS LECTURE NOTES PAUL WESSEL SECTION TESTING OF HYPOTHESES Much of statistics is cocered with testig hypothesis agaist data
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationRank tests and regression rank scores tests in measurement error models
Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationFinal Examination Solutions 17/6/2010
The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:
More informationLecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS
Lecture 5: Parametric Hypothesis Testig: Comparig Meas GENOME 560, Sprig 2016 Doug Fowler, GS (dfowler@uw.edu) 1 Review from last week What is a cofidece iterval? 2 Review from last week What is a cofidece
More informationThe Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution
Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters
More informationComparing Two Populations. Topic 15 - Two Sample Inference I. Comparing Two Means. Comparing Two Pop Means. Background Reading
Topic 15 - Two Sample Iferece I STAT 511 Professor Bruce Craig Comparig Two Populatios Research ofte ivolves the compariso of two or more samples from differet populatios Graphical summaries provide visual
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationFinal Review. Fall 2013 Prof. Yao Xie, H. Milton Stewart School of Industrial Systems & Engineering Georgia Tech
Fial Review Fall 2013 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech 1 Radom samplig model radom samples populatio radom samples: x 1,..., x
More informationMatrix Representation of Data in Experiment
Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationClass 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700
Class 23 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 2017 by D.B. Rowe 1 Ageda: Recap Chapter 9.1 Lecture Chapter 9.2 Review Exam 6 Problem Solvig Sessio. 2
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationLecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)
Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +
More informationRegression, Inference, and Model Building
Regressio, Iferece, ad Model Buildig Scatter Plots ad Correlatio Correlatio coefficiet, r -1 r 1 If r is positive, the the scatter plot has a positive slope ad variables are said to have a positive relatioship
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More informationStatistics 20: Final Exam Solutions Summer Session 2007
1. 20 poits Testig for Diabetes. Statistics 20: Fial Exam Solutios Summer Sessio 2007 (a) 3 poits Give estimates for the sesitivity of Test I ad of Test II. Solutio: 156 patiets out of total 223 patiets
More informationSection 14. Simple linear regression.
Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo
More informationTrimmed Mean as an Adaptive Robust Estimator of a Location Parameter for Weibull Distribution
World Academy of Sciece Egieerig ad echology Iteratioal Joural of Mathematical ad Computatioal Scieces Vol: No:6 008 rimmed Mea as a Adaptive Robust Estimator of a Locatio Parameter for Weibull Distributio
More informationMaximum likelihood estimation from record-breaking data for the generalized Pareto distribution
METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio
More informationMBACATÓLICA. Quantitative Methods. Faculdade de Ciências Económicas e Empresariais UNIVERSIDADE CATÓLICA PORTUGUESA 9. SAMPLING DISTRIBUTIONS
MBACATÓLICA Quatitative Methods Miguel Gouveia Mauel Leite Moteiro Faculdade de Ciêcias Ecoómicas e Empresariais UNIVERSIDADE CATÓLICA PORTUGUESA 9. SAMPLING DISTRIBUTIONS MBACatólica 006/07 Métodos Quatitativos
More informationChapter 13, Part A Analysis of Variance and Experimental Design
Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationEstimation of Gumbel Parameters under Ranked Set Sampling
Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com
More informationTABLES AND FORMULAS FOR MOORE Basic Practice of Statistics
TABLES AND FORMULAS FOR MOORE Basic Practice of Statistics Explorig Data: Distributios Look for overall patter (shape, ceter, spread) ad deviatios (outliers). Mea (use a calculator): x = x 1 + x 2 + +
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science APRIL/MAY 2009 EXAMINATIONS ECO220Y1Y PART 1 OF 2 SOLUTIONS
PART of UNIVERSITY OF TORONTO Faculty of Arts ad Sciece APRIL/MAY 009 EAMINATIONS ECO0YY PART OF () The sample media is greater tha the sample mea whe there is. (B) () A radom variable is ormally distributed
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More informationA Risk Comparison of Ordinary Least Squares vs Ridge Regression
Joural of Machie Learig Research 14 (2013) 1505-1511 Submitted 5/12; Revised 3/13; Published 6/13 A Risk Compariso of Ordiary Least Squares vs Ridge Regressio Paramveer S. Dhillo Departmet of Computer
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationST 305: Exam 3 ( ) = P(A)P(B A) ( ) = P(A) + P(B) ( ) = 1 P( A) ( ) = P(A) P(B) σ X 2 = σ a+bx. σ ˆp. σ X +Y. σ X Y. σ X. σ Y. σ n.
ST 305: Exam 3 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad the basic
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationTABLES AND FORMULAS FOR MOORE Basic Practice of Statistics
TABLES AND FORMULAS FOR MOORE Basic Practice of Statistics Explorig Data: Distributios Look for overall patter (shape, ceter, spread) ad deviatios (outliers). Mea (use a calculator): x = x 1 + x 2 + +
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationCorrelation. Two variables: Which test? Relationship Between Two Numerical Variables. Two variables: Which test? Contingency table Grouped bar graph
Correlatio Y Two variables: Which test? X Explaatory variable Respose variable Categorical Numerical Categorical Cotigecy table Cotigecy Logistic Grouped bar graph aalysis regressio Mosaic plot Numerical
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationCommon Large/Small Sample Tests 1/55
Commo Large/Small Sample Tests 1/55 Test of Hypothesis for the Mea (σ Kow) Covert sample result ( x) to a z value Hypothesis Tests for µ Cosider the test H :μ = μ H 1 :μ > μ σ Kow (Assume the populatio
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationn n i=1 Often we also need to estimate the variance. Below are three estimators each of which is optimal in some sense: n 1 i=1 k=1 i=1 k=1 i=1 k=1
MATH88T Maria Camero Cotets Basic cocepts of statistics Estimators, estimates ad samplig distributios 2 Ordiary least squares estimate 3 3 Maximum lielihood estimator 3 4 Bayesia estimatio Refereces 9
More informationof the matrix is =-85, so it is not positive definite. Thus, the first
BOSTON COLLEGE Departmet of Ecoomics EC771: Ecoometrics Sprig 4 Prof. Baum, Ms. Uysal Solutio Key for Problem Set 1 1. Are the followig quadratic forms positive for all values of x? (a) y = x 1 8x 1 x
More informationRegression, Part I. A) Correlation describes the relationship between two variables, where neither is independent or a predictor.
Regressio, Part I I. Differece from correlatio. II. Basic idea: A) Correlatio describes the relatioship betwee two variables, where either is idepedet or a predictor. - I correlatio, it would be irrelevat
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationDepartment of Mathematics
Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationCHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS. 8.1 Random Sampling. 8.2 Some Important Statistics
CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS 8.1 Radom Samplig The basic idea of the statistical iferece is that we are allowed to draw ifereces or coclusios about a populatio based
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationAgreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times
Sigificace level vs. cofidece level Agreemet of CI ad HT Lecture 13 - Tests of Proportios Sta102 / BME102 Coli Rudel October 15, 2014 Cofidece itervals ad hypothesis tests (almost) always agree, as log
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationGUIDELINES ON REPRESENTATIVE SAMPLING
DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationBIOS 4110: Introduction to Biostatistics. Breheny. Lab #9
BIOS 4110: Itroductio to Biostatistics Brehey Lab #9 The Cetral Limit Theorem is very importat i the realm of statistics, ad today's lab will explore the applicatio of it i both categorical ad cotiuous
More informationLinear Algebra and its Applications
Liear Algebra ad its Applicatios 437 () 675 69 Cotets lists available at SciVerse ScieceDirect Liear Algebra ad its Applicatios joural homepage: www.elsevier.com/locate/laa Simple regressio i view of elliptical
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationSimple Linear Regression
Simple Liear Regressio 1. Model ad Parameter Estimatio (a) Suppose our data cosist of a collectio of pairs (x i, y i ), where x i is a observed value of variable X ad y i is the correspodig observatio
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationIt should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.
Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig
More informationModeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy
Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral
More information