Preliminary test and Bayes Estimation of a Location Parameter Under Blinex Loss
|
|
- Joseph Charles
- 6 years ago
- Views:
Transcription
1 Prelimiary test ad Bayes Estimatio of a Locatio Parameter Uder Bliex Loss J. COETSEE, A. BEKKER, AND S. MILLARD Departmet of Statistics, Uiversity of Pretoria, Pretoria, South Africa I this article, the prelimiary test estimator is cosidered uder the BLINEX loss fuc-tio. The problem uder cosideratio is the estimatio of the locatio parameter from a ormal distributio. The risk uder the ull hypothesis for the prelimiary test esti-mator, the exact risk fuctio for restricted maximum likelihood ad approximated risk fuctio for the urestricted maximum likelihood estimator, are derived uder BLINEX loss ad the differet risk structures are compared to oe aother both aalytically ad computatioally. As a motivatio o the use of BLINEX rather tha LINEX, the risk for the prelimiary test estimator uder BLINEX loss is compared to the risk of the pre-limiary test estimator uder LINEX loss ad it is show that the LINEX expected loss is higher tha BLINEX expected loss. Furthermore, two feasible Bayes estimators are derived uder BLINEX loss, ad a feasible Bayes prelimiary test estimator is defied ad compared to the classical prelimiary test estimator. Keywords Prelimiary test estimator; LINEX loss fuctio; BLINEX loss fuctio; Feasible Bayes estimator; Feasible Bayes prelimiary test estimator. Mathematics Subject Classificatio 6F15; 6F Itroductio I this article, the performace of the prelimiary test estimator PTE), restricted maximum likelihood estimator RMLE), ad urestricted maximum likelihood estimator UMLE) are all cosidered uder the BLINEX loss fuctio ad the risk fuctios are compared to oe aother i order to determie which estimator performs better compared to the rest. At the ed of this article, all three estimators metioed above are cosidered uder both the BLINEX ad LINEX loss fuctio i order to determie which of the two loss fuctios performs the best i the sese of havig smaller risk. A umber of articles have already bee published o the prelimiary test estimators usig differet proposed loss structures by Bacroft 1944, 1964), Giles ad Giles 1996), Giles 00), Ohtai et al. 1997), Kibria ad Saleh 1993, 006), Saleh 006), ad Arashi et al. 008), to ame a few. Furthermore, two feasible Bayes estimators are derived uder BLINEX loss ad a feasible Address correspodece to J. Coetsee, Departmet of Statistics, Faculty of Natural ad Agricultural Scieces, Uiversity of Pretoria, Pretoria, South Africa; judy.coetsee@up.ac.za 1
2 Bayes prelimiary test estimator FBPTE) is defied ad it s performace is compared to the performace of the classical prelimiary test estimator. I a article by We ad Levy 001), a ew parametric family of bouded ad asymmetric loss fuctios, called the BLINEX loss fuctio, was developed ad the mathematical properties of the BLINEX loss fuctio were discussed. I Parsia ad Kirmai 00), Porosiński ad Kamińska 009), Arashi 010), ad Arashi ad Tabatabaey 010), the properties of the LINEX fuctio, which was first proposed by Varia 1975), was preseted together with results of estimatio uder LINEX loss for a umber of probability distributios. The BLINEX fuctio is the bouded alterative to the LINEX loss fuctio, therefore it does t have the same limitatios as the LINEX loss fuctio, for example, the LINEX loss fuctio exhibits a huge icrease i expected loss which limits the applicatio of the loss fuctio i practice. The BLINEX fuctio is therefore both bouded ad asymmetric, which allowed the same flexibility as exhibited by the LINEX loss fuctio but it also has the added advatage of beig bouded. The relatioship betwee the BLINEX ad LINEX loss fuctios will be cosidered ext. Assume that τ is a estimator of the ukow parameter θ the the LINEX loss fuctio is defied as follows: L τ,θ) = d e aτ θ) a τ θ) 1 ), where a is the shape parameter ad d is the scale parameter. The BLINEX loss fuctio is derived from the LINEX loss fuctio; let L τ,θ) = d e aτ θ) a τ θ) 1 ) 1 + λd e aτ θ) a τ θ) 1 ) = λ 1 + b e aτ θ) a τ θ) 1 ) 1) with b = λd. The BLINEX loss fuctio depeds o the selected values of three parameters, amely a, b, ad λ, where each of these values plays a sigificat role i the shape of the loss fuctio. The boudig parameter, λ, specifies the rage of the loss which is bouded betwee 0 ad 1. The sig of the costat a will determie the directio of error pealisatio, λ where egative values will pealise egative errors ad a positive value will pealise positive errors. This costat also iflueces the flatess of the curve, for small positive values of a, the curve will be flatter ad large positive values will result i a steeper curve. The costat b is a asymmetry parameter ad it ca be see that for smaller values of b the loss fuctio is more asymmetric ad for larger values of b the fuctio is more symmetric. The ifluece of the differet parameters as discussed above is depicted i Figure 1 for differet parameter values. The problem uder study is to cosider the estimatio of a locatio parameter μ from a ormal populatio with ukow variace i order to evaluate the fiite-sample properties of the prelimiary test estimator i terms of it s risk. Suppose that X 1, X,...,X is a radom sample from Nμ, σ ) where both μ R ad σ R + are ukow. The outcome of a prelimiary test o μ will determie which of the estimators will be used to estimate the populatio mea μ. The urestricted maximum likelihood estimator, X = X i, will be regarded as the estimator of μ whe othig is a priori kow about the parameter μ, whereas the restricted maximum likelihood estimator will be chose whe
3 Figure 1. BLINEX loss fuctio 1 with i) λ = 0.8,a = b = 1, ii) λ = b = 1,a = 5, iii)... λ = b = 1,a = 5, ad iv).-.λ = a = 1,b = 5. some costraits are imposed to the model as a ull hypothesis. The stadard t test for the populatio mea will be the appropriate test sice the scale parameter σ is ukow. Now cosider the case where we are dealig with the followig hypotheses: { H0 : μ = μ 0 H A : μ μ 0. The it is well kow that the test statistic is give as t = X μ 0 s t 1) with X Nμ, σ ). Alteratively, we ca use the followig statistic t = X μ 0) = F F 1, 1). I more geeral terms, the samplig distributio of the test statistic will be the o cetral F variate, F F 1, 1,λ ) with λ = δ kow as the ocetrality parameter σ ad the estimatio error is defied as δ = μ 0 μ. It ca easily be see that whe δ = 0, the samplig distributio uder the ull hypothesis will be the cetral F 1, 1, 0) distributio. Based o this proposal the urestricted maximum likelihood estimator UMLE) is give by μ 1 = X ad the restricted maximum likelihood estimator RMLE) is equal to μ 0. The the prelimiary test estimator of μ is defied as where ad I R F ) = 1 I NR F ) = 1 μ p = I R F ) μ 1 + I NR F ) μ 0 whe the ull hypothesis is rejected = 0 otherwise whe the ull hypothesis is ot rejected = 0 otherwise. The ull hypothesis will ot be rejected whe F c α, where c α is a critical value defied as F α,1, 1,λ =0, ad α is the level of sigificace. s 3
4 The outlie of this article is as follows. I Sec., the risk fuctio of the RMLE, UMLE ad PTE are derived uder BLINEX loss. These differet risk fuctios will be computatioally compared. I Sec. 3, two feasible Bayes estimators are derived uder BLINEX loss. A feasible Bayes prelimiary test estimator FBPTE) is the defied ad the risk fuctio of the PTE is compared to that of the FBPTE. Sectio 4 is a discussio of the results obtaied i this article ad illustratios are provided for the motivatio to use BLINEX loss rather tha LINEX loss fuctios.. Risk Fuctios.1 Risk Fuctio of RMLE The risk fuctio of RMLE is defied ad followed by a illustratio of how the risk fuctio behaves for differet choices of the parameters i the fuctio. The risk fuctio of the RMLE is defied as follows: 1 1 R μ 0 ) = E 1 λ 1 + b e aδ aδ 1 ) = λ 1 + b e aδ aδ 1 ) with δ = μ 0 μ. I the case where δ = 0, Rμ 0 ) = 0. By examiig the risk fuctio it ca be see that whe both a ad δ are egative values or whe both a ad δ are positive, with δ either tedig to or, the risk of RMLE, Rμ 0 )) teds to 1 λ. Whe δ teds to zero, the term beaδ aδ 1) teds to zero ad therefore Rμ 0 ) teds to 0.. Risk Fuctio of UMLE By defiitio, the risk fuctio of UMLE ca be calculated as below: 1 1 R μ 1 ) = 1 λ 1 + b e aμ 1 μ) a μ 1 μ) 1 p μ 1 ) dμ 1, ) where pμ 1 ) is the desity of N μ, σ ). Therefore, by applyig the biomial expasio to 1 Z) 1 where Z = baμ 1 μ) e aμ 1 μ) + 1 R μ 1 ) = 1 λ 1 λ ) 1 πσ e μ 1 μ) σ ) 1 z dμ 1. The risk fuctio of UMLE ca be expaded to: = b e a σ 1 + a b σ e a σ 1 + b e a σ e a σ 1 λ λ λ 4
5 + 3a b 3 σ λ + 3b3 λ e a σ + e a σ e a σ e a σ a σ ) 1 + 6a b 3 σ λ e a σ e a σ + b3 e 9a σ ) λ The risk fuctio of the UMLE is ot a fuctio of the estimatio error, δ, ad is therefore also costat with regard to the o cetrality parameter λ...1 Mote Carlo Simulatios of Risk of UMLE. The risk fuctio of UMLE was also evaluated as a fuctio of λ ad it was foud that the risk fuctio is a decreasig fuctio of both ad λ. Table 1 gives the simulatio results where the fuctio was evaluated for differet values of a,b,σ, ad ad usig p = 1000 iteratios. The results i the table just cofirm some of the expected characteristics of the risk fuctio, amely that the risk of UMLE is a decreasig fuctio of both λ ad, butthe risk is a icreasig fuctio of the variace for a specific choice of parameter..3 Risk of PTE I this sectio the ull risk risk uder the ull hypothesis) of the prelimiary test estimator is derived uder BLINEX loss. The followig lemma is due to Judge ad Bock 1978) ad work doe by Clarke 1986). Lemma.1. Let w be a o cetral chi-square variate with g degrees of freedom ad o cetrality parameter θ, letφ ), be ay real-valued fuctio ad let be ay real value such that > g, the Ew φw)) = e θ θ m Ɣ 1 g + + m) m! Ɣ 1 g + m) E φ χg++m) ). m=0 Theorem.1. Igorig the terms of order 3, the risk fuctio of the prelimiary test estimator usig the BLINEX loss fuctio uder H 0 is give by Rμ p ) = ab σ ) 1 λ 1 + e λ λ m Ɣ 1 + m) eaδ ) m! Ɣ m)p F 1 <cα + 3b a r λ r! r=1 e λ λ i i! i=0 ) σ a b λ ) r σ π m=0 π Ɣ ) r+1 + δ r P F <c α r Ɣ r j + i) Ɣ i) P F 3 <cα ) Ɣ ) 3 + δp F <c α 1 σ δ j 1 j) δ j ) r j ) σ r j) 5
6 Table 1 Risk of UMLE for specific choices of a,b,σ, ad λ = 1 a = 1, b = 0.1,λ= 1 a = 0.1, b = 1,λ= 1 a = 0.1, b = 0.1,λ= 1 Sample size σ = 1 σ = σ = 5 σ = 1 σ = σ = 5 σ = 1 σ = σ = 5 = = = = =
7 e λ λ k k=0 k! b a) r λ r! r r=1 δ j ) r j Ɣ 1 j + k) Ɣ k) P F 4 <cα ) r σ Ɣ ) r+1 ) σ π r j) i=0 P F 3 <cα ) + O Z 3) + δ r P F <c α e λ λ i i! Ɣ r j + i) Ɣ i) with F 1 = 1)χ +m,λ ) +m)χ 1),F = 1)χ 1,,λ ),F χ 1) 3 = 1)χ 1+r j+i,λ ) 1+r j+i)χ 1) ad F 4 = 1)χ j+k,λ ). j+k)χ 1) Proof. By applyig the biomial expasio for Z = baμ p μ) e aμp μ) + 1 the risk fuctio is give by Rμ p ) = ELμ p,μ) 4) 1 λ E Z) + E Z ) + O Z 3) where a r E μ p μ ) r E Z) = b. r! r= Usig the fact that μp μ ) r = μ1 μ) r I R F ) δ r I NR F ) = μ 1 μ) r + δ r μ 1 μ) r I NR F ) for r = 1,, 3,... r = μ 1 μ) r + δ r δ j ) ) r μ 1 μ 0 ) r j I NR F ) j r = μ 1 μ) r + δ r δ j ) ) r σ χ1,λ r j) ) I NR F ), j where χ1,λ ) is a o cetral Chi-squared variate with 1 degree of freedom ad a o cetrality parameter λ = δ. σ Thus, E μ p μ ) r = E μ1 μ) r r + δ r E I NR F ) δ j ) ) r σ r j) j E I NR F ) χ1,λ ) r j) ). 7
8 Usig Lemma.1, we have: E I NR F ) χ1,λ ) r j) ) = r δ j ) r j ) σ r j) i=0 e λ λ i Ɣ r j + i) Ɣ i) P F 3 <cα i! E Z) = b r= a r E μ 1 μ) r + δ r P F <cα r! e λ λ i i=0 i! r δ j ) r j Ɣ r j + i) Ɣ i) P F 3 <cα ). Cosider the followig expressios see Zeller, 1971, pp ): We fially get EZ) = b E μ 1 μ) r = σ ) r ) Ɣ r + 1 π E μ 1 μ) r 1 = 0 for r = 1,, 3,... r= a r r! e λ λ i i=0 Furthermore, we have Sice i! ) r σ π Ɣ ) r+1 + δ r P F <c α for r = 1,, 3,... r δ j ) r j ) σ ) σ r j) r j) Ɣ r j + i) Ɣ i) P F 3 <cα ). 5) E Z ) = a be μ p μ ) + abe μp μ ) μp abe μ ) e aμ p μ) E e aμ p μ) + be e aμ p μ) + b. μp μ ) = μ 1 μ) I R F ) + μ 0 μ) I NR F ) = μ 1 μ) + δ μ 1 μ) I NR F ) = μ 1 μ) + μ 1 μ 0 ) I NR F ) σ ) 1 χ ) 1 = μ 1 μ) 1,λ I NR F ) 8
9 ad uder H 0 we fid μp E μ ) e aμ p μ) σ χ = E μ 1 μ) E 1,λ σ ) 1 χ = E 1,λ σ ) 1 χ = e aμ0 μ) E 1,λ σ ) 1 m=0 = e aδ) e λ λ m m! otherwise We the fid E Z ) uder H 0 : E Z ) ) σ = a b π ) 1 E μp μ ) e aμ p μ) = 0. Ɣ ) 3 + δp F <cα ) 1 σ δ j ) 1 j e λ λ k k! k=0 m=0 ) 1 I NR F ) e aμ p μ) ) 1 I NR F ) e aμ 1 μ)i R F )+aμ 0 μ)i NR F ) ) 1 I NR F ) Ɣ 1 + m) Ɣ m)p F 1 <cα, Ɣ 1 j + k) Ɣ k) P F 4 <cα σ ) 1 e λ λ m Ɣ 1 + m) ab m! Ɣ 1 m=0 1 + m)p F 1 <cα + ab e aδ) σ ) 1 e λ λ m Ɣ 1 + m) m! Ɣ m)p F 1 <cα b r=1 a r r! ) r σ i=0 π σ r j) e λ λ i i! + b r=1 a) r r! σ ) r Ɣ ) r+1 π σ r j) e λ λ i i! i=0 + δ r P F <c α Ɣ r j + i) P 1 + i) Ɣ ) r+1 Ɣ 1 + δ r P F <c α r δ j ) ) r j ) F 3 <cα r δ j ) ) r j Ɣ r j + i) Ɣ i) P F 3 <cα ). 6) Substitutig 5) ad 6) ito 4) the result follows. 9
10 .4 Compariso Results The risk of UMLE ad PTE are aalytically compared to oe aother ad result is give i the followig theorem. Theorem.. The PTE performs better tha the UMLE i the sese of havig smaller risk if the followig iequality holds: δ 1 1 a l b E 1 1 x μ1 + ae μ p μ ) + 1 E e P F >c) /P F <c). aμ 1 μ)i RF Proof. It is eough to show that Rμ p ) Rμ 1 ). Therefore, we should have E1 1 x μp E1 1 x μ1., where x μp = 1 + be aμp μ) aμ p μ) 1 ad x μ1 = 1 + be aμ1 μ) aμ 1 μ) 1, kowig that E1 1 x μ1 is ot a fuctio of δ. Applyig the iequality, 1 1 x 1, x>0to the LHS of the above expressio it is x sufficiet to prove that Ex μp 1 E1 1 x μ1. Simplifyig the relevat term it yields E e aμ p μ) 1 b E 1 1 x μ1 + ae μ p μ ) + 1. Settig 1 b E1 1 x μ1 + aeμ p μ) + 1 = Q we the have E e aμ p μ) Q. 7) The LHS of the above iquality ca be writte as E e aμ p μ) = E e aμ 1 μ)i RF e aδi NRF. 8) By applyig the Cauchy-Schwarz iequality ad usig 7) ad 8), we obtai E e aμ 1 μ)i RF e aδi NRF E e aμ 1 μ)i RF E e aδi NRF. The, it is eough to show that E e aμ 1 μ)i RF E e aδi NRF Q. From the fact that E e aμ 1 μ)i RF > 0, we have E e aδi NRF Q E. 9) e aμ 1 μ)i RF However, the LHS of the above iequality ca be writte as E e aδi NRF aδ) k = E I NR F k! k=0 aδ) k = P F >c) + P F <c) k! k=0 = P F >c) + P F <c) e aδ 10) 10
11 Figure. a = b = λ = 1,σ = 1,= 10. By makig use of the expressio i 9) ad 10) we have P F >c) + P F <c) e aδ Q E e aμ 1 μ)i RF. By simplifyig ad takig logs o both sides of the iequality the result follows. The risk of RMLE, UMLE, ad PTE calculated uder BLINEX loss are computatioally compared to oe aother i order to determie the performace of the estimators relative to oe aother. The sketches see Figs. -10) i this sectio will be discussed i two ways, first by keepig σ costat ad allowig the sample size,, to icrease ad secodly by keepig costat ad allowig σ to icrease. Figure 3. a = b = λ = 1,σ =,=
12 Figure 4. a = b = λ = 1,σ = 5,= 10. For the case where σ = 1, it ca be see that as the sample size icreases for this choice of σ, the risk of PTE teds towards the risk of UMLE as δ ±. It is well kow that X UMLE) is the most efficiet estimator as the sample size icreases, sice Var X ) = σ. It is clear that as the sample size icreases the Var X ) will ted to zero. Therefore as the sample size icreases, PTE becomes just as efficiet as the UMLE. Similar results are obtaied for differet values of σ. Whe σ icreases for a specific sample size, it ca be see that i the iterval ear the origi, the domiatio iterval of PTE relative to the UMLE becomes larger. Therefore, whe workig with a specific sample size ad if the variace of the sample is relatively high, the PTE is a more efficiet estimator compared to the UMLE. Figure 5. a = b = λ = 1,σ = 1,= 30. 1
13 Figure 6. a = b = λ = 1,σ =,= 30. Figure 7. a = b = λ = 1,σ = 5,= 30. Figure 8. a = b = λ = 1,σ = 1,=
14 Figure 9. a = b = λ = 1,σ =,= Bayesia Estimatio uder the BLINEX Loss Fuctio 3.1 Feasible Bayes Estimator The Bayes estimator uder BLINEX loss is derived i this sectio ad due to the complex ature of BLINEX loss fuctio it was ecessary to make use of alterative methods i order to propose feasible estimators. Suppose that X 1, X,..., X is a sample from Nμ, σ ) where μ R ad σ R + is assumed to be kow. For the case of σ ukow, oe may look at the work of Arashi 010), the results obtaied i his paper are very complex. It is wellkow that the cojugate prior for the ukow parameter μ is N μ,σ ) ad the posterior of μ x is N μ,σ ) where μ = μ 1σ +μ σ )) ad σ = σ σ. σ +σ σ +σ Figure 10. a = b = λ = 1,σ = 5,=
15 To derive the Bayes estimator, the expected loss is equal to EL = L μ B,μ) p μ x) dμ where x = x 1,x,..., x ) The uder the pre-specified assumptios we have ELμ B ) = 1 λ 1 λ E b e aμ B μ) aμ B μ) 1 ). 11) The the Bayes estimator of μ deoted by μ B is the oe that miimises the posterior expectatio of the loss fuctio, i.e., μ B = arg mi μ B ELμ B ). Note that ELμ B ) μ B = b λ E ae aμb μ) a 1 + b e aμ B μ) aμ B μ) 1 ) = 0. Take f a μ B μ) = ae aμ B μ) a. It ca be see that f a μ B μ) 0 whe μ B μ ad f a μ B μ) < 0 whe μ B <μ.also ote that for a radom variable X 0,EX) = 0 implies X = 0 a.e. Therefore, subject to the costrait μ B μ the Bayes estimator is equal to μ B = μ. 1) Now uder the restrictio μ B <μ,cosider the followig optimisatio problem arg max μ B ELμ B ) arg max μb 1 E 1 + b e aμ B μ) aμ B μ) 1 ). 13) 1 Cosider that gμ B μ) = 1+be aμ B μ) aμ B μ) 1) is a icreasig fuctio sice g μ B μ) > 0 whe μ B <μ.also from the fact that e aμb μ) >aμ B μ) + 1 whe μ B <μ, it ca be see that gμ B μ) > 0. There is o uique solutio for 13), therefore 1) is a valid result. The problem with the above solutio 1) is that μ B is ot a valid estimator, because μ is ukow. I this case a feasible estimator, deoted by μ FB, ca be obtaied by substitutig a proper estimator of μ ito the solutio to get μ 1) FB = μ. Aother possible solutio is to use two sets of available iformatio cotaied i the prior distributio, for the ukow parameter μ ad the desity fuctio.x μ, which cotais the iformatio of the origial sample. 15
16 I this case, defie λ L μ, σ ).p μ) μ μ ) e 1 σ x i μ) σ. The takig the derivative with respect to μ, equatig to zero ad substitutig the fial result ito 1) we obtai the feasible estimator i=1 x i + μ σ μ ) FB = σ σ σ ) ). 14) + Note that λ is just a way to produce a estimator of μ ad it totally idepedet of the loss fuctio. The result of λ was substituted ito 11), that was iitiated from BLINEX loss ad the sketches were geerated usig simulatio exercises based o 11). This feasible Bayes estimator is exactly the same as the Bayes estimator uder squared error loss. The properties of μ ) FB are give below: E μ ) FB = μ + μ σ σ ) σ + σ σ if μ = μ the E μ ) μ FB = = μ, therefore uder these circumstaces μ ) σ σ + FB ubiased estimator of μ; if σ = σ the Var Var μ ) FB 0. σ + ) Var μ ) FB = μ ) FB = σ σ +1) σ ) = + ; σ σ σ + σ ) ; is a σ, it ca therefore be see that whe, 3. A Feasible Bayes Prelimiary Test estimator Facig the same problem as i the itroductio ad usig μ ) FB as the urestricted estimator, the feasible Bayes prelimiary test estimator is defied by μ FBP = I R F ) μ ) FB + I NR F ) μ 0. The performace of FBPTE will be explored uder BLINEX loss i the followig sectio Comparig PTE with FBPTE uder BLINEX loss fuctio. The risk fuctios for the PTE ad FBPTE were calculated for specific choices of the parameters ivolved ad are compared to oe aother. I all the sketches the risk fuctio of the PTE is preseted by the dashed lie curve ad the risk fuctio of the FBPTE is give by the solid lie curve. Both risk fuctios of the estimators are fuctios of δ, where 1 δ 1. I the calculatio of the FBPTE oly a fixed value for the prior mea, μ = 13 ad prior stadard deviatio, 16
17 Figure 11. Compariso of PTE ad FBPTE for differet parameter values. σ = 1, were cosidered ad the performace of the estimators must still be evaluated for differet choices of parameters. For these choices it ca be see that depedig o the value of δ, σ ad, the oe estimator outperforms the other oe. 4. Discussio I this article, the PTE ad its exact risk fuctio is derived uder BLINEX loss, It is the compared i terms of it s risk fuctio, to the risk of the RMLE ad UMLE. For specific choices of parameters ad sample sizes it ca be see that the PTE is just as efficiet as UMLE, these results were obtaied whe δ ± as the sample size icreases ad by keepig σ costat. Whe the sample size remais costat ad σ icreases, the iterval where PTE domiates UMLE icreases. I other words, whe σ icreases we rather prefer to use the PTE i our problems. The FBPTE was also defied i Sec. 3. ad the PTE was computatioally compared to the FBPTE. For specific choices of parameters ad sample sizes it ca be see that both estimators perform well uder specific coditios ad for specific values of δ. Sice the feasible Bayes estimator, give by 14), is othig more tha the Bayes estimator uder squared error loss, we ca ot expect that the risk of FBPTE has a special form. It is still uclear how oe ca fid a Bayes estimator uder BLINEX loss with stable risk performace, which leaves this problem ope for further research. By examiig the results obtaied, we foud that the PTE performs better tha FBPTE for some specific parameter choices ad vice versa. The BLINEX ad LINEX risk fuctios are illustrated i the followig sketches see Figs. 1a c) for specific values of the boudig parameter, λ, the asymmetry parameter b, ad the shape parameter a which iflueces the directio of the pealisatio of the delta. I additio to these parameters, differet samples sizes were selected ad the populatio variace was also adjusted to determie the effect o the risk fuctios. I each sketch the 17
18 Figure 1. a. Risk fuctios uder BLINEX ad LINEX loss for differet choices of the scale parameter ad = 10. b. Risk fuctios uder BLINEX ad LINEX loss for differet choices of the scale parameter ad = 30. c. Risk fuctios uder BLINEX ad LINEX loss fordifferet choices of the scale parameter ad =
19 Figure 1. cotiued) correspodig risk fuctios for BLINEX ad LINEX loss are compared to oe aother. The BLINEX risk fuctio is represeted by the dashed lie curve ad the LINEX risk fuctio is represeted by the solid lie curve. All the risk fuctios are represeted as a fuctio of δ, where 1 δ 1. I the first colum of the pael the risk fuctios of the PTE uder BLINEX ad LINEX loss are give. I the secod colum the risk fuctios of the RMLE uder BLINEX ad LINEX loss are give ad i the last colum the risk fuctios of the UMLE uder BLINEX ad LINEX loss are give. Eve though oly specific choices of the parameters a,b,λ,σ, ad were ivestigated, it ca clearly be see that the BLINEX risk fuctios represet lower risk tha that of the correspodig LINEX risk fuctio across all estimators. These results ca be used to motivate why the BLINEX loss fuctio should be used, rather tha the LINEX loss fuctio. The risk fuctios of RMLE remai the same for all choices of σ ad, sice the risk fuctio is ot a fuctio of these two parameters. The risk fuctios of UMLE are ot a fuctio of δ, therefore the risk is costat over the domai of δ. As show i We ad Levy 001), the BLINEX loss fuctio has the same flexibility as the LINEX, together with the added advatage of beig a bouded fuctio, ow it is also show that uder BLINEX loss all the estimators performs better whe compared to LINEX loss. All the simulatios i this article were doe i SAS 9.. Ackowledgmets This authors are grateful for all the valuable commets ad recommedatios made by the aoymous reviewers. 19
20 Fudig This work is based upo research supported by the Natioal Research Foudatio, South Africa Grat: Ulockig the future: FA ). Refereces Arashi, M. 010). Idea of costructig a image of Bayes actio. Statist. Methodol. 7: 9. Arashi, M. 009). Costraied Bayes estimator i elliptical models. 57 th Proc It. Statist. Istit. CPM, Durba, South Africa. Arashi, M., Tabatabaey, S.M.M. 010). Estimatio of the locatio parameter uder LINEX loss fuctio: Multivariate case, Metrika. 71): Arashi, M., Tabatabaey, S.M. M., Kha, S. 008). Estimatio i multiple regressio model with elliptically cotoured errors uder MLINEX loss. J. Appl. Probab. Statist. 31):3 35. Bacroft, T. A. 1964). Aalysis ad iferece for icompletely specified models ivolvig the use of prelimiary tests) of sigificace. Biometrics 0: Bacroft, T. A. 1944). O biases i estimatio due to the use of prelimiary tests of sigificace. A. Mathemat. Statist. 15): Clarke, J. A. 1986). Some implicatios of estimatig a regressio scale parameter after a prelimiary test of restrictios. M.Ec. Mior Thesis, Dept. of Ecoometrics ad Operatios Research, Moash Uiversity. Ghari, B., Arashi, M., Tabatabaey, S. M. M. 009). Estimatio of the vector of a multivariate ormal model uder reflected ormal loss. J. Statist. Res. 431): Giles, D. E. A. 00). Prelimiary test ad bayes estimatio of a locatio parameter uder reflected ormal loss. I: Wa, A., Chaturvedi, A., Eds., Hadbook of Applied Ecoometrics ad Statistical Iferece. New York: Marcel Dekker, pp Giles, J. A., Giles, D. E. A. 1996). Risk of a homoscedasticity pre-test estimator of the regressio scale uder LINEX loss. J. Statist. Pla. Ifer. 50: Judge, G. G., Bock, M. E. 1978). The Statistical Implicatios of Pre-test ad Stei-rule Estimatio i Ecoometrics. Amsterdam: North-Hollad Publishig Compay. Kibria, B. M. G., Saleh, A. K. Md. Ehsaes. 006). Optimum critical value for pre-test estimator. Commu. Statist. Theor. Meth. 35): Ohtai, K., Giles, D. E. A., Giles, J. A. 1997). The exact risk performace of a pre-test estimator i a heteroskedastic liear regressio model uder a balaced loss fuctio. Ecoometric Reviews. 16: Parsia, A., Kirmai, S. N. U. A. 00). Estimatio uder LINEX Loss Fuctio. I: Ullah, A., Wa, A. T. K., Chaturvedi, A., Eds., Hadbook of Applied Ecoometrics ad Statistical Iferece. New York: Marcel Dekker, pp Porosiński, Z., Kamińska, A. 009). O robust Bayesia estimatio uder some asymmetric ad bouded loss fuctio. Statistics 433): Saleh, A. K. Md. Ehsaes. 006). Theory of prelimiary test ad Stei-type estimatio with applicatios. Hoboke: NJ: Wiley. Saleh, A. K. Md. Ehsaes, Kibria, B. M. G. 1993). Performaces of some ew prelimiary test ridge regressio estimators ad their properties. Commu. Statist. Theor. Meth. : Varia, H. R. 1975). A Bayes approach to real estate assessmet. I: Feiberg, S. E., Zeller, A., Eds., Studies i Bayesia Ecoometrics ad Statistics i hoour of L.J. Savage.Amsterdam: North Hollad, pp We, D., Levy, S. 001). BLINEX: A bouded asymmetric loss fuctio with applicatio to Bayesia estimatio. Commu. Statist. Theor. Meth. 301): Zeller, A. 1977). A Itroductio to Bayesia Iferece i Ecoometrics. New York: Wiley. 0
Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function
Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter
More informationThe Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution
Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationChapter 13: Tests of Hypothesis Section 13.1 Introduction
Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More information10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random
Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationMaximum likelihood estimation from record-breaking data for the generalized Pareto distribution
METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio
More informationCHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION
CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods
More informationLecture 10 October Minimaxity and least favorable prior sequences
STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationTMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.
Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationMinimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions
America Joural of heoretical ad Applied Statistics 6; 5(4): -7 http://www.sciecepublishiggroup.com/j/ajtas doi:.648/j.ajtas.654.6 ISSN: 6-8999 (Prit); ISSN: 6-96 (Olie) Miimax Estimatio of the Parameter
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationIf, for instance, we were required to test whether the population mean μ could be equal to a certain value μ
STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially
More informationEDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR
Joural of Statistical Research 26, Vol. 37, No. 2, pp. 43-55 Bagladesh ISSN 256-422 X EDGEORTH SIZE CORRECTED, AND TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Zahirul Hoque Departmet of Statistics
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationGUIDELINES ON REPRESENTATIVE SAMPLING
DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationSimilarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall
Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More informationThe Sample Variance Formula: A Detailed Study of an Old Controversy
The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More information2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2
Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:
More informationAccess to the published version may require journal subscription. Published with permission from: Elsevier.
This is a author produced versio of a paper published i Statistics ad Probability Letters. This paper has bee peer-reviewed, it does ot iclude the joural pagiatio. Citatio for the published paper: Forkma,
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationPSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9
Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I
More informationSolutions: Homework 3
Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationTesting Statistical Hypotheses for Compare. Means with Vague Data
Iteratioal Mathematical Forum 5 o. 3 65-6 Testig Statistical Hypotheses for Compare Meas with Vague Data E. Baloui Jamkhaeh ad A. adi Ghara Departmet of Statistics Islamic Azad iversity Ghaemshahr Brach
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationA goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality
A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationLecture 12: September 27
36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.
More informationModeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy
Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More informationAsymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values
of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More information