Preliminary test and Bayes Estimation of a Location Parameter Under Blinex Loss

Size: px
Start display at page:

Download "Preliminary test and Bayes Estimation of a Location Parameter Under Blinex Loss"

Transcription

1 Prelimiary test ad Bayes Estimatio of a Locatio Parameter Uder Bliex Loss J. COETSEE, A. BEKKER, AND S. MILLARD Departmet of Statistics, Uiversity of Pretoria, Pretoria, South Africa I this article, the prelimiary test estimator is cosidered uder the BLINEX loss fuc-tio. The problem uder cosideratio is the estimatio of the locatio parameter from a ormal distributio. The risk uder the ull hypothesis for the prelimiary test esti-mator, the exact risk fuctio for restricted maximum likelihood ad approximated risk fuctio for the urestricted maximum likelihood estimator, are derived uder BLINEX loss ad the differet risk structures are compared to oe aother both aalytically ad computatioally. As a motivatio o the use of BLINEX rather tha LINEX, the risk for the prelimiary test estimator uder BLINEX loss is compared to the risk of the pre-limiary test estimator uder LINEX loss ad it is show that the LINEX expected loss is higher tha BLINEX expected loss. Furthermore, two feasible Bayes estimators are derived uder BLINEX loss, ad a feasible Bayes prelimiary test estimator is defied ad compared to the classical prelimiary test estimator. Keywords Prelimiary test estimator; LINEX loss fuctio; BLINEX loss fuctio; Feasible Bayes estimator; Feasible Bayes prelimiary test estimator. Mathematics Subject Classificatio 6F15; 6F Itroductio I this article, the performace of the prelimiary test estimator PTE), restricted maximum likelihood estimator RMLE), ad urestricted maximum likelihood estimator UMLE) are all cosidered uder the BLINEX loss fuctio ad the risk fuctios are compared to oe aother i order to determie which estimator performs better compared to the rest. At the ed of this article, all three estimators metioed above are cosidered uder both the BLINEX ad LINEX loss fuctio i order to determie which of the two loss fuctios performs the best i the sese of havig smaller risk. A umber of articles have already bee published o the prelimiary test estimators usig differet proposed loss structures by Bacroft 1944, 1964), Giles ad Giles 1996), Giles 00), Ohtai et al. 1997), Kibria ad Saleh 1993, 006), Saleh 006), ad Arashi et al. 008), to ame a few. Furthermore, two feasible Bayes estimators are derived uder BLINEX loss ad a feasible Address correspodece to J. Coetsee, Departmet of Statistics, Faculty of Natural ad Agricultural Scieces, Uiversity of Pretoria, Pretoria, South Africa; judy.coetsee@up.ac.za 1

2 Bayes prelimiary test estimator FBPTE) is defied ad it s performace is compared to the performace of the classical prelimiary test estimator. I a article by We ad Levy 001), a ew parametric family of bouded ad asymmetric loss fuctios, called the BLINEX loss fuctio, was developed ad the mathematical properties of the BLINEX loss fuctio were discussed. I Parsia ad Kirmai 00), Porosiński ad Kamińska 009), Arashi 010), ad Arashi ad Tabatabaey 010), the properties of the LINEX fuctio, which was first proposed by Varia 1975), was preseted together with results of estimatio uder LINEX loss for a umber of probability distributios. The BLINEX fuctio is the bouded alterative to the LINEX loss fuctio, therefore it does t have the same limitatios as the LINEX loss fuctio, for example, the LINEX loss fuctio exhibits a huge icrease i expected loss which limits the applicatio of the loss fuctio i practice. The BLINEX fuctio is therefore both bouded ad asymmetric, which allowed the same flexibility as exhibited by the LINEX loss fuctio but it also has the added advatage of beig bouded. The relatioship betwee the BLINEX ad LINEX loss fuctios will be cosidered ext. Assume that τ is a estimator of the ukow parameter θ the the LINEX loss fuctio is defied as follows: L τ,θ) = d e aτ θ) a τ θ) 1 ), where a is the shape parameter ad d is the scale parameter. The BLINEX loss fuctio is derived from the LINEX loss fuctio; let L τ,θ) = d e aτ θ) a τ θ) 1 ) 1 + λd e aτ θ) a τ θ) 1 ) = λ 1 + b e aτ θ) a τ θ) 1 ) 1) with b = λd. The BLINEX loss fuctio depeds o the selected values of three parameters, amely a, b, ad λ, where each of these values plays a sigificat role i the shape of the loss fuctio. The boudig parameter, λ, specifies the rage of the loss which is bouded betwee 0 ad 1. The sig of the costat a will determie the directio of error pealisatio, λ where egative values will pealise egative errors ad a positive value will pealise positive errors. This costat also iflueces the flatess of the curve, for small positive values of a, the curve will be flatter ad large positive values will result i a steeper curve. The costat b is a asymmetry parameter ad it ca be see that for smaller values of b the loss fuctio is more asymmetric ad for larger values of b the fuctio is more symmetric. The ifluece of the differet parameters as discussed above is depicted i Figure 1 for differet parameter values. The problem uder study is to cosider the estimatio of a locatio parameter μ from a ormal populatio with ukow variace i order to evaluate the fiite-sample properties of the prelimiary test estimator i terms of it s risk. Suppose that X 1, X,...,X is a radom sample from Nμ, σ ) where both μ R ad σ R + are ukow. The outcome of a prelimiary test o μ will determie which of the estimators will be used to estimate the populatio mea μ. The urestricted maximum likelihood estimator, X = X i, will be regarded as the estimator of μ whe othig is a priori kow about the parameter μ, whereas the restricted maximum likelihood estimator will be chose whe

3 Figure 1. BLINEX loss fuctio 1 with i) λ = 0.8,a = b = 1, ii) λ = b = 1,a = 5, iii)... λ = b = 1,a = 5, ad iv).-.λ = a = 1,b = 5. some costraits are imposed to the model as a ull hypothesis. The stadard t test for the populatio mea will be the appropriate test sice the scale parameter σ is ukow. Now cosider the case where we are dealig with the followig hypotheses: { H0 : μ = μ 0 H A : μ μ 0. The it is well kow that the test statistic is give as t = X μ 0 s t 1) with X Nμ, σ ). Alteratively, we ca use the followig statistic t = X μ 0) = F F 1, 1). I more geeral terms, the samplig distributio of the test statistic will be the o cetral F variate, F F 1, 1,λ ) with λ = δ kow as the ocetrality parameter σ ad the estimatio error is defied as δ = μ 0 μ. It ca easily be see that whe δ = 0, the samplig distributio uder the ull hypothesis will be the cetral F 1, 1, 0) distributio. Based o this proposal the urestricted maximum likelihood estimator UMLE) is give by μ 1 = X ad the restricted maximum likelihood estimator RMLE) is equal to μ 0. The the prelimiary test estimator of μ is defied as where ad I R F ) = 1 I NR F ) = 1 μ p = I R F ) μ 1 + I NR F ) μ 0 whe the ull hypothesis is rejected = 0 otherwise whe the ull hypothesis is ot rejected = 0 otherwise. The ull hypothesis will ot be rejected whe F c α, where c α is a critical value defied as F α,1, 1,λ =0, ad α is the level of sigificace. s 3

4 The outlie of this article is as follows. I Sec., the risk fuctio of the RMLE, UMLE ad PTE are derived uder BLINEX loss. These differet risk fuctios will be computatioally compared. I Sec. 3, two feasible Bayes estimators are derived uder BLINEX loss. A feasible Bayes prelimiary test estimator FBPTE) is the defied ad the risk fuctio of the PTE is compared to that of the FBPTE. Sectio 4 is a discussio of the results obtaied i this article ad illustratios are provided for the motivatio to use BLINEX loss rather tha LINEX loss fuctios.. Risk Fuctios.1 Risk Fuctio of RMLE The risk fuctio of RMLE is defied ad followed by a illustratio of how the risk fuctio behaves for differet choices of the parameters i the fuctio. The risk fuctio of the RMLE is defied as follows: 1 1 R μ 0 ) = E 1 λ 1 + b e aδ aδ 1 ) = λ 1 + b e aδ aδ 1 ) with δ = μ 0 μ. I the case where δ = 0, Rμ 0 ) = 0. By examiig the risk fuctio it ca be see that whe both a ad δ are egative values or whe both a ad δ are positive, with δ either tedig to or, the risk of RMLE, Rμ 0 )) teds to 1 λ. Whe δ teds to zero, the term beaδ aδ 1) teds to zero ad therefore Rμ 0 ) teds to 0.. Risk Fuctio of UMLE By defiitio, the risk fuctio of UMLE ca be calculated as below: 1 1 R μ 1 ) = 1 λ 1 + b e aμ 1 μ) a μ 1 μ) 1 p μ 1 ) dμ 1, ) where pμ 1 ) is the desity of N μ, σ ). Therefore, by applyig the biomial expasio to 1 Z) 1 where Z = baμ 1 μ) e aμ 1 μ) + 1 R μ 1 ) = 1 λ 1 λ ) 1 πσ e μ 1 μ) σ ) 1 z dμ 1. The risk fuctio of UMLE ca be expaded to: = b e a σ 1 + a b σ e a σ 1 + b e a σ e a σ 1 λ λ λ 4

5 + 3a b 3 σ λ + 3b3 λ e a σ + e a σ e a σ e a σ a σ ) 1 + 6a b 3 σ λ e a σ e a σ + b3 e 9a σ ) λ The risk fuctio of the UMLE is ot a fuctio of the estimatio error, δ, ad is therefore also costat with regard to the o cetrality parameter λ...1 Mote Carlo Simulatios of Risk of UMLE. The risk fuctio of UMLE was also evaluated as a fuctio of λ ad it was foud that the risk fuctio is a decreasig fuctio of both ad λ. Table 1 gives the simulatio results where the fuctio was evaluated for differet values of a,b,σ, ad ad usig p = 1000 iteratios. The results i the table just cofirm some of the expected characteristics of the risk fuctio, amely that the risk of UMLE is a decreasig fuctio of both λ ad, butthe risk is a icreasig fuctio of the variace for a specific choice of parameter..3 Risk of PTE I this sectio the ull risk risk uder the ull hypothesis) of the prelimiary test estimator is derived uder BLINEX loss. The followig lemma is due to Judge ad Bock 1978) ad work doe by Clarke 1986). Lemma.1. Let w be a o cetral chi-square variate with g degrees of freedom ad o cetrality parameter θ, letφ ), be ay real-valued fuctio ad let be ay real value such that > g, the Ew φw)) = e θ θ m Ɣ 1 g + + m) m! Ɣ 1 g + m) E φ χg++m) ). m=0 Theorem.1. Igorig the terms of order 3, the risk fuctio of the prelimiary test estimator usig the BLINEX loss fuctio uder H 0 is give by Rμ p ) = ab σ ) 1 λ 1 + e λ λ m Ɣ 1 + m) eaδ ) m! Ɣ m)p F 1 <cα + 3b a r λ r! r=1 e λ λ i i! i=0 ) σ a b λ ) r σ π m=0 π Ɣ ) r+1 + δ r P F <c α r Ɣ r j + i) Ɣ i) P F 3 <cα ) Ɣ ) 3 + δp F <c α 1 σ δ j 1 j) δ j ) r j ) σ r j) 5

6 Table 1 Risk of UMLE for specific choices of a,b,σ, ad λ = 1 a = 1, b = 0.1,λ= 1 a = 0.1, b = 1,λ= 1 a = 0.1, b = 0.1,λ= 1 Sample size σ = 1 σ = σ = 5 σ = 1 σ = σ = 5 σ = 1 σ = σ = 5 = = = = =

7 e λ λ k k=0 k! b a) r λ r! r r=1 δ j ) r j Ɣ 1 j + k) Ɣ k) P F 4 <cα ) r σ Ɣ ) r+1 ) σ π r j) i=0 P F 3 <cα ) + O Z 3) + δ r P F <c α e λ λ i i! Ɣ r j + i) Ɣ i) with F 1 = 1)χ +m,λ ) +m)χ 1),F = 1)χ 1,,λ ),F χ 1) 3 = 1)χ 1+r j+i,λ ) 1+r j+i)χ 1) ad F 4 = 1)χ j+k,λ ). j+k)χ 1) Proof. By applyig the biomial expasio for Z = baμ p μ) e aμp μ) + 1 the risk fuctio is give by Rμ p ) = ELμ p,μ) 4) 1 λ E Z) + E Z ) + O Z 3) where a r E μ p μ ) r E Z) = b. r! r= Usig the fact that μp μ ) r = μ1 μ) r I R F ) δ r I NR F ) = μ 1 μ) r + δ r μ 1 μ) r I NR F ) for r = 1,, 3,... r = μ 1 μ) r + δ r δ j ) ) r μ 1 μ 0 ) r j I NR F ) j r = μ 1 μ) r + δ r δ j ) ) r σ χ1,λ r j) ) I NR F ), j where χ1,λ ) is a o cetral Chi-squared variate with 1 degree of freedom ad a o cetrality parameter λ = δ. σ Thus, E μ p μ ) r = E μ1 μ) r r + δ r E I NR F ) δ j ) ) r σ r j) j E I NR F ) χ1,λ ) r j) ). 7

8 Usig Lemma.1, we have: E I NR F ) χ1,λ ) r j) ) = r δ j ) r j ) σ r j) i=0 e λ λ i Ɣ r j + i) Ɣ i) P F 3 <cα i! E Z) = b r= a r E μ 1 μ) r + δ r P F <cα r! e λ λ i i=0 i! r δ j ) r j Ɣ r j + i) Ɣ i) P F 3 <cα ). Cosider the followig expressios see Zeller, 1971, pp ): We fially get EZ) = b E μ 1 μ) r = σ ) r ) Ɣ r + 1 π E μ 1 μ) r 1 = 0 for r = 1,, 3,... r= a r r! e λ λ i i=0 Furthermore, we have Sice i! ) r σ π Ɣ ) r+1 + δ r P F <c α for r = 1,, 3,... r δ j ) r j ) σ ) σ r j) r j) Ɣ r j + i) Ɣ i) P F 3 <cα ). 5) E Z ) = a be μ p μ ) + abe μp μ ) μp abe μ ) e aμ p μ) E e aμ p μ) + be e aμ p μ) + b. μp μ ) = μ 1 μ) I R F ) + μ 0 μ) I NR F ) = μ 1 μ) + δ μ 1 μ) I NR F ) = μ 1 μ) + μ 1 μ 0 ) I NR F ) σ ) 1 χ ) 1 = μ 1 μ) 1,λ I NR F ) 8

9 ad uder H 0 we fid μp E μ ) e aμ p μ) σ χ = E μ 1 μ) E 1,λ σ ) 1 χ = E 1,λ σ ) 1 χ = e aμ0 μ) E 1,λ σ ) 1 m=0 = e aδ) e λ λ m m! otherwise We the fid E Z ) uder H 0 : E Z ) ) σ = a b π ) 1 E μp μ ) e aμ p μ) = 0. Ɣ ) 3 + δp F <cα ) 1 σ δ j ) 1 j e λ λ k k! k=0 m=0 ) 1 I NR F ) e aμ p μ) ) 1 I NR F ) e aμ 1 μ)i R F )+aμ 0 μ)i NR F ) ) 1 I NR F ) Ɣ 1 + m) Ɣ m)p F 1 <cα, Ɣ 1 j + k) Ɣ k) P F 4 <cα σ ) 1 e λ λ m Ɣ 1 + m) ab m! Ɣ 1 m=0 1 + m)p F 1 <cα + ab e aδ) σ ) 1 e λ λ m Ɣ 1 + m) m! Ɣ m)p F 1 <cα b r=1 a r r! ) r σ i=0 π σ r j) e λ λ i i! + b r=1 a) r r! σ ) r Ɣ ) r+1 π σ r j) e λ λ i i! i=0 + δ r P F <c α Ɣ r j + i) P 1 + i) Ɣ ) r+1 Ɣ 1 + δ r P F <c α r δ j ) ) r j ) F 3 <cα r δ j ) ) r j Ɣ r j + i) Ɣ i) P F 3 <cα ). 6) Substitutig 5) ad 6) ito 4) the result follows. 9

10 .4 Compariso Results The risk of UMLE ad PTE are aalytically compared to oe aother ad result is give i the followig theorem. Theorem.. The PTE performs better tha the UMLE i the sese of havig smaller risk if the followig iequality holds: δ 1 1 a l b E 1 1 x μ1 + ae μ p μ ) + 1 E e P F >c) /P F <c). aμ 1 μ)i RF Proof. It is eough to show that Rμ p ) Rμ 1 ). Therefore, we should have E1 1 x μp E1 1 x μ1., where x μp = 1 + be aμp μ) aμ p μ) 1 ad x μ1 = 1 + be aμ1 μ) aμ 1 μ) 1, kowig that E1 1 x μ1 is ot a fuctio of δ. Applyig the iequality, 1 1 x 1, x>0to the LHS of the above expressio it is x sufficiet to prove that Ex μp 1 E1 1 x μ1. Simplifyig the relevat term it yields E e aμ p μ) 1 b E 1 1 x μ1 + ae μ p μ ) + 1. Settig 1 b E1 1 x μ1 + aeμ p μ) + 1 = Q we the have E e aμ p μ) Q. 7) The LHS of the above iquality ca be writte as E e aμ p μ) = E e aμ 1 μ)i RF e aδi NRF. 8) By applyig the Cauchy-Schwarz iequality ad usig 7) ad 8), we obtai E e aμ 1 μ)i RF e aδi NRF E e aμ 1 μ)i RF E e aδi NRF. The, it is eough to show that E e aμ 1 μ)i RF E e aδi NRF Q. From the fact that E e aμ 1 μ)i RF > 0, we have E e aδi NRF Q E. 9) e aμ 1 μ)i RF However, the LHS of the above iequality ca be writte as E e aδi NRF aδ) k = E I NR F k! k=0 aδ) k = P F >c) + P F <c) k! k=0 = P F >c) + P F <c) e aδ 10) 10

11 Figure. a = b = λ = 1,σ = 1,= 10. By makig use of the expressio i 9) ad 10) we have P F >c) + P F <c) e aδ Q E e aμ 1 μ)i RF. By simplifyig ad takig logs o both sides of the iequality the result follows. The risk of RMLE, UMLE, ad PTE calculated uder BLINEX loss are computatioally compared to oe aother i order to determie the performace of the estimators relative to oe aother. The sketches see Figs. -10) i this sectio will be discussed i two ways, first by keepig σ costat ad allowig the sample size,, to icrease ad secodly by keepig costat ad allowig σ to icrease. Figure 3. a = b = λ = 1,σ =,=

12 Figure 4. a = b = λ = 1,σ = 5,= 10. For the case where σ = 1, it ca be see that as the sample size icreases for this choice of σ, the risk of PTE teds towards the risk of UMLE as δ ±. It is well kow that X UMLE) is the most efficiet estimator as the sample size icreases, sice Var X ) = σ. It is clear that as the sample size icreases the Var X ) will ted to zero. Therefore as the sample size icreases, PTE becomes just as efficiet as the UMLE. Similar results are obtaied for differet values of σ. Whe σ icreases for a specific sample size, it ca be see that i the iterval ear the origi, the domiatio iterval of PTE relative to the UMLE becomes larger. Therefore, whe workig with a specific sample size ad if the variace of the sample is relatively high, the PTE is a more efficiet estimator compared to the UMLE. Figure 5. a = b = λ = 1,σ = 1,= 30. 1

13 Figure 6. a = b = λ = 1,σ =,= 30. Figure 7. a = b = λ = 1,σ = 5,= 30. Figure 8. a = b = λ = 1,σ = 1,=

14 Figure 9. a = b = λ = 1,σ =,= Bayesia Estimatio uder the BLINEX Loss Fuctio 3.1 Feasible Bayes Estimator The Bayes estimator uder BLINEX loss is derived i this sectio ad due to the complex ature of BLINEX loss fuctio it was ecessary to make use of alterative methods i order to propose feasible estimators. Suppose that X 1, X,..., X is a sample from Nμ, σ ) where μ R ad σ R + is assumed to be kow. For the case of σ ukow, oe may look at the work of Arashi 010), the results obtaied i his paper are very complex. It is wellkow that the cojugate prior for the ukow parameter μ is N μ,σ ) ad the posterior of μ x is N μ,σ ) where μ = μ 1σ +μ σ )) ad σ = σ σ. σ +σ σ +σ Figure 10. a = b = λ = 1,σ = 5,=

15 To derive the Bayes estimator, the expected loss is equal to EL = L μ B,μ) p μ x) dμ where x = x 1,x,..., x ) The uder the pre-specified assumptios we have ELμ B ) = 1 λ 1 λ E b e aμ B μ) aμ B μ) 1 ). 11) The the Bayes estimator of μ deoted by μ B is the oe that miimises the posterior expectatio of the loss fuctio, i.e., μ B = arg mi μ B ELμ B ). Note that ELμ B ) μ B = b λ E ae aμb μ) a 1 + b e aμ B μ) aμ B μ) 1 ) = 0. Take f a μ B μ) = ae aμ B μ) a. It ca be see that f a μ B μ) 0 whe μ B μ ad f a μ B μ) < 0 whe μ B <μ.also ote that for a radom variable X 0,EX) = 0 implies X = 0 a.e. Therefore, subject to the costrait μ B μ the Bayes estimator is equal to μ B = μ. 1) Now uder the restrictio μ B <μ,cosider the followig optimisatio problem arg max μ B ELμ B ) arg max μb 1 E 1 + b e aμ B μ) aμ B μ) 1 ). 13) 1 Cosider that gμ B μ) = 1+be aμ B μ) aμ B μ) 1) is a icreasig fuctio sice g μ B μ) > 0 whe μ B <μ.also from the fact that e aμb μ) >aμ B μ) + 1 whe μ B <μ, it ca be see that gμ B μ) > 0. There is o uique solutio for 13), therefore 1) is a valid result. The problem with the above solutio 1) is that μ B is ot a valid estimator, because μ is ukow. I this case a feasible estimator, deoted by μ FB, ca be obtaied by substitutig a proper estimator of μ ito the solutio to get μ 1) FB = μ. Aother possible solutio is to use two sets of available iformatio cotaied i the prior distributio, for the ukow parameter μ ad the desity fuctio.x μ, which cotais the iformatio of the origial sample. 15

16 I this case, defie λ L μ, σ ).p μ) μ μ ) e 1 σ x i μ) σ. The takig the derivative with respect to μ, equatig to zero ad substitutig the fial result ito 1) we obtai the feasible estimator i=1 x i + μ σ μ ) FB = σ σ σ ) ). 14) + Note that λ is just a way to produce a estimator of μ ad it totally idepedet of the loss fuctio. The result of λ was substituted ito 11), that was iitiated from BLINEX loss ad the sketches were geerated usig simulatio exercises based o 11). This feasible Bayes estimator is exactly the same as the Bayes estimator uder squared error loss. The properties of μ ) FB are give below: E μ ) FB = μ + μ σ σ ) σ + σ σ if μ = μ the E μ ) μ FB = = μ, therefore uder these circumstaces μ ) σ σ + FB ubiased estimator of μ; if σ = σ the Var Var μ ) FB 0. σ + ) Var μ ) FB = μ ) FB = σ σ +1) σ ) = + ; σ σ σ + σ ) ; is a σ, it ca therefore be see that whe, 3. A Feasible Bayes Prelimiary Test estimator Facig the same problem as i the itroductio ad usig μ ) FB as the urestricted estimator, the feasible Bayes prelimiary test estimator is defied by μ FBP = I R F ) μ ) FB + I NR F ) μ 0. The performace of FBPTE will be explored uder BLINEX loss i the followig sectio Comparig PTE with FBPTE uder BLINEX loss fuctio. The risk fuctios for the PTE ad FBPTE were calculated for specific choices of the parameters ivolved ad are compared to oe aother. I all the sketches the risk fuctio of the PTE is preseted by the dashed lie curve ad the risk fuctio of the FBPTE is give by the solid lie curve. Both risk fuctios of the estimators are fuctios of δ, where 1 δ 1. I the calculatio of the FBPTE oly a fixed value for the prior mea, μ = 13 ad prior stadard deviatio, 16

17 Figure 11. Compariso of PTE ad FBPTE for differet parameter values. σ = 1, were cosidered ad the performace of the estimators must still be evaluated for differet choices of parameters. For these choices it ca be see that depedig o the value of δ, σ ad, the oe estimator outperforms the other oe. 4. Discussio I this article, the PTE ad its exact risk fuctio is derived uder BLINEX loss, It is the compared i terms of it s risk fuctio, to the risk of the RMLE ad UMLE. For specific choices of parameters ad sample sizes it ca be see that the PTE is just as efficiet as UMLE, these results were obtaied whe δ ± as the sample size icreases ad by keepig σ costat. Whe the sample size remais costat ad σ icreases, the iterval where PTE domiates UMLE icreases. I other words, whe σ icreases we rather prefer to use the PTE i our problems. The FBPTE was also defied i Sec. 3. ad the PTE was computatioally compared to the FBPTE. For specific choices of parameters ad sample sizes it ca be see that both estimators perform well uder specific coditios ad for specific values of δ. Sice the feasible Bayes estimator, give by 14), is othig more tha the Bayes estimator uder squared error loss, we ca ot expect that the risk of FBPTE has a special form. It is still uclear how oe ca fid a Bayes estimator uder BLINEX loss with stable risk performace, which leaves this problem ope for further research. By examiig the results obtaied, we foud that the PTE performs better tha FBPTE for some specific parameter choices ad vice versa. The BLINEX ad LINEX risk fuctios are illustrated i the followig sketches see Figs. 1a c) for specific values of the boudig parameter, λ, the asymmetry parameter b, ad the shape parameter a which iflueces the directio of the pealisatio of the delta. I additio to these parameters, differet samples sizes were selected ad the populatio variace was also adjusted to determie the effect o the risk fuctios. I each sketch the 17

18 Figure 1. a. Risk fuctios uder BLINEX ad LINEX loss for differet choices of the scale parameter ad = 10. b. Risk fuctios uder BLINEX ad LINEX loss for differet choices of the scale parameter ad = 30. c. Risk fuctios uder BLINEX ad LINEX loss fordifferet choices of the scale parameter ad =

19 Figure 1. cotiued) correspodig risk fuctios for BLINEX ad LINEX loss are compared to oe aother. The BLINEX risk fuctio is represeted by the dashed lie curve ad the LINEX risk fuctio is represeted by the solid lie curve. All the risk fuctios are represeted as a fuctio of δ, where 1 δ 1. I the first colum of the pael the risk fuctios of the PTE uder BLINEX ad LINEX loss are give. I the secod colum the risk fuctios of the RMLE uder BLINEX ad LINEX loss are give ad i the last colum the risk fuctios of the UMLE uder BLINEX ad LINEX loss are give. Eve though oly specific choices of the parameters a,b,λ,σ, ad were ivestigated, it ca clearly be see that the BLINEX risk fuctios represet lower risk tha that of the correspodig LINEX risk fuctio across all estimators. These results ca be used to motivate why the BLINEX loss fuctio should be used, rather tha the LINEX loss fuctio. The risk fuctios of RMLE remai the same for all choices of σ ad, sice the risk fuctio is ot a fuctio of these two parameters. The risk fuctios of UMLE are ot a fuctio of δ, therefore the risk is costat over the domai of δ. As show i We ad Levy 001), the BLINEX loss fuctio has the same flexibility as the LINEX, together with the added advatage of beig a bouded fuctio, ow it is also show that uder BLINEX loss all the estimators performs better whe compared to LINEX loss. All the simulatios i this article were doe i SAS 9.. Ackowledgmets This authors are grateful for all the valuable commets ad recommedatios made by the aoymous reviewers. 19

20 Fudig This work is based upo research supported by the Natioal Research Foudatio, South Africa Grat: Ulockig the future: FA ). Refereces Arashi, M. 010). Idea of costructig a image of Bayes actio. Statist. Methodol. 7: 9. Arashi, M. 009). Costraied Bayes estimator i elliptical models. 57 th Proc It. Statist. Istit. CPM, Durba, South Africa. Arashi, M., Tabatabaey, S.M.M. 010). Estimatio of the locatio parameter uder LINEX loss fuctio: Multivariate case, Metrika. 71): Arashi, M., Tabatabaey, S.M. M., Kha, S. 008). Estimatio i multiple regressio model with elliptically cotoured errors uder MLINEX loss. J. Appl. Probab. Statist. 31):3 35. Bacroft, T. A. 1964). Aalysis ad iferece for icompletely specified models ivolvig the use of prelimiary tests) of sigificace. Biometrics 0: Bacroft, T. A. 1944). O biases i estimatio due to the use of prelimiary tests of sigificace. A. Mathemat. Statist. 15): Clarke, J. A. 1986). Some implicatios of estimatig a regressio scale parameter after a prelimiary test of restrictios. M.Ec. Mior Thesis, Dept. of Ecoometrics ad Operatios Research, Moash Uiversity. Ghari, B., Arashi, M., Tabatabaey, S. M. M. 009). Estimatio of the vector of a multivariate ormal model uder reflected ormal loss. J. Statist. Res. 431): Giles, D. E. A. 00). Prelimiary test ad bayes estimatio of a locatio parameter uder reflected ormal loss. I: Wa, A., Chaturvedi, A., Eds., Hadbook of Applied Ecoometrics ad Statistical Iferece. New York: Marcel Dekker, pp Giles, J. A., Giles, D. E. A. 1996). Risk of a homoscedasticity pre-test estimator of the regressio scale uder LINEX loss. J. Statist. Pla. Ifer. 50: Judge, G. G., Bock, M. E. 1978). The Statistical Implicatios of Pre-test ad Stei-rule Estimatio i Ecoometrics. Amsterdam: North-Hollad Publishig Compay. Kibria, B. M. G., Saleh, A. K. Md. Ehsaes. 006). Optimum critical value for pre-test estimator. Commu. Statist. Theor. Meth. 35): Ohtai, K., Giles, D. E. A., Giles, J. A. 1997). The exact risk performace of a pre-test estimator i a heteroskedastic liear regressio model uder a balaced loss fuctio. Ecoometric Reviews. 16: Parsia, A., Kirmai, S. N. U. A. 00). Estimatio uder LINEX Loss Fuctio. I: Ullah, A., Wa, A. T. K., Chaturvedi, A., Eds., Hadbook of Applied Ecoometrics ad Statistical Iferece. New York: Marcel Dekker, pp Porosiński, Z., Kamińska, A. 009). O robust Bayesia estimatio uder some asymmetric ad bouded loss fuctio. Statistics 433): Saleh, A. K. Md. Ehsaes. 006). Theory of prelimiary test ad Stei-type estimatio with applicatios. Hoboke: NJ: Wiley. Saleh, A. K. Md. Ehsaes, Kibria, B. M. G. 1993). Performaces of some ew prelimiary test ridge regressio estimators ad their properties. Commu. Statist. Theor. Meth. : Varia, H. R. 1975). A Bayes approach to real estate assessmet. I: Feiberg, S. E., Zeller, A., Eds., Studies i Bayesia Ecoometrics ad Statistics i hoour of L.J. Savage.Amsterdam: North Hollad, pp We, D., Levy, S. 001). BLINEX: A bouded asymmetric loss fuctio with applicatio to Bayesia estimatio. Commu. Statist. Theor. Meth. 301): Zeller, A. 1977). A Itroductio to Bayesia Iferece i Ecoometrics. New York: Wiley. 0

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Chapter 13: Tests of Hypothesis Section 13.1 Introduction

Chapter 13: Tests of Hypothesis Section 13.1 Introduction Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed

More information

Stat 319 Theory of Statistics (2) Exercises

Stat 319 Theory of Statistics (2) Exercises Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

This is an introductory course in Analysis of Variance and Design of Experiments.

This is an introductory course in Analysis of Variance and Design of Experiments. 1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods

More information

Lecture 10 October Minimaxity and least favorable prior sequences

Lecture 10 October Minimaxity and least favorable prior sequences STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least

More information

11 Correlation and Regression

11 Correlation and Regression 11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Lecture 3. Properties of Summary Statistics: Sampling Distribution

Lecture 3. Properties of Summary Statistics: Sampling Distribution Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

TMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.

TMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences. Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight)

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight) Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........

More information

Minimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions

Minimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions America Joural of heoretical ad Applied Statistics 6; 5(4): -7 http://www.sciecepublishiggroup.com/j/ajtas doi:.648/j.ajtas.654.6 ISSN: 6-8999 (Prit); ISSN: 6-96 (Olie) Miimax Estimatio of the Parameter

More information

On an Application of Bayesian Estimation

On an Application of Bayesian Estimation O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially

More information

EDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR

EDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Joural of Statistical Research 26, Vol. 37, No. 2, pp. 43-55 Bagladesh ISSN 256-422 X EDGEORTH SIZE CORRECTED, AND TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Zahirul Hoque Departmet of Statistics

More information

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2. SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

The Sample Variance Formula: A Detailed Study of an Old Controversy

The Sample Variance Formula: A Detailed Study of an Old Controversy The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2 Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:

More information

Access to the published version may require journal subscription. Published with permission from: Elsevier.

Access to the published version may require journal subscription. Published with permission from: Elsevier. This is a author produced versio of a paper published i Statistics ad Probability Letters. This paper has bee peer-reviewed, it does ot iclude the joural pagiatio. Citatio for the published paper: Forkma,

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9

PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9 Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I

More information

Solutions: Homework 3

Solutions: Homework 3 Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

Chapter 8: Estimating with Confidence

Chapter 8: Estimating with Confidence Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig

More information

Testing Statistical Hypotheses for Compare. Means with Vague Data

Testing Statistical Hypotheses for Compare. Means with Vague Data Iteratioal Mathematical Forum 5 o. 3 65-6 Testig Statistical Hypotheses for Compare Meas with Vague Data E. Baloui Jamkhaeh ad A. adi Ghara Departmet of Statistics Islamic Azad iversity Ghaemshahr Brach

More information

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,

More information

April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE

April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Lecture 12: September 27

Lecture 12: September 27 36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.

More information

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral

More information

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

6 Sample Size Calculations

6 Sample Size Calculations 6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig

More information

Asymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values

Asymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell

More information

6. Sufficient, Complete, and Ancillary Statistics

6. Sufficient, Complete, and Ancillary Statistics Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information