POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES*

Size: px
Start display at page:

Download "POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES*"

Transcription

1 Kobe Uiversity Ecoomic Review 50(2004) 3 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES* By HISASHI TANIZAKI There are various kids of oparametric tests. I this paper, we cosider testig populatio mea, usig the empirical likelihood ratio test. The empirical likelihood ratio test is useful i a large sample, but it has size distortio i a small sample. For size correctio, various correctios have bee cosidered. Here, we utilize the Bartlett correctio ad the bootstrap method. The purpose of this paper is to compare the t test ad the empirical likelihood ratio tests with respect to the sample power as well as the empirical size through Mote Carlo experimets.. Itroductio I the case of testig populatio mea, we test the ull hypothesis usig the t test, assumig that the populatio is ormal. However, covetioally it is ot kow whether a populatio is ormal. I a small sample, whe a populatio is ot ormal, we caot obtai proper results if we apply the t test. I a large sample, whe both mea ad variace are fiite, the distributio of sample mea is approximated as a ormal distributio from the cetral limit theorem, where a populatio distributio is ot assumed. I this paper, we cosider testig populatio mea without ay assumptio o the uderlyig distributio. There are umerous papers o the distributio-free test. Here, we itroduce the empirical-likelihood-based test ad compare it with the t test. I the past research, Thomas ad Grukemeier (975) made a attempt to costruct cofidece itervals usig the empirical likelihood ratio. Owe (988) proposed various test statistics usig the empirical likelihood i uivariate cases, which are based o Thomas ad Grukemeier (975). Moreover, Owe (990) obtaied the cofidece itervals i multivariate cases ad Owe (99) cosidered the testig procedure i liear regressio models, usig the empirical likelihood. As for the other studies, see Baggerly (998), Che ad Qi (993), DiCiccio, Hall ad Romao (989), Hall (990), Kitamura (997, 200), Lazar ad Myklad (998), Qi (993) ad Qi ad Lawless (994). Owe (200) is oe of the best refereces i this field. I a lot of literature, e.g., Che (996), Che ad Hall (993), DiCiccio, Hall ad Romao (99), DiCiccio ad Romao (989) ad Hall (990), the empirical likelihood is Bartlett correctable. Also, see Jig ad Wood (996), where the empirical likelihood is ot Bartlett correctable i a special case. I this paper, we show that i a small sample the Bartlettcorrected empirical likelihood ratio test is improved to some extet but it still has size

2 4 HISASHI TANIZAKI distortio. As show i Namba (2004), the bootstrap empirical likelihood ratio test is preferred. I this paper, the t test ad the empirical-likelihood-based test are compared with respect to the sample powers ad the empirical size through Mote Carlo studies. The empirical-likelihood-based test is a large sample test ad accordigly it has size distortio. To improve the size distortio, we also cosider usig the Bartlett correctio ad the bootstrap method. 2. Empirical Likelihood ratio Test I this sectio, we itroduce the testig procedure o populatio mea, usig the empirical likelihood ratio test. For example, see Owe (200) for the empirical likelihood ratio test. Let X, X 2, X be mutually idepedetly distributed radom variables ad x, x 2,, x be the observed values of X, X 2,, X. For ow, x, x 2,, x are assumed to be the distict values i{x, X 2,, X }. We cosider the discrete approximatio of the distributio fuctio of X, which is approximated as Prob(X i =x i )=p i, where 0< p i < ad p i = have to be satisfied. The joit distributio of X, X 2,, X, i.e., the likelihood fuctio (especially, called the oparametric likelihood), is give by: L(p)= Prob(X i =x i )= p i, where p=(p,p 2,,p ). Let pˆ i be the estimate of p i, which is give by pˆ i =/ because x, x 2, x are regarded as the realizatios radomly geerated from the same distributio. Therefore, the empirical likelihood is represeted as: L(pˆ)= pˆ i =, where pˆ=(pˆ,pˆ 2,,pˆ ). The empirical likelihood ratio R(p) is defied as a ratio of the oparametric likelihood ad the empirical likelihood, which is give by: L(p) R(p)= = p i. () L(pˆ) I this paper, we cosider testig the populatio mea. The expectatio of X is give by: E(X)= x i Prob(X i =x i )= x i p i =µ, which is rewritte as: Π Π Π Π Π (x i-µ)p i= 0. (2) The, give (x, x 2,, x ) ad µ, we wat to obtai the p, p 2,, p which maximize ()

3 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES 5 with the two costraits, i.e., p ad (2). Substitutig the solutios of p, p 2,, p ito (), the maximum value of the empirical likelihood ratio is obtaied as a fuctio of µ. That is, we solve the Lagragia: G= log(p i )-λ'( (x i -µ)p i )+γ( p i -), with respect to p, p 2,, p, λ ad γ, where λ ad γ are deoted by the Lagragia multipliers. I the secod term of the Lagragia, is multiplied for simplicity of calculatio. Sice the logarithm of the empirical likelihood ratio, log R(p)= log( p i ), is cocave for all 0<p i <,,2,,, we have a global maximum of G. However, we have the problem that all the solutios of p, p 2,, p, λ ad γ are ot obtaied i a closed form. Solvig the Lagragia, p i is give by: p i =, +(x (3) i - µ)'λ which depeds o λ. I order to obtai the solutio of λ, multiplyig (x i-µ) i both sides of (3) ad summig up with respect to i, we have the followig expressio: x i-µ +(x i -µ)'λ =0. (4) Sice (4) is a implicit fuctio of λ, we may solve (4) with respect to λ by the iterative procedure such as the Newto-Raphso optimizatio method or a simple grid search. Thus, give µ, we ca obtai the λ which satisfies (4). As a computatioal remark, the coditio 0< p i< is required. This coditio is equivalet to: +(x i -µ)'λ>, (5) which comes from (3). Moreover, (5) is rewritte as: - - / <λ<- - /, x x (6) max -µ mi -µ where x mi ad x max represet miimum ad maximum values of x, x 2,, x, respectively. Therefore, we have to perform the above iterative procedure with the coditio (6). Substitutig the solutio of λ ito (3), we ca obtai (p, p 2,, p ), give (x, x 2,, x,) ad µ. I other words, substitutig (3) ito (), the logarithm of the empirical likelihood ratio, log R(p)= log( p i ), with the costraits p i = ad (2) is rewritte as follows: - log(+(x i -µ)'λ)=logr ~ (x;µ), (7) where x = (x, x 2,, x ) ad λ has to satisfy (4). R ~ (x;µ) correspods to the maximum value of R(p) give x, x 2,, x, µ.

4 6 HISASHI TANIZAKI We have assumed that x, x 2,, x are the distict values i {X, X 2,, X }. Therefore, p i is iterpreted as the probability where X takes x i. Eve whe some of x, x 2,, x take the same value, the above discussio still holds without ay modificatio. However, the iterpretatio of p i should be chaged. Suppose that x i takes the same value as x j for i j, i.e., x i=x j=x *, but it is differet from the others. Prob (X=x * ) = Prob (X=x i) + Prob (X=x j)=p i+p j=p * represets the probability where X takes x i=x j=x *, where p i should be equal to p j. I this case, we eed to iterpret p i as a specific weight, rather tha the probability. Now, we cosider the ull hypothesis H 0 : µ = µ 0. Replace the actual data x i i (7) by the correspodig radom variable X i. The, as goes to ifiity, uder the ull hypothesis H 0 we have the followig asymptotic property: -2 logr ~ (X ;µ 0)=2 log(+(x i-µ 0)'λ) χ 2 (k), (8) which is show i Owe (200), where X=(X, X 2,, X ). Let χ α2 (k) be 00 α percet poit from the χ 2 distributio with k degrees of freedom. Remember that µ is a k vector. Thus, we reject the ull hypothesis H 0:µ=µ 0,whe -2logR ~ (x;µ 0) =2 log(+(x i-µ 0)'µ)>χ α2 (k). Note as follows. Uder the ull hypothesis H 0: µ=µ 0, we sometimes have the case where the λ which satisfies (4), (5) ad µ=µ 0 does ot exist. The reaso why we have this case is because the ull hypothesis H 0 : µ=µ 0 does ot hold. Therefore, it is plausible to cosider that the empirical likelihood ratio -2 logr ~ (x;µ 0 ) takes a extremely large value. Bartlett-Corrected Empirical Likelihood Ratio Test: As metioed above, the empirical likelihood ratio test statistic -2 logr ~ (X ;µ 0 ) is asymptotically distributed as a χ 2 (k) radom variable. However, i a small sample, it is ot ecessarily chi-squared ad the approximatio might be quite poor. Therefore, we cosider applyig size correctio to (8). I the past, various size correctio methods have bee proposed. I this paper, we adopt the Bartlett correctio, which is discussed i Che (996), Che ad Hall (993), DiCiccio, Hall ad Romao (99), DiCiccio ad Romao (989), Hall (990), Jig ad Wood (996) ad Owe (200). By the Bartlett correctio, asymptotically we have the followig: or equivaletly, -2 logr ~ a (X ;µ 0)=2 log(+(x i -µ 0 )'λ) (+ )χ 2 (k), -(+ a ) - 2 logr ~ a (X ;µ 0)=(+ ) - 2 log(+(x i-µ 0)'λ) χ 2 (k), where λ has to satisfy (4), (5) ad µ=µ 0, ad a is deoted by a= (m 4 / m 22 )- 3 (m 32 / m 23 ). m j deotes the jth momet of X about the mea Ε(X), i.e., m j =Ε((X-Ε(X)) j ). Sice m j is ukow, replacig m j by its estimate mˆ j =(/) (x i -x ) j, we perform the testig procedure as follows: 2

5 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES 7 -(+ â ) - 2 logr ~ â (X ;µ 0)=(+ ) - 2 log(+(x i -µ 0 )'λ) χ 2 (k), (9) where λ has to satisfy (4), (5) ad µ=µ 0, ad â idicates the estimate of a, which is show as: â= (mˆ 4/ mˆ 22 )- (mˆ 32 / mˆ 23 ). Thus, we reject the ull hypothesis H 0 : µ=µ 0, whe -(+â/) - 2 2logR ~ 3 (x;µ 0 ) =(+â/) - 2 log(+(x i -µ 0 )'λ)> χ α2 (k). Bootstrap Empirical Likelihood Ratio Test: As aother size correctio method, we cosider derivig a empirical distributio of -2logR ~ (X;µ) by the bootstrap method. Let x *, x 2*,, x * be the bootstrap sample from x, x 2,, x. That is, oe of the origial data x, x 2,, x is radomly chose for x i*. We repeat this procedure for all,2,, with replacemet ad we have the bootstrap sample x *, x 2*,, x *. We solve () subject to the costraits 0<p i <, p i = ad (x i* -x ) p i =0, where x (/) x i. As a result, i (2) - (7), x i ad µ are replaced by x i* ad x, respectively. That is, istead of (7), we obtai the followig test statistic: -2 logr ~ (x * ;x ), (0) where x * =(x *, x 2*,, x * ). Wheever the bootstrap sample {x *, x 2*,, x * } is resampled from {x, x 2,, x } with replacemet, we have a differet value of (0). Resamplig the bootstrap sample M times, we have M empirical log-likelihood ratios, where M =0 4 is take i the Mote Carlo studies i the ext sectio. This procedure is equivalet to derivig the empirical distributio of -2 logr ~ (X;x ), where the sample mea x is give. Sortig the M values by size, we ca obtai the percet poits from the M empirical log-likelihood ratios. The percet poits based o the M values are compared with the empirical log-likelihood ratio based o the origial data. Thus, we ca test the ull hypothesis H 0 : µ=µ 0. See, for example, Hall (987), Namba (2004) ad Owe (200) for the bootstrap empirical likelihood ratio test. Sometimes we have the case where x i* > x or x i* < x for all,2,,. I this case, we cosider that (0) lies o the side of the distributio ad accordigly takes a extremely large value. 3. Mote Carlo Experimets I Sectio 2, we have itroduced the empirical likelihood ratio tests based o (8), (9) ad (0), which are applied to testig the populatio mea. I this sectio, the t test, the covetioal empirical likelihood ratio test (8), the Bartlett-corrected empirical likelihood ratio test (9) ad the bootstrap empirical likelihood ratio test (0) are compared with respect to empirical size ad sample power through Mote Carlo studies. The setup of the Mote Carlo experimets is as follows: (i) For the uderlyig distributio of uivariate radom variable X i, we take the followig

6 8 HISASHI TANIZAKI seve distributios. Stadard Normal Distributio (N): f (x) = exp(- x 2 ), - < x <. π Uiform distributio (U): f (x) =, - x <. χ 2 () Distributio (X): y- x =, where f (y)= y -/2 exp(- 0 <y < π t(3) Distributio (T): y x =, where f (y)= 2 (+y 2 /3) -2 - < y < π Double Expoetial Distributio (D): y x =, where f (y)= exp(- - < y < Logistic Distributio (L): y exp(y) x =, where f (y)=, - < y < π/ exp(y)) 2 Gumbel Distributio (G): y x =, where f (y)=exp(-(y-α)-e -(y-α) ) ad α , - < y < π/ The mea ad variace of X i are ormalized to be zero ad oe for,2,,. (ii) The sample size is give by = 20, 50, 00. (iii) The ull hypothesis H 0 : µ=µ 0 ad the alterative oe H : µ=µ are take for µ 0 =.0 ad µ =.0,.,.2,.4. (iv) The sigificace level α is give by α =.0,.05. (v) For each sigificace level, perform 0 4 simulatio rus ad obtai the umber of rejectios of the ull hypothesis H 0 : µ=µ 0. Dividig the umber of the rejectios by 0 4, the sample power is computed. Uder the setup above, we perform Mote Carlo experimets. The obtaied results are expected as follows:

7 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES 9 Sice the ormal distributio is assumed i (N), the t test idicates the same empirical size as the sigificace level ad it gives us the most powerful test. I the case of µ=.0, the power correspods to the size, i.e., the sigificace level α. However, the empirical likelihood ratio test show i (8) idicates a large sample test. Therefore, i a small sample, it might be expected that the empirical likelihood ratio test (8) has size distortio. The Bartlett-corrected empirical likelihood ratio test (9) ad the bootstrap empirical likelihood ratio test (0) should be improved with respect to the empirical size i a small sample. The covetioal empirical likelihood ratio test, the Bartlett-corrected empirical likelihood ratio test ad the bootstrap empirical likelihood ratio test should be equivalet to the t test as is large, because the three test statistics have the same distributio, i.e., chi-square distributio, i a large sample. The results are obtaied i Table, where the three kids of empirical likelihood ratio tests are show with the t test. (8) represets the covetioal empirical likelihood ratio test which simply utilizes the chi-square percet poits with oe degree of freedom. (9) idicates the Bartlett-corrected empirical likelihood ratio test, where the chi-square percet poit with oe degree of freedom is regarded as the percet poit for the test statistic. (0) shows the bootstrap empirical likelihood ratio test, where the distributio of the test statistic is costructed by the bootstrap sample. Let δˆ be a value i the table. The stadard error of δˆ is give by δˆ(-δˆ)/0 4, ad accordigly it is at most.5(-.5)/0 4 =.005. Note that 0 4 i the square root idicates the umber of simulatio rus. The results are summarized as follows. Empirical Size: First, cosider the case of µ =.0 i Table, which represets the empirical size. Let δ ad δˆ be the true size ad the empirical size, respectively. Uder the ull hypothesis H 0: δ = α, asymptotically we have(δˆ -α)/ α( α)/0 4 ~N (0,), which comes from the cetral limit theorem. I the case of µ =.0 i Table, ** ad * show that the ull hypothesis H 0 : δ = α is rejected at sigificace levels % ad 5 % by the both-sided test. That is, i the case of µ =.0, the values without ** ad * are preferred, because they show correct sizes. As for (N), the t test idicates the correct sizes for all α =.0,.05 ad = 20, 50, 00. These results are plausible, because the t test gives us the uiformly most powerful test uder ormality assumptio. For (U), similarly the empirical size δˆ i the t test is very close to the sigificace level α. For (T), (D) ad (L), the t test is ot a appropriate test especially for small, because the size is statistically differet from the sigificace level. That is, the t test gives us the correct sizes ad the powers for (N), but it yields the over-estimated sizes or the uderestimated sizes for (U), (T), (D) ad (L). Whe is small, for ay distributio the covetioal empirical likelihood ratio test (8) has size distortio ad it over-estimates empirical sizes. For example, comparig the empirical likelihood ratio test (8) ad the t test i the case of (N), µ =.0 ad =20, the empirical likelihood ratio test (8) has larger empirical sizes tha the t test for both α =.0 ad.05 (we

8 20 HISASHI TANIZAKI have ad for the empirical likelihood ratio test (8), ad ad for the t test). As icreases (for example, =00), the empirical likelihood ratio test (8) as well as the t test idicate the correct sizes. I a small sample, we perform Bartlett correctio to improve the size distortio i the empirical likelihood ratio test. See (8) i Table for the Bartlett-corrected empirical likelihood ratio test. We ca observe that the size distortio decreases but we still have the size distortio to some extet. For example, i the case of (N), =20, µ =.0 ad α =.0, (8) is.340 ad (9) is.26, which idicates that (9) is closer to α =.0 tha (8). (8) is.0808 for α =.05 ad (9) is.0735 for α =.05. Therefore, (9) is better tha (8), but it is ot practical. The bootstrap empirical likelihood ratio test (0) is also implemeted to improve the size distortio. Both (8) ad (9) are size-distorted i most of the cases, but (0) shows a correct empirical size i a lot of cases. Thus, the size distortio is improved whe (0) is applied. As a result, we ca coclude that (0) is better tha (8) ad (9) for the empirical size criterio ad that the empirical size i (0) is very close to the sigificace level. Whe is large, the empirical likelihood ratio tests (8) - (0) ad t test show the size which is equal to the sigificace level. That is, i the case of µ =.0 ad =00, there are a lot of values without the superscript *. Thus, all the tests perform better i a large sample. Sample Power: Next, we cosider the case of µ 0 i Table, which idicates the sample power. I the case of µ = 0., 0.2, 0.4 ad the empirical likelihood ratio tests (8) - (0),,, ad idicate compariso with the t test. Let δt be the value i t Test of Table. We put the superscript whe ( δˆ -δ t )/ δ t( δ t)/0 4 is greater tha.9600, ad the superscript whe it is greater tha We put the superscript if ( δˆ -δ t )/ δ t( δ t)/0 4 is less tha , ad the superscript if it is less tha Note that i a large sample we have the followig: ( δˆ -δ t )/ δ t( δ t)/0 4 ~N(0,) uder the ull hypothesis H 0 : δ = δ t ad the alterative oe H : δ δ t. Therefore, the values with the superscript idicate a more powerful test tha the t test. I additio, the umber of the superscript shows the degree of the sample power. Cotrarily, the values with the superscript represet a less powerful test tha the t test. Takig a example of the case (N), = 20 ad µ =., the sample power i (8) is give by δˆ = while that i t Test is δ t = We wat to test H 0 : δ = δ t agaist H : δ δ t. I this case, the test statistic is give by ( ) / 0.325(-0.325)/0 4 =0.677, which is greater tha Therefore, H 0 : δ = δ t is rejected at sigificace level α =0.0. I the case of (N), the t test is the most powerful test. For small, both (8) ad (9) have size distortio, ad they over-estimate the sample powers. Accordigly, it is ot meaigful to compare (8), (9) ad the t test with respect to the sample powers. The empirical likelihood ratio test (0) is very close to the t test i all the cases of (N). Thus, (0) performs better tha (8) ad (9). For (U), the empirical sizes i (8) ad (9) are over-estimated, while those i (0) ad the t test are sometimes uder-estimated but correctly estimated i may cases. I additio, the sample powers i (8) ad (9) are larger tha those i the t test. (0) is slightly better tha the t

9 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES 2 TABLE. Empirical Size ad Sample Power µ \α (8) Empirical Likelihood Ratio Test (9) (0) t Test Normal Distributio(N) ** ** 0.26 ** ** ** ** ** ** * ** ** Uifor Distributio(U) ** ** ** * * * * χ 2 () Distributio(X) ** 0.2 ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** 0.24 ** ** ** **

10 22 HISASHI TANIZAKI TABLE. Empirical Size ad Sample Power < Cotiued > µ \α (8) Empirical Likelihood Ratio Test (9) (0) t Test t (3) Distributio(T) ** 0.05 ** ** ** * ** ** 0.63 ** ** ** * ** ** ** ** 0.87 ** ** Double Expoetial Distributio (D) ** ** ** ** * * ** ** ** 0.59 ** ** ** ** 0.30 ** ** Logistic Distributio (L) ** ** ** ** * ** ** ** 0.23 ** ** ** ** 0.075* **

11 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES 23 TABLE. Empirical Size ad Sample Power < Cotiued > µ \α (8) Empirical Likelihood Ratio Test (9) (0) t Test Gumbel Distributio(G) ** ** ** ** ** ** ** 0.5 ** ** ** ** ** ** ** test but (9) is ot sigificatly differet from the t test. It might be cocluded that (0) is slightly more powerful tha the t test i the case where the uderlyig distributio is give by (U). I the case of (X), (T), (D), (L) ad (G), both (7) ad (8) have size distortio, where all the empirical sizes i (8) ad (9) are over-estimated. Therefore, it is useless for (X), (T), (D), (L) ad (G) to compare (8) ad (9) with the t test. (0) has o size distortio i a lot of cases, while the empirical sizes i the t test are sometimes uder-estimated. I most cases, (0) is less tha the t test with respect to the sample powers. Therefore, the t test is more powerful tha (0), especially i the case of (T), (D) ad (L). I the case of =00, the sample powers take similar values for all µ =0., 0.2, 0.4. Therefore, it is show from Table that all the tests give us the same sample power i a large sample. 4. Summary I this paper, we have compared three empirical likelihood ratio tests with the t test, where we test the populatio mea. I the case of testig the populatio mea, covetioally we assume a ormal distributio. Uder the ormality assumptio, the appropriate test statistic has a t distributio. Thus, we eed the ormality assumptio for the t test. However, the uderlyig distributio is ot kow i geeral. Therefore, the ormality assumptio is ot ecessarily plausible. I this paper, we cosider testig the populatio mea without ay assumptio o the uderlyig distributio. I the case of a large sample, the sample mea is approximated to be ormal whe mea ad

12 24 HISASHI TANIZAKI variace exist. This result comes from the cetral limit theorem. Therefore, usig the ormal distributio, we ca test the hypothesis o the populatio mea. The asymptotic distributio of the t distributio is give by the stadard ormal distributio. Thus, whe the sample size is large we ca apply the t test to ay uderlyig distributio. The empirical likelihood ratio test statistic is asymptotically distributed as a chi-square radom variable, which is also a large sample test, where the chi-square percet poits are compared with the empirical likelihood ratio test statistic. The covetioal empirical likelihood ratio test with chi-square percet poits yields the size distortio. Therefore, we have cosidered the empirical likelihood ratio tests based o the Bartlett correctio ad the bootstrap method. I this paper, the ormal distributio, the uiform distributio, the t (3) distributio, the double expoetial distributio, or the logistic distributio is assumed for the uderlyig distributio. Usig the three empirical likelihood ratio tests show i (8) - (0) ad the t test, we have obtaied the empirical sizes ad the sample powers for each distributio through Mote Carlo experimets. Whe the sample size is large, we have obtaied the result that all the tests show the similar empirical sizes ad sample powers. However, whe is small, the covetioal empirical likelihood ratio test (8) idicates a large size distortio, ad accordigly it is ot practically useful. Therefore, we have performed the size correctio by Bartlett correctio, but the empirical likelihood ratio test with Bartlett correctio, show i (9), still has size distortio although it improves to some extet. Next, usig the bootstrap method, we have obtaied the empirical distributio of the the empirical likelihood ratio test statistic ad derived the critical regio. Based o the critical regio, we have performed the empirical likelihood ratio test (0). The obtaied empirical sizes ad sample powers are plausible, usig (0). REFERENCES Baggerly, K.A. (998), "Empirical Likelihood as a Goodess-of-Fit Measure,'' Biometrika, 85, pp Che, S.X. (996), "Empirical Likelihood Cofidece Itervals for Noparametric Desity Estimatio,'' Biometrika, 83, pp Che, S.X. ad Hall, P. (993), "Smoothed Empirical Likelihood Cofidece Itervals for Quatiles,'' The Aals of Statistics, 2, pp Che, J. ad Qi, J. (993), "Empirical Likelihood Estimatio for Fiite Populatios ad the Effective Usage of Auxiliary Iformatio,'' Biometrika, 80, pp DiCiccio, T.J., Hall, P. ad Romao, J.P. (989), "Compariso of Parametric ad Empirical Likelihood Fuctios,'' Biometrika, 76, pp DiCiccio, T.J., Hall, P. ad Romao, J.P. (99), "Empirical Likelihood is Bartlett-Correctable,'' The Aals of Statistics, 9, pp DiCiccio, T.J. ad Romao, J.P. (989), "O Adjustmets Based o the Siged of the Empirical Likelihood Ratio Statistic,'' Biometrika, 76, pp Hall, P. (987), "O the Bootstrap ad Likelihood-Based Cofidece Regios,'' Biometrika, 74, pp Hall, P. (990), "Pseudo-Likelihood Theory for Empirical Likelihood,'' The Aals of Statistics, 8, pp Jig, B.Y. ad Wood, A.T.A. (996), "Expoetial Empirical Likelihood is Not Bartlett Correctable,'' The Aals of Statistics, 24, pp Kitamura, Y. (997), "Empirical Likelihood Methods with Weakly Depedet Processes,'' The Aals of Statistics, 25, pp Kitamura, Y. (200), "Asymptotic Optimality of Empirical Likelihood for Testig Momet Restrictios,'' Ecoometrica, 69, pp

13 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES 25 Lazar, N. ad Myklad, P.A. (998), "A Evaluatio of the Power ad Coditioality Properties of Empirical Likelihood,'' Biometrika, 85, pp Namba, A. (2004), "Simulatio Studies o Bootstrap Empirical Likelihood Tests,'' Commuicatios i Statistics, Simulatio ad Computatio, 33, pp Owe, A.B. (988), "Empirical Likelihood Ratio Cofidece Itervals for a Sigle Fuctioal,'' Biometrika, 75, pp Owe, A.B. (990), "Empirical Likelihood Ratio Cofidece Regios,'' The Aals of Statistics, 8, pp Owe, A.B. (99), "Empirical Likelihood for Liear Models,'' The Aals of Statistics, 9, pp Owe, A.B. (200), Empirical Likelihood (Moographs o Statistics ad Applied Probability 92), Chapma \& Hall/CRC. Qi, J. (993), "Empirical Likelihood i Biased Sample Problems,'' The Aals of Statistics, 2, pp Qi, J. ad Lawless, J. (994), "Empirical Likelihood ad Geeral Estimatig Equatios,'', 22, pp Thomas, D.R. ad Grukemeier, G.L. (975), "Cofidece Iterval Estimatio of Survival Probabilities for Cesored Data,'' Joural of the America Statistical Associatio, 70, pp

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

ON BARTLETT CORRECTABILITY OF EMPIRICAL LIKELIHOOD IN GENERALIZED POWER DIVERGENCE FAMILY. Lorenzo Camponovo and Taisuke Otsu.

ON BARTLETT CORRECTABILITY OF EMPIRICAL LIKELIHOOD IN GENERALIZED POWER DIVERGENCE FAMILY. Lorenzo Camponovo and Taisuke Otsu. ON BARTLETT CORRECTABILITY OF EMPIRICAL LIKELIHOOD IN GENERALIZED POWER DIVERGENCE FAMILY By Lorezo Campoovo ad Taisuke Otsu October 011 COWLES FOUNDATION DISCUSSION PAPER NO. 185 COWLES FOUNDATION FOR

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Department of Mathematics

Department of Mathematics Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

Lorenzo Camponovo, Taisuke Otsu On Bartlett correctability of empirical likelihood in generalized power divergence family

Lorenzo Camponovo, Taisuke Otsu On Bartlett correctability of empirical likelihood in generalized power divergence family Lorezo Campoovo, Taisuke Otsu O Bartlett correctability of empirical likelihood i geeralized power divergece family Article Accepted versio) Refereed) Origial citatio: Campoovo, Lorezo ad Otsu, Taisuke

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 3. Properties of Summary Statistics: Sampling Distribution

Lecture 3. Properties of Summary Statistics: Sampling Distribution Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Chapter 13: Tests of Hypothesis Section 13.1 Introduction

Chapter 13: Tests of Hypothesis Section 13.1 Introduction Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight)

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight) Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2. SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

x iu i E(x u) 0. In order to obtain a consistent estimator of β, we find the instrumental variable z which satisfies E(z u) = 0. z iu i E(z u) = 0.

x iu i E(x u) 0. In order to obtain a consistent estimator of β, we find the instrumental variable z which satisfies E(z u) = 0. z iu i E(z u) = 0. 27 However, β MM is icosistet whe E(x u) 0, i.e., β MM = (X X) X y = β + (X X) X u = β + ( X X ) ( X u ) \ β. Note as follows: X u = x iu i E(x u) 0. I order to obtai a cosistet estimator of β, we fid

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

Lecture 6 Simple alternatives and the Neyman-Pearson lemma STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2 Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:

More information

HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018

HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018 HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018 We are resposible for 2 types of hypothesis tests that produce ifereces about the ukow populatio mea, µ, each of which has 3 possible

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Introduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 3

Introduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 3 Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 3 (This versio August 17, 014) 015 Pearso Educatio, Ic. Stock/Watso

More information

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes. Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem

More information

Common Large/Small Sample Tests 1/55

Common Large/Small Sample Tests 1/55 Commo Large/Small Sample Tests 1/55 Test of Hypothesis for the Mea (σ Kow) Covert sample result ( x) to a z value Hypothesis Tests for µ Cosider the test H :μ = μ H 1 :μ > μ σ Kow (Assume the populatio

More information

Math 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency

Math 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the

More information

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

A quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population

A quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2 82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,

More information

Study the bias (due to the nite dimensional approximation) and variance of the estimators

Study the bias (due to the nite dimensional approximation) and variance of the estimators 2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

Stat 319 Theory of Statistics (2) Exercises

Stat 319 Theory of Statistics (2) Exercises Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Introductory statistics

Introductory statistics CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)*

GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* *Note: I Frech SAD (Système d Aide à la Décisio) 1. Itroductio to the DSS Eightee statistical distributios are available i HYFRAN-PLUS software to

More information

Chapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.

Chapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc. Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

Agreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times

Agreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times Sigificace level vs. cofidece level Agreemet of CI ad HT Lecture 13 - Tests of Proportios Sta102 / BME102 Coli Rudel October 15, 2014 Cofidece itervals ad hypothesis tests (almost) always agree, as log

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Lecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS

Lecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS Lecture 5: Parametric Hypothesis Testig: Comparig Meas GENOME 560, Sprig 2016 Doug Fowler, GS (dfowler@uw.edu) 1 Review from last week What is a cofidece iterval? 2 Review from last week What is a cofidece

More information

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos .- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,

More information

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc. Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Stat 200 -Testing Summary Page 1

Stat 200 -Testing Summary Page 1 Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece

More information

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral

More information

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,

More information

Power and Type II Error

Power and Type II Error Statistical Methods I (EXST 7005) Page 57 Power ad Type II Error Sice we do't actually kow the value of the true mea (or we would't be hypothesizig somethig else), we caot kow i practice the type II error

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Data Analysis and Statistical Methods Statistics 651

Data Analysis and Statistical Methods Statistics 651 Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Power Comparison of Some Goodness-of-fit Tests

Power Comparison of Some Goodness-of-fit Tests Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School 7-6-2016 Power Compariso of Some Goodess-of-fit Tests Tiayi Liu tliu019@fiu.edu DOI: 10.25148/etd.FIDC000750

More information

STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:

STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to: STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

6 Sample Size Calculations

6 Sample Size Calculations 6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig

More information

Solution to Chapter 2 Analytical Exercises

Solution to Chapter 2 Analytical Exercises Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

Exam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes.

Exam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes. Exam II Review CEE 3710 November 15, 017 EXAM II Friday, November 17, i class. Ope book ad ope otes. Focus o material covered i Homeworks #5 #8, Note Packets #10 19 1 Exam II Topics **Will emphasize material

More information

This chapter focuses on two experimental designs that are crucial to comparative studies: (1) independent samples and (2) matched pair samples.

This chapter focuses on two experimental designs that are crucial to comparative studies: (1) independent samples and (2) matched pair samples. Chapter 9 & : Comparig Two Treatmets: This chapter focuses o two eperimetal desigs that are crucial to comparative studies: () idepedet samples ad () matched pair samples Idepedet Radom amples from Two

More information

Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests

Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests Joural of Moder Applied Statistical Methods Volume 5 Issue Article --5 Bootstrap Itervals of the Parameters of Logormal Distributio Usig Power Rule Model ad Accelerated Life Tests Mohammed Al-Ha Ebrahem

More information

MATH/STAT 352: Lecture 15

MATH/STAT 352: Lecture 15 MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Chapter 8: Estimating with Confidence

Chapter 8: Estimating with Confidence Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig

More information

April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE

April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

TMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.

TMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences. Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Topic 18: Composite Hypotheses

Topic 18: Composite Hypotheses Toc 18: November, 211 Simple hypotheses limit us to a decisio betwee oe of two possible states of ature. This limitatio does ot allow us, uder the procedures of hypothesis testig to address the basic questio:

More information

STAC51: Categorical data Analysis

STAC51: Categorical data Analysis STAC51: Categorical data Aalysis Mahida Samarakoo Jauary 28, 2016 Mahida Samarakoo STAC51: Categorical data Aalysis 1 / 35 Table of cotets Iferece for Proportios 1 Iferece for Proportios Mahida Samarakoo

More information

Bayesian Control Charts for the Two-parameter Exponential Distribution

Bayesian Control Charts for the Two-parameter Exponential Distribution Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com 2 Uiversity of the Free State Abstract By usig data that are the mileages

More information

Math 140 Introductory Statistics

Math 140 Introductory Statistics 8.2 Testig a Proportio Math 1 Itroductory Statistics Professor B. Abrego Lecture 15 Sectios 8.2 People ofte make decisios with data by comparig the results from a sample to some predetermied stadard. These

More information

STAT431 Review. X = n. n )

STAT431 Review. X = n. n ) STAT43 Review I. Results related to ormal distributio Expected value ad variace. (a) E(aXbY) = aex bey, Var(aXbY) = a VarX b VarY provided X ad Y are idepedet. Normal distributios: (a) Z N(, ) (b) X N(µ,

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information