Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution

Size: px
Start display at page:

Download "Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution"

Transcription

1 Journal of Computational and Applied Mathematics 216 (2008) Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution Yildiz E. Yilmaz a, Aysen D. Akkaya a,b, a Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ont., Canada N2L 3G1 b Department of Statistics, Middle East Technical University, Ankara, Turkey Received 12 December 2006; received in revised form 29 May 2007 Abstract We consider one-way classification model in experimental design when the errors have generalized secant hyperbolic distribution. We obtain efficient and robust estimators for block effects by using the modified maximum likelihood estimation (MML) methodology. A test statistic analogous to the normal-theory F statistic is defined to test block effects. We also define a test statistic for testing linear contrasts. It is shown that test statistics based on MML estimators are efficient and robust. The methodology readily extends to unbalanced designs Elsevier B.V. All rights reserved. MSC: 62K10; 62F10; 62F12; 62F03; 62F35 Keywords: Experimental design; Non-normality; Generalized secant hyperbolic; Modified maximum likelihood; Linear contrast; Robustness 1. Introduction Analysis of variance procedures have traditionally been based on the assumption of normality. In practice, however, non-normal distributions occur so frequently. A number of studies have been made to investigate the effect of nonnormality on the test statistics used in analysis of variance. The effect of non-normality on Type I error was studied in [11,7,6,2,9,3,15]. The effect of non-normality on power of the test was studied in [4,13,5,18]. They concluded that the effect of moderate non-normality on Type I error is not very serious but the power is adversely affected; the values of the power are, in fact, considerably smaller than under normality if, particularly, the kurtosis of the underlying distribution is different than 3 (kurtosis of normal). The above investigations for symmetric non-normal distributions have been carried out when the mathematical forms of short-tailed distributions (kurtosis less than 3) and long-tailed distributions (kurtosis greater than 3) are quite distinct from one another, e.g., the former is uniform and the latter is Student s t [22, Chapter 1]. The purpose of this paper is to present unified results by considering the family of generalized secant hyperbolic (GSH) distributions. The properties of GSH distributions have been studied by Vaughan [24]. They represent both short-tailed and long-tailed symmetric distributions with kurtosis ranging from 1.8 to 9 and include logistic as a particular case, uniform as a limiting case, and closely approximate the normal and Student s t distributions. Maximum Corresponding author. Department of Statistics, Middle East Technical University, Ankara, Turkey. Tel.: ; fax: address: akkay@metu.edu.tr (A.D. Akkaya) /$ - see front matter 2007 Elsevier B.V. All rights reserved. doi: /j.cam

2 546 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) likelihood estimators being intractable [12,24], we derive modified maximum likelihood (MML) estimators of block effects (and scale parameter) in the framework of one-way classification experimental design and show that they are asymptotically fully efficient. We also study their properties for small sample sizes n and show that they are in general considerably more efficient than the normal theory (i.e., least squares) estimators. In fact the least squares estimators have a disconcerting feature, namely, their efficiencies relative to the MML estimators decrease as the sample size in a block increases. A test statistic analogous to the normal-theory F statistic is defined to test block effects. We also define a test statistic for testing linear contrasts. It is shown that test statistics based on MML estimators are efficient and robust. The methodology obtained readily extends to unbalanced designs. 2. One-way classification model Consider the one-way classification fixed-effects model y ij = μ + τ i + e ij (i = 1, 2,...,k; j = 1, 2,...,n), (2.1) having k blocks with n observations in each block; y ij is the jth observation in the ith block, μ is the overall mean, τ i is the ith block effect, and e ij are iid random errors. In the fixed effects model, τ i are defined as deviations from their overall mean. Thus, k τ i = 0. In (2.1), suppose that e ij are iid and have GSH distribution [24] GSH(0, ; t): f(e)= c 1 exp(c 2 e/) exp(2c 2 e/) + 2a exp(c 2 e/) + 1 where for π <t 0: a = cos(t), c 2 = (π 2 t 2 )/3 and c 1 = sin(t) t c 2 ( <e< ), (2.2) and for t>0: a = cosh(t), c 2 = (π 2 + t 2 )/3 and c 1 = sinh(t) c 2. t For t > π, t < π and t = π, GSH(0, ; t) represents short-tailed, long-tailed and approximately normal distributions, respectively; is the scale parameter and t is a nuisance parameter. The coefficient of kurtosis, β 2 = μ 4 /μ 2 2, is given below for a few representative values of the shape parameter, t: t= π 2/3 π/2 0 π π 11 β 2 = The likelihood function is L = cn 1 N k n exp(c 2 z ij ) exp(2c 2 z ij ) + 2a exp(c 2 z ij ) + 1, (2.3) where N = nk, z ij = y ij μ τ i (1 i k, 1 j n). Let y i(1) y i(2) y i(n) (1 i k) be the order statistics of the n observations y ij (1 j n) in the ith block. Then z i(j) = (y i(j) μ τ i )/ (1 i k) are the ordered z ij (1 j n) variates. Since complete sums are invariant to ordering, the likelihood equations for estimating μ, τ i (1 i k) and can be expressed in terms of z i(j) as follows: ln L μ = N c c 2 ln L = n c 2 τ i + 2 c 2 g(z i(j) ) = 0, g(z i(j) ) = 0 (2.4) j=1

3 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) and ln L = N 1 c 2 z i(j) + 2 c 2 z i(j) g(z i(j) ) = 0. where g(z) = (exp(2c 2 z) + a exp(c 2 z))/(exp(2c 2 z) + 2a exp(c 2 z) + 1). Eqs. (2.4) do not admit explicit solutions because of the terms involving the non-linear function g(z). Solving these equations by iteration is difficult and time consuming since there are k + 1 equations to solve iteratively. To alleviate these difficulties, we use the method of modified maximum likelihood due to Tiku [16,17] and Tiku and Suresh [21]. This method gives explicit and highly efficient estimators [14,20,22,23]. 3. The MML estimators Let t i(j) = E(z i(j) ) be the expected value of the jth order statistic z i(j) in the ith block. Since the function g(z) is almost linear in small intervals a<z<b[16,17] and z i(j) is located in the vicinity of t i(j) = E(z i(j) ) at any rate for large n, an appropriate linear approximation for g(z i(j) )(1 i k) is obtained by using the first two terms of a Taylor series expansion, namely g(z i(j) ) g(t i(j) ) + g (t i(j) )(z i(j) t i(j) ) = α i(j) + β i(j) z i(j) (1 j n), (3.1) where α i(j) = g(t i(j) ) β i(j) t i(j) and β i(j) = g (t i(j) ). Here, t 1(j) = t 2(j) = =t k(j) = t (j), α 1(j) = α 2(j) = =α k(j) = α j, β 1(j) = β 2(j) = =β k(j) = β j for all j = 1, 2,...,n (3.2) and α j = exp(2c 2t (j) ) + a exp(c 2 t (j) ) exp(2c 2 t (j) ) + 2a exp(c 2 t (j) ) + 1 β j t (j), (3.3) β j = ac 2 exp(3c 2 t (j) ) + 2c 2 exp(2c 2 t (j) ) + ac 2 exp(c 2 t (j) ) [exp(2c 2 t (j) ) + 2a exp(c 2 t (j) ) + 1] 2. (3.4) If β j < 0 then we set β j = 0 [24]. Thus, ˆ in (3.6) is always real and positive. It may be noted that n j=1 α j = n/2 and nj=1 β j t (j) = 0. Remark. It may be noted that the coefficients β j have inverted umbrella ordering (i.e., they increase until the middle value and then decrease in a symmetric fashion) when the GSH(0, ; t) represents short-tailed distributions. The coefficients β j have umbrella ordering when the GSH(0, ; t) represents long-tailed and approximately normal distributions. This gives MML estimators excellent robustness properties. Although the formulation to find the exact values of expected values t (j),1 j n, is available [24], it is difficult to implement. Therefore, we use their following approximate values which is often done in practice [12,20,25]: t (j) = 1 c 2 ln[sin(tq j )/ sin(t(1 q j ))], π <t<0 3 = π ln(q j /(1 q j )), t = 0 = 1 ln[sinh(tq c j )/ sinh(t(1 q j ))], t >0, (3.5) 2 where q j = j/(n + 1).

4 548 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) The use of these approximate values in place of the exact values does not affect the efficiency of the MML estimators in any substantial way. Incorporating (3.1) in (2.4), the modified maximum likelihood equations are obtained. These equations are asymptotically equivalent to the corresponding likelihood equations (2.4) under very general regularity conditions [25] and their solutions are the following MML estimators: ˆμ =ˆμ.., ˆτ i =ˆμ i ˆμ and ˆ = B + B 2 + 4NC 2 N(N k) (bias corrected), (3.6) where ˆμ.. = 1 km β j y i(j), ˆμ i = 1 m β j y i(j), m= β j, B = Nc 2 (ȳ.. ȳ a ), j=1 C = 2c 2 β j (y i(j) ˆμ ˆτ i ) 2, ȳ.. = 1 N y i(j), ȳ a = 2 N α j y i(j). The estimators are explicit functions of sample observations and therefore easy to compute. 4. Efficiency The estimator ˆμ i is unbiased for all n; follows from symmetry. Moreover, ˆμ i is the best asymptotically normal (BAN) estimator; see Appendix A. Given in Table 1 are the simulated variances of the MML estimator ˆμ i of μ i (1 i k), relative efficiency (RE) of the LS estimator μ i =ȳ i, the minimum variance bound (MVB) V 11 (Appendix A) for estimating μ i and the efficiency (Eff) of ˆμ i. From the values of the relative efficiencies RE( μ i ), it is concluded that the MML estimator ˆμ i is considerably more efficient than the LS estimator μ i for all n other than the GSH distribution with t =π. This distribution is indistinguishable from normal and that is the reason for μ i to be highly efficient; however, ˆμ i being asymptotically fully efficient, it takes a lead as n increases and is a little more efficient for n 20. From the values of the efficiencies Eff(ˆμ i ), it is concluded that for all the distributions the variances of ˆμ i steadily decrease as n increases and attain subsequently the minimum variance bounds V 11 (Appendix A). As a result, ˆμ i is 100% efficient for large n. For some of the distributions, in fact, ˆμ i is almost 100% efficient even for moderate sample sizes (say, n 20). Table 1 Variances of the MML estimator and the relative efficiencies of the LS estimator: (1) V(ˆμ i )/ 2 ; (2) RE( μ i )=[V(ˆμ i )/V ( μ i )] 100; (3) MVB(μ i )/ 2 ; (4) Eff( ˆμ i ) =[MVB(μ i )/V ( ˆμ i )] 100 k = 4 β 2 = n = 6 (1) (2) (3) (4) n = 10 (1) (2) (3) (4) n = 20 (1) (2) (3) (4)

5 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) Table 2 Variances of the LS and M-estimators of μ: (1) V( μ)/ 2 ; (2) V(ˆμ w )/ 2 k = 1 β 2 = n = 6 (1) (2) n = 10 (1) (2) n = 20 (1) (2) M-estimators A class of robust estimators of the location parameter μ that are known to be considerably more efficient [20, p. 181] than sample median based estimators (e.g., Tukey s median polish estimator) are called M-estimators and are due to Huber [10]. The most prominent from this class is [10] the wave estimator ˆμ w. The equation for calculating ˆμ w is given in [19, p. 130] reproduced from [8]. Like the MML estimator ˆμ and the LS estimator μ, ˆμ w is unbiased for all symmetric distributions. To compare the efficiency of ˆμ w with ˆμ and μ for the family (2.2), we simulated their variances. The simulated values are given in Table 2 for ˆμ w and μ and in Table 1 for ˆμ. All the simulated values in this paper are based on [100, 000/n] (integer value) Monte Carlo runs. It can be seen that ˆμ has the smallest variances and is, therefore, the most efficient. The M-estimator ˆμ w is more efficient than the LS estimator μ only for long-tailed distributions (kurtosis β 2 > 3). Since ˆμ w is not predominantly more efficient than μ for the family (2.2), we do not consider it any further. Besides, the distribution of ˆμ w is intractable for small n [22, p. 138]. That is due to the fact that the method implicitly censors a number (which is not the same for every sample of size n) of observations [20,22]. 5. Testing block effects To test equality of block effects, that is, to test the null hypothesis H 0 : τ 1 = τ 2 = =τ k = 0 against H 1 : τ i = 0 for some i = 1, 2,...,k, the following decomposition of total sum of squares S T is used: S T = S b + S e, S T = 2c 2 β j (y i(j) ˆμ) 2, S b = 2c 2 m (ˆμ i ˆμ) 2 and S e = 2c 2 β j (y i(j) ˆμ i ) 2. (5.1) S T / 2 and S b / 2 are for large n distributed as chi-squares with N 1 and k 1 degrees of freedom, respectively, and irrespective of H 0 and H 1, S e / 2 is distributed as chi-square with N k degrees of freedom (Appendix A). Since S b / 2 and S e / 2 are independently distributed chi-square random variables, for large n, the null distribution of the ratio kˆτ 2 i W = S b/(k 1) S e /(N k) 2c 2m (k 1)ˆ 2 (5.2) is central F with (k 1, N k) degrees of freedom. The distribution of W under H 1 is non-central F with (k 1, N k) degrees of freedom and non-centrality parameter λ 2 W = 2c 2m k (τ i /) 2 for large n. Large values of W lead to the rejection of H 0 in favour of H 1. The normal-theory test statistic for testing H 0 is F = ((N k)/(k 1)) k τ 2 i / k nj=1 (y ij μ i ) 2 having F distribution with k 1 and N k degrees of freedom. Under H 1, it is distributed as non-central F with k 1 and N k degrees of freedom and non-centrality parameter λ 2 F = k (τ i /) 2. Since λ 2 W > λ2 F, the W-test is more powerful than the F-test. This was to be expected since more efficient estimators are used in the W-test.

6 550 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) Testing linear contrasts The W-test gives an overall assessment whether block differences exist or not. If the W statistic is not significantly large, that does not necessarily imply that no block differences exist. It is, therefore, always advisable to construct linear contrasts to assesss the block differences [20]. A linear function L = k l i τ i = k l i μ i is called linear contrast if k l i = 0. A linear contrast represents a comparison between μ i (1 i k). The MML estimator of the linear contrast L = k l i μ i is k l i ˆμ i with variance 2mc 2 k 2 li 2, for large n. Since ˆμ i are asymptotically normally distributed and ˆ converges to as n becomes large, the distribution of the statistic k 2mc2 l i ˆμ T = i k ˆ li 2 (6.1) is asymptotically normal N(0, 1), under the null hypothesis H 0 : k l i μ i = 0. Large values of T lead to the rejection of H 0. The asymptotic power function of the test is (with Type I error α) 1 β P( Z z α/2 λ T ), (6.2) where Z is a standard normal variate and λ 2 T = 2mc 2( k l i μ i ) 2 / 2 k li 2 is the non-centrality parameter. Note that the normal-theory statistic for testing H 0 is t = n L/. The null distribution of this statistic for large n is Student s t with k(n 1) degrees of freedom and its distribution under the alternative hypothesis is non-central t with k(n 1) degrees of freedom and non-centrality parameter λ 2 t = nl 2 / 2. Since λ 2 T > λ2 t, the T-test is more powerful than the t-test, for large n. 7. Robustness of estimators and tests Since deviations from an assumed model are very common, the issue of robustness becomes important. An estimator is called robust if it is fully efficient (or nearly so) for an assumed distribution and maintains high efficiency for plausible alternatives. A test is said to have criterion robustness if its Type I error is not substantially higher than a pre-specified level and is said to have efficiency robustness if its power is high, at any rate for plausible alternatives to an assumed distribution [22, Preface, 21, Preface]. To illustrate the robustness of both the MML estimators and the tests based on them we consider, for illustration, the following plausible alternatives (1) (5) to the assumed distribution GSH in (2.2) with t = π/2: Misspecification of the distribution: (1) GSH(μ,, π/4). Dixon s outlier model: (2) (n 1) observations come from GSH(μ,, π/2) but one observation (we do not know which one) comes from GSH(μ, 4, π/2). Mixture model: (3) 0.90 GSH(μ,, π,/2) GSH(μ, 4, π/2). Contamination model: (4) 0.90 GSH(μ,, π/2) Uniform( 1/2, 1/2). (5) Normal distribution with mean μ and standard deviation. Note that the coefficients α j and β j in (1) (5) are computed from (2.3) with t = π/2, the assumed distribution. The simulated variances of μ i and ˆμ i are given in Table 3. Also given are the values of the relative efficiency of the LS estimator of μ i. It can be seen that the MML estimator ˆμ i is remarkably efficient and robust. For the normal Table 3 Variances and relative efficiencies: n = 10, = 1 Model Variance RE μ i ˆμ i μ i (1) (2) (3) (4) (5)

7 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) Table 4 Values of Type I error and power for the W and F-tests: d = τ 1 /, τ 2 = d, τ 3 = τ 4 = 0; = 1, k = 4, n = 10 Alternative models (1) (2) (3) (4) d F W d F W d F W d F W distribution, of course, ˆμ i is somewhat less efficient as expected since μ i is the MVB estimator. To show the robustness property of the W-test, the simulated values of the Type I error and power are given in Table 4. It may be noted that the W-test has a double advantage: it has not only smaller Type I error but has also higher power than the F-test. The T-test based on the MMLE for testing linear contrasts has efficiency and robustness properties exactly similar to those in Table 4. We do not reproduce details for conciseness. For the normal distribution, the W-test is a little less powerful as expected since the F-test is known to be UMP (uniformly most powerful). 8. Unbalanced design The methodology readily extends to unbalanced designs, the number of observations in the ith block being n i (1 i k). Without loss of generality, assume k m i τ i = 0 where m i = n i j=1 β i(j) and β i(j) is the coefficient β j in (3.4) with n = n i (1 i k). The MML estimators in (3.6) are exactly similar to those for balanced designs with obvious changes such as ˆμ.. = 1 M m i ˆμ i, ˆμ i = 1 n i n i β m i(j) y i(j), M = m i, C = 2c 2 β i(j) (y i(j) ˆμ ˆτ i ) 2, i j=1 ȳ = 1 n i y i(j), ȳ a = 2 n i α i(j) y i(j), N = n i and N N α i(j) is the coefficient α j in (3.3) with n = n i (1 i k). (8.1) To test equality of block effects, the variance ratio statistic is W = 2c k 2 m i ˆτ 2 i (k 1)ˆ 2. (8.2) The null distribution of W for large n i (1 i k) is central F with (k 1,N k) degrees of freedom and the distribution of W under H 1 is non-central F with (k 1,N k) degrees of freedom and non-centrality parameter λ 2 W = 2c k 2 (m i τ i /) 2. The W-test has exactly similar robustness properties as the test statistic (5.2). In testing a linear contrast, the T-test statistic is k 2c2 l i ˆμ T = i ˆ k li 2 m i (8.3)

8 552 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) and is asymptotically normal N(0, 1), under the null hypothesis H 0 : k l i μ i = 0. The non-centrality parameter in (6.2) becomes λ 2 T = 2c 2( k l i μ i ) 2 / 2 k (l 2 i /m i). Acknowledgment This research work was supported by the Scientific and Technical Research Council of Turkey under grant: TBAG (103T033). Thanks are due to the referees for helpful comments. Appendix A. A.1. Information matrix The Fisher information matrix for one-way classification model is ( ) 2 ( ln L 2 ) ln L E μ 2 E μ I = i i ( 2 ) ( ln L 2 ) ln L, E E μ i 2 where E( 2 ln L/ μ i ) = 0, ( ) 2 ln L for π <t<0, E μ 2 i ( 2 ) ln L E 2 = N ( π 2 t sin 2 t ( ) 2 ln L for t 0, E μ 2 i = c2 2n(t sin t cos t) 2 2 tsin 2 t (π2 3t 2 ) ) cos t t sin t = c2 2n(sinh t cosh t t) 2 2 tsinh 2 t ( 2 ) ln L E 2 = N ( (π 2 + 3t 2 ) cosh t 6 2 π2 + t 2 ) t sinh t sinh 2. t The variance covariance matrix is V = I 1 = (V ij ), where 1 V 11 = E( 2 ln L/ μ 2 i ), V 1 12 = V 21 = 0 and V 22 = E( 2 ln L/ 2 ). (A.1) A.2. Asymptotic properties A.2.1. One-way clasification model Lemma 1. Asymptotically, the estimator ˆμ i =ˆμ i. is BAN with variance V(ˆμ i ) 2 2mc 2. (A.2) Proof. Since ln L / μ i is asymptotically equivalent to ln L/ μ i and assumes the form ln L = 2mc 2 μ i 2 (ˆμ i μ i ), (A.3) [ ] and E r ln L = 0 for all r 3, the result follows [1]. μ r i

9 Y.E. Yilmaz, A.D. Akkaya / Journal of Computational and Applied Mathematics 216 (2008) Corollary 1. The estimator ˆμ =ˆμ.. is BAN with variance 2 V(ˆμ). 2kmc 2 (A.4) Corollary 2. Since ˆμ i (1 i k) are independent of each other and ˆμ = (1/k) k ˆμ i, (k 1)2 V(ˆτ i ). (A.5) 2kmc 2 Remark. The estimators ˆτ i and ˆ are uncorrelated and since E( r+s ln L / τ r i s ) = 0 for all r 1 and s 1, they are independent of each other, asymptotically [1]. Lemma 2. Asymptotically, N ˆ 2 (μ i )/ 2 is conditionally (μ i = μ + τ i ) distributed as chi-square with N degrees of freedom. Proof. For large n, B/ nc 1 0 where C 1 = 2c k nj=1 2 β j (y i(j) μ i ) 2. Therefore, ln L / assumes the form ln L N ( ) C1 3 N 2. (A.6) Evaluation of the cumulants of ln L / in terms of the expected values of the derivatives of ln L / immediately leads to the result that N ˆ 2 (μ i )/ 2 is distributed as chi-square with N degrees of freedom [1,20,22]. Corollary 3. Asymptotically, N ˆ 2 / 2 is distributed as chi-square with N k degrees of freedom. References [1] M.S. Bartlett, Approximate confidence intervals, Biometrika 40 (1953) [2] G.E.P. Box, S.L. Andersen, Permutation theory in the derivation of robust criteria and the study of departures from assumption, J. Roy. Statist. Soc. B 17 (1955) [3] G.E.P. Box, G.S. Watson, Robustness to non-normality of regression tests, Biometrika 49 (1962) [4] F.N. David, N.L. Johnson, The effect of non-normality on the power function of the F-test in the analysis of variance, Biometrika 58 (1951) [5] T.S. Donaldson, Robustness of the F-test to errors of both kinds and the correlation between the numerator and denominator of the F-ratio, J. Amer. Statist. Assoc. 63 (1968) [6] A.K. Gayen, The distribution of the variance ratio in random samples of any size drawn from non-normal universes, Biometrika 37 (1950) [7] R.C. Geary, Testing for normality, Biometrika 34 (1947) [8] A.M. Gross, Confidence interval robustness with long-tailed symmetric distributions, J. Amer. Statist. Assoc. 71 (1976) [9] H.R.B. Hack, An empirical investigation into the distribution of the F-ratio in samples from two non-normal populations, Biometrika 45 (1958) [10] P.J. Huber, Robust estimation of a location parameter, Ann. Math. Statist. 35 (1964) [11] E.S. Pearson, The analysis of variance in cases of non-normal variation, Biometrika 23 (1931) [12] B. Senoglu, M.L. Tiku, Analysis of variance in experimental design with non-normal error distributions, Comm. Statist. Theory Methods 30 (2001) [13] A.B.L. Srivastava, Effect of non-normality on the power of the analysis of variance test, Biometrika 46 (1959) [14] W.Y. Tan, On Tiku s robust procedure-a Bayesian insight, J. Statist. Plann. Inference 11 (1985) [15] M.L. Tiku, Approximating the general non-normal variance ratio sampling distributions, Biometrika 51 (1964) [16] M.L. Tiku, Estimating the mean and standard deviation from a censored normal sample, Biometrika 54 (1967) [17] M.L. Tiku, Estimating the parameters of log-normal distribution from censored samples, J. Amer. Statist. Assoc. 63 (1968) [18] M.L. Tiku, Power function of the F -test under non-normal situations, J. Amer. Statist. Assoc. 66 (1971) [19] M.L. Tiku, Robustness of MML estimators based on censored samples and robust test statistics, J. Statist. Plann. Inference 4 (1980) [20] M.L. Tiku, A.D. Akkaya, Robust Estimation and Hypothesis Testing, New Age International Publishers (Wiley Eastern), New Delhi, [21] M.L. Tiku, R.P. Suresh, A new method of estimation for location and scale parameters, J. Statist. Plann. Inference 30 (1992) [22] M.L. Tiku, W.Y. Tan, N. Balakrishnan, Robust Inference, Marcel Dekker, New York, [23] D.C. Vaughan, On the Tiku-Suresh method of estimation, Comm. Statist. Theory Methods 21 (1992) [24] D.C. Vaughan, The generalized secant hyperbolic distribution and its properties, Comm. Statist. Theory Methods 31 (2002) [25] D.C. Vaughan, M.L. Tiku, Estimation and hypothesis testing for a non-normal bivariate distribution with applications, J. Math. Comput. Modeling 32 (2000)

COMPARISON OF THE ESTIMATORS OF THE LOCATION AND SCALE PARAMETERS UNDER THE MIXTURE AND OUTLIER MODELS VIA SIMULATION

COMPARISON OF THE ESTIMATORS OF THE LOCATION AND SCALE PARAMETERS UNDER THE MIXTURE AND OUTLIER MODELS VIA SIMULATION (REFEREED RESEARCH) COMPARISON OF THE ESTIMATORS OF THE LOCATION AND SCALE PARAMETERS UNDER THE MIXTURE AND OUTLIER MODELS VIA SIMULATION Hakan S. Sazak 1, *, Hülya Yılmaz 2 1 Ege University, Department

More information

Testing for a unit root in an ar(1) model using three and four moment approximations: symmetric distributions

Testing for a unit root in an ar(1) model using three and four moment approximations: symmetric distributions Hong Kong Baptist University HKBU Institutional Repository Department of Economics Journal Articles Department of Economics 1998 Testing for a unit root in an ar(1) model using three and four moment approximations:

More information

STOCHASTIC COVARIATES IN BINARY REGRESSION

STOCHASTIC COVARIATES IN BINARY REGRESSION Hacettepe Journal of Mathematics and Statistics Volume 33 2004, 97 109 STOCHASTIC COVARIATES IN BINARY REGRESSION Evrim Oral and Süleyman Günay Received 27 : 04 : 2004 : Accepted 23 : 09 : 2004 Abstract

More information

Robust factorial ANCOVA with LTS error distributions

Robust factorial ANCOVA with LTS error distributions Hacettepe Journal of Mathematics and Statistics Volume 47 (2) (2018), 347 363 Robust factorial ANCOVA with LTS error distributions Şükrü Acıtaş and Birdal Şenoğlu Abstract In this study, parameter estimation

More information

f(x µ, σ) = b 2σ a = cos t, b = sin t/t, π < t 0, a = cosh t, b = sinh t/t, t > 0,

f(x µ, σ) = b 2σ a = cos t, b = sin t/t, π < t 0, a = cosh t, b = sinh t/t, t > 0, R-ESTIMATOR OF LOCATION OF THE GENERALIZED SECANT HYPERBOLIC DIS- TRIBUTION O.Y.Kravchuk School of Physical Sciences and School of Land and Food Sciences University of Queensland Brisbane, Australia 3365-2171

More information

Modified maximum likelihood estimation of parameters in the log-logistic distribution under progressive Type II censored data with binomial removals

Modified maximum likelihood estimation of parameters in the log-logistic distribution under progressive Type II censored data with binomial removals Modified maximum likelihood estimation of parameters in the log-logistic distribution under progressive Type II censored data with binomial removals D.P.Raykundaliya PG Department of Statistics,Sardar

More information

Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples

Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples 90 IEEE TRANSACTIONS ON RELIABILITY, VOL. 52, NO. 1, MARCH 2003 Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples N. Balakrishnan, N. Kannan, C. T.

More information

Research Article A Nonparametric Two-Sample Wald Test of Equality of Variances

Research Article A Nonparametric Two-Sample Wald Test of Equality of Variances Advances in Decision Sciences Volume 211, Article ID 74858, 8 pages doi:1.1155/211/74858 Research Article A Nonparametric Two-Sample Wald Test of Equality of Variances David Allingham 1 andj.c.w.rayner

More information

Applied Mathematics Research Report 07-08

Applied Mathematics Research Report 07-08 Estimate-based Goodness-of-Fit Test for Large Sparse Multinomial Distributions by Sung-Ho Kim, Heymi Choi, and Sangjin Lee Applied Mathematics Research Report 0-0 November, 00 DEPARTMENT OF MATHEMATICAL

More information

Application of Variance Homogeneity Tests Under Violation of Normality Assumption

Application of Variance Homogeneity Tests Under Violation of Normality Assumption Application of Variance Homogeneity Tests Under Violation of Normality Assumption Alisa A. Gorbunova, Boris Yu. Lemeshko Novosibirsk State Technical University Novosibirsk, Russia e-mail: gorbunova.alisa@gmail.com

More information

A nonparametric two-sample wald test of equality of variances

A nonparametric two-sample wald test of equality of variances University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 211 A nonparametric two-sample wald test of equality of variances David

More information

BTRY 4090: Spring 2009 Theory of Statistics

BTRY 4090: Spring 2009 Theory of Statistics BTRY 4090: Spring 2009 Theory of Statistics Guozhang Wang September 25, 2010 1 Review of Probability We begin with a real example of using probability to solve computationally intensive (or infeasible)

More information

A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations

A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations Journal of Statistical Planning and Inference 18 (22) 85 97 www.elsevier.com/locate/jspi A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations J. Fortiana,

More information

ROBUSTNESS OF TWO-PHASE REGRESSION TESTS

ROBUSTNESS OF TWO-PHASE REGRESSION TESTS REVSTAT Statistical Journal Volume 3, Number 1, June 2005, 1 18 ROBUSTNESS OF TWO-PHASE REGRESSION TESTS Authors: Carlos A.R. Diniz Departamento de Estatística, Universidade Federal de São Carlos, São

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester

More information

A Monte-Carlo study of asymptotically robust tests for correlation coefficients

A Monte-Carlo study of asymptotically robust tests for correlation coefficients Biometrika (1973), 6, 3, p. 661 551 Printed in Great Britain A Monte-Carlo study of asymptotically robust tests for correlation coefficients BY G. T. DUNCAN AND M. W. J. LAYAKD University of California,

More information

MARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES

MARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES REVSTAT Statistical Journal Volume 13, Number 3, November 2015, 233 243 MARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES Authors: Serpil Aktas Department of

More information

Inferences on a Normal Covariance Matrix and Generalized Variance with Monotone Missing Data

Inferences on a Normal Covariance Matrix and Generalized Variance with Monotone Missing Data Journal of Multivariate Analysis 78, 6282 (2001) doi:10.1006jmva.2000.1939, available online at http:www.idealibrary.com on Inferences on a Normal Covariance Matrix and Generalized Variance with Monotone

More information

Two-sample scale rank procedures optimal for the generalized secant hyperbolic distribution

Two-sample scale rank procedures optimal for the generalized secant hyperbolic distribution Two-sample scale rank procedures optimal for the generalized secant hyperbolic distribution O.Y. Kravchuk School of Physical Sciences, School of Land and Food Sciences, University of Queensland, Australia

More information

COMPARISON OF FIVE TESTS FOR THE COMMON MEAN OF SEVERAL MULTIVARIATE NORMAL POPULATIONS

COMPARISON OF FIVE TESTS FOR THE COMMON MEAN OF SEVERAL MULTIVARIATE NORMAL POPULATIONS Communications in Statistics - Simulation and Computation 33 (2004) 431-446 COMPARISON OF FIVE TESTS FOR THE COMMON MEAN OF SEVERAL MULTIVARIATE NORMAL POPULATIONS K. Krishnamoorthy and Yong Lu Department

More information

Testing Statistical Hypotheses

Testing Statistical Hypotheses E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions

More information

Application of Parametric Homogeneity of Variances Tests under Violation of Classical Assumption

Application of Parametric Homogeneity of Variances Tests under Violation of Classical Assumption Application of Parametric Homogeneity of Variances Tests under Violation of Classical Assumption Alisa A. Gorbunova and Boris Yu. Lemeshko Novosibirsk State Technical University Department of Applied Mathematics,

More information

Bias Correction of Cross-Validation Criterion Based on Kullback-Leibler Information under a General Condition

Bias Correction of Cross-Validation Criterion Based on Kullback-Leibler Information under a General Condition Bias Correction of Cross-Validation Criterion Based on Kullback-Leibler Information under a General Condition Hirokazu Yanagihara 1, Tetsuji Tonda 2 and Chieko Matsumoto 3 1 Department of Social Systems

More information

Marcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC

Marcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC A Simple Approach to Inference in Random Coefficient Models March 8, 1988 Marcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC 27695-8203 Key Words

More information

GENERALIZED CONFIDENCE INTERVALS FOR THE SCALE PARAMETER OF THE INVERTED EXPONENTIAL DISTRIBUTION

GENERALIZED CONFIDENCE INTERVALS FOR THE SCALE PARAMETER OF THE INVERTED EXPONENTIAL DISTRIBUTION Internation Journ of Latest Research in Science and Technology ISSN (Online):7- Volume, Issue : Page No.-, November-December 0 (speci Issue Paper ) http://www.mnkjourns.com/ijlrst.htm Speci Issue on Internation

More information

AN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY

AN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY Econometrics Working Paper EWP0401 ISSN 1485-6441 Department of Economics AN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY Lauren Bin Dong & David E. A. Giles Department of Economics, University of Victoria

More information

Weighted empirical likelihood estimates and their robustness properties

Weighted empirical likelihood estimates and their robustness properties Computational Statistics & Data Analysis ( ) www.elsevier.com/locate/csda Weighted empirical likelihood estimates and their robustness properties N.L. Glenn a,, Yichuan Zhao b a Department of Statistics,

More information

Spring 2012 Math 541B Exam 1

Spring 2012 Math 541B Exam 1 Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote

More information

Dr. Junchao Xia Center of Biophysics and Computational Biology. Fall /1/2016 1/46

Dr. Junchao Xia Center of Biophysics and Computational Biology. Fall /1/2016 1/46 BIO5312 Biostatistics Lecture 10:Regression and Correlation Methods Dr. Junchao Xia Center of Biophysics and Computational Biology Fall 2016 11/1/2016 1/46 Outline In this lecture, we will discuss topics

More information

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at Some Applications of Exponential Ordered Scores Author(s): D. R. Cox Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 26, No. 1 (1964), pp. 103-110 Published by: Wiley

More information

Minimax design criterion for fractional factorial designs

Minimax design criterion for fractional factorial designs Ann Inst Stat Math 205 67:673 685 DOI 0.007/s0463-04-0470-0 Minimax design criterion for fractional factorial designs Yue Yin Julie Zhou Received: 2 November 203 / Revised: 5 March 204 / Published online:

More information

TESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST

TESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST Econometrics Working Paper EWP0402 ISSN 1485-6441 Department of Economics TESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST Lauren Bin Dong & David E. A. Giles Department

More information

MA 575 Linear Models: Cedric E. Ginestet, Boston University Non-parametric Inference, Polynomial Regression Week 9, Lecture 2

MA 575 Linear Models: Cedric E. Ginestet, Boston University Non-parametric Inference, Polynomial Regression Week 9, Lecture 2 MA 575 Linear Models: Cedric E. Ginestet, Boston University Non-parametric Inference, Polynomial Regression Week 9, Lecture 2 1 Bootstrapped Bias and CIs Given a multiple regression model with mean and

More information

ASSESSING A VECTOR PARAMETER

ASSESSING A VECTOR PARAMETER SUMMARY ASSESSING A VECTOR PARAMETER By D.A.S. Fraser and N. Reid Department of Statistics, University of Toronto St. George Street, Toronto, Canada M5S 3G3 dfraser@utstat.toronto.edu Some key words. Ancillary;

More information

Testing the homogeneity of variances in a two-way classification

Testing the homogeneity of variances in a two-way classification Biomelrika (1982), 69, 2, pp. 411-6 411 Printed in Ortal Britain Testing the homogeneity of variances in a two-way classification BY G. K. SHUKLA Department of Mathematics, Indian Institute of Technology,

More information

REFERENCES AND FURTHER STUDIES

REFERENCES AND FURTHER STUDIES REFERENCES AND FURTHER STUDIES by..0. on /0/. For personal use only.. Afifi, A. A., and Azen, S. P. (), Statistical Analysis A Computer Oriented Approach, Academic Press, New York.. Alvarez, A. R., Welter,

More information

Summary of Chapters 7-9

Summary of Chapters 7-9 Summary of Chapters 7-9 Chapter 7. Interval Estimation 7.2. Confidence Intervals for Difference of Two Means Let X 1,, X n and Y 1, Y 2,, Y m be two independent random samples of sizes n and m from two

More information

Subject CS1 Actuarial Statistics 1 Core Principles

Subject CS1 Actuarial Statistics 1 Core Principles Institute of Actuaries of India Subject CS1 Actuarial Statistics 1 Core Principles For 2019 Examinations Aim The aim of the Actuarial Statistics 1 subject is to provide a grounding in mathematical and

More information

Estimators for the binomial distribution that dominate the MLE in terms of Kullback Leibler risk

Estimators for the binomial distribution that dominate the MLE in terms of Kullback Leibler risk Ann Inst Stat Math (0) 64:359 37 DOI 0.007/s0463-00-036-3 Estimators for the binomial distribution that dominate the MLE in terms of Kullback Leibler risk Paul Vos Qiang Wu Received: 3 June 009 / Revised:

More information

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A. 1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n

More information

Estimation of parametric functions in Downton s bivariate exponential distribution

Estimation of parametric functions in Downton s bivariate exponential distribution Estimation of parametric functions in Downton s bivariate exponential distribution George Iliopoulos Department of Mathematics University of the Aegean 83200 Karlovasi, Samos, Greece e-mail: geh@aegean.gr

More information

Test of fit for a Laplace distribution against heavier tailed alternatives

Test of fit for a Laplace distribution against heavier tailed alternatives DEPARTMENT OF STATISTICS AND ACTUARIAL SCIENCE University of Waterloo, 200 University Avenue West Waterloo, Ontario, Canada, N2L 3G1 519-888-4567, ext. 00000 Fax: 519-746-1875 www.stats.uwaterloo.ca UNIVERSITY

More information

A MODIFICATION OF THE HARTUNG KNAPP CONFIDENCE INTERVAL ON THE VARIANCE COMPONENT IN TWO VARIANCE COMPONENT MODELS

A MODIFICATION OF THE HARTUNG KNAPP CONFIDENCE INTERVAL ON THE VARIANCE COMPONENT IN TWO VARIANCE COMPONENT MODELS K Y B E R N E T I K A V O L U M E 4 3 ( 2 0 0 7, N U M B E R 4, P A G E S 4 7 1 4 8 0 A MODIFICATION OF THE HARTUNG KNAPP CONFIDENCE INTERVAL ON THE VARIANCE COMPONENT IN TWO VARIANCE COMPONENT MODELS

More information

Spatial autoregression model:strong consistency

Spatial autoregression model:strong consistency Statistics & Probability Letters 65 (2003 71 77 Spatial autoregression model:strong consistency B.B. Bhattacharyya a, J.-J. Ren b, G.D. Richardson b;, J. Zhang b a Department of Statistics, North Carolina

More information

A note on profile likelihood for exponential tilt mixture models

A note on profile likelihood for exponential tilt mixture models Biometrika (2009), 96, 1,pp. 229 236 C 2009 Biometrika Trust Printed in Great Britain doi: 10.1093/biomet/asn059 Advance Access publication 22 January 2009 A note on profile likelihood for exponential

More information

7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between

7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between 7.2 One-Sample Correlation ( = a) Introduction Correlation analysis measures the strength and direction of association between variables. In this chapter we will test whether the population correlation

More information

COMPARISON OF GMM WITH SECOND-ORDER LEAST SQUARES ESTIMATION IN NONLINEAR MODELS. Abstract

COMPARISON OF GMM WITH SECOND-ORDER LEAST SQUARES ESTIMATION IN NONLINEAR MODELS. Abstract Far East J. Theo. Stat. 0() (006), 179-196 COMPARISON OF GMM WITH SECOND-ORDER LEAST SQUARES ESTIMATION IN NONLINEAR MODELS Department of Statistics University of Manitoba Winnipeg, Manitoba, Canada R3T

More information

Continuous Univariate Distributions

Continuous Univariate Distributions Continuous Univariate Distributions Volume 2 Second Edition NORMAN L. JOHNSON University of North Carolina Chapel Hill, North Carolina SAMUEL KOTZ University of Maryland College Park, Maryland N. BALAKRISHNAN

More information

Least Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error Distributions

Least Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error Distributions Journal of Modern Applied Statistical Methods Volume 8 Issue 1 Article 13 5-1-2009 Least Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error

More information

Testing Statistical Hypotheses

Testing Statistical Hypotheses E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........

More information

High-dimensional asymptotic expansions for the distributions of canonical correlations

High-dimensional asymptotic expansions for the distributions of canonical correlations Journal of Multivariate Analysis 100 2009) 231 242 Contents lists available at ScienceDirect Journal of Multivariate Analysis journal homepage: www.elsevier.com/locate/jmva High-dimensional asymptotic

More information

A Very Brief Summary of Statistical Inference, and Examples

A Very Brief Summary of Statistical Inference, and Examples A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2009 Prof. Gesine Reinert Our standard situation is that we have data x = x 1, x 2,..., x n, which we view as realisations of random

More information

CONDITIONS FOR ROBUSTNESS TO NONNORMALITY ON TEST STATISTICS IN A GMANOVA MODEL

CONDITIONS FOR ROBUSTNESS TO NONNORMALITY ON TEST STATISTICS IN A GMANOVA MODEL J. Japan Statist. Soc. Vol. 37 No. 1 2007 135 155 CONDITIONS FOR ROBUSTNESS TO NONNORMALITY ON TEST STATISTICS IN A GMANOVA MODEL Hirokazu Yanagihara* This paper presents the conditions for robustness

More information

Psychology 282 Lecture #4 Outline Inferences in SLR

Psychology 282 Lecture #4 Outline Inferences in SLR Psychology 282 Lecture #4 Outline Inferences in SLR Assumptions To this point we have not had to make any distributional assumptions. Principle of least squares requires no assumptions. Can use correlations

More information

5 Introduction to the Theory of Order Statistics and Rank Statistics

5 Introduction to the Theory of Order Statistics and Rank Statistics 5 Introduction to the Theory of Order Statistics and Rank Statistics This section will contain a summary of important definitions and theorems that will be useful for understanding the theory of order

More information

Nonresponse weighting adjustment using estimated response probability

Nonresponse weighting adjustment using estimated response probability Nonresponse weighting adjustment using estimated response probability Jae-kwang Kim Yonsei University, Seoul, Korea December 26, 2006 Introduction Nonresponse Unit nonresponse Item nonresponse Basic strategy

More information

The University of Hong Kong Department of Statistics and Actuarial Science STAT2802 Statistical Models Tutorial Solutions Solutions to Problems 71-80

The University of Hong Kong Department of Statistics and Actuarial Science STAT2802 Statistical Models Tutorial Solutions Solutions to Problems 71-80 The University of Hong Kong Department of Statistics and Actuarial Science STAT2802 Statistical Models Tutorial Solutions Solutions to Problems 71-80 71. Decide in each case whether the hypothesis is simple

More information

ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION

ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ZHENLINYANGandRONNIET.C.LEE Department of Statistics and Applied Probability, National University of Singapore, 3 Science Drive 2, Singapore

More information

Bayesian inference for sample surveys. Roderick Little Module 2: Bayesian models for simple random samples

Bayesian inference for sample surveys. Roderick Little Module 2: Bayesian models for simple random samples Bayesian inference for sample surveys Roderick Little Module : Bayesian models for simple random samples Superpopulation Modeling: Estimating parameters Various principles: least squares, method of moments,

More information

A Very Brief Summary of Statistical Inference, and Examples

A Very Brief Summary of Statistical Inference, and Examples A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2008 Prof. Gesine Reinert 1 Data x = x 1, x 2,..., x n, realisations of random variables X 1, X 2,..., X n with distribution (model)

More information

Review of Statistics 101

Review of Statistics 101 Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods

More information

Institute of Actuaries of India

Institute of Actuaries of India Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics For 2018 Examinations Subject CT3 Probability and Mathematical Statistics Core Technical Syllabus 1 June 2017 Aim The

More information

A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky

A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky Empirical likelihood with right censored data were studied by Thomas and Grunkmier (1975), Li (1995),

More information

The Goodness-of-fit Test for Gumbel Distribution: A Comparative Study

The Goodness-of-fit Test for Gumbel Distribution: A Comparative Study MATEMATIKA, 2012, Volume 28, Number 1, 35 48 c Department of Mathematics, UTM. The Goodness-of-fit Test for Gumbel Distribution: A Comparative Study 1 Nahdiya Zainal Abidin, 2 Mohd Bakri Adam and 3 Habshah

More information

Statistical Inference: Estimation and Confidence Intervals Hypothesis Testing

Statistical Inference: Estimation and Confidence Intervals Hypothesis Testing Statistical Inference: Estimation and Confidence Intervals Hypothesis Testing 1 In most statistics problems, we assume that the data have been generated from some unknown probability distribution. We desire

More information

PARAMETRIC TESTS OF PERFECT JUDGMENT RANKING BASED ON ORDERED RANKED SET SAMPLES

PARAMETRIC TESTS OF PERFECT JUDGMENT RANKING BASED ON ORDERED RANKED SET SAMPLES REVSTAT Statistical Journal Volume 16, Number 4, October 2018, 463 474 PARAMETRIC TESTS OF PERFECT JUDGMENT RANKING BASED ON ORDERED RANKED SET SAMPLES Authors: Ehsan Zamanzade Department of Statistics,

More information

Long-Run Covariability

Long-Run Covariability Long-Run Covariability Ulrich K. Müller and Mark W. Watson Princeton University October 2016 Motivation Study the long-run covariability/relationship between economic variables great ratios, long-run Phillips

More information

ISSN Some aspects of stability in time series small sample case

ISSN Some aspects of stability in time series small sample case Journal Afrika Statistika Journal Afrika Statistika Vol. 5, N 8, 2010, page 252 259. ISSN 0852-0305 Some aspects of stability in time series small sample case Hocine Fellag Laboratory of Pure and Applied

More information

On robust and efficient estimation of the center of. Symmetry.

On robust and efficient estimation of the center of. Symmetry. On robust and efficient estimation of the center of symmetry Howard D. Bondell Department of Statistics, North Carolina State University Raleigh, NC 27695-8203, U.S.A (email: bondell@stat.ncsu.edu) Abstract

More information

Efficient Robbins-Monro Procedure for Binary Data

Efficient Robbins-Monro Procedure for Binary Data Efficient Robbins-Monro Procedure for Binary Data V. Roshan Joseph School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332-0205, USA roshan@isye.gatech.edu SUMMARY

More information

Stat 5101 Lecture Notes

Stat 5101 Lecture Notes Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random

More information

A Multivariate Two-Sample Mean Test for Small Sample Size and Missing Data

A Multivariate Two-Sample Mean Test for Small Sample Size and Missing Data A Multivariate Two-Sample Mean Test for Small Sample Size and Missing Data Yujun Wu, Marc G. Genton, 1 and Leonard A. Stefanski 2 Department of Biostatistics, School of Public Health, University of Medicine

More information

Geometry of Goodness-of-Fit Testing in High Dimensional Low Sample Size Modelling

Geometry of Goodness-of-Fit Testing in High Dimensional Low Sample Size Modelling Geometry of Goodness-of-Fit Testing in High Dimensional Low Sample Size Modelling Paul Marriott 1, Radka Sabolova 2, Germain Van Bever 2, and Frank Critchley 2 1 University of Waterloo, Waterloo, Ontario,

More information

460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses

460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses Statistica Sinica 5(1995), 459-473 OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WHEN THE DEGREE IS NOT KNOWN Holger Dette and William J Studden Technische Universitat Dresden and Purdue University Abstract:

More information

Chapter 1 Statistical Inference

Chapter 1 Statistical Inference Chapter 1 Statistical Inference causal inference To infer causality, you need a randomized experiment (or a huge observational study and lots of outside information). inference to populations Generalizations

More information

Central Limit Theorem ( 5.3)

Central Limit Theorem ( 5.3) Central Limit Theorem ( 5.3) Let X 1, X 2,... be a sequence of independent random variables, each having n mean µ and variance σ 2. Then the distribution of the partial sum S n = X i i=1 becomes approximately

More information

Session 3 The proportional odds model and the Mann-Whitney test

Session 3 The proportional odds model and the Mann-Whitney test Session 3 The proportional odds model and the Mann-Whitney test 3.1 A unified approach to inference 3.2 Analysis via dichotomisation 3.3 Proportional odds 3.4 Relationship with the Mann-Whitney test Session

More information

Minimum Message Length Analysis of the Behrens Fisher Problem

Minimum Message Length Analysis of the Behrens Fisher Problem Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction

More information

POWER AND TYPE I ERROR RATE COMPARISON OF MULTIVARIATE ANALYSIS OF VARIANCE

POWER AND TYPE I ERROR RATE COMPARISON OF MULTIVARIATE ANALYSIS OF VARIANCE POWER AND TYPE I ERROR RATE COMPARISON OF MULTIVARIATE ANALYSIS OF VARIANCE Supported by Patrick Adebayo 1 and Ahmed Ibrahim 1 Department of Statistics, University of Ilorin, Kwara State, Nigeria Department

More information

Confidence Intervals, Testing and ANOVA Summary

Confidence Intervals, Testing and ANOVA Summary Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0

More information

An Introduction to Multivariate Statistical Analysis

An Introduction to Multivariate Statistical Analysis An Introduction to Multivariate Statistical Analysis Third Edition T. W. ANDERSON Stanford University Department of Statistics Stanford, CA WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION Contents

More information

Simulating Uniform- and Triangular- Based Double Power Method Distributions

Simulating Uniform- and Triangular- Based Double Power Method Distributions Journal of Statistical and Econometric Methods, vol.6, no.1, 2017, 1-44 ISSN: 1792-6602 (print), 1792-6939 (online) Scienpress Ltd, 2017 Simulating Uniform- and Triangular- Based Double Power Method Distributions

More information

Sigmaplot di Systat Software

Sigmaplot di Systat Software Sigmaplot di Systat Software SigmaPlot Has Extensive Statistical Analysis Features SigmaPlot is now bundled with SigmaStat as an easy-to-use package for complete graphing and data analysis. The statistical

More information

ROBUST ESTIMATION OF A CORRELATION COEFFICIENT: AN ATTEMPT OF SURVEY

ROBUST ESTIMATION OF A CORRELATION COEFFICIENT: AN ATTEMPT OF SURVEY ROBUST ESTIMATION OF A CORRELATION COEFFICIENT: AN ATTEMPT OF SURVEY G.L. Shevlyakov, P.O. Smirnov St. Petersburg State Polytechnic University St.Petersburg, RUSSIA E-mail: Georgy.Shevlyakov@gmail.com

More information

Practical tests for randomized complete block designs

Practical tests for randomized complete block designs Journal of Multivariate Analysis 96 (2005) 73 92 www.elsevier.com/locate/jmva Practical tests for randomized complete block designs Ziyad R. Mahfoud a,, Ronald H. Randles b a American University of Beirut,

More information

Model Estimation Example

Model Estimation Example Ronald H. Heck 1 EDEP 606: Multivariate Methods (S2013) April 7, 2013 Model Estimation Example As we have moved through the course this semester, we have encountered the concept of model estimation. Discussions

More information

Bootstrap Procedures for Testing Homogeneity Hypotheses

Bootstrap Procedures for Testing Homogeneity Hypotheses Journal of Statistical Theory and Applications Volume 11, Number 2, 2012, pp. 183-195 ISSN 1538-7887 Bootstrap Procedures for Testing Homogeneity Hypotheses Bimal Sinha 1, Arvind Shah 2, Dihua Xu 1, Jianxin

More information

Lecture 2: Linear Models. Bruce Walsh lecture notes Seattle SISG -Mixed Model Course version 23 June 2011

Lecture 2: Linear Models. Bruce Walsh lecture notes Seattle SISG -Mixed Model Course version 23 June 2011 Lecture 2: Linear Models Bruce Walsh lecture notes Seattle SISG -Mixed Model Course version 23 June 2011 1 Quick Review of the Major Points The general linear model can be written as y = X! + e y = vector

More information

University of California, Berkeley

University of California, Berkeley University of California, Berkeley U.C. Berkeley Division of Biostatistics Working Paper Series Year 24 Paper 153 A Note on Empirical Likelihood Inference of Residual Life Regression Ying Qing Chen Yichuan

More information

Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests

Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests Biometrika (2014),,, pp. 1 13 C 2014 Biometrika Trust Printed in Great Britain Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests BY M. ZHOU Department of Statistics, University

More information

A PRACTICAL WAY FOR ESTIMATING TAIL DEPENDENCE FUNCTIONS

A PRACTICAL WAY FOR ESTIMATING TAIL DEPENDENCE FUNCTIONS Statistica Sinica 20 2010, 365-378 A PRACTICAL WAY FOR ESTIMATING TAIL DEPENDENCE FUNCTIONS Liang Peng Georgia Institute of Technology Abstract: Estimating tail dependence functions is important for applications

More information

PROD. TYPE: COM ARTICLE IN PRESS. Computational Statistics & Data Analysis ( )

PROD. TYPE: COM ARTICLE IN PRESS. Computational Statistics & Data Analysis ( ) COMSTA 28 pp: -2 (col.fig.: nil) PROD. TYPE: COM ED: JS PAGN: Usha.N -- SCAN: Bindu Computational Statistics & Data Analysis ( ) www.elsevier.com/locate/csda Transformation approaches for the construction

More information

Statistical Data Analysis Stat 3: p-values, parameter estimation

Statistical Data Analysis Stat 3: p-values, parameter estimation Statistical Data Analysis Stat 3: p-values, parameter estimation London Postgraduate Lectures on Particle Physics; University of London MSci course PH4515 Glen Cowan Physics Department Royal Holloway,

More information

Hypothesis Testing - Frequentist

Hypothesis Testing - Frequentist Frequentist Hypothesis Testing - Frequentist Compare two hypotheses to see which one better explains the data. Or, alternatively, what is the best way to separate events into two classes, those originating

More information

CONVERTING OBSERVED LIKELIHOOD FUNCTIONS TO TAIL PROBABILITIES. D.A.S. Fraser Mathematics Department York University North York, Ontario M3J 1P3

CONVERTING OBSERVED LIKELIHOOD FUNCTIONS TO TAIL PROBABILITIES. D.A.S. Fraser Mathematics Department York University North York, Ontario M3J 1P3 CONVERTING OBSERVED LIKELIHOOD FUNCTIONS TO TAIL PROBABILITIES D.A.S. Fraser Mathematics Department York University North York, Ontario M3J 1P3 N. Reid Department of Statistics University of Toronto Toronto,

More information

Jyh-Jen Horng Shiau 1 and Lin-An Chen 1

Jyh-Jen Horng Shiau 1 and Lin-An Chen 1 Aust. N. Z. J. Stat. 45(3), 2003, 343 352 A MULTIVARIATE PARALLELOGRAM AND ITS APPLICATION TO MULTIVARIATE TRIMMED MEANS Jyh-Jen Horng Shiau 1 and Lin-An Chen 1 National Chiao Tung University Summary This

More information

Linear Models 1. Isfahan University of Technology Fall Semester, 2014

Linear Models 1. Isfahan University of Technology Fall Semester, 2014 Linear Models 1 Isfahan University of Technology Fall Semester, 2014 References: [1] G. A. F., Seber and A. J. Lee (2003). Linear Regression Analysis (2nd ed.). Hoboken, NJ: Wiley. [2] A. C. Rencher and

More information

Estimation for Mean and Standard Deviation of Normal Distribution under Type II Censoring

Estimation for Mean and Standard Deviation of Normal Distribution under Type II Censoring Communications for Statistical Applications and Methods 2014, Vol. 21, No. 6, 529 538 DOI: http://dx.doi.org/10.5351/csam.2014.21.6.529 Print ISSN 2287-7843 / Online ISSN 2383-4757 Estimation for Mean

More information

Lecture 5: Hypothesis tests for more than one sample

Lecture 5: Hypothesis tests for more than one sample 1/23 Lecture 5: Hypothesis tests for more than one sample Måns Thulin Department of Mathematics, Uppsala University thulin@math.uu.se Multivariate Methods 8/4 2011 2/23 Outline Paired comparisons Repeated

More information

Statistical Inference

Statistical Inference Statistical Inference Classical and Bayesian Methods Revision Class for Midterm Exam AMS-UCSC Th Feb 9, 2012 Winter 2012. Session 1 (Revision Class) AMS-132/206 Th Feb 9, 2012 1 / 23 Topics Topics We will

More information