A Comparison of Three Different Procedures for Estimating Variance Components
|
|
- Charlotte Singleton
- 5 years ago
- Views:
Transcription
1 International Journal of Statistics and Applications 2016, 6(4): DOI: /j.statistics A Coparison of Three Different Procedures for Estiating Variance Coponents Zakaria A. Abdel Wahed 1, Mohaed S. Abdallah 2,* 1 Faculty of Econoics & Political Science, Cairo University, Egypt 2 Cairo University, Egypt Abstract As a consequence of various theoretical developents, and of iproveents in coputing strategies, restricted axiu likelihood (REML) estiation has becoe a viable procedure for estiating the variance coponents in ixed linear odels. In this article, the procedure of Xu and Atchley (1996) has been extended in such a way that can be applied to any general linear odel. Further, alternative estiator based on epirical Bayes approach has been derived for estiating the rando- effects variance coponents in the light of REML function. Coparison between the proposed estiator and the estiators provided by Xu and Atchley (1996) and Moghtased-Azar et al. (2014) has been coputed under unbalanced nested-factorial odel with two fixed crossed factorial and one nested rando factor. Finally, all the estiators in the vignette are activated by an illustrative exaple. Keywords Epirical Bayes, Negative Estiates, Nested Factorial Design, Restricted Maxiu Likelihood, Siulation Study, Variance Coponents 1. Introduction One of the ost traditional ethods to estiate the variance coponents is REML which is quoted by Thopson (1962). The REML approach ay lead to assive coputations, thus any algoriths were presented over the years to calculate REML estiates. A proper and coprehensive review of these algoriths can be found in Meza (1993) and Matilainen (2014). One of the interesting features of REML is considering the fixed effects as nuisance paraeters in order to take into account the iplicit degrees of freedo associated with the fixed effects. A copeting estiation approach is based on epirical Bayes (EB) principle which, as opposed to REML, considers both the fixed and the rando effects as nuisance paraeters whereas the variance coponents are estiated as hyper paraeters fro the arginal likelihood function which includes only the observed data and the variance coponents. In this article, an attept was ade to produce a new estiator that erges between the REML ethod and the EB approach. It is worthwhile to ention that Coponents of variance estiation can be traced back to the work of astronoer Airy (1861). Since this tie rearkable developents and coparisons have taken place on estiation the variance * Corresponding author: statisticss.2010@gail.co (Mohaed S. Abdallah) Published online at Copyright 2016 Scientific & Acadeic Publishing. All Rights Reserved coponents either fro theoretical perspective, epirical view or both. Consequently a plethora of variance coponents estiation were proposed resulting in extensive publications of books and working papers in this area. A proper survey review for these ethods can be found in Sahai (1979), Khuri and Sahai (1985), Khuri (2000) and Sahia and Khurshid (2005). Due to the coplexity of the variance coponents odels, it ay be intractable to conduct any theoretical coparison aong variance coponents estiators even for the siplest cases of the linear ixed odel with unbalanced data. Consequently a nuber of attepts were perfored to study the statistical properties of the variance coponents estiators using Monte Carlo siulation under different types of odels. For instance, based on crossed odels: Swallow and Monahan (1984) ade a coparison aong ANOVA, MLE, REML, and MINQUE ethods, Khattree (1998) copared between his proposed non-negative variance coponents estiator based on siple odification of Henderson's ANOVA ethod and the original Henderson's ANOVA ethod, Lee and Khuri (2000) used the Epirical Quantile Dispersion Graph (EQDG) to ake a coparison between the ANOVA and ML estiation ethods, Subraani (2012) introduced a new procedure to estiate the variance coponents in the light of MINQUE approach and copared with ANOVA and MINQUE ethod, and Chen and Wei (2013) derived paraetric epirical Bayes estiators and investigated the superiorities of their estiator over ANOVA ethod. On the other hand, coparisons based on nested odels: Sahai (1976)
2 242 Zakaria A. Abdel Wahed et al.: A Coparison of Three Different Procedures for Estiating Variance Coponents copared aong ANOVA, MLE and REML ethods, Rao and Hecker (1997) provided a new estiator based on weighted analysis of eans (WAM) estiator which utilizes prior inforation for estiating the variance coponents, further they copared nuerically between their estiator and other traditional variance coponents ethods, Jung et al. (2008) copared between ANOVA and MLE ethods based upon the EQDG. Finally El Leithy et al. (2016) suggested a new estiator based on the estiator of Subraani (2012) and ade a coparative study between the proposed estiator and other coon estiators using nested factorial odels with two crossed factors and one nested factor. This article is structured as follows: Section 2 will explain in details the variance coponent estiator proposed by Moghtased-Azar et al. (2014) which is donated as odified REML (MREML) estiator. In Section 3, the variance coponent estiator based on EB aspect proposed by Xu and Atchley (1996) will be discussed. A proposed variance coponent estiator is introduced in Section 4 which is called odified epirical Bayes (MEB) estiator. Section 5 includes the Monte Carlo results using nested-factorial odel. Section 6 includes an illustrative application for all the preceding estiators. Finally, soe conclusions about this work are given in the last section. 2. MREML Method Consider the variance coponents odel Y = Xβ + Z 1 δ 1 + Z 2 δ 2 + Z r 1 δ r 1 + Z r δ r (2.1) where Y is an n 1 vector of observations, X is an n atrix with known constants, β is an 1 vector of fixed (unknown) paraeters, Z i is an n c i atrix of known constants and δ i is c i 1 rando vector which has ultivariate noral distribution with zero ean and covariance atrix σ 2 ii ci i = 1 r. Further it is assued that δ i and δ j i j are uncorrelated. Model (2.1) can be expressed in a copact for as: Y = Xβ + Zδ (2.2) where Z = [Z 1 Z 2 Z r ] and δ = [δ 1δ 2 δ r]. The odel (2.2) is called a ixed linear, odel. If r = 1, it becoes a fixed odel and if = 1 it becoes a rando odel. Thus generally we have E Y = Xβ and D Y = r i=1 σ 2 iv i, where V i = Z i Z i, D is called the dispersion atrix and the paraeters σ 2 1, σ 2 2,, σ 2 r are the unknown variance coponents whose values should be estiated. Since the norality distribution is assued, thus it is acceptable to operate distribution-based ethods. The preferred paraetric ethod for estiating variance coponents is REML. The original reference to REML is the article by Thopson (1962). Theoretically, REML can be illustrated as assuing K n x,n be a full rank atrix, where x is the rank of X, such that KX = 0, 1 then the likelihood of KY can be forulated as: L σ\y KDK 1 2 exp( 1 2 (Y K (KDK ) 1 KY)) (2.3) where σ = [σ 2 1σ 2 2 σ 2 r] is a vector of the unknown variance coponents. The log likelihood of KY becoes: ln L (σ\y) 1 2 ln KDK 1 2 (Y K (KDK ) 1 KY) in order to obtain REML estiates, it is required to take the partial derivatives of ln(l(σ\y)) with respect to σ then setting to zero, we obtain ln(l(σ\y)) σ 2 = 1 i 2 (tr K KDK 1 KV i + Y K (KDK ) 1 KV i K (KDK ) 1 KY) = 0 using the lea given in Searle et al.(1992) that states: hence we will get K (KDK ) 1 K = P, where P = D 1 D 1 X(X D 1 X) 1 X D 1 ln(l(σ\y)) σ 2 i = tr PV i Y PV i PY = 0 i = 1 r (2.4) It is obvious that we have r equations in r unknowns σ. In soe cases these equations can be siplified to yield a closed for. Yet, in alost cases nuerical algoriths have to be used to solve the equations, it should also be noted that the syste of equations in (2.4) does not involve the eleents of K, which eans no atter what their values are, the sae result will be reached (see Searle et al. (1992)). Nuerically, Rao and Kleffe (1988) affired that REML solutions are equivalent to other variance coponents estiators (e.g. iterated MINQE, iterated BIQUE and ANOVA) under suitable conditions, weakly consistent, asyptotically efficient and asyptotically noral with zero ean and variance atrix equals to the inverse of the restricted inforation atrix. Cressie and Lahiri (1993) studied the consistency and asyptotic norality (CAN) of REML estiates in the light of the results reached by sweeting (1980), and applied REML to census undercount in the USA. Jiang (1996) studied the REML estiators in the absence of norality, boundedness of and prior specification of the structure of the odel. He resorted to deal with REML estiates as a kind of M-estiates in order to reach to the sae REML equations. Further, he proved rigorously that the REML estiates are consistent under odels that are asyptotically identifiable infinitely and whether the nondegenerate condition is added, then REML estiates are asyptotically noral. Finally, he showed that in the light of the nondegenerate, the REML and ANOVA estiates are consistent and asyptotically noral for all unconfounded
3 International Journal of Statistics and Applications 2016, 6(4): balanced ixed odels. The ain drawback concerning the REML technique is that the solution in (2.4) can be negative, which it is not allowed in the real life. This dilea has been resolved by Moghtased-Azar et al. (2014). Moghtased-Azar et al. (2014) claied that using any positive valued functions can guarantee the non-negativity of the variance coponents estiates, thus they decided to depend on the exponential function as its range is positive everywhere. Hence obtaining MREML required first to re-paraetrize ln(l(σ\y)) as replacing σ 2 i with exp(α i ), then axiizing ln(l(σ\y)) with respect to α i instead of σ 2 i. After little algebra (2.4) can be reforulated in ters of α i as: g α = ln(l(α\y)) α i = tr P V i Y P V i P Y = 0 i = 1 r (2.5) where α = α 1 α 2 α r is a vector of the unknown paraeters, P = D 1 D 1 X X D 1 X 1 X D 1 = K (KD K ) 1 K and D r = i=1 exp(α i )V i. As explained above, we have r equations in r unknowns α i, solving these nonlinear equations through any iterative algorith, then the estiated variance coponents can be calculated by σ = exp(α). Fortunately Moghtased-Azar et al. (2014) derived an efficient algorith in order to estiate α i via linearizing (2.5) using Taylor expansion with first order as follows: g α = g α g α + α α=α α α = 0 (2.6) where α is the prior value of the α. The only unknown ter in (2.6) is the first derivative of g α which can be obtained as: After tedious algebra g i α g i α g i α can be expressed as: = (tr P V i Y P V i P Y) = (tr K (KD K ) 1 KV i (Y K (KD K ) 1 KV i K (KD K ) 1 KY) j = 1 r (2.7) = 2exp(α j )( Y P V j P V i P Y) exp(α i )tr P V j P V i i, j = 1 r g α For siplification, Moghtased-Azar et al. (2014) preferred to deal with E( ), which can described as: E g i α It can easily be proved that: = 2exp(α j )E( Y P V j P V i P Y) exp(α i )tr P V j P V i E Y P V j P V i P Y = tr K KD K 1 KV j P V i K KD K 1 KD = tr P V j P V i hence E g i α will becoe: E g i α = 2 exp α j tr P V j P V i exp α i tr P V j P V i = exp α i tr P V j P V i (2.8) Recall Taylor equation which can be rewritten as: where H i,j = E g i α g α + H α α = 0 Hα = Hα g α α = α H 1 g α (2.9). Consequently getting on MREML based on the following steps: 1) Select initial values for α i, in order to calculate g α using (2.5). 2) Calculate the H atrix using (2.8). 3) Evaluate α using (2.9). Then copute σ = exp(α). 4) Update the initial values in the step (1) with α evaluated fro step (3) and repeat the circle until the convergence achieved. Actually Moghtased-Azar et al. (2014) proved atheatically that MREML is an unbiased estiator and has the sae variance as REML, further they showed using an illustrated exaple that the perforance of above algorith is satisfying and converges quickly.
4 244 Zakaria A. Abdel Wahed et al.: A Coparison of Three Different Procedures for Estiating Variance Coponents 3. EB Method In the Bayesian approach, all the paraeters are regarded as rando in the sense that all uncertainty about the should be expressed in ters of a probability distribution function. The basic paradig of Bayesian statistics involves a choice of a joint prior distribution of all paraeters of interest that could be based on objective evidence or subjective judgent or a cobination of both. Generally speaking, the Bayesian approach can be divided into two principal parts. The first one is known as hierarchical Bayesian odels which the linear ixed odel is considered as a ulti-stage hierarchy and all the paraeters of the odel including variance coponents should have prior distributions, for ore details see Jiang (2007). The second case is known as epirical Bayes or arginal likelihood function that all the nuisance paraeters, fixed and rando effects, should be integrated out which yields a likelihood function that includes only the observed data and the variance coponents, thus one can estiate the variance coponents, as in the classical situations, through axiizing the arginal likelihood with respect to the unknown the variance coponents (for ore details see Searle et al. (1992)). Harville (1977) proved that REML can be considered as an epirical Bayes estiator. He showed that the REML can be derived as the arginal likelihood when the fixed effects are integrated out under a non-inforative or flat prior distribution. He used the unifor distribution (-,), f β = 1, as a prior distribution for the fixed effects β, however the rando effects δ i is defined as in (2.1). The arginal likelihood y σ can be expressed as: where: y σ = L y β, δ, σ exp( 1 2 (Y Xβ Zδ) (Y Xβ Zδ)), π δ σ R 1 2exp( 1 2 ( δ R 1 δ)), and R = L y β, δ, σ π δ σ dβ σ 2 1I c σ 2 2I c σ 2 ri cr Since the variance coponents obtained in (2.4) is equivalent to the variance coponents obtained using y σ, hence the latter suffers also fro the negativity proble. Xu and Atchley (1996) proposed a new idea that can be adopted for the estiating non-negative variance coponents based on epirical Bayes using Monte-Carlo integration algorith. In this context, the idea will be generalized through the following steps: 1- Express the rando effect vector δ i as a linear transforation of standard noral deviates which can be expressed as: dδ. δ i = S i σ i, where S i ~N ci 1(0,1) (3.1) 2- Use L( σ Y) in (2.3) to derive a new arginal likelihood function in the light of (3.1) as given below: 1 y σ exp( 1 2 ((Y ZSσ ) P (Y ZSσ )))exp( 1 2 (S S))dS where S = S 1, S 2, S r, σ = [σ 1 σ 2 σ r ] and P = I X(X X) X. 3- Maxiize y σ with respect to σ, then σ = σ 2. Which iplies that σ is positive under all conditions. Since S is copletely known following standard noral distribution, one can easily generate a huge set of standard noral distribution. Therefore Xu and Atchley (1996) suggested replacing the integrations in y σ with the suations to siplify the analysis which yields to: y σ exp 1 2 Y Z 1S 1z σ 1 Z 2 S 2z σ 2 Z r S rz σ r P Y Z 1 S 1z σ 1 Z 2 S 2z σ 2 Z r S rz σ r One should notice that all S iz can be obtained fro generating standard noral saples, they stated that as, y σ y σ, so they recoend to set = The axiu likelihood solution of σ required to take the partial derivatives of the ln( y σ ) with respect to σ as follows: 1 Xu and Atchley (1996) discussed ultiple arginal likelihood functions, yet we confine ourselves to select which based only on REML.
5 International Journal of Statistics and Applications 2016, 6(4): ln( y σ ) σ = where p z S 1z Z 1 P Y p z S 2z Z 2 P Y 1 y σ ( y σ ) σ = p z S 1z Z 1 P Z 1 S 1z σ 1 p z S 2z Z 2 P Z 1 S 1z σ 1 p z S 1z Z 1 P Z r S rz σ r p z S 2z Z 2 P Z 2 S 2z σ 2 p z S 2z Z 2 P Z r S rz σ r p z S rz Z r P Y p z S rz Z r P Z 1 S 1z σ 1 p z S rz Z r P Z r S rz σ r = 0 exp 1 2 Y Z 1S 1z σ 1 Z 2 S 2z σ 2 Z r S rz σ r P Y Z 1 S 1z σ 1 Z 2 S 2z σ 2 Z r S rz σ r p z = y σ The ML of σ ay be written as a linear syste by: Where A = p z S 1z Z 1 P Z 1 S 1z p z S 2z Z 2 P Z 1 S 1z Aσ = C p z S 1z Z 1 P Z r S rz p z S 2z Z 2 P Z 2 S 2z p z S 2z Z 2 P Z r S rz p z S rz Z r P Z 1 S 1z Consequently σ can be calculated as: p z S rz Z r P Z r S rz σ = A 1 C and C = p z S 1z Z 1 P Y p z S 2z Z 2 P Y p z S rz Z r P Y Although algebraically Xu and Atchley (1996) estiator sees to be tedious, it is conceptually very siple, easy to progra and avoids inverting large atrix as opposed to MREML estiator which requires to copute the inverse of D n n during calculating P. 4. MEB Method One can derive a new estiator based on EB estiator. Recall that y σ in ters of δ that can be expressed as: y σ R 1 2exp( 1 2 ((Y Zδ) P (Y Zδ)))exp( 1 2 (δ R 1 δ))dδ Our idea is to solve the above integration analytically, then estiate σ using the algorith explained in Moghtased-Azar et al. (2014). Fortunately the above integration has explicit for which enables us to obtain MEB as follows: y σ R 1 2 exp 1 2 Y Zδ P Y Zδ + δ R 1 δ dδ R 1 2exp( 1 2 (Y P Y 2δ Z P Y + δ Z P Zδ + δ R 1 δ))dδ R 1 2exp( 1 2 (Y P Y 2δ Z P Y + δ (Z P Z + R 1 )δ))dδ Let us define A = (Z P Z + R 1 ), hence we can get:
6 246 Zakaria A. Abdel Wahed et al.: A Coparison of Three Different Procedures for Estiating Variance Coponents y σ R 1 2exp( 1 2 Y P Y + δ A 1 Z P Y A δ A 1 Z P Y Y P ZA 1 Z P Y )dδ R 1 2exp( 1 2 Y P Y Y P ZA 1 Z P Y + δ A 1 Z P Y A δ A 1 Z P Y )dδ R 1 2 exp 1 2 Y P Y Y P ZA 1 Z P Y exp( 1 2 δ A 1 Z P Y A δ A 1 Z P Y ) dδ R Z P Z + I 1 2exp( 1 2 Y P Y Y P ZA 1 Z P Y ) hence ln( y σ ) can be presented as: ln y σ 1 2 (ln R Z P Z + I Y P P ZA 1 Z P Y) Since R is the variance coponents of δ, thus it can be rewritten as: where R 1 = I c R = σ 2 1R 1 + σ 2 2R 2 + σ 2 rr r, R 2 = I c R r = I cr For preventing the negative values of σ, we resort to the idea of Moghtased-Azar et al. (2014) to treat this dilea as replacing σ with exp(α). The axiu likelihood solution of α required to take the partial derivatives of the ln y α with respect to α as follows: ln y α α i = exp(α i )(tr R Z P Z + I 1 R i Z P Z + Y P ZA 1 R 1 R i R 1 A 1 Z P Y ) = 0 For siplicity we define: g α = tr R Z P Z + I 1 R i Z P Z Y P ZA 1 R 1 R i R 1 A 1 Z P Y (4.1) According to (2.6), Taylor expansion with first order ay be given as: where g α = g α + g α α g i α The first ter in (4.2) can be expressed as: tr R Z P Z + I 1 R i Z P Z The second ter in (4.2) can be derived as: Y P ZA 1 R 1 R i R 1 A 1 Z P Y α=α = tr R Z P 1 Z+I Ri Z P Z α α Y P ZA 1 R 1 R i R 1 A 1 Z P Y (4.2) = exp(α j )tr R Z P Z + I 1 R j Z P Z R Z P Z + I 1 R i Z P Z = Y P Z RZ P Z + I 1 R i Z P Z R + I 1 Z P Y = exp(α j )[Y P Z RZ P Z + I 1 R j Z P Z RZ P Z + I 1 R i Z P Z R + I 1 Z P Y + Y P Z RZ P Z + I 1 R i Z P Z R + I 1 Z P Z R j Z P Z R + I 1 Z P Y] Since the outcoe is scalar, hence: Y P ZA 1 R 1 R i R 1 A 1 Z P Y = 2exp(α j )(Y P Z RZ P Z + I 1 R i Z P Z R + I 1 Z P Z R j Z P Z R + I 1 Z P Y) hence g i α will becoe:
7 International Journal of Statistics and Applications 2016, 6(4): g i α = 2exp(α ) Y P Z RZ P Z + I 1 R i Z P Z R + I 1 Z P Z R j Z P Z R + I 1 Z P Y j exp(α j )tr R Z P Z + I 1 R j Z P Z R Z P Z + I 1 R i Z P Z (4.3) Recall Taylor equation which can be rewritten as: g α + H α α = 0 H α = Hα g α α = α H 1 g α (4.4) where H i,j = g i α. Consequently steps to get MEB are suarized as following: 1) Select initial values for α i, in order to calculate g α using (4.1). 2) Calculate the H atrix using (4.3). 3) Evaluate α using (4.4). Then copute σ = exp(α). 4) Update the initial values in the step (1) with α evaluated fro step (3) and repeat the circle until the convergence achieved. 5. Siulation Study Since it ay be intractable to do any theoretical coparisons about the perforance of the preceding estiators, thus one has to resort to copare through Monte Carlo siulation. Monte Carlo siulation is now a uch-used scientific tool for probles that are analytically intractable and for which experientation is too tie-consuing, costly, or ipractical. It depends basically on generating artificial rando sapling any ties, 1000 ties for instance, in order to estiate the statistical odels and the atheatical functions. Even though, siulation also has disadvantages; it can require huge coputing resources, it doesn't give exact solutions, and results are only as good as the odel and inputs used. Typically coparisons between the variance coponents estiators should be conducted under hypothetical odel. Following to Melo et al. (2013) and El Leithy et al. (2016), nested factorial design with two crossed factors and one nested factor is adopted in this context in order to identify the behavior of variance coponents estiators which can be described as: y abcd = α a + β b + γ c(a) + αβ ab + βγ bc(a) + ε abcd a = 1.. I; b = 1.. J; c = 1.. K a ; d = 1.. n abc, where α a is the effect of the a level of factor A, β b is the effect of the b level of factor B, γ c(a) is the effect of the c level of factor C nested within the a level of A, αβ ab is the interaction effect between the factor A and B, βγ bc(a) is the interaction effect between the factor B and C and ε abcd is a rando experiental error. It is assued that all the effects in the odel are fixed paraeters except γ c(a), βγ bc(a) and ε abcd are norally independently distributed such that: γ c(a) ~N(0, σ 2 1), βγ bc(a) ~N 0, σ 2 2 and ε abcd ~N(0, σ 2 3). The ain reason for selecting the above odel is due to widely usage in the real life, as nested factorial odels have the advantage that is suitable for the experients are either with crossing or nesting factors or both. Since the fixed effects are out of our interest, thus one can fix all the fixed paraeters at one. Conversely, the coparison process requires to be conducted under a variety of variance coponents configurations, difference of ibalance degrees and ultiple saple sizes. Following to El Leithy et al. (2016), Table (1). displays the variance coponents values used in the siulation. The easure which is introduced by Ahrens and Pincus (1981) can be reliable for reflecting the ibalance effect of n abc which can be forulated as: 1 φ = n abc a b c n where n is the grand saple size and is the grand nuber of the cells obtained by J a K a, where K a is the levels nuber of the nested factor within the factor a. Table (2). presents the patterns of ibalance according to different saple sizes throughout the siulation. For each variance coponents configuration and pattern of ibalance cobination, 1000 independent rando saples were generated, the estiated bias, MSE and the average of the required iterations for the convergence are shown in Table (3). Since such these estiators are sensitive to the starting points, alost unbiased estiator (AUE) which proposed by Horn et al. (1975) was considered as an initial value in our analysis. The reasons for depending on AUE: 1- Its calculations are siple as it can be expressed in a closed for, 2- It always gives non-negative values. For ore details about AUE principle see Searle et al. (1992). According to Table (3), a nuber of conclusions is drawn fro the results for all the patterns and designs which are suarized in the following points: a) It is observed that the three types of the estiators are very close with respect to the nuber of the iterations particularly at increasing saple size. This result can be explained in light of considering AUE as a priary point which enables the convergence to be achieved rapidly. Generally speaking, EB has the least nuber of iterations across all the cases. b) It is clear the superiority of MEB over all the estiators in ters of MSE criterion that across alost cases MEB has MSE less than either MREML, EB or both. Whereas MREML estiator has least bias aong the preceding estiators. 2
8 248 Zakaria A. Abdel Wahed et al.: A Coparison of Three Different Procedures for Estiating Variance Coponents c) The saple size and the ibalance rate have substantial effect on the behavior of all the estiators, as either increasing the sall size or reducing the ibalance rate yield a significant iproveent in the two easures of the perforance. Furtherore, there is an interaction effect between the saple size and the ibalance rate as the effect of the ibalance rate is downward at high level of the saple size. 6. Illustrative Exaple In this part we will just exaine the applicability of MREML, EB, and MEB estiators through conducting these estiators on practical case especially large dataset. The application within Inforation and counication technologies (ICTs) field is provided and conducted via nested factorial odel. ICT are used frequently by Private enterprises to iprove their productivity and copetitiveness in the arketplace. Various kinds of ICT infrastructure such as coputer usage, internet usage and obile usage help firs in all sectors to anage their resources ore efficiently. Consequently, it is useful to consider the factors affecting the expenditures of ICT by Private sectors. Accordingly, The Ministry of Counication and Inforation Technology (MCIT) conducted a survey in 2012 to easure the ICT usage in the private sectors, a proportional saple with size 5,000 enterprises was selected to reflect ICT usage of all Egyptian enterprises. In this context, we will focus only on the ICT expenditures, the location, the region and the International Standard Industrial Classification (ISIC) V.3. of the firs. It is assued that the ICT expenditures can be ostly affected by the location, the region and the ISIC of the firs. We used the nested factorial design to exaine this effect. The raw data are suarized by Table (4) and Figure (1) (see Annex). For the sake of copleteness, we write the odel equation with the definition of the fixed and rando factors in ters of the preceding application as follows: y abcd = α a + β b + γ c(a) + αβ ab + βγ bc(a) + ε abcd a = 1.. 4; b = 1.. 6; c = 1.. [1; 2; 2; 2]; d = 1.. n abc, where y abcd is the dependent variable which is the ICT expenditure for the private sectors after operating the Logarith transforation two ties to guarantee the norality assuption, α a is the effect of the Region factor, β b is the effect of the ISIC factor, γ c(a) is the effect of the Location factor nested within the Region factor, αβ ab is the interaction effect between the Region factor and ISIC factor, βγ bc(a) is the interaction effect between the ISIC factor and the Location factor and ε abcd is a rando experiental error. Since our saple did not include all ISIC activities, it is assued that all the effects in the odel are fixed paraeters except β b, αβ ab, βγ bc(a) and ε abcd are norally independently distributed such that: β b ~N 0, σ 2 b, αβ ab ~N 0, σ 2 ab, βγ bc a ~N 0, σ 2 bc a and ε abcd ~N(0, σ 2 ε). The REML, EB and MEB estiates are calculated for σ 2 b, σ 2 ab, σ 2 bc(a) and σ 2 ε and given in Table (5). Since testing hypotheses is beyond the scope of this study, it ay interest to take up this topic in the near future. In the light of Table (5), the variance coponents estiates corresponding to all rando factors are estiated by MREML, EB and MEB respectively. As excepted MEB estiator required large nuber of iterations to converge. In our view, the reason for this point that it is required to siplify equation (4.3) as Moghtased-Azar et al. (2014) done. One can also observe that the σ 2 ε is relatively large which eans that the odel needs other factors to explain the variability of the ICT expenditure for the private sectors i.e. the capital size, the nuber of the eployees..etc. It is easily to reark that since the high degree of unbalancedness of our data, the variance coponents look soehow different across the studied ethods nonetheless the saple size is large. 7. Conclusions In this article, a new estiator based on epirical Bayes principle is introduced for estiating the variance coponents in the ixed linear odel. The ai of this article is to evaluate the perforance of the proposed estiator relative to other two (MREML and EB) estiators via siulation studies. The odel we used is the nested-factorial odel with two fixed crossed factorial and one nested rando factor under regularity assuptions. Three criteria bias, MSE and nuber of iterations are used to show the perforance of all the estiators under the study. Fro the nuerical analysis, we have found that the proposed estiator has desirable properties in ters of MSE, however MREML estiator ay be appropriate estiators with respect to bias view, and further EB estiator can be considered as a suitable estiator for handling large data sets since it required low nuber of iterations to converge. ACKNOWLEDGMENTS The authors would like to express their heartiest thanks to the editor and the two referees for careful reading and for their coents which greatly iproved the article.
9 International Journal of Statistics and Applications 2016, 6(4): Annex Table (1). Variance Coponents Configurations Used in the Siulation σ 2 1 σ 2 2 σ 2 3 V V V V V V Table (2). The Patterns of Ibalance Rate for Each Saple Size Used in the Siulation n i j K i n ijk φ P ,2 3,,3 100% P ,2 2,5;3,2;5,3;3,1 83% P ,2 1,2;1,2;2,8;7,1 56% P ,2,3 3,,3 100% P ,2,3 2,2;2,5;2,5;4,4;3,3;2,2 87% P ,2,3 1,1;2,5;2,1;1,10;3,1;7,2 53% P ,3,2 3,,3 100% P ,3,2 2,2,4;4,2,4;2,2,4;4,3,6;3,3,4;3,3,2;3,2,1 87% P ,3,2 2,1,1;3,2,10;8,1,2;1,1,3;3,3,2;9,3,3;3,1,1 57% Figure (1). Histogra of the Logarith of the Annual Expense with the Norality Test
10 250 Zakaria A. Abdel Wahed et al.: A Coparison of Three Different Procedures for Estiating Variance Coponents Table (3). Coparison of MREML, EB and MEB Estiators Based on Copound Absolute Bias, Copound MSE and Average of the Iterations MREML EB MEB absolute bias MSE Average of the iterations absolute bias MSE Average of the iterations absolute bias MSE Average of the iterations P1 P2 P3 P4 P5 P6 P7 V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V
11 International Journal of Statistics and Applications 2016, 6(4): MREML EB MEB absolute bias MSE Average of the iterations absolute bias MSE Average of the iterations absolute bias MSE Average of the iterations P8 P9 V V V V V V V V V V V V Table (4). Average of Annual Expense on ICT for Egyptian Private Enterprises Region URBAN LOWER UPPER BORDER ISIC / Location urban urban rural urban rural urban Rural Manufacturing Construction Whole Sale & Retail Trade Hotels & Restaurants Transport, Storage, Counication Financial Interediation Table (5). Estiates of the Rando Factors MREML EB MEB Estiates Iterations Nuber Estiates Iterations Nuber Estiates Iterations Nuber σ 2 b σ 2 ab σ 2 bc(a) σ 2 ε Analysis REFERENCES [1] Ahrens, H. and Pincus, R. (1981), On Two Measures of Unbalanceness in a One-Way Model and Their Relation to Efficiency. Bioetrics [2] Airy, G. B. (1861). On the Algebraical and Nuerical Theory of Errors of Observations and the Cobinations of Observations. MacMillan, London. [3] Cressie. N. and Lahiri. S. (1993). The Asyptotic Distribution of REML Estiators. Journal of Multivariate [4] Chen. L. and Wei. L. (2013). The Superiorities of Epirical Bayes Estiation of Variance Coponents in Rando Effects Model. Counications in Statistics Theory and Methods.42: [5] Diffey. S. Welsh. A. Sith. A. Cullis. B. (2013). A faster and coputationally ore efficient REML (PX) EM algorith for linear ixed odels. Centre for Statistical & Survey Methodology. Working Paper Series. University of Wollongong. [6] El Leithy, H. Abdel-Wahed, Z. and Abdullah, M. (2016). On non-negative estiation of variance coponents in ixed
12 252 Zakaria A. Abdel Wahed et al.: A Coparison of Three Different Procedures for Estiating Variance Coponents linear odels. Journal of Advanced Research [7] Harville. D. (1977). Maxiu-likelihood approaches to variance coponent estiation and to related probles. JASA [8] Horn. S. Horn. R. and Dunca. D. (1975). Estiation Heteroscedastic Variances in Linear Model. JASA.70: [9] Jiang. J. (1996). REML Estiation: Asyptotic Behavior And Related Topics. The Annals of Statistics [10] Jiang. J. (2007). Linear and Generalized Linear Mixed Models and Their Applications. Springer Science +Business Media. [11] Jung. C. Khuri. I. Lee. J. (2008). Coparison of Designs for the Three Folds Nested Rando Model. Journal of Applied Statistics [12] Khuri. R. (1998). Soe practical estiation procedures for variance coponents. Coputational Statistics & Data Analysis [13] Khuri. A. and Sinha. B. (1998). Statistical Tests for Mixed Linear Models. John Wiley & Sons. New York. [14] Khuri. A. and Sahai. H. (1985). Variance Coponents Analysis: A Selective Literature Survey. International Statistical Review [15] Khuri. A. (2000). Designs for Variance Coponents Estiation: Past and Present. International Statistical Review.68: [16] Lee. J. and Khuri. A. (2000). Quantile Dispersion Graphs for the Coparison of Designs for a Rando Two-Way Model. Journal of Statistical Planning and Inference [17] Matilainen. K. (2014). Variance coponent estiation exploiting Monte Carlo ethods and linearization with coplex odels and large data in anial breeding. Ph.D. thesis. Faculty of Agriculture and Forestry. University of Helsinki. Finland. [18] Melo. S. Garzón. B. Melo. O. (2013). Cell Means Model for Balanced Factorial Designs with Nested Mixed Factors. Counications in Statistics Theory and Methods [19] Meza. M. (1993). Estiation of Variance Coponents And Diagnostic Analysis In Unbalanced Mixed Linear Models. Ph.D. Thesis. Texas University. USA. [20] Moghtased-Azar. K. Tehranchi. R. and Airi-Sikooei. A. (2014). An Alternative Method for Non-Negative Estiation of Variance Coponents. Journal Geodesy [21] Qie. W. and Xu. C. (2009). Evaluation of a New Variance Coponents Estiation Method Modified Henderson s Method 3 With the Application of Two Way Mixed Model. Departent of Econoics and Society, Dalarna University College. [22] Rao. C. and Kleffe. J. (1988). Estiation of Variance Coponents and Applications. North-Holland, Asterda. New York. [23] Rao. S. Heckler. E. (1997). The Three-Fold Nested Rando Effects Model. Journal of Statistical Planning and Inference [24] Sahai, A. (1976). A Coparison of Estiators of Variance Coponents in the Balanced Three-Stage Nested Rando Effects Model Using Mean Squared Error Criterion. JASA [25] Sahai, A. (1979). Bibliography On Variance Coponents. International Statistical Review [26] Sweeting. T. (1980). Unifor Asyptotic Norality of The Maxiu Likelihood Estiator. Ann. Statistics [27] Sahai. H. Khurshid. A. (2005). A Bibliography On Variance Coponents An Introduction And An Update: Statistica Applicata 17, [28] Searle. S. Casella. G. and McCulloch. C. (1992). Variance Coponents; John Wiley & Sons. New York. [29] Subraani. J. (2012). On Modified Miniu Variance Quadratic Unbiased Estiation (MIVQUE) of Variance Coponents in Mixed Linear Models. Model Assisted Statistics and Applications [30] Swallow. H. and Monahan. F. (1984). Monte-Carlo Coparison of ANOVA, MINQUE, REML and ML Estiators of Variance Coponents. Technoetrics [31] Thopson. A. (1962). The Proble of Negative Estiates of Variance Coponents. The Annals of Matheatical Statistics [32] Wei. L. Ding. X. (2003). On epirical Bayes estiation of variance coponents in rando effects odel. Journal of Statistical Planning and Inference [33] Xu. S. Atchley. WR. (1996). A Monte-Carlo algorith for axiu likelihood estiation of variance coponents. Genetics Selection Evolution, BioMed Central
Using EM To Estimate A Probablity Density With A Mixture Of Gaussians
Using EM To Estiate A Probablity Density With A Mixture Of Gaussians Aaron A. D Souza adsouza@usc.edu Introduction The proble we are trying to address in this note is siple. Given a set of data points
More informationEstimation of the Mean of the Exponential Distribution Using Maximum Ranked Set Sampling with Unequal Samples
Open Journal of Statistics, 4, 4, 64-649 Published Online Septeber 4 in SciRes http//wwwscirporg/ournal/os http//ddoiorg/436/os4486 Estiation of the Mean of the Eponential Distribution Using Maiu Ranked
More informationA Note on the Applied Use of MDL Approximations
A Note on the Applied Use of MDL Approxiations Daniel J. Navarro Departent of Psychology Ohio State University Abstract An applied proble is discussed in which two nested psychological odels of retention
More informationESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS. A Thesis. Presented to. The Faculty of the Department of Mathematics
ESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS A Thesis Presented to The Faculty of the Departent of Matheatics San Jose State University In Partial Fulfillent of the Requireents
More informationKeywords: Estimator, Bias, Mean-squared error, normality, generalized Pareto distribution
Testing approxiate norality of an estiator using the estiated MSE and bias with an application to the shape paraeter of the generalized Pareto distribution J. Martin van Zyl Abstract In this work the norality
More informationEnsemble Based on Data Envelopment Analysis
Enseble Based on Data Envelopent Analysis So Young Sohn & Hong Choi Departent of Coputer Science & Industrial Systes Engineering, Yonsei University, Seoul, Korea Tel) 82-2-223-404, Fax) 82-2- 364-7807
More informationEstimation of the Population Mean Based on Extremes Ranked Set Sampling
Aerican Journal of Matheatics Statistics 05, 5(: 3-3 DOI: 0.593/j.ajs.05050.05 Estiation of the Population Mean Based on Extrees Ranked Set Sapling B. S. Biradar,*, Santosha C. D. Departent of Studies
More informationNon-Parametric Non-Line-of-Sight Identification 1
Non-Paraetric Non-Line-of-Sight Identification Sinan Gezici, Hisashi Kobayashi and H. Vincent Poor Departent of Electrical Engineering School of Engineering and Applied Science Princeton University, Princeton,
More informationSupport Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization
Recent Researches in Coputer Science Support Vector Machine Classification of Uncertain and Ibalanced data using Robust Optiization RAGHAV PAT, THEODORE B. TRAFALIS, KASH BARKER School of Industrial Engineering
More informationTesting equality of variances for multiple univariate normal populations
University of Wollongong Research Online Centre for Statistical & Survey Methodology Working Paper Series Faculty of Engineering and Inforation Sciences 0 esting equality of variances for ultiple univariate
More informationBiostatistics Department Technical Report
Biostatistics Departent Technical Report BST006-00 Estiation of Prevalence by Pool Screening With Equal Sized Pools and a egative Binoial Sapling Model Charles R. Katholi, Ph.D. Eeritus Professor Departent
More informationA note on the multiplication of sparse matrices
Cent. Eur. J. Cop. Sci. 41) 2014 1-11 DOI: 10.2478/s13537-014-0201-x Central European Journal of Coputer Science A note on the ultiplication of sparse atrices Research Article Keivan Borna 12, Sohrab Aboozarkhani
More informationBlock designs and statistics
Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent
More informationDERIVING PROPER UNIFORM PRIORS FOR REGRESSION COEFFICIENTS
DERIVING PROPER UNIFORM PRIORS FOR REGRESSION COEFFICIENTS N. van Erp and P. van Gelder Structural Hydraulic and Probabilistic Design, TU Delft Delft, The Netherlands Abstract. In probles of odel coparison
More informationOn the Maximum Likelihood Estimation of Weibull Distribution with Lifetime Data of Hard Disk Drives
314 Int'l Conf. Par. and Dist. Proc. Tech. and Appl. PDPTA'17 On the Maxiu Likelihood Estiation of Weibull Distribution with Lifetie Data of Hard Disk Drives Daiki Koizui Departent of Inforation and Manageent
More informationCombining Classifiers
Cobining Classifiers Generic ethods of generating and cobining ultiple classifiers Bagging Boosting References: Duda, Hart & Stork, pg 475-480. Hastie, Tibsharini, Friedan, pg 246-256 and Chapter 10. http://www.boosting.org/
More informationInspection; structural health monitoring; reliability; Bayesian analysis; updating; decision analysis; value of information
Cite as: Straub D. (2014). Value of inforation analysis with structural reliability ethods. Structural Safety, 49: 75-86. Value of Inforation Analysis with Structural Reliability Methods Daniel Straub
More informationMSEC MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL SOLUTION FOR MAINTENANCE AND PERFORMANCE
Proceeding of the ASME 9 International Manufacturing Science and Engineering Conference MSEC9 October 4-7, 9, West Lafayette, Indiana, USA MSEC9-8466 MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL
More informationBayesian Approach for Fatigue Life Prediction from Field Inspection
Bayesian Approach for Fatigue Life Prediction fro Field Inspection Dawn An and Jooho Choi School of Aerospace & Mechanical Engineering, Korea Aerospace University, Goyang, Seoul, Korea Srira Pattabhiraan
More informationTEST OF HOMOGENEITY OF PARALLEL SAMPLES FROM LOGNORMAL POPULATIONS WITH UNEQUAL VARIANCES
TEST OF HOMOGENEITY OF PARALLEL SAMPLES FROM LOGNORMAL POPULATIONS WITH UNEQUAL VARIANCES S. E. Ahed, R. J. Tokins and A. I. Volodin Departent of Matheatics and Statistics University of Regina Regina,
More informationSoft Computing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis
Soft Coputing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis Beverly Rivera 1,2, Irbis Gallegos 1, and Vladik Kreinovich 2 1 Regional Cyber and Energy Security Center RCES
More informationEstimating Parameters for a Gaussian pdf
Pattern Recognition and achine Learning Jaes L. Crowley ENSIAG 3 IS First Seester 00/0 Lesson 5 7 Noveber 00 Contents Estiating Paraeters for a Gaussian pdf Notation... The Pattern Recognition Proble...3
More informationModified Systematic Sampling in the Presence of Linear Trend
Modified Systeatic Sapling in the Presence of Linear Trend Zaheen Khan, and Javid Shabbir Keywords: Abstract A new systeatic sapling design called Modified Systeatic Sapling (MSS, proposed by ] is ore
More informationDepartment of Electronic and Optical Engineering, Ordnance Engineering College, Shijiazhuang, , China
6th International Conference on Machinery, Materials, Environent, Biotechnology and Coputer (MMEBC 06) Solving Multi-Sensor Multi-Target Assignent Proble Based on Copositive Cobat Efficiency and QPSO Algorith
More informationarxiv: v1 [stat.ot] 7 Jul 2010
Hotelling s test for highly correlated data P. Bubeliny e-ail: bubeliny@karlin.ff.cuni.cz Charles University, Faculty of Matheatics and Physics, KPMS, Sokolovska 83, Prague, Czech Republic, 8675. arxiv:007.094v
More informationFeature Extraction Techniques
Feature Extraction Techniques Unsupervised Learning II Feature Extraction Unsupervised ethods can also be used to find features which can be useful for categorization. There are unsupervised ethods that
More informationpaper prepared for the 1996 PTRC Conference, September 2-6, Brunel University, UK ON THE CALIBRATION OF THE GRAVITY MODEL
paper prepared for the 1996 PTRC Conference, Septeber 2-6, Brunel University, UK ON THE CALIBRATION OF THE GRAVITY MODEL Nanne J. van der Zijpp 1 Transportation and Traffic Engineering Section Delft University
More informationExtension of CSRSM for the Parametric Study of the Face Stability of Pressurized Tunnels
Extension of CSRSM for the Paraetric Study of the Face Stability of Pressurized Tunnels Guilhe Mollon 1, Daniel Dias 2, and Abdul-Haid Soubra 3, M.ASCE 1 LGCIE, INSA Lyon, Université de Lyon, Doaine scientifique
More informationW-BASED VS LATENT VARIABLES SPATIAL AUTOREGRESSIVE MODELS: EVIDENCE FROM MONTE CARLO SIMULATIONS
W-BASED VS LATENT VARIABLES SPATIAL AUTOREGRESSIVE MODELS: EVIDENCE FROM MONTE CARLO SIMULATIONS. Introduction When it coes to applying econoetric odels to analyze georeferenced data, researchers are well
More informationSymbolic Analysis as Universal Tool for Deriving Properties of Non-linear Algorithms Case study of EM Algorithm
Acta Polytechnica Hungarica Vol., No., 04 Sybolic Analysis as Universal Tool for Deriving Properties of Non-linear Algoriths Case study of EM Algorith Vladiir Mladenović, Miroslav Lutovac, Dana Porrat
More informationBayes Decision Rule and Naïve Bayes Classifier
Bayes Decision Rule and Naïve Bayes Classifier Le Song Machine Learning I CSE 6740, Fall 2013 Gaussian Mixture odel A density odel p(x) ay be ulti-odal: odel it as a ixture of uni-odal distributions (e.g.
More informationIdentical Maximum Likelihood State Estimation Based on Incremental Finite Mixture Model in PHD Filter
Identical Maxiu Lielihood State Estiation Based on Increental Finite Mixture Model in PHD Filter Gang Wu Eail: xjtuwugang@gail.co Jing Liu Eail: elelj20080730@ail.xjtu.edu.cn Chongzhao Han Eail: czhan@ail.xjtu.edu.cn
More informationIntelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines
Intelligent Systes: Reasoning and Recognition Jaes L. Crowley osig 1 Winter Seester 2018 Lesson 6 27 February 2018 Outline Perceptrons and Support Vector achines Notation...2 Linear odels...3 Lines, Planes
More informationCS Lecture 13. More Maximum Likelihood
CS 6347 Lecture 13 More Maxiu Likelihood Recap Last tie: Introduction to axiu likelihood estiation MLE for Bayesian networks Optial CPTs correspond to epirical counts Today: MLE for CRFs 2 Maxiu Likelihood
More informationStatistical Logic Cell Delay Analysis Using a Current-based Model
Statistical Logic Cell Delay Analysis Using a Current-based Model Hanif Fatei Shahin Nazarian Massoud Pedra Dept. of EE-Systes, University of Southern California, Los Angeles, CA 90089 {fatei, shahin,
More informationModel Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon
Model Fitting CURM Background Material, Fall 014 Dr. Doreen De Leon 1 Introduction Given a set of data points, we often want to fit a selected odel or type to the data (e.g., we suspect an exponential
More informationCOS 424: Interacting with Data. Written Exercises
COS 424: Interacting with Data Hoework #4 Spring 2007 Regression Due: Wednesday, April 18 Written Exercises See the course website for iportant inforation about collaboration and late policies, as well
More informationOptimum Value of Poverty Measure Using Inverse Optimization Programming Problem
International Journal of Conteporary Matheatical Sciences Vol. 14, 2019, no. 1, 31-42 HIKARI Ltd, www.-hikari.co https://doi.org/10.12988/ijcs.2019.914 Optiu Value of Poverty Measure Using Inverse Optiization
More informationASSUME a source over an alphabet size m, from which a sequence of n independent samples are drawn. The classical
IEEE TRANSACTIONS ON INFORMATION THEORY Large Alphabet Source Coding using Independent Coponent Analysis Aichai Painsky, Meber, IEEE, Saharon Rosset and Meir Feder, Fellow, IEEE arxiv:67.7v [cs.it] Jul
More informationare equal to zero, where, q = p 1. For each gene j, the pairwise null and alternative hypotheses are,
Page of 8 Suppleentary Materials: A ultiple testing procedure for ulti-diensional pairwise coparisons with application to gene expression studies Anjana Grandhi, Wenge Guo, Shyaal D. Peddada S Notations
More informationMachine Learning Basics: Estimators, Bias and Variance
Machine Learning Basics: Estiators, Bias and Variance Sargur N. srihari@cedar.buffalo.edu This is part of lecture slides on Deep Learning: http://www.cedar.buffalo.edu/~srihari/cse676 1 Topics in Basics
More informationExperimental Design For Model Discrimination And Precise Parameter Estimation In WDS Analysis
City University of New York (CUNY) CUNY Acadeic Works International Conference on Hydroinforatics 8-1-2014 Experiental Design For Model Discriination And Precise Paraeter Estiation In WDS Analysis Giovanna
More informationThe proofs of Theorem 1-3 are along the lines of Wied and Galeano (2013).
A Appendix: Proofs The proofs of Theore 1-3 are along the lines of Wied and Galeano (2013) Proof of Theore 1 Let D[d 1, d 2 ] be the space of càdlàg functions on the interval [d 1, d 2 ] equipped with
More informationAN EFFICIENT CLASS OF CHAIN ESTIMATORS OF POPULATION VARIANCE UNDER SUB-SAMPLING SCHEME
J. Japan Statist. Soc. Vol. 35 No. 005 73 86 AN EFFICIENT CLASS OF CHAIN ESTIMATORS OF POPULATION VARIANCE UNDER SUB-SAMPLING SCHEME H. S. Jhajj*, M. K. Shara* and Lovleen Kuar Grover** For estiating the
More informationSPECTRUM sensing is a core concept of cognitive radio
World Acadey of Science, Engineering and Technology International Journal of Electronics and Counication Engineering Vol:6, o:2, 202 Efficient Detection Using Sequential Probability Ratio Test in Mobile
More informationInference in the Presence of Likelihood Monotonicity for Polytomous and Logistic Regression
Advances in Pure Matheatics, 206, 6, 33-34 Published Online April 206 in SciRes. http://www.scirp.org/journal/ap http://dx.doi.org/0.4236/ap.206.65024 Inference in the Presence of Likelihood Monotonicity
More informationDEPARTMENT OF ECONOMETRICS AND BUSINESS STATISTICS
ISSN 1440-771X AUSTRALIA DEPARTMENT OF ECONOMETRICS AND BUSINESS STATISTICS An Iproved Method for Bandwidth Selection When Estiating ROC Curves Peter G Hall and Rob J Hyndan Working Paper 11/00 An iproved
More informatione-companion ONLY AVAILABLE IN ELECTRONIC FORM
OPERATIONS RESEARCH doi 10.1287/opre.1070.0427ec pp. ec1 ec5 e-copanion ONLY AVAILABLE IN ELECTRONIC FORM infors 07 INFORMS Electronic Copanion A Learning Approach for Interactive Marketing to a Custoer
More informationProbability Distributions
Probability Distributions In Chapter, we ephasized the central role played by probability theory in the solution of pattern recognition probles. We turn now to an exploration of soe particular exaples
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Notes for EE227C (Spring 2018): Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee227c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee227c@berkeley.edu October
More informationIntelligent Systems: Reasoning and Recognition. Artificial Neural Networks
Intelligent Systes: Reasoning and Recognition Jaes L. Crowley MOSIG M1 Winter Seester 2018 Lesson 7 1 March 2018 Outline Artificial Neural Networks Notation...2 Introduction...3 Key Equations... 3 Artificial
More informationIN modern society that various systems have become more
Developent of Reliability Function in -Coponent Standby Redundant Syste with Priority Based on Maxiu Entropy Principle Ryosuke Hirata, Ikuo Arizono, Ryosuke Toohiro, Satoshi Oigawa, and Yasuhiko Takeoto
More informationFairness via priority scheduling
Fairness via priority scheduling Veeraruna Kavitha, N Heachandra and Debayan Das IEOR, IIT Bobay, Mubai, 400076, India vavitha,nh,debayan}@iitbacin Abstract In the context of ulti-agent resource allocation
More informationA LOSS FUNCTION APPROACH TO GROUP PREFERENCE AGGREGATION IN THE AHP
ISAHP 003, Bali, Indonesia, August 7-9, 003 A OSS FUNCTION APPROACH TO GROUP PREFERENCE AGGREGATION IN THE AHP Keun-Tae Cho and Yong-Gon Cho School of Systes Engineering Manageent, Sungkyunkwan University
More informationEffective joint probabilistic data association using maximum a posteriori estimates of target states
Effective joint probabilistic data association using axiu a posteriori estiates of target states 1 Viji Paul Panakkal, 2 Rajbabu Velurugan 1 Central Research Laboratory, Bharat Electronics Ltd., Bangalore,
More informationarxiv: v1 [cs.ds] 3 Feb 2014
arxiv:40.043v [cs.ds] 3 Feb 04 A Bound on the Expected Optiality of Rando Feasible Solutions to Cobinatorial Optiization Probles Evan A. Sultani The Johns Hopins University APL evan@sultani.co http://www.sultani.co/
More informationOn the Analysis of the Quantum-inspired Evolutionary Algorithm with a Single Individual
6 IEEE Congress on Evolutionary Coputation Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-1, 6 On the Analysis of the Quantu-inspired Evolutionary Algorith with a Single Individual
More informationInteractive Markov Models of Evolutionary Algorithms
Cleveland State University EngagedScholarship@CSU Electrical Engineering & Coputer Science Faculty Publications Electrical Engineering & Coputer Science Departent 2015 Interactive Markov Models of Evolutionary
More informationKernel-Based Nonparametric Anomaly Detection
Kernel-Based Nonparaetric Anoaly Detection Shaofeng Zou Dept of EECS Syracuse University Eail: szou@syr.edu Yingbin Liang Dept of EECS Syracuse University Eail: yliang6@syr.edu H. Vincent Poor Dept of
More informationChapter 6 1-D Continuous Groups
Chapter 6 1-D Continuous Groups Continuous groups consist of group eleents labelled by one or ore continuous variables, say a 1, a 2,, a r, where each variable has a well- defined range. This chapter explores:
More informationThe Distribution of the Covariance Matrix for a Subset of Elliptical Distributions with Extension to Two Kurtosis Parameters
journal of ultivariate analysis 58, 96106 (1996) article no. 0041 The Distribution of the Covariance Matrix for a Subset of Elliptical Distributions with Extension to Two Kurtosis Paraeters H. S. Steyn
More informationINTELLECTUAL DATA ANALYSIS IN AIRCRAFT DESIGN
INTELLECTUAL DATA ANALYSIS IN AIRCRAFT DESIGN V.A. Koarov 1, S.A. Piyavskiy 2 1 Saara National Research University, Saara, Russia 2 Saara State Architectural University, Saara, Russia Abstract. This article
More informationA Smoothed Boosting Algorithm Using Probabilistic Output Codes
A Soothed Boosting Algorith Using Probabilistic Output Codes Rong Jin rongjin@cse.su.edu Dept. of Coputer Science and Engineering, Michigan State University, MI 48824, USA Jian Zhang jian.zhang@cs.cu.edu
More informationLeast Squares Fitting of Data
Least Squares Fitting of Data David Eberly, Geoetric Tools, Redond WA 98052 https://www.geoetrictools.co/ This work is licensed under the Creative Coons Attribution 4.0 International License. To view a
More informationQualitative Modelling of Time Series Using Self-Organizing Maps: Application to Animal Science
Proceedings of the 6th WSEAS International Conference on Applied Coputer Science, Tenerife, Canary Islands, Spain, Deceber 16-18, 2006 183 Qualitative Modelling of Tie Series Using Self-Organizing Maps:
More informationBayes Estimation of the Logistic Distribution Parameters Based on Progressive Sampling
Appl. Math. Inf. Sci. 0, No. 6, 93-30 06) 93 Applied Matheatics & Inforation Sciences An International Journal http://dx.doi.org/0.8576/ais/0063 Bayes Estiation of the Logistic Distribution Paraeters Based
More informationAN OPTIMAL SHRINKAGE FACTOR IN PREDICTION OF ORDERED RANDOM EFFECTS
Statistica Sinica 6 016, 1709-178 doi:http://dx.doi.org/10.5705/ss.0014.0034 AN OPTIMAL SHRINKAGE FACTOR IN PREDICTION OF ORDERED RANDOM EFFECTS Nilabja Guha 1, Anindya Roy, Yaakov Malinovsky and Gauri
More informationBest Procedures For Sample-Free Item Analysis
Best Procedures For Saple-Free Ite Analysis Benjain D. Wright University of Chicago Graha A. Douglas University of Western Australia Wright s (1969) widely used "unconditional" procedure for Rasch saple-free
More informationSampling How Big a Sample?
C. G. G. Aitken, 1 Ph.D. Sapling How Big a Saple? REFERENCE: Aitken CGG. Sapling how big a saple? J Forensic Sci 1999;44(4):750 760. ABSTRACT: It is thought that, in a consignent of discrete units, a certain
More informationMeta-Analytic Interval Estimation for Bivariate Correlations
Psychological Methods 2008, Vol. 13, No. 3, 173 181 Copyright 2008 by the Aerican Psychological Association 1082-989X/08/$12.00 DOI: 10.1037/a0012868 Meta-Analytic Interval Estiation for Bivariate Correlations
More informationData-Driven Imaging in Anisotropic Media
18 th World Conference on Non destructive Testing, 16- April 1, Durban, South Africa Data-Driven Iaging in Anisotropic Media Arno VOLKER 1 and Alan HUNTER 1 TNO Stieltjesweg 1, 6 AD, Delft, The Netherlands
More informationSupport recovery in compressed sensing: An estimation theoretic approach
Support recovery in copressed sensing: An estiation theoretic approach Ain Karbasi, Ali Horati, Soheil Mohajer, Martin Vetterli School of Coputer and Counication Sciences École Polytechnique Fédérale de
More informationProc. of the IEEE/OES Seventh Working Conference on Current Measurement Technology UNCERTAINTIES IN SEASONDE CURRENT VELOCITIES
Proc. of the IEEE/OES Seventh Working Conference on Current Measureent Technology UNCERTAINTIES IN SEASONDE CURRENT VELOCITIES Belinda Lipa Codar Ocean Sensors 15 La Sandra Way, Portola Valley, CA 98 blipa@pogo.co
More informationE. Alpaydın AERFAISS
E. Alpaydın AERFAISS 00 Introduction Questions: Is the error rate of y classifier less than %? Is k-nn ore accurate than MLP? Does having PCA before iprove accuracy? Which kernel leads to highest accuracy
More informationCh 12: Variations on Backpropagation
Ch 2: Variations on Backpropagation The basic backpropagation algorith is too slow for ost practical applications. It ay take days or weeks of coputer tie. We deonstrate why the backpropagation algorith
More informationFast Montgomery-like Square Root Computation over GF(2 m ) for All Trinomials
Fast Montgoery-like Square Root Coputation over GF( ) for All Trinoials Yin Li a, Yu Zhang a, a Departent of Coputer Science and Technology, Xinyang Noral University, Henan, P.R.China Abstract This letter
More informationBoosting with log-loss
Boosting with log-loss Marco Cusuano-Towner Septeber 2, 202 The proble Suppose we have data exaples {x i, y i ) i =... } for a two-class proble with y i {, }. Let F x) be the predictor function with the
More informationBest Linear Unbiased and Invariant Reconstructors for the Past Records
BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY http:/athusy/bulletin Bull Malays Math Sci Soc (2) 37(4) (2014), 1017 1028 Best Linear Unbiased and Invariant Reconstructors for the Past Records
More informationStatistical properties of contact maps
PHYSICAL REVIEW E VOLUME 59, NUMBER 1 JANUARY 1999 Statistical properties of contact aps Michele Vendruscolo, 1 Balakrishna Subraanian, 2 Ido Kanter, 3 Eytan Doany, 1 and Joel Lebowitz 2 1 Departent of
More informationAnalyzing Simulation Results
Analyzing Siulation Results Dr. John Mellor-Cruey Departent of Coputer Science Rice University johnc@cs.rice.edu COMP 528 Lecture 20 31 March 2005 Topics for Today Model verification Model validation Transient
More informationThis model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t.
CS 493: Algoriths for Massive Data Sets Feb 2, 2002 Local Models, Bloo Filter Scribe: Qin Lv Local Models In global odels, every inverted file entry is copressed with the sae odel. This work wells when
More informationIntroduction to Machine Learning. Recitation 11
Introduction to Machine Learning Lecturer: Regev Schweiger Recitation Fall Seester Scribe: Regev Schweiger. Kernel Ridge Regression We now take on the task of kernel-izing ridge regression. Let x,...,
More informationOnline Publication Date: 19 April 2012 Publisher: Asian Economic and Social Society
Online Publication Date: April Publisher: Asian Econoic and Social Society Using Entropy Working Correlation Matrix in Generalized Estiating Equation for Stock Price Change Model Serpilılıç (Faculty of
More informationDetection and Estimation Theory
ESE 54 Detection and Estiation Theory Joseph A. O Sullivan Sauel C. Sachs Professor Electronic Systes and Signals Research Laboratory Electrical and Systes Engineering Washington University 11 Urbauer
More informationSupervised Baysian SAR image Classification Using The Full Polarimetric Data
Supervised Baysian SAR iage Classification Using The Full Polarietric Data (1) () Ziad BELHADJ (1) SUPCOM, Route de Raoued 3.5 083 El Ghazala - TUNSA () ENT, BP. 37, 100 Tunis Belvedere, TUNSA Abstract
More informationNUMERICAL MODELLING OF THE TYRE/ROAD CONTACT
NUMERICAL MODELLING OF THE TYRE/ROAD CONTACT PACS REFERENCE: 43.5.LJ Krister Larsson Departent of Applied Acoustics Chalers University of Technology SE-412 96 Sweden Tel: +46 ()31 772 22 Fax: +46 ()31
More informationKernel Methods and Support Vector Machines
Intelligent Systes: Reasoning and Recognition Jaes L. Crowley ENSIAG 2 / osig 1 Second Seester 2012/2013 Lesson 20 2 ay 2013 Kernel ethods and Support Vector achines Contents Kernel Functions...2 Quadratic
More informationPh 20.3 Numerical Solution of Ordinary Differential Equations
Ph 20.3 Nuerical Solution of Ordinary Differential Equations Due: Week 5 -v20170314- This Assignent So far, your assignents have tried to failiarize you with the hardware and software in the Physics Coputing
More informationA Model for the Selection of Internet Service Providers
ISSN 0146-4116, Autoatic Control and Coputer Sciences, 2008, Vol. 42, No. 5, pp. 249 254. Allerton Press, Inc., 2008. Original Russian Text I.M. Aliev, 2008, published in Avtoatika i Vychislitel naya Tekhnika,
More information2 Q 10. Likewise, in case of multiple particles, the corresponding density in 2 must be averaged over all
Lecture 6 Introduction to kinetic theory of plasa waves Introduction to kinetic theory So far we have been odeling plasa dynaics using fluid equations. The assuption has been that the pressure can be either
More informationSolving initial value problems by residual power series method
Theoretical Matheatics & Applications, vol.3, no.1, 13, 199-1 ISSN: 179-9687 (print), 179-979 (online) Scienpress Ltd, 13 Solving initial value probles by residual power series ethod Mohaed H. Al-Sadi
More informationThis article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and
This article appeared in a ournal published by Elsevier. The attached copy is furnished to the author for internal non-coercial research and education use, including for instruction at the authors institution
More informationCurious Bounds for Floor Function Sums
1 47 6 11 Journal of Integer Sequences, Vol. 1 (018), Article 18.1.8 Curious Bounds for Floor Function Sus Thotsaporn Thanatipanonda and Elaine Wong 1 Science Division Mahidol University International
More informationOn Constant Power Water-filling
On Constant Power Water-filling Wei Yu and John M. Cioffi Electrical Engineering Departent Stanford University, Stanford, CA94305, U.S.A. eails: {weiyu,cioffi}@stanford.edu Abstract This paper derives
More informationNumerical Studies of a Nonlinear Heat Equation with Square Root Reaction Term
Nuerical Studies of a Nonlinear Heat Equation with Square Root Reaction Ter Ron Bucire, 1 Karl McMurtry, 1 Ronald E. Micens 2 1 Matheatics Departent, Occidental College, Los Angeles, California 90041 2
More informationConstructing Locally Best Invariant Tests of the Linear Regression Model Using the Density Function of a Maximal Invariant
Aerican Journal of Matheatics and Statistics 03, 3(): 45-5 DOI: 0.593/j.ajs.03030.07 Constructing Locally Best Invariant Tests of the Linear Regression Model Using the Density Function of a Maxial Invariant
More informationThe Simplex Method is Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate
The Siplex Method is Strongly Polynoial for the Markov Decision Proble with a Fixed Discount Rate Yinyu Ye April 20, 2010 Abstract In this note we prove that the classic siplex ethod with the ost-negativereduced-cost
More informationIn this chapter, we consider several graph-theoretic and probabilistic models
THREE ONE GRAPH-THEORETIC AND STATISTICAL MODELS 3.1 INTRODUCTION In this chapter, we consider several graph-theoretic and probabilistic odels for a social network, which we do under different assuptions
More informationA Simple Regression Problem
A Siple Regression Proble R. M. Castro March 23, 2 In this brief note a siple regression proble will be introduced, illustrating clearly the bias-variance tradeoff. Let Y i f(x i ) + W i, i,..., n, where
More informationPattern Recognition and Machine Learning. Artificial Neural networks
Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2017 Lessons 7 20 Dec 2017 Outline Artificial Neural networks Notation...2 Introduction...3 Key Equations... 3 Artificial
More information