A comparison of small area estimators of counts aligned with direct higher level estimates
|
|
- Marvin Green
- 5 years ago
- Views:
Transcription
1 A comparison of small area estimators of counts aligne with irect higher level estimates Giorgio E. Montanari, M. Giovanna Ranalli an Cecilia Vicarelli Abstract Inirect estimators for small areas use auxiliary variables to borrow strength from relate areas through a linking moel. Precision of inirect estimators epens on the valiity of such a moel. To protect against possible moel failures, benchmarking proceures make the total of small area estimates match a esign consistent estimate for a larger area. This is also particularly important for National Institutes of Statistics to ensure coherence between small area estimates an irect estimates prouce at higher level planne omains. We investigate a self-benchmarke estimator in the case of a unit level logistic mixe moel for a binary response, propose an estimator for its mean square error an compare its performance with competing estimators through a simulation stuy. Key wors: Small area estimation, Logistic mixe moel, Penalize Quasi Likelihoo, Unit level moel, MSE estimation. 1 Introuction Sample surveys are esigne to provie reliable estimates of finite population parameters for large omains. In fact, esign-unbiase or approximately esignunbiase irect estimators are use for those omains whose sample size is sufficiently large. However, local an central governments increase their eman of etaile statistical information on small omains, either geographical areas that are smaller than those planne, or specific subpopulations, as those given by a fine classification on socio-emografic variables. Since such omains are not planne at the esign stage, their sample size coul be very small an even zero. Consequently, irect estimators of small area parameters may have very large variance an some- Giorgio E. Montanari, M. Giovanna Ranalli an Cecilia Vicarelli Dipartimento i Economia, Finanza e Statistica, Università egli Stui i Perugia, giovanna.ranalli@stat.unipg.it 1
2 2 Giorgio E. Montanari, M. Giovanna Ranalli an Cecilia Vicarelli times cannot be calculate ue to lack of observations. This makes it necessary to fin inirect estimators that connect relate small areas through a linking moel that is base on auxiliary information to borrow strength an increase the effective sample size. Precision of inirect estimators epens on the valiity of such a moel. To protect against possible moel failures, benchmarking proceures make the total of small area estimates match a esign consistent estimate for a larger area. This is also particularly important for National Statistical Institutes to ensure coherence between small area estimates an irect estimates prouce at higher level planne omains. There are two kins of benchmarke estimators: estimators that are internally benchmarke (or self-benchmarke) an those that are externally benchmarke. For a recent review see Wang et al. (2008). Self benchmarke preictors are, for example, the pseuo-eblup introuce by You an Rao (2002) an the augmente estimator propose by Wang et al. (2008). A rawback of this type of self benchmarke estimators is that they force the use of the same auxiliary information use for the irect usually GREG-type estimator also for the moel-base small area preictors, whereas it coul be very profitable to allow for ifferent auxiliary variables at the small area level. Externally benchmarke preictors are obtaine through an a-posteriori ajustment of moel-base preictors. Among the others, Pfeffermann an Barnar (1991) propose an externally restricte benchmarke estimator of small area means. This is constructe uner an area linear mixe moel for a continuous response variable. In this work, we investigate an extension of this approach to the case of a unit level logistic mixe moel for a binary response. This has particular relevance any time the small area estimate takes the form of a count. You et al. (2004) aress this issue by using a ratio type ajustment of Hierarchal Bayes estimators. The paper is organize as follows. Section 2 escribes the small area estimator propose by Pfeffermann an Barnar (1991) an then Section 3 illustrates the propose methoology to tackle situations in which the variable of interest is binary. An algorithm to actually compute parameter estimates an ranom variables preictions is propose together with an analytic estimator for its mean square error. The results of a limite simulation stuy that compares the performance of ifferent estimators are then presente in Section 4. 2 Some small area estimators with the benchmarking property Consier a finite population U = {1,2,..,N} an a partition of U in omains (small areas) U i mae of N i units, with i = 1,2,..,, such that U i = U an N i = N. We are intereste in estimating small area totals Y i = j Ui y i j of a binary y variable. To this purpose, we assume that a (K + 1)-imensional rowvector x i j = [1,x i j1,..,x i jk ] of an auxiliary variable x is known for each element j U i, for i = 1,2,..,. Let X N = {x i j } j Ui ;,2,.., be the matrix of population values x i j. Suppose we also know the -imensional row-vector z i j that takes value 1 in its i-th position an 0 otherwise, for all units j U i, for i = 1,2,..,. Let
3 Benchmarke small area estimators of counts 3 Z N = {z i j } j Ui ;,2,.., be the matrix of population values z i j. To estimate the population an omains total, a sample s of size n is rawn from the finite population U using a probabilistic sampling esign p(s). Let s i = s U i enote the sample with n i elements realize in the i-th omain, for i = 1,2,..,. Estimators Ŷi bench have the benchmarking property if Ŷ i bench = Ŷ, where Ŷ is a consistent estimator, usually a GREG or Calibration type estimator of the population total Y = j Ui y i j. Moel base estimators the most wiely use for small area parameters usually o not have this property when p(s) is a complex sampling esign. Given a small area estimator Ŷ i, that oesn t show the benchmarking property, a first simple way of achieving benchmarking is by a ratio type ajustment, i.e. Ŷi bench Ŷ = Ŷ i. (1) Ŷi Pfeffermann an Barnar (1991) consier an area level moel for farmlan values an moify the optimal preictor uner a linear mixe moel to have the benchmarking property on the sample mean. To this en, they compute the moel parameters an ranom effects as the penalize generalize least squares solution uner the benchmark constraint. This proceure gives ajuste estimates that are equivalent to the (un-benchmarke) small area estimates uner the linear mixe moel plus a correction term. This correction term is given for each small omain estimate by a proportion, a i, of the ifference between the esign consistent estimate an the sum of the moel-base small area estimates. In particular, Ŷ bench i = Ŷ i + a i (Ŷ Ŷ i ), (2) with a i = 1. These proportions take the form a i = cov(ŷ i, Ŷi)/var( Ŷi). In this work we consier a similar approach to eal with variables of interest that are binary an small area totals that are, therefore, counts. This is illustrate in the next section. 3 Benchmarke small area estimates of counts We assume that the y i j s are inipenent bernoulli ranom variables with P(y i j = 1 x i j ) = ( p i j ) pi j logit(p i j ) = log = η i j = x i j b + z i j u, (3) 1 p i j u N(0,σu 2 I) for j U i, i = 1,2,...,. We want to erive a benchmarke estimator Ŷi bench of Y i for i = 1,2,.., uner moel (3) that takes the following form
4 4 Giorgio E. Montanari, M. Giovanna Ranalli an Cecilia Vicarelli Ŷ bench i = y i j + ˆp i j = y i j + j s i j U i \s i j s i j U i \s i exp(x i j ˆb + z i jû) 1 + exp(x i j ˆb + z i j û) (4) (see e.g. Saei an Chambers, 2003, or Rao, 2003), but for which the benchmarking property hols, i.e. such that Ŷ bench i = Ŷ. (5) To this en, we consier the Penalize Quasi log-likelihoo (PQL) of moel (3) uner the benchmark constraint in equation (5). The PQL approach consiers a loglikelihoo function of the sample values y i j for i s i an i = 1,..., conitional on u with the aition of a penalty function ue to the presence of the ranom effect, given by the logarithm of the probability ensity function of u (for a more etaile escrition of PQL methos see e.g. McCulloch an Searle, 2001). We moify such PQL metho by aing the benchmark constraint through the metho of Lagrange multipliers. As a result, the loglikelihoo is mae of three parts. In particular, let l 1 be the loglikelihoo function of the sample values y i j conitional on u, let l 2 be the penalization coming from the marginal istribution of the ranom effects u, an let l 3 be the penalization ue to the benchmarking constraint. Therefore, the benchmarke PQL is given by l = l 1 + l 2 + l 3, with l 1 = y t sη s 1 t n log[1 + exp(η s )], l 2 = 1 2 [σ 2 l 3 = λ (Ŷ u u t u + log(σu 2 )], ) ( Ŷi bench = λ Ŷ 1 t ny s 1 t exp(η r ) N n 1 + exp(η r ) where y s enotes the vector of observe values y i j for j s i an i = 1,2,..,; η s is the linear preictor vector for j s i, i = 1,2,..,, an η r is the linear preictor vector for j U i \s i, i = 1,2,..,. To obtain maximum benchmarke PQL estimates of b, u, λ an the ML estimate of the variance component σ 2 u we use an algorithm base on Fisher Scoring. Saei an Chambers (2003) escribe the proceure to obtain small area estimates from a logistic mixe moel. Such proceure is aapte to accommoate l 3 an escribe below. 1. Assign initial values to b,u, λ, an σ 2 u. 2. Upate b, u an λ using Fisher scoring, i.e. by b (r+1) b (r) ), u (r+1) = u (r) + I(b (r),u (r),λ (r) ) 1 S(b (r),u (r),λ (r) ) λ (r+1) λ (r) where I( ) an S( ) are the Information matrix an the score of l, respectively. 3. Calculate η s an η N. 4. Calculate B s = ( 2 l 1 / η s η t s) an C r = ( 2 l 3 / η r η t r).
5 Benchmarke small area estimators of counts 5 5. Calculate T = (σu 2(r) I + Z t sb s Z s + Z t rc r Z r ) 1, where Z s = {z i j } j si ;,2,.., an Z r is its analogous on non-sample units. 6. Upate σu 2(r+1) = 1 (trace(t) + u t(r+1) u (r+1) ). 7. Return to step 2 an repeat the proceure until convergence of the loglikelihoo. It is recommene that ifferent starting values are consiere to check whether the proceure got trappe in some local maximum. Goo starting values for b an u are those coming from a fixe logistic moel, for σu 2 is the variance of these u estimates. The choice for λ, on the other sie, seems less critical; in the simulation stuies a value of 1 has been use. Using the results of the algorithm we obtain estimates of parameters to be use in (4). To calculate the mean square error (MSE) of the propose estimator we use an approximation that is an application of Prasa an Rao (1990) analytic form of MSE after a Taylor linearization of the moel. In particular, let ŷ bench = (Ŷ1 bench,...,ŷ bench ) t, MSE(ŷ bench ) = G 1 (σ 2 u ) + G 2 (σ 2 u ) + G 3 (σ 2 u ) + G 4 (σ 2 u ) (6) where, if matrices X r an B r are the analogous of X s an B s for nonsample units, an A r is a (N n) matrix of ones, G 1 (σ 2 u ) = A t rh r Z r TZ t rh t ra r, G 2 (σ 2 u ) = A t rh r (X r Z r TZ t sb s X s )(X t sv 1 s X s ) 1 (X t r X t sb s Z s TZ t r)h t ra r, G 3 (σ 2 u ) = var( ˆσ 2 u )[h t k Zt sb s V s B s Z s h l ] k,l=1,...,, an G 4 (σ 2 u ) = A t rb r A r, where H r = iag[ ˆp i j (1 ˆp i j )] j Ui \s i for i = 1,..,, V s = σu 2 Z s Z t s + B 1 s, h t k = (h k1,..,h k ) = a t rk Z rt, a t rk enotes the k-th row of At rh r, an h t k = ( h k1/ σu 2,..., h k / σu 2 ). Observe that the approximation in (6) epens on how well the linear mixe moel in the linearize response variable approximates the original generalize linear mixe moel, an how goo is the first-orer Taylor approximation. An estimator for MSE(ŷ bench ) can then be obtaine by mse(ŷ bench ) = Ĝ 1 ( ˆσ u 2 ) + Ĝ 2 ( ˆσ u 2 )+2Ĝ 3 ( ˆσ u 2 )+Ĝ 4 ( ˆσ u 2 ), where hats enote substitution with estimate values from the output of the algorithm. For more etails in the un-benchmarke case see Saei an Chambers (2003) an González-Manteiga et al. (2007). 4 Simulation stuy an some concluing remarks We conuct a simulation stuy (i) to investigate the effect of benchmarking on the performance of the estimators, (ii) to compare the performance of estimators base on linear mixe moels an that of those base on logistic mixe moels to estimate small area counts an (iii) to compare the performance of estimators base on alternative algorithms that estimate logistic mixe moels. To these ens we start from real ata coming from the Italian Multipurpose househol survey. The sample
6 6 Giorgio E. Montanari, M. Giovanna Ranalli an Cecilia Vicarelli from the Region Umbria has been use as our finite population mae of N = 4,879 units ivie into = 51 small area given by municipalities. To simulate a complex sampling esign, units are ranomly assigne to four strata of imension 500, 800, 1,500 an 2,079, respectively. The response variable is simulate an constructe using age, sex an stratum membership as covariates in the following linear preictor η i j = 0.4str 1i j + 0.1str 2i j 1.7str 3i j 2str 4i j 0.16age i j + 0.9sex i j + u i, with = 51 ranom effects u i rawn from a zero mean normal variable with variance 3. This moel allows to buil an informative stratification. A bernoulli experiment is then rawn once with probabilities p i j = exp(η i j )/(1 exp(η i j )) to obtain binary response variable y i j. An ajustment is then mae to have at least 3 values equal to 1 for each small area. This allows to use overall measures of performance base on relative bias (see later in this section) to ease the comparison of the ifferent estimators. The overall mean of the response variable is 7.8%. Five hunres stratifie ranom samples of imension n = 500 have been selecte using a isproportionate allocation. In particular, we select 112 elements from the first stratum, 120 from the secon, 112 from the thir an 156 from the fourth. This gets sampling rates within strata of 22.4%, 15.0%, 7.5% an 7.5%, respectively. The benchmark is the Horvitz-Thompson estimator of the total. For each sample several small area estimators are compute. All use moels base on the same two covariates age an sex an a normal ranom area effect. Firstly, a set of three estimators base on a unit level linear mixe moel are consiere: the classical Battese et al. (1988) estimator BHF that is not benchmarke, then its ratio ajustment as in equation (1) BHFr an, finally, the Pfeffermann an Barnar (1991) estimator PB as in equation (2). Seconly, a set of seven estimators base on a logistic mixe moel is consiere. It is well known that, ifferently from the normal case, maximum likelihoo estimates of the parameters an of the variance components in a logistic-normal mixe moel is hinere by the presence of a imensional integral, so that irect calculation is intractable an well known computational issues arise. Therefore, more attention shoul be pai when computing these estimators by, possibly, comparing results coming from ifferent softwares that use ifferent algorithms. Consequently, we consier the estimator RPQL obtaine using the function glmmpql of R, an its ratio ajustment RPQLr, the estimator RML obtaine using the function glmmml of R, an its ratio ajustment RMLr. Finally, three estimators are consiere that are obtaine using the Saei an Chambers (2003) algorithm: the first one is the un-benchmarke one SC, then its ratio ajustment SCr an, finally, the propose self-benchmarke estimator SCsb. Let Ŷi r be the value of a small area estimator of the total at replicate r, for r = 1,...,500; then the following evaluation criteria have been compute an reporte in Table 1: % Relative Bias for small area i: RB i = 1 R [ R r=1 ] Ŷi r Y i 100; Y i
7 Benchmarke small area estimators of counts 7 Average Absolute RB: AARB = 1 RB i ; Maximum Absolute RB: MARB = max RB i ; i % Relative Root MSE for small area i: RRMSE i = 1 R Average RRMSE: ARRMSE = 1 RRMSE i ; Maximum RRMSE: MRRMSE = maxrrmse i. i [ R r=1 (Ŷ ) r 2 ] i Y i 100; Y i Table 1 Simulation results: Average an Maximum Absolute % Relative Bias, Average an Maximum % Relative Root Mean Square Error for all estimators. BHF BHFr PB RPQL RPQLr RML RMLr SC SCr SCsb AARB MARB ARRMSE MRRMSE First we can note that estimators with the benchmarking property all have a smaller bias an MSE than their corresponing un-benchmarke ones. This can be explaine by the fact that benchmarking moel base estimates to the unbiase Horvitz-Thompson estimator helps in ecreasing the bias of the estimates. Seconly, we compare the performance of estimators base on linear mixe moels an that of those base on a logistic mixe moel. In fact, if in classical statistics using normal moels for a binary variable instea of the appropriate logistic ones is usually eprecate, for small area statistics there is not a clear-cut evience of the superiority in terms of performance of the latter over the former. In fact, in this case the performance is similar, both in terms of bias an error. However, note that normal base moels prouce negative estimates for the areas with a low population count. This has happene 60 times for BHF an BHFr an 268 times for PB in the estimates. Thirly, when comparing estimators base on a logistic mixe moel compute using ifferent algorithms, we can note that the Saei an Chambers (2003) algorithm has a goo performance with respect to the two others, both in terms of bias an error. Finally, it can be note that the self-benchmarke propose estimator shows a very goo performance in terms of overall bias, an it also ecreases significantly the bias for the most biase area it has the smallest MARB value. This is true also for the MSE. Decrease of bias shown by the benchmarke estimators can be likely explaine by the fact that the sampling esign is, in this case, informative. It will be interesting, therefore, to evaluate the effect of weighting the likelihoo equations provie in Section 3 to account for the sampling esign. In aition, we envision the stuy of
8 8 Giorgio E. Montanari, M. Giovanna Ranalli an Cecilia Vicarelli the effect of benchmarking to GREG-type estimators base on auxiliary information that may or may not coincie with that use in the small area moels. Also, it will be of interest to compare the performance of the ifferent estimators for ifferent values of the population proportion of the attribute an of the variance of the area effects. Finally, evaluation of the analytic MSE estimator is also on the agena. Acknowlegements Work supporte by the project PRIN 2007 Efficient use of auxiliary information at the esign an at the estimation stage of complex surveys: methoological aspects an applications for proucing official statistics. References 1. Battese, G.E., Harter, R.M., Fuller, W.A., An error-components moel for preiction of county crop areas using survey an satellite ata. J Am Stat Ass. 83, (1988). 2. McCulloch, C.E., Searle, S.R., Generalize, Linear, an Mixe Moel, Wiley, New York (2001) 3. González-Manteiga, W., Lombaría, M.J., Molina, I., Morales, D., Santamaría, L., Estimation of the mean square error of preictors of small area linear parameters uner a logistic mixe moel, Comput Stat Data An. 51, (2007) 4. Pfeffermann, D., Barnar, C.H., Some New Estimators for Small-Area Means With Application to the Assessment of Farmlan Values, J Bus Econ Stat. 90, (1991) 5. Prasa, N.G.N., Rao, J.N.K., The estimation of the mean square errror of small area estimators. J Am Stat Ass. 85, (1990) 6. Rao, J.N.K., Small area estimation. Wiley, New Jersey (2003) 7. Saei, A., Chambers, R., Small Area Estimation Uner Linear an Generalize Linear Moel With Time an Area Effects. Working Paper M03/15, Southampton Statistical Sciences Research Institute, University of Southampton (2003). 8. Wang, J., Fuller, W.A., Qu, Y., Small area estimation uner a restriction. Surv Methool. 34, (2008) 9. You, Y., Rao, J.N.K., A pseuo-empirical Best Linear Unbiase Preiction Approach to Small Area Estimation Using Survey Weights. Can J Stat. 30, (2002). 10. You, Y., Rao, J.N.K., Dick, P., Benchmarking hierarchical bayes small area estimators in the Canaian census unercoverage estimation. Statistics in Transition, 6, (2004)
This module is part of the. Memobust Handbook. on Methodology of Modern Business Statistics
This moule is part of the Memobust Hanbook on Methoology of Moern Business Statistics 26 March 2014 Metho: Balance Sampling for Multi-Way Stratification Contents General section... 3 1. Summary... 3 2.
More informationThis module is part of the. Memobust Handbook. on Methodology of Modern Business Statistics
This moule is part of the Memobust Hanbook on Methoology of Moern Business Statistics 26 March 2014 Metho: EBLUP Unit Level for Small Area Estimation Contents General section... 3 1. Summary... 3 2. General
More informationA COMPARISON OF SMALL AREA AND CALIBRATION ESTIMATORS VIA SIMULATION
SAISICS IN RANSIION new series an SURVEY MEHODOLOGY 133 SAISICS IN RANSIION new series an SURVEY MEHODOLOGY Joint Issue: Small Area Estimation 014 Vol. 17, No. 1, pp. 133 154 A COMPARISON OF SMALL AREA
More informationEstimation of District Level Poor Households in the State of. Uttar Pradesh in India by Combining NSSO Survey and
Int. Statistical Inst.: Proc. 58th Worl Statistical Congress, 2011, Dublin (Session CPS039) p.6567 Estimation of District Level Poor Househols in the State of Uttar Praesh in Inia by Combining NSSO Survey
More informationSurvey-weighted Unit-Level Small Area Estimation
Survey-weighte Unit-Level Small Area Estimation Jan Pablo Burgar an Patricia Dörr Abstract For evience-base regional policy making, geographically ifferentiate estimates of socio-economic inicators are
More informationSurvey Sampling. 1 Design-based Inference. Kosuke Imai Department of Politics, Princeton University. February 19, 2013
Survey Sampling Kosuke Imai Department of Politics, Princeton University February 19, 2013 Survey sampling is one of the most commonly use ata collection methos for social scientists. We begin by escribing
More informationThe Role of Models in Model-Assisted and Model- Dependent Estimation for Domains and Small Areas
The Role of Moels in Moel-Assiste an Moel- Depenent Estimation for Domains an Small Areas Risto Lehtonen University of Helsini Mio Myrsylä University of Pennsylvania Carl-Eri Särnal University of Montreal
More informationEstimating Unemployment for Small Areas in Navarra, Spain
Estimating Unemployment for Small Areas in Navarra, Spain Ugarte, M.D., Militino, A.F., an Goicoa, T. Departamento e Estaística e Investigación Operativa, Universia Pública e Navarra Campus e Arrosaía,
More informationImproving Estimation Accuracy in Nonrandomized Response Questioning Methods by Multiple Answers
International Journal of Statistics an Probability; Vol 6, No 5; September 207 ISSN 927-7032 E-ISSN 927-7040 Publishe by Canaian Center of Science an Eucation Improving Estimation Accuracy in Nonranomize
More informationSmall Area Estimation: A Review of Methods Based on the Application of Mixed Models. Ayoub Saei, Ray Chambers. Abstract
Small Area Estimation: A Review of Methos Base on the Application of Mixe Moels Ayoub Saei, Ray Chambers Abstract This is the review component of the report on small area estimation theory that was prepare
More informationPoisson M-quantile regression for small area estimation
University of Wollongong Research Online Centre for Statistical & Survey Methoology Working Paper Series Faculty of Engineering an Information Sciences 2013 Poisson M-quantile regression for small area
More informationCombining Time Series and Cross-sectional Data for Current Employment Statistics Estimates 1
JSM015 - Surey Research Methos Section Combining Time Series an Cross-sectional Data for Current Employment Statistics Estimates 1 Julie Gershunskaya U.S. Bureau of Labor Statistics, Massachusetts Ae NE,
More informationM-Quantile Regression for Binary Data with Application to Small Area Estimation
University of Wollongong Research Online Centre for Statistical & Survey Methoology Working Paper Series Faculty of Engineering an Information Sciences 2012 M-Quantile Regression for Binary Data with Application
More informationR package sae: Methodology
R package sae: Methoology Isabel Molina *, Yolana Marhuena March, 2015 Contents 1 Introuction 3 2 Function irect 3 2.1 Sampling without replacement.................... 3 2.2 Sampling with replacement......................
More informationDeliverable 2.2. Small Area Estimation of Indicators on Poverty and Social Exclusion
Deliverable 2.2 Small Area Estimation of Inicators on Poverty an Social Exclusion Version: 2011 Risto Lehtonen, Ari Veijanen, Mio Myrsylä an Maria Valaste The project FP7-SSH-2007-217322 AMELI is supporte
More informationLATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION
The Annals of Statistics 1997, Vol. 25, No. 6, 2313 2327 LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION By Eva Riccomagno, 1 Rainer Schwabe 2 an Henry P. Wynn 1 University of Warwick, Technische
More informationComputing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions
Working Paper 2013:5 Department of Statistics Computing Exact Confience Coefficients of Simultaneous Confience Intervals for Multinomial Proportions an their Functions Shaobo Jin Working Paper 2013:5
More informationSYNCHRONOUS SEQUENTIAL CIRCUITS
CHAPTER SYNCHRONOUS SEUENTIAL CIRCUITS Registers an counters, two very common synchronous sequential circuits, are introuce in this chapter. Register is a igital circuit for storing information. Contents
More informationLecture 2: Correlated Topic Model
Probabilistic Moels for Unsupervise Learning Spring 203 Lecture 2: Correlate Topic Moel Inference for Correlate Topic Moel Yuan Yuan First of all, let us make some claims about the parameters an variables
More informationLinear Regression with Limited Observation
Ela Hazan Tomer Koren Technion Israel Institute of Technology, Technion City 32000, Haifa, Israel ehazan@ie.technion.ac.il tomerk@cs.technion.ac.il Abstract We consier the most common variants of linear
More informationA Review of Multiple Try MCMC algorithms for Signal Processing
A Review of Multiple Try MCMC algorithms for Signal Processing Luca Martino Image Processing Lab., Universitat e València (Spain) Universia Carlos III e Mari, Leganes (Spain) Abstract Many applications
More informationA Modification of the Jarque-Bera Test. for Normality
Int. J. Contemp. Math. Sciences, Vol. 8, 01, no. 17, 84-85 HIKARI Lt, www.m-hikari.com http://x.oi.org/10.1988/ijcms.01.9106 A Moification of the Jarque-Bera Test for Normality Moawa El-Fallah Ab El-Salam
More informationGaussian processes with monotonicity information
Gaussian processes with monotonicity information Anonymous Author Anonymous Author Unknown Institution Unknown Institution Abstract A metho for using monotonicity information in multivariate Gaussian process
More informationThermal conductivity of graded composites: Numerical simulations and an effective medium approximation
JOURNAL OF MATERIALS SCIENCE 34 (999)5497 5503 Thermal conuctivity of grae composites: Numerical simulations an an effective meium approximation P. M. HUI Department of Physics, The Chinese University
More informationEstimating International Migration on the Base of Small Area Techniques
MPRA Munich Personal RePEc Archive Estimating International Migration on the Base of Small Area echniques Vergil Voineagu an Nicoleta Caragea an Silvia Pisica 2013 Online at http://mpra.ub.uni-muenchen.e/48775/
More informationLeast-Squares Regression on Sparse Spaces
Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction
More information'HVLJQ &RQVLGHUDWLRQ LQ 0DWHULDO 6HOHFWLRQ 'HVLJQ 6HQVLWLYLW\,1752'8&7,21
Large amping in a structural material may be either esirable or unesirable, epening on the engineering application at han. For example, amping is a esirable property to the esigner concerne with limiting
More informationA Course in Machine Learning
A Course in Machine Learning Hal Daumé III 12 EFFICIENT LEARNING So far, our focus has been on moels of learning an basic algorithms for those moels. We have not place much emphasis on how to learn quickly.
More informationContributors: France, Germany, Italy, Netherlands, Norway, Poland, Spain, Switzerland
ESSNET ON SMALL AREA ESTIMATION REPORT ON WORK PACKAGE 5 CASE STUDIES FINAL VERSION REVISION FEBRUARY 1 Contributors: France, Germany, Italy, Netherlans, Norway, Polan, Spain, Switzerlan Contents 1. Overview
More informationTime-of-Arrival Estimation in Non-Line-Of-Sight Environments
2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor
More informationRobust Bounds for Classification via Selective Sampling
Nicolò Cesa-Bianchi DSI, Università egli Stui i Milano, Italy Clauio Gentile DICOM, Università ell Insubria, Varese, Italy Francesco Orabona Iiap, Martigny, Switzerlan cesa-bianchi@siunimiit clauiogentile@uninsubriait
More informationHybrid Fusion for Biometrics: Combining Score-level and Decision-level Fusion
Hybri Fusion for Biometrics: Combining Score-level an Decision-level Fusion Qian Tao Raymon Velhuis Signals an Systems Group, University of Twente Postbus 217, 7500AE Enschee, the Netherlans {q.tao,r.n.j.velhuis}@ewi.utwente.nl
More informationSmall Area Estimation Using a Nonparametric Model Based Direct Estimator
University of Wollongong Research Online Centre for Statistical & Survey Methodology Working Paper Series Faculty of Engineering and Information Sciences 2009 Small Area Estimation Using a Nonparametric
More informationTutorial on Maximum Likelyhood Estimation: Parametric Density Estimation
Tutorial on Maximum Likelyhoo Estimation: Parametric Density Estimation Suhir B Kylasa 03/13/2014 1 Motivation Suppose one wishes to etermine just how biase an unfair coin is. Call the probability of tossing
More informationKNN Particle Filters for Dynamic Hybrid Bayesian Networks
KNN Particle Filters for Dynamic Hybri Bayesian Networs H. D. Chen an K. C. Chang Dept. of Systems Engineering an Operations Research George Mason University MS 4A6, 4400 University Dr. Fairfax, VA 22030
More informationResearch Article When Inflation Causes No Increase in Claim Amounts
Probability an Statistics Volume 2009, Article ID 943926, 10 pages oi:10.1155/2009/943926 Research Article When Inflation Causes No Increase in Claim Amounts Vytaras Brazauskas, 1 Bruce L. Jones, 2 an
More informationMonte Carlo Methods with Reduced Error
Monte Carlo Methos with Reuce Error As has been shown, the probable error in Monte Carlo algorithms when no information about the smoothness of the function is use is Dξ r N = c N. It is important for
More informationStable and compact finite difference schemes
Center for Turbulence Research Annual Research Briefs 2006 2 Stable an compact finite ifference schemes By K. Mattsson, M. Svär AND M. Shoeybi. Motivation an objectives Compact secon erivatives have long
More informationFLUCTUATIONS IN THE NUMBER OF POINTS ON SMOOTH PLANE CURVES OVER FINITE FIELDS. 1. Introduction
FLUCTUATIONS IN THE NUMBER OF POINTS ON SMOOTH PLANE CURVES OVER FINITE FIELDS ALINA BUCUR, CHANTAL DAVID, BROOKE FEIGON, MATILDE LALÍN 1 Introuction In this note, we stuy the fluctuations in the number
More informationarxiv: v1 [cond-mat.stat-mech] 9 Jan 2012
arxiv:1201.1836v1 [con-mat.stat-mech] 9 Jan 2012 Externally riven one-imensional Ising moel Amir Aghamohammai a 1, Cina Aghamohammai b 2, & Mohamma Khorrami a 3 a Department of Physics, Alzahra University,
More informationMath 342 Partial Differential Equations «Viktor Grigoryan
Math 342 Partial Differential Equations «Viktor Grigoryan 6 Wave equation: solution In this lecture we will solve the wave equation on the entire real line x R. This correspons to a string of infinite
More informationA Fay Herriot Model for Estimating the Proportion of Households in Poverty in Brazilian Municipalities
Int. Statistical Inst.: Proc. 58th Worl Statistical Congress, 2011, Dublin (Session CPS016) p.4218 A Fay Herriot Moel for Estimating the Proportion of Househols in Poverty in Brazilian Municipalities Quintaes,
More informationAnalyzing Tensor Power Method Dynamics in Overcomplete Regime
Journal of Machine Learning Research 18 (2017) 1-40 Submitte 9/15; Revise 11/16; Publishe 4/17 Analyzing Tensor Power Metho Dynamics in Overcomplete Regime Animashree Ananumar Department of Electrical
More informationLower Bounds for the Smoothed Number of Pareto optimal Solutions
Lower Bouns for the Smoothe Number of Pareto optimal Solutions Tobias Brunsch an Heiko Röglin Department of Computer Science, University of Bonn, Germany brunsch@cs.uni-bonn.e, heiko@roeglin.org Abstract.
More informationEntanglement is not very useful for estimating multiple phases
PHYSICAL REVIEW A 70, 032310 (2004) Entanglement is not very useful for estimating multiple phases Manuel A. Ballester* Department of Mathematics, University of Utrecht, Box 80010, 3508 TA Utrecht, The
More informationGENERALIZED FIDUCIAL INFERENCE VIA DISCRETIZATION
Statistica Sinica 23 2013), 489-514 oi:http://x.oi.org/10.5705/ss.2011.102 GENERALIZED FIDUCIAL INFERENCE VIA DISCRETIZATION Jan Hannig The University of North Carolina at Chapel Hill Abstract: In aition
More informationHow to Minimize Maximum Regret in Repeated Decision-Making
How to Minimize Maximum Regret in Repeate Decision-Making Karl H. Schlag July 3 2003 Economics Department, European University Institute, Via ella Piazzuola 43, 033 Florence, Italy, Tel: 0039-0-4689, email:
More informationThe derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)
Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)
More informationOnline Appendix for Trade Policy under Monopolistic Competition with Firm Selection
Online Appenix for Trae Policy uner Monopolistic Competition with Firm Selection Kyle Bagwell Stanfor University an NBER Seung Hoon Lee Georgia Institute of Technology September 6, 2018 In this Online
More informationA Path Planning Method Using Cubic Spiral with Curvature Constraint
A Path Planning Metho Using Cubic Spiral with Curvature Constraint Tzu-Chen Liang an Jing-Sin Liu Institute of Information Science 0, Acaemia Sinica, Nankang, Taipei 5, Taiwan, R.O.C., Email: hartree@iis.sinica.eu.tw
More informationBayesian Estimation of the Entropy of the Multivariate Gaussian
Bayesian Estimation of the Entropy of the Multivariate Gaussian Santosh Srivastava Fre Hutchinson Cancer Research Center Seattle, WA 989, USA Email: ssrivast@fhcrc.org Maya R. Gupta Department of Electrical
More informationSchrödinger s equation.
Physics 342 Lecture 5 Schröinger s Equation Lecture 5 Physics 342 Quantum Mechanics I Wenesay, February 3r, 2010 Toay we iscuss Schröinger s equation an show that it supports the basic interpretation of
More informationNOTES ON EULER-BOOLE SUMMATION (1) f (l 1) (n) f (l 1) (m) + ( 1)k 1 k! B k (y) f (k) (y) dy,
NOTES ON EULER-BOOLE SUMMATION JONATHAN M BORWEIN, NEIL J CALKIN, AND DANTE MANNA Abstract We stuy a connection between Euler-MacLaurin Summation an Boole Summation suggeste in an AMM note from 196, which
More informationSituation awareness of power system based on static voltage security region
The 6th International Conference on Renewable Power Generation (RPG) 19 20 October 2017 Situation awareness of power system base on static voltage security region Fei Xiao, Zi-Qing Jiang, Qian Ai, Ran
More informationinflow outflow Part I. Regular tasks for MAE598/494 Task 1
MAE 494/598, Fall 2016 Project #1 (Regular tasks = 20 points) Har copy of report is ue at the start of class on the ue ate. The rules on collaboration will be release separately. Please always follow the
More informationSimilarity Measures for Categorical Data A Comparative Study. Technical Report
Similarity Measures for Categorical Data A Comparative Stuy Technical Report Department of Computer Science an Engineering University of Minnesota 4-92 EECS Builing 200 Union Street SE Minneapolis, MN
More informationOptimal Signal Detection for False Track Discrimination
Optimal Signal Detection for False Track Discrimination Thomas Hanselmann Darko Mušicki Dept. of Electrical an Electronic Eng. Dept. of Electrical an Electronic Eng. The University of Melbourne The University
More informationMulti-View Clustering via Canonical Correlation Analysis
Technical Report TTI-TR-2008-5 Multi-View Clustering via Canonical Correlation Analysis Kamalika Chauhuri UC San Diego Sham M. Kakae Toyota Technological Institute at Chicago ABSTRACT Clustering ata in
More informationarxiv: v1 [hep-lat] 19 Nov 2013
HU-EP-13/69 SFB/CPP-13-98 DESY 13-225 Applicability of Quasi-Monte Carlo for lattice systems arxiv:1311.4726v1 [hep-lat] 19 ov 2013, a,b Tobias Hartung, c Karl Jansen, b Hernan Leovey, Anreas Griewank
More informationHomework 2 Solutions EM, Mixture Models, PCA, Dualitys
Homewor Solutions EM, Mixture Moels, PCA, Dualitys CMU 0-75: Machine Learning Fall 05 http://www.cs.cmu.eu/~bapoczos/classes/ml075_05fall/ OUT: Oct 5, 05 DUE: Oct 9, 05, 0:0 AM An EM algorithm for a Mixture
More informationarxiv: v2 [cond-mat.stat-mech] 11 Nov 2016
Noname manuscript No. (will be inserte by the eitor) Scaling properties of the number of ranom sequential asorption iterations neee to generate saturate ranom packing arxiv:607.06668v2 [con-mat.stat-mech]
More informationDesigning of Acceptance Double Sampling Plan for Life Test Based on Percentiles of Exponentiated Rayleigh Distribution
International Journal of Statistics an Systems ISSN 973-675 Volume, Number 3 (7), pp. 475-484 Research Inia Publications http://www.ripublication.com Designing of Acceptance Double Sampling Plan for Life
More informationSeparation of Variables
Physics 342 Lecture 1 Separation of Variables Lecture 1 Physics 342 Quantum Mechanics I Monay, January 25th, 2010 There are three basic mathematical tools we nee, an then we can begin working on the physical
More informationExperiment 2, Physics 2BL
Experiment 2, Physics 2BL Deuction of Mass Distributions. Last Upate: 2009-05-03 Preparation Before this experiment, we recommen you review or familiarize yourself with the following: Chapters 4-6 in Taylor
More informationChapter 4. Electrostatics of Macroscopic Media
Chapter 4. Electrostatics of Macroscopic Meia 4.1 Multipole Expansion Approximate potentials at large istances 3 x' x' (x') x x' x x Fig 4.1 We consier the potential in the far-fiel region (see Fig. 4.1
More informationEstimation of the Maximum Domination Value in Multi-Dimensional Data Sets
Proceeings of the 4th East-European Conference on Avances in Databases an Information Systems ADBIS) 200 Estimation of the Maximum Domination Value in Multi-Dimensional Data Sets Eleftherios Tiakas, Apostolos.
More informationA PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks
A PAC-Bayesian Approach to Spectrally-Normalize Margin Bouns for Neural Networks Behnam Neyshabur, Srinah Bhojanapalli, Davi McAllester, Nathan Srebro Toyota Technological Institute at Chicago {bneyshabur,
More informationLeaving Randomness to Nature: d-dimensional Product Codes through the lens of Generalized-LDPC codes
Leaving Ranomness to Nature: -Dimensional Prouct Coes through the lens of Generalize-LDPC coes Tavor Baharav, Kannan Ramchanran Dept. of Electrical Engineering an Computer Sciences, U.C. Berkeley {tavorb,
More informationTHE ACCURATE ELEMENT METHOD: A NEW PARADIGM FOR NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS
THE PUBISHING HOUSE PROCEEDINGS O THE ROMANIAN ACADEMY, Series A, O THE ROMANIAN ACADEMY Volume, Number /, pp. 6 THE ACCURATE EEMENT METHOD: A NEW PARADIGM OR NUMERICA SOUTION O ORDINARY DIERENTIA EQUATIONS
More informationParameter estimation: A new approach to weighting a priori information
Parameter estimation: A new approach to weighting a priori information J.L. Mea Department of Mathematics, Boise State University, Boise, ID 83725-555 E-mail: jmea@boisestate.eu Abstract. We propose a
More informationCascaded redundancy reduction
Network: Comput. Neural Syst. 9 (1998) 73 84. Printe in the UK PII: S0954-898X(98)88342-5 Cascae reunancy reuction Virginia R e Sa an Geoffrey E Hinton Department of Computer Science, University of Toronto,
More informationLectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs
Lectures - Week 10 Introuction to Orinary Differential Equations (ODES) First Orer Linear ODEs When stuying ODEs we are consiering functions of one inepenent variable, e.g., f(x), where x is the inepenent
More informationIntroduction to Markov Processes
Introuction to Markov Processes Connexions moule m44014 Zzis law Gustav) Meglicki, Jr Office of the VP for Information Technology Iniana University RCS: Section-2.tex,v 1.24 2012/12/21 18:03:08 gustav
More informationSpurious Significance of Treatment Effects in Overfitted Fixed Effect Models Albrecht Ritschl 1 LSE and CEPR. March 2009
Spurious Significance of reatment Effects in Overfitte Fixe Effect Moels Albrecht Ritschl LSE an CEPR March 2009 Introuction Evaluating subsample means across groups an time perios is common in panel stuies
More informationRobust Low Rank Kernel Embeddings of Multivariate Distributions
Robust Low Rank Kernel Embeings of Multivariate Distributions Le Song, Bo Dai College of Computing, Georgia Institute of Technology lsong@cc.gatech.eu, boai@gatech.eu Abstract Kernel embeing of istributions
More informationLecture 6: Calculus. In Song Kim. September 7, 2011
Lecture 6: Calculus In Song Kim September 7, 20 Introuction to Differential Calculus In our previous lecture we came up with several ways to analyze functions. We saw previously that the slope of a linear
More informationHomework 2 EM, Mixture Models, PCA, Dualitys
Homework 2 EM, Mixture Moels, PCA, Dualitys CMU 10-715: Machine Learning (Fall 2015) http://www.cs.cmu.eu/~bapoczos/classes/ml10715_2015fall/ OUT: Oct 5, 2015 DUE: Oct 19, 2015, 10:20 AM Guielines The
More informationIntroduction to variational calculus: Lecture notes 1
October 10, 2006 Introuction to variational calculus: Lecture notes 1 Ewin Langmann Mathematical Physics, KTH Physics, AlbaNova, SE-106 91 Stockholm, Sween Abstract I give an informal summary of variational
More informationSTATISTICAL LIKELIHOOD REPRESENTATIONS OF PRIOR KNOWLEDGE IN MACHINE LEARNING
STATISTICAL LIKELIHOOD REPRESENTATIONS OF PRIOR KNOWLEDGE IN MACHINE LEARNING Mark A. Kon Department of Mathematics an Statistics Boston University Boston, MA 02215 email: mkon@bu.eu Anrzej Przybyszewski
More informationTractability results for weighted Banach spaces of smooth functions
Tractability results for weighte Banach spaces of smooth functions Markus Weimar Mathematisches Institut, Universität Jena Ernst-Abbe-Platz 2, 07740 Jena, Germany email: markus.weimar@uni-jena.e March
More informationConcentration of Measure Inequalities for Compressive Toeplitz Matrices with Applications to Detection and System Identification
Concentration of Measure Inequalities for Compressive Toeplitz Matrices with Applications to Detection an System Ientification Borhan M Sananaji, Tyrone L Vincent, an Michael B Wakin Abstract In this paper,
More informationBinary Discrimination Methods for High Dimensional Data with a. Geometric Representation
Binary Discrimination Methos for High Dimensional Data with a Geometric Representation Ay Bolivar-Cime, Luis Miguel Corova-Roriguez Universia Juárez Autónoma e Tabasco, División Acaémica e Ciencias Básicas
More informationNonparametric Small Area Estimation via M-quantile Regression using Penalized Splines
Nonparametric Small Estimation via M-quantile Regression using Penalized Splines Monica Pratesi 10 August 2008 Abstract The demand of reliable statistics for small areas, when only reduced sizes of the
More informationBalancing Expected and Worst-Case Utility in Contracting Models with Asymmetric Information and Pooling
Balancing Expecte an Worst-Case Utility in Contracting Moels with Asymmetric Information an Pooling R.B.O. erkkamp & W. van en Heuvel & A.P.M. Wagelmans Econometric Institute Report EI2018-01 9th January
More informationReal-time arrival prediction models for light rail train systems EDOUARD NAYE
DEGREE PROJECT IN TRANSPORT AND LOCATION ANALYSIS STOCKHOLM, SWEDEN 14 Real-time arrival preiction moels for light rail train systems EDOUARD NAYE KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF ARCHITECTURE
More informationIntroduction to Machine Learning
How o you estimate p(y x)? Outline Contents Introuction to Machine Learning Logistic Regression Varun Chanola April 9, 207 Generative vs. Discriminative Classifiers 2 Logistic Regression 2 3 Logistic Regression
More informationSmall Area Estimates of Poverty Incidence in the State of Uttar Pradesh in India
Small Area Estimates of Poverty Incidence in the State of Uttar Pradesh in India Hukum Chandra Indian Agricultural Statistics Research Institute, New Delhi Email: hchandra@iasri.res.in Acknowledgments
More informationA new identification method of the supply hole discharge coefficient of gas bearings
Tribology an Design 95 A new ientification metho of the supply hole ischarge coefficient of gas bearings G. Belforte, F. Colombo, T. Raparelli, A. Trivella & V. Viktorov Department of Mechanics, Politecnico
More informationTopic 7: Convergence of Random Variables
Topic 7: Convergence of Ranom Variables Course 003, 2016 Page 0 The Inference Problem So far, our starting point has been a given probability space (S, F, P). We now look at how to generate information
More informationSystems & Control Letters
Systems & ontrol Letters ( ) ontents lists available at ScienceDirect Systems & ontrol Letters journal homepage: www.elsevier.com/locate/sysconle A converse to the eterministic separation principle Jochen
More informationDiagonalization of Matrices Dr. E. Jacobs
Diagonalization of Matrices Dr. E. Jacobs One of the very interesting lessons in this course is how certain algebraic techniques can be use to solve ifferential equations. The purpose of these notes is
More informationELECTRON DIFFRACTION
ELECTRON DIFFRACTION Electrons : wave or quanta? Measurement of wavelength an momentum of electrons. Introuction Electrons isplay both wave an particle properties. What is the relationship between the
More informationModelling and simulation of dependence structures in nonlife insurance with Bernstein copulas
Moelling an simulation of epenence structures in nonlife insurance with Bernstein copulas Prof. Dr. Dietmar Pfeifer Dept. of Mathematics, University of Olenburg an AON Benfiel, Hamburg Dr. Doreen Straßburger
More informationApproaches for Predicting Collection Efficiency of Fibrous Filters
Volume 5, Issue, Summer006 Approaches for Preicting Collection Efficiency of Fibrous Filters Q. Wang, B. Maze, H. Vahei Tafreshi, an B. Poureyhimi Nonwovens Cooperative esearch Center, North Carolina State
More informationarxiv: v2 [math.st] 20 Jun 2014
A solution in small area estimation problems Andrius Čiginas and Tomas Rudys Vilnius University Institute of Mathematics and Informatics, LT-08663 Vilnius, Lithuania arxiv:1306.2814v2 [math.st] 20 Jun
More informationCopyright 2015 Quintiles
fficiency of Ranomize Concentration-Controlle Trials Relative to Ranomize Dose-Controlle Trials, an Application to Personalize Dosing Trials Russell Reeve, PhD Quintiles, Inc. Copyright 2015 Quintiles
More informationNew Statistical Test for Quality Control in High Dimension Data Set
International Journal of Applie Engineering Research ISSN 973-456 Volume, Number 6 (7) pp. 64-649 New Statistical Test for Quality Control in High Dimension Data Set Shamshuritawati Sharif, Suzilah Ismail
More informationCONTROL CHARTS FOR VARIABLES
UNIT CONTOL CHATS FO VAIABLES Structure.1 Introuction Objectives. Control Chart Technique.3 Control Charts for Variables.4 Control Chart for Mean(-Chart).5 ange Chart (-Chart).6 Stanar Deviation Chart
More informationβ ˆ j, and the SD path uses the local gradient
Proceeings of the 00 Winter Simulation Conference E. Yücesan, C.-H. Chen, J. L. Snowon, an J. M. Charnes, es. RESPONSE SURFACE METHODOLOGY REVISITED Ebru Angün Jack P.C. Kleijnen Department of Information
More informationAPPPHYS 217 Thursday 8 April 2010
APPPHYS 7 Thursay 8 April A&M example 6: The ouble integrator Consier the motion of a point particle in D with the applie force as a control input This is simply Newton s equation F ma with F u : t q q
More information