A Comparison between Biased and Unbiased Estimators in Ordinary Least Squares Regression
|
|
- Clifton Simpson
- 5 years ago
- Views:
Transcription
1 Journal of Modern Alied Statistical Methods Volume Issue Article A Comarison between Biased and Unbiased Estimators in Ordinary Least Squares Regression Ghadban Khalaf King Khalid University, Saudi Arabia Follow this and additional works at: htt://digitalcommons.wayne.edu/jmasm Part of the Alied Statistics Commons, Social and Behavioral Sciences Commons, and the Statistical Theory Commons Recommended Citation Khalaf, Ghadban (03) "A Comarison between Biased and Unbiased Estimators in Ordinary Least Squares Regression," Journal of Modern Alied Statistical Methods: Vol. : Iss., Article 7. DOI: 0.37/jmasm/ Available at: htt://digitalcommons.wayne.edu/jmasm/vol/iss/7 This Regular Article is brought to you for free and oen access by the Oen Access Journals at DigitalCommons@WayneState. It has been acceted for inclusion in Journal of Modern Alied Statistical Methods by an authorized editor of DigitalCommons@WayneState.
2 Journal of Modern Alied Statistical Methods November 03, Vol., No., Coyright 03 JMASM, Inc. ISSN A Comarison between Biased and Unbiased Estimators in Ordinary Least Squares Regression Ghadban Khalaf King Khalid University Saudi Arabia During the ast years, different kinds of estimators have been roosed as alternatives to the Ordinary Least Squares (OLS) estimator for the estimation of the regression coefficients in the resence of multicollinearity. In the general linear regression model, Y = Xβ + e, it is known that multicollinearity makes statistical inference difficult and may even seriously distort the inference. Ridge regression, as viewed here, defines a class of estimators of β indexed by a scalar arameter k. Two methods of secifying k are roosed and evaluated in terms of Mean Square Error (MSE) by simulation techniques. A comarison is made with other ridge-tye estimators evaluated elsewhere. The estimated MSE of the suggested estimators are lower than other estimators of the ridge arameter and the OLS estimator. Keywords: OLS estimator, linear regression, multicollinearity, ridge regression, Monte Carlo simulation. Introduction Consider the multile linear regression model Y = Xβ + e () where Y is an ( n ) resonse vector, X is a fixed ( n ) matrix of indeendent variables of rank, β is the unknown ( ) arameter vector of regression coefficients and, finally, e is an ( n ) vector of uncorrelated errors with mean zero and common unknown variance σ. If XX is nonsingular, the OLS estimator for β is given by Ghadban Khalaf is an Associate Professor in the Deartment of Mathematics. 93
3 A COMPARISON BETWEEN BIASED AND UNBIASED ESTIMATORS ˆ β = ( XX) X Y () For orthogonal data, the OLS estimator in the linear regression model is strongly efficient. But in the resence of multicollinearity, the OLS efficiency can be reduced and hence an imrovement uon it would be necessary and desirable. The term multicollinearity is used to denote the resence of linear relationshis, or near linear relationshis, among exlanatory variables. If the exlanatory variables are erfectly linearly correlated, that is, if the correlation coefficient for these variables is equal to unity, then the arameters become indeterminate; i.e, it is imossible to obtain numerical values for each arameter searately and the method of lease squares breaks down. Conversely, if the correlation coefficient for the exlanatory variables is equal to zero, then the variables are called orthogonal and there are no roblems concerning the estimates of the coefficients. When multicollinearity occurs, the least squares estimates are still unbiased and efficient but the roblem is that; the estimated standard error S ˆi β for the coefficient ˆi β become infinitely large; i.e, the standard error tends to be larger than it would be in the absence of multicollinearity and when S ˆi β is larger than it would be, then the t- value for testing the significance of βi is smaller than it should be. Thus one is likely to conclude that a variable X i is not imortant in the relationshi when it realy is. To solve the roblem of multicollinearity, there is no single solution that will eliminate multicollinearity altogether. One common rocedure is to select the indeendent variable most seriously involved in the multicollinearity and remove it from the model. This rocedure often imroves the standard error of the remaining coefficients and may make formerly insignificant variables significant, since the elimination of a variable reduces any multicollinearity caused by it. The difficulty with this aroach is that the model now may not correctly reresent the oulation relationshi and all estimated coefficients would contain a oulation secification. The rocedure of increasing the samle size is sometimes recommended as another suggested rocedure to solve the roblem of multicollinearity. In fact this method imroves the recision of an estimator and hence reduces the adverse effects of multicollinearity. Hoerl and Kennard (970) suggested a new technique to overcome the roblem of multicollinearity. This technique is called ridge regression. Ridge 94
4 GHADBAN KHALAF regression is a variant of ordinary multile linear regression whose goal is to circumvent the redictors collinearity. It gives u the least squares as a method for estimating the arameters of the model and focuses instead of the XX matrix. This matrix will be artificially modified so as to make its determinant areciably different from zero. This is accomlished by adding a small ositive quantity, say k (k > 0), to each of the diagonal elements of the matrix XX before inverting it for least squares estimation. The resulting estimator is given by ˆ( k ) ( X X ki ) β = + X Y, k > 0 (3) which coincides with the OLS estimator, defined by (), when k = 0. The resulting estimator will be biased, but have smaller variances than ˆβ. This is recisely what the ridge regression estimator we study can accomlish. The lan of this aer is as follows: Section resents the roosed estimators included in the study; a novel feature is our roosed ridge estimator which, as we shall see resently, has lower MSE. Section 3 is described the simulation technique that we have adoted in our study to evaluate the erformance of the new values of the ridge arameter we suggest. The results of the simulation study, which aear in the tables, are resented in Section 4. Finally, Section 5 contains summary and conclusions. The Proosed Estimators With the ridge estimator method, there arises the roblem of determining an otimal value of k. With a good choice of k, one might hoe to imrove on the OLS estimator for every coefficient. Hoerl, Kennard and Baldwin (975) showed, through simulation, that the use of ridge estimator with the following biasing arameter kˆ = ˆ σ i= imlies that MSE( ˆ β( k)) < MSE( ˆ β), where denotes the number of arameters (excluding the intercet) and ˆ σ is the usual unbiased estimate of σ, defined by; ˆ β i (4) 95
5 A COMPARISON BETWEEN BIASED AND UNBIASED ESTIMATORS n ˆ = ei / ( n ). i= σ They showed that the robability of a smaller MSE using (4) increases with the number of arameters. We will use the acronym HKB for the estimator (4). Khalaf and Shukur (005) suggested a modification of Hoerl and Kennard (970) given by; ˆ t ˆ σ k = ( n ) σ + t max ˆ ˆ maxβmax (5) which guaranteed lower MSE, where t max is the maximum eigenvalue of XX matrix. For this estimator we will use the acronym KS. From the estimators (4) and (5), we suggest as a modification of HKB and KS by multilying them by the amount; ( tmax + tmin ) tmax + tmin = ˆ β ˆ, βi i i= i= where t min is the minimum eigenvalue of the matrix XX. This leads to the following estimators; ( t + t ) ˆ σ ˆ max min =. k ˆ β i i= i= ( t + t ) t ˆ β ˆ σ i ˆ max min max =. ˆ ˆ ˆ βi (( n ) σ + tmaxβmax ) i= k (6) (7) For our two suggested estimators, defined by (6) and (7), we use the acronym K and K, resectively. 96
6 GHADBAN KHALAF The Simulation Study A simulation study was conducted in order to draw conclusions about the erformance of our suggested estimators relative to HKB, KS and the OLS estimator. To achieve different degree of collinearity, following Kibria (003), the exlanatory variables are generated by using the following equation; x z z i n j / ij = ( ρ ) ij + ρ i, =,,...,. =,,..., zij where are indeendent standard normal distribution, is the number of the exlanatory variables and ρ is secified so that the correlation between any two ρ exlanatory variables is given by. Three different sets of correlation are considered according to the value of ρ = 0.85, 0.95 and The n observations for the deendent variable are determined by the following equation; y = β0 + βx+ βx β x + e, i =,,..., n i i i i i where e i are i.i.d seudo-random numbers. In this study, β 0 is taken to be zero and the term e i is generated from each of the following distributions: N(0, ), T(3), T(7) and F(3, ). The arameters values are chosen so that βi =, i= which is a common restriction in simulation studies (see Muniz and Kibria (009)). The other factors we chose to vary is the samle size and the number of regressions. We generate models consisting of 5, 50, 00 and 50 observations and with and 4 exlanatory variables. It is noted from the results of the revious simulation studies (see Khalaf and Shukur (005), Alkhamisi and Shukur (008) and Khalaf (0)) that increasing the number of regressor and using non-normal seudo random numbers to generate e i leads to a higher estimated MSE, while increasing the samle size leads to a lower estimated MSE. The criterion roosed here for measuring the goodness of an estimator is the MSE using the following formula; ˆ MSE( β ) ( ˆ )( ˆ r = βr β βr β), 5000 (8) 97
7 A COMPARISON BETWEEN BIASED AND UNBIASED ESTIMATORS where ˆr β is the estimator of β obtained from the OLS estimator or from the ridge estimator for different estimated values of k considered for comarison reasons and, finally, 5000 is the number of relicates used in the Monte Carlo simulation. The Simulation Results Tables 6 below, resent the outut from the Monte Carlo exeriment concerning roerties of the different methods that used to choose the ridge arameter k. The results showed that the estimated MSE is affected by all factors we choose to vary in the design of exeriment. It is also noted that the higher the degree of correlation the higher estimated MSE, but this increase is much greater for the OLS than the ridge regression estimator. The distribution of the error term and the number of exlanatory variables having a different imact on the estimators. Table. Estimated MSE when ρ = 0.85 and =. OLS HKB KS K K N(0, ) T(3) T(7) F(3, )
8 GHADBAN KHALAF Table. Estimated MSE when ρ = 0.85 and = 4. OLS HKB KS K K N(0, ) T(3) T(7) F(3, ) Table 3. Estimated MSE when ρ = 0.95 and =. OLS HKB KS K K N(0, ) T(3) T(7) F(3, )
9 A COMPARISON BETWEEN BIASED AND UNBIASED ESTIMATORS Table 4. Estimated MSE when ρ = 0.95 and = 4. OLS HKB KS K K N(0, ) T(3) T(7) F(3, ) Table 5. Estimated MSE when ρ = 0.99 and =. OLS HKB KS K K N(0, ) T(3) T(7) F(3, )
10 GHADBAN KHALAF Table 6. Estimated MSE when ρ = 0.99 and = 4. OLS HKB KS K K N(0, ) T(3) T(7) F(3, ) For non-normal error term in combination with ρ = 0.95 and ρ = 0.99 leads to a larger estimated MSE for the OLS estimator and the ridge arameter, esecially when n is small, but when the samle size increases the estimated MSE of the suggested ridge arameters, namely K and K decreases substantially. The erformance of K and K is well for all cases when the error term is distributed as a normal and, when n is greater than 5 and the error term in nonnormal. When n is greater than 5, the modified ridge arameter erformance, defined by (6) and (7), is much better than the estimators HKB, KS and the OLS, where K has a low estimated MSE when the number of regressor equals 4. Summary and Conclusions In multile linear regression, the effect of non-orthogonality of the exlanatory variables is to ull the least squares estimates of the regression coefficients away from the true coefficients, β, that one is trying to estimate. The coefficients can 30
11 A COMPARISON BETWEEN BIASED AND UNBIASED ESTIMATORS be both too large in absolute value and incorrect with resect to sign. Furthermore, the variance and the covariance of the OLS tend to become too large. A slight movement away from this oint can give comletely different estimates of the coefficients. This is accomlished by adding a small ositive quantity, k, to each of the diagonal elements of the matrix XX. The resulting estimator is called the ridge estimator, suggested by Hoerl and Kennard (970) and given by (3). Several rocedure for constructing ridge estimators have been roosed in the literature. These rocedures were aiming at a rule (or algorithm) for selecting the constant k in equation (3). In fact, the best method of estimating k is an unsolved roblem and there is no constant value of k that is certain to yield an estimator which is uniformly better (in terms of MSE) than the OLS in all cases. By means of Monte Carlo simulations two suggested ridge arameters were evaluated and the result were comared with ridge arameters evaluated by Hoerl et. al (975) and Khalaf and Shukur (005). The estimator HKB erformed well in this study. It aears to outerform KS when ρ is small and the samle size is greater than 5. The suggested estimators K and K erforms well in our simulation. They aeared to offer an oortunity for large reduction in MSE when = and the error term in normally distributed. For non-normal error term the versions of the ridge arameter has a lower estimated MSE when the samle size is greater than 5. K is always minimizes the estimated MSE when the error term in normally distributed. References Alkhamisi, M., & Shukur, G. (008). Develoing Ridge Parameters for SUR Model. Communication in Statistics- Theory and Methods, 37, Hoerl, A. E., & Kennard, R. W. (970). Ridge Regression: Biased Estimation for non-orthogonal Problems. Technometrics, Vol., Hoerl, A. E., Kennard, R. W., & Baldwin, K. F. (975). Ridge Regression: some Simulation. Communications in Statistics- Theory and Methods, 4, Khalaf, G. (0). Suggested Ridge Regression Estimators Under Multicollinearity. Journal of Natural and Alied Sciences, University of Aden, Vol. 5,
12 GHADBAN KHALAF Khalaf, G., & Shukur, G. (005). Choosing Ridge Parameters for Regression Problems. Communication in Statistics Theory and Methods, 34, Kibria, B. M. G. (003). Performance of some New Ridge Regression Estimators. Communication in Statistics- Theory and Methods, 3, Muniz, G., & Kibria, B. M. G. (009). On some Ridge Regression Estimators: An Emirical Comarisons. Communications in Statistics-Simulation and Comutation, 38,
Multicollinearity and A Ridge Parameter Estimation Approach
Journal of Modern Applied Statistical Methods Volume 15 Issue Article 5 11-1-016 Multicollinearity and A Ridge Parameter Estimation Approach Ghadban Khalaf King Khalid University, albadran50@yahoo.com
More informationRidge Regression and Ill-Conditioning
Journal of Modern Applied Statistical Methods Volume 3 Issue Article 8-04 Ridge Regression and Ill-Conditioning Ghadban Khalaf King Khalid University, Saudi Arabia, albadran50@yahoo.com Mohamed Iguernane
More informationA New Asymmetric Interaction Ridge (AIR) Regression Method
A New Asymmetric Interaction Ridge (AIR) Regression Method by Kristofer Månsson, Ghazi Shukur, and Pär Sölander The Swedish Retail Institute, HUI Research, Stockholm, Sweden. Deartment of Economics and
More informationImproved Ridge Estimator in Linear Regression with Multicollinearity, Heteroscedastic Errors and Outliers
Journal of Modern Applied Statistical Methods Volume 15 Issue 2 Article 23 11-1-2016 Improved Ridge Estimator in Linear Regression with Multicollinearity, Heteroscedastic Errors and Outliers Ashok Vithoba
More informationAn Improved Generalized Estimation Procedure of Current Population Mean in Two-Occasion Successive Sampling
Journal of Modern Alied Statistical Methods Volume 15 Issue Article 14 11-1-016 An Imroved Generalized Estimation Procedure of Current Poulation Mean in Two-Occasion Successive Samling G. N. Singh Indian
More informationGeneral Linear Model Introduction, Classes of Linear models and Estimation
Stat 740 General Linear Model Introduction, Classes of Linear models and Estimation An aim of scientific enquiry: To describe or to discover relationshis among events (variables) in the controlled (laboratory)
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationTests for Two Proportions in a Stratified Design (Cochran/Mantel-Haenszel Test)
Chater 225 Tests for Two Proortions in a Stratified Design (Cochran/Mantel-Haenszel Test) Introduction In a stratified design, the subects are selected from two or more strata which are formed from imortant
More informationComparison of Some Improved Estimators for Linear Regression Model under Different Conditions
Florida International University FIU Digital Commons FIU Electronic Theses and Dissertations University Graduate School 3-24-2015 Comparison of Some Improved Estimators for Linear Regression Model under
More informationHotelling s Two- Sample T 2
Chater 600 Hotelling s Two- Samle T Introduction This module calculates ower for the Hotelling s two-grou, T-squared (T) test statistic. Hotelling s T is an extension of the univariate two-samle t-test
More informationBayesian Spatially Varying Coefficient Models in the Presence of Collinearity
Bayesian Satially Varying Coefficient Models in the Presence of Collinearity David C. Wheeler 1, Catherine A. Calder 1 he Ohio State University 1 Abstract he belief that relationshis between exlanatory
More informationRelationship between ridge regression estimator and sample size when multicollinearity present among regressors
Available online at www.worldscientificnews.com WSN 59 (016) 1-3 EISSN 39-19 elationship between ridge regression estimator and sample size when multicollinearity present among regressors ABSTACT M. C.
More informationStatistics II Logistic Regression. So far... Two-way repeated measures ANOVA: an example. RM-ANOVA example: the data after log transform
Statistics II Logistic Regression Çağrı Çöltekin Exam date & time: June 21, 10:00 13:00 (The same day/time lanned at the beginning of the semester) University of Groningen, Det of Information Science May
More informationCombining Logistic Regression with Kriging for Mapping the Risk of Occurrence of Unexploded Ordnance (UXO)
Combining Logistic Regression with Kriging for Maing the Risk of Occurrence of Unexloded Ordnance (UXO) H. Saito (), P. Goovaerts (), S. A. McKenna (2) Environmental and Water Resources Engineering, Deartment
More informationState Estimation with ARMarkov Models
Deartment of Mechanical and Aerosace Engineering Technical Reort No. 3046, October 1998. Princeton University, Princeton, NJ. State Estimation with ARMarkov Models Ryoung K. Lim 1 Columbia University,
More informationImproved Liu Estimators for the Poisson Regression Model
www.ccsenet.org/isp International Journal of Statistics and Probability Vol., No. ; May 202 Improved Liu Estimators for the Poisson Regression Model Kristofer Mansson B. M. Golam Kibria Corresponding author
More informationUsing the Divergence Information Criterion for the Determination of the Order of an Autoregressive Process
Using the Divergence Information Criterion for the Determination of the Order of an Autoregressive Process P. Mantalos a1, K. Mattheou b, A. Karagrigoriou b a.deartment of Statistics University of Lund
More information4. Score normalization technical details We now discuss the technical details of the score normalization method.
SMT SCORING SYSTEM This document describes the scoring system for the Stanford Math Tournament We begin by giving an overview of the changes to scoring and a non-technical descrition of the scoring rules
More informationSOME NEW PROPOSED RIDGE PARAMETERS FOR THE LOGISTIC REGRESSION MODEL
IMPACT: International Journal of Research in Applied, Natural and Social Sciences (IMPACT: IJRANSS) ISSN(E): 2321-8851; ISSN(P): 2347-4580 Vol. 3, Issue 1, Jan 2015, 67-82 Impact Journals SOME NEW PROPOSED
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analysis of Variance and Design of Exeriment-I MODULE II LECTURE -4 GENERAL LINEAR HPOTHESIS AND ANALSIS OF VARIANCE Dr. Shalabh Deartment of Mathematics and Statistics Indian Institute of Technology Kanur
More informationPerformance of lag length selection criteria in three different situations
MPRA Munich Personal RePEc Archive Performance of lag length selection criteria in three different situations Zahid Asghar and Irum Abid Quaid-i-Azam University, Islamabad Aril 2007 Online at htts://mra.ub.uni-muenchen.de/40042/
More informationUse of Transformations and the Repeated Statement in PROC GLM in SAS Ed Stanek
Use of Transformations and the Reeated Statement in PROC GLM in SAS Ed Stanek Introduction We describe how the Reeated Statement in PROC GLM in SAS transforms the data to rovide tests of hyotheses of interest.
More informationarxiv: v1 [physics.data-an] 26 Oct 2012
Constraints on Yield Parameters in Extended Maximum Likelihood Fits Till Moritz Karbach a, Maximilian Schlu b a TU Dortmund, Germany, moritz.karbach@cern.ch b TU Dortmund, Germany, maximilian.schlu@cern.ch
More informationNotes on Instrumental Variables Methods
Notes on Instrumental Variables Methods Michele Pellizzari IGIER-Bocconi, IZA and frdb 1 The Instrumental Variable Estimator Instrumental variable estimation is the classical solution to the roblem of
More informationOn split sample and randomized confidence intervals for binomial proportions
On slit samle and randomized confidence intervals for binomial roortions Måns Thulin Deartment of Mathematics, Usala University arxiv:1402.6536v1 [stat.me] 26 Feb 2014 Abstract Slit samle methods have
More informationHidden Predictors: A Factor Analysis Primer
Hidden Predictors: A Factor Analysis Primer Ryan C Sanchez Western Washington University Factor Analysis is a owerful statistical method in the modern research sychologist s toolbag When used roerly, factor
More informationShadow Computing: An Energy-Aware Fault Tolerant Computing Model
Shadow Comuting: An Energy-Aware Fault Tolerant Comuting Model Bryan Mills, Taieb Znati, Rami Melhem Deartment of Comuter Science University of Pittsburgh (bmills, znati, melhem)@cs.itt.edu Index Terms
More informationLOGISTIC REGRESSION. VINAYANAND KANDALA M.Sc. (Agricultural Statistics), Roll No I.A.S.R.I, Library Avenue, New Delhi
LOGISTIC REGRESSION VINAANAND KANDALA M.Sc. (Agricultural Statistics), Roll No. 444 I.A.S.R.I, Library Avenue, New Delhi- Chairerson: Dr. Ranjana Agarwal Abstract: Logistic regression is widely used when
More informationEstimating function analysis for a class of Tweedie regression models
Title Estimating function analysis for a class of Tweedie regression models Author Wagner Hugo Bonat Deartamento de Estatística - DEST, Laboratório de Estatística e Geoinformação - LEG, Universidade Federal
More informationChapter 10. Supplemental Text Material
Chater 1. Sulemental Tet Material S1-1. The Covariance Matri of the Regression Coefficients In Section 1-3 of the tetbook, we show that the least squares estimator of β in the linear regression model y=
More informationTowards understanding the Lorenz curve using the Uniform distribution. Chris J. Stephens. Newcastle City Council, Newcastle upon Tyne, UK
Towards understanding the Lorenz curve using the Uniform distribution Chris J. Stehens Newcastle City Council, Newcastle uon Tyne, UK (For the Gini-Lorenz Conference, University of Siena, Italy, May 2005)
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More informationCHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules
CHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules. Introduction: The is widely used in industry to monitor the number of fraction nonconforming units. A nonconforming unit is
More informationProbability Estimates for Multi-class Classification by Pairwise Coupling
Probability Estimates for Multi-class Classification by Pairwise Couling Ting-Fan Wu Chih-Jen Lin Deartment of Comuter Science National Taiwan University Taiei 06, Taiwan Ruby C. Weng Deartment of Statistics
More informationPublished: 14 October 2013
Electronic Journal of Alied Statistical Analysis EJASA, Electron. J. A. Stat. Anal. htt://siba-ese.unisalento.it/index.h/ejasa/index e-issn: 27-5948 DOI: 1.1285/i275948v6n213 Estimation of Parameters of
More informationDeriving Indicator Direct and Cross Variograms from a Normal Scores Variogram Model (bigaus-full) David F. Machuca Mory and Clayton V.
Deriving ndicator Direct and Cross Variograms from a Normal Scores Variogram Model (bigaus-full) David F. Machuca Mory and Clayton V. Deutsch Centre for Comutational Geostatistics Deartment of Civil &
More informationENHANCING THE EFFICIENCY OF THE RIDGE REGRESSION MODEL USING MONTE CARLO SIMULATIONS
www.arpapress.com/volumes/vol27issue1/ijrras_27_1_02.pdf ENHANCING THE EFFICIENCY OF THE RIDGE REGRESSION MODEL USING MONTE CARLO SIMULATIONS Rania Ahmed Hamed Mohamed Department of Statistics, Mathematics
More informationMATHEMATICAL MODELLING OF THE WIRELESS COMMUNICATION NETWORK
Comuter Modelling and ew Technologies, 5, Vol.9, o., 3-39 Transort and Telecommunication Institute, Lomonosov, LV-9, Riga, Latvia MATHEMATICAL MODELLIG OF THE WIRELESS COMMUICATIO ETWORK M. KOPEETSK Deartment
More informationSTABILITY ANALYSIS AND CONTROL OF STOCHASTIC DYNAMIC SYSTEMS USING POLYNOMIAL CHAOS. A Dissertation JAMES ROBERT FISHER
STABILITY ANALYSIS AND CONTROL OF STOCHASTIC DYNAMIC SYSTEMS USING POLYNOMIAL CHAOS A Dissertation by JAMES ROBERT FISHER Submitted to the Office of Graduate Studies of Texas A&M University in artial fulfillment
More informationChapter 13 Variable Selection and Model Building
Chater 3 Variable Selection and Model Building The comlete regsion analysis deends on the exlanatory variables ent in the model. It is understood in the regsion analysis that only correct and imortant
More informationAsymptotic theory for linear regression and IV estimation
Asymtotic theory for linear regression and IV estimation Jean-Marie Dufour McGill University First version: November 20 Revised: December 20 his version: December 20 Comiled: December 3, 20, : his work
More informationLower Confidence Bound for Process-Yield Index S pk with Autocorrelated Process Data
Quality Technology & Quantitative Management Vol. 1, No.,. 51-65, 15 QTQM IAQM 15 Lower onfidence Bound for Process-Yield Index with Autocorrelated Process Data Fu-Kwun Wang * and Yeneneh Tamirat Deartment
More informationYixi Shi. Jose Blanchet. IEOR Department Columbia University New York, NY 10027, USA. IEOR Department Columbia University New York, NY 10027, USA
Proceedings of the 2011 Winter Simulation Conference S. Jain, R. R. Creasey, J. Himmelsach, K. P. White, and M. Fu, eds. EFFICIENT RARE EVENT SIMULATION FOR HEAVY-TAILED SYSTEMS VIA CROSS ENTROPY Jose
More informationDeveloping A Deterioration Probabilistic Model for Rail Wear
International Journal of Traffic and Transortation Engineering 2012, 1(2): 13-18 DOI: 10.5923/j.ijtte.20120102.02 Develoing A Deterioration Probabilistic Model for Rail Wear Jabbar-Ali Zakeri *, Shahrbanoo
More informationUncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning
TNN-2009-P-1186.R2 1 Uncorrelated Multilinear Princial Comonent Analysis for Unsuervised Multilinear Subsace Learning Haiing Lu, K. N. Plataniotis and A. N. Venetsanooulos The Edward S. Rogers Sr. Deartment
More informationAn Analysis of Reliable Classifiers through ROC Isometrics
An Analysis of Reliable Classifiers through ROC Isometrics Stijn Vanderlooy s.vanderlooy@cs.unimaas.nl Ida G. Srinkhuizen-Kuyer kuyer@cs.unimaas.nl Evgueni N. Smirnov smirnov@cs.unimaas.nl MICC-IKAT, Universiteit
More informationUnsupervised Hyperspectral Image Analysis Using Independent Component Analysis (ICA)
Unsuervised Hyersectral Image Analysis Using Indeendent Comonent Analysis (ICA) Shao-Shan Chiang Chein-I Chang Irving W. Ginsberg Remote Sensing Signal and Image Processing Laboratory Deartment of Comuter
More informationAI*IA 2003 Fusion of Multiple Pattern Classifiers PART III
AI*IA 23 Fusion of Multile Pattern Classifiers PART III AI*IA 23 Tutorial on Fusion of Multile Pattern Classifiers by F. Roli 49 Methods for fusing multile classifiers Methods for fusing multile classifiers
More informationA Model for Randomly Correlated Deposition
A Model for Randomly Correlated Deosition B. Karadjov and A. Proykova Faculty of Physics, University of Sofia, 5 J. Bourchier Blvd. Sofia-116, Bulgaria ana@hys.uni-sofia.bg Abstract: A simle, discrete,
More informationAdaptive estimation with change detection for streaming data
Adative estimation with change detection for streaming data A thesis resented for the degree of Doctor of Philosohy of the University of London and the Diloma of Imerial College by Dean Adam Bodenham Deartment
More informationAmerican Society for Quality
American Society for Quality Ridge Regression: Biased Estimation for Nonorthogonal Problems Author(s): Arthur E. Hoerl and Robert W. Kennard Source: Technometrics, Vol. 42, No. 1, Secial 40th Anniversary
More informationInformation collection on a graph
Information collection on a grah Ilya O. Ryzhov Warren Powell February 10, 2010 Abstract We derive a knowledge gradient olicy for an otimal learning roblem on a grah, in which we use sequential measurements
More informationDETC2003/DAC AN EFFICIENT ALGORITHM FOR CONSTRUCTING OPTIMAL DESIGN OF COMPUTER EXPERIMENTS
Proceedings of DETC 03 ASME 003 Design Engineering Technical Conferences and Comuters and Information in Engineering Conference Chicago, Illinois USA, Setember -6, 003 DETC003/DAC-48760 AN EFFICIENT ALGORITHM
More informationSystem Reliability Estimation and Confidence Regions from Subsystem and Full System Tests
009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 0-, 009 FrB4. System Reliability Estimation and Confidence Regions from Subsystem and Full System Tests James C. Sall Abstract
More informationSolved Problems. (a) (b) (c) Figure P4.1 Simple Classification Problems First we draw a line between each set of dark and light data points.
Solved Problems Solved Problems P Solve the three simle classification roblems shown in Figure P by drawing a decision boundary Find weight and bias values that result in single-neuron ercetrons with the
More informationMinimax Design of Nonnegative Finite Impulse Response Filters
Minimax Design of Nonnegative Finite Imulse Resonse Filters Xiaoing Lai, Anke Xue Institute of Information and Control Hangzhou Dianzi University Hangzhou, 3118 China e-mail: laix@hdu.edu.cn; akxue@hdu.edu.cn
More informationOn Wrapping of Exponentiated Inverted Weibull Distribution
IJIRST International Journal for Innovative Research in Science & Technology Volume 3 Issue 11 Aril 217 ISSN (online): 2349-61 On Wraing of Exonentiated Inverted Weibull Distribution P.Srinivasa Subrahmanyam
More informationModeling and Estimation of Full-Chip Leakage Current Considering Within-Die Correlation
6.3 Modeling and Estimation of Full-Chi Leaage Current Considering Within-Die Correlation Khaled R. eloue, Navid Azizi, Farid N. Najm Deartment of ECE, University of Toronto,Toronto, Ontario, Canada {haled,nazizi,najm}@eecg.utoronto.ca
More informationCOMPARISON OF VARIOUS OPTIMIZATION TECHNIQUES FOR DESIGN FIR DIGITAL FILTERS
NCCI 1 -National Conference on Comutational Instrumentation CSIO Chandigarh, INDIA, 19- March 1 COMPARISON OF VARIOUS OPIMIZAION ECHNIQUES FOR DESIGN FIR DIGIAL FILERS Amanjeet Panghal 1, Nitin Mittal,Devender
More informationResearch of PMU Optimal Placement in Power Systems
Proceedings of the 5th WSEAS/IASME Int. Conf. on SYSTEMS THEORY and SCIENTIFIC COMPUTATION, Malta, Setember 15-17, 2005 (38-43) Research of PMU Otimal Placement in Power Systems TIAN-TIAN CAI, QIAN AI
More informationThe power performance of fixed-t panel unit root tests allowing for structural breaks in their deterministic components
ATHES UIVERSITY OF ECOOMICS AD BUSIESS DEPARTMET OF ECOOMICS WORKIG PAPER SERIES 23-203 The ower erformance of fixed-t anel unit root tests allowing for structural breaks in their deterministic comonents
More informationNew Schedulability Test Conditions for Non-preemptive Scheduling on Multiprocessor Platforms
New Schedulability Test Conditions for Non-reemtive Scheduling on Multirocessor Platforms Technical Reort May 2008 Nan Guan 1, Wang Yi 2, Zonghua Gu 3 and Ge Yu 1 1 Northeastern University, Shenyang, China
More informationCovariance Matrix Estimation for Reinforcement Learning
Covariance Matrix Estimation for Reinforcement Learning Tomer Lancewicki Deartment of Electrical Engineering and Comuter Science University of Tennessee Knoxville, TN 37996 tlancewi@utk.edu Itamar Arel
More informationNumerical Linear Algebra
Numerical Linear Algebra Numerous alications in statistics, articularly in the fitting of linear models. Notation and conventions: Elements of a matrix A are denoted by a ij, where i indexes the rows and
More informationA Qualitative Event-based Approach to Multiple Fault Diagnosis in Continuous Systems using Structural Model Decomposition
A Qualitative Event-based Aroach to Multile Fault Diagnosis in Continuous Systems using Structural Model Decomosition Matthew J. Daigle a,,, Anibal Bregon b,, Xenofon Koutsoukos c, Gautam Biswas c, Belarmino
More informationNumerical and experimental investigation on shot-peening induced deformation. Application to sheet metal forming.
Coyright JCPDS-International Centre for Diffraction Data 29 ISSN 197-2 511 Numerical and exerimental investigation on shot-eening induced deformation. Alication to sheet metal forming. Florent Cochennec
More informationInformation collection on a graph
Information collection on a grah Ilya O. Ryzhov Warren Powell October 25, 2009 Abstract We derive a knowledge gradient olicy for an otimal learning roblem on a grah, in which we use sequential measurements
More informationChapter 3. GMM: Selected Topics
Chater 3. GMM: Selected oics Contents Otimal Instruments. he issue of interest..............................2 Otimal Instruments under the i:i:d: assumtion..............2. he basic result............................2.2
More informationSpectral Analysis by Stationary Time Series Modeling
Chater 6 Sectral Analysis by Stationary Time Series Modeling Choosing a arametric model among all the existing models is by itself a difficult roblem. Generally, this is a riori information about the signal
More informationMULTIVARIATE STATISTICAL PROCESS OF HOTELLING S T CONTROL CHARTS PROCEDURES WITH INDUSTRIAL APPLICATION
Journal of Statistics: Advances in heory and Alications Volume 8, Number, 07, Pages -44 Available at htt://scientificadvances.co.in DOI: htt://dx.doi.org/0.864/jsata_700868 MULIVARIAE SAISICAL PROCESS
More informationRoad Traffic Accidents in Saudi Arabia: An ARDL Approach and Multivariate Granger Causality
MPRA Munich Personal RePEc Archive Road Traffic Accidents in Saudi Arabia: An ARDL Aroach and Multivariate Granger Causality Mohammed Moosa Ageli King Saud University, RCC, Riyadh, Saudi Arabia 24. Aril
More informationsubstantial literature on emirical likelihood indicating that it is widely viewed as a desirable and natural aroach to statistical inference in a vari
Condence tubes for multile quantile lots via emirical likelihood John H.J. Einmahl Eindhoven University of Technology Ian W. McKeague Florida State University May 7, 998 Abstract The nonarametric emirical
More informationOn parameter estimation in deformable models
Downloaded from orbitdtudk on: Dec 7, 07 On arameter estimation in deformable models Fisker, Rune; Carstensen, Jens Michael Published in: Proceedings of the 4th International Conference on Pattern Recognition
More informationAN OPTIMAL CONTROL CHART FOR NON-NORMAL PROCESSES
AN OPTIMAL CONTROL CHART FOR NON-NORMAL PROCESSES Emmanuel Duclos, Maurice Pillet To cite this version: Emmanuel Duclos, Maurice Pillet. AN OPTIMAL CONTROL CHART FOR NON-NORMAL PRO- CESSES. st IFAC Worsho
More informationImproved Capacity Bounds for the Binary Energy Harvesting Channel
Imroved Caacity Bounds for the Binary Energy Harvesting Channel Kaya Tutuncuoglu 1, Omur Ozel 2, Aylin Yener 1, and Sennur Ulukus 2 1 Deartment of Electrical Engineering, The Pennsylvania State University,
More informationGuaranteed In-Control Performance for the Shewhart X and X Control Charts
Guaranteed In-Control Performance for the Shewhart X and X Control Charts ROB GOEDHART, MARIT SCHOONHOVEN, and RONALD J. M. M. DOES University of Amsterdam, Plantage Muidergracht, 08 TV Amsterdam, The
More informationAn Investigation on the Numerical Ill-conditioning of Hybrid State Estimators
An Investigation on the Numerical Ill-conditioning of Hybrid State Estimators S. K. Mallik, Student Member, IEEE, S. Chakrabarti, Senior Member, IEEE, S. N. Singh, Senior Member, IEEE Deartment of Electrical
More informationThe Nottingham eprints service makes this work by researchers of the University of Nottingham available open access under the following conditions.
Harvey, David I. and Leybourne, Stehen J. and Taylor, A.M. Robert (04) On infimum Dickey Fuller unit root tests allowing for a trend break under the null. Comutational Statistics & Data Analysis, 78..
More informationFinite Mixture EFA in Mplus
Finite Mixture EFA in Mlus November 16, 2007 In this document we describe the Mixture EFA model estimated in Mlus. Four tyes of deendent variables are ossible in this model: normally distributed, ordered
More informationMorten Frydenberg Section for Biostatistics Version :Friday, 05 September 2014
Morten Frydenberg Section for Biostatistics Version :Friday, 05 Setember 204 All models are aroximations! The best model does not exist! Comlicated models needs a lot of data. lower your ambitions or get
More informationRatio Estimators in Simple Random Sampling Using Information on Auxiliary Attribute
ajesh Singh, ankaj Chauhan, Nirmala Sawan School of Statistics, DAVV, Indore (M.., India Florentin Smarandache Universit of New Mexico, USA atio Estimators in Simle andom Samling Using Information on Auxiliar
More informationMODULAR LINEAR TRANSVERSE FLUX RELUCTANCE MOTORS
MODULAR LINEAR TRANSVERSE FLUX RELUCTANCE MOTORS Dan-Cristian POPA, Vasile IANCU, Loránd SZABÓ, Deartment of Electrical Machines, Technical University of Cluj-Naoca RO-400020 Cluj-Naoca, Romania; e-mail:
More informationOne-way ANOVA Inference for one-way ANOVA
One-way ANOVA Inference for one-way ANOVA IPS Chater 12.1 2009 W.H. Freeman and Comany Objectives (IPS Chater 12.1) Inference for one-way ANOVA Comaring means The two-samle t statistic An overview of ANOVA
More informationHigh-dimensional Ordinary Least-squares Projection for Screening Variables
High-dimensional Ordinary Least-squares Projection for Screening Variables Xiangyu Wang and Chenlei Leng arxiv:1506.01782v1 [stat.me] 5 Jun 2015 Abstract Variable selection is a challenging issue in statistical
More informationEvaluating Process Capability Indices for some Quality Characteristics of a Manufacturing Process
Journal of Statistical and Econometric Methods, vol., no.3, 013, 105-114 ISSN: 051-5057 (rint version), 051-5065(online) Scienress Ltd, 013 Evaluating Process aability Indices for some Quality haracteristics
More informationDEPARTMENT OF ECONOMICS ISSN DISCUSSION PAPER 20/07 TWO NEW EXPONENTIAL FAMILIES OF LORENZ CURVES
DEPARTMENT OF ECONOMICS ISSN 1441-549 DISCUSSION PAPER /7 TWO NEW EXPONENTIAL FAMILIES OF LORENZ CURVES ZuXiang Wang * & Russell Smyth ABSTRACT We resent two new Lorenz curve families by using the basic
More informationarxiv:cond-mat/ v2 25 Sep 2002
Energy fluctuations at the multicritical oint in two-dimensional sin glasses arxiv:cond-mat/0207694 v2 25 Se 2002 1. Introduction Hidetoshi Nishimori, Cyril Falvo and Yukiyasu Ozeki Deartment of Physics,
More informationJournal of Chemical and Pharmaceutical Research, 2014, 6(5): Research Article
Available online www.jocr.com Journal of Chemical and Pharmaceutical Research, 204, 6(5):580-585 Research Article ISSN : 0975-7384 CODEN(USA) : JCPRC5 Exort facilitation and comarative advantages of the
More informationEstimating Time-Series Models
Estimating ime-series Models he Box-Jenkins methodology for tting a model to a scalar time series fx t g consists of ve stes:. Decide on the order of di erencing d that is needed to roduce a stationary
More informationLower bound solutions for bearing capacity of jointed rock
Comuters and Geotechnics 31 (2004) 23 36 www.elsevier.com/locate/comgeo Lower bound solutions for bearing caacity of jointed rock D.J. Sutcliffe a, H.S. Yu b, *, S.W. Sloan c a Deartment of Civil, Surveying
More informationarxiv: v2 [stat.me] 3 Nov 2014
onarametric Stein-tye Shrinkage Covariance Matrix Estimators in High-Dimensional Settings Anestis Touloumis Cancer Research UK Cambridge Institute University of Cambridge Cambridge CB2 0RE, U.K. Anestis.Touloumis@cruk.cam.ac.uk
More informationAn Outdoor Recreation Use Model with Applications to Evaluating Survey Estimators
United States Deartment of Agriculture Forest Service Southern Research Station An Outdoor Recreation Use Model with Alications to Evaluating Survey Estimators Stanley J. Zarnoch, Donald B.K. English,
More informationScaling Multiple Point Statistics for Non-Stationary Geostatistical Modeling
Scaling Multile Point Statistics or Non-Stationary Geostatistical Modeling Julián M. Ortiz, Steven Lyster and Clayton V. Deutsch Centre or Comutational Geostatistics Deartment o Civil & Environmental Engineering
More informationUniversal Finite Memory Coding of Binary Sequences
Deartment of Electrical Engineering Systems Universal Finite Memory Coding of Binary Sequences Thesis submitted towards the degree of Master of Science in Electrical and Electronic Engineering in Tel-Aviv
More informationVarious Proofs for the Decrease Monotonicity of the Schatten s Power Norm, Various Families of R n Norms and Some Open Problems
Int. J. Oen Problems Comt. Math., Vol. 3, No. 2, June 2010 ISSN 1998-6262; Coyright c ICSRS Publication, 2010 www.i-csrs.org Various Proofs for the Decrease Monotonicity of the Schatten s Power Norm, Various
More informationThe Noise Power Ratio - Theory and ADC Testing
The Noise Power Ratio - Theory and ADC Testing FH Irons, KJ Riley, and DM Hummels Abstract This aer develos theory behind the noise ower ratio (NPR) testing of ADCs. A mid-riser formulation is used for
More informationVIBRATION ANALYSIS OF BEAMS WITH MULTIPLE CONSTRAINED LAYER DAMPING PATCHES
Journal of Sound and Vibration (998) 22(5), 78 85 VIBRATION ANALYSIS OF BEAMS WITH MULTIPLE CONSTRAINED LAYER DAMPING PATCHES Acoustics and Dynamics Laboratory, Deartment of Mechanical Engineering, The
More informationJ. Electrical Systems 13-2 (2017): Regular paper
Menxi Xie,*, CanYan Zhu, BingWei Shi 2, Yong Yang 2 J. Electrical Systems 3-2 (207): 332-347 Regular aer Power Based Phase-Locked Loo Under Adverse Conditions with Moving Average Filter for Single-Phase
More informationRobustness of multiple comparisons against variance heterogeneity Dijkstra, J.B.
Robustness of multile comarisons against variance heterogeneity Dijkstra, J.B. Published: 01/01/1983 Document Version Publisher s PDF, also known as Version of Record (includes final age, issue and volume
More informationJohan Lyhagen Department of Information Science, Uppsala University. Abstract
Why not use standard anel unit root test for testing PPP Johan Lyhagen Deartment of Information Science, Usala University Abstract In this aer we show the consequences of alying a anel unit root test that
More information