A Network Intrusion Detection Method Based on Improved K-means Algorithm
|
|
- Margery Francis
- 6 years ago
- Views:
Transcription
1 Advanced Scence and Technology Letters, pp A Network Intruson Detecton Method Based on Improved K-means Algorthm Meng Gao 1,1, Nhong Wang 1, 1 Informaton and Computer Engneerng College, Northeast Forestry Unversty, Harbn, Chna gaomeng0916@126.com,wnh@mal.nefu.edu.cn Abstract. K-means algorthm could be used n ntruson detecton, and selecton of ntal cluster centers was one of the most mportant factor that nfluenced the clusterng performance, tradtonal method had a certan degree of randomness n dealng wth ths problem, therefore, nformaton entropy was ntroduced nto the process of cluster centers selecton, and a fuson algorthm combnng wth nformaton entropy and K-means algorthm was proposed, nformaton entropy value was used to measure the smlarty degree among records, t could help to choose a least smlar record to be a cluster center. Comparson results show that the detecton rato and false alarm rato of the proposed method s better than tradtonal K-means algorthm. Keywords: K-means; Informaton entropy; Intruson detecton 1 Introducton Network ntruson detecton s a process whch ncludes seres of actons, such as collectng data related to network status and behavors from key nodes, analyzng these data, dscoverng abnormal behavor as well as provdng early warnng [1-2], t can acheve the purpose of montorng network behavor and defendng network ntruson. As ntruson behavors tend to have uncertanly n some degree, so, t s of great sgnfcance to dentfy unknown behavors by extractng hdden nformaton n ntruson data [3-4]. L Wenhua proposed a FCM cluster network ntruson detecton model based on fuzzy c-means [5]; Zhang Guosuo proposed an mproved FCM cluster algorthm, t could solve the boundedness n dealng wth bg dataset by usng tradtonal FCM [6]; Reda M. Elbasony used random forests and weghed k-means algorthm to buld ntruson patterns and choose anomalous clusters [7]; Luo Mn researched on the non-supervsed ntruson detecton model based on K-means algorthm [8]; L Helng proposed the mproved K-means algorthm and carred out experments amng at the problem of uneven data dstrbuton [9]; Researches above focused on solvng the problem of data sze that the algorthm can deal wth, they 1 Meng Gao, female (1989- ), Ph.D., manly engaged n forestry nformatzaton and system securty, E-mal: gaomeng0916@126.com. ISSN: ASTL Copyrght 2014 SERSC
2 Advanced Scence and Technology Letters gnored the kernel of algorthm tself. Ths paper uses K-means algorthm to detect ntruson behavors, as selecton of ntal cluster centers s the key factor that nfluences the cluster results, the nformaton entropy technology s ntroduced to auxlary determne cluster centers, experments show that the mproved fuson algorthm has a good detecton rato and false alarm rato. 2 Algorthm Combng wth Informaton Entropy and K-means 2.1 K-means Algorthm Ths paper uses Eucldean dstance to measure the smlarty among records, and use formula (1) to evaluate the clusterng results. E k x d 2 x. x d 1 d x (1) where E s the sum of all objects mean squared error; d s a data cluster ; x s a data object; d s the number of objects n d ; k s the number of clusters; the smaller value of E, the better of the clusterng effect. Data clusterng process usng K-means algorthm can be descrbed as follows: (1) Defne the number k of clusters to be fnally generated; (2) Choose k records to be the ntal cluster centers; (3) Dvde the orgnal data nto the k clusters, and recalculate the center of each cluster; (4) Break the clusterng result n last stage, put object j nto the correspondng cluster accordng to the prncple of mnmum Eucldean dstance, then, form the new clusters, and calculate the value of E at the same tme; (5) Repeat stage (4) untl the new clusters are same as the prevous clusters. We can know that performance of the algorthm s manly determned by stage (1) and (2), cluster number k s often determned accordng to actual stuatons [10-11], therefore, selecton of ntal cluster centers s the key factor that nfluences the algorthm performance. 2.2 Informaton Entropy Informaton entropy s used to measure the uncertanty of a random varable nformaton, the bgger of t, the more dsordered of the data; otherwse, the more ordered and smlar of the data [11-12]. If usng nformaton entropy to evaluate clusterng effect, then the smaller of the entropy, the more smlar of data n a same cluster and better of the clusterng effect [13-14]. 430 Copyrght 2014 SERSC
3 Advanced Scence and Technology Letters Informaton entropy of a random varable X can be descrbed as:. (2) E ( X ) lo g ( p ( x )) x s ( x ) n Where S ( X ) s the possble value set of X ; p( X ) s the probablty functon of X. 2.3 Improved K-means algorthm based on nformaton entropy Assume that sample space M ncludes n records, frst, calculate the nformaton entropy value of each record, and then start from the frst record, compare the value of current record wth other records, fnally, regard the mnmum value as the nformaton entropy baselne of the current record, the comparson matrx s shown as Table 1. Table 1. Comparson matrx of nformaton entropy value j n Baselne 1 E(M 1,M 1) E(M 1,M 2) E(M 1,M 3) E(M 1,M n) mn E(M 1,M j) 2 E(M 2,M 1) E(M 2,M 2) E(M 2,M 3) E(M 2,M n) mne(m 2,M j) 3 E(M 3,M 1) E(M 3,M 2) E(M 3,M 3) E(M 3,M n) mne(m 3,M j) N E(M n,m 1) E(M n,m 2) E(M n,m 3) E(M n,m n) mne(m n,m j) Calculate the nformaton entropy baselne set ( ) { m n (, ), m n (, ),..., m n (, )},1, and order the B ase M E M M E M M E M M j n 1 2 j j n j baselne from bg to small, get the ordered baselne set SortB ase( M ), the bgger of the nformaton entropy value, the less smlar between the correspondng record and other records, and the more sutable to be center of the ntal cluster. Combne wth the cluster number k determned n stage (1) of K-means algorthm, choose the topk records correspondng wth the nformaton entropy values n SortB ase( M ) as the least smlar records, and these records can be regarded as the ntal cluster centers. 2.4 Network Intruson Detecton Algorthm Based on IE-K-means The process of detectng network ntruson usng IE-K-means algorthm can be descrbed as: (1) Defne the number k of clusters to be fnally generated, and set the nstance threshold n s tan cel n e of clusters; (2) Choose k records as the ntal cluster center C ( k ) usng IE-K-means algorthm, calculate the Eucldean dstance d (, j) between C and other records; 431 Copyrght 2014 SERSC
4 Advanced Scence and Technology Letters (4) Accordng to the mnmum d (, j), dvde each record nto clusters wth the mnmum Eucldean dstance, and generate new clusters, recalculate C of the new clusters, and record the nstance number In s tan ce of each cluster. (6) Break the clusterng result n last stage, and repeat stage (3)-(5) untl the current clusters are the same as the prevous clusters. (7) Record C and In s ta n c e of the each generated cluster; (8) If In s tan ce n s tan cel n e, mark C as the center of abnormal cluster C ; a b n o rm a l f In s tan ce n s tan cel n e, mark C as the center of normal cluster n o r m a l C ; (9) When new connecton s comng, calculate the Eucldean dstance d (C, C ) n e w between new connecton and each C, f d (C, C ) s closer wth C n ew a b n o rm a l, mark the new connecton as the abnormal ntruson; If d (C, C ) s closer wth C n e w n o r m a l, mark the new connecton as the normal ntruson. 3 Smulaton Experment and Analyss Use KDDCUP99 data packets to verfy the feasblty and effectveness of IE-Kmeans algorthm, choose 7200 DoS attack data, of whch 5500 records are used as tranng data for tranng model, and the other 1700 records are used as testng data for testng the effectveness of the ntruson detecton model. The experment adopts dfferent cluster number k, cluster the tranng data at frst to get the cluster center set, and then send the testng data nto the anomaly detecton system for ntruson detecton, calculate the D etectr a te and F a lsed etectr a te of each data set at the same tme, experment results are shown n Table 2. It can be seen that the network ntruson detecton model based on IE-K-means s feasble, and the mproved algorthm s better than tradtonal K-means algorthm n detecton rato and false alarm rato based on dfferent cluster amount. Table 2. Comparson experment results k K-means algorthm IE-K-means algorthm DetectRate/% FalseDetectRate/% DetectRate/% FalseDetectRate/% Conclusons Accordng to the characterstcs of network ntruson data, amng at the problems exsted n the current ntruson detecton researches, ths paper proposes up a network ntruson detecton method based on the fuson algorthm combnng wth nformaton entropy and K-means, experment results show that the fuson algorthm has mproved the detecton rato and reduced the false alarm rato compared wth 432 Copyrght 2014 SERSC
5 Advanced Scence and Technology Letters tradtonal K-means algorthm. However, the mplementaton of the fuson algorthm dd not consder the algorthm executon effcency, whch requres the further study. Acknowledgments. Ths work s supported by Specal Fund for Scentfc Research n the Publc Interest ( ) and The Fundamental Research Funds for the Central Unverstes ( AB22). References 1. Jonathan, J.D., Andrew, J.C.: Data Processng for anomaly based network ntruson detecton: A revew. Computers & Securty. 30, (2013) 2. Lao, S.H., Chu, P.H., Hsao, P.Y.: Data mnng technques and applcatons A decade revew from 2000 to Expert Systems wth Applcatons. 39, (2012) 3. Mohammand, S.A., Hamd, M., Jafar, H.: Desgn and analyss of genetc fuzzy systems for ntruson detecton n computer networks. Expert Systems wth Applcatons. 38, (2011) 4. Chen, X.H.: Intruson Detecton Method Baed on Data Mnng Algorthm. Computer Engneerng. 36, (2010) 5. L, W.H.: Network Intruson Detecton Model Based on Clusterng Analyss. Computer Engneerng. 37, (2011) 6. Zhang, G.S., Zhou, C.M., Le, Y.J.: Improved fuzzy C-means clusterng algorthm and ts applcaton to ntruson detecton. Journal of Computer Applcatons. 29, (2009) 7. Reda, M.E., Elsayed, A.S., Tarek, E.E., Mahmoud, M.F.: A hybrd network ntruson detecton framework based on random forests and weghed k-means. An Shames Engneerng Journal. 4, (2013) 8. Luo, M., Wang, L.N., Zhang, H.G.: An Unsupervsed Clusterng-Based Intruson Detecton Method. ACTA ELECTRONICA SINICA. 31, (2003) 9. L, H.L.: Study on Applcaton of data mnng n network ntruson detecton. JLn Unversty, JLn (2013) 10. L, Y.: Applcaton of K-means Clusterng Algorthm n Intruson Detecton. Computer Engneerng. 33, (2007) 11. Du, Q., Sun, M.: Intruson detecton system based on mproved clusterng algorthm. Computer Engneerng and Applcatns. 47, (2011) 12. Ye, Z.W.: The Research of Intruson Detecton Algorthms Based on the Clusterng of Informaton Entropy. Proceda Envronmental Scences. 12, (2012) 13. Feng, J., Su, Y.F., Cao, C.G.: An Informaton entropy-based approach to outler detecton n rough sets. Expert Systems wth Applcatons. 37, (2010) 14. Jn, C.X., L, F.C., L, Y.: A generalzed fuzzy ID3 algorthm usng generalzed nformaton entropy. Knowledge-Based Systems. 64, (2014) 433 Copyrght 2014 SERSC
The Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationAn Improved multiple fractal algorithm
Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton
More informationUsing Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*
Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton
More informationA New Evolutionary Computation Based Approach for Learning Bayesian Network
Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang
More informationPop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing
Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,
More informationA New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane
A New Scramblng Evaluaton Scheme based on Spatal Dstrbuton Entropy and Centrod Dfference of Bt-plane Lang Zhao *, Avshek Adhkar Kouch Sakura * * Graduate School of Informaton Scence and Electrcal Engneerng,
More informationA Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function
Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,
More informationA Fast Computer Aided Design Method for Filters
2017 Asa-Pacfc Engneerng and Technology Conference (APETC 2017) ISBN: 978-1-60595-443-1 A Fast Computer Aded Desgn Method for Flters Gang L ABSTRACT *Ths paper presents a fast computer aded desgn method
More informationModeling of Risk Treatment Measurement Model under Four Clusters Standards (ISO 9001, 14001, 27001, OHSAS 18001)
Avalable onlne at www.scencedrect.com Proceda Engneerng 37 (202 ) 354 358 The Second SREE Conference on Engneerng Modelng and Smulaton Modelng of Rsk Treatment Measurement Model under Four Clusters Standards
More informationCollaborative Filtering Recommendation Algorithm
Vol.141 (GST 2016), pp.199-203 http://dx.do.org/10.14257/astl.2016.141.43 Collaboratve Flterng Recoendaton Algorth Dong Lang Qongta Teachers College, Haou 570100, Chna, 18689851015@163.co Abstract. Ths
More informationPower law and dimension of the maximum value for belief distribution with the max Deng entropy
Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng
More informationMDL-Based Unsupervised Attribute Ranking
MDL-Based Unsupervsed Attrbute Rankng Zdravko Markov Computer Scence Department Central Connectcut State Unversty New Brtan, CT 06050, USA http://www.cs.ccsu.edu/~markov/ markovz@ccsu.edu MDL-Based Unsupervsed
More informationConstructing Control Process for Wafer Defects Using Data Mining Technique
The Fourth nternatonal Conference on Electronc Busness (CEB004) / Bejng 5 Constructng Control ocess for Wafer Defects Usng Data Mnng Technque Leeng Tong Hsngyn Lee Chfeng Huang Changke Ln Chenhu Yang Department
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationMulti-Robot Formation Control Based on Leader-Follower Optimized by the IGA
IOSR Journal of Computer Engneerng (IOSR-JCE e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 19, Issue 1, Ver. III (Jan.-Feb. 2017, PP 08-13 www.osrjournals.org Mult-Robot Formaton Control Based on Leader-Follower
More informationInternational Journal of Mathematical Archive-3(3), 2012, Page: Available online through ISSN
Internatonal Journal of Mathematcal Archve-3(3), 2012, Page: 1136-1140 Avalable onlne through www.ma.nfo ISSN 2229 5046 ARITHMETIC OPERATIONS OF FOCAL ELEMENTS AND THEIR CORRESPONDING BASIC PROBABILITY
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationCalculation of time complexity (3%)
Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add
More informationChapter 2 A Class of Robust Solution for Linear Bilevel Programming
Chapter 2 A Class of Robust Soluton for Lnear Blevel Programmng Bo Lu, Bo L and Yan L Abstract Under the way of the centralzed decson-makng, the lnear b-level programmng (BLP) whose coeffcents are supposed
More informationOutline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]
DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm
More informationRBF Neural Network Model Training by Unscented Kalman Filter and Its Application in Mechanical Fault Diagnosis
Appled Mechancs and Materals Submtted: 24-6-2 ISSN: 662-7482, Vols. 62-65, pp 2383-2386 Accepted: 24-6- do:.428/www.scentfc.net/amm.62-65.2383 Onlne: 24-8- 24 rans ech Publcatons, Swtzerland RBF Neural
More informationComparative Studies of Law of Conservation of Energy. and Law Clusters of Conservation of Generalized Energy
Comparatve Studes of Law of Conservaton of Energy and Law Clusters of Conservaton of Generalzed Energy No.3 of Comparatve Physcs Seres Papers Fu Yuhua (CNOOC Research Insttute, E-mal:fuyh1945@sna.com)
More informationTurbulence classification of load data by the frequency and severity of wind gusts. Oscar Moñux, DEWI GmbH Kevin Bleibler, DEWI GmbH
Turbulence classfcaton of load data by the frequency and severty of wnd gusts Introducton Oscar Moñux, DEWI GmbH Kevn Blebler, DEWI GmbH Durng the wnd turbne developng process, one of the most mportant
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationResearch on Route guidance of logistic scheduling problem under fuzzy time window
Advanced Scence and Technology Letters, pp.21-30 http://dx.do.org/10.14257/astl.2014.78.05 Research on Route gudance of logstc schedulng problem under fuzzy tme wndow Yuqang Chen 1, Janlan Guo 2 * Department
More informationA Novel Feistel Cipher Involving a Bunch of Keys supplemented with Modular Arithmetic Addition
(IJACSA) Internatonal Journal of Advanced Computer Scence Applcatons, A Novel Festel Cpher Involvng a Bunch of Keys supplemented wth Modular Arthmetc Addton Dr. V.U.K Sastry Dean R&D, Department of Computer
More informationSpeeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem
H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence
More informationAssignment 5. Simulation for Logistics. Monti, N.E. Yunita, T.
Assgnment 5 Smulaton for Logstcs Mont, N.E. Yunta, T. November 26, 2007 1. Smulaton Desgn The frst objectve of ths assgnment s to derve a 90% two-sded Confdence Interval (CI) for the average watng tme
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationErrors in Nobel Prize for Physics (7) Improper Schrodinger Equation and Dirac Equation
Errors n Nobel Prze for Physcs (7) Improper Schrodnger Equaton and Drac Equaton u Yuhua (CNOOC Research Insttute, E-mal:fuyh945@sna.com) Abstract: One of the reasons for 933 Nobel Prze for physcs s for
More informationSingle-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition
Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu
More informationRegularized Discriminant Analysis for Face Recognition
1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths
More informationLecture 4. Instructor: Haipeng Luo
Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would
More informationGrey prediction model in world women s pentathlon performance prediction applied research
Avalable onlne www.jocpr.com Journal of Chemcal and Pharmaceutcal Research, 4, 6(6):36-4 Research Artcle ISSN : 975-7384 CODEN(USA) : JCPRC5 Grey predcton model n world women s pentathlon performance predcton
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationOnline Appendix to: Axiomatization and measurement of Quasi-hyperbolic Discounting
Onlne Appendx to: Axomatzaton and measurement of Quas-hyperbolc Dscountng José Lus Montel Olea Tomasz Strzaleck 1 Sample Selecton As dscussed before our ntal sample conssts of two groups of subjects. Group
More informationNP-Completeness : Proofs
NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem
More informationWavelet chaotic neural networks and their application to continuous function optimization
Vol., No.3, 04-09 (009) do:0.436/ns.009.307 Natural Scence Wavelet chaotc neural networks and ther applcaton to contnuous functon optmzaton Ja-Ha Zhang, Yao-Qun Xu College of Electrcal and Automatc Engneerng,
More informationPCA-PSO-BP Neural Network Application in IDS Lan SHI a, YanLong YANG b JanHui LV c
Internatonal Power, Electroncs and Materals Engneerng Conference (IPEMEC 2015) PCA-PSO-BP Neural Network Applcaton n IDS Lan SHI a, YanLong YANG b JanHu LV c College of Informaton Scence and Engneerng,
More informationOperating conditions of a mine fan under conditions of variable resistance
Paper No. 11 ISMS 216 Operatng condtons of a mne fan under condtons of varable resstance Zhang Ynghua a, Chen L a, b, Huang Zhan a, *, Gao Yukun a a State Key Laboratory of Hgh-Effcent Mnng and Safety
More informationMultilayer Perceptrons and Backpropagation. Perceptrons. Recap: Perceptrons. Informatics 1 CG: Lecture 6. Mirella Lapata
Multlayer Perceptrons and Informatcs CG: Lecture 6 Mrella Lapata School of Informatcs Unversty of Ednburgh mlap@nf.ed.ac.uk Readng: Kevn Gurney s Introducton to Neural Networks, Chapters 5 6.5 January,
More informationA New Grey Relational Fusion Algorithm Based on Approximate Antropy
Journal of Computatonal Informaton Systems 9: 20 (2013) 8045 8052 Avalable at http://www.jofcs.com A New Grey Relatonal Fuson Algorthm Based on Approxmate Antropy Yun LIN, Jnfeng PANG, Ybng LI College
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationA New Evidence Combination Method based on Consistent Strength
TELKOMNIKA, Vol.11, No.11, November 013, pp. 697~6977 e-issn: 087-78X 697 A New Evdence Combnaton Method based on Consstent Strength Changmng Qao, Shul Sun* Insttute of Electronc Engneerng, He Longang
More informationFuzzy Boundaries of Sample Selection Model
Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN
More informationon the improved Partial Least Squares regression
Internatonal Conference on Manufacturng Scence and Engneerng (ICMSE 05) Identfcaton of the multvarable outlers usng T eclpse chart based on the mproved Partal Least Squares regresson Lu Yunlan,a X Yanhu,b
More informationJournal of Chemical and Pharmaceutical Research, 2014, 6(5): Research Article
Avalable onlne www.jocpr.com Journal of Chemcal and Pharmaceutcal Research, 014, 6(5):1683-1688 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Multple mode control based on VAV ar condtonng system
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationOrientation Model of Elite Education and Mass Education
Proceedngs of the 8th Internatonal Conference on Innovaton & Management 723 Orentaton Model of Elte Educaton and Mass Educaton Ye Peng Huanggang Normal Unversty, Huanggang, P.R.Chna, 438 (E-mal: yepeng@hgnc.edu.cn)
More informationStudy of Selective Ensemble Learning Methods Based on Support Vector Machine
Avalable onlne at www.scencedrect.com Physcs Proceda 33 (2012 ) 1518 1525 2012 Internatonal Conference on Medcal Physcs and Bomedcal Engneerng Study of Selectve Ensemble Learnng Methods Based on Support
More informationAccurate Forecasting of Underground Fading Channel Based on Improved LS-SVM Anyi Wang1, a, Xi Xi1, b
nd Workshop on Advanced Research and echnology n Industry Applcatons (WARIA 06) Accurate Forecastng of Underground Fadng Channel Based on Improved LS-SVM Any Wang, a, X X, b College of Communcaton and
More informationIntroduction to Information Theory, Data Compression,
Introducton to Informaton Theory, Data Compresson, Codng Mehd Ibm Brahm, Laura Mnkova Aprl 5, 208 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on the 3th of March 208 for a Data Structures
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationCredit Card Pricing and Impact of Adverse Selection
Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n
More informationApplication research on rough set -neural network in the fault diagnosis system of ball mill
Avalable onlne www.ocpr.com Journal of Chemcal and Pharmaceutcal Research, 2014, 6(4):834-838 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Applcaton research on rough set -neural network n the
More informationSemi-supervised Classification with Active Query Selection
Sem-supervsed Classfcaton wth Actve Query Selecton Jao Wang and Swe Luo School of Computer and Informaton Technology, Beng Jaotong Unversty, Beng 00044, Chna Wangjao088@63.com Abstract. Labeled samples
More informationThe Similarity for Nominal Variables Based on F-Divergence
Internatonal Journal of Database Theory and Applcaton, pp. 191-0 http://dx.do.org/10.1457/jdta.016.9.3.19 The Smlarty for Nomnal Varables Based on F-Dvergence Zhao Lang *,1 and Lu Janhu 1 Insttute of Graduate,
More informationChapter 5 Multilevel Models
Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationGEMINI GEneric Multimedia INdexIng
GEMINI GEnerc Multmeda INdexIng Last lecture, LSH http://www.mt.edu/~andon/lsh/ Is there another possble soluton? Do we need to perform ANN? 1 GEnerc Multmeda INdexIng dstance measure Sub-pattern Match
More informationA Hybrid Evaluation model for Distribution Network Reliability Based on Matter-element Extension Method
Advanced Scence and Technology Letters Vol.74 (ASEA 204), pp.87-95 http://dx.do.org/0.4257/astl.204.74.7 A Hybrd Evaluaton model for Dstrbuton Network Relablty Based on Matter-element Extenson Method Huru
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationParameter Estimation for Dynamic System using Unscented Kalman filter
Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,
More informationMULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN
MULTISPECTRAL IMAGE CLASSIFICATION USING BACK-PROPAGATION NEURAL NETWORK IN PCA DOMAIN S. Chtwong, S. Wtthayapradt, S. Intajag, and F. Cheevasuvt Faculty of Engneerng, Kng Mongkut s Insttute of Technology
More informationLecture Nov
Lecture 18 Nov 07 2008 Revew Clusterng Groupng smlar obects nto clusters Herarchcal clusterng Agglomeratve approach (HAC: teratvely merge smlar clusters Dfferent lnkage algorthms for computng dstances
More informationStatistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA
14 th Internatonal Users Conference Sesson: ALE-FSI Statstcal Energy Analyss for Hgh Frequency Acoustc Analyss wth Zhe Cu 1, Yun Huang 1, Mhamed Soul 2, Tayeb Zeguar 3 1 Lvermore Software Technology Corporaton
More informationA new Approach for Solving Linear Ordinary Differential Equations
, ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationSuppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl
RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com
More informationMath Review. CptS 223 Advanced Data Structures. Larry Holder School of Electrical Engineering and Computer Science Washington State University
Math Revew CptS 223 dvanced Data Structures Larry Holder School of Electrcal Engneerng and Computer Scence Washngton State Unversty 1 Why do we need math n a data structures course? nalyzng data structures
More informationP R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /
Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons
More informationProbability, Statistics, and Reliability for Engineers and Scientists SIMULATION
CHATER robablty, Statstcs, and Relablty or Engneers and Scentsts Second Edton SIULATIO A. J. Clark School o Engneerng Department o Cvl and Envronmental Engneerng 7b robablty and Statstcs or Cvl Engneers
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationAPPLICATION OF RBF NEURAL NETWORK IMPROVED BY PSO ALGORITHM IN FAULT DIAGNOSIS
Journal of Theoretcal and Appled Informaton Technology 005-01 JATIT & LLS. All rghts reserved. ISSN: 199-8645 www.jatt.org E-ISSN: 1817-3195 APPLICATION OF RBF NEURAL NETWORK IMPROVED BY PSO ALGORITHM
More informationA Two-Level Detection Algorithm for Optical Fiber Vibration
PHOTOIC SESORS/ Vol. 5, o. 3, 05: 84 88 A Two-Level Detecton Algorthm for Optcal Fber Vbraton Fukun BI, uecong RE *, Hongquan QU, and Ruqng JIAG College of Informaton Engneerng, orth Chna Unversty of Technology,
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationA Short Term Forecasting Method for Wind Power Generation System based on BP Neural Networks
Advanced Scence and Technology Letters Vol.83 (ISA 05), pp.7-75 http://dx.do.org/0.457/astl.05.83.4 A Short Term Forecastng Method for Wnd Power Generaton System based on BP Neural Networks Shenghu Wang,
More informationBoostrapaggregating (Bagging)
Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationTREND OF POVERTY INTENSITY IN IRAN
www.arpapress.com/volumes/vol4issue/ijrras_4.pdf TREND OF POVERTY INTENSITY IN IRAN 99-200 F. Bagher & M.S. Avazalpour 2 Statstcal Research and Tranng Centre, Tehran, Iran 2 Statstcal Research and Tranng
More informationUncertainty in measurements of power and energy on power networks
Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationLecture 10: May 6, 2013
TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,
More informationDERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION
Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung
More informationKeyword Reduction for Text Categorization using Neighborhood Rough Sets
IJCSI Internatonal Journal of Computer Scence Issues, Volume 1, Issue 1, No, January 015 ISSN (rnt): 1694-0814 ISSN (Onlne): 1694-0784 www.ijcsi.org Keyword Reducton for Text Categorzaton usng Neghborhood
More informationChapter 12 Analysis of Covariance
Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty
More informationSequential Condition Diagnosis for Centrifugal Pump System Using Fuzzy Neural Network
eural Informaton Processng Letters and Revews Vol., o. 3, March 007 LETTER Sequental Condton Dagnoss for Centrfugal Pump System Usng Fuzzy eural etwork Huaqng Wang and Peng Chen Department of Envronmental
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationSupporting Information
Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to
More informationUSE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE
STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,
More informationAggregation of Social Networks by Divisive Clustering Method
ggregaton of Socal Networks by Dvsve Clusterng Method mne Louat and Yves Lechaveller INRI Pars-Rocquencourt Rocquencourt, France {lzennyr.da_slva, Yves.Lechevaller, Fabrce.Ross}@nra.fr HCSD Beng October
More informationStability Analysis of Wireless Measurement and Control System Based on Dynamic Matrix
Sensors & ransducers, Vol 6, Issue, January 4, pp - Sensors & ransducers 4 by IFSA Publshng, S L http://wwwsensorsportalcom Stablty Analyss of Wreless Measurement and Control System Based on Dynamc Matrx,
More informationERROR RESEARCH ON A HEPA FILTER MEDIA TESTING SYSTEM OF MPPS(MOST PENETRATION PARTICLE SIZE) EFFICIENCY
Proceedngs: Indoor Ar 2005 ERROR RESEARCH ON A HEPA FILTER MEDIA TESTING SYSTEM OF MPPS(MOST PENETRATION PARTICLE SIZE) EFFICIENCY S Lu, J Lu *, N Zhu School of Envronmental Scence and Technology, Tanjn
More information