A New Evolutionary Computation Based Approach for Learning Bayesian Network
|
|
- William Newman
- 5 years ago
- Views:
Transcription
1 Avalable onlne at Proceda Engneerng 15 (2011) Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang Zhu a,b, Dayou Lu a,b *,Hayang Ja a,b a College of Computer Scence and Technology, Jln Unversty, Changchun , Chna b Key Laboratory of Symbolc Computaton and Knowledge Engneerng of Mnstry of Educaton, Jln Unversty, Changchun , Chna Abstract Bayesan network s a popular tool for uncertanty process n Artfcal Intellgence. In recent years, more and more attenton has been pad to learnng of Bayesan network. In ths paper, we proposed a novel learnng algorthm for Bayesan network based on (μ, λ)-evoluton Strategy, we present the encodng scheme and ftness functon, desgned the evolutonary operators of recombnaton, mutaton and selecton. Theoretcal analyss and expermental results all demonstrate that the proposed method can learn the Bayesan network from data effectvely Publshed by Elsever Ltd. Selecton and/or peer-revew under responsblty of [CEIS 2011] Open access under CC BY-NC-ND lcense. Keywords: Bayesan network; Evoluton strategy; Evolutonary computaton 1. Introducton Bayesan network has been a powerful tool for managng uncertanty. It has been successfully appled to expert system, dagnoss system, and decson support system et al. Bayesan network ntegrates graphcal model and probablty theory, and t ndcates the nternal relatonshp among varables. In recent years, many researchers pay much attenton to the learnng algorthm for Bayesan network. Learnng the structure of a Bayesan network can be consdered a specfc example of the general problem of selectng a probablstc model that explans a gven set of data[1]. * Correspondng author. E-mal address: dylu@jlu.edu.cn Publshed by Elsever Ltd. do: /j.proeng Open access under CC BY-NC-ND lcense.
2 Yungang Zhu et al. / Proceda Engneerng 15 (2011) In ths paper we proposed a novel learnng algorthm for Bayesan network based on Evoluton Strategy. In detal, we adopt (μ, λ)-evoluton Strategy whch s an evolutonary computng method to learn Bayesan network. The rest of ths paper s organzed as follows: Secton 2 presents bref background knowledge. The method we proposed s descrbed n Secton 3. Secton 4 presents the expermental results and dscusson of the proposed method. Fnally, conclusons are summarzed n Secton Theoretcal Background A Bayesan network (BN) s a graphcal model for representng relatonshps among varables. Let us consder a set of varables X={X 1,X 2,,X n }, a Bayesan network s a tuple (G, Θ), where G s a drected acyclc graph (DAG), each node of G represents the varable, and each drected edge represents relatonshps between varables; and Θ={ P(X π ),1 n } represents the local condtonal probablty dstrbuton of each node gven the values of ther parent nodes, where π s the parent set of X. 1 r Assumed the range of X s { 1 q x,..., x }, the range of π s{ π,..., π }, the local condtonal probablty k dstrbuton of each node s represented by j n q r θ jk = P ( X = x π = π ), and Θ = U U U { θ. 1 j 1 k 1 jk} = = = Evoluton Strategy (ES) s one of the evolutonary computng methods. ES produces consecutve generatons of ndvdual, durng a generaton a selecton method s used to select specfc ndvduals whch form the new generaton by recombnaton and mutaton [2]. 3. Learnng Bayesan network based on Evoluton Strategy The problem of learnng of Bayesan network can be stated as follows. Assumng that D represent the data, the purpose s to obtan a Bayesan network S that best ft the D Encodng The Bayesan network structure was encoded nto adjacency matrx or adjacency lst n prevous codng way, but the method wll result n a large amount of cyclc graphs whch are llegal structures. Based on the codng scheme n [3][4], n ths paper, the code s dvded nto 3 parts. The 1st part s a sequence of nodes: Ths order s the reverse of topologcal sort of the network nodes, so there s no cycle. For example, the sequence of Fgure 1 s Fg. 1. A smple example of Bayesan network. The 2nd part has n-1 segments, each segment ndcate the parents of each node n the sequence above, the last node has no parent, so only n-1 segments needed. For example, the structure of Fgure 1, the second part of code s segment 1 ndcate that for node 5, node 4,2,3 s parent, and Node 1
3 4028 Yungang Zhu et al. / Proceda Engneerng 15 (2011) s not parent; segment 2 ndcate that for node 4, node 2,3,1 s parent; segment 3 ndcate for Node 2, Node 3 s parent, and Node 1 s not; and so on. Further more, consderng smple of network structure, we restrct the number of parents of each node can not exceed k. In general, k s much smaller than n, and usng the code above wll nclude lots of 0. So we use compress form of the code, that s only recordng the poston of 1 n the order of sequence from frst part, thus the fnal code s [ ]. The 3rd Part s adaptve step sze n mutaton evolutonary strategy σ. So n summary, the code of Fgure 1 s [ σ] Ftness functon We use Bayesan Informaton Crteron (BIC)[1] scorng measure to be the Ftness functon, that s as follows: 1 Ftness ( S) = log P( D S) Pen( S) = ( Njk logθjk ) log L π ( X 1) j k 2 k j where s number of sample whch X = and π = n data D. L s the number of samples. X s N jk X the number of assgnment of X. and P ( D S ) measures the ftness of S to data D, Pen(S) s penalty functon about the structure of S to make the learnng algorthm trend to obtan concse model whch s easy for management Evolutonary operator Recombnaton The Recombnaton of evoluton strategy s equvalent of the cross for genetc algorthm. But unlke GA, the Recombnaton generates only one ndvdual from two parent ndvduals. For the frst part of the code, we use Partally Matched Crossover of GA[5], selectng a new ndvdual from the two resultng ndvduals randomly. For the second part of the code, for each segment, a segment s selected randomly from the two parent ndvduals as the segment of the chld ndvdual. The thrd part s the sze of step n Mutaton, usng the md-value for Recombnaton. If the thrd part of two parents are σ 1 and σ 2, after Recombnaton, t s (σ 1 +σ 1 )/2. Mutaton There are three types of mutaton operator: the addng an arc, deletng an arc, and reversng an arc. It s not to perform one mutaton operator durng mutaton, but to perform σ N(0,1) mutaton operators, N(0,1) s normally dstrbuted random varable whch mean=0 and varance=1. Selecton Selecton s strctly accordng to the ftness, elmnatng all the poor ndvduals, selectng all the good ones. The proposed algorthm usng (μ, λ) selecton strategy: μ parent ndvduals generate λ (λ>μ) chldren ndvduals, and select μ ndvduals from the resultng λ ndvduals as the next generaton. π In summary, the pseudo-code of the learnng algorthm based on Procedure ESBN (data D) begn Generate μ Bayesan networks randomly as nt group S(0); Select a network randomly from S(0) as current best network S max ; for each S n S(0) do Ftness[S ]= Cal-Ftness(S ) ; //Calculate Ftness end for ( μ, λ) ES descrbed as follows:
4 Yungang Zhu et al. / Proceda Engneerng 15 (2011) S max =Select_Top_One(S(0)) ; S mn =Select_Lowest_One(S(0)) ; t=0; whle ( t< t max Ftness[S max ] Ftness[S mn ]<ε) do for =1 to λ do //Generate λ chldren ndvduals S (t) Random_Select(S(t)) ; S j (t) Random_Select(S(t)) ; Chldren Recombnaton(S (t), S j (t) ) ; // Recombnaton Chldren Mutaton(Chldren ) ; // Mutaton Ftness[Chldren ]=Cal-Ftness(Chldren ) ; end for Select μ ndvduals as next generaton S(t+1) from // Selecton {Chldren,, Chldren λ } accordng to Ftness[Chldren ] (1 λ ) t=t+1; S max =Select_Top_One(S(t)); S mn =Select_Lowest_One(S(t)); end whle return S max ; end 4. Experment and dscusson We use benchmark experment data generated from a classcal Bayesan network called Alarm [6] whch has 37 nodes. In detal, we generate a tranng data set wth 4000 samples, the frst 3000 samples are used for learnng, and the last 1000 samples are used for testng. We make the learnng samples nto 3 groups each of whch contans 1000 samples, 2000 samples, 3000 samples, then we learn 3 Bayesan networks from the 3 groups and test the learnng accuracy separately. The algorthm s evaluated based on the N average Log-Loss of each learned network on ths test set, that s 1 N P C = 1 S ( ) [7], where N s the number of test data, C s the th sample of test data. For convenence, we actually use the absolute value of Log- Loss, t's value can measure how well the learned network ft the data, that s the accuracy of learned network, and the value s the smaller, the better. The results are summarzed n Fgure Absolute value of Log-Loss N=1000 N=2000 N= Iteraton numbers Fg. 2. The learnng performance of the proposed algorthm wth 3 groups test data.
5 4030 Yungang Zhu et al. / Proceda Engneerng 15 (2011) From Fgure 2, we can see the algorthm can converge to a good network, and the more samples used for learnng, the faster algorthm wll converge, and the better Bayesan network wll be obtaned. Because more data can contans more statstcal features, so the learned result wll be more accurate. The expermental shows that the algorthm s effectve. 5. Conclusons In ths paper, a (μ, λ)-evoluton Strategy based learnng algorthm for Bayesan network s proposed. An mproved encodng scheme of Bayesan network structure s proposed, the ftness functon s desgned based on the BIC scorng measure. The recombnaton, mutaton and selecton evolutonary operators are also proposed. Expermental results show that the proposed algorthm can learn the Bayesan network from data effectvely. Acknowledgements Professor Dayou Lu s the correspondng author for ths paper. Ths work s supported by the Natonal Natural Scence Foundaton of Chna (NSFC) under Grant No , , Ths work s also supported by the Open Projects of Shangha Key Laboratory of Intellgent Informaton Processng n Fudan Unversty under the Grand No. IIPL References [1] Daly R, Shen Q, Atken S. Learnng Bayesan networks: approaches and ssues.the Knowledge Engneerng Revew,2011, 26(2), p [2] Gruttner M, Sehnke F, et al. Mult-Dmensonal Deep Memory Atar-Go Players for Parameter Explorng Polcy Gradents. The 20th Internatonal Conference on Artfcal Neural Networks,2010, p [3] Zhang C, Shen YD, et al. Structure Learnng of Belef Network by Genetc Algorthms: A New Network Encodng Method. Computer Scence.2004, 31(12),p [4] Lee J, Chung W,et al.a new genetc approach to structure learnng of Bayesan networks.advances n Neural Networks - ISNN 2006, PT 1 Lecture Notes n Computer Scence 3971, Part , p [5] Zhou CJ, Lang YC. Evolutonary Computaton. 3rd ed. Changchun:Jln Unversty Press;2009. [6] Benlch I, Suermondt G, et al. The ALRAM montorng system: A case study wth two probablstc nference. The 2nd European Conf on A rtfcal Intellgence n Medcne, 1989, p [7] Fredman N. Learnng belef networks n the presence of mssng values and hdden varables.the 14th Internatonal Conf on Machne Learnng,1997, p
The Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationPower law and dimension of the maximum value for belief distribution with the max Deng entropy
Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationHidden Markov Models
CM229S: Machne Learnng for Bonformatcs Lecture 12-05/05/2016 Hdden Markov Models Lecturer: Srram Sankararaman Scrbe: Akshay Dattatray Shnde Edted by: TBD 1 Introducton For a drected graph G we can wrte
More informationSparse Gaussian Processes Using Backward Elimination
Sparse Gaussan Processes Usng Backward Elmnaton Lefeng Bo, Lng Wang, and Lcheng Jao Insttute of Intellgent Informaton Processng and Natonal Key Laboratory for Radar Sgnal Processng, Xdan Unversty, X an
More informationArtificial Intelligence Bayesian Networks
Artfcal Intellgence Bayesan Networks Adapted from sldes by Tm Fnn and Mare desjardns. Some materal borrowed from Lse Getoor. 1 Outlne Bayesan networks Network structure Condtonal probablty tables Condtonal
More informationInternational Journal of Mathematical Archive-3(3), 2012, Page: Available online through ISSN
Internatonal Journal of Mathematcal Archve-3(3), 2012, Page: 1136-1140 Avalable onlne through www.ma.nfo ISSN 2229 5046 ARITHMETIC OPERATIONS OF FOCAL ELEMENTS AND THEIR CORRESPONDING BASIC PROBABILITY
More informationA Network Intrusion Detection Method Based on Improved K-means Algorithm
Advanced Scence and Technology Letters, pp.429-433 http://dx.do.org/10.14257/astl.2014.53.89 A Network Intruson Detecton Method Based on Improved K-means Algorthm Meng Gao 1,1, Nhong Wang 1, 1 Informaton
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationOutline. Bayesian Networks: Maximum Likelihood Estimation and Tree Structure Learning. Our Model and Data. Outline
Outlne Bayesan Networks: Maxmum Lkelhood Estmaton and Tree Structure Learnng Huzhen Yu janey.yu@cs.helsnk.f Dept. Computer Scence, Unv. of Helsnk Probablstc Models, Sprng, 200 Notces: I corrected a number
More informationSemi-supervised Classification with Active Query Selection
Sem-supervsed Classfcaton wth Actve Query Selecton Jao Wang and Swe Luo School of Computer and Informaton Technology, Beng Jaotong Unversty, Beng 00044, Chna Wangjao088@63.com Abstract. Labeled samples
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More informationUsing Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*
Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton
More informationWavelet chaotic neural networks and their application to continuous function optimization
Vol., No.3, 04-09 (009) do:0.436/ns.009.307 Natural Scence Wavelet chaotc neural networks and ther applcaton to contnuous functon optmzaton Ja-Ha Zhang, Yao-Qun Xu College of Electrcal and Automatc Engneerng,
More informationBayesian predictive Configural Frequency Analysis
Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse
More informationMarkov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationMicrowave Diversity Imaging Compression Using Bioinspired
Mcrowave Dversty Imagng Compresson Usng Bonspred Neural Networks Youwe Yuan 1, Yong L 1, Wele Xu 1, Janghong Yu * 1 School of Computer Scence and Technology, Hangzhou Danz Unversty, Hangzhou, Zhejang,
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationValuated Binary Tree: A New Approach in Study of Integers
Internatonal Journal of Scentfc Innovatve Mathematcal Research (IJSIMR) Volume 4, Issue 3, March 6, PP 63-67 ISS 347-37X (Prnt) & ISS 347-34 (Onlne) wwwarcournalsorg Valuated Bnary Tree: A ew Approach
More informationA Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach
A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland
More informationAn improved multi-objective evolutionary algorithm based on point of reference
IOP Conference Seres: Materals Scence and Engneerng PAPER OPEN ACCESS An mproved mult-objectve evolutonary algorthm based on pont of reference To cte ths artcle: Boy Zhang et al 08 IOP Conf. Ser.: Mater.
More informationConjugacy and the Exponential Family
CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the
More informationStudy of Selective Ensemble Learning Methods Based on Support Vector Machine
Avalable onlne at www.scencedrect.com Physcs Proceda 33 (2012 ) 1518 1525 2012 Internatonal Conference on Medcal Physcs and Bomedcal Engneerng Study of Selectve Ensemble Learnng Methods Based on Support
More informationAdaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays *
Journal of Robotcs, etworkng and Artfcal Lfe, Vol., o. (September 04), 5-9 Adaptve Consensus Control of Mult-Agent Systems wth Large Uncertanty and me Delays * L Lu School of Mechancal Engneerng Unversty
More informationNatural Images, Gaussian Mixtures and Dead Leaves Supplementary Material
Natural Images, Gaussan Mxtures and Dead Leaves Supplementary Materal Danel Zoran Interdscplnary Center for Neural Computaton Hebrew Unversty of Jerusalem Israel http://www.cs.huj.ac.l/ danez Yar Wess
More informationSpace of ML Problems. CSE 473: Artificial Intelligence. Parameter Estimation and Bayesian Networks. Learning Topics
/7/7 CSE 73: Artfcal Intellgence Bayesan - Learnng Deter Fox Sldes adapted from Dan Weld, Jack Breese, Dan Klen, Daphne Koller, Stuart Russell, Andrew Moore & Luke Zettlemoyer What s Beng Learned? Space
More informationCourse 395: Machine Learning - Lectures
Course 395: Machne Learnng - Lectures Lecture 1-2: Concept Learnng (M. Pantc Lecture 3-4: Decson Trees & CC Intro (M. Pantc Lecture 5-6: Artfcal Neural Networks (S.Zaferou Lecture 7-8: Instance ased Learnng
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationImproved delay-dependent stability criteria for discrete-time stochastic neural networks with time-varying delays
Avalable onlne at www.scencedrect.com Proceda Engneerng 5 ( 4456 446 Improved delay-dependent stablty crtera for dscrete-tme stochastc neural networs wth tme-varyng delays Meng-zhuo Luo a Shou-mng Zhong
More informationon the improved Partial Least Squares regression
Internatonal Conference on Manufacturng Scence and Engneerng (ICMSE 05) Identfcaton of the multvarable outlers usng T eclpse chart based on the mproved Partal Least Squares regresson Lu Yunlan,a X Yanhu,b
More informationUnified Subspace Analysis for Face Recognition
Unfed Subspace Analyss for Face Recognton Xaogang Wang and Xaoou Tang Department of Informaton Engneerng The Chnese Unversty of Hong Kong Shatn, Hong Kong {xgwang, xtang}@e.cuhk.edu.hk Abstract PCA, LDA
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationRegularized Discriminant Analysis for Face Recognition
1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationExercises of Chapter 2
Exercses of Chapter Chuang-Cheh Ln Department of Computer Scence and Informaton Engneerng, Natonal Chung Cheng Unversty, Mng-Hsung, Chay 61, Tawan. Exercse.6. Suppose that we ndependently roll two standard
More informationAn Improved multiple fractal algorithm
Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton
More informationA New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane
A New Scramblng Evaluaton Scheme based on Spatal Dstrbuton Entropy and Centrod Dfference of Bt-plane Lang Zhao *, Avshek Adhkar Kouch Sakura * * Graduate School of Informaton Scence and Electrcal Engneerng,
More informationBoostrapaggregating (Bagging)
Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod
More informationAppendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationHiding data in images by simple LSB substitution
Pattern Recognton 37 (004) 469 474 www.elsever.com/locate/patcog Hdng data n mages by smple LSB substtuton Ch-Kwong Chan, L.M. Cheng Department of Computer Engneerng and Informaton Technology, Cty Unversty
More informationDiscretization of Continuous Attributes in Rough Set Theory and Its Application*
Dscretzaton of Contnuous Attrbutes n Rough Set Theory and Its Applcaton* Gexang Zhang 1,2, Lazhao Hu 1, and Wedong Jn 2 1 Natonal EW Laboratory, Chengdu 610036 Schuan, Chna dylan7237@sna.com 2 School of
More informationMultigradient for Neural Networks for Equalizers 1
Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT
More informationAP Physics 1 & 2 Summer Assignment
AP Physcs 1 & 2 Summer Assgnment AP Physcs 1 requres an exceptonal profcency n algebra, trgonometry, and geometry. It was desgned by a select group of college professors and hgh school scence teachers
More informationShort Term Load Forecasting using an Artificial Neural Network
Short Term Load Forecastng usng an Artfcal Neural Network D. Kown 1, M. Km 1, C. Hong 1,, S. Cho 2 1 Department of Computer Scence, Sangmyung Unversty, Seoul, Korea 2 Department of Energy Grd, Sangmyung
More informationSolving Nonlinear Differential Equations by a Neural Network Method
Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationEM and Structure Learning
EM and Structure Learnng Le Song Machne Learnng II: Advanced Topcs CSE 8803ML, Sprng 2012 Partally observed graphcal models Mxture Models N(μ 1, Σ 1 ) Z X N N(μ 2, Σ 2 ) 2 Gaussan mxture model Consder
More informationTurbulence classification of load data by the frequency and severity of wind gusts. Oscar Moñux, DEWI GmbH Kevin Bleibler, DEWI GmbH
Turbulence classfcaton of load data by the frequency and severty of wnd gusts Introducton Oscar Moñux, DEWI GmbH Kevn Blebler, DEWI GmbH Durng the wnd turbne developng process, one of the most mportant
More informationUncertain Models for Bed Allocation
www.ccsenet.org/ghs Global Journal of Health Scence Vol., No. ; October 00 Uncertan Models for Bed Allocaton Lng Gao (Correspondng author) College of Scence, Guln Unversty of Technology Box 733, Guln 54004,
More informationCryptanalysis of pairing-free certificateless authenticated key agreement protocol
Cryptanalyss of parng-free certfcateless authentcated key agreement protocol Zhan Zhu Chna Shp Development Desgn Center CSDDC Wuhan Chna Emal: zhuzhan0@gmal.com bstract: Recently He et al. [D. He J. Chen
More informationWeek 5: Neural Networks
Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationTHEORY OF GENETIC ALGORITHMS WITH α-selection. André Neubauer
THEORY OF GENETIC ALGORITHMS WITH α-selection André Neubauer Informaton Processng Systems Lab Münster Unversty of Appled Scences Stegerwaldstraße 39, D-48565 Stenfurt, Germany Emal: andre.neubauer@fh-muenster.de
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informationPolymerizer fault diagnosis algorithm based on improved the GA-LMBP
Avalable onlne www.jocpr.com Journal of Chemcal and Pharmaceutcal Research, 04, 6(6):786-793 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Polymerzer fault dagnoss algorthm based on mproved the
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationPop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing
Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,
More informationSupporting Information
Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to
More informationFeature Selection in Multi-instance Learning
The Nnth Internatonal Symposum on Operatons Research and Its Applcatons (ISORA 10) Chengdu-Juzhagou, Chna, August 19 23, 2010 Copyrght 2010 ORSC & APORC, pp. 462 469 Feature Selecton n Mult-nstance Learnng
More informationChecking Pairwise Relationships. Lecture 19 Biostatistics 666
Checkng Parwse Relatonshps Lecture 19 Bostatstcs 666 Last Lecture: Markov Model for Multpont Analyss X X X 1 3 X M P X 1 I P X I P X 3 I P X M I 1 3 M I 1 I I 3 I M P I I P I 3 I P... 1 IBD states along
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationA Trust Model Based on Cloud Model and Bayesian Networks
Avalable onlne at www.scencedrect.com roceda Envronmental Scences (20) 452 459 A Trust Model Based on Cloud Model and Bayesan Networs Bo Jn a,yong Wang b, Zhenyan Lu b, Jngfeng Xue b a Key Lab of Informaton
More informationParticle Swarm Optimization with Adaptive Mutation in Local Best of Particles
1 Internatonal Congress on Informatcs, Envronment, Energy and Applcatons-IEEA 1 IPCSIT vol.38 (1) (1) IACSIT Press, Sngapore Partcle Swarm Optmzaton wth Adaptve Mutaton n Local Best of Partcles Nanda ulal
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More informationDifferential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow
1 Dfferental Evoluton Algorthm wth a Modfed Archvng-based Adaptve Tradeoff Model for Optmal Power Flow 2 Outlne Search Engne Constrant Handlng Technque Test Cases and Statstcal Results 3 Roots of Dfferental
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationBayesian belief networks
CS 1571 Introducton to I Lecture 24 ayesan belef networks los Hauskrecht mlos@cs.ptt.edu 5329 Sennott Square CS 1571 Intro to I dmnstraton Homework assgnment 10 s out and due next week Fnal exam: December
More informationCOMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD
COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD Ákos Jósef Lengyel, István Ecsed Assstant Lecturer, Professor of Mechancs, Insttute of Appled Mechancs, Unversty of Mskolc, Mskolc-Egyetemváros,
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationFuzzy Boundaries of Sample Selection Model
Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN
More informationAn Extended Hybrid Genetic Algorithm for Exploring a Large Search Space
2nd Internatonal Conference on Autonomous Robots and Agents Abstract An Extended Hybrd Genetc Algorthm for Explorng a Large Search Space Hong Zhang and Masum Ishkawa Graduate School of L.S.S.E., Kyushu
More informationMODIFIED PARTICLE SWARM OPTIMIZATION FOR OPTIMIZATION PROBLEMS
Journal of Theoretcal and Appled Informaton Technology 3 st ecember 0. Vol. No. 005 0 JATIT & LLS. All rghts reserved. ISSN: 9985 www.jatt.org EISSN: 87395 MIFIE PARTICLE SARM PTIMIZATIN FR PTIMIZATIN
More informationModeling of Risk Treatment Measurement Model under Four Clusters Standards (ISO 9001, 14001, 27001, OHSAS 18001)
Avalable onlne at www.scencedrect.com Proceda Engneerng 37 (202 ) 354 358 The Second SREE Conference on Engneerng Modelng and Smulaton Modelng of Rsk Treatment Measurement Model under Four Clusters Standards
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationOnline Classification: Perceptron and Winnow
E0 370 Statstcal Learnng Theory Lecture 18 Nov 8, 011 Onlne Classfcaton: Perceptron and Wnnow Lecturer: Shvan Agarwal Scrbe: Shvan Agarwal 1 Introducton In ths lecture we wll start to study the onlne learnng
More informationMDL-Based Unsupervised Attribute Ranking
MDL-Based Unsupervsed Attrbute Rankng Zdravko Markov Computer Scence Department Central Connectcut State Unversty New Brtan, CT 06050, USA http://www.cs.ccsu.edu/~markov/ markovz@ccsu.edu MDL-Based Unsupervsed
More informationMotion Perception Under Uncertainty. Hongjing Lu Department of Psychology University of Hong Kong
Moton Percepton Under Uncertanty Hongjng Lu Department of Psychology Unversty of Hong Kong Outlne Uncertanty n moton stmulus Correspondence problem Qualtatve fttng usng deal observer models Based on sgnal
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationElitist Reconstruction Genetic Algorithm Based on Markov Random Field for Magnetic Resonance Image Segmentation
JOURNAL OF ELECTRONIC SCIENCE AND TECHNOLOGY, VOL. 10, NO. 1, MARCH 2012 83 Eltst Reconstructon Genetc Algorthm Based on Markov Random Feld for Magnetc Resonance Image Segmentaton Xn-Yu Du, Yong-Je L,
More informationMulti-Robot Formation Control Based on Leader-Follower Optimized by the IGA
IOSR Journal of Computer Engneerng (IOSR-JCE e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 19, Issue 1, Ver. III (Jan.-Feb. 2017, PP 08-13 www.osrjournals.org Mult-Robot Formaton Control Based on Leader-Follower
More informationMultilayer Perceptron (MLP)
Multlayer Perceptron (MLP) Seungjn Cho Department of Computer Scence and Engneerng Pohang Unversty of Scence and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjn@postech.ac.kr 1 / 20 Outlne
More informationAn adaptive SMC scheme for ABC. Bayesian Computation (ABC)
An adaptve SMC scheme for Approxmate Bayesan Computaton (ABC) (ont work wth Prof. Mke West) Department of Statstcal Scence - Duke Unversty Aprl/2011 Approxmate Bayesan Computaton (ABC) Problems n whch
More informationNatural Language Processing and Information Retrieval
Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support
More informationCalculating the Quasi-static Pressures of Confined Explosions Considering Chemical Reactions under the Constant Entropy Assumption
Appled Mechancs and Materals Onlne: 202-04-20 ISS: 662-7482, ol. 64, pp 396-400 do:0.4028/www.scentfc.net/amm.64.396 202 Trans Tech Publcatons, Swtzerland Calculatng the Quas-statc Pressures of Confned
More informationMLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012
MLE and Bayesan Estmaton Je Tang Department of Computer Scence & Technology Tsnghua Unversty 01 1 Lnear Regresson? As the frst step, we need to decde how we re gong to represent the functon f. One example:
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationOperating conditions of a mine fan under conditions of variable resistance
Paper No. 11 ISMS 216 Operatng condtons of a mne fan under condtons of varable resstance Zhang Ynghua a, Chen L a, b, Huang Zhan a, *, Gao Yukun a a State Key Laboratory of Hgh-Effcent Mnng and Safety
More informationA DNA Coding Scheme for Searching Stable Solutions
A DNA odng Scheme for Searchng Stable Solutons Intaek Km, HeSong Lan, and Hwan Il Kang 2 Department of ommuncaton Eng., Myongj Unversty, 449-728, Yongn, South Korea kt@mju.ac.kr, hslan@hotmal.net 2 Department
More informationA Method for Filling up the Missed Data in Information Table
A Method for Fllng up the Mssed Data Gao Xuedong, E Xu, L Teke & Zhang Qun A Method for Fllng up the Mssed Data n Informaton Table Gao Xuedong School of Management, nversty of Scence and Technology Beng,
More informationModule 9. Lecture 6. Duality in Assignment Problems
Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept
More informationCase Study of Cascade Reliability with weibull Distribution
ISSN: 77-3754 ISO 900:008 Certfed Internatonal Journal of Engneerng and Innovatve Technology (IJEIT) Volume, Issue 6, June 0 Case Study of Cascade Relablty wth webull Dstrbuton Dr.T.Shyam Sundar Abstract
More informationA Study on Improved Cockroach Swarm Optimization Algorithm
A Study on Improved Cockroach Swarm Optmzaton Algorthm 1 epartment of Computer Scence and Engneerng, Huaan Vocatonal College of Informaton Technology,Huaan 223003, Chna College of Computer and Informaton,
More information