The Study of Teaching-learning-based Optimization Algorithm

Similar documents
Differential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow

Some modelling aspects for the Matlab implementation of MMA

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

A New Evolutionary Computation Based Approach for Learning Bayesian Network

An Improved multiple fractal algorithm

APPLICATION OF RBF NEURAL NETWORK IMPROVED BY PSO ALGORITHM IN FAULT DIAGNOSIS

The Minimum Universal Cost Flow in an Infeasible Flow Network

MMA and GCMMA two methods for nonlinear optimization

Global Optimization Using Hybrid Approach

An improved multi-objective evolutionary algorithm based on point of reference

Markov Chain Monte Carlo Lecture 6

Kernel Methods and SVMs Extension

An Extended Hybrid Genetic Algorithm for Exploring a Large Search Space

ECE559VV Project Report

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems

Transient Stability Constrained Optimal Power Flow Using Improved Particle Swarm Optimization

A Study on Improved Cockroach Swarm Optimization Algorithm

Solving Nonlinear Differential Equations by a Neural Network Method

Research on Route guidance of logistic scheduling problem under fuzzy time window

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Errors for Linear Systems

Chapter Newton s Method

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

A Hybrid Co-evolutionary Particle Swarm Optimization Algorithm for Solving Constrained Engineering Design Problems

Thin-Walled Structures Group

A Short Term Forecasting Method for Wind Power Generation System based on BP Neural Networks

Wavelet chaotic neural networks and their application to continuous function optimization

Lecture Notes on Linear Regression

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods

A Novel Hybrid Bat Algorithm for the Multilevel Thresholding Medical Image Segmentation

A Network Intrusion Detection Method Based on Improved K-means Algorithm

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Optimal Placement and Sizing of DGs in the Distribution System for Loss Minimization and Voltage Stability Improvement using CABC

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Module 9. Lecture 6. Duality in Assignment Problems

Economic dispatch solution using efficient heuristic search approach

Optimal Solution to the Problem of Balanced Academic Curriculum Problem Using Tabu Search

Comparative Analysis of SPSO and PSO to Optimal Power Flow Solutions

Assortment Optimization under MNL

A new Approach for Solving Linear Ordinary Differential Equations

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

AN EFFICIENT METHOD BASED ON ABC FOR OPTIMAL MULTILEVEL THRESHOLDING *

Evolutionary Computational Techniques to Solve Economic Load Dispatch Problem Considering Generator Operating Constraints

Global Sensitivity. Tuesday 20 th February, 2018

Design of College Discrete Mathematics Based on Particle Swarm Optimization. Jiedong Chen1, a

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

A self-adaptive firefly algorithm for structural damage detection

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

Solving Design of Pressure Vessel Engineering Problem Using a Fruit Fly Optimization Algorithm

Newton s Method for One - Dimensional Optimization - Theory

Modified Seeker Optimization Algorithm for Unconstrained Optimization Problems

Note 10. Modeling and Simulation of Dynamic Systems

A Novel Evolutionary Algorithm for Capacitor Placement in Distribution Systems

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD

829. An adaptive method for inertia force identification in cantilever under moving mass

SOLVING CAPACITATED VEHICLE ROUTING PROBLEMS WITH TIME WINDOWS BY GOAL PROGRAMMING APPROACH

A Multi-modulus Blind Equalization Algorithm Based on Memetic Algorithm Guo Yecai 1, 2, a, Wu Xing 1, Zhang Miaoqing 1

MODIFIED PARTICLE SWARM OPTIMIZATION FOR OPTIMIZATION PROBLEMS

Linear Feature Engineering 11

On the Multicriteria Integer Network Flow Problem

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Week 5: Neural Networks

Orientation Model of Elite Education and Mass Education

High resolution entropy stable scheme for shallow water equations

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function

An Improved Particle Swarm Optimization Algorithm based on Membrane Structure

Appendix B: Resampling Algorithms

Multi-Robot Formation Control Based on Leader-Follower Optimized by the IGA

A Modified Approach for Continuation Power Flow

Finding Dense Subgraphs in G(n, 1/2)

TEACHING-LEARNING-BASED OPTIMIZATION ALGORITHM FOR SHAPE AND SIZE OPTIMIZATION OF TRUSS STRUCTURES WITH DYNAMIC FREQUENCY CONSTRAINTS *

EEE 241: Linear Systems

Linear Regression Analysis: Terminology and Notation

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Operating conditions of a mine fan under conditions of variable resistance

Fixed point method and its improvement for the system of Volterra-Fredholm integral equations of the second kind

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

Chapter 2 Real-Coded Adaptive Range Genetic Algorithm

A Hybrid Variational Iteration Method for Blasius Equation

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM

Inexact Newton Methods for Inverse Eigenvalue Problems

An Admission Control Algorithm in Cloud Computing Systems

Chapter 2 A Class of Robust Solution for Linear Bilevel Programming

Adaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays *

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Multilayer Perceptrons and Backpropagation. Perceptrons. Recap: Perceptrons. Informatics 1 CG: Lecture 6. Mirella Lapata

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

An Adaptive Learning Particle Swarm Optimizer for Function Optimization

An Optimization Algorithm Based on Binary Difference and Gravitational Evolution

Complement of Type-2 Fuzzy Shortest Path Using Possibility Measure

Chapter - 2. Distribution System Power Flow Analysis

Feature Selection in Multi-instance Learning

Lagrange Multipliers Kernel Trick

Transcription:

Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute of Technology, Harbn, Chna Northeast Agrcultural, Harbn, Chna 900@qq.com, 0576986@qq.com, Konglele979@hotmal.com, Haolangq6@6.com Abstract. Ths paper presents an adaptve drecton strategy(ads)to mprove the searchng ablty for the TLBO algorthm. The mproved algorthm s tested through searchng the optmal ponts for a few typcal testng functons. The testng result shows that the mproved TLBO algorthm could obtan better optmal solutons n shorter tme. Compared to the normal TLBO algorthm, the stablty and effectveness of the mproved algorthm are ncreased greatly. Keywords: Heurstc algorthm; Teachng-learnng-based optmzaton algorthm; Adaptve drecton strategy; Nonlnear optmzaton Introducton Many real lfe problems could be modeled as nonlnear mathematcal models or global optmzaton models as equaton (): max f ( x, x,, x ) n subect to () mn The heurstc algorthms nclude genetc algorthm (GA), partcle swarm optmzaton (PSO), colony algorthm (ACA), artfcal bee colony (ABC) algorthm and frework exploson optmzaton (FEO) algorthm has been used wdely to solve these problems [-5]. In 0 R.V.Rao proposed the TLBO algorthm based on the populaton heurstc algorthm. Ths algorthm has less parameters to be dentfed and performs well n solvng the optmzaton problem for the real contnuous functons [6-8]. Basc TLBO TLBO s nclude two phases: the frst phase s the teacher phase, n whch the students gan knowledge from the teachers; the second phase s the learner phase n whch the students gan knowledge through communcaton wth other students [9 ]. ISSN: 87- ASTL Copyrght 06 SERSC

Advanced Scence and Technology Letters Vol. (AST 06). Teacher Phase Frst, dentfy the learnng ablty of each student, or D fference - Mean as shown n equaton (), Dfference - Mean r ( Best, TF M ) () n whch r s a random number between (0,). The r dentfes the learnng degree. TF s the teachng affectng factor, t denotes the how much does the teachng nfluencng the average value of the group. The value of TF s ether or. The equaton to dentfy the TF s shown as equaton (), T F round[ rand(0,)( )] () Dfference _ Mean Upon the, the updatng rule for the teacher phase s shown as equaton (), new, old, Dfference _ Mean () old where, s the th orgnal ndvdual n the populaton, new, s the new correspondng updated ndvdual. If, old has a better ftness value than,, new then, old wll replace,.. Leaner Phase For each ndvdual the ftness value. If, randomly choose another ndvdual s better than ( )and compare, then update the value followng equaton (5), r( ) (5) new, Otherwse, update the value followng equaton (6) r( ) (6) new, Smlar to the teacher phase, f new, s better than, then replace by new,. Repeat the procedure for the entre group to update the populaton once more. ADS Frst fnd the nfluence factor of the communcaton, as shown n Eqn (7) f ( ) (7) f ( ) f ( ) 06 Copyrght 06 SERSC

Advanced Scence and Technology Letters Vol. (AST 06) where f ( ) s the ftness value of the ndvdual. current generaton. by Eqn (8) and (9). s the teacher of the s the th ndvdual of the populaton. The teacher s updated ( ) (8) (), () ( ) (9) (),,, If the obtaned ndvdual has a better ftness value than, replace by the obtaned ndvdual. () () The relatonshp between,,, and s shown n Fgure. () (),,, Fg.. The locaton of the updated teacher Suppose the varables mentoned above locate near one of the optmal value, and the ftness value functon of the updated teacher s shown n Fgure, then t s lkely () to obtan a better teacher from and., (), Fg.. The relatonshp between the updated teacher and the orgnal teacher Calculate the nfluencng factor, as shown n Eqn (0) f ( ) (0) f ( ) f ( ) where, f ( ) s the ftness value of. The updatng of an ndvdual s dvded nto two cases, f and () s a better soluton than, the updatng rule s shown n Eqn () ) () () new, ( () ( ) () () new, new, Copyrght 06 SERSC 07

Advanced Scence and Technology Letters Vol. (AST 06) Otherwse, follow Eqn () and () ( ) () () new, () ( ) () () new, new, If the obtaned soluton s better than, then replace wth the new value. The evoluton process of the mproved TLBO s llustrated as below. Frst, create an optmzaton model, and ntate the correspondng parameters. Then randomly generate the ntal populaton followed by updatng the populaton. Repeat the updatng process untl populaton satsfes the endng condton. The evoluton process of the mproved TLBO s shown n Fgure. Begn Create the optmzaton model Defne parameters Generate ntal populaton Calculate ndvdual s ftness Confrm the teacher N Execute teacher phase ADS for teacher phase Execute learner phase adopted ADS If meet the stop condton Y End Fg.. The flowchart of the ADS-TLBO algorthm 08 Copyrght 06 SERSC

Advanced Scence and Technology Letters Vol. (AST 06). Testng and analyss In ths part, the performance of the TLBO s tested by 5 dfferent benchmark testng functon. Functon : 5 mn f cos x 0.5( x.5) ( x 0.800) -0 x, x 0 (5) Ths s a functon wth multple optmal values, 760 local optmal values and one * global optmal value. The optmal soluton s x (.5, 0.800), wth obectve functon value f ( x * ) 86. 709. The searchng process s easly trapped n the local optmal soluton -86.00. Functon : a max f x b x (6) a, b 0.05, 5. x, x 5. The global optmal soluton for ths functon s x * (0,0),wth maxmum value f ( x * ) 600 Functon : mn f ( x) 500 x, x 500 x sn x (7) The optmal soluton s x * (0.9687,0.9687),wth mnmum value f ( x * ) 87.9658. Functon : mn f ( x) 5 S T 6 8 0 x x x x 8x x x x 8x x x 5 6 0 0; g 0; g 0; g (,,,9,) x x x 7 x x x x 0 0 x 5 x x x 5 7 x 0 0; 0 0; 0 0; ( x) 8x ( x) x 9 ( x) x 0 x x x 5 8 0; x x 0 9 0; x 0; 00 ( 0,,) (8) Copyrght 06 SERSC 09

Advanced Scence and Technology Letters Vol. (AST 06) The feasble regon conssts of only 0.000% of the searchng regon. In the optmal soluton pont, there are 6 nequalty functon lmts the searchng. The optmal soluton s x * (,,,,,,,,,,,,, ),wth obectve functon value f ( x * ) 5 Functon 5: 00 x 5 x 5 x 5 max f ( x) 00 S. T. x p x q x r 0.065 0 (9) 0 x 0,, p, q, r,,, 9 The feasble searchng regon conssts of 9 ndependent spheres. The condton for pont (x, x, x) to be feasble soluton s satsfyng any of the constrans correspondng to p, q, r. The optmal soluton s x (5,5,5 ) wth f ( x * ).The populaton sze s chosen to be 50, the maxmum evoluton tme s set to be 00. The testng result of the algorthm s shown n Table. Table. The testng result of the testng functon Functon Method Best Mean Worst Ave tmes/s Ave Gen /tmes f f f f f5 B-TLBO -86.709-85.0-8.750.00 97.8 ADS-TLBO -86.709-86.79-86.05.008 8.6 B-TLBO 600.0000-596.90 577.9 0.85 7.67 ADS-TLBO 600.0000 600.0000 600.0000 0.0907 6.09 B-TLBO -87.9658-87.906-87.655.09 67.50 ADS-TLBO -87.9658-87.9658-87.9658 0.586.9 B-TLBO -.986-7.767 -.60.68 9. ADS-TLBO -5.0000 -.986 -.076.79 05.79 B-TLBO -.0000-0.9955-0.9668.5 89.5 ADS-TLBO -.0000 -.0000-0.9999 0.690 5.5 From Table, ADS-TLBO algorthm has hgher effcency n solvng the constraned and unconstraned optmzaton problem and s more stable. 5 Concluson Ths paper presents an mproved TLBO algorthm for solvng nonlnear optmzaton problem. The ntroducng of self-learnng process of the teacher greatly mproves the searchng effcency. The proposed mproved methods ncrease the searchng and 0 Copyrght 06 SERSC

Advanced Scence and Technology Letters Vol. (AST 06) updatng ablty of the algorthm. The testng result wth the benchmark testng functon, t can be seen that the mproved algorthm has satsfactory result for fndng the optmal value of dfferent types of functon. It shows that the mproved ADS-TLBO s feasble and effectve. References. Deep, K., Thakur, M.: A new mutaton operator for real coded genetc algorthms, Appled Mathematcs and Computaton 9 (007) 0. Goldberg, D.: Genetc algorthms n search, optmzaton, and machne learnng, Addson-Wesley, New York (989). Back, T.: Evolutonary algorthms n theory and practce, Oxford Unversty Press (996). Kennedy, V., Eberhart, R.: Partcle swarm optmzaton. In: Proceedngs of the IEEE Internatonal Conference on Neural Networks. 995. p. 9 8 5. Clerc, M.: Partcle swarm optmzaton, ISTE Publshng Company (006) 6. Karaboga, D.: An dea based on honey bee swarm for numercal optmzaton. Techncal report-tr06. ErcyesUnversty, Engneerng Faculty, Computer Engneerng Department. 005 7. Basturk, B., Karaboga, D.: An artfcal bee colony (ABC) algorthm for numerc functon optmzaton. In: IEEE Swarm Intellgence Symposum. 006 8. Karaboga, D., Basturk, B.: On the performance of artfcal bee colony (ABC) algorthm, Appled Soft Computng, 8 (008), pp. 687 697 9. Dorgo, M., Stutzle, T.: Ant colony optmzaton, MIT Press (00) Copyrght 06 SERSC