Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Similar documents
Markov Chain Monte Carlo Lecture 6

The Study of Teaching-learning-based Optimization Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Chapter 2 Real-Coded Adaptive Range Genetic Algorithm

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

arxiv: v1 [math.oc] 3 Aug 2010

Lecture Notes on Linear Regression

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

Capacitor Placement In Distribution Systems Using Genetic Algorithms and Tabu Search

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems

Solving Nonlinear Differential Equations by a Neural Network Method

A New Evolutionary Computation Based Approach for Learning Bayesian Network

Chapter Newton s Method

Thin-Walled Structures Group

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods

Some modelling aspects for the Matlab implementation of MMA

Global Optimization Using Hybrid Approach

An Interactive Optimisation Tool for Allocation Problems

Boostrapaggregating (Bagging)

Differential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow

HYBRID FUZZY MULTI-OBJECTIVE EVOLUTIONARY ALGORITHM: A NOVEL PARETO-OPTIMIZATION TECHNIQUE

Generalized Linear Methods

An improved multi-objective evolutionary algorithm based on point of reference

A Hybrid Variational Iteration Method for Blasius Equation

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Appendix B: Resampling Algorithms

Modified Seeker Optimization Algorithm for Unconstrained Optimization Problems

MMA and GCMMA two methods for nonlinear optimization

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

A DNA Coding Scheme for Searching Stable Solutions

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Kernel Methods and SVMs Extension

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

Using the estimated penetrances to determine the range of the underlying genetic model in casecontrol

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

THEORY OF GENETIC ALGORITHMS WITH α-selection. André Neubauer

DESIGN OF NONLINEAR FRAMED STRUCTURES USING GENETIC OPTIMIZATION

Chapter - 2. Distribution System Power Flow Analysis

On the Multicriteria Integer Network Flow Problem

ECONOMIC POWER DISPATCH USING THE COMBINATION OF TWO GENETIC ALGORITHMS

GENETIC ALGORITHM APPLICATION IN ECONOMIC LOAD DISTRIBUTION

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

MODIFIED PREDATOR-PREY (MPP) ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION

Cantilever Beam and Torsion Rod Design Optimization Using Genetic Algorithm

Multi-agent system based on self-adaptive differential evolution for solving dynamic optimization problems

10.34 Numerical Methods Applied to Chemical Engineering Fall Homework #3: Systems of Nonlinear Equations and Optimization

Computing Correlated Equilibria in Multi-Player Games

Irene Hepzibah.R 1 and Vidhya.R 2

SIMULTANEOUS TUNING OF POWER SYSTEM STABILIZER PARAMETERS FOR MULTIMACHINE SYSTEM

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Self-Adaptive Simulated Binary Crossover for Real-Parameter Optimization

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced,

An Integrated Asset Allocation and Path Planning Method to to Search for a Moving Target in in a Dynamic Environment

Week 5: Neural Networks

A discrete differential evolution algorithm for multi-objective permutation flowshop scheduling

Multi-Objective Evolutionary Programming for Economic Emission Dispatch Problem

Lecture 10 Support Vector Machines II

Evolutionary Algorithm in Identification of Stochastic Parameters of Laminates

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

Statistics II Final Exam 26/6/18

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

The Minimum Universal Cost Flow in an Infeasible Flow Network

Lecture 20: November 7

ECE559VV Project Report

A Robust Method for Calculating the Correlation Coefficient

An Extended Hybrid Genetic Algorithm for Exploring a Large Search Space

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

Elitist Reconstruction Genetic Algorithm Based on Markov Random Field for Magnetic Resonance Image Segmentation

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

COS 521: Advanced Algorithms Game Theory and Linear Programming

Mean Field / Variational Approximations

Journal of Applied Research and Technology ISSN: Centro de Ciencias Aplicadas y Desarrollo Tecnológico.

BALANCING OF U-SHAPED ASSEMBLY LINE

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

VQ widely used in coding speech, image, and video

Utilizing cumulative population distribution information in differential evolution

The Order Relation and Trace Inequalities for. Hermitian Operators

International Journal of Mathematical Archive-3(3), 2012, Page: Available online through ISSN

Maximizing Overlap of Large Primary Sampling Units in Repeated Sampling: A comparison of Ernst s Method with Ohlsson s Method

Multi-Robot Formation Control Based on Leader-Follower Optimized by the IGA

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM

Time-Varying Systems and Computations Lecture 6

The optimal solution prediction for genetic and distribution building algorithms with binary representation

An Improved Genetic Algorithm with Average-Bound Crossover and Wavelet Mutation Operations

THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS

Process Optimization by Soft Computing and Its Application to a Wire Bonding Problem

Module 9. Lecture 6. Duality in Assignment Problems

An Adaptive Learning Particle Swarm Optimizer for Function Optimization

THE SUMMATION NOTATION Ʃ

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

A Novel Evolutionary Algorithm for Capacitor Placement in Distribution Systems

High resolution entropy stable scheme for shallow water equations

Research Article An Enhanced Differential Evolution with Elite Chaotic Local Search

arxiv: v3 [cs.ne] 5 Jun 2013

Transcription:

Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test Functon Study M. Andalb Sahnehsarae, M. J. Mahmoodabad, S. Entezar Sahnehsarae Abstract In ths paper, frst a modfed multple-crossover genetc algorthm s proposed. Used operators such as reproducton, crossover and mutaton are ntroduced completely. It s selected some test functons to challenge the ablty of ths algorthm. All test functons are sngle-objectve. Numercal results are presented. The obtaned numercal results are compared wth the results related to three other algorthms appled on the same test functons to valdate the proposed algorthm. Keywords genetc algorthm, multple-crossover, sngleobjectve optmzaton, test functons. I. INTRODUCTION ENETIC Algorthm (GA that belongs to the group of Gevolutonary algorthms s one of the most powerful tools to solve optmzaton problems. In two recent decades, many researchers have been nterested n usng of GA n dfferent felds []. Ths nterest s because of two man advantages avalable n GA n comparson wth other old and tradtonal optmzaton algorthms []. The advantages consst of applyng optmzaton varables n coded forms, and the ablty of GA n the use of a set of solutons, named populaton. After dentfyng the functon that must be optmzed and t s named cost or objectve functon, GA s started by specfyng a set of solutons, named ntal populaton. Each soluton n populaton s called a chromosome. Then, t s assgned a ftness value to each chromosome wth respect to the objectve functon. Now, GA by use of three operators named reproducton, crossover, and mutaton tres to produce a new and better populaton, of course. Ths loop s repeated to obtan optmal solutons. Hence, a GA can end after some certan teraton as the stoppng crteron. Each one of these three operators can be performed n several dfferent methods. Morteza Andalb Sahnehsarae was wth the Unversty of Gulan, Rasht, Iran. He s now wth the Natonal Iranan Gas Company (NIGC, Ramsar, Iran (correspondng author to provde phone: +8665; fax: +855807; e-mal: morteza_andalb@yahoo.com. Mohammad Javad Mahmoodabad, s wth Unversty of Gulan, Rasht, Iran (e-mal: mahmoodabad@gulan.ac.r. Samaneh Entezar Sahnehsarae s wth the Imam Sajjad Hosptal, Ramsar, Iran (e-mal: entezar.hosptal@yahoo.com. For example, the reproducton operator can be appled n some dfferent approaches that the famous ones are roulette wheel as well as tournament method. Every GA can use an especal combnaton of dfferent operators. But the truth of the matter s that an especal GA never has an absolute domnance relatve to other GAs. All known crossover operators use two chromosomes. In ths work, t has been consdered the ablty of a GA wth the crossover operator that uses three chromosomes. Frst, ths method has used by Lung Chen and Chang [, ]. They appled ths novel crossover operator n ther GA to solve an especal problem. The present paper s gong to challenge and consder the ablty of the proposed GA n solvng of dfferent sngle-objectve problems. Hence, one of the best procedures for ths consderaton s the use of some famous test functons. Here, well-known test functons that all belong to the class of sngle-objectve functons, are selected [5]. Some these functons are unmodal and the others are multmodal. A functon s unmodal f there be exactly one optmum pont. For a multmodal functon, there are some local optmum ponts n addton to one global optmum pont. Furthermore, t s presented three algorthms named, Fast Evolutonary Programmng (FEP, Classc Evolutonary Programmng (CEP [5] and multple-crossover GA [, ]. Each of these three algorthms s run for the same test functons. The obtaned numercal results are compared to evaluate the performance of the proposed method. II. A MODIFIED MULTIPLE-CROSSOVER GA The man dea of evolutonary algorthms was brought up by Rechenberg n 60 s. GA s a branch of these algorthms. John Holland mooted GA n 75 wth nspraton of Darwn s theory about the survval of fttest [6]. Hence, the structure of GA s based on genes and chromosomes. In general, GA s a method to optmze sngle-objectve or multobjectve and constraned or non-constraned problems. As sad n ntroducton, GA s started wth a set of solutons that s selected randomly. Ths set of solutons s called ntal populaton. In general, such set of solutons n every stage of GA s called a populaton. Each soluton n a populaton s a chromosome or an ndvdual. The number of chromosomes n a populaton state populaton sze. One of abltes of GA s to

Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE work wth coded varables. There are several methods for encodng n GA that bnary encodng s the most common among them. In ths method, after producng the ntal populaton, GA must encode all parameters as bnary dgts. But n ths study, t has been used real-coded GA. Now the am of GA s to produce a better populaton n comparson wth before populaton. Ths procedure s done wth respect to ftness value assgned to each chromosome. Ftness value s usually obtaned from puttng each chromosome nto the objectve functon. An objectve functon s the functon that must be optmzed. GA wll succeed to produce a new generaton after performng three stages. Each of stages s done by an especal operator. They are reproducton, crossover, and mutaton. Fg. shows a flow dagram of a realcoded GA. It s descrbed the detals of three used genetc operators n ths study below. smpler the tournament method as well as beng more effcent n convergence than roulette wheel method, t s used tournament mechansm as a reproducton operator. In selecton by tournament method, two chromosomes are selected randomly to wn accordng to ther ftness values. The chromosome wth better ftness value wll be duplcated nto the populaton and the chromosome wth worse ftness value wll be dscarded from the populaton. Ths operaton s done for p r N chromosomes, where p and N are the probablty r of reproducton and populaton sze, respectvely. At the end of selecton operaton, although there wll be a new populaton of better chromosomes than prevous populaton, but t has not produced a new generaton yet. B. Modfed Multple-crossover A tradtonal crossover operator contans only two chromosomes. A novel crossover operator has been proposed n []. Ths novel crossover uses three chromosomes. It has been called multple-crossover. Here, t s presented a modfed multple-crossover wth some changes n ponted multple-crossover formula. Let Γ, Γ, and Γ represent three chromosomes that are selected from the parent populaton. If Γ has the smallest ftness value among ftness values of these three chromosomes the formula of the modfed multple-crossover proposed s stated below., Γ + ( Γ - Γ Γ ( Γ - Γ Γ ( Γ - Γ Γ Γ ρλ - Γ ρ λ - Γ ρλ - Γ +, (. Γ + Fg. Flow dagram of a real-coded GA A. Reproducton Reproducton that s called selecton as well, s usually the frst operaton that s appled on the populaton. Reproducton operaton selects the better ones from a populaton to form a new populaton named parents. There are several selecton mechansms. Two mechansms named roulette wheel and tournament methods are more famous. On account of beng Where ρ ρ,and [0, ] are random values and, ρ λ = Γ Γ, =,, p c. The sgn. denotes the absolute ( N value. It s appled chromosomes to the crossover operaton n ths study, where parameter p s referred to c probablty of crossover. After performng crossover operaton, t s created some new chromosomes or ndvduals named offsprng. But t has not been produced a new generaton yet. C. 7BNew Mutaton After reproducton and crossover, there s a new populaton wth the same amount of chromosomes. Some have been drectly coped and the others have produced by the new multple-crossover. In order to ensure that the chromosomes are not all exactly the same, t must be allowed for a small chance of mutaton. Snce the used GA n ths paper s a realcoded type, t s presented below formula to compute the mutaton for a randomly selected chromosome Γ. ( Γ Γ + s. Φ.

Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Where both s and Φ are vectors ( n, and n s the number of the dmensons of each chromosome. In the other hand, s s the chromosome that has the smallest ftness value among all chromosomes n the current populaton, and Φ s defned as rand (,n where returns an - by -n matrx contanng pseudorandom values drawn from the standard unform dstrbuton on the open nterval (0,. Fnally, the operator. multples the correspondng members from vectors s and Φ. Lke what was mentoned for reproducton and crossover, p m N chromosomes mutate randomly durng the mutaton procedure, where p m s the probablty of mutaton. After performng three operators, reproducton, crossover, and mutaton by the algorthm, t can be clamed to have a new generaton. Ths loop s so terated untl the algorthm stoppng crteron become satsfed. In ths work, t s wanted algorthm to be stopped after producng a certan number of generatons (G. III. OPTIMIZATION In the most general terms, optmzaton theory s a body of mathematcal results and numercal methods for fndng and dentfyng the best canddate from a collecton of alternatves wthout havng to explctly enumerate and evaluate all possble alternatves [7]. Optmal soluton of an optmzaton problem mnmzes or maxmzes the objectve functon(s. A. Sngle-objectve problems An optmzaton problem s dvded to two classes of sngleobjectve and mult objectve problems wth the pont of the number of objectve functons. Here, t s presented some famous test functons to challenge the ablty of proposed algorthm. All these test functons are sngle-objectve that must be mnmzed. Some essental nformaton about the test functons has been summarzed n Table I. IV. NUMERICAL RESULTS In ths secton, performance of the proposed GA s evaluated. Hence, the results of 50 ndependent runs of the proposed algorthm for test functons are presented. These results are compared wth the smlar results related to three algorthms FEP, CEP and multple- crossover GA. Table II shows ths comparson. The results have been llustrated under the ttles of Mean Best and Std Dev for each method. Mean Best ndcates the mean of the best solutons after 50 ndependent runs and Std Dev stands for the standard devaton. For ease n comparson affar, better results have become boldface for each functon separately. The results related to both FEP and CEP mentoned here are the same exactly comng n [5]. To perform multple-crossover GA and new multple-crossover GA, the proposed method, t has been supposed that p r = 0. 6, p c = 0., p m = 0., N = 00, and G = 00. In the most cases, an optmzaton problem s summarzed to a mnmzaton problem wthout losng the publcty of the problem. TABLE I SINGLE-OBJECTIVE TEST FUNCTIONS Name Comment Dmenson (n Generaton Intal & Search Range Sphere ( f Unmodal 500 [-00,00] n Schwefel. ( f Unmodal 000 [-0,0] n Schwefel. ( f Unmodal 5000 [-00,00] n Schwefel. ( f Unmodal 5000 [-00,00] n Rosenbrock ( f5 Unmodal 0000 [-,] n Step ( f6 Unmodal dscontnuous 500 [-00,00] n Quartc ( f 7 Unmodal nosy 00 [-.8,.8] n Rastrgn ( f8 Multmodal 5000 [-5.,5.] n Ackley ( f Multmodal 500 [-,] n Grewank ( f0 Multmodal 000 [-600,600] n Camel-Back ( f Multmodal 00 [-5,5] n Brann ( f Multmodal 00 [-5,0] [0,5] Golsten-Prce ( f Multmodal 00 [-,] n 5

Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE As t s observed, the proposed method performs much better than three other methods on functons f - f, f and f 0. For step functon f 6, both FEP and proposed method present the best results. For three functons f 5, f and 7 f 8, FEP performs better than others. For functons f and f, there s not a sensble domnance among the algorthms except n ther standard devatons.fnally, for functon f the obtaned results show that three algorthms CEP, multplecrossover GA and modfed multple-crossover GA present the same results for the Mean Best and better than FEP, but CEP has better Std Dev. Accordng to presented results, the proposed GA performs much better than three other methods on all unmodal test functons except two. And t s very good on all multmodal test functons except one. Hence, the proposed modfed multple-crossover GA can be ntroduced as an acceptable method to solve many sngle-objectve optmzaton problems. Improvement n multple-crossover operator s the man reason of beng better the proposed method than multplecrossover GA, although t has been created a slght change n mutaton, too. Thus, the selected name, modfed multplecrossover GA, for ths algorthm can be proper. V. CONCLUSION Ths paper frst proposes a modfed multple-crossover GA that has been mproved on ts multple-crossover and mutaton operators relatve to multple-crossover GA. Then, the performance of ths proposed GA s evaluated on a number of test functons. The obtaned results are compared wth the results of three other algorthms. The comparson shows that the proposed algorthm has acceptable performance and performs much better on the most test functons than three other algorthms. TABLE II NUMERICAL RESULTS FEP CEP Multple Crossover Proposed Method Mean Best Std Dev Mean Best Std Dev Mean Best Std Dev Mean Best Std Dev f 5.7 0 -. 0 -. 0-5. 0-5. 0-5.6 0-5.6 0-5 5. 0-5 f 8. 0-7.7 0 -.6 0 -.7 0-5.0 0 -.6 0-5. 0 -. 0 - f.6 0 -. 0-5.0 0-6.6 0 -.0 0 -. 0 -. 0-0 7.6 0-0 f 0. 0.5.0. 8.0.0 6. 0-5. 0 - f 5 5.06 5.87 6.7.6 65.8 66. 0.7 0.5 f 6 0 0 577.76 5.76 0.66. 0 0 f 7 7.6 0 -.6 0 -.8 0-6. 0-0..7 0-0.5 8. 0 - f 8.6 0 -. 0-8.0. 5.87 8.65 0.8 8.6 f.8 0 -. 0 -..8.5.5. 0-8.7 0-8 f 0.6 0 -. 0-8.6 0-0..8 0 -. 0 -.0 0 -. 0 - f -.0. 0-7 -.0. 0-7 -.0 6. 0 - -.0 5.7 0-7 f 0.8.5 0-7 0.8.5 0-7 0.8. 0-8 0.8.8 0 - f.0 0..00 0.00. 0-7.00. 0-5 6

Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE APPENDIX BENCHMARK FUNCTIONS A. Sphere f( = x, -00 x 00 = mn( f = f(0,...,0 = 0. B. Schwefel s. f( = x + x, -0 x 0 = = mn( f = f(0,...,0 = 0. C. Schwefel s. f( = (, -00 00 = x j x j = mn( f D. Schwefel s. f ( = max x,, E. Rosenbrock { } mn( f -00 x ( x - x + ( x - 00 f5( = 00 +, - x = mn( f5 = f5(,..., = 0. F. F. Step f ( = x + 0.5, -00 x 00 6 = G. Quartc ( mn( f f7 ( = x = H. Rastrgn f8( = ( x = mn( f 6 mn( f 8 7-5. x 6 + random[0,, -.8 x 7 5. -0 cos(πx + 0 8.8 I. Ackley - f ( = -0 exp (-0. - exp ( = x, cos(πx + 0 + e mn( f = x J. Grewank x f0( = - cos( 000 x + = = - 600 x 600 mn( f 0 0 K. Camel-Back 6 f( = x -.x + x + xx - x + x - 5 x 5 xmn = (0.088, - 0.76, (0.088, - 0.76 mn( f =.0685. L. Brann 5. 5 f( = ( x - x + x - 6 π π + 0 (- cos x + 0 8π - 5 x 0, 0 x 5 xmn = (-.,.75, (.,.75, (.5,.5 mn( f = 0.8. M. Goldsten-Prce f ( = [+ ( x + x + ( -x + 6x x + x ] [ + (x + x - x -x (8 - x + x + 8x - 6xx + 7x ] - x, mn( f (0, =. REFERENCES [] Mtchell, M.,. An ntroducton to genetc algorthms. 5th ed., The MIT Press, Massachusetts. [] Huang, Y.P., and Huang, C.H., 7. Real-valued genetc algorthm for fuzzy grey predcton system. Fuzzy Sets and Systems, 87, pp. 65-76. [] Chang, W.D., 007. A multple-crossover genetc approach to multvarable PID controllers tunng. Expert Systams wth Applcatons,, pp. 60-66. [] Chen, J.L., and Chang, W.D., 00. Feedback lnearzaton control of a two-lnk robot usng a mult-crossover genetc algorthm. Expert Systems wth Applcatons, 6, pp. 5-5. [5] Yao, X., Lu, Y., and Ln, G., July,. Evolutonary programmng made faster. IEEE Transactons on Evolutonary Computaton, Vol., no., pp. 8-0. [6] Holland, J.,75. Adaptaton n Natural and Artfcal Systems. Unversty of Mchgan Press, Ann Arbor, Mchgan. 7

Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE [7] Ravndran, A., Ragsdell, K.M., and Reklats, G.V., 006. Engneerng Optmzaton: Methods and Applcatons. nd ed., Wley, Hoboken, New Jersey. 8