Performance Assessment of Generalized Differential Evolution 3 (GDE3) with a Given Set of Problems

Size: px
Start display at page:

Download "Performance Assessment of Generalized Differential Evolution 3 (GDE3) with a Given Set of Problems"

Transcription

1 Perormance Assessment o Generalized Dierential Evolution (GDE) with a Given Set o Problems Saku Kukkonen, Student Member, IEEE and Jouni Lampinen Abstract This paper presents results or the CEC 007 Special Session on Perormance Assessment o Multi-Objective Optimization Algorithms where Generalized Dierential Evolution (GDE) has been used to solve a given set o test problems. The set consist o 9 problems having two, three, or ive objectives. Problems have dierent properties in the sense o separability, modality, and geometry o the Pareto-ront According to the results, a near optimal set o solutions was ound in the majority o the problems. Rotated problems given caused more diiculty than the other problems. Perormance metrics indicate that obtained approximation sets were even better than provided reerence sets or many problems. I. INTRODUCTION In this paper, a general purpose Evolutionary Algorithm (EA) called Generalized Dierential Evolution (GDE) [], [] with a diversity maintenance technique suited or manyobjective problems [] has been used to solve multi-objective problems deined or the CEC 007 Special Session on Perormance Assessment o Multi-Objective Optimization Algorithms. The problems have been deined in [], where also evaluation criteria are given. The problems have two, three, or ive objectives, and the number o decision variables varies rom to 0. Diiculty o unctions vary in means o separability, modality, and geometry o the Pareto-ront. Some o the problems pose also diiculty o loosing diversity among decision variables. This paper continues with the ollowing parts: Multiobjective optimization with constraints is briely deined in Section II. Section III describes the multi-objective optimization method used to solve the given set o problems. Section IV describes experiments and inally conclusions are given in Section V. II. MULTI-OBJECTIVE OPTIMIZATION WITH CONSTRAINTS A multi-objective optimization problem (MOOP) with constraints can be presented in the orm [, p. 7]: minimize { ( x), ( x),..., M ( x)} subject to (g ( x),g ( x),...,g K ( x)) T 0. Thus, there are M unctions to be optimized and K constraint unctions. The objective o Pareto-optimization is to ind an approximation o the Pareto-ront, i.e., to ind a set o solutions that are not dominated by any other solution. Weak dominance relation between two vectors is deined such a way that x The authors are with the Department o Inormation Technology, Lappeenranta University o Technology, P.O. Box 0, FIN-8 Lappeenranta, Finland; saku.kukkonen@lut.i. weakly dominates x, i.e., x x i i : i ( x ) i ( x ). Dominance relation between two vectors is deined such a way that x dominates x, i.e., x x i x x i : i ( x ) < i ( x ). The dominance relationship can be extended to take into consideration constraint values and objective values at the same time. A constraint-domination c is deined in this paper so that x constraint-dominates x, i.e., x c x i any o the ollowing conditions is true []: x and x are ineasible and x dominates x in constraint unction violation space. x is easible and x is not. x and x are easible and x dominates x in objective unction space. The deinition or weak constraint-domination c is analogous dominance relation changed to weak dominance in the deinition above. This constraint-domination is a special case o more general concept o having goals and priorities that is presented in [7]. III. OPTIMIZATION METHOD A. Dierential Evolution The Dierential Evolution (DE) algorithm [8], [9] was introduced by Storn and Price in 99. The design principles o DE are simplicity, eiciency, and the use o loating-point encoding instead o binary numbers. As a typical EA, DE has a random initial population that is then improved using selection, mutation, and crossover operations. Several ways exist to determine a stopping criterion or EAs but usually a predeined upper limit (G max ) or the number o generations to be computed provides an appropriate stopping condition. Other control parameters or DE are the crossover control parameter (CR), the mutation actor (F ), and the population size (NP ). In each generation G, DE goes through each D dimensional decision vector x i,g o the population and creates the corresponding trial vector u i,g as ollows [0]: r,r,r {,,...,NP}, (randomly selected, except mutually dierent and dierent rom i) j rand =loor(rand i [0, ) D)+ or(j =;j D; j = j +) { i(rand j [0, ) <CR j = j rand ) u j,i,g = x j,r,g + F (x j,r,g x j,r,g) else u j,i,g = x j,i,g } --0-0/07$.00 c 007 IEEE 9

2 This is the most common DE version, DE/rand//bin. Both CR and F remain ixed during the entire execution o the algorithm. Parameter CR [0, ], which controls the crossover operation, represents the probability that an element or the trial vector is chosen rom a linear combination o three randomly chosen vectors and not rom the old vector x i,g. The condition j = j rand ensures that at least one element o the trial vector is dierent compared to the elements o the old vector. Parameter F is a scaling actor or mutation and its value range is (0, +]. In practice, CR controls rotational invariance o the search, and its small value (e.g., 0.) is practicable with separable problems while larger values (e.g., 0.9) are or non-separable problems. Parameter F controls the speed and robustness o the search, i.e., a lower value or F increases the convergence rate but it also increases the risk o getting stuck into a local optimum. Parameters CR and NP have the similar eect on the convergence rate as F has. Ater the mutation and crossover operations, the trial vector u i,g is compared to the old vector x i,g. I the trial vector has an equal or better objective value, then it replaces the old vector in the next generation. This can be presented as ollows in the case o minimization o an objective [0]: { ui,g i ( u x i,g+ = i,g ) ( x i,g ). x i,g otherwise DE is an elitist method since the best population member is always preserved and the average objective value o the population will never deteriorate. B. Generalized Dierential Evolution The irst version o Generalized Dierential Evolution (GDE) extended DE or constrained multi-objective optimization, and it modiied only the selection rule o the basic DE []. The basic idea in the selection rule o GDE is that the trial vector is selected to replace the old vector in the next generation i it weakly constraint-dominates the old vector. There was no explicit sorting o non-dominated solutions [, pp. ] during the optimization process or any mechanism or maintaining the distribution and extent o solutions. Also, there was no extra repository or nondominated solutions. The second version, GDE, made the selection based on crowdedness when the trial and old vector were easible and non-dominating each other in the objective unction space []. This improved the extent and distribution o the obtained set o solutions but slowed down the convergence o the overall population because it avored isolated solutions ar rom the Pareto-ront until all the solutions were converged near the Pareto-ront. The third and latest version is GDE [], []. Besides the selection, another part o the basic DE has also been modiied. Now, in the case o easible and non-dominating solutions, both vectors are saved or the population o next Notation means that F is larger than 0 and upper limit is in practice around although there is no hard upper limit. generation. Beore continuing to the next generation, the size o the population is reduced using non-dominated sorting and pruning based on diversity preservation. The pruning technique used in the original GDE is based on crowding distance, which provides a good crowding estimation in the case o two objectives. However, crowding distance ails to approximate crowdedness o solutions when the number o objectives is more than two []. Since, the provided problem set in [] consists o problems with more than two objectives, a more general diversity maintenance technique proposed in [] was used. The technique is based on a crowding estimation using the nearest neighbors o solutions in Euclidean sense, and an eicient nearest neighbors search technique. All the GDE versions handle any number o M objectives and any number o K constraints, including the cases where M = 0 (constraint satisaction problem) and K = 0 (unconstrained problem). When M = and K = 0, the versions are identical to the original DE, and this is why they are reerred as Generalized DEs. IV. EXPERIMENTS A. Coniguration GDE and the given problems were implemented in the ANSI-C programming language and compiled with the GCC compiler. The hardware was an ordinary PC with. GHz CPU & GB RAM, and the operating system was Linux. In the case o boundary constraint violations, violating variable values were relected back rom the violated boundary using ollowing rule beore the selection operation o GDE: x (lo) j u j,i,g i u j,i,g <x (lo) j u j,i,g = x (up) j u j,i,g i u j,i,g >x (up), j u j,i,g otherwise where x (lo) j and x (up) j are lower and upper limits respectively or a decision variable x j. B. Parameter Setting Along stopping criterion and size o the population (NP ), GDE has two control parameters (CR and F ) as described in Section III-A, where the eect and ranges o these are also given. As a rule o thumb in single-objective optimization, i nothing is known about the problem in hand then suitable initial control parameter values are CR =0.9 and F =0.9, and NP = D...0 D, where D is the number o decision variables o the problem []. For an easy problem (e.g., moderately multimodal and low dimensional), a small value o NP is suicient but with diicult problems, a large value o NP is recommended in order to avoid stagnation to a local optimum. In general, increase o control parameter values, will also increase the number o unction evaluations (FES) needed. Dependency between NP and FES needed is linear while FES needed increases more rapidly along CR and F []. I values o F and/or NP are too low, search is prone to stagnate to a local optimum (with very low control IEEE Congress on EvolutionaryComputation (CEC 007)

3 parameter values the search converges without the selection pressure). In the case o multi-objective optimization and conlicting objectives, lower control parameter values (e.g., 0.) orcr and F can be used than in single-objective optimization because conlicting objectives already maintain diversity and restrain the search speed. This has been noted in [], [], where the eect o the control parameters has been studied empirically. Also, i the complexity o objectives dier (e.g., as in the case o the ZDT problems [, pp. 0]), then a high value or CR might lead to premature convergence with respect to one objective compared to another. The value o NP can be selected in same way as in single-objective optimization or it can be selected according to a desired approximation set size o the Pareto-optimal ront. To keep the setup as simple as possible, same set o control parameter values were used or all the problems. It would had been also possible to apply some kind o dependency on the number o objectives and/or the number o decision variables. As well, it would had been possible to use some control parameter adaptation strategy as in [7] [9]. However, these were not applied, because then it would had been unclear, how parameter adjustment vs. the optimization algorithm itsel contributes to the results. The control parameter values used were CR = 0., F =0., NP = 00, and G max = 999. First two control parameter values were obtained by a couple o preliminary tests with the problems. Value o CR was relatively low but suitable because most o the problems were separable and because the complexity o objectives dier or the problems modiied rom the ZDT problems []. Value o F is a compromise between speed and robustness. Value F =0.has been noted to be especially suitable or the ZDT problem because o equally spaced local optima [], []. The size o the population was set according to the smallest desired approximation set size given in []. With chosen NP and G max values, FES is exactly , which was an upper limit given in []. In [], approximation sets o dierent sizes were demanded or dierent problems. In GDE, the size o the approximation set is usually same as NP.Now,NP was kept ixed or all the problems, and solutions or the approximation set were collected during generations. Populations o 00 last generations (9 last generations in the case o 000 unction evaluations) were merged together and nondominated solutions were selected rom this merged set o solutions. I the size o non-dominated set was larger than the desired approximation set size, then the set was reduced to desired size using the pruning technique described in []. C. Results o Experiments The problems given in [] were solved times and achieved results are presented in Tables I VII and Figs.. Tables II VII show the best, the worst, median, mean, and standard deviation values o two perormance indicators ater dierent FES. Binary indicators used were R [0] and Hypervolume indicator (I H) []. When these are used to compare against a reerence set, then a smaller indicator value express better perormance (value 0 indicates equal perormance respect to the reerence set). According to the R indicator values in Tables II IV, a better approximation set than the given reerence set (i.e., negative indicator value) was ound or problems OKA, S ZDT, S ZDT, WFG (M=), WFG8 (M=,), and WFG9 (M=). According to the Hypervolume indicator values in Tables V VII, a better approximation set than the given reerence set was ound or problems OKA, S ZDT, S DTLZ (M=), WFG (M=), WFG8 (M=,), WFG9 (M=,), and R DTLZ (M=). Covered sets (CS) metric [] measures number o covered Pareto-subsets in the decision variable space. The SYM- PART problem has been designed to have several Paretosubsets in the the decision variable space mapping into a single Pareto-set in the objective space. CS values or the SYMPART problem are shown in Table I and these indicate that solutions converged into a single Pareto-subset in the decision variable space. This is not surprising since GDE does not explicitly maintain diversity in the decision variable space but in the objective space according to common goals o multi-objective optimization []. TABLE I THE RESULTS FOR COVERED SETS CS FOR TEST FUNCTION SYMPART FES e+ e+ e+ Best.0000e e e+00 Median.0000e e e+00 Worst e e e+00 Mean.0000e e e+00 Std 0.000e e e+00 Attainment suraces [] in the case o two and three objectives are shown in Figs. and. Results in Fig. indicate that the Pareto-optimal ront is ound reliably in all the two-objective cases except with the ZDT problem modiications and S ZDT. According to Fig., the rotated version o ZDT (R ZDT) is harder to solve than the unrotated version (S ZDT). 00 % attainment surace or S ZDT is a single point (, ), thus sometimes the result can be a single solution or this problem. Dierent control parameter values would give dierent results. Attainment suraces or the three-objective problems in Fig. indicate good perormance in the most cases. The rotated DTLZ problem (R DTLZ) seems to be the most diicult one, and also S DTLZ causes some diiculty. Figure illustrates pairwise interaction o objective unctions in the case o the ive-objective WFG8 and WFG9 problems. The results indicate good coverage o the Paretooptimal ront since the approximation sets appear to be close to the true Pareto-ront and also the area o the Pareto-ront is well covered. D. Algorithm Complexity GDE is well scalable algorithm with the simple genetic operations o DE. Thereore, also problems with a large 007 IEEE Congress on EvolutionaryComputation (CEC 007) 9

4 TABLE II THE RESULTS FOR R INDICATOR ON TEST FUNCTIONS 7 FES. OKA. SYMPART. S ZDT. S ZDT. S ZDT. R ZDT 7. S ZDT Best -9.7e-0.99e-0.9e-0 8.0e-0.97e-0 9.9e-0.0e-0 Median -.70e-0.7e-0.9e-0 9.8e-0 7.7e-0.779e-0.e-0 e+ Worst 8.70e-0.80e-0.07e-0.08e e-0.8e-0.880e-0 Mean.7e-0.8e-0.e-0 9.8e-0 7.e e-0.e-0 Std.978e-0.089e-0.8e-0.000e-0.7e-0.e-0.7e-0 Best -.00e-0.e-0.7e-0.9e-0.8e-0.07e-0.799e-0 Median -9.8e-0.e-0.00e-0.88e-0.8e-0 7.7e-0.99e-0 e+ Worst -8.00e-0.877e-0.9e-0.09e-0 9.9e-0.7e-0.e-0 Mean -9.80e-0.8e-0.e-0.8e-0.97e-0 8.e-0.990e-0 Std.0e-0 7.0e-0.e-0.0e e-0.e-0 7.8e-0 Best -.0e-0.8e-0.98e-08.8e e-09.7e e-0 Median -.09e-0.07e-0.7e e-0 -.e e e-0 e+ Worst -.00e-0.99e-0.0e-0.00e-0 7.7e-0.99e e-0 Mean -.08e-0.9e-0.8e-0.e-0.e-0.77e e-0 Std.7e-0.0e-07.09e-0.088e-0.88e-0.0e-0.87e- TABLE III THE RESULTS FOR R INDICATOR ON TEST FUNCTIONS 8 WHEN M= FES 8. S DTLZ 9. R DTLZ 0. S DTLZ. WFG. WFG8. WFG9 Best.0e-0.7e-0.0e-0.8e-0 -.e e-0 Median.90e-0.908e-0.880e e-0 -.0e e-0 e+ Worst.e-0.978e-0 7.0e-0 8.0e e-0.7e-0 Mean.098e-0.00e-0.880e e e e-0 Std.e-0.7e-0.07e-0.98e-0.8e-0.0e-0 Best.9e e-0.007e-0.07e e e-0 Median.7e-0.7e-0.79e-0.899e-0 -.9e e-0 e+ Worst 9.78e-0.708e-0.e-0.00e e-0 -.e-0 Mean.0877e-0.7e-0.79e-0.7e-0 -.9e-0-8.9e-0 Std.0e-0.097e-0.70e-0.08e-0.e-0.e-0 Best.7e-0.87e-0.88e e e e-0 Median.877e-0.0e-0.77e-07.7e-0 -.8e e-0 e+ Worst.99e-0.897e-0.e-0.99e e-0 -.8e-0 Mean.00e-0.897e-0.90e-07.77e e-0-9.e-0 Std.90e-0 7.9e-0.e-07.77e-0.e-0.979e-0 TABLE IV THE RESULTS FOR R INDICATOR ON TEST FUNCTIONS 8 WHEN M= FES 8. S DTLZ 9. R DTLZ 0. S DTLZ. WFG. WFG8. WFG9 Best.87e-0.89e-0.800e-0.0e-0.97e-0.99e-0 Median.0e-0.9e-0.090e-0.7e-0.7e-0.87e-0 e+ Worst.090e-0.0e-0.7e-0.78e-0 8.e-0.e-0 Mean.07e-0.9e-0.e-0.8e-0.878e-0 7.0e-0 Std.7e-0.08e-0.9e-0.78e-0.08e-0.99e-0 Best.9e e-0 8.9e-0.8e e-0.8e-0 Median.789e-0.8e-0.80e-0.8e e-0.7e-0 e+ Worst.78e-0 7.9e-0.e-0.88e-0 -.e-0.987e-0 Mean.9e-0.78e-0.9e-0.e-0-7.7e-0.7e-0 Std 7.9e e-0.0e-0.700e-0 8.e e-0 Best.0e-0.8e-0 8.0e-09.9e-0 -.9e-0.0e-0 Median.08e-0.8e-0.7e-07.00e-0 -.e-0.8e-0 e+ Worst.9e e-0.07e e-0 -.0e-0.987e-0 Mean.e-0.e-0.e e-0 -.e-0.998e-0 Std.0e-0.08e-0.79e-07.9e-0.99e-0 7.0e IEEE Congress on EvolutionaryComputation (CEC 007)

5 TABLE V THE RESULTS FOR HYPERVOLUME INDICATOR I H ON TEST FUNCTIONS 7 FES. OKA. SYMPART. S ZDT. S ZDT. S ZDT. R ZDT 7. S ZDT Best -8.8e-0.07e-0.e-0.090e-0.780e-0.987e-0.0e-0 Median -.07e-0 7.7e-0.e-0.e-0.8e-0.98e-0.7e-0 e+ Worst.e-0.08e e-0.79e-0.e e-0.e-0 Mean.79e e-0.e-0.7e-0.90e-0.07e-0.97e-0 Std.879e-0.7e-0.8e-0.e-0.7e-0.0e-0.8e-0 Best -.7e-0.98e-0.87e-0.97e-0.708e-0.e-0.98e-0 Median -.87e-0.7e-0.8e-0.9e-0.008e e-0.8e-0 e+ Worst e-0.e e-0.80e-0.77e-0.88e-0.88e-0 Mean -.0e e-0.79e-0.8e-0.078e-0.07e-0.900e-0 Std.7e-0.e-0 9.0e-0.e-0.9e-0.9e-0.90e-0 Best -.9e-0.90e-0.7e-0.9e-0 8.0e e-0 -.e-0 Median -.80e-0.079e-0.707e-0.0e e-07.e e-0 e+ Worst -.08e-0.90e-0.00e-0.78e-0.9e-0.09e e-0 Mean -.7e-0.77e-0.78e-0.0e-0.790e-0.90e e-0 Std.e-0.8e-07.0e-0.78e-0.70e-0.9e-0.0e-07 TABLE VI THE RESULTS FOR HYPERVOLUME INDICATOR I H ON TEST FUNCTIONS 8 WHEN M= FES 8. S DTLZ 9. R DTLZ 0. S DTLZ. WFG. WFG8. WFG9 Best.90e e-0.88e-0.e-0-8.8e e-0 Median.7e-0.090e-0 7.e-0.079e-0-7.9e-0 -.9e-0 e+ Worst.708e-0.87e-0.00e-0.98e e-0.8e-0 Mean.88e-0.08e-0 7.7e-0.00e-0-7.0e-0 -.9e-0 Std.900e-0.e-0.00e-0.e e-0.889e-0 Best.9e-0.00e-0.0e-0.87e e e-0 Median.07e-0.97e-0.e-0.0e e-0 -.9e-0 e+ Worst.0e-0 8.9e e-0.8e-0 -.e e-0 Mean.7e-0.89e-0.99e-0.89e e-0 -.e-0 Std 8.e-0.7e-0.9e-0.98e-0.008e-0.0e-0 Best -.9e-0.880e-0.9e e e e-0 Median -7.09e-0 7.e-0 7.7e e e e-0 e+ Worst.98e-0.789e-0.08e-08.07e e e-0 Mean -.88e-0 8.7e-0.98e-09.77e-0 -.7e e-0 Std.87e-0.709e-0.00e-09.77e e e-0 TABLE VII THE RESULTS FOR HYPERVOLUME INDICATOR I H ON TEST FUNCTIONS 8 WHEN M= FES 8. S DTLZ 9. R DTLZ 0. S DTLZ. WFG. WFG8. WFG9 Best 8.e-0.07e-0.87e-0.9e e-0 7.0e-0 Median.7e-0.00e-0.7e-0.e-0 -.e-0.99e-0 e+ Worst.7e-0.8e-0.9e-0.e e-0.08e-0 Mean.77e-0.97e-0.9e-0.9e-0 -.9e-0.8e-0 Std.99e-0 8.e-0.0e-0.88e-0.789e-0.79e-0 Best.08e-0-8.7e-0.98e-0.99e e-0 -.e-0 Median.0e-0.08e-0 7.8e-0.e-0 -.9e e-0 e+ Worst.0e-0 8.0e-0.788e-0.708e-0 -.8e e-0 Mean.778e-0 -.7e e-0.7e e e-0 Std.e-0.0e-0.8e-0.907e-0.99e-0 9.7e-0 Best.e e-0.880e-.997e-0 -.7e-0 -.0e-0 Median 9.9e e-0.9e-.99e-0 -.0e-0 -.0e-0 e+ Worst.08e e-0.808e e-0 -.8e e-0 Mean.000e-0 -.e-0.9e-0.9e e-0 -.e-0 Std.87e-0.7e e-0.0e-0 9.9e-0.9e IEEE Congress on EvolutionaryComputation (CEC 007) 97

6 OKA 0. 0% attainment surace 0. 0% attainment surace 00% attainment surace Pareto optimal ront SYMPART 0% attainment surace 0% attainment surace 00% attainment surace Pareto optimal ront S_ZDT 0% attainment surace 0% attainment surace 00% attainment surace Pareto optimal ront.8. S_ZDT % attainment surace 0% attainment surace. 00% attainment surace Pareto optimal ront S_ZDT 0% attainment surace 0% attainment surace 00% attainment surace Pareto optimal ront R_ZDT 0% attainment surace 0% attainment surace 00% attainment surace Pareto optimal ront S_ZDT % attainment surace 0% attainment surace 00% attainment surace Pareto optimal ront Fig.. Pareto-optimal ront and 0%, 0%, 00% attainment suraces ater e+ FES on test unctions IEEE Congress on EvolutionaryComputation (CEC 007)

7 S_DTLZ R_DTLZ S_DTLZ WFG9. WFG8 0. Fig.. 00 WFG % attainment suraces ater e+ FES on test unctions 8 (M = ) Fig Upper diagonal plots are or WFG8 (M = ) and lower diagonal plots are or WFG9 (M = ). 007 IEEE Congress on Evolutionary Computation (CEC 007) 99

8 number o decision variables and/or a large population size as in [] are solvable in reasonable time. The most complex operation in GDE ( is non-dominated ) sorting, which time complexity is O N log M N []. The time complexity o GDE was measured according to instructions given in [], and observed CPU times are reported in Table VIII. TABLE VIII COMPUTATIONAL COMPLEXITY: TIS MEAN TIME FOR EVALUATING ALL THE PROBLEMS 0000 TIMES AND T IS MEAN TIME FOR SOLVING ALL THE PROBLEMS USING GDE AND 0000 FUNCTION EVALUATIONS T T (T T ) /T. s.78 s 0.88 V. CONCLUSIONS Results o Generalized Dierential Evolution (GDE) or the CEC 007 Special Session on Perormance Assessment o Multi-Objective Optimization Algorithms have been reported. The problems given were solved with the same ixed control parameter settings, i.e., there was no parameter adaption based on problem characteristic or other criteria. According to the results, GDE perormed well especially with the problems without artiicial rotation according to the attainment suraces obtained. Worse perormance with rotated problems was probably due to selected control parameter values. In several cases, the perormance metrics indicate that the obtained approximation sets were even better than the given reerence sets. REFERENCES [] S. Kukkonen and J. Lampinen, GDE: The third evolution step o Generalized Dierential Evolution, in Proceedings o the 00 Congress on Evolutionary Computation (CEC 00), Edinburgh, Scotland, Sept 00, pp. 0. [Online]. Available: [] S. Kukkonen and K. Deb, Improved pruning o non-dominated solutions based on crowding distance or bi-objective optimization problems, in Proceedings o the 00 Congress on Evolutionary Computation (CEC 00), Vancouver, BC, Canada, July 00, pp [], A ast and eective method or pruning o non-dominated solutions in many-objective problems, in Proceedings o the 9th International Conerence on Parallel Problem Solving rom Nature (PPSN IX),, Reykjavik, Iceland, Sept 00, pp.. [] V. L. Huang, A. K. Qin, K. Deb, E. Zitzler, P. N. Suganthan, J. J. Liang, M. Preuss, and S. Huband, Problem deinitions or perormance assessment on multi-objective optimization algorithms, School o EEE, Nanyang Technological University, Singapore, 9798, Technical Report, January 007. [Online]. Available: iles/cec- 07/CEC-07-TR--Feb.pd, [] K. Miettinen, Nonlinear Multiobjective Optimization. Boston: Kluwer Academic Publishers, 998. [] J. Lampinen, DE s selection rule or multiobjective optimization, Lappeenranta University o Technology, Department o Inormation Technology, Tech. Rep., 00. [Online]. Available: Actual non-dominated sorting implementation in GDE is naive that increased the computation time. [7] C. M. Fonseca and P. J. Fleming, Multiobjective optimization and multiple constraint handling with evolutionary algorithms part I: A uniied ormulation, IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans, vol. 8, no., pp. 7, Jan 998. [8] R. Storn and K. V. Price, Dierential Evolution - a simple and eicient heuristic or global optimization over continuous spaces, Journal o Global Optimization, vol., no., pp. 9, Dec 997. [9] K. V. Price, R. Storn, and J. Lampinen, Dierential Evolution: A Practical Approach to Global Optimization. Berlin: Springer-Verlag, 00. [0] K. V. Price, New Ideas in Optimization. London: McGraw-Hill, 999, ch. An Introduction to Dierential Evolution, pp [] K. Deb, Multi-Objective Optimization using Evolutionary Algorithms. Chichester, England: John Wiley & Sons, 00. [] S. Kukkonen and J. Lampinen, An extension o Generalized Dierential Evolution or multi-objective optimization with constraints, in Proceedings o the 8th International Conerence on Parallel Problem Solving rom Nature (PPSN VIII), Birmingham, England, Sept 00, pp [] J. Lampinen and R. Storn, New Optimization Techniques in Engineering. Springer, 00, ch. Dierential Evolution, pp.. [] S. Kukkonen and J. Lampinen, Constrained real-parameter optimization with Generalized Dierential Evolution, in Proceedings o the 00 Congress on Evolutionary Computation (CEC 00), Vancouver, BC, Canada, July 00, pp [], An empirical study o control parameters or Generalized Dierential Evolution, in Proceedings o the Sixth Conerence on Evolutionary and Deterministic Methods or Design, Optimization and Control with Applications to Industrial and Societal Problems (EUROGEN 00), Munich, Germany, Sept 00, p. pages. [], An empirical study o control parameters or the third version o Generalized Dierential Evolution (GDE), in Proceedings o the 00 Congress on Evolutionary Computation (CEC 00), Vancouver, BC, Canada, July 00, pp [7] H. A. Abbass, The sel-adaptive Pareto Dierential Evolution algorithm, in Proceedings o the 00 Congress on Evolutionary Computation (CEC 00), Honolulu, Hawaii, May 00, pp [8] D. Zaharie, Control o population diversity and adaptation in Dierential Evolution algorithms, in Proceedings o Mendel 00, 9th International Conerence on Sot Computing, Brno, Czech Republic, June 00, pp.. [9] V. L. Huang, A. K. Qin, and P. N. Suganthan, Sel-adaptive Dierential Evolution algorithm or constrained real-parameter optimization, in Proceedings o the 00 Congress on Evolutionary Computation (CEC 00), Vancouver, BC, Canada, July 00, pp.. [0] M. P. Hansen and A. Jaszkiewicz, Evaluating the quality o approximations o the non-dominated set, Institute o Mathematical Modeling, Technical University o Denmark, IMM Technical Report IMM-REP-998-7, 998. [] E. Zitzler, Evolutionary algorithms or multiobjective optimization: Methods and applications, Ph.D. dissertation, Swiss Federal Institute o Technology (ETH) Zurich, TIK-Schritenreihe Nr. 0, Diss ETH No. 98, Shaker Verlag, Germany, Dec 999. [] G. Rudolph, B. Naujoks, and M. Preuss, Capabilities o EMOA to detect and preserve equivalent Pareto subsets, in Proceedings o the th International Conerence on Evolutionary Multi-Criterion Optimization (EMO 007), Matsushima, Japan, March 007, pp. 0. [] V. Grunert da Fonseca, C. M. Fonseca, and A. O. Hall, Inerential perormance assessment o stochastic optimizers and the attainment unction, in Proceedings o the First International Conerence on Evolutionary Multi-Criterion Optimization (EMO 00), Zurich, Switzerland, March 00, pp.. [] S. Kukkonen, S. R. Jangam, and N. Chakraborti, Solving the molecular sequence alignment problem with Generalized Dierential Evolution (GDE), in Proceedings o the 007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM 007), Honolulu, HI, USA, April 007, pp [] M. T. Jensen, Reducing the run-time complexity o multiobjective EAs: The NSGA-II and other algorithms, IEEE Transactions on Evolutionary Computation, vol. 7, no., pp. 0, Oct IEEE Congress on EvolutionaryComputation (CEC 007)

Performance Assessment of Generalized Differential Evolution 3 with a Given Set of Constrained Multi-Objective Test Problems

Performance Assessment of Generalized Differential Evolution 3 with a Given Set of Constrained Multi-Objective Test Problems Performance Assessment of Generalized Differential Evolution 3 with a Given Set of Constrained Multi-Objective Test Problems Saku Kukkonen, Student Member, IEEE and Jouni Lampinen Abstract This paper presents

More information

Constrained Real-Parameter Optimization with Generalized Differential Evolution

Constrained Real-Parameter Optimization with Generalized Differential Evolution 2006 IEEE Congress on Evolutionary Computation Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 2006 Constrained Real-Parameter Optimization with Generalized Differential Evolution

More information

GDE3: The third Evolution Step of Generalized Differential Evolution

GDE3: The third Evolution Step of Generalized Differential Evolution GDE3: The third Evolution Step of Generalized Differential Evolution Saku Kukkonen Kanpur Genetic Algorithms Laboratory (KanGAL) Indian Institute of Technology Kanpur Kanpur, PIN 28 16, India saku@iitk.ac.in,

More information

An Empirical Study of Control Parameters for Generalized Differential Evolution

An Empirical Study of Control Parameters for Generalized Differential Evolution An Empirical tudy of Control Parameters for Generalized Differential Evolution aku Kukkonen Kanpur Genetic Algorithms Laboratory (KanGAL) Indian Institute of Technology Kanpur Kanpur, PIN 8 6, India saku@iitk.ac.in,

More information

An Evolutionary Strategy for. Decremental Multi-Objective Optimization Problems

An Evolutionary Strategy for. Decremental Multi-Objective Optimization Problems An Evolutionary Strategy or Decremental Multi-Objective Optimization Problems Sheng-Uei Guan *, Qian Chen and Wenting Mo School o Engineering and Design, Brunel University, UK Department o Electrical and

More information

Evolving Dynamic Multi-objective Optimization Problems. with Objective Replacement. Abstract

Evolving Dynamic Multi-objective Optimization Problems. with Objective Replacement. Abstract Evolving Dynamic Multi-objective Optimization Problems with Objective eplacement Sheng-Uei Guan, Qian Chen and Wenting Mo Department o Electrical and Computer Engineering National University o Singapore

More information

Behavior of EMO Algorithms on Many-Objective Optimization Problems with Correlated Objectives

Behavior of EMO Algorithms on Many-Objective Optimization Problems with Correlated Objectives H. Ishibuchi N. Akedo H. Ohyanagi and Y. Nojima Behavior of EMO algorithms on many-objective optimization problems with correlated objectives Proc. of 211 IEEE Congress on Evolutionary Computation pp.

More information

This is an electronic reprint of the original article. This reprint may differ from the original in pagination and typographic detail.

This is an electronic reprint of the original article. This reprint may differ from the original in pagination and typographic detail. This is an electronic reprint of the original article. This reprint may differ from the original in pagination and typographic detail. Author(s): Sindhya, Karthik; Ruuska, Sauli; Haanpää, Tomi; Miettinen,

More information

Decomposition and Metaoptimization of Mutation Operator in Differential Evolution

Decomposition and Metaoptimization of Mutation Operator in Differential Evolution Decomposition and Metaoptimization of Mutation Operator in Differential Evolution Karol Opara 1 and Jaros law Arabas 2 1 Systems Research Institute, Polish Academy of Sciences 2 Institute of Electronic

More information

Research Article A Novel Ranking Method Based on Subjective Probability Theory for Evolutionary Multiobjective Optimization

Research Article A Novel Ranking Method Based on Subjective Probability Theory for Evolutionary Multiobjective Optimization Mathematical Problems in Engineering Volume 2011, Article ID 695087, 10 pages doi:10.1155/2011/695087 Research Article A Novel Ranking Method Based on Subjective Probability Theory for Evolutionary Multiobjective

More information

Constrained Optimization by the Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites

Constrained Optimization by the Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites 2006 IEEE Congress on Evolutionary Computation Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 6-2, 2006 Constrained Optimization by the Constrained Differential Evolution with Gradient-Based

More information

PIBEA: Prospect Indicator Based Evolutionary Algorithm for Multiobjective Optimization Problems

PIBEA: Prospect Indicator Based Evolutionary Algorithm for Multiobjective Optimization Problems PIBEA: Prospect Indicator Based Evolutionary Algorithm for Multiobjective Optimization Problems Pruet Boonma Department of Computer Engineering Chiang Mai University Chiang Mai, 52, Thailand Email: pruet@eng.cmu.ac.th

More information

Robust Multi-Objective Optimization in High Dimensional Spaces

Robust Multi-Objective Optimization in High Dimensional Spaces Robust Multi-Objective Optimization in High Dimensional Spaces André Sülflow, Nicole Drechsler, and Rolf Drechsler Institute of Computer Science University of Bremen 28359 Bremen, Germany {suelflow,nd,drechsle}@informatik.uni-bremen.de

More information

Solving Multi-Mode Time-Cost-Quality Trade-off Problem in Uncertainty Condition Using a Novel Genetic Algorithm

Solving Multi-Mode Time-Cost-Quality Trade-off Problem in Uncertainty Condition Using a Novel Genetic Algorithm International Journal o Management and Fuzzy Systems 2017; 3(3): 32-40 http://www.sciencepublishinggroup.com/j/ijms doi: 10.11648/j.ijms.20170303.11 Solving Multi-Mode Time-Cost-Quality Trade-o Problem

More information

THE objective of global optimization is to find the

THE objective of global optimization is to find the Large Scale Global Optimization Using Differential Evolution With Self-adaptation and Cooperative Co-evolution Aleš Zamuda, Student Member, IEEE, Janez Brest, Member, IEEE, Borko Bošković, Student Member,

More information

Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism

Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism Sanaz Mostaghim 1 and Jürgen Teich 2 1 Electrical Engineering Department University of Paderborn,

More information

OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION

OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION Xu Bei, Yeo Jun Yoon and Ali Abur Teas A&M University College Station, Teas, U.S.A. abur@ee.tamu.edu Abstract This paper presents

More information

Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms

Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms Tadahiko Murata 1, Shiori Kaige 2, and Hisao Ishibuchi 2 1 Department of Informatics, Kansai University 2-1-1 Ryozenji-cho,

More information

Running time analysis of a multi-objective evolutionary algorithm on a simple discrete optimization problem

Running time analysis of a multi-objective evolutionary algorithm on a simple discrete optimization problem Research Collection Working Paper Running time analysis of a multi-objective evolutionary algorithm on a simple discrete optimization problem Author(s): Laumanns, Marco; Thiele, Lothar; Zitzler, Eckart;

More information

Effects of the Use of Non-Geometric Binary Crossover on Evolutionary Multiobjective Optimization

Effects of the Use of Non-Geometric Binary Crossover on Evolutionary Multiobjective Optimization Effects of the Use of Non-Geometric Binary Crossover on Evolutionary Multiobjective Optimization Hisao Ishibuchi, Yusuke Nojima, Noritaka Tsukamoto, and Ken Ohara Graduate School of Engineering, Osaka

More information

Multi-objective approaches in a single-objective optimization environment

Multi-objective approaches in a single-objective optimization environment Multi-objective approaches in a single-objective optimization environment Shinya Watanabe College of Information Science & Engineering, Ritsumeikan Univ. -- Nojihigashi, Kusatsu Shiga 55-8577, Japan sin@sys.ci.ritsumei.ac.jp

More information

Robust Residual Selection for Fault Detection

Robust Residual Selection for Fault Detection Robust Residual Selection or Fault Detection Hamed Khorasgani*, Daniel E Jung**, Gautam Biswas*, Erik Frisk**, and Mattias Krysander** Abstract A number o residual generation methods have been developed

More information

The Deutsch-Jozsa Problem: De-quantization and entanglement

The Deutsch-Jozsa Problem: De-quantization and entanglement The Deutsch-Jozsa Problem: De-quantization and entanglement Alastair A. Abbott Department o Computer Science University o Auckland, New Zealand May 31, 009 Abstract The Deustch-Jozsa problem is one o the

More information

A Restart CMA Evolution Strategy With Increasing Population Size

A Restart CMA Evolution Strategy With Increasing Population Size Anne Auger and Nikolaus Hansen A Restart CMA Evolution Strategy ith Increasing Population Size Proceedings of the IEEE Congress on Evolutionary Computation, CEC 2005 c IEEE A Restart CMA Evolution Strategy

More information

Gaussian EDA and Truncation Selection: Setting Limits for Sustainable Progress

Gaussian EDA and Truncation Selection: Setting Limits for Sustainable Progress Gaussian EDA and Truncation Selection: Setting Limits for Sustainable Progress Petr Pošík Czech Technical University, Faculty of Electrical Engineering, Department of Cybernetics Technická, 66 7 Prague

More information

A Non-Parametric Statistical Dominance Operator for Noisy Multiobjective Optimization

A Non-Parametric Statistical Dominance Operator for Noisy Multiobjective Optimization A Non-Parametric Statistical Dominance Operator for Noisy Multiobjective Optimization Dung H. Phan and Junichi Suzuki Deptartment of Computer Science University of Massachusetts, Boston, USA {phdung, jxs}@cs.umb.edu

More information

BACKTRACKING DETERMINISTIC ANNEALING FOR CONSTRAINT SATISFACTION PROBLEMS

BACKTRACKING DETERMINISTIC ANNEALING FOR CONSTRAINT SATISFACTION PROBLEMS Proc. Int. Con. on Artiicial Neural Networks ICANN 1999, Edinburgh, pages 868-873 BACKTRACKING DETERMINISTIC ANNEALING FOR CONSTRAINT SATISFACTION PROBLEMS Heiko Wersing and Helge Ritter University o Bieleeld,

More information

Multiobjective Optimisation An Overview

Multiobjective Optimisation An Overview ITNPD8/CSCU9YO Multiobjective Optimisation An Overview Nadarajen Veerapen (nve@cs.stir.ac.uk) University of Stirling Why? Classic optimisation: 1 objective Example: Minimise cost Reality is often more

More information

Population Variance Based Empirical Analysis of. the Behavior of Differential Evolution Variants

Population Variance Based Empirical Analysis of. the Behavior of Differential Evolution Variants Applied Mathematical Sciences, Vol. 9, 2015, no. 66, 3249-3263 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.54312 Population Variance Based Empirical Analysis of the Behavior of Differential

More information

Adaptive Differential Evolution and Exponential Crossover

Adaptive Differential Evolution and Exponential Crossover Proceedings of the International Multiconference on Computer Science and Information Technology pp. 927 931 ISBN 978-83-60810-14-9 ISSN 1896-7094 Adaptive Differential Evolution and Exponential Crossover

More information

Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method

Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method Kalyanmoy Deb Department of Mechanical Engineering Indian Institute of Technology Kanpur Kanpur,

More information

Dynamic Optimization using Self-Adaptive Differential Evolution

Dynamic Optimization using Self-Adaptive Differential Evolution Dynamic Optimization using Self-Adaptive Differential Evolution IEEE Congress on Evolutionary Computation (IEEE CEC 2009), Trondheim, Norway, May 18-21, 2009 J. Brest, A. Zamuda, B. Bošković, M. S. Maučec,

More information

design variable x1

design variable x1 Multipoint linear approximations or stochastic chance constrained optimization problems with integer design variables L.F.P. Etman, S.J. Abspoel, J. Vervoort, R.A. van Rooij, J.J.M Rijpkema and J.E. Rooda

More information

A Simple Explanation of the Sobolev Gradient Method

A Simple Explanation of the Sobolev Gradient Method A Simple Explanation o the Sobolev Gradient Method R. J. Renka July 3, 2006 Abstract We have observed that the term Sobolev gradient is used more oten than it is understood. Also, the term is oten used

More information

Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method

Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method ABSTRACT Kalyanmoy Deb Department of Mechanical Engineering Indian Institute of Technology Kanpur

More information

DE/BBO: A Hybrid Differential Evolution with Biogeography-Based Optimization for Global Numerical Optimization

DE/BBO: A Hybrid Differential Evolution with Biogeography-Based Optimization for Global Numerical Optimization 1 : A Hybrid Differential Evolution with Biogeography-Based Optimization for Global Numerical Optimization Wenyin Gong, Zhihua Cai, and Charles X. Ling, Senior Member, IEEE Abstract Differential Evolution

More information

Crossover and the Different Faces of Differential Evolution Searches

Crossover and the Different Faces of Differential Evolution Searches WCCI 21 IEEE World Congress on Computational Intelligence July, 18-23, 21 - CCIB, Barcelona, Spain CEC IEEE Crossover and the Different Faces of Differential Evolution Searches James Montgomery Abstract

More information

Simpler Functions for Decompositions

Simpler Functions for Decompositions Simpler Functions or Decompositions Bernd Steinbach Freiberg University o Mining and Technology, Institute o Computer Science, D-09596 Freiberg, Germany Abstract. This paper deals with the synthesis o

More information

Telescoping Decomposition Method for Solving First Order Nonlinear Differential Equations

Telescoping Decomposition Method for Solving First Order Nonlinear Differential Equations Telescoping Decomposition Method or Solving First Order Nonlinear Dierential Equations 1 Mohammed Al-Reai 2 Maysem Abu-Dalu 3 Ahmed Al-Rawashdeh Abstract The Telescoping Decomposition Method TDM is a new

More information

A Particle Swarm Optimization Algorithm for Neighbor Selection in Peer-to-Peer Networks

A Particle Swarm Optimization Algorithm for Neighbor Selection in Peer-to-Peer Networks A Particle Swarm Optimization Algorithm or Neighbor Selection in Peer-to-Peer Networks Shichang Sun 1,3, Ajith Abraham 2,4, Guiyong Zhang 3, Hongbo Liu 3,4 1 School o Computer Science and Engineering,

More information

WORST CASE OPTIMIZATION USING CHEBYSHEV INEQUALITY

WORST CASE OPTIMIZATION USING CHEBYSHEV INEQUALITY WORST CASE OPTIMIZATION USING CHEBYSHEV INEQUALITY Kiyoharu Tagawa School of Science and Engineering, Kindai University, Japan tagawa@info.kindai.ac.jp Abstract In real-world optimization problems, a wide

More information

18-660: Numerical Methods for Engineering Design and Optimization

18-660: Numerical Methods for Engineering Design and Optimization 8-66: Numerical Methods or Engineering Design and Optimization Xin Li Department o ECE Carnegie Mellon University Pittsburgh, PA 53 Slide Overview Linear Regression Ordinary least-squares regression Minima

More information

Finger Search in the Implicit Model

Finger Search in the Implicit Model Finger Search in the Implicit Model Gerth Stølting Brodal, Jesper Sindahl Nielsen, Jakob Truelsen MADALGO, Department o Computer Science, Aarhus University, Denmark. {gerth,jasn,jakobt}@madalgo.au.dk Abstract.

More information

arxiv: v1 [cs.ne] 9 May 2016

arxiv: v1 [cs.ne] 9 May 2016 Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES) arxiv:1605.02720v1 [cs.ne] 9 May 2016 ABSTRACT Ilya Loshchilov University of Freiburg Freiburg, Germany ilya.loshchilov@gmail.com

More information

2.6 Two-dimensional continuous interpolation 3: Kriging - introduction to geostatistics. References - geostatistics. References geostatistics (cntd.

2.6 Two-dimensional continuous interpolation 3: Kriging - introduction to geostatistics. References - geostatistics. References geostatistics (cntd. .6 Two-dimensional continuous interpolation 3: Kriging - introduction to geostatistics Spline interpolation was originally developed or image processing. In GIS, it is mainly used in visualization o spatial

More information

Educational Procedure for Designing and Teaching Reflector Antennas in Electrical Engineering Programs. Abstract. Introduction

Educational Procedure for Designing and Teaching Reflector Antennas in Electrical Engineering Programs. Abstract. Introduction Educational Procedure or Designing and Teaching Relector Antennas in Electrical Engineering Programs Marco A.B. Terada Klipsch School o Electrical and Computer Engineering New Mexico State University Las

More information

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Yong Wang and Zhi-Zhong Liu School of Information Science and Engineering Central South University ywang@csu.edu.cn

More information

Feasibility of a Multi-Pass Thomson Scattering System with Confocal Spherical Mirrors

Feasibility of a Multi-Pass Thomson Scattering System with Confocal Spherical Mirrors Plasma and Fusion Research: Letters Volume 5, 044 200) Feasibility o a Multi-Pass Thomson Scattering System with Conocal Spherical Mirrors Junichi HIRATSUKA, Akira EJIRI, Yuichi TAKASE and Takashi YAMAGUCHI

More information

Expected Running Time Analysis of a Multiobjective Evolutionary Algorithm on Pseudo-boolean Functions

Expected Running Time Analysis of a Multiobjective Evolutionary Algorithm on Pseudo-boolean Functions Expected Running Time Analysis of a Multiobjective Evolutionary Algorithm on Pseudo-boolean Functions Nilanjan Banerjee and Rajeev Kumar Department of Computer Science and Engineering Indian Institute

More information

AMULTIOBJECTIVE optimization problem (MOP) can

AMULTIOBJECTIVE optimization problem (MOP) can 1 IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Letters 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 Decomposition-Based Multiobjective Evolutionary Algorithm with an Ensemble of Neighborhood Sizes Shi-Zheng

More information

Multi-start JADE with knowledge transfer for numerical optimization

Multi-start JADE with knowledge transfer for numerical optimization Multi-start JADE with knowledge transfer for numerical optimization Fei Peng, Ke Tang,Guoliang Chen and Xin Yao Abstract JADE is a recent variant of Differential Evolution (DE) for numerical optimization,

More information

Improvement of Sparse Computation Application in Power System Short Circuit Study

Improvement of Sparse Computation Application in Power System Short Circuit Study Volume 44, Number 1, 2003 3 Improvement o Sparse Computation Application in Power System Short Circuit Study A. MEGA *, M. BELKACEMI * and J.M. KAUFFMANN ** * Research Laboratory LEB, L2ES Department o

More information

Multiobjective Optimization of Cement-bonded Sand Mould System with Differential Evolution

Multiobjective Optimization of Cement-bonded Sand Mould System with Differential Evolution DOI: 10.7763/IPEDR. 013. V63. 0 Multiobjective Optimization of Cement-bonded Sand Mould System with Differential Evolution T. Ganesan 1, I. Elamvazuthi, Ku Zilati Ku Shaari 3, and P. Vasant + 1, 3 Department

More information

Differential Evolution: Competitive Setting of Control Parameters

Differential Evolution: Competitive Setting of Control Parameters Proceedings of the International Multiconference on Computer Science and Information Technology pp. 207 213 ISSN 1896-7094 c 2006 PIPS Differential Evolution: Competitive Setting of Control Parameters

More information

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Yong Wang and Zhi-Zhong Liu School of Information Science and Engineering Central South University ywang@csu.edu.cn

More information

Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions

Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17) Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions Hong Qian, Yang Yu National

More information

Complexity and Algorithms for Two-Stage Flexible Flowshop Scheduling with Availability Constraints

Complexity and Algorithms for Two-Stage Flexible Flowshop Scheduling with Availability Constraints Complexity and Algorithms or Two-Stage Flexible Flowshop Scheduling with Availability Constraints Jinxing Xie, Xijun Wang Department o Mathematical Sciences, Tsinghua University, Beijing 100084, China

More information

Fluctuationlessness Theorem and its Application to Boundary Value Problems of ODEs

Fluctuationlessness Theorem and its Application to Boundary Value Problems of ODEs Fluctuationlessness Theorem and its Application to Boundary Value Problems o ODEs NEJLA ALTAY İstanbul Technical University Inormatics Institute Maslak, 34469, İstanbul TÜRKİYE TURKEY) nejla@be.itu.edu.tr

More information

it simpliies the notation, we write unary unction symbols without parenthesis, e.g., h((h(x);a)) would be written as h(hx; a). By s[t] we indicate tha

it simpliies the notation, we write unary unction symbols without parenthesis, e.g., h((h(x);a)) would be written as h(hx; a). By s[t] we indicate tha Fast Algorithms or Uniorm Semi-Uniication Alberto Oliart Λ Laboratorio Nacional de Inormática Avanzada, A.C. Rébsamen 8, Xalapa, Veracruz, Mexico aoliart@lania.mx Wayne Snyder Boston University Computer

More information

An Introduction to Differential Evolution. Kelly Fleetwood

An Introduction to Differential Evolution. Kelly Fleetwood An Introduction to Differential Evolution Kelly Fleetwood Synopsis Introduction Basic Algorithm Example Performance Applications The Basics of Differential Evolution Stochastic, population-based optimisation

More information

Frederick Sander. Variable Grouping Mechanisms and Transfer Strategies in Multi-objective Optimisation

Frederick Sander. Variable Grouping Mechanisms and Transfer Strategies in Multi-objective Optimisation Frederick Sander Variable Grouping Mechanisms and Transfer Strategies in Multi-objective Optimisation Intelligent Cooperative Systems Master Thesis Variable Grouping Mechanisms and Transfer Strategies

More information

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods Optimization Last time Root inding: deinition, motivation Algorithms: Bisection, alse position, secant, Newton-Raphson Convergence & tradeos Eample applications o Newton s method Root inding in > 1 dimension

More information

INPUT GROUND MOTION SELECTION FOR XIAOWAN HIGH ARCH DAM

INPUT GROUND MOTION SELECTION FOR XIAOWAN HIGH ARCH DAM 3 th World Conerence on Earthquake Engineering Vancouver, B.C., Canada August -6, 24 Paper No. 2633 INPUT GROUND MOTION LECTION FOR XIAOWAN HIGH ARCH DAM CHEN HOUQUN, LI MIN 2, ZHANG BAIYAN 3 SUMMARY In

More information

Differential Evolution: a stochastic nonlinear optimization algorithm by Storn and Price, 1996

Differential Evolution: a stochastic nonlinear optimization algorithm by Storn and Price, 1996 Differential Evolution: a stochastic nonlinear optimization algorithm by Storn and Price, 1996 Presented by David Craft September 15, 2003 This presentation is based on: Storn, Rainer, and Kenneth Price

More information

On Performance Metrics and Particle Swarm Methods for Dynamic Multiobjective Optimization Problems

On Performance Metrics and Particle Swarm Methods for Dynamic Multiobjective Optimization Problems On Performance Metrics and Particle Swarm Methods for Dynamic Multiobjective Optimization Problems Xiaodong Li, Jürgen Branke, and Michael Kirley, Member, IEEE Abstract This paper describes two performance

More information

Plateaus Can Be Harder in Multi-Objective Optimization

Plateaus Can Be Harder in Multi-Objective Optimization Plateaus Can Be Harder in Multi-Objective Optimization Tobias Friedrich and Nils Hebbinghaus and Frank Neumann Max-Planck-Institut für Informatik, Campus E1 4, 66123 Saarbrücken, Germany Abstract In recent

More information

OPTIMIZATION OF CONTINUOUS CASTING MOULD OSCILLATION PARAMETERS IN STEEL MANUFACTURING PROCESS USING GENETIC ALGORITHMS

OPTIMIZATION OF CONTINUOUS CASTING MOULD OSCILLATION PARAMETERS IN STEEL MANUFACTURING PROCESS USING GENETIC ALGORITHMS OPTIMIZATION OF CONTINUOUS CASTING MOULD OSCILLATION PARAMETERS IN STEEL MANUFACTURING PROCESS USING GENETIC ALGORITHMS Arya K. Bhattacharya, Member, IEEE, S. Debjani, Abhik Roychowdhury, Jadav Das ABSTRACT

More information

GF(4) Based Synthesis of Quaternary Reversible/Quantum Logic Circuits

GF(4) Based Synthesis of Quaternary Reversible/Quantum Logic Circuits GF(4) ased Synthesis o Quaternary Reversible/Quantum Logic Circuits MOZAMMEL H. A. KHAN AND MAREK A. PERKOWSKI Department o Computer Science and Engineering, East West University 4 Mohakhali, Dhaka, ANGLADESH,

More information

Supplementary material for Continuous-action planning for discounted infinite-horizon nonlinear optimal control with Lipschitz values

Supplementary material for Continuous-action planning for discounted infinite-horizon nonlinear optimal control with Lipschitz values Supplementary material or Continuous-action planning or discounted ininite-horizon nonlinear optimal control with Lipschitz values List o main notations x, X, u, U state, state space, action, action space,

More information

Relation between Pareto-Optimal Fuzzy Rules and Pareto-Optimal Fuzzy Rule Sets

Relation between Pareto-Optimal Fuzzy Rules and Pareto-Optimal Fuzzy Rule Sets Relation between Pareto-Optimal Fuzzy Rules and Pareto-Optimal Fuzzy Rule Sets Hisao Ishibuchi, Isao Kuwajima, and Yusuke Nojima Department of Computer Science and Intelligent Systems, Osaka Prefecture

More information

Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution

Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution Mădălina M. Drugan Artificial Intelligence lab, Vrije Universiteit Brussel, Pleinlaan 2, B-1050 Brussels,

More information

Objectives. By the time the student is finished with this section of the workbook, he/she should be able

Objectives. By the time the student is finished with this section of the workbook, he/she should be able FUNCTIONS Quadratic Functions......8 Absolute Value Functions.....48 Translations o Functions..57 Radical Functions...61 Eponential Functions...7 Logarithmic Functions......8 Cubic Functions......91 Piece-Wise

More information

Finding Multiple Global Optima Exploiting Differential Evolution s Niching Capability

Finding Multiple Global Optima Exploiting Differential Evolution s Niching Capability Finding Multiple Global Optima Exploiting Differential Evolution s Niching Capability Michael G. Epitropakis Computational Intelligence Laboratory, Department of Mathematics, University of Patras, Greece.

More information

2 Differential Evolution and its Control Parameters

2 Differential Evolution and its Control Parameters COMPETITIVE DIFFERENTIAL EVOLUTION AND GENETIC ALGORITHM IN GA-DS TOOLBOX J. Tvrdík University of Ostrava 1 Introduction The global optimization problem with box constrains is formed as follows: for a

More information

Probabilistic Model of Error in Fixed-Point Arithmetic Gaussian Pyramid

Probabilistic Model of Error in Fixed-Point Arithmetic Gaussian Pyramid Probabilistic Model o Error in Fixed-Point Arithmetic Gaussian Pyramid Antoine Méler John A. Ruiz-Hernandez James L. Crowley INRIA Grenoble - Rhône-Alpes 655 avenue de l Europe 38 334 Saint Ismier Cedex

More information

Prediction-based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization

Prediction-based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization Prediction-based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization Aimin Zhou 1, Yaochu Jin 2, Qingfu Zhang 1, Bernhard Sendhoff 2, and Edward Tsang 1 1 Department of Computer

More information

A Brief Introduction to Multiobjective Optimization Techniques

A Brief Introduction to Multiobjective Optimization Techniques Università di Catania Dipartimento di Ingegneria Informatica e delle Telecomunicazioni A Brief Introduction to Multiobjective Optimization Techniques Maurizio Palesi Maurizio Palesi [mpalesi@diit.unict.it]

More information

Chapter 6 Reliability-based design and code developments

Chapter 6 Reliability-based design and code developments Chapter 6 Reliability-based design and code developments 6. General Reliability technology has become a powerul tool or the design engineer and is widely employed in practice. Structural reliability analysis

More information

Theory of the Hypervolume Indicator: Optimal µ-distributions and the Choice of the Reference Point

Theory of the Hypervolume Indicator: Optimal µ-distributions and the Choice of the Reference Point Author manuscript, published in "Foundations of Genetic Algorithms (FOGA 9 (9" DOI :.45/575.5738 Theory of the Hypervolume Indicator: Optimal -Distributions and the Choice of the Reference Point Anne Auger

More information

Inter-Relationship Based Selection for Decomposition Multiobjective Optimization

Inter-Relationship Based Selection for Decomposition Multiobjective Optimization Inter-Relationship Based Selection for Decomposition Multiobjective Optimization Ke Li, Sam Kwong, Qingfu Zhang, and Kalyanmoy Deb Department of Electrical and Computer Engineering Michigan State University,

More information

RESOLUTION MSC.362(92) (Adopted on 14 June 2013) REVISED RECOMMENDATION ON A STANDARD METHOD FOR EVALUATING CROSS-FLOODING ARRANGEMENTS

RESOLUTION MSC.362(92) (Adopted on 14 June 2013) REVISED RECOMMENDATION ON A STANDARD METHOD FOR EVALUATING CROSS-FLOODING ARRANGEMENTS (Adopted on 4 June 203) (Adopted on 4 June 203) ANNEX 8 (Adopted on 4 June 203) MSC 92/26/Add. Annex 8, page THE MARITIME SAFETY COMMITTEE, RECALLING Article 28(b) o the Convention on the International

More information

Testing Gaussian Process Surrogates on CEC 2013 multi-modal benchmark

Testing Gaussian Process Surrogates on CEC 2013 multi-modal benchmark ITAT 2016 Proceedings, CEUR Workshop Proceedings Vol. 1649, pp. 138 146 http://ceur-ws.org/vol-1649, Series ISSN 1613-0073, c 2016 N. Orekhov, L. Bajer, M. Holeňa Testing Gaussian Process Surrogates on

More information

YURI LEVIN AND ADI BEN-ISRAEL

YURI LEVIN AND ADI BEN-ISRAEL Pp. 1447-1457 in Progress in Analysis, Vol. Heinrich G W Begehr. Robert P Gilbert and Man Wah Wong, Editors, World Scientiic, Singapore, 003, ISBN 981-38-967-9 AN INVERSE-FREE DIRECTIONAL NEWTON METHOD

More information

Figure 1: Bayesian network for problem 1. P (A = t) = 0.3 (1) P (C = t) = 0.6 (2) Table 1: CPTs for problem 1. (c) P (E B) C P (D = t) f 0.9 t 0.

Figure 1: Bayesian network for problem 1. P (A = t) = 0.3 (1) P (C = t) = 0.6 (2) Table 1: CPTs for problem 1. (c) P (E B) C P (D = t) f 0.9 t 0. Probabilistic Artiicial Intelligence Problem Set 3 Oct 27, 2017 1. Variable elimination In this exercise you will use variable elimination to perorm inerence on a bayesian network. Consider the network

More information

Running Time Analysis of Multi-objective Evolutionary Algorithms on a Simple Discrete Optimization Problem

Running Time Analysis of Multi-objective Evolutionary Algorithms on a Simple Discrete Optimization Problem Running Time Analysis of Multi-objective Evolutionary Algorithms on a Simple Discrete Optimization Problem Marco Laumanns 1, Lothar Thiele 1, Eckart Zitzler 1,EmoWelzl 2,and Kalyanmoy Deb 3 1 ETH Zürich,

More information

Investigation of Mutation Strategies in Differential Evolution for Solving Global Optimization Problems

Investigation of Mutation Strategies in Differential Evolution for Solving Global Optimization Problems Investigation of Mutation Strategies in Differential Evolution for Solving Global Optimization Problems Miguel Leon Ortiz and Ning Xiong Mälardalen University, Västerås, SWEDEN Abstract. Differential evolution

More information

TIES598 Nonlinear Multiobjective Optimization A priori and a posteriori methods spring 2017

TIES598 Nonlinear Multiobjective Optimization A priori and a posteriori methods spring 2017 TIES598 Nonlinear Multiobjective Optimization A priori and a posteriori methods spring 2017 Jussi Hakanen jussi.hakanen@jyu.fi Contents A priori methods A posteriori methods Some example methods Learning

More information

A Novel Multiobjective Formulation of the Robust Software Project Scheduling Problem

A Novel Multiobjective Formulation of the Robust Software Project Scheduling Problem A Novel Multiobjective Formulation of the Robust Problem Francisco Chicano, Alejandro Cervantes, Francisco Luna, Gustavo Recio 1 / 30 Software projects usually involve many people and many resources that

More information

Research Article A Convergent Differential Evolution Algorithm with Hidden Adaptation Selection for Engineering Optimization

Research Article A Convergent Differential Evolution Algorithm with Hidden Adaptation Selection for Engineering Optimization Mathematical Problems in Engineering, Article ID 135652, 11 pages http://dx.doi.org/10.1155/2014/135652 Research Article A Convergent Differential Evolution Algorithm with Hidden Adaptation Selection for

More information

Scattering of Solitons of Modified KdV Equation with Self-consistent Sources

Scattering of Solitons of Modified KdV Equation with Self-consistent Sources Commun. Theor. Phys. Beijing, China 49 8 pp. 89 84 c Chinese Physical Society Vol. 49, No. 4, April 5, 8 Scattering o Solitons o Modiied KdV Equation with Sel-consistent Sources ZHANG Da-Jun and WU Hua

More information

OBSERVER/KALMAN AND SUBSPACE IDENTIFICATION OF THE UBC BENCHMARK STRUCTURAL MODEL

OBSERVER/KALMAN AND SUBSPACE IDENTIFICATION OF THE UBC BENCHMARK STRUCTURAL MODEL OBSERVER/KALMAN AND SUBSPACE IDENTIFICATION OF THE UBC BENCHMARK STRUCTURAL MODEL Dionisio Bernal, Burcu Gunes Associate Proessor, Graduate Student Department o Civil and Environmental Engineering, 7 Snell

More information

An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules

An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules Joc Cing Tay and Djoko Wibowo Intelligent Systems Lab Nanyang Technological University asjctay@ntuedusg Abstract As the Flexible

More information

Probabilistic Optimisation applied to Spacecraft Rendezvous on Keplerian Orbits

Probabilistic Optimisation applied to Spacecraft Rendezvous on Keplerian Orbits Probabilistic Optimisation applied to pacecrat Rendezvous on Keplerian Orbits Grégory aive a, Massimiliano Vasile b a Université de Liège, Faculté des ciences Appliquées, Belgium b Dipartimento di Ingegneria

More information

(One Dimension) Problem: for a function f(x), find x 0 such that f(x 0 ) = 0. f(x)

(One Dimension) Problem: for a function f(x), find x 0 such that f(x 0 ) = 0. f(x) Solving Nonlinear Equations & Optimization One Dimension Problem: or a unction, ind 0 such that 0 = 0. 0 One Root: The Bisection Method This one s guaranteed to converge at least to a singularity, i not

More information

Optimization Performance of Irreversible Refrigerators Based on Evolutionary Algorithm

Optimization Performance of Irreversible Refrigerators Based on Evolutionary Algorithm OPEN ACCESS Conerence Proceedings Paper Entropy www.sciorum.net/conerence/ecea-1 Optimization Perormance o Irreversible Rerigerators Based on Evolutionary Algorithm Mohammad H. Ahmadi 1, *, Mohammad Ali

More information

8. INTRODUCTION TO STATISTICAL THERMODYNAMICS

8. INTRODUCTION TO STATISTICAL THERMODYNAMICS n * D n d Fluid z z z FIGURE 8-1. A SYSTEM IS IN EQUILIBRIUM EVEN IF THERE ARE VARIATIONS IN THE NUMBER OF MOLECULES IN A SMALL VOLUME, SO LONG AS THE PROPERTIES ARE UNIFORM ON A MACROSCOPIC SCALE 8. INTRODUCTION

More information

Constraint-Handling in Evolutionary Algorithms. Czech Institute of Informatics, Robotics and Cybernetics CTU Prague

Constraint-Handling in Evolutionary Algorithms. Czech Institute of Informatics, Robotics and Cybernetics CTU Prague in Evolutionary Algorithms Jiří Kubaĺık Czech Institute of Informatics, Robotics and Cybernetics CTU Prague http://cw.felk.cvut.cz/doku.php/courses/a0m33eoa/start pmotivation The general nonlinear programming

More information

Fin efficiency of the newly developed Compartmented Coil of a Single Coil Twin Fan System

Fin efficiency of the newly developed Compartmented Coil of a Single Coil Twin Fan System Fin eiciency o the newly developed Compartmented Coil o a Single Coil Twin Fan System ABSTRACT In predicting the perormance o any cooling coil, HVAC designers ace multiold challenges in designing the system

More information

Feedback linearization control of systems with singularities: a ball-beam revisit

Feedback linearization control of systems with singularities: a ball-beam revisit Chapter 1 Feedback linearization control o systems with singularities: a ball-beam revisit Fu Zhang The Mathworks, Inc zhang@mathworks.com Benito Fernndez-Rodriguez Department o Mechanical Engineering,

More information

(C) The rationals and the reals as linearly ordered sets. Contents. 1 The characterizing results

(C) The rationals and the reals as linearly ordered sets. Contents. 1 The characterizing results (C) The rationals and the reals as linearly ordered sets We know that both Q and R are something special. When we think about about either o these we usually view it as a ield, or at least some kind o

More information