arxiv: v1 [math.oc] 3 Aug 2010

Similar documents
Chapter 2 A Class of Robust Solution for Linear Bilevel Programming

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Lecture 10 Support Vector Machines. Oct

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

Pattern Classification

Global Optimization Using Hybrid Approach

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Generalized Linear Methods

Chapter Newton s Method

Lecture Notes on Linear Regression

Some modelling aspects for the Matlab implementation of MMA

DUE: WEDS FEB 21ST 2018

Integrals and Invariants of Euler-Lagrange Equations

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems

Global Sensitivity. Tuesday 20 th February, 2018

Lecture 12: Classification

Newton s Method for One - Dimensional Optimization - Theory

Optimal Solution to the Problem of Balanced Academic Curriculum Problem Using Tabu Search

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

The General Nonlinear Constrained Optimization Problem

Conic Programming in GAMS

Lecture 10 Support Vector Machines II

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

The Study of Teaching-learning-based Optimization Algorithm

Markov Chain Monte Carlo Lecture 6

On the Multicriteria Integer Network Flow Problem

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach

Least squares cubic splines without B-splines S.K. Lucas

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

DEGREE REDUCTION OF BÉZIER CURVES USING CONSTRAINED CHEBYSHEV POLYNOMIALS OF THE SECOND KIND

Chapter 4: Root Finding

An Improved multiple fractal algorithm

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

COS 521: Advanced Algorithms Game Theory and Linear Programming

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate

Integrals and Invariants of

Modified Seeker Optimization Algorithm for Unconstrained Optimization Problems

Sharp integral inequalities involving high-order partial derivatives. Journal Of Inequalities And Applications, 2008, v. 2008, article no.

A Hybrid Variational Iteration Method for Blasius Equation

Estimation: Part 2. Chapter GREG estimation

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

An Interactive Optimisation Tool for Allocation Problems

Numerical Solution of Ordinary Differential Equations

ALGORITHM FOR THE CALCULATION OF THE TWO VARIABLES CUBIC SPLINE FUNCTION

Kernel Methods and SVMs Extension

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function

Perfect Competition and the Nash Bargaining Solution

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

CHAPTER 7 CONSTRAINED OPTIMIZATION 2: SQP AND GRG

1 Convex Optimization

A stochastic algorithm for function minimization

Another converse of Jensen s inequality

Module 3: Element Properties Lecture 1: Natural Coordinates

A new Approach for Solving Linear Ordinary Differential Equations

Assortment Optimization under MNL

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

Fuzzy Approaches for Multiobjective Fuzzy Random Linear Programming Problems Through a Probability Maximization Model

Lagrange Multipliers Kernel Trick

A Robust Method for Calculating the Correlation Coefficient

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI

Feature Selection: Part 1

MODIFIED PARTICLE SWARM OPTIMIZATION FOR OPTIMIZATION PROBLEMS

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

A Study on Improved Cockroach Swarm Optimization Algorithm

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem

APPENDIX A Some Linear Algebra

Chapter Introduction

MMA and GCMMA two methods for nonlinear optimization

arxiv: v3 [cs.ne] 5 Jun 2013

Bezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization

Thin-Walled Structures Group

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

Math1110 (Spring 2009) Prelim 3 - Solutions

Multilayer Perceptrons and Backpropagation. Perceptrons. Recap: Perceptrons. Informatics 1 CG: Lecture 6. Mirella Lapata

Lecture 3. Ax x i a i. i i

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

Solving Nonlinear Differential Equations by a Neural Network Method

The Quadratic Trigonometric Bézier Curve with Single Shape Parameter

Neural networks. Nuno Vasconcelos ECE Department, UCSD

Lecture 16 Statistical Analysis in Biomaterials Research (Part II)

Numerical Heat and Mass Transfer

Test Problem Construction for Single-Objective Bilevel Optimization

Research Article. Almost Sure Convergence of Random Projected Proximal and Subgradient Algorithms for Distributed Nonsmooth Convex Optimization

arxiv: v1 [math.oc] 19 Dec 2013

FUZZY FINITE ELEMENT METHOD

Review: Fit a line to N data points

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

3.1 ML and Empirical Distribution

Transcription:

arxv:1008.0549v1 math.oc] 3 Aug 2010 Test Problems n Optmzaton Xn-She Yang Department of Engneerng, Unversty of Cambrdge, Cambrdge CB2 1PZ, UK Abstract Test functons are mportant to valdate new optmzaton algorthms and to compare the performance of varous algorthms. There are many test functons n the lterature, but there s no standard lst or set of test functons one has to follow. New optmzaton algorthms should be tested usng at least a subset of functons wth dverse propertes so as to make sure whether or not the tested algorthm can solve certan type of optmzaton effcently. Here we provde a selected lst of test problems for unconstraned optmzaton. Ctaton detal: X.-S. Yang, Test problems n optmzaton, n: Engneerng Optmzaton: An Introducton wth Metaheurstc Applcatons (Eds Xn-She Yang), John Wley & Sons, (2010).

In order to valdate any new optmzaton algorthm, we have to valdate t aganst standard test functons so as to compare ts performance wth well-establshed or exstng algorthms. Therearemanytestfunctons, sotheresnostandardlstorsetoftestfunctons one has to follow. However, varous test functons do exst, so new algorthms should be tested usngat least a subsetof functons wth dverse propertes so as to make sure whether or not the tested algorthm can solve certan type of optmzaton effcently. In ths appendx, we wll provde a subset of commonly used test functons wth smple bounds as constrants, though they are often lsted as unconstraned problems n lterature. We wll lst the functon form f(x), ts search doman, optmal solutons x and/or optmal objectve value f. Here, we use x = (x 1,...,x n ) T where n s the dmenson. Ackley s functon: 20exp 1 1 5 n x 2 ] 1 exp n ] cos(2πx ) +20+e, (1) where n = 1,2,..., and 32.768 x 32.768 for = 1,2,...,n. Ths functon has the global mnmum f = 0 at x = (0,0,...,0). De Jong s functons: The smplest of De Jong s functons s the so-called sphere functon x 2, 5.12 x 5.12, (2) whose global mnmum s obvously f = 0 at (0,0,...,0). Ths functon s unmodal and convex. A related functon s the so-called weghted sphere functon or hyper-ellpsod functon x 2, 5.12 x 5.12, (3) whch s also convex and unmodal wth a global mnmum f = 0 at x = (0,0,...,0). Another related test functon s the sum of dfferent power functon whch has a global mnmum f = 0 at (0,0,...,0). Easom s functon: x +1, 1 x 1, (4) cos(x)cos(y)exp (x π) 2 +(y π) 2], (5) whose global mnmum s f = 1 at x = (π,π) wthn 100 x,y 100. It has many local mnma. Xn-She Yang extended n 2008 ths functon to n dmensons, and we have ( 1) n( n ) cos 2 (x ) exp (x π) 2], (6) whose global mnmum f = 1 occurs at x = (π,π,...,π). Here the doman s 2π x 2π where = 1,2,...,n.

Equalty-Constraned Functon: subject to an equalty constrant (a hyper-sphere) ( n n) n x, (7) x 2 = 1. (8) The global mnmum f = 1 of f(x) occurs at x (1/ n,...,1/ n) wthn the doman 0 x 1 for = 1,2,...,n. Grewank s functon: 1 4000 n x 2 cos( x )+1, 600 x 600, (9) whose global mnmum s f = 0 at x = (0,0,...,0). Ths functon s hghly multmodal. Mchaelwcz s functon: sn(x ) sn( x2 ] 2m π ), (10) where m = 10, and 0 x π for = 1,2,...,n. In 2D case, we have f(x,y) = sn(x)sn 20 ( x2 π ) sn(y)sn20 ( 2y2 ), (11) π where (x,y) 0,5] 0,5]. Ths functon has a global mnmum f 1.8013 at x = (x,y ) = (2.20319,1.57049). Perm Functons: { n ( j +β) ( x ]} )j 1, (β > 0), (12) j=1 whch has the global mnmum f = 0 at x = (1,2,...,n) n the search doman n x n for = 1,...,n. A related functon { n (+β) x j (1 )j]} 2, (13) j=1 has the global mnmum f = 0 at (1,1/2,1/3,...,1/n) wthn the bounds 1 x 1 for all = 1,2,...,n. As β > 0 becomes smaller, the global mnmum becomes almost ndstngushable from ther local mnma. In fact, n the extreme case β = 0, every soluton s also a global mnmum. Rastrgn s functon: 10n+ ] x 2 10cos(2πx ), 5.12 x 5.12, (14)

whose global mnmum s f = 0 at (0,0,...,0). Ths functon s hghly multmodal. Rosenbrock s functon: n 1 (x 1) 2 +100(x +1 x 2 )2], (15) whose global mnmum f = 0 occurs at x = (1,1,...,1) n the doman 5 x 5 where = 1,2,...,n. In the 2D case, t s often wrtten as whch s often referred to as the banana functon. Schwefel s functon: f(x,y) = (x 1) 2 +100(y x 2 ) 2, (16) ( ) x sn x, 500 x 500, (17) whose global mnmum f 418.9829n occurs at x = 420.9687 where = 1,2,...,n. Sx-hump camel back functon: f(x,y) = (4 2.1x 2 + 1 3 x4 )x 2 +xy +4(y 2 1)y 2, (18) where 3 x 3 and 2 y 2. Ths functon has two global mnma f 1.0316 at (x,y ) = (0.0898, 0.7126) and ( 0.0898,0.7126). Shubert s functon: n ( )] cos +(+1)x n ( )] cos +(+1)y, (19) whchhas18global mnmaf 186.7309 forn=5nthesearch doman 10 x,y 10. Xn-She Yang s functons: ( n ) x exp sn(x 2 ], ) (20) whch has the global mnmum f = 0 at x = (0,0,...,0) n the doman 2π x 2π where = 1,2,...,n. Ths functon s not smooth, and ts dervatves are not well defned at the optmum (0,0,...,0). A related functon s ( n ) ( x exp x 2 ), 10 x 10, (21) whch has multple global mnma. For example, for n = 2, we have 4 equal mnma f = 1/ e 0.6065 at (1/2,1/2), (1/2, 1/2), ( 1/2,1/2) and ( 1/2, 1/2).

Yang also desgned a standng-wave functon wth a defect e n (x /β) 2m 2e n ] n x2 cos 2 x, m = 5, (22) whch has many local mnma and the unque global mnmum f = 1 at x = (0,0,...,0) for β = 15 wthn the doman 20 x 20 for = 1,2,...,n. The locaton of the defect can easly be shft to other postons. For example, e n (x /β) 2m 2e n (x π) 2] n cos 2 x, m = 5, (23) has a unque global mnmum f = 1 at x = (π,π,...,π) Yang also proposed another multmodal functon { n ] } sn 2 (x ) exp( x 2 ) exp sn 2 x ], (24) whose global mnmum f = 1 occurs at x = (0,0,...,0) n the doman 10 x 10 where = 1,2,...,n. In the 2D case, ts landscape looks lke a wonderful candlestck. Most test functons are determnstc. Yang desgned a test functon wth stochastc components f(x,y) = 5e β(x π)2 +(y π) 2] K K ǫ j e α(x )2 +(y j) 2], (25) j=1 where α,β > 0 are scalng parameters, whch can often be taken as α = β = 1. Here ǫ j are random varables and can be drawn from a unform dstrbuton ǫ j Unf0,1]. The doman s 0 x,y K and K = 10. Ths functon has K 2 local valleys at grd locatons and the fxed global mnmum at x = (π,π). It s worth pontng that the mnmum f mn s random, rather than a fxed value; t may vary from (K 2 +5) to 5, dependng α and β as well as the random numbers drawn. Furthermore, he also desgned a stochastc functon x ǫ 1, 5 x 5, (26) where ǫ ( = 1,2,...,n) are random varables whch are unformly dstrbuted n 0,1]. That s, ǫ Unf0,1]. Ths functon has the unque mnmum f = 0 at x = (1,1/2,...,1/n) whch s also sngular. Zakharov s functons: ( 1 x 2 + 2 ) 2 ( 1 ) 4, x + x (27) 2 whose global mnmum f = 0 occurs at x = (0,0,...,0). Obvously, we can generalze ths functon as K x 2 + Jn 2k, (28) where K = 1,2,...,20 and k=1 J n = 1 x. (29) 2

References 1] D. H. Ackley, A Connectonst Machne for Genetc Hllclmbng, Kluwer Academc Publshers, 1987. 2] C. A. Floudas, P. M., Pardalos, C. S. Adjman, W. R. Esposto, Z. H. Gumus, S. T. Hardng, J. L. Klepes, C. A., Meyer, C. A. Scheger, Handbook of Test Problems n Local and Global Optmzaton, Sprnger, 1999. 3] A. Hedar, Test functon web pages, http://www-optma.amp..kyoto-u.ac.jp /member/student/hedar/hedar fles/testgo fles/page364.htm 4] M. Molga, C. Smutnck, Test functons for optmzaton needs, http://www.zsd.ct.pwr.wroc.pl/fles/docs/functons.pdf 5] X.-S. Yang, Frefly algorthm, Lévy flghts and global optmzaton, n: Research and Development n Intellgent Systems XXVI, (Eds M. Bramer et al.), Sprnger, London, pp. 209-218 (2010). 6] X.-S. Yang and S. Deb, Engneerng optmzaton by cuckoo search, Int. J. Math. Modelng and Numercal Optmzaton, 1, No. 4, 330-343 (2010). 7] X.-S. Yang, Frefly algorthm, stochastc test functons and desgn optmzaton, Int. J. Bo-nspred Computaton, 2, No. 2, 78-84 (2010).