Abstract Key Words: 1 Introduction

Similar documents
Section 10.7 Taylor series

LOWELL WEEKLY JOURNAL. ^Jberxy and (Jmott Oao M d Ccmsparftble. %m >ai ruv GEEAT INDUSTRIES

Section 6.1: Composite Functions

COURSE Iterative methods for solving linear systems

Extra Problems and Examples

Calculus I Exam 1 Review Fall 2016

MS 2001: Test 1 B Solutions

Section 3.5: Implicit Differentiation

Skill 6 Exponential and Logarithmic Functions

Riemann Integrable Functions

LOWELL WEEKLY JOURNAL.

T k b p M r will so ordered by Ike one who quits squuv. fe2m per year, or year, jo ad vaoce. Pleaie and THE ALTO SOLO

Vincent Guigues FGV/EMAp, Rio de Janeiro, Brazil 1.1 Comparison of the confidence intervals from Section 3 and from [18]

Cheat Sheet on Linearization

FUNCTIONAL ANALYSIS HAHN-BANACH THEOREM. F (m 2 ) + α m 2 + x 0

Neural Networks: Backpropagation

MATH 4211/6211 Optimization Basics of Optimization Problems

HOMEWORK ASSIGNMENT 5

(d). Why does this imply that there is no bounded extension operator E : W 1,1 (U) W 1,1 (R n )? Proof. 2 k 1. a k 1 a k

A nonlinear equation is any equation of the form. f(x) = 0. A nonlinear equation can have any number of solutions (finite, countable, uncountable)

Chap. 1. Some Differential Geometric Tools

Ch3 Operations on one random variable-expectation

On second order sufficient optimality conditions for quasilinear elliptic boundary control problems

PHYS 410/555 Computational Physics Solution of Non Linear Equations (a.k.a. Root Finding) (Reference Numerical Recipes, 9.0, 9.1, 9.

HARMONIC ANALYSIS. Date:

UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH

Functions Functions and Modeling A UTeach/TNT Course

Math 868 Final Exam. Part 1. Complete 5 of the following 7 sentences to make a precise definition (5 points each). Y (φ t ) Y lim

APPLICATIONS OF DIFFERENTIABILITY IN R n.

LOWELL WEEKLY JOURNAL

Zygfryd Kominek REMARKS ON THE STABILITY OF SOME QUADRATIC FUNCTIONAL EQUATIONS

Mathematics (Course B) Lent Term 2005 Examples Sheet 2

MATH 104: INTRODUCTORY ANALYSIS SPRING 2008/09 PROBLEM SET 8 SOLUTIONS

MATHS & STATISTICS OF MEASUREMENT

m d v dt = q E + q c v B

MAS331: Metric Spaces Problems on Chapter 1

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Analysis Qualifying Exam

Absolute Extrema. Joseph Lee. Metropolitan Community College

A collocation method for solving some integral equations in distributions

AP Calculus AB Summer Packet

1 Introduction. 2 Measure theoretic definitions

About solving time dependent Schrodinger equation

Essential Ordinary Differential Equations

Section 0.2 & 0.3 Worksheet. Types of Functions

Spring -07 TOPOLOGY III. Conventions

Homework 3. (33-40) The graph of an exponential function is given. Match each graph to one of the following functions.

for all subintervals I J. If the same is true for the dyadic subintervals I D J only, we will write ϕ BMO d (J). In fact, the following is true

MATH 31BH Homework 5 Solutions

where c R and the content of f is one. 1

Solution: f( 1) = 3 1)

Efficient Non-domination Level Update Method for Steady-State Evolutionary Multi-objective. optimization

INTRODUCTION TO TOPOLOGY, MATH 141, PRACTICE PROBLEMS

Optimization. Escuela de Ingeniería Informática de Oviedo. (Dpto. de Matemáticas-UniOvi) Numerical Computation Optimization 1 / 30

Milnor s Exotic 7-Spheres Jhan-Cyuan Syu ( June, 2017 Introduction

h(x) lim H(x) = lim Since h is nondecreasing then h(x) 0 for all x, and if h is discontinuous at a point x then H(x) > 0. Denote

5 Applying the Fokker-Planck equation

The Area bounded by Two Functions

Calculus & Analytic Geometry I

Weak convergence and large deviation theory

Introduction of Partial Differential Equations and Boundary Value Problems

BIFURCATION PHENOMENA Lecture 1: Qualitative theory of planar ODEs

7.1. Calculus of inverse functions. Text Section 7.1 Exercise:

Technische Universität Ilmenau Institut für Mathematik

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

Inverse problem and optimization

Advanced Calculus I Chapter 2 & 3 Homework Solutions October 30, Prove that f has a limit at 2 and x + 2 find it. f(x) = 2x2 + 3x 2 x + 2

Computational Optimization. Mathematical Programming Fundamentals 1/25 (revised)

Laplace s Equation. Chapter Mean Value Formulas

Applied Machine Learning for Biomedical Engineering. Enrico Grisan

b n x n + b n 1 x n b 1 x + b 0

Advanced Calculus II Unit 7.3: 7.3.1a, 7.3.3a, 7.3.6b, 7.3.6f, 7.3.6h Unit 7.4: 7.4.1b, 7.4.1c, 7.4.2b, 7.4.3, 7.4.6, 7.4.7

QUALIFYING EXAMINATION Harvard University Department of Mathematics Tuesday September 21, 2004 (Day 1)

Example. Determine the inverse of the given function (if it exists). f(x) = 3

MCE693/793: Analysis and Control of Nonlinear Systems

A Nonstandard Fourier Inequality

LECTURE 16 GAUSS QUADRATURE In general for Newton-Cotes (equispaced interpolation points/ data points/ integration points/ nodes).

Math 321 Final Examination April 1995 Notation used in this exam: N. (1) S N (f,x) = f(t)e int dt e inx.

Chapter 2. First-Order Differential Equations

Hadronic Decay of η and η

HOW TO NOT LOSE POINTS...

On sequential optimality conditions for constrained optimization. José Mario Martínez martinez

MATH 409 Advanced Calculus I Lecture 12: Uniform continuity. Exponential functions.

Lecture 32: Taylor Series and McLaurin series We saw last day that some functions are equal to a power series on part of their domain.

1 FUNCTIONS _ 5 _ 1.0 RELATIONS

Mini-batch Stochastic Approximation Methods for Nonconvex Stochastic Composite Optimization

Test 2 Review Math 1111 College Algebra

Differentiation Shortcuts

The query register and working memory together form the accessible memory, denoted H A. Thus the state of the algorithm is described by a vector

DRAFT - Math 101 Lecture Note - Dr. Said Algarni

Math 40510, Algebraic Geometry

ON A FUNCTIONAL EQUATION ASSOCIATED WITH THE TRAPEZOIDAL RULE - II

ECS289: Scalable Machine Learning

A Fifth-Order Iterative Method for Solving Nonlinear Equations

2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

arxiv: v1 [quant-ph] 15 Dec 2011

Newtonian Mechanics. Chapter Classical space-time

Chapter 4. Continuous Random Variables

Multilayer Neural Networks

C3 PAPER JUNE 2014 *P43164A0232* 1. The curve C has equation y = f (x) where + 1. (a) Show that 9 f (x) = (3)

Transcription:

f(x) x Ω MOP

Ω R n f(x) = ( (x),..., f q (x)) f i : R n R i =,..., q max i=,...,q f i (x) Ω n P F P F + R + n

f 3 f 3 f 3 η =., η =.9 ( 3 )

( ) ( ) f (x) x + x min = min x Ω (x) x [ 5,] (x 5) + (x 5)

5 5 5 5 5 5 x -5 5 - -5 5 5 x 5 5 5 5 x 5-5 -5 5 x 5 5

5 5 5 5 5 5 5 5 5 5 5 5 ( ) ( ) f (x) ln(x ) ln(x min = min ) x Ω (x) x (,] x. + x

8 6 - -5 5 x 7 6 5 3 5 6 7 8 x 8 6 - -5 5 ( ) ( f (x) n min = min i= x i + n ) x Ω (x) n x [,3] 3 i= x ii= x3 i

8 8 6 6 f f - -5-5 f -5 5 f Figure : Multistart approach for (T6) for MHT (left) and DMS (right) and with f declared as expensive function. The unique efficient point for this optimization problem is x = (,, ) with the function values f ( x) = f ( x) =. For all considered starting points all three algorithms compute this unique nondominated point respectively a point with vanishing distance to it. This is shown in Figure 5 for one instance. The 8 8 6 f f 6.5.5.5 f 6 3 f 5 6 8 f 6.5.5 f.5 6 Figure 5: Test run for (T7) for MHT (top left), EFOS (top right) and DMS (bottom) 9

min x Ω ( f (x) (x) ) = min x [,] ( x g(x)h(x) ) g(x) = + x h(x) = (x /g(x)) (x /g(x)) sin(8πx ) 8 8 6 6 -...6.8 -...6.8 8 6 -...6.8

8 8 6 6 -...6.8 -...6.8 8 6 -...6.8 n = ( ) f (x) ( x min = min x Ω (x) x [,] g(x) ) x g(x) g(x) = + 3 i= x i

starting points. DMS and MHT compute nondominated points for all instances of this problem. The multistart approach with randomly chosen starting points in Figure 8 shows that both compute different nondominated points given different starting points. However, the points computed by DMS are better spread than the points computed by MHT. Regarding the required function evaluations no clear statement can be made which algorithm needs less (DMS 9-6, MHT 3-69). In all runs MHT needs many function 8 8 6 6 f f...6.8.. f.6.8 f Figure 8: Multistart approach for (Jin) for MHT (left) and DMS (right) evaluations in the end of the procedure. Due to the nonconvexity and the local search strategy this number of function evaluations is needed to ensure the stopping criterion being fulfilled. This is exemplarily shown for one specific run in Figure 9. This instance again illustrates the coordinate search of DMS. 8 8 6 6 f f...6.8. f..6.8 f Figure 9: Test run for (Jin) for MHT (left) and DMS (right) As last nonconvex test problem we consider FF with n = 3 from [] given by ( n ( ) ) ( ) exp i= xi n f (x) ( n ( min = min 3 ) ) f (x) x Ω x [,] exp xi + n i= 3 (FF)

x = (.6,.38,.833) ( x) =.996 ( x) =.53 x t t = 3.398 7 ω x ω( x) = 8.6 3 (n + )(n + )/ n +

n min x Ω ( f (x) (x) ) = min x [,] n ( ) n n i= x i n n i= (x i ) n {, 3,, 5,,, 3,, 5} n = 5 n = n = 3.5 3.5.5...6.8 n = 5 n = n = 5 n = n = 5 n = n =

3.5 3.5.5...6.8 n = 5 n = n

n

percentage of solved test instances.8.6. MHT. DMS EFOS 5 5 number of expensive function evaluations percentage of solved test instances.8.6.. MHT DMS EFOS 3 5 number of expensive function evaluations percentage of solved test instances.8.6.. MHT DMS EFOS 5 5 number of expensive function evaluations percentage of solved test instances.8.6.. MHT DMS EFOS 3 5 number of expensive function evaluations n

ω : R n R ω(x) := min d max i=,...,q xf i (x) d f i : R n R i =,..., q ω ω(x) x R n x R n MOP ω(x) = x f( x) ω( x) ε ε =. percentage of solved test instances.8.6.. MHT DMS EFOS 5 5 number of expensive function evaluations percentage of solved test instances.8.6.. MHT DMS EFOS 3 5 number of expensive function evaluations

MOP n = q = Ω = R (x) = x + x x (x) = x + x x MOP n = q = Ω = R (x) = sin x (x) = exp ( ( x ) ( x ) ) MOP n = q = Ω = [, ] (x) = x + (x) = x + x MOP n {, 3,, 5,,, 3,, 5} q = Ω = [, ] n n (x) = x i + (x) = i= n x i MOP n = q = Ω = (, 3] [, 3] i= (x) = x ln(x ) + x (x) = x + x

MOP n =, q = Ω = (, ] (x) = ln(x ) ln(x ) (x) = x + x MOP n = 3, q = Ω = [, 3] 3 n n (x) = x i + (x) = i= n i= MOP n = 3, q = 3 Ω = (, ] [, ] [, ] n (x) = i= n x 3 i x i i= x 3 i (x) = (x i ) + x n f 3 (x) = ln(x ) + 5 f 3 i= n i= x i R n Pn p p = (n + )(n + )/ ψ = {ψ, ψ,..., ψ p } Pn m(x) Pn p m(x) = α j ψ j (x) j= α R p m(y i ) = f(y i ) i =,,..., p

M(ψ, Y )α ψ = f(y ) (M(ψ, Y )) ij = ψ j (y i ) i, j =,..., p f(y ) = (f(y ), f(y ),..., f(y p )) α ψ = (α, α,..., α p ) M(ψ, Y ) Y = {y, y,..., y p } R n M(ψ, Y ) ψ P n M(ψ, Y ) ψ P d n m f : R n R Y R n m L = {l, l,..., l p } Y = {y, y,..., y p } R n l i (y j ) = { i = j. ψ := { } ψ,..., ψ } p = {, x, x,..., x n, x, x x,..., x n x n, x n. ψ i l i, i =,,..., p Y Y = p i =,,..., p j i = i j p l i (y j ) l i (y j i ) = Y y i y j i Y l i (x) = l i (x)/l i (y i ) l j (x) = l j (x) l j (y i )l i (x) j =,,..., p, j i Y = {y, y,..., y p } R n m(x) = p i= f(yi )l i (x)

P n f : R n R Y = {y, y,..., y p } R n m L : R n R m L (x) = p i= f(yi )l i (x) f = m L Y f Pn Pn α i R i {,..., n} f(x) = p i= α il i (x) x R n f(y j ) = p i= α il i (y j ) = α j f(y j ) = m L (y j ) = p i= f(yi )l i (y j ) = f(y j ) y j Y, j =,..., p α j = f(y j ) j {,..., p} f = m L Y B ψ i l i, i =,,..., p Y Y = p ini B i =,,..., p j i = i j pini l i (y j ) l i (y j i ) > i p ini y i y j i Y i p ini y i y i l i (x) x B l i (x) = l i (x)/l i (y i ) l j (x) = l j (x) l j (y i )l i (x) j =,,..., p, j i B B k Y x k B k