arxiv: v1 [math.oc] 16 Jul 2016

Transcription

1 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms Zhong Jin David Y Gao arxiv: v [math.oc] 6 Jul 06 Abstract we study a canonical duality method to solve a mixed-integer nonconvex fourth-order polynomial minimization problem with fixed cost terms. This constrained nonconvex problem can be transformed into a continuous concave maximization dual problem without duality gap. The global optimality conditions are proposed and the existence and uniqueness criteria are discussed. Application to a decoupled mixed-integer problem is illustrated and analytic solution for a global minimum is obtained under some suitable conditions. Several examples are given to show the method is effective. Keywords Canonical duality theory Mixed-integer programming Fixed cost objective function Global optimization Mathematics Subject Classification 90C, 49N Introduction In this paper, we consider mixed integer minimization problem as follows: (P b ) : minp(x,v) = Q(x)+W(x) f T v (x,v) χ v } () ( where Q(x) = xt Ax c T x, W(x) = xt Bx α ), A R n n is a symmetric matrix and B R n n is a symmetric positive semi-definite matrix, α > 0 is a real number, c,f R n are two given vectors, v 0,} n means fixed cost variable, and χ v = (x,v) R n 0,} n v x v}. () The constraint x [ v,v] with v 0,} n is called as fixed charge constraint []and problem P b belongs to the class of fixed charge problems, which have attracted considerable attention and extensive study in the integer programming literature in recent years [ 0]. This class of problem has many practical applications in a variety of problems, including facility location [], network design [3, 5, 7], lot-sizing application [4, 6], and transportation [6, 8 0].The literature provides only a few exact methods for solving fixed charge problems, such as branch-and-bound type methods, then a good deal of effort has been devoted to finding approximate solutions to fixed charge problems by heuristic methods. Although these problems can be written as mixed integer programs, their computational requirements usually increase exponentially with the size of the problem due to the existence of fixed cost terms in its objective function. Canonical duality theory, as a breakthrough methodological theory, was originally developed from infinite dimensional nonconvex systems []. It has been applied successfully for solving a class of challenging problems in global optimization and nonconvex analysis, such as quadratic problems [ 4], box constrained problems problems [5], polynomial optimization [5 7], Z. Jin( ) Department of Mathematics, Shanghai Maritime University, Shanghai, 0306, P.R.China asdjz34@63.com D.Y. Gao ( ) Faculty of Science and Technology, Federation University Australia, Victoria 3353, Australia d.gao@federation.edu.au

2 Jin & Gao transportation problems [0], location problems [8], and integer programming problems [, 9]. Under some certain conditions, these problems can be solved by canonical dual method to obtain global minimums of the primal problems. Moreover, problem P b is related with some problems solved by canonical duality method. Particularly, if the fixed cost term f T v = 0 and the feasible space is defined by χ = x R n L l x L u } where L l and L u are two given vectors, then P b changes to the nonconvex polynomial programming problem with box constraints in [5]. If f T v = 0 and the feasible space is simply defined by χ = x R n x i = 0 or,i =,,n}, P b converts to the simple 0- quadratic programming problem in []. If W(x) = 0, P b becomes the fixed cost quadratic problem that the canonical duality theory is introduced to solve in [0], where the existence and uniqueness of global optimal solutions are proved. In this paper, we design a canonical duality algorithm to solve a mixed-integer nonconvex fourth-order polynomial minimization problem with fixed cost terms. The presented method is inspired by the method introduced by David Y. Gao for fixed cost quadratic programs [0] and provides a nontrivial extension of his work to polynomial minimization problem. Based on the geometrically admissible operators of [0, 5], we define a new geometrically admissible operator and transform the fourth-order polynomial minimization problem in R n into a continuous concave maximization dual problem in R n+ without duality gap. We give the global optimality conditions and obtain the existence and uniqueness criteria. Furthermore, we discuss the application to decouple problem. Some numerical experiments are given to show our method is effective. This paper is organised as follows. In the next section, the canonical dual problem for P b is formulated, and the corresponding complementary-dual principle is showed. The global optimality criteria are put forward in Section 3, and the existence and uniqueness criteria are proposed in Section 4. We apply our method to decoupled problem in Section 5 and illustrate the effectiveness of our method by some examples in Section 6. Some conclusions and further work are given in the last section. Canonical dual problem We propose and describe the canonical dual problem of P b without duality gap in this section. First, the box constraints v x v, v 0,} n in the primal problem can be rewritten as relaxed quadratic form: x x v, v (v e) 0, (3) where e = } n is an n-vector of all ones and notation x v = (x v,x v,,x n v n ) denotes the Hadamard product between any two vectors x,v R n. So P b can be reformulated to the relaxed problem in the following: (P r ) : minp(x,v) = xt Ax c T x+ ( ) xt Bx α f T v x x v,v (v e) 0}. (4) In our paper we introduce a so-called geometrically admissible operator ( ξ y = Λ(x,v) = = ǫ) ξ ǫ = xt Bx α x x v R n+, (5) v v v ǫ and it is trivial to see that the constraints (3) are equivalent to ǫ 0. Define V(y) = ξ +Ψ(ǫ), (6) where Ψ(ǫ) = 0 if ǫ 0 R n, + otherwise, and let U(x,v) = Q(x) + f T v, then unconstrained canonical form of relaxed primal problem (P r ) can be obtained: (P c ) : minπ(x,v) = V(Λ(x,v)) U(x,v) x R n,v R n }. (8) (7)

3 3 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms ( ) ς Set y = = ς ( σ σ ξ be the dual vector of y = ǫ σ conjugate of V (y) can be defined as ) with ǫ 0, then sup-fenchel V (y ) = sup y R +n y T y V(y)} where = sup ξς ξ α ξ }+ sup sup ǫ T σ +ǫ T σ Ψ(ǫ)} ǫ R n ǫ R n = ς +Ψ (σ), s.t. ς α, (9) Ψ 0 if σ 0 R (σ) = n,σ 0 R n + otherwise. Now the extended canonical duality relations can be given from the theory of convex analysis: and when ǫ 0 and σ 0 we have then it yields that (0) y V(y) y V (y ) V(y)+V (y ) = y T y, () ǫ T σ +ǫ T σ = (ξ ς) 0, ǫ T σ = 0 and ǫ T σ = 0. () Apparently it holds from ǫ T σ = σ T (v v v) = 0 in () that v v v = 0 for σ > 0. By replacing V(Λ(x,v)) in (8) by the Fenchel-Young equality V(Λ(x,v)) = Λ(x,v) T y V (y ), the total complementary function Ξ(x,v,ς,σ) corresponding to (P c ) can be defined in the following: where Ξ(x,v,ς,σ) = Λ(x,v) T y V (y ) U(x,v) = xt G(ς,σ )x c T x+v T Diag(σ )v (f +σ +σ ) T v ς ας Ψ (σ), (3) G(ς,σ ) = A+ςB +Diag(σ ), (4) and Diag(σ ) denotes a diagonal matrix with diagonal elements (σ ) i, i =,,n. Then we get the canonical dual function: Π d (ς,σ) = staξ(x,v,ς,σ) x R n,v R n } = U Λ (ς,σ) V (ς,σ), (5) where U Λ (ς,σ) = sta Λ(x,v) T y U(x,v) x R n,v R n} is the Λ-conjugate transformation and the notation sta } represents calculating stationary point with respect to (x, v). Correspondingly, introducing a dual feasible space S = (ς,σ) R R n ς α,σ 0,σ > 0,c C ol (G(ς,σ ))}, (6) where C ol (G) denotes the column space of G, we can construct the canonical dual function as follows: Π d (ς,σ) = U Λ (ς,σ) ς = ct G + (ς,σ )c 4 i= (σ ) i (f i +(σ ) i +(σ ) i ) ς ας, (ς,σ) S, (7)

4 Jin & Gao 4 where G + stands for the Moore-Penrose generalized inverse of G. Then it leads to the canonical dual problem for the primal problem (P b ) as (P ) : max Π d (ς,σ) (ς,σ) S }. (8) Next we present the complementary-dual principle and for simplicity we denote t s = t i /s i } n for any given n-vectors t = t i } n and s = s i } n. Theorem If ( ς, σ) S is a KKT point of Π d (ς,σ), then the vector ( x, v) is feasible to the primal problem (P b ) and we have where P( x, v) = Ξ( x, v, ς, σ) = Π d ( ς, σ), (9) x = x( ς, σ ) = G + ( ς, σ )c, (0) v = v( σ) = (f + σ + σ ) σ. () Proof: Introducing lagrange multiplier ǫ = (ǫ 0,ǫ,ǫ ) R R n R n with the respective three inequalities in (6), we have the lagrangian function Θ for problem (P ): It follows from the criticality conditions that Θ(ς,σ,ǫ 0,ǫ,ǫ ) = Π d (ς,σ) ǫ 0 (ς +α) ǫ T σ ǫ T σ. () σ Θ( ς, σ,ǫ 0,ǫ,ǫ ) = 0, σ Θ( ς, σ,ǫ 0,ǫ,ǫ ) = 0 ǫ = σ Π d ( ς, σ) = x( ς, σ ) x( ς, σ ) v( σ) (3) ǫ = σ Π d ( ς, σ) = v( σ) v( σ) v( σ), (4) where x( ς, σ ) = G + ( ς, σ )c and v( σ) = (f + σ + σ ) σ. Then the corresponding KKT conditions include σ T ǫ = 0 and σ T ǫ = 0, (5) where σ 0, σ > 0, ǫ 0 and ǫ 0. By ǫ 0 and (3), we have x x v. Clearly, together with σ > 0 and (4), σ T ( v v v) = 0 in (5) implies that v v = v. So when ( ς, σ) is a KKT point of the problem Π d (ς,σ), ( x, v) is feasible point of (P b ). Furthermore, v = (f + σ + σ ) σ implies ( ) i +( σ ) ( σ ) i +( σ ) i i = σ f T ( v v) = v T Diag( σ ) v ( σ ) i and i= v T Diag( σ ) v = v T (f + σ + σ ), then with x = G + ( ς, σ )c and Ψ ( σ) = 0, from (7) we get Π d ( ς, σ) = xt G( ς, σ ) x c T x v T Diag( σ ) v ς α ς = xt G( ς, σ ) x c T x+ v T Diag( σ ) v v T (f + σ + σ ) ς α ς (6) = Ξ( x, v, ς, σ), where ( ς, σ) S. By (4), (6), v T Diag( σ ) v = σ T ( v v) and x T Diag( σ ) x = σ T ( x x), we have Π d ( ς, σ) = Ξ( x, v, ς, σ) = ) xt( A+ ςb +Diag( σ ) x c T x+ σ T ( v v) vt (f + σ + σ ) ς α ς = xt A x c T x f T v + σ T ( x x v)+ σ T ( v v v) + ς xt B x ς α ς. (7)

5 5 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms By substituting σ T( x x v) = 0 and σt ( v v v) = 0 into (7), we obtain Π d ( ς, σ) = Ξ( x, v, ς, σ) = xt A x c T x f T v + ς xt B x ς α ς. (8) From ς Θ( ς, σ,ǫ 0,ǫ,ǫ ) = 0, together with x = G + ( ς, σ )c it follows that and the accompanying KKT conditions include xt B x ς α ǫ 0 = 0, (9) ς +α 0, ǫ 0 0, ǫ 0 ( ς +α) = 0. (30) Suppose ǫ 0 < 0, it holds from ǫ 0 ( ς +α) = 0 that ς +α = 0, then due to (9) we have xt B x ǫ 0 = 0, on the other hand, since B is a symmetric positive semi-definite matrix and ǫ 0 < 0, we acquire xt B x ǫ 0 > 0, which is a contradiction, then ǫ 0 = 0. Thereby from (9), we have xt B x ς α = 0, (3) which implies that α = xt B x ς and ς = xt B x α, then the following equality holds: ς +α ς = ς + Thus it is apparent from (8) that ( xt B x ς) ς = ς xt B x ς = ς xt B x ( ) xt B x α. Π d ( ς, σ) = Ξ( x, v, ς, σ) = xt A x c T x+ ( ) xt B x α f T v = P( x, v). (3) The proof is completed. 3 Global Optimality Criteria The global optimality conditions for problem (P b ) are developed in this section. Firstly, we introduce the following useful feasible space: S + = (ς,σ) R R n ς α,σ 0,σ > 0,G(ς,σ ) 0}, (33) where G(ς,σ ) 0 means that G(ς,σ ) is a positive definite matrix. It is easy to prove that S + is a convex set. In the following, we use G for short to denote G(ς,σ ). For convenience, we give the first and second derivatives of function Π d (ς,σ): Π d (ς,σ) = ct G G ς G c ς α } n ct G G (σ ) i G c f i+(σ ) i+(σ ) i (σ ) i i= ( ) } n f j+(σ ) j+(σ ) j (σ ) j + fi+(σ ) i+(σ ) i 4 (σ ) i j=, (34) Π d (ς,σ) = J J J 3, (35)

6 Jin & Gao 6 in which J, J and J 3 R (n+) (n+) are defined as J =......, J = [ ] Z T G Z 0 (n+) n, and J 0 n (n+) 0 3 = n n 0 0 n 0 n 0 n H σ H σσ, 0 n H σσ H σ where [ G ς G G c, ] Z = (σ ) G G c, (σ ) G G c,..., (σ ) n G c, H σ = Diag }, (σ ) i } (σ ) i +f i H σσ = H σσ = Diag (σ ), i H σ = Diag ((σ ) i +f i ) } (σ ) 3. i Lemma The canonical dual function Π d (ς,σ) is concave on S +. Proof: For any given non-zero vector W = r s R n+, where r R, s R n, t R n, ( ) t r let Z 0 =, by (35), with G 0 and σ s > 0 we have W T Π d (ς,σ)w = W T J W W T J W W T J 3 W = r (ZZ 0 ) T G (ZZ 0 )+ i= (σ ) i ( ) (σ ) i +f i s i t i (σ ) i 0, (36) so the canonical dual function Π d (ς,σ) is concave on S +. Theorem 3 Suppose that the vector ȳ = ( ς, σ) = ( ς, σ, σ ) S + is a critical point of the dual function Π d (ς,σ), then ȳ is a global maximizer of Π d (ς,σ) on S +. Let ( x, v) = ( G ( ς, σ )c, (f + σ + σ ) σ ) ), the ( x, v) is a global minimum of P(x,v) on χ v (i.e., the ( x, v) is a global solution of (P b )), and P( x, v) = min (x,v) χ v P(x,v) = max (ς,σ) S + Π d (ς,σ) = Π d ( ς, σ). (37) Proof: From Lemma the dual function Π d (ς,σ) is concave on S +, so ȳ = ( ς, σ) is a global maximizer of Π d (ς,σ) on S +, i.e., Π d ( ς, σ) = max (ς,σ) S + Π d (ς,σ), (38) and this critical point of Π d (ς,σ) is a KKT point of Π d (ς,σ). Then by Theorem, the vector ( x, v) defined by (0)(now G + ( ς, σ ) = G ( ς, σ )) and () is a feasible solution to problem (P b ) and P( x, v) = Ξ( x, v, ς, σ) = Π d ( ς, σ). (39) As G 0 and σ > 0, we have (x,v) Ξ(x,v,ς,σ) 0 and (ς,σ) Ξ(x,v,ς,σ) 0. So Ξ(x,v,ς,σ) is convex in (x,v) R n = R n R n and concave in y = (ς,σ) S +, then Π d (ς,σ) = min (x,v) RnΞ(x,v,ς,σ), (40)

7 7 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms and ( x, v,ȳ ) = ( x, v, ς, σ) is a saddle point of the total complementary function Ξ( x, v, ς, σ) on R n S +, thereby the saddle min-max duality theory holds max (ς,σ) S + min (x,v) RnΞ(x,v,ς,σ) = min max (x,v) R n (ς,σ) S + Ξ(x,v,ς,σ). (4) Combining (39), (38), (40) and (4), we get P( x, v) = min max (x,v) R n (ς,σ) S + Ξ(x,v,ς,σ), (4) where ( x, v) χ v. ( ξ By (5), Λ(x,v) = = ǫ) ξ ǫ = xt Bx α x x v. When (ς,σ) S +, together with (9) and ǫ v v v (0), V (y ) = ς. From (3) and U(x,v) = Q(x)+f T v, when (ς,σ) S + we obtain Ξ(x,v,ς,σ) = Λ(x,v) T y V (y ) U(x,v) = ξ T ǫ ς ς ( Q(x)+f T v) (a) Consider max (ς,σ) S + ( ς +ξς). ǫ σ σ = Q(x) f T v ς +ξς +ǫ T σ +ǫ T σ, (43) max ( (ς,σ) S + ς +ξς) = ξ = ( ) xt Bx α = W(x). (44) (b) Consider max (ς,σ) S + (ǫ T σ +ǫ T σ ). ( ) ( ) ǫ x x v Noting =, by (3) we define the relaxed quadratic form region ǫ v v v then we have χ v χ v and χ v = (x,v) R n R n x x v, v (v e) 0}, (45) ( ǫ ) 0 (x,v) χ ǫ v. (46) It follows from (ς,σ) S + that σ 0 and σ > 0, thus with (46) we have max (ǫ T (ς,σ) S + σ +ǫ T 0 if (x,v) σ χv, ) = + otherwise( i.e., if (x,v) / χ v ). (47) Taking (43), (44) and (47) into consideration, we find max (ς,σ) S + Ξ(x,v,ς,σ) = Q(x) f T v + max = (ς,σ) S + ( ς +ξς)+ max (ς,σ) S + (ǫ T σ +ǫ T σ ) Q(x)+W(x) f T v = P(x,v) if (x,v) χ v, + otherwise. (48) Then it holds form(4) and (48) that P( x, v) = min max (x,v) R n (ς,σ) S + Ξ(x,v,ς,σ) = min (x,v) χ v P(x,v). (49) Because χ v χ v, it yields min (x,v) χ v P(x,v) min (x,v) χ v P(x,v),

8 Jin & Gao 8 which with (49) lead to which with ( x, v) χ v implies Due to the fact that (50), (39) and (38), we get P( x, v) min (x,v) χ v P(x,v), P( x, v) = min (x,v) χ v P(x,v). (50) P( x, v) = min (x,v) χ v P(x,v) = max (ς,σ) S + Π d (ς,σ) = Π d ( ς, σ). Theorem 3 shows that our fourth-order polynomial mixed-integer minimization problem (P b ) is canonically dual to the concave maximization problem as follows: } (P+) : max Π d (ς,σ) (ς,σ) S +. (5) Noted that Π d (ς,σ) is a continuous concave function over a convex feasible space S +, if ( ς, σ) S + is a critical point of Π d (ς,σ), then it must be a global maximum point of problem (P + ), and ( x, v) = ( G ( ς, σ )c, (f + σ + σ ) σ ) ) should be a global minimum point of problem (P b ). Using (σ ) i = f i +(σ ) i is the solution of min (σ) i >0 (σ ) (f i +(σ ) i i +(σ ) i ), we have So for a fixed (ς,σ ), let max (f i +(σ ) (σ ) i >0 4(σ ) i +(σ ) i ) = (f i +(σ ) i ) +. (5) i Π g (ς,σ ) = max σ >0 Πd (ς,σ) = ct G c where (f i +(σ ) i ) + ς ας, (ς,σ ) S ςσ +, (53) i= S + ςσ = (ς,σ ) R R n ς α,σ 0,G(ς,σ ) 0,f i +(σ ) i 0, i =,,n}. (54) Then we can write the canonical dual problem (P + ) to a simple form: (P g + ) : max Π g (ς,σ ) (ς,σ ) S + ςσ }. (55) Moreover, set δ(t) + = δ i (t i ) + } n R n, where δ i (t i ) + if ti > 0, = 0 if t i < 0, i =,,n. (56) By Theorem 3, it can be easily to get next theorem about analytic solution to primal problem (P b ). Theorem 4 Given A R n n, B 0 R n n, c,f R n, if ( ς, σ ) S + ςσ is a critical point of Π g (ς,σ ), then the vector ( x, v) = ( G ( ς, σ )c,δ(f + σ ) +) (57) is a global minimum point of (P b ). 4 Existence and Uniqueness Criteria In this section we study certain existence and uniqueness conditions for the canonical dual problem to have a critical point. We first let S + = (ς,σ) R R n ς α,σ 0,σ 0,G 0}, (58) S + = (ς,σ) S + det(g) = 0}. (59) g a = (ς,σ) R R n σ 0,det(G) = 0}. (60)

9 9 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms Lemma 5 If g a S +, it holds that S + = g a. Proof: It is obvious that S + is a closed convex set. From g a S +, we have which shows Then it holds (ς,σ ) R R n det(g) = 0} (ς,σ ) R R n ς α,σ 0,G 0} (ς,σ ) R R n G 0} (ς,σ ) R R n ς α,σ 0}. thus together with (59) we have S + = (ς,σ) R R n σ 0,G 0}, S + = (ς,σ) R R n σ 0,det(G) = 0} = g a. (6) Motivated by the existence and uniqueness criteria given in [4, 0], we have the following theorem about existence and uniqueness criteria. Theorem 6 Given A R n n and a symmetric positive semi-definite matrix B R n n, α > 0, c,f R n, such that S + and g a S +. If for any given (ς 0,σ 0 ) g a and (ς,σ) S +, lim t 0 + Π d (ς 0 +tς,σ 0 +tσ) =, (6) then the canonical dual problem (P g + ) has at least one critical point ( ς, σ ) S + ςσ and the vector ( x, v) = ( G ( ς, σ )c,δ(f + σ ) +) is a global optimizer of the primal problem (P b ). Furthermore, if A, B are two diagonal matrices and c i 0, i =,,n, then the vector ( x, v) is a unique global minimum point of (P b ). Proof: It holds from g a S + and Lemma 5 that S + = g a. By the definition, S + is a closed convex set and its interior is S +. If for any given (ς,σ) S+ lim t + Πd (tς,tσ) = lim t + ( ct G (tς,tσ )c 4 i= t(σ ) i (f i +t(σ ) i +t(σ ) i ) t ς αtς) =, (63) which with (6) implies that the function Π d (ς,σ) is coercive on the open convex set S +. Therefore, (P + ) has at least one critical point ( ς, σ) S+ and the vector ( x, v) = (G ( ς, σ )c, (f + σ + σ ) σ )) is a global minimum point of problem (P b ). So accordingly (P g +) has at least one critical point ( ς, σ ) S + ςσ and the vector ( x, v) = ( G ( ς, σ )c,δ(f + σ ) +) is a global minimum point of (P b ). Next we will prove the canonical dual function Π d (ς,σ) is strict concave on S +. From (36), we have W T Π d (ς,σ)w = r (ZZ 0 ) T G (ZZ 0 )+ i= ( ) (σ ) i +f i s i t i. (64) (σ ) i (σ ) i ( ) r (a) If Z 0 = = 0, W 0 leads to t 0, then with (σ s ) i > 0 and f i +(σ ) i 0, we get W T Π d (ς,σ)w = i= ( ) (σ ) i +f i 0 t i = (σ ) i (σ ) i t i ((σ ) i ) 3 (f i +(σ ) i ) < 0. i=

10 Jin & Gao 0 ( ) r (b) If Z 0 = 0, there are two cases. s (b.) If r 0, then W T Π d (ς,σ)w( r ) < 0. 0 (b.) If r = 0, then s 0 and Z 0 =, thus s (ZZ 0 ) T G (ZZ 0 ) = 4s T Diag(x(ς,σ )) T G Diag(x(ς,σ ))s. (65) Since A and B are two diagonal matrices, then from (4) we know G is a diagonal matrix, which with G 0 shows that G is a diagonal matrix whose all diagonal elements are positive. Then it follows from x(ς,σ ) = G c and c i 0, i =,,n that x(ς,σ ) i 0, i =,,n. By G 0, we find Diag(x(ς,σ )) T G Diag(x(ς,σ )) 0, then it is observed from (65) that hence (ZZ 0 ) T G (ZZ 0 ) < 0, W T Π d (ς,σ)w (ZZ 0 ) T G (ZZ 0 ) < 0. From above two cases, we can see Π d (ς,σ) is strictly concave on S +. Thereby (P + ) has a unique critical point in S +, which implies (Pg + ) has a unique critical point in S+ ςσ and the primal problem has a unique global minimum. 5 Application to Decoupled Problem In this section, we discuss the application of presented theory to the decoupled problems. Consider the decoupled minimization problem as follows: min P(x,v) = ( ) n ( ) } b i x i α + a ix i c i x i f i v i (66) i= i= s.t. v i x i v i,v i 0,},i =,...,n. (67) For simplicity, we may take A = Diag(a) and B = Diag(b) stand for two diagonal matrices with diagonal elements a = a i } R n and b = b i } R n respectively. The canonical dual function of above problem has the following simple form Π d (ς,σ) = ( i= c i + (f i +(σ ) i +(σ ) i ) a i +ςb i +(σ ) i (σ ) i ) ς ας. (68) Due to Π d (ς,σ) = 0, then when (σ ) i 0 and c i 0, we can obtain the critical points of Π d (ς,σ) in the following ς = b i α, (σ ) i M i = ( ( ) ) } a i + b i α b i ±c i, (69) i= (σ ) i N i = f i ( ( a i + i= i= ) ) } b i α b i ±c i, i =,...,n. (70) For (σ ) i > 0, using Theorem, we can derive the accompanying primal solution ( c i (x i,v i ) = a i +( n i= b, f ) i +(σ ) i +(σ ) i, i =,...,n. (7) i α)b i +(σ ) i (σ ) i According to the fact that there are two possible solutions for each component of σ = (σ,σ ) R n, together with (69) and (70), it follows that the canonical dual function Π d has n critical points. Then from Theorem 3, it is easy to show the global minimum of the primal problem will be arrived at by next theorem.

11 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms Theorem 7 Given A = Diag(a) R n n and a symmetric positive semi-definite matrix B = Diag(b) R n n, α > 0, c,f R n, c i 0 for i, if maxm i > 0 and maxn i > 0, i =,...,n. (7) then Π d (ς,σ) has a unique critical point ( ς, σ) = ( ς, σ, σ ) = ( b i α, maxm i,i =,...,n }, maxn i,i =,...,n }) S +, i= which is a global maximizer of Π d (ς,σ) on S +, and is a global minimum of P(x,v) on χ v. ( x, v) = ( } ) ci,e c i 6 Examples Now we give a summary of numerical experiments to illustrate our method, where diagonal matrices A and B, vectors f and c are chosen and taken at random. These examples are classified into three cases and in every case we give several representatives. In the first case we consider the decoupled problems satisfying the conditions of Theorem 7, whose results are consistent with Theorem 7 and show our method is promising for decoupled problems. In the second case some general decoupled problems not satisfying Theorem 7 are computed by our method and the global solution are also obtained. In the last case, our method is tested for some general problems. All of performed examples show our method is very effective. 6. Case : Decoupled Problems satisfying Theorem 7 In the following three decoupled examples, we can verify the conditions of Theorem 7 are satisfied, so a unique critical point ( ς, σ) of Π d (ς,σ) on S + and a global minimum point ( x, v) ofp(x,v) on χ v are obtained by Theorem 7. For simplicity we denote λ min ( ς, σ ) be the smallest eigenvalue of G. Example Set α = 0, A = Diag(,,,5,), B = Diag(,4,,4,), f = (0,,,,3) and c = ( 8, 9,0,9, 5), in which n = 5. Example Set α = 0, A = Diag(7,9,6, 5,4,0,9,8), B = Diag(3,5,4,3,,7,5,7), f = (3, 3,3,,0,6,6,4) and c = (7, 6,8,, 5,8, 8,7), in which n = 8. Example 3 Setα = 5, A = Diag(,8,7,3,6,4,0,, 6,9),B = Diag(9,,,,6,8,5,3,9,6), f = (6,,4,3,6,5,7,0,3,6) and c = (9,4, 9, 9, 8,7,, 4, 8,8), in which n = 0. The values of n i= b i α, M i and N i from (69) and (70) are first needed to be computed and are listed in Table as follows. Then it can be found that conditions of Theorem 7 are all satisfied.

12 Jin & Gao Experiments n i= b i α M i Max M i N i Max N i M = 7, } 7 N = 7,9} 7 M =,3} N = 4,5} 4 Example -3.5 M 3 = 3.75,6.5} 6.5 N 3 = 4.75,5.5} 5.5 M 4 = 0,9} 9 N 4 =,0} 0 M 5 = 5,0} 5 N 5 = 8,3} 8 M = 3.5,3.75} 3.75 N = 9.75,6.75} 6.75 M = 4.75,.5} 4.75 N =.75, 4.5}.75 M 3 =,6} 6 N 3 =,9} 9 Example -.5 M 4 = 6.75,5.75} 6.75 N 4 = 7.75,6.75} 7.75 M 5 =.75, 3.5}.75 N 5 =.75,6.75}.75 M 6 = 0.5,7.75} 7.75 N 6 = 5.75,3.75} 3.75 M 7 = 5.75,.5} 5.75 N 7 =.75,3.75}.75 M 8 =.5,8.5} 8.5 N 8 = 5.5,.5}.5 M = 0.5,8.5} 8.5 N = 4.5,4.5} 4.5 M =,3} 3 N = 0,4} 4 M =, 8} 3 N = 5, 4} 3 5 M 4 = 3, 6} 3 N 4 = 6,7} 6 Example 3 0 M 5 =, 7} N 5 = 7, } 7 M 6 = 5.5,.5}.5 N 6 = 0.5,6.5} 6.5 M 7 = 6, 6} 6 N 7 = 3,} 3 M 8 = 6.5, 7.5} 6.5 N 8 = 6.5,.5} 6.5 M 9 = 7, } 7 N 9 = 0,} 0 M 0 = 3.5,4.5} 4.5 N 0 =.5,0.5} 0.5 Table : Conditions of Theorem 7 are satisfied in Examples -3. On the one hand, by Theorem 7 we know ς = n ( } ) i= b i α, ( σ ) i = maxm i, ( σ ) i = maxn i and ( x, v) = ci c i,e, so from Table we can easily get the corresponding ( ς, σ) and ( x, v) for Examples -3 listed in Table. Experiments ς σ Primal solution ( x, v) ς = 3.5 σ Example = (7,,6.5,9,5), x = (,,,, ), σ = (7,4,5.5,0,8). v = (,,,,). ς =.5 σ = (3.75,4.75,6,6.75,.75,7.75,5.75,8.5), x = (,,,,,,,) Example σ = (6.75,.75,9,7.75,.75,3.75,.75,.5). v = (,,,,,,,). ς = 0 σ = (8.5,3,,3,,.5,6,6.5,7,4.5), x = (,,,,,,,,,), Example 3 σ = (4.5,4,5,6,7,6.5,3,6.5,0,0.5). v = (,,,,,,,,,). Table : Results of Theorem 7 in Examples -3. On the other hand, we can also get ( ς, σ) by solving the canonical dual problem (P +), then ( x, v) can be computed by ( x, v) = ( G ( ς, σ )c, (f + σ + σ ) σ ) ). The corresponding results are listed below: Experiments Dual solution ( ς, σ) Π d ( ς, σ) λ min ( ς, σ ) Primal solution ( x, v) P( x, v) ς = 3.5, x = (,,,, ), Example σ = (7,,6.5,9,5), v = (,,,,) σ = (7,4,5.5,0,8). ς =.5, x = (,,,,,,, Example σ = (3.75,4.75,6,6.75,.75,7.75,5.75,8.5), ), σ = (6.75,.75,9,7.75,.75,3.75,.75,.5). v = (,,,,,,,). ς = 0, x = (,,,,,,, Example 3 σ = (8.5,3,,3,,.5,6,6.5,7,4.5), - 8,,), - σ = (4.5,4,5,6,7,6.5,3,6.5,0,0.5). v = (,,,,,,,,,). Table 3: Results by solving problem (P + ) in Examples -3. From Tables and 3, it can be seen that the results from Theorem 7 are consistent with the ones by our canonical dual method. And the fact that ς α, σ 0, σ 0,G( ς, σ ) 0 in everyexampleindicates( ς, σ) S +. ByTheorem7, thesolutionofprimalproblemisobtained. It is verified that our method is promising for decoupled problems when the conditions of Theorem 7 are satisfied for the decoupled problems.

13 3 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms 6. Part : Decoupled Problems where Theorem 7 are not satisfied It needs to say that there are many decoupled problems not to satisfy Theorem 7. Here we choose three of them to indicate the details. Let n = 5 and α = 0, diagonal matrices A and B, vectors f and c are chosen and taken at random. Example 4 Set A = Diag(6,3,9,9,), B = Diag(,4,5,4,3), f = (5,4,4,0,9) and c = (, 9, 6,3, 5). Example 5 Set A = Diag(,,,4,4), B = Diag(,,,4,5), f = (, 5,,, 6)and c = (3,0,,,0). Example 6 Set A = Diag(5,,,5,), B = Diag(5,,,,4), f = (3, 35,,,5) and c = (7,0,4, 6,0). n Experiments i= b i α M i Max M i N i Max N i M =.5,.5} -.5 N =.5,3.5} 3.5 M = 5, 4} 5 N = 9,0} 9 Example 4 - M 3 =, 5} N 3 = 5, } 5 M 4 = 4, } - N 4 = 6,9} 9 M 5 = 3, } 3 N 5 =,7} Table 4: Conditions of Theorem 7 are not all satisfied in Examples 4. From Table 4, we find that Max M =.5 < 0 which makes the conditions of Theorem 7 are not satisfied. We solve the simple form problem (P g + ) instead of the canonical dual problem (P+) and use Theorem 4 to obtain the analytic solution (x,v) to primal problem (P b ). The corresponding results are listed below: Experiments Dual solution ( ς, σ ) Π g ( ς, σ ) λ min ( ς, σ ) Primal solution ( x, v) P( x, v) Example 4 ς =.8, x = (0.44,,,, ), σ = (0,6.64,3.05,0.64,4.3). v = (,,,,) Table 5: Results by solving problem (P+) g in Examples 4. It is obvious that there exists some c i = 0 in Examples 5 and 6, which does not satisfy the conditions of Theorem 7. We also solve them by the simple form problem (P g + ), whose results are illustrated in Table 6. Experiments Dual solution ( ς, σ ) Π g ( ς, σ ) λ min ( ς, σ ) Primal solution ( x, v) P( x, v) Example 5 ς = 7, x = (,0,,,0), 3.5 σ = (4.5,34.987,3.5,3,54.367). v = (,0,,,0). 3.5 Example 6 ς = 4, x = (,0,,,), σ = (,5.6,5,.5,.5). v = (,0,,,) Table 6: Results by solving problem (P+) g in Examples 5 and 6. From Tables 5-6, we have ς α, σ 0,G( ς, σ ) 0,f i + ( σ ) i 0, i =,,n in every example, so ( ς, σ ) S + ςσ. By Theorem 4, the solution of primal problem is obtained. Thus when the conditions of Theorem 7 are not all satisfied, our method is also effective for the decoupled problem. 6.3 Part 3: General Nonconvex Problems For general nonconvex problems in this part, we solve the simple form problem (P g + ) and use Theorem 4 to obtain the analytic solution (x,v) to primal problem (P b ). Two general nonconvex examples not decoupled are tested and the corresponding results are listed below:

14 Jin & Gao 4 Example 7 Set A = and B = 3 8, α = 8, f = (3,,3) and c = (0,6,7). Example 8 Set A = and B = α = 4, f = (6,,5,4,0) and c = (7, 3,0, 4, 3). The corresponding results are listed below: Experiments Dual solution ( ς, σ ) Π g ( ς, σ ) λ min ( ς, σ ) Primal solution ( x, v) P( x, v) Example 7 ς = 0.5, x = (,,), σ = (.5,9.75,6). v = (,,) Example 8 ς = 0.088, x = (0.556, 0, 0.978, 0.74, 0.5), σ = (0,.994,0,0,0). v = (,0,,,) Table 7: Results by solving problem (P+) g in Examples 7 and 8. From Table 7, it holds that ς α, σ 0,G( ς, σ ) 0,f i + ( σ ) i 0, i =,,n in every example, so ( ς, σ ) S + ςσ. By Theorem 4, the solution of primal problem is obtained. So our method is also effective for the general problems. 7 Conclusions and further work In this paper we propose a canonical duality method for solving a mixed-integer nonconvex fourthorder polynomial minimization problem with fixed cost terms. By rewriting the box constraints in a relaxed quadratic form, a relaxed reformulation of the primal problem (P b ) is obtained, then the canonical dual problem (P ) is defined and the complementary-dual principle is proved. The primal problem (P b ) is canonically dual to a concave maximization problem (P + ) where a useful spaces + isintroduced. Thisconstrainednonconvexproblem(P b ) inr n canbe transformedinto a continuous concave maximization dual problem (P+) g in R n+ without duality gap. The global optimality conditions are proposed and the existence and uniqueness criteria are illustrated. Application to the decoupled mixed-integer problem is illustrated and analytic solution for a global minimum is obtained under some suitable conditions. Several examples are given to show our method is effective. Canonical duality theory is a potentially powerful methodology, which can be used to model complex systems to a wide class of discrete and continuous problems in global optimization and nonconvex analysis. The ideas and results with canonical duality theory presentedin thispaper canbe usedorgeneralizedforsolvingothertype ofproblemsin the future. References [] Padberg M.W., Van Roy T.J., Wolsey L.A.: Valid linear inequalities for fixed charge problems. Oper. Res. 33, 84-86(985). [] Aardal, K.: Capacitated facility location: separation algorithms and computational experience. Math. Program. 8() Ser.B, 49-75(998). [3] Kim D., Pardalos P.M.: A solution approach to the fixed charge network flow problem using a dynamic slope scaling procedure. Operations Research Letters. 4:95-03(999).

15 5 Canonical dual method for mixed integer fourth-order polynomial minimization problems with fixed cost terms [4] Glover F., Sherali H.D.: Some classes of valid inequalities and convex hull characterizations for dynamic fixed-charge problems under nested constraints. Ann. Oper. Res. 40(), 5-34(005). [5] Rebennack S., Nahapetyan A., Pardalos P.M.: Bilinear modeling solution approach for fixed charge network flow problems. Optim Lett. 3: (009). [6] Vyve M.V.: Fixed-charge transportation on a path: optimization, LP formulations and separation. Math. Program., Ser. A. 4:37-395(03). [7] Agra A., Doostmohammadi M.: Facets for the single node fixed-charge network set with a node set-up variable. Optim Lett. 8:50-55(04). [8] Adlakha V., Kowalski K.: Fractional Polynomial Bounds for the Fixed Charge Problem. J Optim Theory Appl. 64:06-038(05). [9] Housh M., Cai X.M.: Successive smoothing algorithm for solving large-scale optimization models with fixed cost. Ann Oper Res. 9: (05). [0] Gao D.Y., Ruan N., Sherali H.D.: Canonical Dual Solutions for Fixed Cost Quadratic Programs. in: Chinchuluun A., Pardalos P.M., Enkhbat R., Tseveendorj I. (eds.). Optimization and Optimal Control, pp , Springer, New York(00). [] Gao, D.Y.: Canonical dual transformation method and generalized triality theory in nonsmooth global optimization. J. Global Optim. 7, 7-60(000). [] Fang S.C., Gao D.Y., Shue R.L., Wu S.Y., Canonical dual approach to solving 0- quadratic programming problems. J. Ind. Manage. Optim. 4(), 5-4(008). [3] Gao D.: Canonical duality theory and solutions to constrained nonconvex quadratic programming. J. Global Optim. 9, (004). [4] Gao D., Ruan, N.: On the Solutions to quadratic minimization problems with box and integer constraints. J. Global Optim. 47, (00). [5] Gao D.Y.: Solutions and optimality to box constrained nonconvex minimization problems. J. Ind. Manage Optim. 3(), (007). [6] Gao D.: Complete solutions and extremality criteria to polynomial optimization problems. J. Global Optim. 35, 3-43(006). [7] Zhou X.J., Gao D.Y., Yang C.H.: Canonical primal-dual algorithm for solving fourth-order polynomial minimization problems. Appl.Math.Comput. 7:46-55(04). [8] Gao D., Ruan, N., Pardalos, P.: Canonical dual solutions to sum of fourth-order polynomials minimization problems with applications to sensor network localization. In: Boginski, V. L., Commander, C. W., Pardalos, P. M., Ye, Y. (eds.) Sensors: Theory, Algorithms, and Applications. Springer, Berlin, pp (0). [9] Wang Z., Fang S., Gao D., Xing W.: Canonical dual approach to solving the maximum cut problem. J. Global Optim. 54(), 34-35(0). [0] Gao, D.Y., Ruan, N., Sherali, H.D.: Solutions and optimality criteria for nonconvex constrained global optimization problems with connections between canonical and Lagrangian duality. J. Global Optim. 45: (009).