arxiv:math/ v1 [math.co] 23 May 2000

Similar documents
c 2000 Society for Industrial and Applied Mathematics

A General Framework for Convex Relaxation of Polynomial Optimization Problems over Cones

WHEN DOES THE POSITIVE SEMIDEFINITENESS CONSTRAINT HELP IN LIFTING PROCEDURES?

Successive Convex Relaxation Methods for Nonconvex Quadratic Optimization Problems

Lift-and-Project Inequalities

On the relative strength of families of intersection cuts arising from pairs of tableau constraints in mixed integer programs

Notes on the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre by M. Laurent, December 13, 2012

On the relative strength of families of intersection cuts arising from pairs of tableau constraints in mixed integer programs

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations

constraints Ax+Gy» b (thus any valid inequalityforp is of the form u(ax+gy)» ub for u 2 R m + ). In [13], Gomory introduced a family of valid inequali

Second Order Cone Programming Relaxation of Nonconvex Quadratic Optimization Problems

Chapter 1. Preliminaries

Lagrangian-Conic Relaxations, Part I: A Unified Framework and Its Applications to Quadratic Optimization Problems

The Trust Region Subproblem with Non-Intersecting Linear Constraints

CSC Linear Programming and Combinatorial Optimization Lecture 12: The Lift and Project Method

Minimal inequalities for an infinite relaxation of integer programs

A strongly polynomial algorithm for linear systems having a binary solution

SOME STABILITY RESULTS FOR THE SEMI-AFFINE VARIATIONAL INEQUALITY PROBLEM. 1. Introduction

Lecture 9 Monotone VIs/CPs Properties of cones and some existence results. October 6, 2008

The Triangle Closure is a Polyhedron

Cuts for mixed 0-1 conic programs

Cutting planes from extended LP formulations

c 2005 Society for Industrial and Applied Mathematics

Minimal Valid Inequalities for Integer Constraints

March 2002, December Introduction. We investigate the facial structure of the convex hull of the mixed integer knapsack set

A Simple Derivation of a Facial Reduction Algorithm and Extended Dual Systems

7. Lecture notes on the ellipsoid algorithm

Polyhedral Approach to Integer Linear Programming. Tepper School of Business Carnegie Mellon University, Pittsburgh

On the Relative Strength of Split, Triangle and Quadrilateral Cuts

arxiv: v1 [cs.cc] 5 Dec 2018

Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point

Two-Term Disjunctions on the Second-Order Cone

Research Reports on Mathematical and Computing Sciences

Appendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS

Cutting Planes for First Level RLT Relaxations of Mixed 0-1 Programs

CORC REPORT Approximate fixed-rank closures of covering problems

Lecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min.

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC

Minimal inequalities for an infinite relaxation of integer programs

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

A Note on Representations of Linear Inequalities in Non-Convex Mixed-Integer Quadratic Programs

MAT-INF4110/MAT-INF9110 Mathematical optimization

1 Maximal Lattice-free Convex Sets

MINI-TUTORIAL ON SEMI-ALGEBRAIC PROOF SYSTEMS. Albert Atserias Universitat Politècnica de Catalunya Barcelona

3. Linear Programming and Polyhedral Combinatorics

A Strongly Polynomial Simplex Method for Totally Unimodular LP

On the Rank of Cutting-Plane Proof Systems

The Triangle Closure is a Polyhedron

Lift-and-Project Techniques and SDP Hierarchies

Disjunctive Cuts for Cross-Sections of the Second-Order Cone

Carnegie Mellon University, Pittsburgh, USA. April Abstract

The Split Closure of a Strictly Convex Body

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013

A FULL-NEWTON STEP INFEASIBLE-INTERIOR-POINT ALGORITHM COMPLEMENTARITY PROBLEMS

The Simplest Semidefinite Programs are Trivial

Nonconvex Quadratic Programming: Return of the Boolean Quadric Polytope

Lecture notes on the ellipsoid algorithm

Structure in Mixed Integer Conic Optimization: From Minimal Inequalities to Conic Disjunctive Cuts

Relations between Semidefinite, Copositive, Semi-infinite and Integer Programming

Game theory: Models, Algorithms and Applications Lecture 4 Part II Geometry of the LCP. September 10, 2008

Notes taken by Graham Taylor. January 22, 2005

LOVÁSZ-SCHRIJVER SDP-OPERATOR AND A SUPERCLASS OF NEAR-PERFECT GRAPHS

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Lecture 7: Semidefinite programming

Absolute value equations

The Q Method for Symmetric Cone Programmin

POLARS AND DUAL CONES

Key words. Integer nonlinear programming, Cutting planes, Maximal lattice-free convex sets

A geometric perspective on lifting

Structure of Valid Inequalities for Mixed Integer Conic Programs

LP Relaxations of Mixed Integer Programs

3. Linear Programming and Polyhedral Combinatorics

Convex Optimization. (EE227A: UC Berkeley) Lecture 6. Suvrit Sra. (Conic optimization) 07 Feb, 2013

The Split Closure of a Strictly Convex Body

Second Order Cone Programming Relaxation of Positive Semidefinite Constraint

Change in the State of the Art of (Mixed) Integer Programming

B-468 A Quadratically Constrained Quadratic Optimization Model for Completely Positive Cone Programming

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion

A Parametric Simplex Algorithm for Linear Vector Optimization Problems

Assignment 1: From the Definition of Convexity to Helley Theorem

Mixed-integer linear representability, disjunctions, and variable elimination

Semidefinite Programming

Research Reports on Mathematical and Computing Sciences

Lifting for conic mixed-integer programming

3.10 Lagrangian relaxation

Low-Complexity Relaxations and Convex Hulls of Disjunctions on the Positive Semidefinite Cone and General Regular Cones

Convex relaxation. In example below, we have N = 6, and the cut we are considering

An Alternative Proof of Primitivity of Indecomposable Nonnegative Matrices with a Positive Trace

On the Relative Strength of Split, Triangle and Quadrilateral Cuts

Lecture 7 Monotonicity. September 21, 2008

Note 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)

arxiv: v3 [math.oc] 24 May 2016

A Geometrical Analysis of a Class of Nonconvex Conic Programs for Convex Conic Reformulations of Quadratic and Polynomial Optimization Problems

Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem

BCOL RESEARCH REPORT 07.04

Some Properties of Convex Hulls of Integer Points Contained in General Convex Sets

Convex relaxation. In example below, we have N = 6, and the cut we are considering

Math 341: Convex Geometry. Xi Chen

Problem 1 (Exercise 2.2, Monograph)

Transcription:

Some Fundamental Properties of Successive Convex Relaxation Methods on LCP and Related Problems arxiv:math/0005229v1 [math.co] 23 May 2000 Masakazu Kojima Department of Mathematical and Computing Sciences Tokyo Institute of Technology 2-12-1 Oh-Okayama, Meguro-ku, Tokyo 152-8552, Japan e-mail:kojima@is.titech.ac.jp Levent Tunçel 1 Department of Combinatorics and Optimization Faculty of Mathematics University of Waterloo Waterloo, Ontario N2L 3G1, Canada e-mail:ltuncel@math.uwaterloo.ca October 8, 1999 Abstract: General Successive Convex Relaxation Methods (SRCMs) can be used to compute the convex hull of any compact set, in an Euclidean space, described by a system of quadratic inequalities and a compact convex set. Linear Complementarity Problems (LCPs) make an interesting and rich class of structured nonconvex optimization problems. In this paper, we study a few of the specialized lift-and-project methods and some of the possible ways of applying the general SCRMs to LCPs and related problems. Keywords: Nonconvex Quadratic Optimization, Linear Complementarity Problem, Semidefinite Programming, Global Optimization, SDP Relaxation, Convex Relaxation, Lift-and- Project Procedures. AMS Subject Classification: 90C33, 52A27, 90C25, 90C05, 90C26 Address for correspondence: Prof. Levent Tunçel, Department of Combinatorics and Optimization, Faculty of Mathematics, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada. e-mail:ltuncel@math.uwaterloo.ca 1 Research of this author was supported in part by a grant from NSERC and a PREA from Ontario, Canada. Some of this work was completed while this author was a member of the Fields Institute, Toronto, Canada, during September-December 1999. 1

1 Introduction, SCRMs and Lovász-Schrijver procedures Since 1960 s, complementarity problems attracted a very significant attention in the theory as well as applications of operations research. See, for instance, the bookon LCP [4]. In this paper, we consider various complementarity problems in the context of Successive Convex Relaxation Methods (SCRMs) proposed by the authors [5, 6]. Since these methods can be used to compute the convex hull of any compact subset of an Euclidean space described by a system of quadratic inequalities and a compact convex set, they can be used to attack many complementarity problems from several angles. In the special case of 0-1 optimization problems over convex sets, or more specially polytopes, there are many Successive Convex Relaxation Methods (SCRMs) based on liftand-project techniques. We also discuss some of the relationships of general SCRMs and these more specialized algorithms in solving LCPs. Let F be a compact set in the n-dimensional Euclidean space R n. SCRMs take as input, a compact convex subset C 0 of R n and a set P F of quadratic functions which induce a description of F such that F = {x C 0 : qf(x;γ,q,q) 0, qf( ;γ,q,q) P F. Here we denote by qf( ;γ,q,q), the quadratic function (γ+2q T x+x T Qx). Note that the variable x is irrelevant outside a context and it will always be clear what the variable vector is, from the context. Let l be an integer such that 1 < 2l m, d R m, and let A be a compact convex subset of R m. Consider the convex optimization problem with complementarity conditions: maximize d T u subject to u A, 0 u i, 0 u i+l, u i u i+l = 0, i {1,2,...,l. First of all, it is clear that LCP, with a known upper bound on a solution of it, is a special case of (1) (we can take m = 2l and A as an affine subspace intersected with a large enough ball). Secondly, it is very elementary to formulate this problem as a mixed 0-1 optimization problem with convex constraints: where C 0 maximize c T v subject to v C 0, v i {0, 1, i {m+1,m+2,...,n, v = u v m+1. v n Rm+l : n m+l, r max i {max{u i : u A. u A, 0 u i rv m+i, 0 u i+l r(1 v m+i ), i {1,2,...,l, c ( d 0 ) R m+l, (1) (2) 2

In general, we allow C 0 to be an arbitrary compact convex set in R n. There are various successive convex relaxation methods that can be applied to such a problem. We can represent the feasible region F R n of (2) as F = {v C 0 : p(v) 0, p( ) P F, where P F denotes a set consisting of quadratic functions on R n. (v 2 i v i ), ( v 2 i +v i ), i {m+1,m+2,...,n In connection with the SCRMs and also the Lovász-Schrijver procedures (see [8]), it seems convenient to introduce the following notation: For every compact convex relaxation C C 0 of F and every subset D of D {d R n : d = 1, P 2 (C,D) { (d T v α(c 0,d))( d T v α(c, d)) : d D, d D, V S n such that N(C,D) v C 0 : γ +2q T v +Q V 0, qf( ;γ,q,q) P F P 2 (C,D) (a Semi-Infinite LP relaxation of F), ( ) 1 v V S n T such that S 1+n + v V N, + (C,D) v C 0 : γ +2q T v +Q V 0, qf( ;γ,q,q) P F P 2 (C,D) (an SDP relaxation of F), where α(c,d) max{d T v : v C for every d D. Let S n and S 1+n + denote the set of n n symmetric matrices and the set of (1+n) (1+n) symmetric positive semidefinite matrices, respectively. The corresponding variants of Successive Semi-Infinite LP Relaxation Method (SSILPRM) and Successive SDP Relaxation Method (SSDPRM) can be written as follows. Algorithm 1.1. (SSILPRM) Step 0: Choose a D 0 D. Let k = 0. Step 1: If C k = (the convex hull of F), then stop. Step 2: Let C k+1 = N(C k,d 0 ). Step 3: Let k = k +1, and go to Step 1. Algorithm 1.2. (SSDPRM) Steps 0, 1 and 3: The same as the Steps 0, 1 and 3 of Algorithm 1.1. 3

Step 2: Let C k+1 = N + (C k,d 0 ). To connect these algorithms to the Lovász-Schrijver procedures, we need to introduce some additional notation. For every pair of closed convex cones K and T in R 1+n, define M(K,T ) M + (K,T ) Y = ( λ λv T λv λv Y = ( λ λv T λv λv ) : ) : λ 0, v C 0, V S n, v i = V ii, i {m+1,m+2,...,n, v T Yw 0, v T, w K λ 0, v C 0, V S n,y S 1+n + v i = V ii, i {m+1,m+2,...,n, v T Yw 0, v T, w K Let T 0 and K 0 be closed convex cones given by ({( ) ) T α(c0,d) 0 = c.cone R 1+n : d D d 0, {( ) λ K 0 = R 1+n : v C λv 0, λ 0. (Note that T 0 itself is defined as the dual of T 0.) If C C 0 is a compact convex relaxation of F and {( ) λ K = R 1+m : v C, λ 0, λv then N(C,D 0 ) = N + (C,D 0 ) = { ( 1 v v R n T : v V { ( 1 v v R n T : v V ) ) M(K,T 0 ) M + (K,T 0 ) Algorithms 1.1 and 1.2 specialized to (2) with P F = {v 2 i v i, v 2 i +v i, i {m+1,m+ 2,...,n can be stated in the following forms, which are essentially the Lovász-Schrijver procedures. Algorithm 1.1H (Homogeneous form of Algorithm 1.1) Step 0: Choose a D 0 D. Define T 0 and K 0 as above. Let k = 0. ({( ) ) 1 Step 1: If K k = c.cone : v F then stop. v Step 2: Let K k+1 = {Ye 0 : Y M(K k,t 0 ). Step 3: Let k = k +1, and go to Step 1.,.,. Algorithm 1.2H (Homogeneous form of Algorithm 1.2) 4

Steps 0, 1 and 3: The same as Steps 0, 1 and 3 of Algorithm 1.2H, respectively. Step 2: Let K k+1 = {Ye 0 : Y M + (K k,t 0 ). In this paper e j denotes the jth unit vector and e denotes the vector of all ones (the dimensions of the vectors will be clear from the context). 2 SCRMs applied to LCP with an á priori bound Let M R l l, q R l be given. Consider the LCP in the following form. (LCP) Find x, s such that Mx+q = s, x 0, s 0, x i s i = 0, i {1,2,...,l. Suppose we are given B(ξ,r) { u R 2l : u ξ r, an Euclidean ball containing a solution of the LCP. (In the case of rational data (M,q), we can take B centered at the origin with the radius bounded above by a polynomial function of the bit size of the data (M,q).) For the rest of this section, we assume that the Euclidean ball with center ξ 0 and the radius r (r is assumed given) contains some solution of the LCP. Under the boundedness assumption above, it is particularly easy to model any LCP as a 0-1 mixed integer programming problem, since the only nonlinear constraints of LCP can be expressed as x i = 0, or s i = 0, i {1,2,...,l. Balas method [1] can be directly applied to such formulations. We can also apply some variants of the Lovász-Schrijver procedures [8] to the mixed integer programming feasibility problem: Find x, s and z such that Mx+q = s, 0 x rz, 0 s r(e z), z {0,1 l. Note that we can eliminate the variable vector s from the formulation and apply the SSILPR and SSDPR Methods to the following formulation: 0 Mx+q r(e z), 0 z e, 0 x rz, z 2 i z i 0, z 2 i +z i 0, i {1,2,...,l. To apply the SCRMs, we can take { ( ) x C 0 v = R n : z m l, n 2l, 0 Mx+q r(e z), 0 z e, 0 x rz P F { (v 2 i v i), ( v 2 i +v i), i {m+1,m+2,...,n. 5,

Both algorithms, SSILPRM and SSDPRM presented in Section 1, terminate in at most l steps. This fact can be proved easily, using the results of Balas [1], Sherali and Adams [10], Lovász and Schrijver [8], or Kojima and Tunçel [5, 6]. For computational experience on similar algorithms for similar problems see [3], [12]. In the next section, we give the details of a proof of such a convergence result when the methods are applied to a formulation of Pardalos and Rosen [9]. 3 SCRMs applied to Pardalos-Rosen formulation of LCP We will illustrate the convergence proof on a formulation of (LCP) by Pardalos and Rosen [9]. They homogenize the vector q with a new continuous variable α, then they maximize α. Note that (MIP α ) maximize α subject to 0 Mx+qα e z, 0 x z, 0 α 1, z {0,1 l. ᾱ 0 is feasible in (MIP α ) and, it is easy to see that (MIP α ) has an optimal x z α solution with α > 0 iff the (LCP) has a solution (or solutions) [9]. Moreover, if x is z an optimal solution of (MIP α ) with α > 0 then x solves the (LCP) [9]. One advantage α of (MIP α ) is that it does not require the introduction of large, data dependent constants (such as r in the previous section) or their a priori estimates. Now, we take α C 0 v = x R 1+2l 0 Mx+qα e z, : 0 x z, 0 α 1, z m l+1, n 2l+1, P F { (vi 2 v i), ( vi 2 +v i), i {m+1,m+2,...,n. We have an analog of a very elementary but also a key lemma (Lemma 1.3 of [8]) of Lovász and Schrijver (and their proof technique is adapted here). In what follows, we refer to the vectors in the space of K k by v. At the same time, we refer to different subvectors of v by different names, such as x, α etc., to keep the correspondence of elements of v and the original formulation of F clearer. The proof of Lemma 1.3 of [8] leads to the following analogous result in our case. Lemma 3.1. Let D 0 {±e m+1,±e m+2,...,±e n. Then the sequence of convex cones {K k : k 0 given by Algorithm 1.1H satisfies K k+1 (K k {v : x i = 0)+(K k {v : (Mx+qα) i = 0), for every i {1,2,...,l, and for every k 0. 6

1 ᾱ Proof: Let w x K k+1. Fix j {1,2,...,l arbitrarily. By the definition z of D 0 and T 0, the unit vector e 0 is in T 0. Hence, by the definition of M(K k,t 0 ), K k+1 K k for every k 0. Therefore, w K k. If x j = 0 or (Mx+qα) j = 0 then the statement of the lemma clearly holds. So, without loss of generality, we assume x j > 0 and (Mx + qα) j > 0. Let Y M(K k,t 0 ) such that w = Y e 0. By our choice of the cone T 0, we conclude that Y e n+j and Y (e 0 e n+j ) are both in K k. Note that w = ŵ+ w, where ŵ Y e n+j and w Y (e 0 e n+j ). We will refer to the x and z parts of the vector ŵ by ˆx, ẑ etc. (Similarly for w.) First, since by the definition of M(K k,t 0 ), v i = V ii for every i {m+1,m+2,...,n, we have z j = 0 which implies x j = 0. Therefore, w lies in the cone (K 0 {v : x j = 0). Second, since x j > 0, z j must be positive. Therefore, (1/ z j )ŵ K 0. Since v i = V ii for every i {m+1,m+2,...,n, ẑ j = z j. So, ˆα 1 ˆx C k, z j ẑ with its z j entry equal to 1. Thus, (Mˆx+qˆα) j = 0. Hence, ŵ is in the cone (K k {v : (Mx+qα) j = 0). Since the argument above is independent of the index j the proof is complete. Note that the conclusion of the above lemma also applies to the SSDPR Method since SSDPR Method yields at least as tight relaxations as the SSILPR Method. Theorem 3.2. Both algorithms, Algorithm 1.1H and 1.2H terminate in l iterations when applied to the formulation (MIP α ) with our choice of P F, C 0 and D 0 above. Proof: First note that α c.hull(f) x R n : z 1 α x K k, k 0. z Next, let i,j {1,2,...,l, i j. Since x 0 and Mx +qα 0, for all v K k, for every k 0, [(K k {v : x i = 0)+(K k {v : (Mx+qα) i = 0)] {v : x j = 0 = (K k {v : x i = 0, x j = 0)+(K k {v : x j = 0, (Mx+qα) i = 0). Similarly, for the intersection with {v : (Mx+qα) j = 0. Now, we apply Lemma 3.1 repeatedly to conclude that K l is the homogenization of the convex hull of all solutions of the LCP that lie in the original relaxation C 0. 7

4 SCRMs applied to the smaller formulation of LCP with explicit treatment of disjunctive constraints Now, we consider a formulation with fewer variables and constraints. (LCP α ) maximize α subject to Mx+qα 0, x 0, α 0, e T (M +I)x+(e T q +1)α 1, x i (Mx+qα) i = 0, i {1,2,...,l. ( x It is easy to see that 0 is feasible in (LCP α ), and it is also easy to observe that ᾱ) (LCP α ) has an optimal solution with α > 0 iff the (LCP) has a solution(or solutions). ( x ) Moreover, if α is an optimal solution of (LCP α ) with α > 0 then x solves the (LCP). α Note that the inclusion in Lemma 3.1 can sometimes be strict for the SSILPR and SSDPR Methods. We explicitly include the variable vector s in our discussion in this section, for the sake of presentation. Let x C 0 v = s R 2l+1 s = Mx+qα 0, x 0, α 0, : e α T (M +I)x+(e T q +1)α 1,. In this section, we will describe another Successive Convex Relaxation Method based on the ideas of Balas [1], Lovász and Schrijver [8]. This method will use only Linear Programming (LP) relaxations. We describe the method in the original space of F and C 0. Let F(C 0 ) denote the set of facet defining inequalities for C 0. F(C 0 ) is the input of the algorithm which we introduce now. Algorithm 4.1. Step 0. k 0. Step 1. F(C k+1 ) F(C k ). Step 2. For every inequality l (u i x i +u l+i s i ) u 2l+1 α u 0 i=1 in F(C k ) and every j {1,2,...,l solve the LP problems and (P j ) minimize u T ξ (j) subject to ξ (j) j = 1, ξ (j) l+j = 0, ξ(j) K k, (P l+j ) minimize u T ξ (l+j) subject to ξ (l+j) j = 0, ξ (l+j) l+j = 1, ξ (l+j) K k. 8

If (P j ) is infeasible then add the equation x j = 0 (or the inequality x j 0, since the inequality x j 0 is already included) to F(C k+1 ). If (P l+j ) is infeasible then add the equation s j = 0 to F(C k+1 ). Otherwise, let (ξ (j) ) and (ξ (l+j) ) denote the optimal solutions of (P j ) and (P l+j ) respectively. Define y j u j u T (ξ (j) ), y l+j u l+j u T (ξ (l+j) ). Add the inequality (u i x i +u l+i s i ) y j x j y l+j s j u 2l+1 α u 0 i j to F(C k+1 ). Step 3. Let k = k +1, and go to Step 1. Note that in iteration k, the algorithm solves (2l F(C k ) ) LP problems. Theorem 4.2. Let C k, k {1,2,... be the sequence of convex relaxations generated by Algorithm 4.1. Then C l = c.hull(f). Proof: We think of K k for all k 0, as a subset of R 1+(2l+1), with the 0th component being the homogenizing variable, the next l components representing x, the next l components representing s and the last component representing α. Note that iff K 1 (K 0 {v : x j = 0)+(K 0 {v : s j = 0) K 1 (K 0 +{ e j ) (K 0 +{ e l+j ). (3) (We used the fact that K 0 R 1+(2l+1) +.) Therefore, if we ensure the latter inclusion, then Theorem 3.2 applies and we can conclude the convergence of the method in l iterations. Recall that every vector u K 0 represents a valid inequality l (u i x i +u l+i s i ) u 2l+1 α u 0 i=1 for C 0. To ensure the inclusion (3), it suffices to prove: For every u,w K 0 such that u i = w i, i / {j,l+j;u j w j,u l+j w l+j, we have y K 1, where y i u i, i j; y j w j. This is equivalent to proving the fact that if the two inequalities l (u i x i +u l+i s i ) u 2l+1 α u 0, and i=1 (u i x i +u l+i s i ) w j x j w l+j s j u 2l+1 α u 0 i j are valid for C 0, then (u i x i +u l+i s i ) w j x j u l+j s j u 2l+1 α u 0 i j 9

is valid for C 1. To compute all such inequalities defining C 1, we solve for every valid inequality l (u i x i +u l+i s i ) u 2l+1 α u 0 i=1 for C 0 and every j {1,2,...,l, the linear programming problems and maximize β subject to βe j +δe l+j K 0 maximize γ subject to κe j +γe l+j K 0 u, u. Here, K 0 denotes the partial order induced by the convex cone K 0 (that is, u 1 K 0 iff (u 2 u 1 ) K 0). Note that both problems are always feasible. Therefore, each of them either has an optimal solution or is unbounded. If both LPs have optimal solutions, say β and γ then we set w j u j β and u l+j u l+j γ. Since the above two problems are LPs, we can equivalently solve their duals. Namely, we solve the LPs: and (P j ) minimize u T ξ (j) subject to ξ (j) j = 1, ξ (j) l+j = 0, ξ(j) K 0, (P l+j ) minimize u T ξ (l+j) subjcet to ξ (l+j) j = 0, ξ (l+j) l+j = 1, ξ (l+j) K 0. These latter two linear programming problems are precisely the ones used by Algorithm 4.1. Notice that since their duals are either unbounded or have optimal solutions, these LP problems either have optimal solutions or are infeasible. When (P j ) is infeasible, the equality x j = 0 is valid for F and the algorithm adds this equality to the describing inequalities of C k. Similarly, when (P l+j ) is infeasible, s j = 0 is valid for F and the algorithm behaves correctly in this instance. (In either instance, the inclusion (3) is obviously satisfied for j.) However, the proof is not yet complete; because, the arguments so far ensure the inclusion (3) when the algorithm is ran for every valid inequality of C 0. So, next we prove that what the algorithm does (using only the facets of C 0 ) suffices. To see this, we need to prove that to derive the facets of K 1, it suffices to start with a facet u of K 0 in the above procedure. Suppose u,w K 0 satisfy the above conditions but u is not facet inducing for K 0. (We will prove that the valid inequality derived from u and w is implied by some other inequalities derived from some facets u 1,u 2,...,u l of K 0.) Since u is not facet inducing for K 0, u is not an extreme ray of K 0. Hence, there exist extreme rays u 1,u 2,...,u l of K 0 such that for some λ r > 0, r {1,2,...,l, l r=1 λ r = 1 the following conditions are satisfied: u 2 u = l λ r u r, u r 0 = u 0, r {1,2,...,l. r=1 10

Note that u r is facet inducing for each r. Let ξ r be the optimal solution of (P j ) above for the objective function vector u r. Let ξ be an optimal solution of (P j ) when the objective function vector is u. We claim that there exists ξ K 0 such that (u r ) T ξ = (u r ) T ξ r, r {1,2,...,l, ξj = 1, ξl+j = 0, ξ K 0. (ThisclaimfollowsfromFarkas Lemma, usingthefactsthatu r K 0, r andξ r K 0, r.) Thus, we have l λ r (u r ) T ξ r = u T ξ u T ξ. r=1 Therefore, the inequality obtained from u is equivalent to or dominated by a nonnegative combination of the inequalities obtained from u r which induce facets of K 0. The proof is complete. We illustrated a derivation and convergence proof for a successive relaxation method (closely related to Balas approach and analogous to a suggestion of Lovász and Schrijver [8]) based on Lemma 3.1 and Theorem 3.2. Algorithm 4.1 is an analog of a method based on relaxations N k 0(K) from [8] (which is concerned with the case of 0-1 integer programming). Fortherelationshipofthemethodsof[1]and[8], seebalas, Ceria andcornuejols[2]. (Balas method [1], in essence, corresponds to defining K k+1 (K k {v : x k+1 = 0)+(K 0 {v : (Mx+qα) k+1 = 0).) Let C (4) k, k 0 denote the projection of C k generated by Algorithm 4.1 onto the coordinates. Let C ( x α) (3) k, k 0 denote the projection of C k, generated by Algorithm 1.1, as ( x used in Section 3, onto the coordinates. Let K α) (4) k denote the convex cone associated with C (4) k. From the proof of Theorem 4.2, it is easy to see that K (4) k+1 = l i=1 [( K (4) k {v : x i = 0 ) + ( K (4) k {v : s i = 0 )]. Therefore, the proofs of Theorems 3.2 and 4.2 imply that if C (4) 0 C (3) 0 then C (4) k C (3) k for all k 0. Thus, the SSILPR Method (Algorithm 1.1) as applied in Section 3 to (MIP α ) converges at least as fast as Algorithm 4.1 applied to (LCP α ). 5 SCRMs applied to the smaller formulation of LCP with an implicit treatment of the disjunctive constraints We have already seen various ways of applying SCRMs to LCP problems. Since the methods proposed in [5, 6] only require a formulation of the feasible solutions by quadratic inequali- 11

ties, we are also interested in applying the methods of [5, 6] to the following formulation: { (α ) C 0 R l+1 : x Mx+qα 0, x 0, α 0, e T (M +I)x+(e T q +1)α 1, and P F {x i (Mx+qα) i 0, i {1,2,...,l. The general theory of Kojima-Tunçel [5] implies that their SSDPR and SSILPR Methods converge. It would be interesting to characterize the conditions under which the Algorithms 3.1 and 3.2 of [6] converge in at most l iterations for the above description of P F and C 0. Also see [7], where the authors derived some necessary and some sufficient conditions for the finite convergence of SCRMs. 6 A general linear complementarity problem Let A : R l R l, a linear transformation, q R l and K R l a pointed, closed convex cone with nonempty interior, be given. Consider the Complementarity Problem (CP): where K is the dual of K: (CP) Find x, s such that A(x)+q = s, x K, s K, x,s = 0, K {s R l : x,s 0, x K. Since K is a pointed, closed convex cone with nonempty interior, so is K. Such problems were studied recently, in the context of interior-point methods [11]. We pick η int(k), η int(k ) and we can solve instead the optimization problem (CP α ) maximize α subject to x K, [A(x)+qα] K, α 0, η,x + η,a(x)+qα +α 1, x,a(x)+αq = 0. We choose { (α ) C 0 R l+1 : x x K, [A(x)+qα] K, α 0, η,x + η,a(x)+qα +α 1. Note that C 0 is always a compact convex set (see the next theorem). We also pick P F { x,a(x)+αq, x,a(x)+αq. Theorem 6.1. (i) C 0 is a compact convex set. 12

(ii) (CP α ) has an optimal solution with α > 0 iff (CP) has a solution (or solutions). ( α ) (iii) If x is an optimal solution of (CP α ) with α > 0 then the pair of vectors ( x 1 ) α, )+q solves (CP). α A(x Proof: (i) We only need to show that C 0 is bounded; because, C 0 is a closed and convex subset of R ( l+1 by ) definition. Assume on the contrary that we can take an unbounded direction α 0 in C x 0 ; ( ) α 0, x K, α 0, [A( x)+q α] K, x η, x + η,a( x)+q α + α 0. Since each term in the left hand side of the last inequality is nonnegative, we have η, x = 0 and α = 0. Since η int(k ) and x K, the first identity above implies that x = 0. Thus, ( ) α we have a contradiction to 0. x (ii) Suppose (CP α ) has an optimal solution s 1 α A(x )+q K. We have ( α ) x with α > 0. Then x x α K, x, s = x,a( x)+q = 1 (α ) 2 x,a(x )+α q = 0. Therefore, ( x, s) solves (CP). For the converse, let ( x, s) be a solution of (CP). Let ζ η, x + η, s 0, α = 1 ζ +1 and x = x ζ +1. ( α ) Then isafeasiblesolutionof(cp α ). Butthefeasibleregionof(CP α ) iscompact x and nonempty, its objective function is linear, hence, (CP α ) has optimal solution (or solutions). Since we already showed a solution with positive objective value, the optimum value is positive. (iii) This claim follows from the proof of (ii). Theorem 6.1 shows that we can apply SCRMs to (CP α ) with the above C 0 and P F and solve the original, general problem (CP). 13

References [1] Balas, E. (1974), Disjunctive programming: Properties of the convex hull of feasible points. Management Science Research Report 348 GSIA, Carnegie Mellon University, Pittsburgh, PA, USA. [2] Balas, E., S. Ceria and G. Cornuéjols (1993), A lift-and-project cutting plane algorithm for mixed 0-1 programs. Mathematical Programming 58 295 323. [3] Ceria, S. and G. Pataki (1998), Solving integer and disjunctive programs by lift-andproject, Proceedings of the Sixth IPCO Conference. [4] Cottle, R. W., J.-S. Pang and R. E. Stone (1992), Linear Complementarity Problem, Academic Press. [5] Kojima, M. and L. Tunçel (1998), Cones of matrices and successive convex relaxations of nonconvex sets. SIAM J. Optimization, to appear. [6] Kojima, M. and L. Tunçel (1998), Discretization and localization in successive convex relaxation methods for nonconvex quadratic optimization problems. Technical Report B-341, Dept. of Mathematical and Computing Sciences, Tokyo Institute of Technology, Tokyo, Japan. Also: Research Report 98 34, Department of Combinatorics and Optimization, University of Waterloo, Waterloo, Ontario, Canada. [7] Kojima, M. and L. Tunçel (1999), On the finite convergence of successive SDP relaxation methods. Technical Report B-354, Dept. of Mathematical and Computing Sciences, Tokyo Institute of Technology, Tokyo, Japan. Also: Research Report 98 36, Department of Combinatorics and Optimization, University of Waterloo, Waterloo, Ontario, Canada. [8] Lovász, L. and A. Schrijver (1991), Cones of matrices and set-functions and 0-1 optimization. SIAM J. Optimization 1 166 190. [9] Pardalos, P. M. and J. B. Rosen (1988), Global optimization approach to the linear complementarity problem. SIAM J. Scientific and Statistical Computing 9 341-353. [10] Sherali, H. D. and W. P. Adams (1990), A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM J. Discrete Mathematics 3 411 430. [11] Shida, M., S. Shindoh and M. Kojima (1997), Centers of monotone generalized complementarity problems. Mathematics of Operations Research 22 969 976. [12] Stubbs, R. A. and S. Mehrotra (1996), A branch-and-cut method for 0-1 mixed convex programming, Mathematical Programming, to appear. 14