A polynomial time interior point path following algorithm for LCP based on Chen Harker Kanzow smoothing techniques

Similar documents
A PENALIZED FISCHER-BURMEISTER NCP-FUNCTION. September 1997 (revised May 1998 and March 1999)

A Novel Inexact Smoothing Method for Second-Order Cone Complementarity Problems

Stationary Points of Bound Constrained Minimization Reformulations of Complementarity Problems1,2

Key words. linear complementarity problem, non-interior-point algorithm, Tikhonov regularization, P 0 matrix, regularized central path

1. Introduction The nonlinear complementarity problem (NCP) is to nd a point x 2 IR n such that hx; F (x)i = ; x 2 IR n + ; F (x) 2 IRn + ; where F is

20 J.-S. CHEN, C.-H. KO AND X.-R. WU. : R 2 R is given by. Recently, the generalized Fischer-Burmeister function ϕ p : R2 R, which includes

A FULL-NEWTON STEP INFEASIBLE-INTERIOR-POINT ALGORITHM COMPLEMENTARITY PROBLEMS

WHEN ARE THE (UN)CONSTRAINED STATIONARY POINTS OF THE IMPLICIT LAGRANGIAN GLOBAL SOLUTIONS?

Enlarging neighborhoods of interior-point algorithms for linear programming via least values of proximity measure functions

A WIDE NEIGHBORHOOD PRIMAL-DUAL INTERIOR-POINT ALGORITHM WITH ARC-SEARCH FOR LINEAR COMPLEMENTARITY PROBLEMS 1. INTRODUCTION

A Continuation Method for the Solution of Monotone Variational Inequality Problems

A Regularization Newton Method for Solving Nonlinear Complementarity Problems

Department of Social Systems and Management. Discussion Paper Series

Smoothed Fischer-Burmeister Equation Methods for the. Houyuan Jiang. CSIRO Mathematical and Information Sciences

Fischer-Burmeister Complementarity Function on Euclidean Jordan Algebras

A Generalized Homogeneous and Self-Dual Algorithm. for Linear Programming. February 1994 (revised December 1994)

On Superlinear Convergence of Infeasible Interior-Point Algorithms for Linearly Constrained Convex Programs *

A smoothing Newton-type method for second-order cone programming problems based on a new smoothing Fischer-Burmeister function

Solution of a General Linear Complementarity Problem using smooth optimization and its application to bilinear programming and LCP

An Infeasible Interior Point Method for the Monotone Linear Complementarity Problem

A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE

School of Mathematics, the University of New South Wales, Sydney 2052, Australia

Lecture 10. Primal-Dual Interior Point Method for LP

ON REGULARITY CONDITIONS FOR COMPLEMENTARITY PROBLEMS

Expected Residual Minimization Method for Stochastic Linear Complementarity Problems 1

Newton-type Methods for Solving the Nonsmooth Equations with Finitely Many Maximum Functions

Error bounds for symmetric cone complementarity problems

A full-newton step feasible interior-point algorithm for P (κ)-lcp based on a new search direction

Improved Full-Newton-Step Infeasible Interior- Point Method for Linear Complementarity Problems

PREDICTOR-CORRECTOR SMOOTHING METHODS FOR LINEAR PROGRAMS WITH A MORE FLEXIBLE UPDATE OF THE SMOOTHING PARAMETER 1

Predictor-corrector methods for sufficient linear complementarity problems in a wide neighborhood of the central path

Absolute value equations

Research Article The Solution Set Characterization and Error Bound for the Extended Mixed Linear Complementarity Problem

A Regularized Directional Derivative-Based Newton Method for Inverse Singular Value Problems

2 B. CHEN, X. CHEN AND C. KANZOW Abstract: We introduce a new NCP-function that reformulates a nonlinear complementarity problem as a system of semism

A Smoothing Newton Method for Solving Absolute Value Equations

Research Note. A New Infeasible Interior-Point Algorithm with Full Nesterov-Todd Step for Semi-Definite Optimization

Spectral gradient projection method for solving nonlinear monotone equations

system of equations. In particular, we give a complete characterization of the Q-superlinear

Examples of Perturbation Bounds of P-matrix Linear Complementarity Problems 1

IBM Almaden Research Center,650 Harry Road Sun Jose, Calijornia and School of Mathematical Sciences Tel Aviv University Tel Aviv, Israel

A Second-Order Path-Following Algorithm for Unconstrained Convex Optimization

An O(nL) Infeasible-Interior-Point Algorithm for Linear Programming arxiv: v2 [math.oc] 29 Jun 2015

CCO Commun. Comb. Optim.

Properties of Solution Set of Tensor Complementarity Problem

A full-newton step infeasible interior-point algorithm for linear complementarity problems based on a kernel function

On the Coerciveness of Merit Functions for the Second-Order Cone Complementarity Problem

Semismooth Support Vector Machines

The speed of Shor s R-algorithm

An Infeasible Interior-Point Algorithm with full-newton Step for Linear Optimization

Interior Point Methods for Linear Programming: Motivation & Theory

1. Introduction. We consider the classical variational inequality problem [1, 3, 7] VI(F, C), which is to find a point x such that

Interior-Point Methods

Contraction Methods for Convex Optimization and Monotone Variational Inequalities No.16

A PRIMAL-DUAL INTERIOR POINT ALGORITHM FOR CONVEX QUADRATIC PROGRAMS. 1. Introduction Consider the quadratic program (PQ) in standard format:

A new primal-dual path-following method for convex quadratic programming

A SIMPLY CONSTRAINED OPTIMIZATION REFORMULATION OF KKT SYSTEMS ARISING FROM VARIATIONAL INEQUALITIES

Finite Convergence for Feasible Solution Sequence of Variational Inequality Problems

Primal-dual relationship between Levenberg-Marquardt and central trajectories for linearly constrained convex optimization

Inexact alternating projections on nonconvex sets

Affine covariant Semi-smooth Newton in function space

A class of Smoothing Method for Linear Second-Order Cone Programming

A path following interior-point algorithm for semidefinite optimization problem based on new kernel function. djeffal

A Continuation Approach Using NCP Function for Solving Max-Cut Problem

A projection algorithm for strictly monotone linear complementarity problems.

SOR- and Jacobi-type Iterative Methods for Solving l 1 -l 2 Problems by Way of Fenchel Duality 1

A Power Penalty Method for a Bounded Nonlinear Complementarity Problem

Corrector-predictor methods for monotone linear complementarity problems in a wide neighborhood of the central path

The Q Method for Symmetric Cone Programmin

BOOK REVIEWS 169. minimize (c, x) subject to Ax > b, x > 0.

Semidefinite Programming

Rachid Benouahboun 1 and Abdelatif Mansouri 1

On the Local Quadratic Convergence of the Primal-Dual Augmented Lagrangian Method

A double projection method for solving variational inequalities without monotonicity

A Full Newton Step Infeasible Interior Point Algorithm for Linear Optimization

Interior Point Methods. We ll discuss linear programming first, followed by three nonlinear problems. Algorithms for Linear Programming Problems

An unconstrained smooth minimization reformulation of the second-order cone complementarity problem

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

Interior Point Methods in Mathematical Programming

Tensor Complementarity Problem and Semi-positive Tensors

On Generalized Primal-Dual Interior-Point Methods with Non-uniform Complementarity Perturbations for Quadratic Programming

Manual of ReSNA. matlab software for mixed nonlinear second-order cone complementarity problems based on Regularized Smoothing Newton Algorithm

Formulating an n-person noncooperative game as a tensor complementarity problem

SOLUTION OF NONLINEAR COMPLEMENTARITY PROBLEMS

Bulletin of the. Iranian Mathematical Society

c 1998 Society for Industrial and Applied Mathematics

Applying a type of SOC-functions to solve a system of equalities and inequalities under the order induced by second-order cone

On the Iteration Complexity of Some Projection Methods for Monotone Linear Variational Inequalities

Affine scaling interior Levenberg-Marquardt method for KKT systems. C S:Levenberg-Marquardt{)KKTXÚ

A full-newton step infeasible interior-point algorithm for linear programming based on a kernel function

Strict Feasibility Conditions in Nonlinear Complementarity Problems 1

A CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE

Merit functions and error bounds for generalized variational inequalities

CONVERGENCE ANALYSIS OF AN INTERIOR-POINT METHOD FOR NONCONVEX NONLINEAR PROGRAMMING

A FRITZ JOHN APPROACH TO FIRST ORDER OPTIMALITY CONDITIONS FOR MATHEMATICAL PROGRAMS WITH EQUILIBRIUM CONSTRAINTS

On the O(1/t) convergence rate of the projection and contraction methods for variational inequalities with Lipschitz continuous monotone operators

Polynomial complementarity problems

Infeasible Primal-Dual (Path-Following) Interior-Point Methods for Semidefinite Programming*

Eigenvalue analysis of constrained minimization problem for homogeneous polynomial

Nonsmooth Matrix Valued Functions Defined by Singular Values

Transcription:

Math. Program. 86: 9 03 (999) Springer-Verlag 999 Digital Object Identifier (DOI) 0.007/s007990056a Song Xu James V. Burke A polynomial time interior point path following algorithm for LCP based on Chen Harker Kanzow smoothing techniques Received September 9, 996 / Revised version received December, 997 Published online March 6, 999 Abstract. A polynomial complexity bound is established for an interior point path following algorithm for the monotone linear complementarity problem that is based on the Chen Harker Kanzow smoothing techniques. The fundamental difference with the Chen Harker and Kanzow algorithms is the introduction of a rescaled Newton direction. The rescaling requires the iterates to remain in the interior of the positive orthant. To compensate for this restriction, the iterates are not required to remain feasible with respect to the affine constraints. If the method is initiated at an interior point that is also feasible with respect to the affine constraints, then the complexity bound is O( nl); otherwise, the complexity bound is O(nL). The relations between our search direction and the one used in the standard interior-point algorithm are also discussed. Key words. linear complementarity polynomial complexity path following interior point method. Introduction Consider the monotone linear complementarity problem: LCP: Find(x,y ) IR n IR n satisfying Mx y + q = 0, () x 0, y 0,(x ) T y =0, () where M IR n n is positive semi definite and q IR n. In this paper, we establish the polynomial complexity of an interior point path following algorithm for LCP. The proposed algorithm can be viewed as an interior point variation on the Chen and Harker [5] and the Kanzow [] non interior path following algorithms for LCP. The algorithm has the same best polynomial time complexity as is exhibited by the standard short step interior point path following algorithm. The results of this paper represent a first step toward understanding the relationship between interior and non interior path following methods and provide a spring board for discovering the complexity of the new non interior path following algorithms for LCP. S. Xu: Department of Combinatorics and Optimization, University of Waterloo, Waterloo, Ontario NL 3G, e-mail: sxu@math.uwaterloo.ca J.V. Burke: Department of Mathematics, Box # 354350, University of Washington, Seattle, WA 9895 4350, e-mail: burke@math.washington.edu. This research is supported by the National Science Foundation Grant No. DMS-930377 Mathematics Subject Classification (99): 90C33

9 Song Xu, James V. Burke Path following (or continuation) methods for solving LCP are typically designed to follow the path in the positive orthant, IR n ++ IRn ++, determined by the equations F θµ (x, y) = 0forµ>0where the function F θµ : IR n IR n IR n IR n is given by with θ µ (a, b) = ab µ and F θµ (x, y) := [ ] Mx y + q, (3) µ (x, y) θ µ (x, y ) µ (x, y) =... θ µ (x n,y n ). (4) This path is called the central path [3]. Most path following methods attempt to follow the central path by applying Newton s method to the equations F θµ (x, y) = 0for decreasing values of µ. In this regard, predictor correctorstrategies are the most popular due to their rapid local convergence (for examples, see [9,3,34,35]). In a predictor corrector strategy a predictor step (µ = 0) is followed by a corrector step (µ >0) to return the iterates to a pre-specified neighborhood of the central path. Interior point methods stay in the vicinity of the central path and remain in the positive orthant [3]. Each iterate of a feasible interior point method must satisfy the affine equation 0 = Mx y + q while the iterates of an infeasible interior point method are not required to satisfy this equation. Non interior path following methods also follow the central path, but the iterates do not necessarily reside in the positive orthant. The first non interior path following method for LCP was developed by Chen and Harker [5] and was based on a scaled version of the function υ µ (a, b) = a + b (a b) 4 + µ. Later Kanzow [] developed non interior path following methods based on the functions υ µ and ψ µ (a, b) = a + b a + b + µ. Itiseasytoshowthatψ µ (a,b)=0(orυ µ (a,b)=0) if and only if 0 a, 0 b, and ab = µ. Thus, the functions ψ µ and υ µ have a fundamental advantage over the function θ µ which makes them well suited to non interior path following methods. That is, the condition ψ µ (a, b) = 0or(υ µ (a,b)=0) guarantees the non negativity of the arguments a and b. Using ψ µ and υ µ as building blocks, one defines the functions [ ] Mx y + q F ψµ (x, y) :=, (5) µ (x, y)

An LCP continuation method 93 where and where ψ µ (x, y ) µ (x, y) =... ψ µ (x n,y n ), (6) F υµ (x, y) := [ ] Mx y + q, (7) ϒ µ (x, y) ϒ µ (x, y) = υ µ(x, y ).... (8) υ µ (x n,y n ) Clearly, a point (x, y) is on the central path if and only if F ψµ (x, y)=0(orf υµ (x,y)=0). Setting µ = 0, we have υ 0 (a, b) = min{a, b}. This instance of υ µ has been studied extensively by Pang [6,7] and Harker and Pang [8]. Again taking µ = 0, the function ψ 0 (a, b) was introduced by Fischer in [] who attributes the function to Burmeister. In the growing literature associated with the function ψ 0 [8,0,,3 5,0,,30] it is often referred to as the Fischer Burmeister function. Newton like implementations based on these functions have proven to be quite successful. Extensions to solving nonlinear programming problems with equilibrium constraints are also being studied [9,6]. Two reasons for the growing interest in non interior methods based on the functions υ µ and ψ µ are () these methods are ideally suited for application to the nonlinear complementarity problem where the interiority restriction on the iterates is quite severe, and () the numerical evidence on the efficiency of these methods is very impressive. We partially explain this numerical success by establishing the polynomial complexity of an interior point implementation. This is the first complexity result available for these methods and indicates that a similar complexity result may be possible for a non interior implementation. The functions υ µ and ψ µ are very closely related. By rewriting the expression under the square root, we see that and υ µ (a, b) = a + b ψ µ (a, b) = a + b (a + b) 4 (a + b) + (µ ab) + (µ ab). The analysis of the algorithms based on these two functions are very similar differing only by a constant here and there. In what follows, we choose to focus on the function ψ µ. However, whenever appropriate, we indicate how the analysis differs when the function υ µ is used instead of ψ µ.

94 Song Xu, James V. Burke The plan of the paper is as follows. In Section, we discuss the rescaled Newton direction for the functions F ψµ and F υµ and its relation to the direction used in the standard interior point methods. The algorithm and its complexity are presented in Section 3. We conclude in Section 4 with some remarks on the relationship between our algorithm and the algorithms studied by Mizuno [4,5]. A few words about our notation are in order. All vectors are column vectors with the superscript T denoting transpose. The notation IR n is used for real n dimensional space with IR n ++ being the positive orthant, i.e. the set of vectors in IRn that are componentwise positive. Following standard usage in the interior point literature, we denote by e IR n the vector each of whose components is, and, for the vectors x, y, andzin IR n,we denote by X, Y, and Z the diagonal matrices whose diagonal entries are given by x, y, and z, respectively, e.g., X ii = x i for i =,,...,n. With this notation, the function µ (x, y) defined in (4) can be written as µ (x, y) = Xy µe.givenx IR n, we denote by x, x,and x, the norm, the norm, and the norm of x, respectively, and by x min the minimum component of the vector x.. The rescaled Newton directions The first step in our analysis is to rescale the Newton step to yield iterates comparable to those of a standard interior point strategy. By analogy with the infeasible interior point strategies, at iteration k we compute a Newton step based on the equations [ ] s F (x, y) = k ψµ k, 0 where s k := ( γ k )(Mx k y k + q) with 0 <γ k <. The equations for the Newton step ( x k, y k )take the form where and M x y = γ k (Mx k y k + q) (9) D x k x + D y k y = µ k(x k,y k ), (0) D x k := diag D y k := diag Observe that if (x, y) is on the central path, then x i + y i xi k (xi k) +(yi k) + µ k y k i (xi k) +(yi k) + µ k. + µ = x i + y i, for i =,...,n.

An LCP continuation method 95 (xi By replacing the expression k) +(yi k) + µ k in the definitions of the diagonal matrices D x k and D y k by the expression xk i +yk i and then multiplying (0) through by the diagonal ( (x ) matrix diag k i + yi k), we obtain the rescaled Newton equations where, for the sake of convenience, we define M x y = γ k (Mx k y k + q) () Y k x + X k y = ˆ µ k(x k,y k ). () ˆ µ (x, y) := diag ( xi + y i ) µ (x, y). The only difference between these rescaled Newton equations and the Newton equations used in a standard interior point path following strategy occurs in equation () where ˆ µ k(x k, y k ) replaces the usual term µ k(x k, y k ). The pattern of our development should now be clear. After a few identities and inequalities relating the functions ˆ µ (x, y) and µ (x, y) have been established, a convergence theory and complexity analysis can be developed which is based on standard techniques from the theory of interior point path following methods. The necessary identities and inequalities are given in the next lemma. Lemma. For a, b,µ IR satisfying a > 0, b > 0,µ>0, we have (a + b)θ µ (a, b) ˆψ µ (a, b) = (a + b) + a + b + µ, (3) ψ µ (a, b) = ˆψ µ (a, b) θ µ (a, b), and (4) ˆψ µ (a, b) θ µ (a,b), (5) where ˆψ µ (a, b) := a+b ψ µ (a, b). In addition, given 0 <β<,0<µ, and (x, y) IR n ++ IRn ++ satisfying µ(x, y) βµ, (6) we have ˆ µ (x, y) µ (x, y) β µ ( β). (7) Remark. The identity (3) is due to B. Chen []. Remark. Inequality (5) implies that for µ>0andβ>0, the condition (6) (used in standard interior point methods to define the neighborhood of the central path) implies that the condition ˆ µ (x, y) βµ is also satisfied.

96 Song Xu, James V. Burke Remark 3. The identities (3) and (4), the[ inequalities (5) and (7), and the second remark remain valid with the expressions (a + b) + ] a + b + µ, ˆψ µ,and ˆ µ [ replaced by (a + b) + ] (a b) + 4µ, ˆυ µ and ˆϒ µ, respectively, where ˆυ µ (a, b) := a+b υ µ(a, b) and ˆϒ µ (x, y) := diag ( x i +y i ) ϒµ (x, y). Remark 4. The bound (7) shows that the values ˆ µ k(x k, y k ) approach the values µ k(x k, y k ) used in the standard interior point methods as µ k approaches 0. This partially explains why the interior point method based on the rescaled Newton direction studied in the next section has the same best polynomial-time complexity as the standard short step path-following interior point methods. Proof. For a, b,µ IR satisfying a > 0, b > 0,µ > 0, the identity (3) is easily derived. The identity (4) and the inequality (5) follow readily from (3). In order to see the bound (7), note that for any (x, y) IR n ++ IR n ++ satisfying (6), we have x i y i ( β)µ for i =,,...,n, and so (x i + y i ) = (x i y i ) + 4x i y i x i y i ( β)µ for i =,,...,n. (8) It now follows from the identity (4), the inequality (5), and (8) that ˆ µ (x, y) µ (x, y) µ (x, y) ˆ µ (x, y) µ ( β)µ (x, y) ( β)µ β µ ( β)µ = β µ ( β). 3. The algorithm We present an algorithm based on the interior point algorithm proposed by Tseng [9]. The global linear convergence and complexity results are stated without proof since these proofs closely parallel those provided by Tseng [9]. Algorithm. Choose any (β,β ) IR satisfying 0 <β <β <, β β <β, β ( β ) +β β +β ( β )<β, (9) and any (x 0, y 0,µ 0 ) IR n+ ++ satisfying µ 0(x 0, y 0 ) β µ 0.Let η = β [ β ( β ) +β β +β ( β )] n+β. (0)

An LCP continuation method 97 For k = 0,,...,compute (x k+, y k+,µ k+ )from (x k, y k,µ k )according to x k+ = x k + x k, y k+ = y k + y k,µ k+ =( γ k )µ k, () where γ k is the largest γ (0,η ]satisfying ) ˆ µ k(x k, y k ) + γx k (Mx k y k + q) β (µ k µ k(x k, y k ), () and ( x k, y k )is the unique vector in IR n satisfying M x k y k = γ k (Mx k y k + q), (3) Y k x k + X k y k = ˆ µ k(x k,y k ). (4) Remark 5. To implement the algorithm using the function υ µ, begin by selecting the parameters β and β so that Then set 0 <β <β <, β β <β, η = β ( β ) +β β +β ( β )<β. (5) [ ] β β ( β ) + β β + β ( β ) (6) n + β and replace the function ˆ µ k in () and (4) by the function ˆϒ µ k. Remark 6. The set of pairs (β,β )satisfying either (9) or (5) is non empty. In both cases, it follows that η > 0. For a choice of β and β satisfying both (9) and (5), take β = 0.09,β =0.. The following Theorem shows that if the algorithm is initiated in the positive orthant, then it is well defined and the iterates remain both in the positive orthant and the set {(x, y) IR n IR n : µ (x, y) β µ} for decreasing values of µ. Theorem. Fix any (β,β ) IR satisfying (9). Let η be given by (0). Suppose that (x k, y k,µ k ) IR++ n+ satisfies µ k(x k, y k ) β µ k and ( x k, y k ) satisfies (3) and (4), with γ k being the largest γ (0,η ]satisfying (), then γ k > 0 exists and (x k + x k, y k + y k )>0, (7) ( γ k )µ k(xk + x k, y k + y k ) β ( γ k )µ k. (8) Proof. For the sake of simplicity, denote (x, y,µ) = (x k,y k,µ k ), ( x, y) = ( x k, y k )and γ = γ k respectively. We first establish that γ>0exists. By Proposition, ˆ µ (x, y) µ (x, y) β µ. By the choice of β and β in (9), we know that β <β ( β ). Therefore,

98 Song Xu, James V. Burke ( ˆ µ (x, y) <β µ( β ) β µ µ (x, y) ), which implies that γ>0exists since a strict inequality holds in () when γ = 0. Next set r = ˆ µ (x, y), s = Mx y + q, andz=x xand β = µ Then the system (3) and (4) can be rewritten as µ(x,y). MXz y = γs, YXz + X y = r. It follows that Since M is positive semidefinite, we have (YX + XMX)z = r γxs. z T YXz z T (YX + XMX)z = z T ( r γxs) z r+γxs, (9) which implies that z r + γxs min i x i y i r + γxs µ( β), (30) where the second inequality follows from the inequality Xy ( β)µe, (3) which is itself a consequence of the relation µ (x, y) = Xy µe βµ. By combining (30) with (), we find that z β <. Thus, in particular, e + z > 0. Let x = x + x and y = y + y. Hence x = x + Xz = X(e + z)>0, since x > 0. From Lemma and (4), for each i =,...,n,wehave (x i +( x) i )(y i + ( y) i ) µ = x i y i µ+[x i ( y) i + y i ( x) i ]+( x) i ( y) i ˆψ µ = ˆψ µ (x i,y i ) (x i,y i ) ( x i+y i ˆψ µ (x i,y i )+( x) i ( y) i ) ˆψ µ (x i, y i ) + ( x) i ( y) i (x i +y i ) ˆψ µ (x i, y i ) ( β)µ + ( x) i( y) i, (3)

An LCP continuation method 99 where (3) follows from the fact that (x i+y i ) x i y i ( β)µ. Therefore, X y µe ˆψ µ (x, y ) ( β)µ... ˆψ µ (x + ZX y (by (3)) n,y n ) ˆψ µ (x, y ) ( β)µ... ˆψ µ (x + Z( ˆ µ (x,y) Y x) (by (4)) n,y n ) ( β)µ ˆ µ (x, y) + Z ˆ µ (x, y) + ZYXz ( β)µ ˆ µ (x, y) + Z ˆ µ (x, y) + ZYXz ˆ µ (x, y) + z ˆ µ (x, y) + z T YXz ( β)µ (βµ) ( β)µ + ββ µ + z r +γxs (Proposition and (9)) (βµ) ( β)µ + ββ µ + β β µ( β) (by ()) β µ ( β ) + β β µ + β ( β )µ, (33) where (33) follows from the fact that β β and ββ µ + β ( β)µ = ββ µ + β µ β βµ = β(β β )µ + β µ β (β β )µ + β µ = β β µ + β ( β )µ. Therefore, by (9) and (33), X y µe β µ. It follows from x > 0andβ < that y > 0. The triangle inequality, (33), and the inequality γ<η now imply that X y ( γ)µe ( γ)µ X y µe ( γ)µ + γ n γ β ( β ) + β β + β ( β ) + γ n γ γ β η ( n + β ) + η n = β. η η The following global linear convergence result is patterned on [9, Theorem 3.].

00 Song Xu, James V. Burke Theorem. Let S denote the set of solutions to LCP: S := { } (x, y) : 0 x, 0 y, y = Mx + q, and x T y = 0, and let β,β,η and {(x k, y k,µ k,γ k )} k=0,,..., be generated by the Algorithm of Section 3. Then for all k,wherefork>0 0 <(x k,y k ), (34) β µ k µ k(x k, y k ), and (35) µ k µ 0 (Mx0 y 0 + q) = Mx k y k + q, (36) µ k =( γ k )...( γ 0 )µ 0. (37) Moreover, the sequence {(x k, y k )} is bounded if and only if the solution set S is non empty, in which case, for any (x, y ) S, we have γ k min{η,η }for all k,where { [β ( β ) β ]µ 0 min i yi 0 η = [(+β )nµ 0 +(x 0 ) T y 0 +(x ) T y 0 +(x 0 ) T y ] Mx 0 y 0 +q if Mx 0 y 0 + q = 0, if Mx 0 y 0 + q = 0. (38) Thus, if S is nonempty, the Algorithm of Section 3 forces µ k to zero at a global linear rate with the convergence ratio less than min{η,η }. Therefore, by standard results in the interior point literature (e.g., see [3]), one can find an element of S in O((min{η,η }) L)iterations, where L denotes the size of the binary encoding of the problem. It is easily seen that η = O( n), so it only remains to estimate η.inthe case where (x 0, y 0,µ 0 )is chosen so that η is O( n) (such as when Mx 0 y 0 +q = 0), the iteration count is O( nl). In the case where (x 0, y 0,µ 0 )is the standard choice x 0 = ρ p e, y 0 = ρ d e,µ 0 =ρ p ρ d, ρ p x,ρ d max n { y where (x, y ) is any element of S, the formula (38) yields so the iteration count is O(nL). η 3(4 + β )n, β ( β ) β n, ρ p Me + q },

An LCP continuation method 0 4. Concluding remarks In Section 3, we present the first rate of convergence result and the first complexity result of any kind for a path following algorithm based on the Chen Harker Kanzow smoothing techniques. In the year following the announcement of this result there has been a flurry of activity on rate of convergence results for non-interior path following and smoothing methods for the complementarity problems and variational inequalities [,3,4,6,8,3,33]. All of this work builds on new neighborhood concepts [,9] for smoothingpaths (e.g. the central path) that do not necessarily lie in the positive orthant. The first global linear convergence result for non-interior path following methods appears in []. The work in [3,4,6,3,33] builds on the ideas presented in [] and [9]. In [3], Xu establishes the global linear convergence result for nonlinear complementarity problems. In [3,4,6] the authors extend the analysis to larger classes of smoothing functions [7,7] and, in addition, establish the local quadratic or super linear convergence of their methods. In [8], the authors build on the approach developed in [9] and establish the global linear convergence or the local super linear convergence of their method depending on the choice of parameters. The interior point path following method studied in this paper is essentially a variation on standard interior point methods wherein the right hand side in the Newton equations is perturbed in a very special way. For this reason, it is possible to analyze the algorithm within the framework developed by Mizuno. In [4,5], Mizuno proposed a class of feasible interior point algorithms for monotone LCP which are based on the search direction ( x k, y k )satisfying the following equations M x y = 0, (39) Y k x + X k y = v k σx k y k, (40) where v k IR n ++ and σ>0. By adjusting the choice of the sequences {vk } with σ =, Mizuno is able to construct both path following and potential reduction methods and thereby provides a unifying framework within which a number of interior point methods can be studied. In order for this program to work, one must first show that the sequence {v k } satisfies the following three properties: (A) v k > 0fork=0,,... (B) the sequence {v k } is an α sequence for some α 0, that is, v k+ N (v k,α)for all k = 0,,,...,whereN(v, α) ={u IR n : V 0.5 (v u) α v min }, with V = diag (v),and (C) there is an iteration index m = O( nl) such that 0 v m L+ e. A referee for this paper has observed that the algorithm of Section 3 can be cast within Mizuno s framework. To see this, define v k = X k y k ˆ µ k(x k, y k ). (4) With this definition, the Newton equations (39) and (40) are identical to the equations () and () when σ =. If one now assumes that β (0, ] and (µk µ k+ )/µ k =

0 Song Xu, James V. Burke O(/ n), it can be shown that the sequence {v k } defined by (4) satisfies the conditions (A) and (B). The condition β (0, ] can be enforced during the initialization phase of the algorithm. It is used to show that θ µ(x i, y i ) ˆψ µ (x i,y i ) θ µ (x i,y i ), for i =,,...,n whenever (x, y) IR n ++ IRn ++ and µ (x, y) βµ, which in turn shows that condition (A) is satisfied. The bounds min{η,η }γ k η (Theorem and (0)) show that O(/ n) = γ k if (x 0, y 0,µ 0 ) is chosen so that η = O(/ n) (for example, when y 0 = Mx 0 + q). This in turn implies that the condition (µ k µ k+ )/µ k = O(/ n) is also satisfied. Finally, condition (C) can be verified using the complexity result established in this paper. This connection to Mizuno s work should provide a basis for developing a deeper understanding of the relationship between standard path following methods, potential reduction methods, and the path following method proposed in this paper. Acknowledgements. We thank Bintong Chen for observing the identity (3) which greatly simplified the original proof of Lemma. In addition, we wish to express our gratitude to an anonymous referee for providing the details of the relationship between the rescaled Newton direction and Mizuno s convergence framework. References. Burke, J., Xu, S. (996): The global linear convergence of a non-interior path-following algorithm for linear complementarity problem. Preprint, Department of Mathematics, University of Washington, Seattle, WA 9895. December 996. Chen, B. (997): Personal communication. January 997 3. Chen, B., Chen, X. (997): A global linear and local quadratic continuation method for variational inequalities with box constraints. Preprint, Department of Management and Systems, Washington State University, Pullman, WA 9964-4736. March 997 4. Chen, B., Chen, X. (997): A global and local super linear continuation method for P 0 +R 0 and monotone NCP. Preprint, Department of Management and Systems, Washington State University, Pullman, WA 9964-4736. May 997. To appear in SIAM J. Optim. 5. Chen, B., Harker, P.T. (993): A non interior point continuation method for linear complementarity problems. SIAM J. Matrix Anal. Appl. 4, 68 90 6. Chen, B., Xiu, N. (997): A global linear and local quadratic non-interior continuation method for nonlinear complementarity problems based on Chen-Mangasarian smoothing functions. Preprint, Department of Management and Systems, Washington State University, Pullman, WA 9964-4736. February 997. To appear in SIAM J. Optim. 7. Chen, C., Mangasarian, O.L. (996): A class of smoothing functions for nonlinear and mixed complementarity problems. Comput. Optim. Appl. 5, 97 38 8. De Luca, T., Facchinei, F., Kanzow, C. (996): A semismooth equation approach to the solution of nonlinear complementarity problems. Math. Program. 75, 406 439 9. Facchinei, F., Jiang, H., Qi, L. (996): A smoothing method for mathematical programs with equilibrium constraints. Preprint, School of Mathematis, University of New South Wales, Sydney, Australia. To appear in Math. Program. 0. Facchinei, F., Soares, J. (995): Testing a new class of algorithms for nonlinear complementarity problems. In: Giannessi, F., Maugeri, A., eds., Variational Inequalities and Network Equilibrium Problems, pp. 69 83. Plenum Press, New York

An LCP continuation method 03. Facchinei, F., Soares, J. (997): A new merit function for nonlinear complementarity problems and a related algorithm. SIAM J. Optim. 7, 5 47. Fischer, A. (99): A special Newton type optimization method. Optimization 4, 69 84 3. Fischer, A. (995): A Newton type method for positive semi definite linear complementarity problems. J. Optimization Theory Appl. 86, 585 608 4. Fischer, A. (995): An NCP function and its use for the solution of complementarity problems. In: Du, D.-Z., Qi, L., Womersley, R.S., eds., Recent Advances in Nonsmooth Optimization, pp. 88 05. World Scientific Publishers, Singapore 5. Fischer, A. (995): On the local super linear convergence of a Newton type method for LCP under weak conditions. Optimization Methods Software 6, 83 07 6. Fukushima, M., Luo, Z.-Q., Pang, J.-S. (998): A globally convergent sequential quadratic programming algorithm for mathematical programs with linear complementarity constraints. Comput. Optim. Appl. 0, 5 34 7. Gabriel, S.A., Moré, J.J. (997): Smoothing of mixed complementarity problems. In: Ferris, M.C., Pang, J.S., eds., Complementarity and Variational Problems: State of the Art, pp. 05 6. SIAM, Philadelphia, PA 8. Harker, P.T., Pang, J.-S. (990): A damped Newton method for the linear complementarity problem. In: Allgower, E.L., Georg, K., eds., Computational Solution of Nonlinear Systems of Equations, pp. 65 84. Lectures in Applied Mathematics, Vol. 6, AMS, Providence, Rhode Island 9. Hotta, K., Yoshise, A. (996): Global convergence of a class of non interior point algorithms using Chen Harker Kanzow functions for nonlinear complementarity problems. Discussion Paper Series, No. 708, University of Tsukuba, Tsukuba, Ibaraki 305, Japan. December 996. To appear in Math. Program. 0. Kanzow, C. (996): Global convergence properties of some iterative methods for linear complementarity problems. SIAM J. Optim. 6, 36 34. Kanzow, C. (996): Some noninterior continuation methods for linear complementarity problems. SIAM J. Matrix Anal. Appl. 7, 85 868. Kanzow, C., Jiang, H. (998): A continuation method for (strongly) monotone variational inequalities. Math. Program. 8, 03 5 3. Kojima, M., Meggido, N., Noma, T., Yoshise, A. (99): A unified approach to interior point algorithms for linear complementarity problems. Springer, Berlin 4. Mizuno, S. (990): An O(n 3 L) algorithm using a sequence for a linear complementarity problem. J. Oper. Res. Soc. Japan 33, 66 75 5. Mizuno, S. (99): A new polynomial time method for a linear complementarity problem. Math. Program. 56, 3 43 6. Pang, J.-S. (990): Newton s method for B differentiable equations. Math. Oper. Res. 5, 3 34 7. Pang, J.-S. (99): A B differentiable equation based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity, and variational inequality problems. Math. Program. 5, 0 3 8. Qi, L., Sun, D. (997): Globally linearly, and globally and locally superlinearly convergent versions of the Hotta Yoshise non interior point algorithm for nonlinear complementarity problems. Applied Mathematics Report, School of Mathematics University of New South Wales, Sydney 05, Australia. May 997. To appear in Math. Comp. 9. Tseng, P. (994): Simplified analysis of an O(nL) iteration infeasible predictor corrector path following method for monotone LCP. In: Agarwal, R.P., ed., Recent Trends in Optimization Theory and Applications, pp. 43 434. World Scientific Press, Singapore 30. Tseng, P. (996): Growth behavior of a class of merit functions for the nonlinear complementarity problem. J. Optimization Theory Appl. 89, 7 37 3. Wright, S.J. (993): A path following infeasible interior point algorithm for linear complementarity problems. Optimization Methods Software, 79 06 3. Xu, S. (996): The global linear convergence of an infeasible non interior path folowing algorithm for complementarity problems with uniform P functions. Technique Report, Department of Mathematics, University of Washington, Seattle, WA 9895. December 996 33. Xu, S. (997): The global linear convergence and complexity of a non-interior path-following algorithm for monotone LCP based on Chen-Harker-Kanzow-Smale smoothing function. Technique Report, Department of Mathematics, University of Washington, Seattle, WA 9895. February 997 34. Ye, Y., Anstreicher, K. (993): On quadratic and O( nl) iteration convergence of a predictor corrector algorithm for LCP. Math. Program. 6, 537 55 35. Zhang, Y. (994): On the convergence of a class of infeasible interior point algorithms for the horizontal linear complementarity problem. SIAM J. Optim., 4, 08 7