Barrier Functions in Interior Point Methods Osman Guler Technical Report 94{01, March 1994 (Revised May 1995) Abstract We show that the universal barr

Size: px
Start display at page:

Download "Barrier Functions in Interior Point Methods Osman Guler Technical Report 94{01, March 1994 (Revised May 1995) Abstract We show that the universal barr"

Transcription

1 Barrier Functions in Interior Point Methods Osman Guler Technical Report 94{01, March 1994 (Revised May 1995) Abstract We show that the universal barrier function of a convex cone introduced by Nesterov and Nemirovskii is the logarithm of the characteristic function of the cone. This interpretation demonstrates the invariance of the universal barrier under the automorphism group of the underlying cone. This provides a simple method for calculating the universal barrier for homogeneous cones. We identify some known barriers as the universal barrier scaled by an appropriate constant. We also calculate some new universal barrier functions. Our results connect the eld of interior point methods to several branches of mathematics such as Lie groups, Jordan algebras, Siegel domains, dierential geometry, complex analysis of several variables, etc. Key words. Barrier functions, interior point methods, self{concordance, convex cones, characteristic function, duality mapping, automorphism group of a cone, homogeneous cones, homogeneous self{dual cones. Abbreviated title. Barrier Functions in Interior Point Methods. AMS(MOS) subject classications: primary 90C25, 90C60, 52A41; secondary 90C06, 90C15, 90C20, 90C33. Department of Mathematics and Statistics, University of Maryland Baltimore County, Baltimore, Maryland 21228, USA. ( guler@math.umbc.edu). Research partially supported by the National Science Foundation under grant DMS{

2 1 Introduction Since Karmarkar [17] introduced his polynomial{time projective algorithm for linear programming, the eld of interior point methods has been developing at a rapid rate. There are at present close to 1500 papers written in the eld. Most of these papers deal with the important problems of linear programming, convex quadratic programming, and monotone linear complementarity. At the same time, some researchers, especially Nesterov and Nemirovskii have successfully developed a general theory of interior point methods for nonlinear convex programming problems and monotone variational inequalities. The details of this theory can be found in the recent book by Nesterov and Nemirovskii [20]. The two main components of this theory are the self{concordant barrier functions and the Newton method. This paper is concerned with the construction of barrier functions. We now recall some relevant concepts. Let Q R n be an open convex set. A function F : Q! R is called an {self{concordant function if F is at least three times dierentiable, convex, and satises the property jd 3 F (x)[h; h; h]j 2 p (D 2 F (x)[h; h]) 3=2 ; (1) where D k F (x)[h; : : : ; h] is the kth directional of F at x along the direction h 2 R n. The function F is called strongly self{concordant if it is also a barrier function of Q, that is, F (x)! 1 as One of the main contributions of Nesterov and Nemirovskii is to show that the (damped) Newton method performs well in minimizing a self{concordant function, and that this is responsible for the polynomial{time convergence of the interior point methods. They also show that, in solving constrained convex programming problems, a key role is played by self{concordant barrier functions which are 1{self{concordant and satisfy the additional property jdf (x)[h]j 2 #D 2 F (x)[h; h]: (2) The constant # is called the parameter of the barrier function, and determines the speed of the underlying interior point method. We also recall the relevant barrier function concepts for a pointed convex cone K with non{empty interior, that is, a convex cone containing no lines and having a non{empty interior. (There is no essential loss of generality in restricting attention to pointed cones.) A function F is called a #{logarithmically homogeneous barrier for K if it is a barrier function for K and satises the property F (tx) = F (x)? # log t; (3) 2

3 that is, the function '(x) = e F (x) is?# homogeneous: '(tx) = '(x) t # : The function F is called a #{normal barrier for K if it is #{logarithmically homogeneous and 1{self{concordant. Nesterov and Nemirovskii [20], Proposition 5.1.4, show that any self{concordant{barrier function on a convex set with non{empty interior can be extended to a logarithmically homogeneous self{concordant barrier function on the cone tted to Q (conic hull in the terminology of [20]). Thus we can restrict our attention to cones. In this paper, we shall be concerned with the construction of logarithmically homogeneous self{concordant barrier functions for convex cones. Nesterov and Nemirovskii show that any open convex set Q admits a universal barrier function which is also logarithmically homogeneous if Q is a pointed convex cone. They describe the universal barrier function in terms of the volume of the polar set, see Section 4. One of the main contributions of the present paper is to show that there exists a simpler representation of this function in terms of the characteristic function of a cone described below in Section 3. The characteristic function, introduced by Koecher [18] in 1957, is useful in the classication of homogeneous bounded domains in several complex variables. This subject has its origins in the works of Poincare, E. Cartan [3], C. L. Siegel, Pyatetskii{Shapiro, and others, (see the book [24] by Pyatetskii{Shapiro for details). The characteristic function also has connections with the Bergman kernel function on tube domains [8], etc; it even has uses in algebraic geometry [23]. The characteristic function for a cone K has invariance properties under the action of the automorphism group of K. This will be discussed below in Section 2. These invariance properties will help greatly in calculating the characteristic function of homogeneous cones, see Section 7. It is remarkable that homogeneous self{dual cones (\domains of positivity" in Koecher's terminology [18]) can be completely classied in terms of certain Jordan algebras, see Koecher [19], Hertneck [14], Vinberg [34], Satake [28], Faraut and Koranyi [8]. There exist only ve classes of irreducible self{dual cones which will be mentioned in Section 2. Vinberg [34] is the rst to give an example of a homogeneous cone that is not self{dual. The class of homogeneous cones is much larger than the class of homogeneous self{dual cones. However, homogeneous cones can also be classied in terms of a class of non{ associative matrix algebras, called T {algebras by Vinberg, see Vinberg [32, 33]. These cones can be constructed recursively, see Vinberg [32, 33], Gindikin [10], Rothaus [27], Dorfmeister [4, 5, 6], etc. The Hessian of the characteristic function denes an invariant Riemannian metric in K. Thus, the characteristic function has intimate connections with Lie groups and 3

4 dierential geometry [18, 19, 26, 32, 4, 5, 28]. The characteristic function also has uses in carrying out Fourier analysis on K [15, 10, 30, 8]. The paper is organized as follows. In Section 2 we present some concepts and results from the theory of convex cones, especially concepts related to the automorphism group of the cone. In Section 3, we introduce the characteristic function of a cone K R n and discuss its invariance properties. In Section 4, we prove the important result that the universal barrier function of K is essentially the logarithm of the characteristic function of K. In Section 5, we introduce the duality mapping which is an analytic bijection between K 0 and (K ) 0, the interiors of K and its dual K. We also show that if K is a homogeneous cone, then the (slightly modied) Fenchel dual of the universal barrier for K is the same as the universal barrier for K. In Section 6, we describe the important concept of a Siegel cone and how it relates to homogeneous cones and their classication. In Section 7, we calculate the universal barrier functions for some cones. Concluding remarks are made in Section 8. 2 Convex Cones In this section we present some elementary concepts and some relevant results from the theory of convex cones. Denition 2.1 A subset K R n is called a cone if for x 2 K and a scalar 0, we have x 2 K. A cone K is called convex if x; y 2 K implies x + y 2 K. If in addition K 0 6= ; and K contains no lines, then K is called a regular convex cone. In this paper, we shall always be concerned with regular convex cones, and will refer to these simply as cones. Two cones K 1 and K 2 are called isomorphic if there exists an invertible linear mapping A 2 R nn such that A(K 1 ) = K 2. Isomorphic cones can be considered equivalent. Let R n be endowed with an inner product hx; yi = x T Sy where S is a symmetric, positive denite matrix. The dual of cone K is dened as \ K = fy 2 R n : hx; yi 0g: (4) x2k It is well{known that if K is any closed convex cone, then K = K, and if K is regular, then so is K. Note that the dual cone depends on the inner product; it can be veried that if hx; yi I = x T y is the standard inner product on R n, then the dual K I is related to K by the equation K = S?1 (K I ): (5) 4

5 A cone is called self{dual if there exists an inner product such that K = K. Note that a self{dual cone in one inner product may not be so in another one. The self{duality is a useful property, and this is the main reason why we allow inner products other than the standard one, see for example Section 7.3. Note that a self{dual cone K in the inner product h; i S is isomorphic to the cone S 1=2 (K) which is self{dual in the standard inner product. Thus, if one is willing to work with transformed coordinates, one can always work with the standard inner product. However, this may not be convenient, since it might make it harder to describe the cone in the transformed coordinates, see again Section 7.3. Let K i R n i, i = 1; : : : ; k be cones. The direct sum of the cones K i is the cone K 1 K 2 : : : K k = f(x 1 ; : : : ; x k ) : x i 2 K i g: A cone K is called decomposable if it can be written as a direct product of cones. Otherwise, it is called indecomposable or irreducible. It is well known that a decomposable cone can be written as a direct sum of irreducible cones essentially in a unique way, see for example Schneider [29], Theorem 3.2.1, pp The following denition formalizes the symmetries of a cone. Denition 2.2 Let K R n be a cone. The set of non-singular linear maps A : R n! R n leaving K invariant, that is satisfying A(K) = K, is called the automorphism group of K and is denoted by Aut(K). K is called homogeneous if Aut(K) is transitive on K 0, that is, given arbitrary points x; y in K 0, there exists A 2 Aut(K) such that Ax = y. It is easy to verify that Aut(K) forms a subgroup of the general linear group GL(n; R) of all non{singular linear transformations of R n. It is also easy to see that Aut(K) is a closed subgroup of GL(n; R). Thus, by a theorem of von Neumann (or a more general result of E. Cartan), Aut(K) is a Lie group. From (4) it follows that if A 2 Aut(K), and x 2 K 0, y 2 (K ) 0, we have 0 < x T A T Sy = (Ax) T Sy = hax; yi hx; A yi = x T SA y: (6) This shows that the conjugate map A = S?1 A T S 2 Aut(K ). Similarly, if B 2 Aut(K ), then B 2 Aut(K). It follows that Aut(K ) = fa : A = S?1 A T S; A 2 Aut(K)g; that is, the groups Aut(K) and Aut(K ) are isomorphic. It follows from (6) that the mapping (A) = (A )?1 = S?1 (A T )?1 S is a group isomorphism between Aut(K) and Aut(K ). If K is homogeneous, then so is the dual cone K, see (16). The automorphism group of a decomposable group is related 5

6 to the automorphism groups of its summands in the following way (see Vinberg [32]): if K = k i=1 K i, then Q k i=1 Aut(K i) is a normal subgroup of nite index in Aut(K). It is clear that if the cones K i are homogeneous, then so is K. Irreducible homogeneous self{dual cones can be characterized completely in terms of formally real Jordan algebras [19, 14, 34, 28, 8], etc. These algebras, invented by P. Jordan in connection with quantum mechanics, are essentially classied in the very rst paper on Jordan algebras, the paper [16] by P. Jordan, J. von Neumann, and E. Wigner. Any homogeneous, irreducible self{dual cone is isomorphic to one of the following ve cones: (i) the cone of positive semi{denite symmetric matrices (see Section 7.3), (ii) the Lorentz cone (see Section 7.2), (iii) the cone of positive semi{denite Hermitian matrices, (iv) the cone of positive semi{denite Hermitian quaternion matrices, (v) a 27 dimensional exceptional cone. The characteristic function of a cone discussed in Section 3 below is an important tool in this classication. Vinberg [34] gives an example of a homogeneous cone that is not isomorphic to a self{dual cone. In his seminal paper [32], he classies the homogeneous cones in term of T {algebras, a class of matrix algebras that he invents for this purpose. Again, the characteristic function plays a central role in the classication of homogeneous cones. As mentioned above, it is possible to build up homogeneous cones in a recursive manner. This is discussed in some detail in Section Characteristic Function of a Cone In this section we state the denition of the characteristic function of a cone and present its most important properties. Denition 3.1 Let K R n be a cone equipped with an inner product hx; yi = x T Sy, where S 2 R nn is a symmetric, positive denite matrix. The characteristic function ' K : K 0! R of the cone K is the function ' K (x) = K e?hx;yi dy: (7) 6

7 We shall write ' when the cone under consideration is obvious. The function ' is essentially independent of the inner product. Consider the standard product in hx; yi I = x T y. Equation (5) implies K I = S(K ) and we have ' I (x) = K I e?xt y dy = S(K ) e?hx;s?1 yi dy = K e?hx;y0i (det S)dy 0 = '(x) det S: (8) Consequently, the two characteristic functions dier by a multiplicative constant. The characteristic function has been introduced in connection with the classication of bounded homogeneous domains in complex analysis of several variables. Its main properties can be found in Koecher [18, 19], Rothaus [26], Vinberg [32], and Faraut and Koranyi [8], etc. The most important properties of ' are (P1) ' is an analytic function dened on the interior of K and '(x)! 1 as (P2) ' is logarithmically strictly convex, that is, the function is strictly convex, (P3) If A is an automorphism of K, then F (x) = log('(x)) '(Ax) = '(x) j det Aj : (9) We note that since ti 2 Aut(K) for any t > 0, we have '(tx) = '(x) t n : (10) The properties (P1) and (P2) show that ' and F above are smooth barrier functions for K. These two functions, especially F will be important for interior point methods; we will show in Section 4 that F is essentially the universal barrier function of K. Property (P3) is the important invariance property of '. Note that it is obtained from (7) by the change of variables formula. Since '(Ax) = '(x)=(j det Aj), we have which implies the important identity F (Ax) = F (x)? log(j det Aj); D k F (Ax)[Ah; Ah; : : : ; Ah] = D k F (x)[h; h; : : : ; h]; 8h 2 R n ; k 1: (11) 7

8 Property (P3) is important in calculating the barrier function of homogeneous cones. Let K be a homogeneous cone. Fix a point e 2 K 0. Let x 2 K 0 be an arbitrary point, and suppose that A x 2 Aut(K) satises A x e = x. Then (P3) implies Consequently, '(x) = '(A x e) = '(e) j det A x j = const j det A x j : (12) F (x) = const? log(j det A x j): (13) We conclude this section by noting that D 2 F (x) denes an invariant Riemannian metric on K. In fact, (11) implies that each derivative D k F (x), k 1, is invariant under the action of Aut(K). Moreover, (9) and the change of variables formula imply that the measure '(x)dx is invariant under Aut(K), that is, if A 2 Aut(K), then K h(ax)'(x)dx = whenever the integral on the right exists. K h(x)'(x)dx 4 Self{Concordance of the Characteristic Function In this section we prove the important result that the universal barrier function of Nesterov and Nemirovskii is essentially the logarithm of the characteristic function. This representation of the universal barrier function will make it easier to calculate barrier functions for cones. Let Q R n be a convex set. Nesterov and Nemirovskii [20] dene the universal barrier function for Q as u(x) = log(vol n (Q (x)); where vol n stands for the n{dimensional Lebesgue measure, and Q (x) is the polar set of Q centered at x, that is, Q (x) = fy 2 R n : hz? x; yi 1; 8z 2 Qg: (14) We need the following result in the proof of Theorem 4.1. Lemma 4.1 Let K R n be a cone. Then for x 2 K, K (x) =?fy 2 K : hy; xi 1g: 8

9 Proof. Denote the set on the right by U. First, we show that U K (x). Suppose that u 2 U. Then h?x; ui 1 and since u 2?K, we also have hz; ui 0 for all z 2 K. Adding these two inequalities gives hz? x; ui 1 for all z 2 K, implying u 2 K (x). Conversely, suppose that u 2 K (x). Then y =?u satises hz 0? x;?yi 1; 8z 0 2 K: Setting z 0 = 0 above gives hx; yi 1. Also, setting z 0 = x + z, > 0, z 2 K gives hz; yi?1=. Letting! 1 shows hz; yi 0, that is, y 2 K. Thus, u 2 U. We dene the sets H(x; ) = fy : hx=jjxjj; yi = g; H? (x; ) = fy : hx=jjxjj; yi g: The following theorem is one of the main results of this paper. Theorem 4.1 Let ' be the characteristic function of a cone K, and dene F (x) = log('(x)). Then F (x) = u(x) + log n!: Proof. The hyperplane H(x; ) is orthogonal to x and has distance from the origin. The function e?hx;yi = e?jjxjj is constant on this hyperplane, and we can write '(x) as 1 '(x) = e?hx;yi dy = e?jjxjj d n?1 y d K 0 K \H(x;) 1 = e?jjxjj (n? 1)! n?1 d d n?1 y = vol 0 K \H(x;1) jjxjj n n?1 (K \ H(x; 1)): Here the second equality can be obtained by elementary methods, for example by transforming variables. It is also a direct application of the co{area formula, see [7], Theorem 2, Section 3.4.3, pp. 117, or [9], Theorem 3.2.3, pp Since we have '(x) n! = vol n (K \ H? (x; 1)) = vol n?1(k \ H(x; 1)) ; n 1 jjxjj n vol n(k \ H? (x; 1)) = vol n (K \ H? (x; 1=jjxjj)) = vol n (fy 2 K : hx; yi 1g) = vol n (K (x)) = e u(x) ; 9

10 where the fourth equality follows from Lemma 4.1. Let Q R n be a closed convex set with non{empty interior. Endow R n+1 with the inner product h(x; t); (y; )i = hx; yi + t, and consider the tted cone K(Q) R n+1 dened by K(Q) = cl(f(x; t) : x 2 tq; t > 0g = ft(z; 1) : z 2 Q; t > 0g): Since Q is identied with the cross section K(Q) \ f(x; 1) : x 2 R n g, the restriction of ' K(Q) to the cross section gives a \characteristic function" for Q. We begin by calculating ' K(Q). Theorem 4.2 Let '(x; t) be the characteristic function of the cone K(Q). Then '(x; t) = n! t n+1 vol n((q) (x=t)): Proof. Theorem 4.1 gives '(x; t) = (n + 1)! vol n+1 K(Q) \ f(y; ) : h(x; t); (y; )i 1g = (n + 1)! vol n+1 K(Q) \ H? ((x; t); 1=jj(x; t)jj : Thus, we have Now '(x; t) (n + 1)! = = = 1 jj(x; t)jj vol n+1 n+1 K(Q) \ H? ((x; t); 1)) 1 (n + 1)jj(x; t)jj vol n(k(q) \ H((x; t); 1)) n+1 1 (n + 1)jj(x; t)jj vol n(k(q) \ H((x; t); 1=jj(x; t)jj)): K(Q) \ H((x; t); 1=jj(x; t)jj) = f(y; ) : hz; yi + t 0; 8z 2 tq; and hx; yi + t = 1g = 1? hx; yi f(y; ) : hz? x;?yi 1; 8z 2 tqg t = 1? hx; yi f(y; ) : y 2?(tQ) (x)g: t Therefore, n! '(x; t) = jj(x; t)jj vol 1? hx; yi n f(y; ) : y 2?(tQ) (x)g : t 10

11 The set in the above formula is the graph of the function (y) = (1? hx; yi)=t over the domain?(tq) (x). By the surface area formula in calculus, it has volume This shows that and proves the theorem. jj(x=t; 1)jjvol n ((tq) (x)) = jj(x; t)jj vol n (Q (x=t)): t n+1 '(x; t) = n! t n+1 vol n(q (x=t)); Corollary 4.1 Dene F Q (x) = log(' K(Q) (x; 1)). Then F Q (x) = u Q (x) + log n!; where u Q is the universal barrier function for Q. In other words, F Q (x) and the universal barrier function for Q dier only by an additive constant. Nesterov and Nemirovskii prove in their book, [20] (Theorem 2.5.1, pp. 50), that the universal barrier function is self{concordant with a parameter # = O(n). Their derivation of the bound on # is long and involves delicate moment inequalities. At least for homogeneous cones, one can give a simple proof that F is self{concordant, although the proof does not give any bound on the important self{concordance parameter #. (We know # = O(n) as mentioned above.) Theorem 4.3 Let K R n concordant barrier function. be a homogeneous cone. Then F (x) = log ' K (x) is a self{ Proof. Fix a point e 2 K 0 and let x 2 K 0 be an arbitrary point. Since K is homogeneous, there exists A x 2 Aut(K) such that A x e = x. It follows from (11) that D k F (x)[a x h; A x h; : : : ; A x h] = D k F (e)[h; h; : : : ; h]; k 1: (15) Since ' satises (10), it suces to show (see [20]) that there exists a constant c > 0 satisfying jd 3 F (x)[h 0 ; h 0 ; h 0 ]j c(d 2 F (x)[h 0 ; h 0 ]) 3=2 ; 8h 0 2 R n : It follows from (15) that it is sucient to prove this inequality only at e, that is, it is enough to show that jd 3 F (e)[h; h; h]j c(d 2 F (e)[h; h]) 3=2 ; 8h 2 R n : 11

12 This is obvious, since D 2 F (e) is a symmetric positive denite matrix. We remark that the above proof reduces the calculation of the parameter # on the whole set K 0 to calculating it at a single point x 2 K 0. In a number of papers in interior point methods, the expression log(det D 2 F (x)) appears in the barrier function, for example in the volumetric barrier, see Nesterov and Nemirovskii [20]. We close this section by showing that in the case where K is a homogeneous cone, the characteristic function can be written using the same expression. Theorem 4.4 Let K R n be a homogeneous cone and x a point e 2 K 0. We have '(e) q '(x) = q det D 2 F (x); det D2 F (e) F (x) = const log(det D2 F (x)): Proof. Since K is homogeneous, there exists A x 2 Aut(K) satisfying A x e = x. Equation (11) gives A T x D2 F (x)a x = D 2 F (e). This implies (det A x ) 2 det D 2 F (x) = det D 2 F (e), and '(x) = '(e) j det A x j = '(e) q q det D 2 F (x): det D2 F (e) This proves the rst equality; the second one follows from the rst. 5 Duality Mapping In this section we dene the duality mapping and present its main properties. It will be useful in determining barrier functions on dual cones. Let K R n be a cone. Consider the characteristic function ' of K and its logarithm F (x) = log('(x)) both dened in K 0. Now DF (x) is a linear functional on R n, which in the standard inner product u T v on R n, is identied with the vector of the partial derivatives of F at x. If we endow R n with a new inner product hx; yi = x T Sy where S is a symmetric, positive denite matrix S, then DF (x) can be written in the form DF (x)[u] = h?x ; ui; 8u 2 R n : Thus, in this inner product, the linear functional?df (x) is identied with the vector x 2 R n. 12

13 Denition 5.1 The mapping x 7! x is called the duality mapping. The basic properties of the duality mapping can be found in [19, 26, 8] for homogeneous self{dual cones and in [32] when K is a homogeneous cone. Many of these properties also hold when K is an arbitrary cone. The following fundamental result can be found in Vinberg [32]. Theorem 5.1 Let K R n be a cone. The duality mapping is an analytic bijection between K 0 and (K ) 0. We have hx; x i = n: In fact, x is characterized by the condition x = arg minf'(y) : y 2 K ; hx; yi = ng: Moreover, x is the center of gravity of the cross section fy 2 K : hx; yi = ng of K. If A 2 Aut(K), then (Ax) = (A)x = S?1 (A T )?1 Sx : (16) In particular, if t > 0, then (tx) = x t : Proof. We give here only a sketch of the proof; a more detailed proof of the theorem can be found in [32]. The proof of the claim that x is the center of gravity of the above cross section follows, since we have implying h?x ; hi = DF (x)[h] = D'(x)[h] '(x) x = R K ye?hx;yi dy RK e?hx;yi dy : =? R K hy; hie?hx;yi dy R ; K e?hx;yi dy Writing the integrals above in the form of iterated integrals as in Theorem 4.1 proves the result. Also, equation (16) follows from the fact that h 2 R n implies hx ; hi =?DF (x)[h] =?DF (Ax)[Ah] = h(ax) ; Ahi = ha (Ax) ; hi; where the second equality follows from (11). This implies A (Ax) = x or (Ax) = (A )?1 x = (A)x. 13

14 It is known that the duality mapping has a unique xed point x = x which we denote by e. This can be seen as follows. Consider the convex minimization problem minf 1 2 hx; xi : F K(x) 0g; where the constraint set is nonempty since x 2 K 0 and t! 1 imply F K (tx)!?1. A solution to this problem exists and is unique, as the objective function is strictly convex and coercive. The constraint set can be shown to be bounded away from the origin, so that the solution x satises the condition x = (x) for some > 0. Then the point x = x=p satises x = x. The point e plays an important role in the classication of both homogeneous self{dual cones and the homogeneous cones. The point e can be called the \center" of the cone K. However, we note that e has signicance only with respect to the given inner product; changing the inner product will change the center. In fact, it can be shown that any point of K 0 of a homogeneous cone can be made into a center by choosing an appropriate inner product on R n. The existence of e implies immediately the following result in Ochiai [22], which can also be proved by an elementary separation argument. Corollary 5.1 Let K R n be a cone. Then K 0 \ (K ) 0 6= ;. When K is a homogeneous cone, the duality mapping has further useful properties. For example, the following important result can be found in Vinberg [32]. We include its easy proof. Theorem 5.2 Let K R n be a homogeneous cone. Then ' K (x)' K (x ) = const; F K (x) + F K (x ) = const: Proof. Let A 2 Aut(K). Equation (16) gives ' K (Ax)' K ((Ax) ) = ' K (Ax)' K ((A )?1 x ) = Since K is homogeneous, the theorem is proved. ' K (x)' K (x ) j det Aj j det(a )?1 j = ' K(x)' K (x ): The following result is also well{known, see for example [19, 26, 32, 8]. We include its proof for completeness. Our proof follows Rothaus [26]. 14

15 Theorem 5.3 Let K R n be a homogeneous cone. Then (x ) = x: Proof. It is well known that the bilinear form D 2 F (x) can be represented by a self{ adjoint linear mapping H K (x) : R n! R n, D 2 F (x)[u; v] = hh K (x)u; vi: Since hx ; ui =?DF (x)[u], H K (x) is the Jacobian of the mapping x 7!?x. Dierentiating the equation hx ; xi = n gives H K (x)x = x : See also [20], equation , pp. 41. In addition, Theorem 5.2 gives?f K (x)? F K (x ) = const: Since (x + h) = x? H K (x)h + o(jhj) as jhj! 0, dierentiating the above equation with respect to x gives x? H K (x)(x ) = 0: Thus, H K (x)x = H K (x)(x ) = x : Since H K (x) is non{singular, we have (x ) = x. We mention some other useful results in the case where K is a homogeneous self{dual cone. The proofs can be found in Rothaus [26]. Theorem 5.4 Let K R n be a homogeneous self{dual cone. The set of linear maps fh K (x) : x 2 Kg forms a simply transitive subset of Aut(K), that is, given any two a; b 2 K 0, there exists a unique x 2 K 0 such that H K (x)a = b. Moreover, any A 2 Aut(K) can be written uniquely as A = B H K (x) where B 2 Aut(K) leaves the point e xed, that is, Be=e. We remark that, in the inner product ha; bi = a T Sb, the linear mappings B and H K (x) are orthogonal and symmetric positive denite, respectively; i.e., we have BB = I and hh K (x)a; bi = ha; H K (x)bi > 0 for all a; b 2 R n. In other words, A = BH K (x) is the polar decomposition of A. Primal{dual interior point methods need a barrier function on both K and K, see Nesterov and Nemirovskii [20]. Thus it becomes important to calculate the barrier on 15

16 K eciently. For self{dual cones, there is clearly no problem, as we can take the same barrier both on K and K. Nesterov and Nemirovskii [20] (Theorem 2.4.4) show that the (slightly modied) Fenchel dual of the barrier function of F K, (F K ) (y) = supfhx;?yi? F K (x) : x 2 K 0 g; (17) is a barrier for K and has the same parameter # as F K. (In the ordinary Fenchel dual, one has y instead of?y in (17).) We use the properties of the duality mapping to determine the properties of (F K ). Note that if y 2 (K ) 0, then the maximization problem in (17) has a unique solution x satisfying y = x. Since hx; x i = n by Theorem 5.1, we obtain (F K ) (x ) =?n? F K (x): (18) Thus, in the case where K is a homogeneous cone we have the following important result. Theorem 5.5 Let K R n be a homogeneous cone. If y 2 (K ) 0, then (F K ) (y) = const + F K (y): Proof. Since K is homogeneous, Theorem 5.3 implies that there exists a unique x 2 K such that y = x. Then (F K ) (x ) =?n? F K (x) = const + F K (y); where the rst equality follows from (18) and the second one from Theorem 5.2. We end this section with a geometric description of the dual barrier function (F K ). As mentioned above, the optimal value is achieved in (17) at a point x 2 K 0 such that x = y. Since hx; x i = n, we can rewrite (17), (F K ) (y) = supfhx;?yi? F K (x) : x 2 K 0 ; hx; yi = ng =?n? log inff' K (x) : x 2 K 0 ; hx; yi = ng: We show in the proof of Theorem 4.1 that ' K (x) is proportional to V ol n (fz 2 K : hx; zi ng); that is, the volume of the truncated cone after K is cut by the hyperplane having normal x and passing through the point y 2 K. Let K x;y = fz 2 K : hx; zi hx; yig 16

17 be such a cone. Combining the above results, we see that (F K ) is, up to an additive constant, equal to the function F + K dened by F + K (y) =? log inffv ol n(k x;y) : x 2 Kg: We summarize these results for the cone K as follows. For a proper cone K, we have, in addition to the universal barrier function F K, a second \universal barrier" function F + K given by F + K (x) =? log inffv ol n (K y;x) : y 2 K g ; where K y;x is truncated cone after K is cut by the hyperplane with normal y and passing through the point x 2 K. The description of the \characteristic function" related to F + K can already be found in [31]. We show in Theorem 5.5 above that these two universal barrier functions coincide if K is a homogeneous cone. 6 Homogeneous Cones and Siegel Domains Homogeneous cones form an attractive class among cones because of their invariance properties. As we note in Section 2, Vinberg [32] is the rst to give an algebraic classication of these cones. Siegel domains described below play an essential role in the classication and in the construction of homogeneous cones. The literature on these two topics is large, see for example [32, 33, 10, 11, 27, 4, 5, 6], etc. Here we will be content to describe only the basic elements of this theory and those aspects of it that we need in order to calculate the universal barrier functions of homogeneous cones. Denition 6.1 Let K be a cone in R k. A K{bilinear form B(u; v) in R p from R p R p to R k satisfying the following properties is a mapping 1. B( 1 u u 2 ; v) = 1 B(u 1 ; v) + 2 B(u 2 ; v) for 1 ; 2 2 R, 2. B(u; v) = B(v; u), 3. B(u; u) 2 K, 4. B(u; u) = 0 implies u = 0. Denition 6.2 Let B and K satisfy the conditions (1)-(4) in Denition 6.1. The Siegel domain corresponding to K and B is the set S(K; B) = f(x; u) 2 R k R p : x? B(u; u) 2 Kg: 17

18 Denition 6.3 A K{bilinear form B is called homogeneous if K is a homogeneous cone and there exists a transitive subgroup G Aut(K) such that for every g 2 G, there exists a linear transformation of g of R p such that that is, the following diagram g B(u; v) = B(gu; gv); R p R p B? y R k gg?! R p R p? yb g?! R k commutes. The Siegel domain S(K; B) corresponding to a homogeneous K{bilinear form B is ane homogeneous. This can be seen by checking that the following ane transformations form a transitive subgroup of S(K; B): A 1 (x; u) = (x + 2B(u; a) + B(a; a); u + a); a 2 R p ; A 2 (x; u) = (gx; gu); g 2 G Aut(K): The following remarkable theorem is due to Vinberg, see [32, 10]. Theorem 6.1 Any ane{homogeneous domain D R n domain. is ane equivalent to a Siegel The cone tted to a Siegel domain S(K; B) is given by SC(K; B) = f(x; u; t) 2 R k R p R : t 0; tx? B(u; u) 2 Kg: We remark that a more general construction than SC(K; B) can be found in Nesterov and Nemirovskii [20], Example 5, pp. 165, except that the homogeneity condition described in Denition 6.3 is not considered there. Lemma 6.1 If K is a homogeneous cone and B is a homogeneous K{bilinear form, then the cone SC(K; B) is homogeneous, and the following linear mappings form a transitive subgroup of Aut(SC(K; B)), p T 1 (x; u; t) = (x; u; t); > 0; T 2 (x; u; t) = (x + 2B(u; a) + tb(a; a); u + ta; t); a 2 R p ; T 3 (x; u; t) = (gx; gu; t); g 2 G Aut(K); where G is a transitive subgroup of Aut(K). 18

19 Proof. It is easy to show, using Denitions 6.1{6.3, that each map T i 2 Aut(SC(K; B)). Let (x 0 ; 0; 1) 2 SC(K; B) 0 be a xed point, where x 0 2 K 0. Let (x ; u ; t ) 2 SC(K; B) 0 be an arbitrary point, where x 2 K 0, t > 0, and u 2 R p. Consider the linear map T = T 3 T 2 T 1, T i 2 Aut(SC(K; B)), T 1 (x; u; t) = u (x; p t ; t t ); T 2 (x; u; t) = (x? p 2 t B(u; u ) + t t B(u ; u ); u? p t t u ; t) T 3 (x; u; t) = (gx; gu; t); where g 2 G satises g(x? B(u ; u )=t ) = x 0. We note that T 1 (x ; u ; t ) = (x ; T 2 (x ; u p t ; 1); u p t ; 1) = (x? B(u ; u ) t ; 0; 1); T 3 (x? B(u ; u ) t ; 0; 1) = (x 0 ; 0; 1): This shows that T (x ; u ; t ) = (x 0 ; 0; 1). The above lemma demonstrates that a homogeneous cone K gives rise to a homogeneous cone SC(K; B) in a higher dimensional space. The converse is also true. That is, given a homogeneous cone K, there exists a lower dimensional cone K and a homogeneous K{bilinear form B such that K is linearly equivalent to SC(K; B), see for example Gindikin [11], pp. 75. Consequently, it is possible to recursively construct an arbitrary homogeneous cone out of lower dimensional homogeneous cones, starting from the real half{line fx 2 R : x 0g. This is a generalization of the familiar construction of the (n+1)(n+1) symmetric positive semi{denite matrices from the nn symmetric positive semi{denite matrices, see Section 7.3. This construction process yields the algebraic classication of homogeneous cones. The number of recursive steps necessary to build up a homogeneous cone is invariant, and is called the rank of the cone, see Vinberg [32]. We end this section by giving a recursive formula for the characteristic function and the universal barrier function of a homogeneous cone. Corollary 6.1 Let K be a homogeneous cone and B a homogeneous K{bilinear form. The characteristic function and the universal barrier function of the cone SC(K; B) are given by '(x; u; t) = const t p ' B(u; u) K(x? ) det g; 2 +1 t B(u; u) F (x; u; t) = const + F K (x? ) + log(det g)? ( p + 1) log t: t 2 19

20 Proof. It follows from (12) that '(x; u; t) = '(x 0 ; 0; 1) det T; where x 0 2 K 0 is a xed point, and T 2 Aut(SC(K; B)) satises T (x; u; t) = (x 0 ; 0; 1). It is thus sucient to calculate the determinants of the linear maps at the end of the proof of the above lemma. It is easy to see that det(t 1 ) = 1=t p 2 +1, det(t 2 ) = 1, and det(t 3 ) = det g det g = const ' K (x? B(u; u)=t) det g; where the last equality follows from The corollary is proved. ' K (x? B(u; u)=t) = ' K (g?1 x 0 ) = ' K(x 0 ) = const det g:?1 det g 7 Characteristic Function of Some Cones In this section we calculate the characteristic function ' of some cones and the corresponding barrier function F. We demonstrate that, although the universal barrier function is usually very hard to calculate, it can be calculated in some important cases. It is known that the universal barrier function does not always have the optimal parameter #, see for example Sections 7.2, 7.3, and 7.7. However, the universal barrier functions in these sections can be scaled to either agree with the optimal barrier functions or to have comparable parameter #. As we mentioned in the previous section, the calculation of the universal barrier functions in these sections bears a strong resemblance to the calculations carried out in Chapter 5 of [20]. (However, homogeneity is not considered in [20].) Using their classication theory, we determine in [13] the optimal parameter # for homogeneous cones. It is not known at present whether the universal barrier function of an arbitrary irreducible homogeneous cone can be scaled so that it has parameter # comparable to the optimal one. The barrier in Section 7.1 is the familiar logarithmic function. The barrier in Section 7.5 can be obtained by the methods in [20] and has # = n. We show here that it is the universal barrier function for the underlying cone. The barrier calculated in Section 7.4 seems to be new, and has # = O(n). However, it seems useless for interior point methods, since it would take eort exponential in n to calculate it and its derivatives. We note that, since the cones in Sections 7.4 and 7.5 are dual, the Fenchel dual of the universal barrier for one cone is the second \universal" barrier function for the other cone. We do not calculate explicit barriers in Section 7.6, but some barriers can be calculated using the formula in Lemma 7.5. In Section 7.7 we obtain the universal barrier function of some 20

21 cones related to matrix norms given in [20], Section The method used here can, in principle, be applied to calculate the universal function of an arbitrary homogeneous cone (using the classication of these cones). Finally, in Section 7.8, we show that the calculation of the universal barrier function of a polyhedral cone reduces, in theory, to the triangulation of the dual polyhedral cone. This shows, in particular, that the universal function of such a cone is the logarithm of a rational function. It also shows that it would be hard in general to calculate the universal barrier function of polyhedral cones. 7.1 The Non{Negative Orthant The non{negative orthant R n + = R + : : : R + is the direct sum of n copies of R +. Thus, '(x 1 ; : : : ; x n ) = Since ' R+ (x i ) = R 1 0 e?x iy i dy i = 1=x i, we have '(x 1 ; : : : ; x n ) = ny i=1 ' R+ (x i ): 1 Q n i=1 x ; F (x) =? i F (x) is the familiar self{concordant barrier function for R n +. nx i=1 log x i : 7.2 The Lorentz Cone This is the cone K n = fx 2 R n : q x x : : : x 2 n?1 x n g: It is variously known as the spherical cone, light cone, ice cream cone, etc. The cone K 4 plays a prominent role in special relativity. Note that K n+1 is the cone tted to the unit ball B n = fx 2 R n : jjxjj 1g. If we endow R n with the usual inner product, then this cone is self{dual. This can be inferred from Section 15 of Rockafellar [25]. We include a short proof. If the point (y; ) 2 R n+1 is in Kn+1, then hx; yi + t 0 for all (x; t) satisfying jjxjj t. This implies hu; yi + 0 for all u such that jjujj 1. Thus, sup jjujj1 hu; yi and jjyjj. Since the implications can be reversed, we have K n+1 = K n+1. Consider the cone SC(R + ; B n ) = f(x; u; t) 2 R R n R : x 0; t 0; tx? juj 2 0g; where B n (u; v) = u T v can be easily shown to be a homogeneous R + {bilinear form. After a rotation of the variables (t; x) the term tx becomes t 2? x 2, so that SC(R + ; B n ) is linearly 21

22 isomorphic to K n+2. Since the former cone is homogeneous by Lemma 6.1, the cone S k is homogeneous for all k 3. The cone S 1 = R + is obviously homogeneous, and it is easy to show that S 2 is linearly isomorphic to R 2 + which is homogeneous. Thus all cones S k, k 1, are homogeneous. We now calculate the characteristic function of the cone SC(R + ; B n ) using the Siegel domain construction in Section 6. Dene T 2 Aut(R + ), where > 0 and T x = x. The corresponding linear transformation T on R n is T u = p u. By Corollary 6.1 F (x; u; t) = const? log(x? juj2 t ) + log(det T )? ( n + 1) log t; 2 where (x? juj 2 =t) = 1. This gives det T = (x? juj 2 =t)?n=2, and F (x; u; t) = const? n log(tx? juj 2 ): After of a rotation of the variables (t; x), we obtain the following lemma. Lemma 7.1 The characteristic function of the Lorentz cone K n+1 and the corresponding barrier function are given by '(x; t) = const (t 2? jjxjj 2 ) (n+1)=2 ; F (x; t) = const? n log(t 2? jjxjj 2 ): The barrier function F has parameter # = n + 1 which is much worse than the parameter # = 2 of the optimal barrier function G(x; t) =? log(t 2? jjxjj 2 ). However, note that G = (2=(n + 1))F up to a constant, so that the optimal barrier function can be obtained by scaling the universal barrier function. 7.3 Symmetric Positive Semi{Denite Matrices Consider the vector space n of nn symmetric matrices endowed with the inner product hx; yi = tr(xy): This is the same as the inner product on R n(n+1)=2 obtained as follows. Let ~x; ~y be the vectors obtained by putting in some order the diagonal and strict upper diagonal elements of x and y into vectors in R n(n+1)=2, respectively. Then hx; yi = ~x T D~y; 22

23 where D is a diagonal matrix with D ii = 1 and D ij = 2 for 1 i < j n. It is easy to see that the set of positive denite matrices form a cone in n which we denote by + n. It is well known that + n is a self{dual cone, that is, ( + n ) = + n. This can be shown as follows. First, let x; y 2 + n, and let x 1=2 2 + n be the square root of x. Then tr(xy) = tr(x 1=2 x 1=2 y) = tr(x 1=2 yx 1=2 ) 0; where the inequality follows as x 1=2 yx 1=2 2 + n. This shows + n ( + n ). Conversely, let y 2 ( + n ). Then tr(xy) 0 for all x 2 + n. If u 2 R n, then u T yu = tr(yuu T ) = hy; uu T i 0. Thus, y 2 + n, and consequently ( + n ) = + n. The interior ( + n ) 0 corresponds to the set of symmetric positive denite matrices. The cone + n+1 can be realized as a Siegel domain cone over + n. In fact, we have + n+1 = SC( + n ; B n); where the bilinear form B n : R n R n! n is given by B(u; v) = (uv T + vu T )=2. If g 2 GL(n; R), then the linear map T g : n! n given by T g x = gxg T is evidently an automorphism of the cone + n. The corresponding linear map T g : R n! R n is given by T g u = gu and has determinant det g. Thus, B n is a homogeneous + n {bilinear form. Also, it is well known that a symmetric (n + 1) (n + 1) matrix x = t u T where t 2 R, u 2 R n, and x 2 n is positive semidenite if and only if t 0, x 2 + n, and tx? uu T 2 + n. The above claim follows easily from these. We now calculate the universal barrier function of the cones n. Using Corollary 6.1 and the fact g(x? uu T =t)g T = I, or g = (x? uu T =t)?1=2 implies det T g = det(x? uu T =t)?1=2, we obtain u x 1 A ; F n+1(x) = const + F n(x? uut )? 1 t 2 log det(tx? uut )? n log t: 2 Since det x = det(tx? uu T ), we can easily prove the following result by induction. Lemma 7.2 The universal barrier for the cone of symmetric positive semi{denite matrices is the function F (x) = const? n + 1 log(det x): 2 23

24 Note that the cone is one of the ve irreducible homogeneous self{dual cones listed in Section 2. The universal barrier function of the cone of positive semi denite complex matrices and the cone of positive semi denite quaternion matrices can be calculated similarly. The barrier function F has parameter # = n(n + 1)=2 which is much worse than the parameter # = n of the optimal barrier function G(x) =? log det x. Since G = (2=(n + 1))F up to a constant, the optimal barrier function can again be obtained from the universal barrier by scaling. Examples of convex programming problems which involve the cone of symmetric positive denite matrices can be found in Nesterov and Nemirovskii [20], Alizadeh's Ph.D. thesis [1], etc. Some of these problems naturally occur in matrix analysis, combinatorial optimization, and control theory. 7.4 The l1 Unit Ball Here we calculate the characteristic function of the convex set Q = fx 2 R n : jjxjj 1 1g. The tted cone is K(Q) = f(x; t) : jjxjj 1 tg. It is easy to show that the dual cone is given by K(Q) = f(y; ) : jjyjj 1 g, see Rockafellar [25]. We calculate '(x; t) = = It is easy to verify that 1 e?t e?hx;yi dyd = e?t ( e?hx;yi dy)d jjyjj 1 0 jjyjj 1 1 e?t Y n 1 e?x iy i Y n dy i = e?t e jxij? e?jx ij d: 0? 0 jx i=1 i=1 i j ny i=1 (e jx ij? e?jx ij ) = X " i =1 ( ny n " i )ep i=1 " ijx i j : i=1 Thus, we have '(x; t) = = 1 Q n i=1 jx i j 1 Q n i=1 jx i j X " i =1 X " i =1 ny 1 " i ) i=1 0 Q n i=1 " i t? P n i=1 " ijx i j ; ( e? (t?p n i=1 " ijx i j) d the barrier function is F (x; t) = log( X " i =1 Q n i=1 " i t? P n i=1 " ijx i j )? 24 nx i=1 log(jx i j);

25 and the induced barrier on Q is F (x) = F (x; 1) = log( X " i =1 Q n i=1 " i 1? P n i=1 " ijx i j )? nx i=1 log(jx i j): The barrier function F has parameter # = O(n). Since l 1 cone in Section 7.3 is dual to the l 1 cone here, and the optimal barrier function for the former cone is at least n by Proposition in [20], we see that F has parameter of optimal order. However, F is practically useless for interior point calculations for large n, since the eort to calculate it and its derivatives is exponential in n. For n = 2, the barrier of Q is F (x) = const? log(1? (jx 1 j + jx 2 j) 2 )? log(1? (jx 1 j? jx 2 j) 2 ): 7.5 The l1 Unit Ball Here we calculate the characteristic function of the convex set Q = fx 2 R n : jjxjj 1 1g. The tted cone is K(Q) = f(x; t) : jjxjj 1 tg. The dual cone is K(Q) = f(y; ) : jjyjj 1 g. Lemma 7.3 The characteristic function of the unit l 1 ball in R n is ' n (x; t) = 2 n t n?1 Q n 1(t 2? x 2 i ) ; F n (x; t) = const? nx 1 log(t 2? x 2 i ) + (n? 1) log t: Proof. We prove the lemma by induction. For n = 1, it is a routine task to verify that ' 1 (x; t) = 2=(t 2? x 2 ). Suppose that the lemma holds true for n; we will prove it for n + 1. We denote x = (x 1 ; : : : ; x n ; x n+1 ) = (x 0 ; x n+1 ). Similarly, we write y = (y 0 ; y n+1 ). We have ' n+1 (x; t) = e?t e?hx;yi dyd jjyjj 1 1 = e?x n+1y n+1 ( e?t e?hx0 ;y 0 i dy 0 d)dyn+1?1 f(y 0 ; ):jjy 0 jj 1?jy n+1 jg 1 =?1 e?x n+1y n+1 e?tjyn+1j ( f(y 0 ; ):jjy 0 jj 1?jy n+1 jg e?t(?jy n+1j) e?hx0 ;y0 i dy 0 d)dyn+1 1 =?1 e?x n+1y n+1 e?tjy n+1j ( f(y 0 ; 0 ):jjy 0 jj 1 0 g e?t 0 e?hx0 ;y0 i dy 0 d 0 )dy n+1 25

26 = = = 1?1 e?x n+1y n+1 e?tjy n+1j 2 n t Q n?1 n dy i=1(t 2? x 2 n+1 i ) 0 2 n t n?1 Q n i=1(t 2? x 2 i ) 1 e?(x n+1?t)y n+1 dy n+1 + e?(x n+1+t)y n+1 dy n+1?1 0 2 n t Q n?1 n i=1(t 2? x 2 i ) ( ): t? x n+1 t + x n+1 Since 1=(t? x n+1 ) + 1=(t + x n+1 ) = 2t=(t 2? x 2 n+1), we have This proves the lemma. ' n+1 (x; t) = 2 n+1 t n Q n+1 1 (t 2? x 2 i ) : The barrier function F has parameter # = n which is optimal, see [20], Proposition Epigraph of Convex Functions The following result is essentially contained in Rockafellar [25], Theorem 14.4, pp Lemma 7.4 Let f : R n! R [ f1g be a proper closed convex function. Let Q = f(x; ) : f(x) g be the epigraph of f and let K(Q) = ft(x; ; 1) : f(x) ; t 0g denote the cone tted to Q. We have K(Q) = cl(f(u; 1; ) : > 0; f (?u) g): Lemma 7.5 Suppose f : R n! R [ f1g, Q, and K(Q) are as in the above lemma. If (x; ; t) 2 K(Q) 0, we have ' K(Q) (x; ; t) = n! du t D(f n+1 ) [?hx=t; ui + =t + f (u)] : n Proof. It is sucient to prove the lemma for t = 1. We have '(x; ; 1) = K(Q) eh(x;;1);(y;; )i dydd: 26

27 We use the description of K(O) in the above lemma and change the variables of integration from (y; ; ) to (u; ; ), where y =?u, and =. Notice that the ; )=@(u; ; ) = n+1. Thus, dening G = f(u; ; ) : 0; f (u) g, we have ' K(Q) (x; ; 1) = The lemma is proved. = = = n+1 e?(hx;?ui++ ) d ddu G 1 n+1 e?(?hx;ui+) ( e? d)ddu f(u;):>0;u2d(f )g f (u)?f (u) f(u;):>0;u2d(f )g n+1 e e?(?hx;ui+) 1 ( n e?(?hx;ui++f(u)) d)du = n! D(f ) D(f ) 0 du [?hx; ui + + f (u)] n : ddu 7.7 Epigraph of Matrix Norms We consider the vector space m of symmetric m m matrices, the cone K = + m of symmetric p.s.d. matrices in m, and the vector space R nm of n m matrices, where m n. We endow m with the inner product hx; yi = tr(xy) and R nm with the inner product hu; vi = tr(u T v). Note that B n;m : R nm R nm! n given by B n;m (u; v) = (u T v + v T u)=2 is a + m{bilinear form. The subgroup G = ft g : g 2 ( + m) 0 g, where T g is dened in Section 7.3, is obviously a transitive subgroup of Aut( + m). Dening T g : R nm! R nm such that T g u = ug we see that T g (B n;m (u; v)) = B n;m (T g u; T g v); that is, B n;m is a homogeneous + m{bilinear form. Thus, the Siegel Domain S( + m ; B n;m) = f(x; u) 2 + m R nm : x? u T u 2 + mg is an ane homogeneous convex set, and the Siegel cone is homogeneous. SC( + m ; B n;m) = f(x; u; t) 2 + m R nm R : tx? u T u 2 + m ; t 0g We now calculate the characteristic function of the cone SC(K; B) = SC( + m ; B n;m). It is easy to verify that det T g = (det g) n. If T g (x? ut u t ) = g(x? ut u )g T = I; t 27

28 then g = (x? ut u )?1=2 and det T t g = det(x? ut u )?n=2. This and Corollary 6.1 give the t following result. Lemma 7.6 The characteristic function and the universal barrier function of the cone SC( + m ; B n;m) are given by '(x; u; t) = t? mn 2?1 (det(x? ut u ))? m+n+1 2 ; t F (x; u; t) = const? m + n + 1 log(det(x? ut u ))? ( mn 2 t 2 + 1) log t: The cone SC(K; B) 2 R l where l = 1 + mn + m(m + 1)=2. Hence by Theorem in Nesterov and Nemirovskii [20], F a self{concordant barrier for SC(K; B) 2 R l with parameter # = O(l). This parameter is much larger than the parameter # = m + 1 for the following barrier function for the same cone given in [20], pp. 200, H(x; u; t) =? log(det(x? ut u ))? log t: t The barrier function H can be shown to be optimal, see [13]. However, if we multiply F with 2=(m + n + 1), we obtain a scaled barrier function G =? log(det(x? ut u t ))? mn + 2 log t: m + n + 1 Now, the function G is obtained by applying Proposition in [20] to the barrier function G 1 (x) =? log det x for the cone + m and the barrier function G 2 (t) =? log t for the non{negative real line R + with = (mn+2)=(m+n+1). Since 1, it is easy to verify that G 2 is a self{concordant barrier function for R + with parameter # =. It then follows from Proposition in [20] that G is a self{concordant barrier for SC(K; B) with parameter # = m + = m + mn + 2 m + n + 1 2m: Thus, we see that the barrier function G and the optimal barrier function H have comparable parameters #, although H has a slightly better parameter. It a routine matter to calculate the dual barrier function G, since we know from Theorem 5.5 that it coincides with a multiple of the universal barrier function of the dual cone SC(K; B). We do not calculate G here as it would take us far aeld. We end this subsection by describing the dual cone SC( m ; B n;m ). Here we endow the vector space m R nm R with the inner product h(x; u; t); (y; v; s)i = tr(xy) + tr(u T v) + ts: The method can be extended to calculate the dual of any Siegel cone SC(K; B), and in fact to give a recursive \dual" procedure to build up any homogeneous cone, see [27]. 28

Recursive Construction of Optimal Self-Concordant Barriers for Homogeneous Cones

Recursive Construction of Optimal Self-Concordant Barriers for Homogeneous Cones Recursive Construction of Optimal Self-Concordant Barriers for Homogeneous Cones OLENA SHEVCHENKO November 20, 2006 Abstract. In this paper, we give a recursive formula for optimal dual barrier functions

More information

Supplement: Universal Self-Concordant Barrier Functions

Supplement: Universal Self-Concordant Barrier Functions IE 8534 1 Supplement: Universal Self-Concordant Barrier Functions IE 8534 2 Recall that a self-concordant barrier function for K is a barrier function satisfying 3 F (x)[h, h, h] 2( 2 F (x)[h, h]) 3/2,

More information

Key words. Complementarity set, Lyapunov rank, Bishop-Phelps cone, Irreducible cone

Key words. Complementarity set, Lyapunov rank, Bishop-Phelps cone, Irreducible cone ON THE IRREDUCIBILITY LYAPUNOV RANK AND AUTOMORPHISMS OF SPECIAL BISHOP-PHELPS CONES M. SEETHARAMA GOWDA AND D. TROTT Abstract. Motivated by optimization considerations we consider cones in R n to be called

More information

ON THE ARITHMETIC-GEOMETRIC MEAN INEQUALITY AND ITS RELATIONSHIP TO LINEAR PROGRAMMING, BAHMAN KALANTARI

ON THE ARITHMETIC-GEOMETRIC MEAN INEQUALITY AND ITS RELATIONSHIP TO LINEAR PROGRAMMING, BAHMAN KALANTARI ON THE ARITHMETIC-GEOMETRIC MEAN INEQUALITY AND ITS RELATIONSHIP TO LINEAR PROGRAMMING, MATRIX SCALING, AND GORDAN'S THEOREM BAHMAN KALANTARI Abstract. It is a classical inequality that the minimum of

More information

Permutation invariant proper polyhedral cones and their Lyapunov rank

Permutation invariant proper polyhedral cones and their Lyapunov rank Permutation invariant proper polyhedral cones and their Lyapunov rank Juyoung Jeong Department of Mathematics and Statistics University of Maryland, Baltimore County Baltimore, Maryland 21250, USA juyoung1@umbc.edu

More information

Largest dual ellipsoids inscribed in dual cones

Largest dual ellipsoids inscribed in dual cones Largest dual ellipsoids inscribed in dual cones M. J. Todd June 23, 2005 Abstract Suppose x and s lie in the interiors of a cone K and its dual K respectively. We seek dual ellipsoidal norms such that

More information

L. Vandenberghe EE236C (Spring 2016) 18. Symmetric cones. definition. spectral decomposition. quadratic representation. log-det barrier 18-1

L. Vandenberghe EE236C (Spring 2016) 18. Symmetric cones. definition. spectral decomposition. quadratic representation. log-det barrier 18-1 L. Vandenberghe EE236C (Spring 2016) 18. Symmetric cones definition spectral decomposition quadratic representation log-det barrier 18-1 Introduction This lecture: theoretical properties of the following

More information

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008.

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008. 1 ECONOMICS 594: LECTURE NOTES CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS W. Erwin Diewert January 31, 2008. 1. Introduction Many economic problems have the following structure: (i) a linear function

More information

Linear Regression and Its Applications

Linear Regression and Its Applications Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start

More information

A Primal-Dual Second-Order Cone Approximations Algorithm For Symmetric Cone Programming

A Primal-Dual Second-Order Cone Approximations Algorithm For Symmetric Cone Programming A Primal-Dual Second-Order Cone Approximations Algorithm For Symmetric Cone Programming Chek Beng Chua Abstract This paper presents the new concept of second-order cone approximations for convex conic

More information

y Ray of Half-line or ray through in the direction of y

y Ray of Half-line or ray through in the direction of y Chapter LINEAR COMPLEMENTARITY PROBLEM, ITS GEOMETRY, AND APPLICATIONS. THE LINEAR COMPLEMENTARITY PROBLEM AND ITS GEOMETRY The Linear Complementarity Problem (abbreviated as LCP) is a general problem

More information

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2. APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product

More information

Lecture 2: Review of Prerequisites. Table of contents

Lecture 2: Review of Prerequisites. Table of contents Math 348 Fall 217 Lecture 2: Review of Prerequisites Disclaimer. As we have a textbook, this lecture note is for guidance and supplement only. It should not be relied on when preparing for exams. In this

More information

We describe the generalization of Hazan s algorithm for symmetric programming

We describe the generalization of Hazan s algorithm for symmetric programming ON HAZAN S ALGORITHM FOR SYMMETRIC PROGRAMMING PROBLEMS L. FAYBUSOVICH Abstract. problems We describe the generalization of Hazan s algorithm for symmetric programming Key words. Symmetric programming,

More information

THE EULER CHARACTERISTIC OF A LIE GROUP

THE EULER CHARACTERISTIC OF A LIE GROUP THE EULER CHARACTERISTIC OF A LIE GROUP JAY TAYLOR 1 Examples of Lie Groups The following is adapted from [2] We begin with the basic definition and some core examples Definition A Lie group is a smooth

More information

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability... Functional Analysis Franck Sueur 2018-2019 Contents 1 Metric spaces 1 1.1 Definitions........................................ 1 1.2 Completeness...................................... 3 1.3 Compactness......................................

More information

NORMS ON SPACE OF MATRICES

NORMS ON SPACE OF MATRICES NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system

More information

Topological properties

Topological properties CHAPTER 4 Topological properties 1. Connectedness Definitions and examples Basic properties Connected components Connected versus path connected, again 2. Compactness Definition and first examples Topological

More information

Semidefinite Programming

Semidefinite Programming Chapter 2 Semidefinite Programming 2.0.1 Semi-definite programming (SDP) Given C M n, A i M n, i = 1, 2,..., m, and b R m, the semi-definite programming problem is to find a matrix X M n for the optimization

More information

Symmetry Characterization Theorems for Homogeneous Convex Cones and Siegel Domains. Takaaki NOMURA

Symmetry Characterization Theorems for Homogeneous Convex Cones and Siegel Domains. Takaaki NOMURA Symmetry Characterization Theorems for Homogeneous Convex Cones and Siegel Domains Takaaki NOMURA (Kyushu University) Cadi Ayyad University, Marrakech April 1 4, 2009 1 2 Interpretation via Cayley transform

More information

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009 LMI MODELLING 4. CONVEX LMI MODELLING Didier HENRION LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ Universidad de Valladolid, SP March 2009 Minors A minor of a matrix F is the determinant of a submatrix

More information

Some characterizations of cone preserving Z-transformations

Some characterizations of cone preserving Z-transformations Annals of Operations Research manuscript No. (will be inserted by the editor) Some characterizations of cone preserving Z-transformations M. Seetharama Gowda Yoon J. Song K.C. Sivakumar This paper is dedicated,

More information

A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE

A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE Yugoslav Journal of Operations Research 24 (2014) Number 1, 35-51 DOI: 10.2298/YJOR120904016K A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE BEHROUZ

More information

3.1 Basic properties of real numbers - continuation Inmum and supremum of a set of real numbers

3.1 Basic properties of real numbers - continuation Inmum and supremum of a set of real numbers Chapter 3 Real numbers The notion of real number was introduced in section 1.3 where the axiomatic denition of the set of all real numbers was done and some basic properties of the set of all real numbers

More information

Problems in Linear Algebra and Representation Theory

Problems in Linear Algebra and Representation Theory Problems in Linear Algebra and Representation Theory (Most of these were provided by Victor Ginzburg) The problems appearing below have varying level of difficulty. They are not listed in any specific

More information

Introduction to Koecher Cones. Michael Orlitzky

Introduction to Koecher Cones. Michael Orlitzky Introduction to Koecher Cones Extreme Points Definition 1. Let S be a convex set in some vector space. We say that the point x S is an extreme point of the set S if x = λx 1 + (1 λ)x 2 for λ (0, 1) implies

More information

Course Summary Math 211

Course Summary Math 211 Course Summary Math 211 table of contents I. Functions of several variables. II. R n. III. Derivatives. IV. Taylor s Theorem. V. Differential Geometry. VI. Applications. 1. Best affine approximations.

More information

Convex Feasibility Problems

Convex Feasibility Problems Laureate Prof. Jonathan Borwein with Matthew Tam http://carma.newcastle.edu.au/drmethods/paseky.html Spring School on Variational Analysis VI Paseky nad Jizerou, April 19 25, 2015 Last Revised: May 6,

More information

Multivariable Calculus

Multivariable Calculus 2 Multivariable Calculus 2.1 Limits and Continuity Problem 2.1.1 (Fa94) Let the function f : R n R n satisfy the following two conditions: (i) f (K ) is compact whenever K is a compact subset of R n. (ii)

More information

Math Linear Algebra II. 1. Inner Products and Norms

Math Linear Algebra II. 1. Inner Products and Norms Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,

More information

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version Convex Optimization Theory Chapter 5 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com

More information

Simple Lie subalgebras of locally nite associative algebras

Simple Lie subalgebras of locally nite associative algebras Simple Lie subalgebras of locally nite associative algebras Y.A. Bahturin Department of Mathematics and Statistics Memorial University of Newfoundland St. John's, NL, A1C5S7, Canada A.A. Baranov Department

More information

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION   henrion COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS Didier HENRION www.laas.fr/ henrion October 2006 Geometry of LMI sets Given symmetric matrices F i we want to characterize the shape in R n of the LMI set F

More information

58 Appendix 1 fundamental inconsistent equation (1) can be obtained as a linear combination of the two equations in (2). This clearly implies that the

58 Appendix 1 fundamental inconsistent equation (1) can be obtained as a linear combination of the two equations in (2). This clearly implies that the Appendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS Here we consider systems of linear constraints, consisting of equations or inequalities or both. A feasible solution

More information

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................

More information

L(C G (x) 0 ) c g (x). Proof. Recall C G (x) = {g G xgx 1 = g} and c g (x) = {X g Ad xx = X}. In general, it is obvious that

L(C G (x) 0 ) c g (x). Proof. Recall C G (x) = {g G xgx 1 = g} and c g (x) = {X g Ad xx = X}. In general, it is obvious that ALGEBRAIC GROUPS 61 5. Root systems and semisimple Lie algebras 5.1. Characteristic 0 theory. Assume in this subsection that chark = 0. Let me recall a couple of definitions made earlier: G is called reductive

More information

Course 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra

Course 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra Course 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra D. R. Wilkins Contents 3 Topics in Commutative Algebra 2 3.1 Rings and Fields......................... 2 3.2 Ideals...............................

More information

Chapter 4. Inverse Function Theorem. 4.1 The Inverse Function Theorem

Chapter 4. Inverse Function Theorem. 4.1 The Inverse Function Theorem Chapter 4 Inverse Function Theorem d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d dd d d d d This chapter

More information

On the game-theoretic value of a linear transformation on a symmetric cone

On the game-theoretic value of a linear transformation on a symmetric cone On the game-theoretic value of a linear transformation ona symmetric cone p. 1/25 On the game-theoretic value of a linear transformation on a symmetric cone M. Seetharama Gowda Department of Mathematics

More information

1 Fields and vector spaces

1 Fields and vector spaces 1 Fields and vector spaces In this section we revise some algebraic preliminaries and establish notation. 1.1 Division rings and fields A division ring, or skew field, is a structure F with two binary

More information

Representations of moderate growth Paul Garrett 1. Constructing norms on groups

Representations of moderate growth Paul Garrett 1. Constructing norms on groups (December 31, 2004) Representations of moderate growth Paul Garrett Representations of reductive real Lie groups on Banach spaces, and on the smooth vectors in Banach space representations,

More information

1. Let r, s, t, v be the homogeneous relations defined on the set M = {2, 3, 4, 5, 6} by

1. Let r, s, t, v be the homogeneous relations defined on the set M = {2, 3, 4, 5, 6} by Seminar 1 1. Which ones of the usual symbols of addition, subtraction, multiplication and division define an operation (composition law) on the numerical sets N, Z, Q, R, C? 2. Let A = {a 1, a 2, a 3 }.

More information

5 Quiver Representations

5 Quiver Representations 5 Quiver Representations 5. Problems Problem 5.. Field embeddings. Recall that k(y,..., y m ) denotes the field of rational functions of y,..., y m over a field k. Let f : k[x,..., x n ] k(y,..., y m )

More information

Lifting to non-integral idempotents

Lifting to non-integral idempotents Journal of Pure and Applied Algebra 162 (2001) 359 366 www.elsevier.com/locate/jpaa Lifting to non-integral idempotents Georey R. Robinson School of Mathematics and Statistics, University of Birmingham,

More information

Chapter 8 Integral Operators

Chapter 8 Integral Operators Chapter 8 Integral Operators In our development of metrics, norms, inner products, and operator theory in Chapters 1 7 we only tangentially considered topics that involved the use of Lebesgue measure,

More information

Optimization: Interior-Point Methods and. January,1995 USA. and Cooperative Research Centre for Robust and Adaptive Systems.

Optimization: Interior-Point Methods and. January,1995 USA. and Cooperative Research Centre for Robust and Adaptive Systems. Innite Dimensional Quadratic Optimization: Interior-Point Methods and Control Applications January,995 Leonid Faybusovich John B. Moore y Department of Mathematics University of Notre Dame Mail Distribution

More information

16 Chapter 3. Separation Properties, Principal Pivot Transforms, Classes... for all j 2 J is said to be a subcomplementary vector of variables for (3.

16 Chapter 3. Separation Properties, Principal Pivot Transforms, Classes... for all j 2 J is said to be a subcomplementary vector of variables for (3. Chapter 3 SEPARATION PROPERTIES, PRINCIPAL PIVOT TRANSFORMS, CLASSES OF MATRICES In this chapter we present the basic mathematical results on the LCP. Many of these results are used in later chapters to

More information

Rearrangements and polar factorisation of countably degenerate functions G.R. Burton, School of Mathematical Sciences, University of Bath, Claverton D

Rearrangements and polar factorisation of countably degenerate functions G.R. Burton, School of Mathematical Sciences, University of Bath, Claverton D Rearrangements and polar factorisation of countably degenerate functions G.R. Burton, School of Mathematical Sciences, University of Bath, Claverton Down, Bath BA2 7AY, U.K. R.J. Douglas, Isaac Newton

More information

Math 413/513 Chapter 6 (from Friedberg, Insel, & Spence)

Math 413/513 Chapter 6 (from Friedberg, Insel, & Spence) Math 413/513 Chapter 6 (from Friedberg, Insel, & Spence) David Glickenstein December 7, 2015 1 Inner product spaces In this chapter, we will only consider the elds R and C. De nition 1 Let V be a vector

More information

1 Directional Derivatives and Differentiability

1 Directional Derivatives and Differentiability Wednesday, January 18, 2012 1 Directional Derivatives and Differentiability Let E R N, let f : E R and let x 0 E. Given a direction v R N, let L be the line through x 0 in the direction v, that is, L :=

More information

Chapter 1. Preliminaries

Chapter 1. Preliminaries Introduction This dissertation is a reading of chapter 4 in part I of the book : Integer and Combinatorial Optimization by George L. Nemhauser & Laurence A. Wolsey. The chapter elaborates links between

More information

A matrix over a field F is a rectangular array of elements from F. The symbol

A matrix over a field F is a rectangular array of elements from F. The symbol Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F ) denotes the collection of all m n matrices over F Matrices will usually be denoted

More information

On the game-theoretic value of a linear transformation relative to a self-dual cone

On the game-theoretic value of a linear transformation relative to a self-dual cone On the game-theoretic value of a linear transformation relative to a self-dual cone M. Seetharama Gowda Department of Mathematics and Statistics University of Maryland, Baltimore County Baltimore, Maryland

More information

EE 546, Univ of Washington, Spring Proximal mapping. introduction. review of conjugate functions. proximal mapping. Proximal mapping 6 1

EE 546, Univ of Washington, Spring Proximal mapping. introduction. review of conjugate functions. proximal mapping. Proximal mapping 6 1 EE 546, Univ of Washington, Spring 2012 6. Proximal mapping introduction review of conjugate functions proximal mapping Proximal mapping 6 1 Proximal mapping the proximal mapping (prox-operator) of a convex

More information

9. Birational Maps and Blowing Up

9. Birational Maps and Blowing Up 72 Andreas Gathmann 9. Birational Maps and Blowing Up In the course of this class we have already seen many examples of varieties that are almost the same in the sense that they contain isomorphic dense

More information

8. Geometric problems

8. Geometric problems 8. Geometric problems Convex Optimization Boyd & Vandenberghe extremal volume ellipsoids centering classification placement and facility location 8 Minimum volume ellipsoid around a set Löwner-John ellipsoid

More information

Topics in linear algebra

Topics in linear algebra Chapter 6 Topics in linear algebra 6.1 Change of basis I want to remind you of one of the basic ideas in linear algebra: change of basis. Let F be a field, V and W be finite dimensional vector spaces over

More information

only nite eigenvalues. This is an extension of earlier results from [2]. Then we concentrate on the Riccati equation appearing in H 2 and linear quadr

only nite eigenvalues. This is an extension of earlier results from [2]. Then we concentrate on the Riccati equation appearing in H 2 and linear quadr The discrete algebraic Riccati equation and linear matrix inequality nton. Stoorvogel y Department of Mathematics and Computing Science Eindhoven Univ. of Technology P.O. ox 53, 56 M Eindhoven The Netherlands

More information

1 Outline Part I: Linear Programming (LP) Interior-Point Approach 1. Simplex Approach Comparison Part II: Semidenite Programming (SDP) Concludin

1 Outline Part I: Linear Programming (LP) Interior-Point Approach 1. Simplex Approach Comparison Part II: Semidenite Programming (SDP) Concludin Sensitivity Analysis in LP and SDP Using Interior-Point Methods E. Alper Yldrm School of Operations Research and Industrial Engineering Cornell University Ithaca, NY joint with Michael J. Todd INFORMS

More information

Analysis-3 lecture schemes

Analysis-3 lecture schemes Analysis-3 lecture schemes (with Homeworks) 1 Csörgő István November, 2015 1 A jegyzet az ELTE Informatikai Kar 2015. évi Jegyzetpályázatának támogatásával készült Contents 1. Lesson 1 4 1.1. The Space

More information

Definition 5.1. A vector field v on a manifold M is map M T M such that for all x M, v(x) T x M.

Definition 5.1. A vector field v on a manifold M is map M T M such that for all x M, v(x) T x M. 5 Vector fields Last updated: March 12, 2012. 5.1 Definition and general properties We first need to define what a vector field is. Definition 5.1. A vector field v on a manifold M is map M T M such that

More information

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE CONVEX ANALYSIS AND DUALITY Basic concepts of convex analysis Basic concepts of convex optimization Geometric duality framework - MC/MC Constrained optimization

More information

Projected Gradient Methods for NCP 57. Complementarity Problems via Normal Maps

Projected Gradient Methods for NCP 57. Complementarity Problems via Normal Maps Projected Gradient Methods for NCP 57 Recent Advances in Nonsmooth Optimization, pp. 57-86 Eds..-Z. u, L. Qi and R.S. Womersley c1995 World Scientic Publishers Projected Gradient Methods for Nonlinear

More information

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND

More information

The Jordan Algebraic Structure of the Circular Cone

The Jordan Algebraic Structure of the Circular Cone The Jordan Algebraic Structure of the Circular Cone Baha Alzalg Department of Mathematics, The University of Jordan, Amman 1194, Jordan Abstract In this paper, we study and analyze the algebraic structure

More information

Analysis on Graphs. Alexander Grigoryan Lecture Notes. University of Bielefeld, WS 2011/12

Analysis on Graphs. Alexander Grigoryan Lecture Notes. University of Bielefeld, WS 2011/12 Analysis on Graphs Alexander Grigoryan Lecture Notes University of Bielefeld, WS 0/ Contents The Laplace operator on graphs 5. The notion of a graph............................. 5. Cayley graphs..................................

More information

120A LECTURE OUTLINES

120A LECTURE OUTLINES 120A LECTURE OUTLINES RUI WANG CONTENTS 1. Lecture 1. Introduction 1 2 1.1. An algebraic object to study 2 1.2. Group 2 1.3. Isomorphic binary operations 2 2. Lecture 2. Introduction 2 3 2.1. The multiplication

More information

On John type ellipsoids

On John type ellipsoids On John type ellipsoids B. Klartag Tel Aviv University Abstract Given an arbitrary convex symmetric body K R n, we construct a natural and non-trivial continuous map u K which associates ellipsoids to

More information

Optimization and Optimal Control in Banach Spaces

Optimization and Optimal Control in Banach Spaces Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,

More information

2 Garrett: `A Good Spectral Theorem' 1. von Neumann algebras, density theorem The commutant of a subring S of a ring R is S 0 = fr 2 R : rs = sr; 8s 2

2 Garrett: `A Good Spectral Theorem' 1. von Neumann algebras, density theorem The commutant of a subring S of a ring R is S 0 = fr 2 R : rs = sr; 8s 2 1 A Good Spectral Theorem c1996, Paul Garrett, garrett@math.umn.edu version February 12, 1996 1 Measurable Hilbert bundles Measurable Banach bundles Direct integrals of Hilbert spaces Trivializing Hilbert

More information

REPRESENTATION THEORY WEEK 7

REPRESENTATION THEORY WEEK 7 REPRESENTATION THEORY WEEK 7 1. Characters of L k and S n A character of an irreducible representation of L k is a polynomial function constant on every conjugacy class. Since the set of diagonalizable

More information

LECTURE 3: REPRESENTATION THEORY OF SL 2 (C) AND sl 2 (C)

LECTURE 3: REPRESENTATION THEORY OF SL 2 (C) AND sl 2 (C) LECTURE 3: REPRESENTATION THEORY OF SL 2 (C) AND sl 2 (C) IVAN LOSEV Introduction We proceed to studying the representation theory of algebraic groups and Lie algebras. Algebraic groups are the groups

More information

TOPOLOGICAL GROUPS MATH 519

TOPOLOGICAL GROUPS MATH 519 TOPOLOGICAL GROUPS MATH 519 The purpose of these notes is to give a mostly self-contained topological background for the study of the representations of locally compact totally disconnected groups, as

More information

Linear Algebra. Preliminary Lecture Notes

Linear Algebra. Preliminary Lecture Notes Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date April 29, 23 2 Contents Motivation for the course 5 2 Euclidean n dimensional Space 7 2. Definition of n Dimensional Euclidean Space...........

More information

Lecture 1. Toric Varieties: Basics

Lecture 1. Toric Varieties: Basics Lecture 1. Toric Varieties: Basics Taras Panov Lomonosov Moscow State University Summer School Current Developments in Geometry Novosibirsk, 27 August1 September 2018 Taras Panov (Moscow University) Lecture

More information

Elementary linear algebra

Elementary linear algebra Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The

More information

REMARKS ON THE TIME-OPTIMAL CONTROL OF A CLASS OF HAMILTONIAN SYSTEMS. Eduardo D. Sontag. SYCON - Rutgers Center for Systems and Control

REMARKS ON THE TIME-OPTIMAL CONTROL OF A CLASS OF HAMILTONIAN SYSTEMS. Eduardo D. Sontag. SYCON - Rutgers Center for Systems and Control REMARKS ON THE TIME-OPTIMAL CONTROL OF A CLASS OF HAMILTONIAN SYSTEMS Eduardo D. Sontag SYCON - Rutgers Center for Systems and Control Department of Mathematics, Rutgers University, New Brunswick, NJ 08903

More information

Lecture 2: Linear Algebra Review

Lecture 2: Linear Algebra Review EE 227A: Convex Optimization and Applications January 19 Lecture 2: Linear Algebra Review Lecturer: Mert Pilanci Reading assignment: Appendix C of BV. Sections 2-6 of the web textbook 1 2.1 Vectors 2.1.1

More information

University of Houston, Department of Mathematics Numerical Analysis, Fall 2005

University of Houston, Department of Mathematics Numerical Analysis, Fall 2005 3 Numerical Solution of Nonlinear Equations and Systems 3.1 Fixed point iteration Reamrk 3.1 Problem Given a function F : lr n lr n, compute x lr n such that ( ) F(x ) = 0. In this chapter, we consider

More information

LECTURE 10: THE ATIYAH-GUILLEMIN-STERNBERG CONVEXITY THEOREM

LECTURE 10: THE ATIYAH-GUILLEMIN-STERNBERG CONVEXITY THEOREM LECTURE 10: THE ATIYAH-GUILLEMIN-STERNBERG CONVEXITY THEOREM Contents 1. The Atiyah-Guillemin-Sternberg Convexity Theorem 1 2. Proof of the Atiyah-Guillemin-Sternberg Convexity theorem 3 3. Morse theory

More information

arxiv: v1 [math.oc] 21 Mar 2015

arxiv: v1 [math.oc] 21 Mar 2015 Convex KKM maps, monotone operators and Minty variational inequalities arxiv:1503.06363v1 [math.oc] 21 Mar 2015 Marc Lassonde Université des Antilles, 97159 Pointe à Pitre, France E-mail: marc.lassonde@univ-ag.fr

More information

4th Preparation Sheet - Solutions

4th Preparation Sheet - Solutions Prof. Dr. Rainer Dahlhaus Probability Theory Summer term 017 4th Preparation Sheet - Solutions Remark: Throughout the exercise sheet we use the two equivalent definitions of separability of a metric space

More information

IMC 2015, Blagoevgrad, Bulgaria

IMC 2015, Blagoevgrad, Bulgaria IMC 05, Blagoevgrad, Bulgaria Day, July 9, 05 Problem. For any integer n and two n n matrices with real entries, B that satisfy the equation + B ( + B prove that det( det(b. Does the same conclusion follow

More information

2. Intersection Multiplicities

2. Intersection Multiplicities 2. Intersection Multiplicities 11 2. Intersection Multiplicities Let us start our study of curves by introducing the concept of intersection multiplicity, which will be central throughout these notes.

More information

QUASI-UNIFORMLY POSITIVE OPERATORS IN KREIN SPACE. Denitizable operators in Krein spaces have spectral properties similar to those

QUASI-UNIFORMLY POSITIVE OPERATORS IN KREIN SPACE. Denitizable operators in Krein spaces have spectral properties similar to those QUASI-UNIFORMLY POSITIVE OPERATORS IN KREIN SPACE BRANKO CURGUS and BRANKO NAJMAN Denitizable operators in Krein spaces have spectral properties similar to those of selfadjoint operators in Hilbert spaces.

More information

We simply compute: for v = x i e i, bilinearity of B implies that Q B (v) = B(v, v) is given by xi x j B(e i, e j ) =

We simply compute: for v = x i e i, bilinearity of B implies that Q B (v) = B(v, v) is given by xi x j B(e i, e j ) = Math 395. Quadratic spaces over R 1. Algebraic preliminaries Let V be a vector space over a field F. Recall that a quadratic form on V is a map Q : V F such that Q(cv) = c 2 Q(v) for all v V and c F, and

More information

Robust Solutions to Multi-Objective Linear Programs with Uncertain Data

Robust Solutions to Multi-Objective Linear Programs with Uncertain Data Robust Solutions to Multi-Objective Linear Programs with Uncertain Data M.A. Goberna yz V. Jeyakumar x G. Li x J. Vicente-Pérez x Revised Version: October 1, 2014 Abstract In this paper we examine multi-objective

More information

A Generalized Homogeneous and Self-Dual Algorithm. for Linear Programming. February 1994 (revised December 1994)

A Generalized Homogeneous and Self-Dual Algorithm. for Linear Programming. February 1994 (revised December 1994) A Generalized Homogeneous and Self-Dual Algorithm for Linear Programming Xiaojie Xu Yinyu Ye y February 994 (revised December 994) Abstract: A generalized homogeneous and self-dual (HSD) infeasible-interior-point

More information

A Distributed Newton Method for Network Utility Maximization, II: Convergence

A Distributed Newton Method for Network Utility Maximization, II: Convergence A Distributed Newton Method for Network Utility Maximization, II: Convergence Ermin Wei, Asuman Ozdaglar, and Ali Jadbabaie October 31, 2012 Abstract The existing distributed algorithms for Network Utility

More information

MAT 570 REAL ANALYSIS LECTURE NOTES. Contents. 1. Sets Functions Countability Axiom of choice Equivalence relations 9

MAT 570 REAL ANALYSIS LECTURE NOTES. Contents. 1. Sets Functions Countability Axiom of choice Equivalence relations 9 MAT 570 REAL ANALYSIS LECTURE NOTES PROFESSOR: JOHN QUIGG SEMESTER: FALL 204 Contents. Sets 2 2. Functions 5 3. Countability 7 4. Axiom of choice 8 5. Equivalence relations 9 6. Real numbers 9 7. Extended

More information

The proximal mapping

The proximal mapping The proximal mapping http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghes lecture notes Outline 2/37 1 closed function 2 Conjugate function

More information

Math113: Linear Algebra. Beifang Chen

Math113: Linear Algebra. Beifang Chen Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary

More information

Applied Mathematics &Optimization

Applied Mathematics &Optimization Appl Math Optim 29: 211-222 (1994) Applied Mathematics &Optimization c 1994 Springer-Verlag New Yor Inc. An Algorithm for Finding the Chebyshev Center of a Convex Polyhedron 1 N.D.Botin and V.L.Turova-Botina

More information

THEODORE VORONOV DIFFERENTIABLE MANIFOLDS. Fall Last updated: November 26, (Under construction.)

THEODORE VORONOV DIFFERENTIABLE MANIFOLDS. Fall Last updated: November 26, (Under construction.) 4 Vector fields Last updated: November 26, 2009. (Under construction.) 4.1 Tangent vectors as derivations After we have introduced topological notions, we can come back to analysis on manifolds. Let M

More information

IRREDUCIBLE REPRESENTATIONS OF SEMISIMPLE LIE ALGEBRAS. Contents

IRREDUCIBLE REPRESENTATIONS OF SEMISIMPLE LIE ALGEBRAS. Contents IRREDUCIBLE REPRESENTATIONS OF SEMISIMPLE LIE ALGEBRAS NEEL PATEL Abstract. The goal of this paper is to study the irreducible representations of semisimple Lie algebras. We will begin by considering two

More information

MATH 326: RINGS AND MODULES STEFAN GILLE

MATH 326: RINGS AND MODULES STEFAN GILLE MATH 326: RINGS AND MODULES STEFAN GILLE 1 2 STEFAN GILLE 1. Rings We recall first the definition of a group. 1.1. Definition. Let G be a non empty set. The set G is called a group if there is a map called

More information

Chapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space.

Chapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space. Chapter 1 Preliminaries The purpose of this chapter is to provide some basic background information. Linear Space Hilbert Space Basic Principles 1 2 Preliminaries Linear Space The notion of linear space

More information

Linear Algebra: Matrix Eigenvalue Problems

Linear Algebra: Matrix Eigenvalue Problems CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given

More information

Convex Functions and Optimization

Convex Functions and Optimization Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized

More information

8. Conjugate functions

8. Conjugate functions L. Vandenberghe EE236C (Spring 2013-14) 8. Conjugate functions closed functions conjugate function 8-1 Closed set a set C is closed if it contains its boundary: x k C, x k x = x C operations that preserve

More information