Tamás Terlaky George N. and Soteria Kledaras 87 Endowed Chair Professor. Chair, Department of Industrial and Systems Engineering Lehigh University

Size: px
Start display at page:

Download "Tamás Terlaky George N. and Soteria Kledaras 87 Endowed Chair Professor. Chair, Department of Industrial and Systems Engineering Lehigh University"

Transcription

1 BME Cone Linear Optimization (CLO) From LO, SOCO and SDO Towards Mixed-Integer CLO Tamás Terlaky George N. and Soteria Kledaras 87 Endowed Chair Professor. Chair, Department of Industrial and Systems Engineering Lehigh University

2 Outline Motivation: Data uncertainty in linear inequalities-robust LO Data uncertainty in linear inequalities Ellipsoidal uncertainty set norm constraint Eigen- and singular value optimization problems Relaxing integer variables Conic Linear Optimization (CLO): General Convex Cones Second Order Conic Optimization (SOCO) Portfolio optimization as SOCO Semidefinite Optimization (SDO) Interior Point Algorithms for SOCO and SDO: MISOCO: Mixed Integer Second Order Conic Optimization Sisyphus got stuck with a suboptimal solution; don t let it happen to you! 1

3 Robust Linear Optimization Classic Polyhedral (scenario) approach (P ) min c T x a j b j n j i=1 s.t. a T j x b j 0 j n j = ai j b i j i=1 λ i j ai j b i j T x 1 λ i j n j i=1 0 Let (a j, b j ) be uncertain, it is coming from a polyhedral set (e.g. convex combination of scenario data points): λ i j = 1, λ i j 0 for all n j i=1 The inequality a T j x b j must be true for all possible values of (a T j, b j): λ i j = 1, λ i j 0 Infinitely many constraints! iff [a i j] T x b i j 0 for i = 1,..., n Finally the problem stays linear as: j (RP ) min c T x s.t. [a i j ]T x b i j 0 for i = 1,..., n j j Disadvantages: Huge number of linear inequalities Polyhedral uncertainty set not realistic. 2

4 Robust Linear Optimization a0 j b 0 j (P ) min c T x s.t. a T j x b j 0 j a j = a0 j + P u b u IRk, u T u 1 j T + P u x 1 b 0 j Let (a j, b j ) be uncertain, it is coming from an ellipsoid (e.g. level set of a distribution): The inequality a T j x b j must be true for all possible values of (a T j, b j): 0 u : u T u 1 iff [a 0 j ] T x b 0 j + min (P u)t x u T u [a 0 j ] T x b 0 j P T x This is a nondifferentiable norm constraint: (See second order cones) P T x [a 0 j 1 ]T x b 0 j. 2 Single nonlinear, norm-constraint! 3

5 Eigenvalue Optimization Given n n symmetric matrices A 1,..., A m. Problem: Find a nonnegative combination of the matrices that has the maximal smallest eigenvalue. Solution: max λ m i=1 A i y i λi is positive semidefinite y i 0 i = 1,..., m Problem: Find a nonnegative combination of the matrices that has the smallest maximal eigenvalue. m λi A i y i Solution: min λ i=1 is positive semidefinite y i 0 i = 1,..., m The semidefiteness constraint is not differentiable, not easy to calculate when formulated by explicit functions, e.g., min-eigenvalue, determinant (of minors). See Semidefinite Optimization. 4

6 Relaxing Binary Variables Given z 1,..., z n binary, i.e., {0, 1} variables with other, e.g., linear constraints. Problem: Find convex, continuous relaxations of the binary constraints. Old solution: Let 0 z i 1 for all i = 1,..., n and use branch and bound, branch and cut schemes. New opportunity to get tighter relaxations: Let x i = 2z for all i = 1,..., n. Thus gives x i as a { 1, 1} variable. Now n = n x 2 i = x T x = Tr(x T x) = Tr(xx T ) = Tr(X), i=1 where X = xx T is a rank-1 positive semidefinite matrix with diag(x) = e. Thus, for x i { 1, 1} i we may use the relaxation: X ii = 1 i and X is positive semidefinite The semidefiteness constraint is not differentiable, not easy to calculate when formulated by explicit functions, e.g., min-eigenvalue, determinant (of minors). See Semidefinite Optimization. 5

7 Stability of Optimal Power Flow The stability of the Power Flow is ensured by a lower bound on the singular value of the Jacobian J pf of the power flow equations: σ min (J pf ) σ cpf equivalently λ min (J pf Jpf T ) σ cpf by substitution X J pf Jpf T = 0 and X σ cpf I is positive semidefinite Again a semidefinite constraint! One may want maximize σ cpf. 6

8 New/Old Convex Optimization Problems Cone Linear Optimization Problems Primal-dual pair of CLO problems is given as (P ) min c T x (D) max b T y s.t. Ax b C 1 s.t. c A T y C 2 x C 2 y C1, where b, y IR m, c, x IR n, A : m n matrix, C 1, C 2 are convex cones and Ci = {s IRn : x T s 0, x C i } are the dual cones for i = 1, 2. These are solvable efficiently (in polynomial time) by using Interior Point Methods. LO is based on polyhedral cones. Be careful! Perfect duality, strict complementarity lost. Are all convex cones good??? NOT 7

9 Self-dual embedding of CLO min θβ Ax κb +θ b z = 0 A T y +κc θ c s = 0 b T y c T x +θα ρ = 0 b T y + c T x κα ν = β z C 1, x C 2, y C1, s C 2, ρ 0, θ 0, ν 0, κ 0, where b := b + z 0 Ax 0, c := c s 0 A T y 0, α := 1 + c T x 0 b T y 0, β := (x 0 ) T s 0 + (y 0 ) T z x 0 int(c 2 ), z 0 int(c 1 ), y 0 int(c 1 ), s0 int(c 2 ), θ0 = ρ 0 = κ 0 = ν 0 = 1 interior feasible; the embedding problem is self-dual; the central path exists and the duality gap equals 2θβ; the central path leads to a maximally complementary solution, in the interior of the optimal set; ANY feasible IPM is applicable and yield an MC optimal solution. This is our self-dual model!!!! 8

10 Self-Dual Embedding of CLO results For (P ) and (D) we distinguish the following possibilities: (I) A primal-dual optimal pair (x, y) exists with 0 duality gap (c T x b T y = 0); (IIa) a primal ray exists (x C 2 such that Ax C 1 and c T x < 0), the primal is either infeasible or unbounded; (IIb) a dual ray exists (y C 1 such that AT y C 2 and bt y > 0), the dual is either infeasible or unbounded; (III) no optimal pair with zero duality gap exists, and neither (P ) nor (D) has a ray. Theorem 1. For the self-dual embedding problem let a maximally complementary solution (y, x, κ, θ, z, s, ρ, ν ) be given. Then: (i) if κ > 0 then case (I) holds; (ii) if κ = 0 and ρ > 0 and either case (IIa) or case (IIb) holds. (iii) if κ = ρ = 0 then case (III) holds. 9

11 New Convex Optimization Problems Second Order Conic Optimization (SOCO) The second order cone in IR n is defined as S2 n := x IRn : x 2:n = n x 2 i x 1 i=2. The name ice cream cone is coming from the 3-dimensional shape of the cone. The second order cone is self-dual: (S n 2 ) = S n 2. Optimization problems, where cones C 1 and C 2 are polyhedral or products of second order cones, are second order cone optimization (SOCO) problems. Significance Norm minimization, robust optimization, quadratic, and thus portfolio optimization. 10

12 SOCO Optimality The primal-dual SOCO problem is defined as (SP ) min c T x s.t. Ax = b, (SD) max b T y s.t. A T y + s = c x k j=1 Sn j 2 s k j=1 Sn j 2. x T = ((x 1 ) T,..., (x j ) T,..., (x k ) T ) IR n ; and s T = ((s 1 ) T,..., (s j ) T,..., (s k ) T ) IR n. Ax = b, Optimality: x k j=1 Sn j 2, AT y + s = c, s k j=1 Sn j 2 (x j ) T s j = 0 x j s j = 0 Arr(x j )s j = Arr(s j )x j = 0 j Here we have used the notation: u v = u T v u 1 v 2:n + v 1 u 2:n and Arr(u) = u 1 u 2... u n u 2 u u n u 1 11

13 Notes on SOCO Convex (conic) optimization problem with vectors Vector calculus not associative Duality gap may exists (next page) Strong duality with interior point (Slater) condition Second order cones cannot be combined into larger second order cones, i.e., S n 1 2 Sn 2 2 Sn 1+n 2 2 Generalization of LO: S 1 2 = IR1 + Rotated cone x 2:n 2 x 0 x 1, x 0, x 1 0 n ( ) x 2 x0 i + x 2 ( 1 x0 x i=2 Efficiently solvable by IPMs. ) 2 12

14 SOCO: Duality gap example Primal Problem (SP ) min x 2 s.t. x 1 x 3 = 0, x x2 3 x 1 (SD) max 0 y s.t. y + s 1 = 0 0 y + s 2 = 1 y + s 3 = 0 s s2 3 s 1 Dual Problem Primal Optimal solutions: x 1 = x 3 0; x 2 = 0 Dual problem is infeasible!! Slater not satisfied = Zero duality gap may not hold 13

15 Portfolio optimization SOCO Portfolio optimization: Let A : m n, b IR m, c IR n and Q : n n positive semidefinite matrix, e = (1,..., 1) T IR n, p IR. min c T x xt Qx s.t. Ax = b, e T x = p, x 0. Towards second order optimization: Cholesky factorization Q = 2L T L implying x T Qx = 2(Lx) T (Lx) = z T z with z = Lx. c T x xt Qx ζ z T z ζ c T x = ( ζ c T x + 1 Let: z 0 := ζ ct x+1 2 and z n+1 = ζ ct x 1 2, then 2 ) 2 z z n+1 ( ζ c T x 1 2 z 0. ) 2 14

16 Portfolio optimization SOCO variants The original portfolio problem maybe written in SOCO form as: min s.t. n+1 i=1 ζ zi 2 z 0, Ax = b, e T x = p, x 0, Lx z = 0, z 0 = ζ ct x + 1, z n+1 = ζ ct x Another portfolio problem in SOCO form as: min c T x + τ s.t. z τ, Lx z = 0, Ax = b, e T x = p, x 0. 15

17 New Convex Optimization Problems Semidefinite Optimization I The semidefinite cone in IR n n is defined as S n := { X IR n n : X = X T, z T Xz 0 z IR n} i.e. the matrices X are symmetric and positive semidefinite, denoted as X 0. The semidefinite cone is self-dual: (S n ) = S n. Optimization problems where the cones C 1 and C 2 are either polyhedral, second order or semidefinite cones are called semidefinite optimization (SDO) problems. 16

18 New Convex Optimization Problems Semidefinite Optimization Let A i, i = 1,, n and C, X be n n symmetric real matrices, b, y IR m and let Tr( ) denote the trace of a matrix. The primal-dual SDO problem is defined as (SP ) min Tr(CX) s.t. Tr(A i X) b i 0, i X 0 (SD) max b T y s.t. Optimality: Tr(CX) b T y = Tr(XS) = 0 XS = 0 Significance C m i=1 A i y i 0 y 0. Robust optimization, eigenvalue and singular value optimization Linear matrix inequalities, trust design Convex relaxation of nonconvex/integer problems 17

19 Notes on SDO Convex (conic) optimization problem with matrices Matrix calculus not commutative Product of symmetric matrices is not smmetric Duality gap may exists Strong duality with interior point (Slater) condition Semidefinite cones can be combined into larger semidefinite cones, i.e., S n 1 S n 2 S n 1+n 2 Generalization of LO: S 1 = IR 1 + diagonal matrices Not proper generalization of SOCO: x S n 2 Arr(x) Sn, BUT arrow-head structure cannot be preserved Efficiently solvable by IPMs. 18

20 LO Linear Optimization v/s Conic LO Conic LO linear objective linear equality constraints linear inequality constraints perfect duality strictly complementary opt.sol. Euclidean linear algebra x T s = 0 xs = 0 linear objective linear equality constraints conic inequality constraints perfect duality only with IPC maximally complementary opt.sol. matrix and Jordan algebra x T s = 0 x s = 0 (SOCO) Tr(XS) = 0 XS = 0 (SDO) Tr(XS) = 0 X 1 2SX 1 2 = S 2XS = 0 (P XP T ) 1 2(P T SP 1 )(P XP T ) 1 2 = µi (P SP T ) 1 2(P T XP 1 )(P SP T ) 1 2 = µi 19

21 Solvability of CLO problems Use IPMs Classic Linear Optimization Large scale LO problems are solved efficiently. High performance packages, like (CPLEX, GuRoBi, XPRESS-MP, MOSEK) offer simplex and interior point solvers as well. Problems solved with 10 7 variables. SOCO and SDO Polynomial solvability established. Traditional software is unable to handle conic constraints. Specialized software is developed. (SeDuMi, SDPA, SDPT3, CSDP, DSDP, SDPpack, MOSEK etc.) SOCO: MOSEK - commercial SDO: SDPA, CSDP, DSDP LO-SOCO-SDO: SeDuMi, SDPT3 SOCO: Problems solved with O(10 6 ) variables. SDO: solved with O(10 4 ) dimensional matrices. 20

22 Complexity of IPMs for LO Method Practice Large update Small update θ adaptive 1 1/100 1/ n Iter. bound max 100 O(ϑ log ϑ ϵ ) O( ϑ log ϑ ϵ ) Performance Efficient Efficient Very poor Almost constant (< 100) number of iterations in practice! CLO ϑ = cost/iteration LO # of variables O(n 3 ) sparse SOCO # of second order cones O(n 3 )+update SDO dimension of matrix X O(n 2 m 3 ) dense 26

23 Several IPM Solvers for CLO Problems What made this major advance possible? Advances in Computers and Software Computers processor speed memory disk space floating point arithmetic architecture (cash...) Software component/algorithms presolve LINEAR ALGEBRA sparse factorizations symmetric square root IPMs, predictor-corrector dense and sparse versions SeDuMi, SDPT3 SDPA-xxx tuned to all three cones CSDP, DSDP tuned to SDO only MOSEK, CPLEX are commercial solves for SOCO. Parallel implementations exist coming. MODELING languages YALMIP (Löfberg); CVx (Boyd/Grant). 27

24 Further notes Norm and convex quadratic (including portfolio) optimization prob s can be solved with almost the same efficiency as LO. Efficient tools to eigenvalue, singular value optimization, LMI s CLO based approximation algorithms for nonconvex and combinatorial optimization problems. Lots of activity in exploring special structure of conic problems and developing modeling systems that support conic formulation First HPC-massively parallel implementations Cheap first order methods for very large scale SDO problems. Warm start and decomposition/cutting plane algorithms. Now: Adding logarithmic objective. 28

25 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work Disjunctive Conic Cuts for Mixed Integer Second Order Cone Optimization (MISOCO) Tamás Terlaky Joint work with: Pietro Belotti, Julio C. Góez, Imre Pólik, Ted Ralphs With thanks for the AFOSR Award #: FA

26 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work CONTENTS Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work

27 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work MIXED INTEGER SECOND ORDER CONE OPTIMIZATION (MISOCO) minimize: c T x subject to: Ax = b x K x Z d R n d, (MISOCO) where, A R m n, c R n, b R m L n = {x x 1 x 2:n } K = L n 1 1 Ln k k Rows of A are linearly independent

28 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work OBJECTIVES Obtain the convex hull after applying a linear disjunction to a Mixed Integer Second Order Conic Optimization (MISOCO) problem. Design Disjunctive Conic Cuts for MISOCO.

29 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work PREVIOUS WORK Atamtürk and Narayanan (2010), conic cuts for general MISOCO problems. Drewes (2009), nonlinear cuts for 0-1 MISOCO problems. Krokhmal and Soberanisin(2010), Drewes (2009), Vielma et al. (2008), branch and bound algorithm based on linear outer approximations for Second Order Cones. Drewes (2009), Atamtürk and Narayanan (2009), lifting techniques for MISOCO problems. Çezik and Iyengar (2005), cuts for mixed 0-1 conic programming. Stubbs and Mehrotra (1999), lift-and-project method for 01 mixed convex programming.

30 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work APPLICATIONS Turbine balancing problems can be modeled as MISOCOs, White (1996). The euclidean Steiner tree problem can be formulated as a MISOCO, Fampa and Maculan (2004) Computer Vision and Pattern Recognition, Kumar, Torr, and Zisserman (2006). Cardinality-constrained portfolio optimization problems, Bertsimas and Shioda (2009).

31 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work SINGLE CONE PROBLEM Let us consider the special case: minimize: c T x subject to: Ax = b x L n (MISOCO) x Z d R n d, This problem has a single second order cone All the variables are in the single second order cone

32 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work STEP 1: SOLVE THE RELAXED PROBLEM Find the optimal solution x for the continuous relaxation of the MISOCO problem minimize: 3x 1 +2x 2 +2x 3 +x 4 subject to: 9x 1 +x 2 +x 3 +x 4 = 10 (x 1, x 2, x 3, x 4 ) L 4 x 4 Z. Relaxing the integrality constraint we get the optimal solution: x = (1.36, 0.91, 0.91, 0.45), with and optimal objective value: z = 0.00.

33 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work STEP 2: FIND A DISJUNCTION a T x β a T x β VIOLATED BY x = (1.36, 0.91, 0.91, 0.45) The disjunction x 4 1 x 4 0 is violated by x x x x 0 3 Relaxed optimal solution x x 2

34 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work STEP 3: APPLY THE DISJUNCTION AND CONVEXIFY min: 3x 1 +2x 2 +2x 3 +x 4 s.t: 9x 1 +x 2 +x 3 +x 4 = x x x 4 +x 5 = x x x 4 +x 6 = x x 3 +x 7 = 0 (x 1, x 2, x 3, x 4 ) L 4 (x 5, x 6, x 7 ) L 3 x 4 Z. The constraints in red represent the disjunctive conic cut. An integer optimal solution is obtained after adding one cut: x = (1.32, 0.93, 0.93, 0.00, 10.06, 10.06, 0.00), with and optimal objective value: z = 0.24.

35 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work CONVEX HULL OF THE INTERSECTION OF A DISJUNCTION AND A CONVEX SET Consider a closed convex set E and two halfspaces H 1 = {x R n : a x α} and H 2 = {x R n : b x β}, such that they do not intersect inside E, i.e., E H 1 H 2 =. Denote H = 1 = {x Rn : a x = α}, and H = 2 = {x Rn : b x = β}. If a convex cone K s.t. H = 1 E = K H= 1 and H= 2 E = K H= 2 are bounded, then conv(e (H 1 H 2 )) = E K.

36 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work INTERSECTION OF AN AFFINE SPACE AND A SECOND ORDER CONE Consider an affine subspace H = {x Ax = b} and x 0 H. Let H A be s.t rank([h, A T ]) = n, & columns of H are orthonormal. We can write H = {x x = x 0 + Hz, z R}. Then, there exist a matrix Q R n m n m, q R n m, ρ R, s.t. H L n = {y x = x 0 + Hz with z Qz + 2q z + ρ 0}. Further, Q has at most one negative eigenvalue. Define a quadric as the set Q = {z z Qz + 2q z + ρ 0}, which we also denote as Q = (Q, q, ρ).

37 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work UNI-PARAMETRIC FAMILY OF QUADRICS Q(τ) Given two hyperplanes H 1 = {z a 1 z = α 1} and H 2 = {z a 2 z = α 2}. Let Q = (Q, q, ρ) be a quadric where Q is positive definite. The family of quadrics having the same intersection with H 1 and H 2 as the quadric Q is parametrized by τ R as Q(τ), where Q(τ) = Q + τ a 1a T 2 + a 2a T 1 ω q(τ) = q τ α 2a 1 + α 1 a 2 ω ρ(τ) = ρ + 2τ α 1α 2 ω, where ω = { 2a T 1 a 2 if a T 1 a if a T 1 a 2 = 0.

38 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work UNI-PARAMETRIC FAMILY OF QUADRICS Q(τ) Sequence of quadrics x Q(τ)x + 2q(τ) x + ρ(τ) 0, for τ 1617

39 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work UNI-PARAMETRIC FAMILY OF QUADRICS Q(τ) Range Description τ = , τ = 1617 Paraboloid τ = , τ = Cones < τ < 1617 Ellipsoids τ > 1617 Two sheets hyperboloids < τ < One sheet hyperboloids τ < , Two sheets hyperboloids Behavior of the quadrics for different ranges of τ

40 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work THE DISJUNCTIVE CONIC CUT FOR PARALLEL DISJUNCTIONS Theorem Let A 1 = {x a 1 x = α 1} and A 2 = {x a 2 x = α 2}, be two parallel hyperplanes where a 1 = γa 2. The disjunctive conic cut is the quadric generated by Q(ˆτ) = (Q(ˆτ), q(ˆτ), ρ(ˆτ)), where ˆτ is the larger root of equation q(τ) Q(τ)q(τ) ρ(τ) = 0.

41 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work y y OUR DISJUNCTIVE CONIC CUT IS NEW Atamtürk and Narayanan designed a conic mixed integer rounding inequality. Our disjunctive conic cut is different, sometimes stronger. Consider the problem: minimize: x y subject to: x +y +2t = α (x 4 3 )2 + (y 1) 2 t x Z, y R Relaxed Optimal Solution Conic mixed integer 0.5 rounding inequality Disjunctive conic cut x Case with α = Relaxed Optimal Solution In this particular example our disjunctive conic cut is stronger. 0 1 Disjunctive conic cut Conic mixed integer rounding inequality x Case with α = 8

42 Introduction Disjunctive Conic Cuts for MISOCO Formulation of a Disjunctive Conic Cut Conclusions and Future Work CONCLUSIONS We developed a new disjunctive conic cut for MISOCO. It is algebraically simple to find the disjunctive conic cut for MISOCO problems. Next steps Develop disjunctive conic cuts for the case when Q is not positive definite. Develop a prototype branch-and-cut framework for solving MISOCO problems using disjunctive conic cuts. Develop strategies which, and how many disjunctive conic cuts to generate when several cones are in the problem. Develop a comprehensive branch-and-cut framework for solving MISOCO problems using disjunctive conic cuts. Far future work Develop disjunctive conic cuts for Semidefinite Optimization.

Tamás Terlaky George N. and Soteria Kledaras 87 Endowed Chair Professor. Chair, Department of Industrial and Systems Engineering Lehigh University

Tamás Terlaky George N. and Soteria Kledaras 87 Endowed Chair Professor. Chair, Department of Industrial and Systems Engineering Lehigh University 5th SJOM Bejing, 2011 Cone Linear Optimization (CLO) From LO, SOCO and SDO Towards Mixed-Integer CLO Tamás Terlaky George N. and Soteria Kledaras 87 Endowed Chair Professor. Chair, Department of Industrial

More information

Disjunctive conic cuts: The good, the bad, and implementation

Disjunctive conic cuts: The good, the bad, and implementation Disjunctive conic cuts: The good, the bad, and implementation MOSEK workshop on Mixed-integer conic optimization Julio C. Góez January 11, 2018 NHH Norwegian School of Economics 1 Motivation Goals! Extend

More information

A conic representation of the convex hull of disjunctive sets and conic cuts for integer second order cone optimization

A conic representation of the convex hull of disjunctive sets and conic cuts for integer second order cone optimization A conic representation of the convex hull of disjunctive sets and conic cuts for integer second order cone optimization Pietro Belotti Xpress Optimizer Team, FICO, Birmingham, UK. Julio C. Góez Dept of

More information

Second-order cone programming

Second-order cone programming Outline Second-order cone programming, PhD Lehigh University Department of Industrial and Systems Engineering February 10, 2009 Outline 1 Basic properties Spectral decomposition The cone of squares The

More information

15. Conic optimization

15. Conic optimization L. Vandenberghe EE236C (Spring 216) 15. Conic optimization conic linear program examples modeling duality 15-1 Generalized (conic) inequalities Conic inequality: a constraint x K where K is a convex cone

More information

BCOL RESEARCH REPORT 07.04

BCOL RESEARCH REPORT 07.04 BCOL RESEARCH REPORT 07.04 Industrial Engineering & Operations Research University of California, Berkeley, CA 94720-1777 LIFTING FOR CONIC MIXED-INTEGER PROGRAMMING ALPER ATAMTÜRK AND VISHNU NARAYANAN

More information

Disjunctive Cuts for Cross-Sections of the Second-Order Cone

Disjunctive Cuts for Cross-Sections of the Second-Order Cone Disjunctive Cuts for Cross-Sections of the Second-Order Cone Sercan Yıldız Gérard Cornuéjols June 10, 2014 Abstract In this paper we provide a unified treatment of general two-term disjunctions on crosssections

More information

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009 LMI MODELLING 4. CONVEX LMI MODELLING Didier HENRION LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ Universidad de Valladolid, SP March 2009 Minors A minor of a matrix F is the determinant of a submatrix

More information

Lecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min.

Lecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min. MA 796S: Convex Optimization and Interior Point Methods October 8, 2007 Lecture 1 Lecturer: Kartik Sivaramakrishnan Scribe: Kartik Sivaramakrishnan 1 Conic programming Consider the conic program min s.t.

More information

A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE

A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE Yugoslav Journal of Operations Research 24 (2014) Number 1, 35-51 DOI: 10.2298/YJOR120904016K A PREDICTOR-CORRECTOR PATH-FOLLOWING ALGORITHM FOR SYMMETRIC OPTIMIZATION BASED ON DARVAY'S TECHNIQUE BEHROUZ

More information

4TE3/6TE3. Algorithms for. Continuous Optimization

4TE3/6TE3. Algorithms for. Continuous Optimization 4TE3/6TE3 Algorithms for Continuous Optimization (Duality in Nonlinear Optimization ) Tamás TERLAKY Computing and Software McMaster University Hamilton, January 2004 terlaky@mcmaster.ca Tel: 27780 Optimality

More information

Lifting for conic mixed-integer programming

Lifting for conic mixed-integer programming Math. Program., Ser. A DOI 1.17/s117-9-282-9 FULL LENGTH PAPER Lifting for conic mixed-integer programming Alper Atamtürk Vishnu Narayanan Received: 13 March 28 / Accepted: 28 January 29 The Author(s)

More information

III. Applications in convex optimization

III. Applications in convex optimization III. Applications in convex optimization nonsymmetric interior-point methods partial separability and decomposition partial separability first order methods interior-point methods Conic linear optimization

More information

Summer School: Semidefinite Optimization

Summer School: Semidefinite Optimization Summer School: Semidefinite Optimization Christine Bachoc Université Bordeaux I, IMB Research Training Group Experimental and Constructive Algebra Haus Karrenberg, Sept. 3 - Sept. 7, 2012 Duality Theory

More information

Research overview. Seminar September 4, Lehigh University Department of Industrial & Systems Engineering. Research overview.

Research overview. Seminar September 4, Lehigh University Department of Industrial & Systems Engineering. Research overview. Research overview Lehigh University Department of Industrial & Systems Engineering COR@L Seminar September 4, 2008 1 Duality without regularity condition Duality in non-exact arithmetic 2 interior point

More information

Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A.

Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A. . Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A. Nemirovski Arkadi.Nemirovski@isye.gatech.edu Linear Optimization Problem,

More information

Convex hull of two quadratic or a conic quadratic and a quadratic inequality

Convex hull of two quadratic or a conic quadratic and a quadratic inequality Noname manuscript No. (will be inserted by the editor) Convex hull of two quadratic or a conic quadratic and a quadratic inequality Sina Modaresi Juan Pablo Vielma the date of receipt and acceptance should

More information

Two-Term Disjunctions on the Second-Order Cone

Two-Term Disjunctions on the Second-Order Cone Noname manuscript No. (will be inserted by the editor) Two-Term Disjunctions on the Second-Order Cone Fatma Kılınç-Karzan Sercan Yıldız the date of receipt and acceptance should be inserted later Abstract

More information

IMPLEMENTATION OF INTERIOR POINT METHODS

IMPLEMENTATION OF INTERIOR POINT METHODS IMPLEMENTATION OF INTERIOR POINT METHODS IMPLEMENTATION OF INTERIOR POINT METHODS FOR SECOND ORDER CONIC OPTIMIZATION By Bixiang Wang, Ph.D. A Thesis Submitted to the School of Graduate Studies in Partial

More information

Interior Point Methods for Nonlinear Optimization

Interior Point Methods for Nonlinear Optimization Interior Point Methods for Nonlinear Optimization Imre Pólik 1 and Tamás Terlaky 2 1 School of Computational Engineering and Science, McMaster University, Hamilton, Ontario, Canada, imre@polik.net 2 School

More information

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c

More information

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION   henrion COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS Didier HENRION www.laas.fr/ henrion October 2006 Geometry of LMI sets Given symmetric matrices F i we want to characterize the shape in R n of the LMI set F

More information

10 Numerical methods for constrained problems

10 Numerical methods for constrained problems 10 Numerical methods for constrained problems min s.t. f(x) h(x) = 0 (l), g(x) 0 (m), x X The algorithms can be roughly divided the following way: ˆ primal methods: find descent direction keeping inside

More information

Lecture Note 5: Semidefinite Programming for Stability Analysis

Lecture Note 5: Semidefinite Programming for Stability Analysis ECE7850: Hybrid Systems:Theory and Applications Lecture Note 5: Semidefinite Programming for Stability Analysis Wei Zhang Assistant Professor Department of Electrical and Computer Engineering Ohio State

More information

Convex Optimization M2

Convex Optimization M2 Convex Optimization M2 Lecture 3 A. d Aspremont. Convex Optimization M2. 1/49 Duality A. d Aspremont. Convex Optimization M2. 2/49 DMs DM par email: dm.daspremont@gmail.com A. d Aspremont. Convex Optimization

More information

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following

More information

The Ongoing Development of CSDP

The Ongoing Development of CSDP The Ongoing Development of CSDP Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt.edu Joseph Young Department of Mathematics New Mexico Tech (Now at Rice University)

More information

Interior Point Methods for Mathematical Programming

Interior Point Methods for Mathematical Programming Interior Point Methods for Mathematical Programming Clóvis C. Gonzaga Federal University of Santa Catarina, Florianópolis, Brazil EURO - 2013 Roma Our heroes Cauchy Newton Lagrange Early results Unconstrained

More information

Cuts for Conic Mixed-Integer Programming

Cuts for Conic Mixed-Integer Programming Cuts for Conic Mixed-Integer Programming Alper Atamtürk and Vishnu Narayanan Department of Industrial Engineering and Operations Research, University of California, Berkeley, CA 94720-1777 USA atamturk@berkeley.edu,

More information

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 17

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 17 EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 17 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory May 29, 2012 Andre Tkacenko

More information

15-780: LinearProgramming

15-780: LinearProgramming 15-780: LinearProgramming J. Zico Kolter February 1-3, 2016 1 Outline Introduction Some linear algebra review Linear programming Simplex algorithm Duality and dual simplex 2 Outline Introduction Some linear

More information

Sparse Optimization Lecture: Basic Sparse Optimization Models

Sparse Optimization Lecture: Basic Sparse Optimization Models Sparse Optimization Lecture: Basic Sparse Optimization Models Instructor: Wotao Yin July 2013 online discussions on piazza.com Those who complete this lecture will know basic l 1, l 2,1, and nuclear-norm

More information

Conic Linear Programming. Yinyu Ye

Conic Linear Programming. Yinyu Ye Conic Linear Programming Yinyu Ye December 2004, revised October 2017 i ii Preface This monograph is developed for MS&E 314, Conic Linear Programming, which I am teaching at Stanford. Information, lecture

More information

Penalty and Barrier Methods General classical constrained minimization problem minimize f(x) subject to g(x) 0 h(x) =0 Penalty methods are motivated by the desire to use unconstrained optimization techniques

More information

Semidefinite Programming, Combinatorial Optimization and Real Algebraic Geometry

Semidefinite Programming, Combinatorial Optimization and Real Algebraic Geometry Semidefinite Programming, Combinatorial Optimization and Real Algebraic Geometry assoc. prof., Ph.D. 1 1 UNM - Faculty of information studies Edinburgh, 16. September 2014 Outline Introduction Definition

More information

Lecture: Examples of LP, SOCP and SDP

Lecture: Examples of LP, SOCP and SDP 1/34 Lecture: Examples of LP, SOCP and SDP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2018.html wenzw@pku.edu.cn Acknowledgement:

More information

A semidefinite relaxation scheme for quadratically constrained quadratic problems with an additional linear constraint

A semidefinite relaxation scheme for quadratically constrained quadratic problems with an additional linear constraint Iranian Journal of Operations Research Vol. 2, No. 2, 20, pp. 29-34 A semidefinite relaxation scheme for quadratically constrained quadratic problems with an additional linear constraint M. Salahi Semidefinite

More information

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010 I.3. LMI DUALITY Didier HENRION henrion@laas.fr EECI Graduate School on Control Supélec - Spring 2010 Primal and dual For primal problem p = inf x g 0 (x) s.t. g i (x) 0 define Lagrangian L(x, z) = g 0

More information

Module 04 Optimization Problems KKT Conditions & Solvers

Module 04 Optimization Problems KKT Conditions & Solvers Module 04 Optimization Problems KKT Conditions & Solvers Ahmad F. Taha EE 5243: Introduction to Cyber-Physical Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ taha/index.html September

More information

Lecture: Introduction to LP, SDP and SOCP

Lecture: Introduction to LP, SDP and SOCP Lecture: Introduction to LP, SDP and SOCP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2015.html wenzw@pku.edu.cn Acknowledgement:

More information

Sparse Matrix Theory and Semidefinite Optimization

Sparse Matrix Theory and Semidefinite Optimization Sparse Matrix Theory and Semidefinite Optimization Lieven Vandenberghe Department of Electrical Engineering University of California, Los Angeles Joint work with Martin S. Andersen and Yifan Sun Third

More information

The moment-lp and moment-sos approaches

The moment-lp and moment-sos approaches The moment-lp and moment-sos approaches LAAS-CNRS and Institute of Mathematics, Toulouse, France CIRM, November 2013 Semidefinite Programming Why polynomial optimization? LP- and SDP- CERTIFICATES of POSITIVITY

More information

A ten page introduction to conic optimization

A ten page introduction to conic optimization CHAPTER 1 A ten page introduction to conic optimization This background chapter gives an introduction to conic optimization. We do not give proofs, but focus on important (for this thesis) tools and concepts.

More information

Split Cuts for Convex Nonlinear Mixed Integer Programming

Split Cuts for Convex Nonlinear Mixed Integer Programming Split Cuts for Convex Nonlinear Mixed Integer Programming Juan Pablo Vielma Massachusetts Institute of Technology joint work with D. Dadush and S. S. Dey S. Modaresi and M. Kılınç Georgia Institute of

More information

Semidefinite Programming

Semidefinite Programming Semidefinite Programming Basics and SOS Fernando Mário de Oliveira Filho Campos do Jordão, 2 November 23 Available at: www.ime.usp.br/~fmario under talks Conic programming V is a real vector space h, i

More information

Convex Optimization. (EE227A: UC Berkeley) Lecture 6. Suvrit Sra. (Conic optimization) 07 Feb, 2013

Convex Optimization. (EE227A: UC Berkeley) Lecture 6. Suvrit Sra. (Conic optimization) 07 Feb, 2013 Convex Optimization (EE227A: UC Berkeley) Lecture 6 (Conic optimization) 07 Feb, 2013 Suvrit Sra Organizational Info Quiz coming up on 19th Feb. Project teams by 19th Feb Good if you can mix your research

More information

ORF 523 Lecture 9 Spring 2016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Thursday, March 10, 2016

ORF 523 Lecture 9 Spring 2016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Thursday, March 10, 2016 ORF 523 Lecture 9 Spring 2016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Thursday, March 10, 2016 When in doubt on the accuracy of these notes, please cross check with the instructor

More information

Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization

Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization Instructor: Farid Alizadeh Author: Ai Kagawa 12/12/2012

More information

Structure in Mixed Integer Conic Optimization: From Minimal Inequalities to Conic Disjunctive Cuts

Structure in Mixed Integer Conic Optimization: From Minimal Inequalities to Conic Disjunctive Cuts Structure in Mixed Integer Conic Optimization: From Minimal Inequalities to Conic Disjunctive Cuts Fatma Kılınç-Karzan Tepper School of Business Carnegie Mellon University Joint work with Sercan Yıldız

More information

Continuous Optimisation, Chpt 9: Semidefinite Problems

Continuous Optimisation, Chpt 9: Semidefinite Problems Continuous Optimisation, Chpt 9: Semidefinite Problems Peter J.C. Dickinson DMMP, University of Twente p.j.c.dickinson@utwente.nl http://dickinson.website/teaching/2016co.html version: 21/11/16 Monday

More information

4. Algebra and Duality

4. Algebra and Duality 4-1 Algebra and Duality P. Parrilo and S. Lall, CDC 2003 2003.12.07.01 4. Algebra and Duality Example: non-convex polynomial optimization Weak duality and duality gap The dual is not intrinsic The cone

More information

The Ellipsoid Algorithm

The Ellipsoid Algorithm The Ellipsoid Algorithm John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA 9 February 2018 Mitchell The Ellipsoid Algorithm 1 / 28 Introduction Outline 1 Introduction 2 Assumptions

More information

Lagrange Duality. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)

Lagrange Duality. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST) Lagrange Duality Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Lagrangian Dual function Dual

More information

Robust and Optimal Control, Spring 2015

Robust and Optimal Control, Spring 2015 Robust and Optimal Control, Spring 2015 Instructor: Prof. Masayuki Fujita (S5-303B) D. Linear Matrix Inequality D.1 Convex Optimization D.2 Linear Matrix Inequality(LMI) D.3 Control Design and LMI Formulation

More information

5. Duality. Lagrangian

5. Duality. Lagrangian 5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized

More information

Primal-dual IPM with Asymmetric Barrier

Primal-dual IPM with Asymmetric Barrier Primal-dual IPM with Asymmetric Barrier Yurii Nesterov, CORE/INMA (UCL) September 29, 2008 (IFOR, ETHZ) Yu. Nesterov Primal-dual IPM with Asymmetric Barrier 1/28 Outline 1 Symmetric and asymmetric barriers

More information

Example: feasibility. Interpretation as formal proof. Example: linear inequalities and Farkas lemma

Example: feasibility. Interpretation as formal proof. Example: linear inequalities and Farkas lemma 4-1 Algebra and Duality P. Parrilo and S. Lall 2006.06.07.01 4. Algebra and Duality Example: non-convex polynomial optimization Weak duality and duality gap The dual is not intrinsic The cone of valid

More information

On implementing a primal-dual interior-point method for conic quadratic optimization

On implementing a primal-dual interior-point method for conic quadratic optimization On implementing a primal-dual interior-point method for conic quadratic optimization E. D. Andersen, C. Roos, and T. Terlaky December 18, 2000 Abstract Conic quadratic optimization is the problem of minimizing

More information

Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma

Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma Venkataramanan (Ragu) Balakrishnan School of ECE, Purdue University 8 September 2003 European Union RTN Summer School on Multi-Agent

More information

On the Sandwich Theorem and a approximation algorithm for MAX CUT

On the Sandwich Theorem and a approximation algorithm for MAX CUT On the Sandwich Theorem and a 0.878-approximation algorithm for MAX CUT Kees Roos Technische Universiteit Delft Faculteit Electrotechniek. Wiskunde en Informatica e-mail: C.Roos@its.tudelft.nl URL: http://ssor.twi.tudelft.nl/

More information

Structure of Valid Inequalities for Mixed Integer Conic Programs

Structure of Valid Inequalities for Mixed Integer Conic Programs Structure of Valid Inequalities for Mixed Integer Conic Programs Fatma Kılınç-Karzan Tepper School of Business Carnegie Mellon University 18 th Combinatorial Optimization Workshop Aussois, France January

More information

CSCI 1951-G Optimization Methods in Finance Part 10: Conic Optimization

CSCI 1951-G Optimization Methods in Finance Part 10: Conic Optimization CSCI 1951-G Optimization Methods in Finance Part 10: Conic Optimization April 6, 2018 1 / 34 This material is covered in the textbook, Chapters 9 and 10. Some of the materials are taken from it. Some of

More information

Cuts for mixed 0-1 conic programs

Cuts for mixed 0-1 conic programs Cuts for mixed 0-1 conic programs G. Iyengar 1 M. T. Cezik 2 1 IEOR Department Columbia University, New York. 2 GERAD Université de Montréal, Montréal TU-Chemnitz Workshop on Integer Programming and Continuous

More information

Interior Point Methods in Mathematical Programming

Interior Point Methods in Mathematical Programming Interior Point Methods in Mathematical Programming Clóvis C. Gonzaga Federal University of Santa Catarina, Brazil Journées en l honneur de Pierre Huard Paris, novembre 2008 01 00 11 00 000 000 000 000

More information

Some cut-generating functions for second-order conic sets

Some cut-generating functions for second-order conic sets Some cut-generating functions for second-order conic sets Asteroide Santana 1 and Santanu S. Dey 1 1 School of Industrial and Systems Engineering, Georgia Institute of Technology June 1, 2016 Abstract

More information

A CONIC DANTZIG-WOLFE DECOMPOSITION APPROACH FOR LARGE SCALE SEMIDEFINITE PROGRAMMING

A CONIC DANTZIG-WOLFE DECOMPOSITION APPROACH FOR LARGE SCALE SEMIDEFINITE PROGRAMMING A CONIC DANTZIG-WOLFE DECOMPOSITION APPROACH FOR LARGE SCALE SEMIDEFINITE PROGRAMMING Kartik Krishnan Advanced Optimization Laboratory McMaster University Joint work with Gema Plaza Martinez and Tamás

More information

Nonsymmetric potential-reduction methods for general cones

Nonsymmetric potential-reduction methods for general cones CORE DISCUSSION PAPER 2006/34 Nonsymmetric potential-reduction methods for general cones Yu. Nesterov March 28, 2006 Abstract In this paper we propose two new nonsymmetric primal-dual potential-reduction

More information

The Solution of Euclidean Norm Trust Region SQP Subproblems via Second Order Cone Programs, an Overview and Elementary Introduction

The Solution of Euclidean Norm Trust Region SQP Subproblems via Second Order Cone Programs, an Overview and Elementary Introduction The Solution of Euclidean Norm Trust Region SQP Subproblems via Second Order Cone Programs, an Overview and Elementary Introduction Florian Jarre, Felix Lieder, Mathematisches Institut, Heinrich-Heine

More information

Continuous Optimisation, Chpt 9: Semidefinite Optimisation

Continuous Optimisation, Chpt 9: Semidefinite Optimisation Continuous Optimisation, Chpt 9: Semidefinite Optimisation Peter J.C. Dickinson DMMP, University of Twente p.j.c.dickinson@utwente.nl http://dickinson.website/teaching/2017co.html version: 28/11/17 Monday

More information

SEMIDEFINITE PROGRAM BASICS. Contents

SEMIDEFINITE PROGRAM BASICS. Contents SEMIDEFINITE PROGRAM BASICS BRIAN AXELROD Abstract. A introduction to the basics of Semidefinite programs. Contents 1. Definitions and Preliminaries 1 1.1. Linear Algebra 1 1.2. Convex Analysis (on R n

More information

HW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given.

HW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given. HW1 solutions Exercise 1 (Some sets of probability distributions.) Let x be a real-valued random variable with Prob(x = a i ) = p i, i = 1,..., n, where a 1 < a 2 < < a n. Of course p R n lies in the standard

More information

A priori bounds on the condition numbers in interior-point methods

A priori bounds on the condition numbers in interior-point methods A priori bounds on the condition numbers in interior-point methods Florian Jarre, Mathematisches Institut, Heinrich-Heine Universität Düsseldorf, Germany. Abstract Interior-point methods are known to be

More information

3. Linear Programming and Polyhedral Combinatorics

3. Linear Programming and Polyhedral Combinatorics Massachusetts Institute of Technology 18.433: Combinatorial Optimization Michel X. Goemans February 28th, 2013 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory

More information

Midterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A.

Midterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. Midterm Review Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapter 1-4, Appendices) 1 Separating hyperplane

More information

4TE3/6TE3. Algorithms for. Continuous Optimization

4TE3/6TE3. Algorithms for. Continuous Optimization 4TE3/6TE3 Algorithms for Continuous Optimization (Algorithms for Constrained Nonlinear Optimization Problems) Tamás TERLAKY Computing and Software McMaster University Hamilton, November 2005 terlaky@mcmaster.ca

More information

On Valid Inequalities for Quadratic Programming with Continuous Variables and Binary Indicators

On Valid Inequalities for Quadratic Programming with Continuous Variables and Binary Indicators On Valid Inequalities for Quadratic Programming with Continuous Variables and Binary Indicators Hongbo Dong and Jeff Linderoth Wisconsin Institutes for Discovery University of Wisconsin-Madison, USA, hdong6,linderoth}@wisc.edu

More information

More First-Order Optimization Algorithms

More First-Order Optimization Algorithms More First-Order Optimization Algorithms Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye Chapters 3, 8, 3 The SDM

More information

Continuous Optimisation, Chpt 7: Proper Cones

Continuous Optimisation, Chpt 7: Proper Cones Continuous Optimisation, Chpt 7: Proper Cones Peter J.C. Dickinson DMMP, University of Twente p.j.c.dickinson@utwente.nl http://dickinson.website/teaching/2017co.html version: 10/11/17 Monday 13th November

More information

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Laura Galli 1 Adam N. Letchford 2 Lancaster, April 2011 1 DEIS, University of Bologna, Italy 2 Department of Management Science,

More information

Interior Point Methods. We ll discuss linear programming first, followed by three nonlinear problems. Algorithms for Linear Programming Problems

Interior Point Methods. We ll discuss linear programming first, followed by three nonlinear problems. Algorithms for Linear Programming Problems AMSC 607 / CMSC 764 Advanced Numerical Optimization Fall 2008 UNIT 3: Constrained Optimization PART 4: Introduction to Interior Point Methods Dianne P. O Leary c 2008 Interior Point Methods We ll discuss

More information

Introduction to Semidefinite Programs

Introduction to Semidefinite Programs Introduction to Semidefinite Programs Masakazu Kojima, Tokyo Institute of Technology Semidefinite Programming and Its Application January, 2006 Institute for Mathematical Sciences National University of

More information

Semidefinite Programming Basics and Applications

Semidefinite Programming Basics and Applications Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent

More information

Interior-Point Methods

Interior-Point Methods Interior-Point Methods Stephen Wright University of Wisconsin-Madison Simons, Berkeley, August, 2017 Wright (UW-Madison) Interior-Point Methods August 2017 1 / 48 Outline Introduction: Problems and Fundamentals

More information

Part 4: Active-set methods for linearly constrained optimization. Nick Gould (RAL)

Part 4: Active-set methods for linearly constrained optimization. Nick Gould (RAL) Part 4: Active-set methods for linearly constrained optimization Nick Gould RAL fx subject to Ax b Part C course on continuoue optimization LINEARLY CONSTRAINED MINIMIZATION fx subject to Ax { } b where

More information

Chapter 2: Preliminaries and elements of convex analysis

Chapter 2: Preliminaries and elements of convex analysis Chapter 2: Preliminaries and elements of convex analysis Edoardo Amaldi DEIB Politecnico di Milano edoardo.amaldi@polimi.it Website: http://home.deib.polimi.it/amaldi/opt-14-15.shtml Academic year 2014-15

More information

Introduction and Math Preliminaries

Introduction and Math Preliminaries Introduction and Math Preliminaries Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye Appendices A, B, and C, Chapter

More information

ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications

ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications Professor M. Chiang Electrical Engineering Department, Princeton University March

More information

Interior-Point Methods for Linear Optimization

Interior-Point Methods for Linear Optimization Interior-Point Methods for Linear Optimization Robert M. Freund and Jorge Vera March, 204 c 204 Robert M. Freund and Jorge Vera. All rights reserved. Linear Optimization with a Logarithmic Barrier Function

More information

Approximate Farkas Lemmas in Convex Optimization

Approximate Farkas Lemmas in Convex Optimization Approximate Farkas Lemmas in Convex Optimization Imre McMaster University Advanced Optimization Lab AdvOL Graduate Student Seminar October 25, 2004 1 Exact Farkas Lemma Motivation 2 3 Future plans The

More information

Lecture: Algorithms for LP, SOCP and SDP

Lecture: Algorithms for LP, SOCP and SDP 1/53 Lecture: Algorithms for LP, SOCP and SDP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2018.html wenzw@pku.edu.cn Acknowledgement:

More information

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 18

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 18 EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 18 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory May 31, 2012 Andre Tkacenko

More information

18. Primal-dual interior-point methods

18. Primal-dual interior-point methods L. Vandenberghe EE236C (Spring 213-14) 18. Primal-dual interior-point methods primal-dual central path equations infeasible primal-dual method primal-dual method for self-dual embedding 18-1 Symmetric

More information

12. Interior-point methods

12. Interior-point methods 12. Interior-point methods Convex Optimization Boyd & Vandenberghe inequality constrained minimization logarithmic barrier function and central path barrier method feasibility and phase I methods complexity

More information

Geometric problems. Chapter Projection on a set. The distance of a point x 0 R n to a closed set C R n, in the norm, is defined as

Geometric problems. Chapter Projection on a set. The distance of a point x 0 R n to a closed set C R n, in the norm, is defined as Chapter 8 Geometric problems 8.1 Projection on a set The distance of a point x 0 R n to a closed set C R n, in the norm, is defined as dist(x 0,C) = inf{ x 0 x x C}. The infimum here is always achieved.

More information

Lecture 6 - Convex Sets

Lecture 6 - Convex Sets Lecture 6 - Convex Sets Definition A set C R n is called convex if for any x, y C and λ [0, 1], the point λx + (1 λ)y belongs to C. The above definition is equivalent to saying that for any x, y C, the

More information

What can be expressed via Conic Quadratic and Semidefinite Programming?

What can be expressed via Conic Quadratic and Semidefinite Programming? What can be expressed via Conic Quadratic and Semidefinite Programming? A. Nemirovski Faculty of Industrial Engineering and Management Technion Israel Institute of Technology Abstract Tremendous recent

More information

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013 Convex Optimization (EE227A: UC Berkeley) Lecture 28 (Algebra + Optimization) 02 May, 2013 Suvrit Sra Admin Poster presentation on 10th May mandatory HW, Midterm, Quiz to be reweighted Project final report

More information

The Q Method for Symmetric Cone Programmin

The Q Method for Symmetric Cone Programmin The Q Method for Symmetric Cone Programming The Q Method for Symmetric Cone Programmin Farid Alizadeh and Yu Xia alizadeh@rutcor.rutgers.edu, xiay@optlab.mcma Large Scale Nonlinear and Semidefinite Progra

More information

Infeasible Primal-Dual (Path-Following) Interior-Point Methods for Semidefinite Programming*

Infeasible Primal-Dual (Path-Following) Interior-Point Methods for Semidefinite Programming* Infeasible Primal-Dual (Path-Following) Interior-Point Methods for Semidefinite Programming* Notes for CAAM 564, Spring 2012 Dept of CAAM, Rice University Outline (1) Introduction (2) Formulation & a complexity

More information

Conic optimization under combinatorial sparsity constraints

Conic optimization under combinatorial sparsity constraints Conic optimization under combinatorial sparsity constraints Christoph Buchheim and Emiliano Traversi Abstract We present a heuristic approach for conic optimization problems containing sparsity constraints.

More information