Dimension reduction for semidefinite programming
|
|
- Ellen Skinner
- 5 years ago
- Views:
Transcription
1 1 / 22 Dimension reduction for semidefinite programming Pablo A. Parrilo Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute of Technology Joint work with Frank Permenter (MIT) arxiv: CDC Las Vegas
2 2 / 22 Semidefinite programs (SDPs) minimize Tr CX subject to X A S n + Formulated over vector space S n of n n symmetric matrices. variable X S n A S n an affine subspace, C S n cost matrix S n + cone of psd matrices Efficiently solvable in theory; in practice, solving some instances impossible unless special structure is exploited.
3 Dimension reduction Reformulate problem over subspace S S n intersecting set of optimal solutions minimize Tr CX subject to X A S n + minimize subject to Tr CX X A S n + S (Reformulation) S A S n + opt. solns where S n + S equals product K i K m of simple cones. Reduction methods: symmetry reduction and facial reduction 3 / 22
4 4 / 22 Symmetry reduction (MAXCUT relaxation example ) minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix
5 Symmetry reduction (MAXCUT relaxation example ) minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix range P A S n + opt. solns (e.g., Schrijver 79; Gatermann-P. 03) Idea: find special projection map P P(X) optimal when X optimal. P explicitly constructed from automorphism group of graph. Range block-diagonal a direct-sum of matrix algebras. 4 / 22
6 5 / 22 Facial reduction H S n + A minimize Tr CX subject to X A S n + First, find face of S n + containing feasible set. There exists a hyperplane H containing A. S n + H a face isomorphic to S d + for d < n. Face S n + H contains feasible set A S n +.
7 5 / 22 Facial reduction H S n + A minimize Tr CX subject to X A S n + First, find face of S n + containing feasible set. There exists a hyperplane H containing A. S n + H a face isomorphic to S d + for d < n. Face S n + H contains feasible set A S n +. Next, reformulate SDP over face: minimize subject to Tr CX X A S n + H
8 Facial reduction H S n + A minimize Tr CX subject to X A S n + First, find face of S n + containing feasible set. There exists a hyperplane H containing A. S n + H a face isomorphic to S d + for d < n. Face S n + H contains feasible set A S n +. Next, reformulate SDP over face: minimize subject to Tr CX X A S n + H Borwein-Wolkowicz 81; Pataki 00; Permenter-P / 22
9 6 / 22 Application specific approaches Facial reduction: MAXCUT (Anjos, Wolkowicz) QAP (Zhao,Wolkowicz) Sums-of-squares optimization (Permenter-P., Waki-Muramatsu) Matrix completion (Krislock,Wolkowicz)... Symmetry reduction: MAXCUT (earlier example), QAP (de Klerk, Sotirov); Markov chains (Boyd et al.); codes (Schrijver; Laurent)...
10 7 / 22 Our approach This talk: new reduction method subsuming symmetry reduction Notion of optimal reductions. A general purpose algorithm with optimality guarantees Jordan algebra interpretation; hence, easy extension to symmetric cone optimization (e.g., LP, SOCP). Combinatorial refinements for computational efficiency
11 8 / 22 How does symmetry reduction work? Given SDP min X A S n + Tr CX, method finds special orthogonal projection P : S n S n range of P A S n + opt. solns If X feas./optimal, P(X) feas./optimal.
12 8 / 22 How does symmetry reduction work? Given SDP min X A S n + Tr CX, method finds special orthogonal projection P : S n S n range of P A S n + opt. solns If X feas./optimal, P(X) feas./optimal. P satisfies following conditions: P(A) A, P(S n +) S n +, P(C) = C
13 How does symmetry reduction work? Given SDP min X A S n + Tr CX, method finds special orthogonal projection P : S n S n range of P A S n + opt. solns If X feas./optimal, P(X) feas./optimal. P satisfies following conditions: P(A) A, P(S n +) S n +, P(C) = C Hence, if X feasible then P(X) feasible with equal cost: 8 / 22
14 9 / 22 Example: a MAXCUT SDP relaxation minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix
15 9 / 22 Example: a MAXCUT SDP relaxation minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix
16 9 / 22 Example: a MAXCUT SDP relaxation minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix Let G denote group of permutation matrices (automorphisms) G := {U a permutation matrix : U T CU = C}
17 9 / 22 Example: a MAXCUT SDP relaxation minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix Let G denote group of permutation matrices (automorphisms) G := {U a permutation matrix : U T CU = C} Taking P(X) := 1 G U G UT XU, desired conditions hold: P(S n +) S n + P(A) A, P(C) = C
18 9 / 22 Example: a MAXCUT SDP relaxation minimize Tr CX subject to X A S n + A := {X S n : X ii = 1} C := adjacency matrix Let G denote group of permutation matrices (automorphisms) G := {U a permutation matrix : U T CU = C} Taking P(X) := 1 G U G UT XU, desired conditions hold: P(S n +) S n + P(A) A, P(C) = C Hence, range of P contains solutions: when X feasible, P(X) feasible with equal cost.
19 10 / 22 Our approach: optimize over projections Given SDP min X A S n + C, X, find map P that solves minimize subject to rank P P(C) = C, P(I) = I P(A) A P(S n +) S n + P : S n S n an orthogonal projection.
20 10 / 22 Our approach: optimize over projections Given SDP min X A S n + C, X, find map P that solves minimize subject to rank P P(C) = C, P(I) = I P(A) A P(S n +) S n + P : S n S n an orthogonal projection. Main properties: Can be solved in polynomial time (!) Range of P structured: a Jordan subalgebra of S n. S n + range P equals a product of symmetric cones.
21 11 / 22 Invariance characterization of optimal subspace Theorem (Permenter-P.) Orthogonal projection P : S n S n solves minimize subject to rank P P(C) = C, P(I) = I P(A) A P(S n +) S n + iff the range of P solves minimize dim S subject to S {I, X L, C} S P L (S) S {X 2 : X S}, where A = X L + L, and X L is the min-norm point of A.
22 12 / 22 Subspace optimization and solution algorithm minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S span{c, X L, I} repeat S S + P L (S) S S + span{x 2 : X S} until converged.
23 12 / 22 Subspace optimization and solution algorithm minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S span{c, X L, I} repeat S S + P L (S) S S + span{x 2 : X S} until converged. Properties of algorithm: Optimal subspace contains each iterate (induction)
24 12 / 22 Subspace optimization and solution algorithm minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S span{c, X L, I} repeat S S + P L (S) S S + span{x 2 : X S} until converged. Properties of algorithm: Optimal subspace contains each iterate (induction) Computes ascending chain of subspaces terminates.
25 12 / 22 Subspace optimization and solution algorithm minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S span{c, X L, I} repeat S S + P L (S) S S + span{x 2 : X S} until converged. Properties of algorithm: Optimal subspace contains each iterate (induction) Computes ascending chain of subspaces terminates. At termination, subspace feasible; hence, optimal.
26 12 / 22 Subspace optimization and solution algorithm minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S span{c, X L, I} repeat S S + P L (S) S S + span{x 2 : X S} until converged. Properties of algorithm: Optimal subspace contains each iterate (induction) Computes ascending chain of subspaces terminates. At termination, subspace feasible; hence, optimal. Properties of minimization problem: Feasible set closed under intersection (lattice)
27 Subspace optimization and solution algorithm minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S span{c, X L, I} repeat S S + P L (S) S S + span{x 2 : X S} until converged. Properties of algorithm: Optimal subspace contains each iterate (induction) Computes ascending chain of subspaces terminates. At termination, subspace feasible; hence, optimal. Properties of minimization problem: Feasible set closed under intersection (lattice) A unique solution. 12 / 22
28 13 / 22 Combinatorial descriptions Great! Now, we can easily compute the optimal subspace S.
29 13 / 22 Combinatorial descriptions Great! Now, we can easily compute the optimal subspace S. But, often want/need additional properties (e.g., dense subspaces may not be very efficient). Can tradeoff dimension with sparsity of a basis?
30 13 / 22 Combinatorial descriptions Great! Now, we can easily compute the optimal subspace S. But, often want/need additional properties (e.g., dense subspaces may not be very efficient). Can tradeoff dimension with sparsity of a basis? Yes! Three kinds of sparse bases for S: E.g., Partition subspaces: defined by a partition of [n] [n]. Coordinate subspaces: defined by a sparsity pattern Combinatorial subspaces: orthogonal basis of 0/1 matrices a a b a a b b b c vs. a b 0 b c d vs. a 0 b 0 a c b c b
31 14 / 22 Finding optimal structured subspaces The main algorithm can be adapted to compute the optimal subspace for each of these three cases.
32 14 / 22 Finding optimal structured subspaces The main algorithm can be adapted to compute the optimal subspace for each of these three cases. Key property (again): lattice structure (closedness under intersection)
33 14 / 22 Finding optimal structured subspaces The main algorithm can be adapted to compute the optimal subspace for each of these three cases. Key property (again): lattice structure (closedness under intersection) E.g., for partition subspaces, instead of optimizing over lattice of subspaces, use the lattice of partitions: minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S is a partition subspace P Part{C, X L, I} repeat P refine(p, P L ) P refine(p, X X 2 ) until converged.
34 14 / 22 Finding optimal structured subspaces The main algorithm can be adapted to compute the optimal subspace for each of these three cases. Key property (again): lattice structure (closedness under intersection) E.g., for partition subspaces, instead of optimizing over lattice of subspaces, use the lattice of partitions: minimize subject to dim S S C, X L, I S P L (S) S {X 2 : X S} S is a partition subspace P Part{C, X L, I} repeat P refine(p, P L ) P refine(p, X X 2 ) until converged. Great! But there s more...
35 15 / 22 Decomposition via Jordan algebras Given SDP min X A S n + C, X, we ve found a subspace invariant under X X 2 containing optimal solutions: S A S n + opt. solns S {X 2 : X S}
36 15 / 22 Decomposition via Jordan algebras Given SDP min X A S n + C, X, we ve found a subspace invariant under X X 2 containing optimal solutions: S A S n + opt. solns S {X 2 : X S} Subspaces invariant under X X 2 have decomposition S S S = Q QT, S m S i are simple Jordan algebras
37 Decomposition via Jordan algebras Given SDP min X A S n + C, X, we ve found a subspace invariant under X X 2 containing optimal solutions: S A S n + opt. solns S {X 2 : X S} Subspaces invariant under X X 2 have decomposition S S S = Q QT, S m S i are simple Jordan algebras Number of distinct eigenvalues of generic element equals rank of S i a complexity measure. 15 / 22
38 16 / 22 Minimizing dimension optimizes decomposition minimize subject to dim S S X L, C, I S P L (S) S {X 2 : X S}, All feasible subspaces have decomp. S = d S i=1 S i. In what sense does solution S optimize the ranks of each S i?
39 16 / 22 Minimizing dimension optimizes decomposition minimize subject to dim S S X L, C, I S P L (S) S {X 2 : X S}, All feasible subspaces have decomp. S = d S i=1 S i. In what sense does solution S optimize the ranks of each S i? Thm. (Permenter-P.): S minimizes i rank S i and max i rank S i
40 Minimizing dimension optimizes decomposition minimize subject to dim S S X L, C, I S P L (S) S {X 2 : X S}, All feasible subspaces have decomp. S = d S i=1 S i. In what sense does solution S optimize the ranks of each S i? Thm. (Permenter-P.): S minimizes i rank S i and max i rank S i Majorization inequalities hold, i.e., for each m 1 m m rank Si rank S i i=1 (ranks sorted in decreasing order) i=1 16 / 22
41 17 / 22 Majorization example Subspaces (parametrized by u i and v i ) and their rank vectors u 1 u u 2 u u u 5 u u 6 u 7 v 1 v v 2 v v 4 v 5 v v 5 v 7 v v 6 v 8 v 9 r u = (2, 1, 2) r v = (2, 3)
42 17 / 22 Majorization example Subspaces (parametrized by u i and v i ) and their rank vectors u 1 u u 2 u u u 5 u u 6 u 7 v 1 v v 2 v v 4 v 5 v v 5 v 7 v v 6 v 8 v 9 r u = (2, 1, 2) r v = (2, 3) Vector r u = (2, 2, 1) majorized by r v = (3, 2, 0): 2 3, ,
43 18 / 22 Jordan algebras Jordan algebras are commutative algebras satisfying Jordan identity (X Y ) X 2 = X (Y X 2 ) The vector space S n a Jordan algebra if equipped with product X Y := 1 (XY + YX) 2 The subalgebras of S n precisely the sets closed under squaring map X X 2 since XY + YX = (X + Y ) 2 X 2 Y 2. Structure theorem of Jordan-von Neumann-Wigner describes subalgebras of S n...
44 Decomposition of S S n + If S S n a Jordan subalgebra, it equals direct-sum m i=1 S i, where each S i is isomorphic to one of the following: Algebra of Hermitian matrices with real, complex or quaternion entries A spin-factor algebra Implies cone-of-squares S S n + isomorphic to product of PSD cones with real/complex/quaternion entries Lorentz cones Yields reformulation of original SDP over this product minimize Tr CX subject to X A S n + minimize Tr CX subject to X A T (K 1 K m ) }{{} S S n + 19 / 22
45 20 / 22 Computational results Comparison with reduction method of de Klerk 10 survey (generating *-algebras from data): instance S S data hamming_7_5_ hamming_8_3_ hamming_9_5_ hamming_9_ hamming_10_ Table list dimension of our subspace S S n and subspace S data S n found by generating *-algebra. Decomposing S yields a linear program.
46 Results: SOSOPT (Seiler 13) Demo scripts Script Name n (before) n (after) sosoptdemo2 13, 3 3, 2 3, 1 7 sosoptdemo , 1 10 gsosoptdemo1 9, 5 6, 3 2, 2 IOGainDemo_3 15, 8 10, 5 2, 3 Chesi(1 2)_IterationWithVlin 9, 5 6, 3 2, 2 Chesi3_GlobalStability 14, 5 8, 6, 3, 2 Chesi(3 4)_IterationWithVlin 9, 5 6, 3 2, 2 Chesi(5 6)_Bootstrap 19, 9 13, 6 2, 3 Chesi(5 6)_IterationWithVlin 19, 9 13, 6 2, 3 Coutinho3_IterationWithVlin 9, 5 6, 3 2, 2 HachichoTibken_Bootstrap 19, 9 12, 7, 6, 3 HachichoTibken_IterationWithVlin 19, 9 12, 7, 6, 3 Hahn_IterationWithVlin 9, 5 6, 3, 3, 2 KuChen_IterationWithVlin 19, 9 13, 6 2, 3 Parrilo1_GlobalStabilityWithVec 3, 2 2, 1 3 Parrilo2_GlobalStabilityWithMat 3, 2 2, 1 3 VDP_IterationWithVball 5, 4 3 2, 2, 1 VDP_IterationWithVlin 9, 5 6, 3 2, 2 VDP_LinearizedLyap 9, 5 6, 3 2, 2 VannelliVidyasagar2_Bootstrap 19, 9 13, 6 2, 3 VannelliVidyasagar2_IterationWithVlin 19, 9 13, 6 2, 3 VincentGrantham_IterationWithVlin 9, 5 6, 3 2, 2 WTBenchmark_IterationWithVlin 19, 9 13, 6 2, 3 21 / 22
47 22 / 22 Conclusions New reduction method for SDP. Generalizes symmetry reduction and *-algebra-methods Fully algorithmic, don t need to compute automorphisms! Yields optimal block-diagonalization (majorization) Can exploit combinatorial description of subspace Through Jordan algebra theory, extends to LP/SOCP/...
48 22 / 22 Conclusions New reduction method for SDP. Generalizes symmetry reduction and *-algebra-methods Fully algorithmic, don t need to compute automorphisms! Yields optimal block-diagonalization (majorization) Can exploit combinatorial description of subspace Through Jordan algebra theory, extends to LP/SOCP/... Preprint at arxiv:
49 22 / 22 Conclusions New reduction method for SDP. Generalizes symmetry reduction and *-algebra-methods Fully algorithmic, don t need to compute automorphisms! Yields optimal block-diagonalization (majorization) Can exploit combinatorial description of subspace Through Jordan algebra theory, extends to LP/SOCP/... Preprint at arxiv: Thanks for your attention!
MIT Algebraic techniques and semidefinite optimization May 9, Lecture 21. Lecturer: Pablo A. Parrilo Scribe:???
MIT 6.972 Algebraic techniques and semidefinite optimization May 9, 2006 Lecture 2 Lecturer: Pablo A. Parrilo Scribe:??? In this lecture we study techniques to exploit the symmetry that can be present
More informationReduction methods in semidefinite and conic optimization
Reduction methods in semidefinite and conic optimization by Frank Noble Permenter BS Electrical Engineering, The University of Houston, 2006 MS Electrical Engineering, Stanford, 2010 Submitted to the Department
More informationApplications of semidefinite programming in Algebraic Combinatorics
Applications of semidefinite programming in Algebraic Combinatorics Tohoku University The 23rd RAMP Symposium October 24, 2011 We often want to 1 Bound the value of a numerical parameter of certain combinatorial
More informationConvex sets, conic matrix factorizations and conic rank lower bounds
Convex sets, conic matrix factorizations and conic rank lower bounds Pablo A. Parrilo Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute
More informationDSOS/SDOS Programming: New Tools for Optimization over Nonnegative Polynomials
DSOS/SDOS Programming: New Tools for Optimization over Nonnegative Polynomials Amir Ali Ahmadi Princeton University Dept. of Operations Research and Financial Engineering (ORFE) Joint work with: Anirudha
More informationFast ADMM for Sum of Squares Programs Using Partial Orthogonality
Fast ADMM for Sum of Squares Programs Using Partial Orthogonality Antonis Papachristodoulou Department of Engineering Science University of Oxford www.eng.ox.ac.uk/control/sysos antonis@eng.ox.ac.uk with
More informationEquivariant semidefinite lifts and sum of squares hierarchies
Equivariant semidefinite lifts and sum of squares hierarchies Pablo A. Parrilo Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute of Technology
More informationSemidefinite Programming Basics and Applications
Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5
Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5 Instructor: Farid Alizadeh Scribe: Anton Riabov 10/08/2001 1 Overview We continue studying the maximum eigenvalue SDP, and generalize
More informationCSCI 1951-G Optimization Methods in Finance Part 10: Conic Optimization
CSCI 1951-G Optimization Methods in Finance Part 10: Conic Optimization April 6, 2018 1 / 34 This material is covered in the textbook, Chapters 9 and 10. Some of the materials are taken from it. Some of
More informationIterative LP and SOCP-based. approximations to. sum of squares programs. Georgina Hall Princeton University. Joint work with:
Iterative LP and SOCP-based approximations to sum of squares programs Georgina Hall Princeton University Joint work with: Amir Ali Ahmadi (Princeton University) Sanjeeb Dash (IBM) Sum of squares programs
More informationRobust and Optimal Control, Spring 2015
Robust and Optimal Control, Spring 2015 Instructor: Prof. Masayuki Fujita (S5-303B) G. Sum of Squares (SOS) G.1 SOS Program: SOS/PSD and SDP G.2 Duality, valid ineqalities and Cone G.3 Feasibility/Optimization
More informationSemidefinite programming and convex algebraic geometry
FoCM 2008 - SDP and convex AG p. 1/40 Semidefinite programming and convex algebraic geometry Pablo A. Parrilo www.mit.edu/~parrilo Laboratory for Information and Decision Systems Electrical Engineering
More informationConvex Optimization of Graph Laplacian Eigenvalues
Convex Optimization of Graph Laplacian Eigenvalues Stephen Boyd Stanford University (Joint work with Persi Diaconis, Arpita Ghosh, Seung-Jean Kim, Sanjay Lall, Pablo Parrilo, Amin Saberi, Jun Sun, Lin
More informationA Numerical Algorithm for Block-Diagonal Decomposition of Matrix -Algebras, Part I: Proposed Approach and Application to Semidefinite Programming
A Numerical Algorithm for Block-Diagonal Decomposition of Matrix -Algebras, Part I: Proposed Approach and Application to Semidefinite Programming Kazuo Murota, Yoshihiro Kanno, Masakazu Kojima, Sadayoshi
More informationThe convex algebraic geometry of rank minimization
The convex algebraic geometry of rank minimization Pablo A. Parrilo Laboratory for Information and Decision Systems Massachusetts Institute of Technology International Symposium on Mathematical Programming
More informationFacial Reduction and Geometry on Conic Programming
Facial Reduction and Geometry on Conic Programming Masakazu Muramatsu UEC Bruno F. Lourenço, and Takashi Tsuchiya Seikei University GRIPS Based on the papers of LMT: 1. A structural geometrical analysis
More information1.4 Solvable Lie algebras
1.4. SOLVABLE LIE ALGEBRAS 17 1.4 Solvable Lie algebras 1.4.1 Derived series and solvable Lie algebras The derived series of a Lie algebra L is given by: L (0) = L, L (1) = [L, L],, L (2) = [L (1), L (1)
More informationReal Symmetric Matrices and Semidefinite Programming
Real Symmetric Matrices and Semidefinite Programming Tatsiana Maskalevich Abstract Symmetric real matrices attain an important property stating that all their eigenvalues are real. This gives rise to many
More informationConvex Optimization of Graph Laplacian Eigenvalues
Convex Optimization of Graph Laplacian Eigenvalues Stephen Boyd Abstract. We consider the problem of choosing the edge weights of an undirected graph so as to maximize or minimize some function of the
More informationFacial reduction for Euclidean distance matrix problems
Facial reduction for Euclidean distance matrix problems Nathan Krislock Department of Mathematical Sciences Northern Illinois University, USA Distance Geometry: Theory and Applications DIMACS Center, Rutgers
More informationA NUMERICAL ALGORITHM FOR BLOCK-DIAGONAL DECOMPOSITION OF MATRIX -ALGEBRAS
A NUMERICAL ALGORITHM FOR BLOCK-DIAGONAL DECOMPOSITION OF MATRIX -ALGEBRAS KAZUO MUROTA, YOSHIHIRO KANNO, MASAKAZU KOJIMA, AND SADAYOSHI KOJIMA (SEPTEMBER 2007 / REVISED OCTOBER 2008) Abstract. Motivated
More informationPositive semidefinite rank
1/15 Positive semidefinite rank Hamza Fawzi (MIT, LIDS) Joint work with João Gouveia (Coimbra), Pablo Parrilo (MIT), Richard Robinson (Microsoft), James Saunderson (Monash), Rekha Thomas (UW) DIMACS Workshop
More informationV&V MURI Overview Caltech, October 2008
V&V MURI Overview Caltech, October 2008 Pablo A. Parrilo Laboratory for Information and Decision Systems Massachusetts Institute of Technology Goals!! Specification, design, and certification!! Coherent
More informationREPRESENTATION THEORY WEEK 5. B : V V k
REPRESENTATION THEORY WEEK 5 1. Invariant forms Recall that a bilinear form on a vector space V is a map satisfying B : V V k B (cv, dw) = cdb (v, w), B (v 1 + v, w) = B (v 1, w)+b (v, w), B (v, w 1 +
More informationSemidefinite programming lifts and sparse sums-of-squares
1/15 Semidefinite programming lifts and sparse sums-of-squares Hamza Fawzi (MIT, LIDS) Joint work with James Saunderson (UW) and Pablo Parrilo (MIT) Cornell ORIE, October 2015 Linear optimization 2/15
More informationProblems in Linear Algebra and Representation Theory
Problems in Linear Algebra and Representation Theory (Most of these were provided by Victor Ginzburg) The problems appearing below have varying level of difficulty. They are not listed in any specific
More informationIntroduction to Association Schemes
Introduction to Association Schemes Akihiro Munemasa Tohoku University June 5 6, 24 Algebraic Combinatorics Summer School, Sendai Assumed results (i) Vandermonde determinant: a a m =. a m a m m i
More informationSta$s$cal models and graphs
Sta$s$cal models and graphs AFOSR FA9550-11-1-0305 Fundamental methodology and applica$ons Convex op$miza$on and graphs as underlying engines Examples: Sparse graph es$ma$on, latent-variable modeling,
More informationSemidefinite Programming and Harmonic Analysis
1 / 74 Semidefinite Programming and Harmonic Analysis Cristóbal Guzmán CS 8803 - Discrete Fourier Analysis and Applications March 7, 2012 2 / 74 Motivation SDP gives best relaxations known for some combinatorial
More informationCSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming
CSC2411 - Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming Notes taken by Mike Jamieson March 28, 2005 Summary: In this lecture, we introduce semidefinite programming
More informationAn LMI description for the cone of Lorentz-positive maps II
An LMI description for the cone of Lorentz-positive maps II Roland Hildebrand October 6, 2008 Abstract Let L n be the n-dimensional second order cone. A linear map from R m to R n is called positive if
More informationSEMIDEFINITE PROGRAM BASICS. Contents
SEMIDEFINITE PROGRAM BASICS BRIAN AXELROD Abstract. A introduction to the basics of Semidefinite programs. Contents 1. Definitions and Preliminaries 1 1.1. Linear Algebra 1 1.2. Convex Analysis (on R n
More informationSymmetric Sums of Squares
Symmetric Sums of Squares Annie Raymond University of Washington MSRI University of Massachusetts Joint with James Saunderson (Monash University), Mohit Singh (Georgia Tech), and Rekha Thomas (UW) November
More informationLift-and-Project Techniques and SDP Hierarchies
MFO seminar on Semidefinite Programming May 30, 2010 Typical combinatorial optimization problem: max c T x s.t. Ax b, x {0, 1} n P := {x R n Ax b} P I := conv(k {0, 1} n ) LP relaxation Integral polytope
More informationA notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations
A notion of for Convex, Semidefinite and Extended Formulations Marcel de Carli Silva Levent Tunçel April 26, 2018 A vector in R n is integral if each of its components is an integer, A vector in R n is
More informationA STRUCTURAL GEOMETRICAL ANALYSIS OF WEAKLY INFEASIBLE SDPS
Journal of the Operations Research Society of Japan Vol. 59, No. 3, July 2016, pp. 241 257 c The Operations Research Society of Japan A STRUCTURAL GEOMETRICAL ANALYSIS OF WEAKLY INFEASIBLE SDPS Bruno F.
More informationREPRESENTATIONS OF U(N) CLASSIFICATION BY HIGHEST WEIGHTS NOTES FOR MATH 261, FALL 2001
9 REPRESENTATIONS OF U(N) CLASSIFICATION BY HIGHEST WEIGHTS NOTES FOR MATH 261, FALL 21 ALLEN KNUTSON 1 WEIGHT DIAGRAMS OF -REPRESENTATIONS Let be an -dimensional torus, ie a group isomorphic to The we
More informationLecture: Examples of LP, SOCP and SDP
1/34 Lecture: Examples of LP, SOCP and SDP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2018.html wenzw@pku.edu.cn Acknowledgement:
More informationLecture 5 : Projections
Lecture 5 : Projections EE227C. Lecturer: Professor Martin Wainwright. Scribe: Alvin Wan Up until now, we have seen convergence rates of unconstrained gradient descent. Now, we consider a constrained minimization
More informationNotes on nilpotent orbits Computational Theory of Real Reductive Groups Workshop. Eric Sommers
Notes on nilpotent orbits Computational Theory of Real Reductive Groups Workshop Eric Sommers 17 July 2009 2 Contents 1 Background 5 1.1 Linear algebra......................................... 5 1.1.1
More informationINTERIOR-POINT METHODS ROBERT J. VANDERBEI JOINT WORK WITH H. YURTTAN BENSON REAL-WORLD EXAMPLES BY J.O. COLEMAN, NAVAL RESEARCH LAB
1 INTERIOR-POINT METHODS FOR SECOND-ORDER-CONE AND SEMIDEFINITE PROGRAMMING ROBERT J. VANDERBEI JOINT WORK WITH H. YURTTAN BENSON REAL-WORLD EXAMPLES BY J.O. COLEMAN, NAVAL RESEARCH LAB Outline 2 Introduction
More informationRelaxations of combinatorial problems via association schemes
1 Relaxations of combinatorial problems via association schemes Etienne de Klerk, Fernando M. de Oliveira Filho, and Dmitrii V. Pasechnik Tilburg University, The Netherlands; Nanyang Technological University,
More informationLinear Algebra problems
Linear Algebra problems 1. Show that the set F = ({1, 0}, +,.) is a field where + and. are defined as 1+1=0, 0+0=0, 0+1=1+0=1, 0.0=0.1=1.0=0, 1.1=1.. Let X be a non-empty set and F be any field. Let X
More informationSDP Relaxations for MAXCUT
SDP Relaxations for MAXCUT from Random Hyperplanes to Sum-of-Squares Certificates CATS @ UMD March 3, 2017 Ahmed Abdelkader MAXCUT SDP SOS March 3, 2017 1 / 27 Overview 1 MAXCUT, Hardness and UGC 2 LP
More informationarxiv: v1 [math.oc] 26 Sep 2015
arxiv:1509.08021v1 [math.oc] 26 Sep 2015 Degeneracy in Maximal Clique Decomposition for Semidefinite Programs Arvind U. Raghunathan and Andrew V. Knyazev Mitsubishi Electric Research Laboratories 201 Broadway,
More informationNon-commutative polynomial optimization
Non-commutative polynomial optimization S. Pironio 1, M. Navascuès 2, A. Acín 3 1 Laboratoire d Information Quantique (Brussels) 2 Department of Mathematics (Bristol) 3 ICFO-The Institute of Photonic Sciences
More informationMath Linear Algebra II. 1. Inner Products and Norms
Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,
More informationAcyclic Semidefinite Approximations of Quadratically Constrained Quadratic Programs
Acyclic Semidefinite Approximations of Quadratically Constrained Quadratic Programs Raphael Louca & Eilyan Bitar School of Electrical and Computer Engineering American Control Conference (ACC) Chicago,
More informationLower bounds on the size of semidefinite relaxations. David Steurer Cornell
Lower bounds on the size of semidefinite relaxations David Steurer Cornell James R. Lee Washington Prasad Raghavendra Berkeley Institute for Advanced Study, November 2015 overview of results unconditional
More informationGraph Partitioning Using Random Walks
Graph Partitioning Using Random Walks A Convex Optimization Perspective Lorenzo Orecchia Computer Science Why Spectral Algorithms for Graph Problems in practice? Simple to implement Can exploit very efficient
More informationThe Graph Realization Problem
The Graph Realization Problem via Semi-Definite Programming A. Y. Alfakih alfakih@uwindsor.ca Mathematics and Statistics University of Windsor The Graph Realization Problem p.1/21 The Graph Realization
More informationJOHNSON SCHEMES AND CERTAIN MATRICES WITH INTEGRAL EIGENVALUES
JOHNSON SCHEMES AND CERTAIN MATRICES WITH INTEGRAL EIGENVALUES AMANDA BURCROFF The University of Michigan Wednesday 6 th September, 2017 Abstract. We are interested in the spectrum of matrices in the adjacency
More informationComplexity of Deciding Convexity in Polynomial Optimization
Complexity of Deciding Convexity in Polynomial Optimization Amir Ali Ahmadi Joint work with: Alex Olshevsky, Pablo A. Parrilo, and John N. Tsitsiklis Laboratory for Information and Decision Systems Massachusetts
More informationAnalysis of Control Systems on Symmetric Cones
Analysis of Control Systems on Symmetric Cones Ivan Papusha Richard M. Murray Abstract It is well known that exploiting special structure is a powerful way to extend the reach of current optimization tools
More informationL(C G (x) 0 ) c g (x). Proof. Recall C G (x) = {g G xgx 1 = g} and c g (x) = {X g Ad xx = X}. In general, it is obvious that
ALGEBRAIC GROUPS 61 5. Root systems and semisimple Lie algebras 5.1. Characteristic 0 theory. Assume in this subsection that chark = 0. Let me recall a couple of definitions made earlier: G is called reductive
More informationarxiv: v4 [math.oc] 12 Apr 2017
Exact duals and short certificates of infeasibility and weak infeasibility in conic linear programming arxiv:1507.00290v4 [math.oc] 12 Apr 2017 Minghui Liu Gábor Pataki April 14, 2017 Abstract In conic
More informationSDP and eigenvalue bounds for the graph partition problem
SDP and eigenvalue bounds for the graph partition problem Renata Sotirov and Edwin van Dam Tilburg University, The Netherlands Outline... the graph partition problem Outline... the graph partition problem
More informationCommuting birth-and-death processes
Commuting birth-and-death processes Caroline Uhler Department of Statistics UC Berkeley (joint work with Steven N. Evans and Bernd Sturmfels) MSRI Workshop on Algebraic Statistics December 18, 2008 Birth-and-death
More informationThe maximal stable set problem : Copositive programming and Semidefinite Relaxations
The maximal stable set problem : Copositive programming and Semidefinite Relaxations Kartik Krishnan Department of Mathematical Sciences Rensselaer Polytechnic Institute Troy, NY 12180 USA kartis@rpi.edu
More informationLINEAR ALGEBRA BOOT CAMP WEEK 1: THE BASICS
LINEAR ALGEBRA BOOT CAMP WEEK 1: THE BASICS Unless otherwise stated, all vector spaces in this worksheet are finite dimensional and the scalar field F has characteristic zero. The following are facts (in
More informationA CONIC DANTZIG-WOLFE DECOMPOSITION APPROACH FOR LARGE SCALE SEMIDEFINITE PROGRAMMING
A CONIC DANTZIG-WOLFE DECOMPOSITION APPROACH FOR LARGE SCALE SEMIDEFINITE PROGRAMMING Kartik Krishnan Advanced Optimization Laboratory McMaster University Joint work with Gema Plaza Martinez and Tamás
More informationUniqueness of the Solutions of Some Completion Problems
Uniqueness of the Solutions of Some Completion Problems Chi-Kwong Li and Tom Milligan Abstract We determine the conditions for uniqueness of the solutions of several completion problems including the positive
More informationOptimization over Polynomials with Sums of Squares and Moment Matrices
Optimization over Polynomials with Sums of Squares and Moment Matrices Monique Laurent Centrum Wiskunde & Informatica (CWI), Amsterdam and University of Tilburg Positivity, Valuations and Quadratic Forms
More informationChordal structure in computer algebra: Permanents
Chordal structure in computer algebra: Permanents Diego Cifuentes Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute of Technology Joint
More informationCOURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion
COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS Didier HENRION www.laas.fr/ henrion October 2006 Geometry of LMI sets Given symmetric matrices F i we want to characterize the shape in R n of the LMI set F
More informationIntroduction to Semidefinite Programming I: Basic properties a
Introduction to Semidefinite Programming I: Basic properties and variations on the Goemans-Williamson approximation algorithm for max-cut MFO seminar on Semidefinite Programming May 30, 2010 Semidefinite
More informationThere are six more problems on the next two pages
Math 435 bg & bu: Topics in linear algebra Summer 25 Final exam Wed., 8/3/5. Justify all your work to receive full credit. Name:. Let A 3 2 5 Find a permutation matrix P, a lower triangular matrix L with
More informationapproximation algorithms I
SUM-OF-SQUARES method and approximation algorithms I David Steurer Cornell Cargese Workshop, 201 meta-task encoded as low-degree polynomial in R x example: f(x) = i,j n w ij x i x j 2 given: functions
More informationMathematical Optimisation, Chpt 2: Linear Equations and inequalities
Mathematical Optimisation, Chpt 2: Linear Equations and inequalities Peter J.C. Dickinson p.j.c.dickinson@utwente.nl http://dickinson.website version: 12/02/18 Monday 5th February 2018 Peter J.C. Dickinson
More informationSemidefinite programming and eigenvalue bounds for the graph partition problem
Semidefinite programming and eigenvalue bounds for the graph partition problem E.R. van Dam R. Sotirov Abstract The graph partition problem is the problem of partitioning the vertex set of a graph into
More informationDegeneracy in Maximal Clique Decomposition for Semidefinite Programs
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Degeneracy in Maximal Clique Decomposition for Semidefinite Programs Raghunathan, A.U.; Knyazev, A. TR2016-040 July 2016 Abstract Exploiting
More informationSemidefinite Programming
Semidefinite Programming Basics and SOS Fernando Mário de Oliveira Filho Campos do Jordão, 2 November 23 Available at: www.ime.usp.br/~fmario under talks Conic programming V is a real vector space h, i
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationAnalysis and synthesis: a complexity perspective
Analysis and synthesis: a complexity perspective Pablo A. Parrilo ETH ZürichZ control.ee.ethz.ch/~parrilo Outline System analysis/design Formal and informal methods SOS/SDP techniques and applications
More informationBlock-Diagonal Decomposition of Matrices based on -Algebra for Structural Optimization with Symmetry Property
Block-Diagonal Decomposition of Matrices based on -Algebra for Structural ptimization with Symmetry Property Yoshihiro Kanno Kazuo Murota Masakazu Kojima Sadayoshi Kojima University of okyo (Japan) okyo
More informationDecentralized Control of Stochastic Systems
Decentralized Control of Stochastic Systems Sanjay Lall Stanford University CDC-ECC Workshop, December 11, 2005 2 S. Lall, Stanford 2005.12.11.02 Decentralized Control G 1 G 2 G 3 G 4 G 5 y 1 u 1 y 2 u
More informationNetwork Localization via Schatten Quasi-Norm Minimization
Network Localization via Schatten Quasi-Norm Minimization Anthony Man-Cho So Department of Systems Engineering & Engineering Management The Chinese University of Hong Kong (Joint Work with Senshan Ji Kam-Fung
More informationLINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM
LINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM Unless otherwise stated, all vector spaces in this worksheet are finite dimensional and the scalar field F is R or C. Definition 1. A linear operator
More informationControl System Analysis on Symmetric Cones
Submitted, 015 Conference on Decision and Control (CDC) http://www.cds.caltech.edu/~murray/papers/pm15-cdc.html Control System Analysis on Symmetric Cones Ivan Papusha Richard M. Murray Abstract Motivated
More informationCopositive Programming and Combinatorial Optimization
Copositive Programming and Combinatorial Optimization Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria joint work with M. Bomze (Wien) and F. Jarre (Düsseldorf) and
More informationLMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009
LMI MODELLING 4. CONVEX LMI MODELLING Didier HENRION LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ Universidad de Valladolid, SP March 2009 Minors A minor of a matrix F is the determinant of a submatrix
More informationBare-bones outline of eigenvalue theory and the Jordan canonical form
Bare-bones outline of eigenvalue theory and the Jordan canonical form April 3, 2007 N.B.: You should also consult the text/class notes for worked examples. Let F be a field, let V be a finite-dimensional
More informationSparse Matrix Theory and Semidefinite Optimization
Sparse Matrix Theory and Semidefinite Optimization Lieven Vandenberghe Department of Electrical Engineering University of California, Los Angeles Joint work with Martin S. Andersen and Yifan Sun Third
More informationA proof of the Jordan normal form theorem
A proof of the Jordan normal form theorem Jordan normal form theorem states that any matrix is similar to a blockdiagonal matrix with Jordan blocks on the diagonal. To prove it, we first reformulate it
More informationThe Trust Region Subproblem with Non-Intersecting Linear Constraints
The Trust Region Subproblem with Non-Intersecting Linear Constraints Samuel Burer Boshi Yang February 21, 2013 Abstract This paper studies an extended trust region subproblem (etrs in which the trust region
More informationConvex sets, matrix factorizations and positive semidefinite rank
Convex sets, matrix factorizations and positive semidefinite rank Pablo A. Parrilo Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute of
More informationRepresentations of Positive Polynomials: Theory, Practice, and
Representations of Positive Polynomials: Theory, Practice, and Applications Dept. of Mathematics and Computer Science Emory University, Atlanta, GA Currently: National Science Foundation Temple University
More informationSignatures of GL n Multiplicity Spaces
Signatures of GL n Multiplicity Spaces UROP+ Final Paper, Summer 2016 Mrudul Thatte Mentor: Siddharth Venkatesh Project suggested by Pavel Etingof September 1, 2016 Abstract A stable sequence of GL n representations
More informationRelaxations and Randomized Methods for Nonconvex QCQPs
Relaxations and Randomized Methods for Nonconvex QCQPs Alexandre d Aspremont, Stephen Boyd EE392o, Stanford University Autumn, 2003 Introduction While some special classes of nonconvex problems can be
More informationOn bounding the bandwidth of graphs with symmetry
On bounding the bandwidth of graphs with symmetry E.R. van Dam R. Sotirov Abstract We derive a new lower bound for the bandwidth of a graph that is based on a new lower bound for the minimum cut problem.
More informationMatrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein
Matrix Mathematics Theory, Facts, and Formulas with Application to Linear Systems Theory Dennis S. Bernstein PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD Contents Special Symbols xv Conventions, Notation,
More informationNumerical block diagonalization of matrix -algebras with application to semidefinite programming
Math. Program., Ser. B (2011) 129:91 111 DOI 10.1007/s10107-011-0461-3 FULL LENGTH PAPER Numerical block diagonalization of matrix -algebras with application to semidefinite programming Etienne de Klerk
More informationApproximation Algorithms
Approximation Algorithms Chapter 26 Semidefinite Programming Zacharias Pitouras 1 Introduction LP place a good lower bound on OPT for NP-hard problems Are there other ways of doing this? Vector programs
More informationLecture: Introduction to LP, SDP and SOCP
Lecture: Introduction to LP, SDP and SOCP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2015.html wenzw@pku.edu.cn Acknowledgement:
More informationCompression, Matrix Range and Completely Positive Map
Compression, Matrix Range and Completely Positive Map Iowa State University Iowa-Nebraska Functional Analysis Seminar November 5, 2016 Definitions and notations H, K : Hilbert space. If dim H = n
More informationThe value of a problem is not so much coming up with the answer as in the ideas and attempted ideas it forces on the would be solver I.N.
Math 410 Homework Problems In the following pages you will find all of the homework problems for the semester. Homework should be written out neatly and stapled and turned in at the beginning of class
More informationEquations in simple algebras: variations on a theme of A. Borel. Boris Kunyavskĭı Bar-Ilan University RAGE conference Emory University, May 18, 2011
Equations in simple algebras: variations on a theme of A. Borel Boris Kunyavskĭı Bar-Ilan University RAGE conference Emory University, May 18, 2011 This talk is based on a joint work with Tatiana Bandman
More informationProblem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show
MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,
More informationBackground on Chevalley Groups Constructed from a Root System
Background on Chevalley Groups Constructed from a Root System Paul Tokorcheck Department of Mathematics University of California, Santa Cruz 10 October 2011 Abstract In 1955, Claude Chevalley described
More information