Robust Integer Programming

Size: px
Start display at page:

Download "Robust Integer Programming"

Transcription

1 Robust Integer Programming Technion Israel Institute of Technology

2 Outline. Overview our theory of Graver bases for integer programming (with Berstein, De Loera, Hemmecke, Lee, Romanchuk, Rothblum, Weismantel)

3 Outline. Overview our theory of Graver bases for integer programming (with Berstein, De Loera, Hemmecke, Lee, Romanchuk, Rothblum, Weismantel) 2. Robust integer programming (Arxiv, 24)

4 Outline. Overview our theory of Graver bases for integer programming (with Berstein, De Loera, Hemmecke, Lee, Romanchuk, Rothblum, Weismantel) 2. Robust integer programming (Arxiv, 24). Application - multiway tables

5 Outline. Overview our theory of Graver bases for integer programming (with Berstein, De Loera, Hemmecke, Lee, Romanchuk, Rothblum, Weismantel) 2. Robust integer programming (Arxiv, 24). Application - multiway tables 4. Huge multiway tables - P versus NP and conp (Arxiv, 24)

6 (Non)-Linear Integer Programming The problem is: min { f(x) : Ax = b, l x u, x in Z n } with data: A: integer m x n matrix b: right-hand side in Z m l,u: lower/upper bounds in Z n f: function from Z n to R

7 (Non)-Linear Integer Programming The problem is: min { f(x) : Ax = b, l x u, x in Z n } with data: A: integer m x n matrix b: right-hand side in Z m l,u: lower/upper bounds in Z n f: function from Z n to R Our theory enables polynomial time solution of broad natural universal (non)-linear integer programs in variable dimension

8 Graver Bases and Nonlinear Integer Programming

9 Graver Bases The Graver basis of an integer matrix A is the finite set G(A) of conformal-minimal nonzero integer vectors x satisfying Ax =. x is conformal-minimal if no other y in same orthant has all y i x i

10 Graver Bases The Graver basis of an integer matrix A is the finite set G(A) of conformal-minimal nonzero integer vectors x satisfying Ax =. Example: Consider A=( 2 ). Then G(A) consists of circuits: ±(2 - ), ±( -), ±( -2) non-circuits: ±( - )

11 Some Theorems on (Non)-Linear Integer Programming Theorem : linear optimization in polytime with G(A): min { wx : Ax = b, l x u, x in Z n } Reference: N-fold integer programming (De Loera, Hemmecke, Onn, Weismantel) Discrete Optimization (Volume in memory of George Dantzig), 28

12 Some Theorems on (Non)-Linear Integer Programming Theorem 2: separable convex minimization in polytime with G(A): min {Σ f i (x i ) : Ax = b, l x u, x in Z n } Reference: A polynomial oracle-time algorithm for convex integer minimization (Hemmecke, Onn, Weismantel) Mathematical Programming, 2

13 Some Theorems on (Non)-Linear Integer Programming Theorem : polynomial minimization in polytime with G(A): min {p(x) : Ax = b, l x u, x in Z n } for a certain class of possibly non-convex multivariate polynomials. Reference: The quadratic Graver cone, quadratic integer minimization & extensions (Lee, Onn, Romanchuk, Weismantel), Mathematical Programming, 22

14 The Iterative Algorithm

15 Proof of Theorem 2 To solve min {f(x) : Ax = b, l x u, x in Z n } R n Do: with the Graver basis G(A) f R

16 Proof of Theorem 2 To solve min {f(x) : Ax = b, l x u, x in Z n } R n f Do: with the Graver basis G(A). Find initial point by auxiliary program R

17 Proof of Theorem 2 To solve min {f(x) : Ax = b, l x u, x in Z n } R n R f with the Graver basis G(A) Do:. Find initial point by auxiliary program 2. Iteratively improve by Graver-best steps, that is, by best cz with c in Z and z in G(A).

18 Proof of Theorem 2 To solve min {f(x) : Ax = b, l x u, x in Z n } R n R f with the Graver basis G(A) Do:. Find initial point by auxiliary program 2. Iteratively improve by Graver-best steps, that is, by best cz with c in Z and z in G(A). Using supermodality of f and integer Caratheodory theorem (Cook-Fonlupt-Schrijver, Sebo) we can show polytime convergence to some optimal solution

19 Robust Integer Programming

20 Robust Integer Programming Player (decision maker) chooses point x feasible in X := {x Z n : Ax = b, l x u }

21 Robust Integer Programming Player (decision maker) chooses point x feasible in X := {x Z n : Ax = b, l x u } Player 2 (nature) reveals cost c in a set of one of two forms: Box: C := {c Z n : d c e } List: C := {c,..., c k }

22 Robust Integer Programming Player (decision maker) chooses point x feasible in X := {x Z n : Ax = b, l x u } Player 2 (nature) reveals cost c in a set of one of two forms: Box: C := {c Z n : d c e } List: C := {c,..., c k } The problem is: min x X max c C cx

23 Robust Integer Programming Player (decision maker) chooses point x feasible in X := {x Z n : Ax = b, l x u } Player 2 (nature) reveals cost c in a set of one of two forms: Box: C := {c Z n : d c e } List: C := {c,..., c k } The problem is: min x X max c C cx The dual problem is: max c C min x X cx

24 Robust Integer Programming Theorem: The following hold for Robust IP with G(A) given: Box C List C min x X max c C cx polynomial time NP-hard max c C min x X cx NP-hard polynomial time Reference: Robust integer programming (Onn) Arxiv, 24

25 Multiway Tables

26 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X m k+ tables with given margins

27 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X m k+ tables with given margins. If all m i fixed then solvable by fixed dimension theory

28 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X n tables with given margins. n

29 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X n tables with given margins. n g If one side n is variable then we have the following: 9 Lemma: For fixed m,..., m k there is Graver complexity g:=g(m,..., m k ) such that the relevant Graver basis consists of all O(n g ) lifts of the relevant Graver basis of m X... X m k X g tables.

30 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X n tables with given margins. n g If one side n is variable then we have the following: 9 Lemma: For fixed m,..., m k there is Graver complexity g:=g(m,..., m k ) such that the relevant Graver basis consists of all O(n g ) lifts of the relevant Graver basis of m X... X m k X g tables. g(,)=9, g(,4) = 27, g(,5) =? Ω(2 m ) = g(,m) = Ο(6 m )

31 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X n tables with given margins. n g Corollary: (Non)-linear optimization over m X... X m k X n tables with given margins is doable in polynomial time O(n g(m,,m k ) L).

32 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X n tables with given margins. n Corollary: (Non)-linear optimization over m X... X m k X n tables with given margins is doable in polynomial time O(n g(m,,m k ) L). Corollary: Robust optimization with Box C over m X... X m k X n tables with given margins is doable in polynomial time O(n g(m,,m k ) L).

33 Multiway Tables The multiway table problem of Motzkin (952) concerns minimization over m X... X m k X n tables with given margins. n Corollary: (Non)-linear optimization over m X... X m k X n tables with given margins is doable in polynomial time O(n g(m,,m k ) L). However, if two sides are variable then have the Universality Theorem: Every integer program is one over X m X n tables with given line-sums.

34 Multiway Tables Theorem: Linear optimization over m X... X m k X n tables with given margins is doable in fixed-parameter cubic time O(n L). Reference: N-fold integer programming in cubic time (Hemmecke, Onn, Romanchuk) Mathematical Programming, 2

35 Huge Multiway Tables

36 Huge Multiway Tables Consider the problem of deciding existence of an l X m X n huge table with t given types of row-sums and column-sums having n k layers of each type k with the n k encoded in binary. n

37 Huge Multiway Tables Consider the problem of deciding existence of an l X m X n huge table with t given types of row-sums and column-sums having n k layers of each type k with the n k encoded in binary. n Theorem: For fixed t the problem is in P. For variable t it is in NP and conp. Reference: Huge Multiway Table Problems (Onn) Arxiv, 24

38 Some Bibliography (available at - The complexity of -way tables (SIAM J. Comp.) - Convex combinatorial optimization (Disc. Comp. Geom.) - Markov bases of -way tables (J. Symb. Comp.) - All linear and integer programs are slim -way programs (SIAM J. Opt.) - Graver complexity of integer programming (Annals Combin.) - N-fold integer programming (Disc. Opt. in memory of Dantzig) - Convex integer maximization via Graver bases (J. Pure App. Algebra) - Polynomial oracle-time convex integer minimization (Math. Prog.) - The quadratic Graver cone, quadratic integer minimization & extensions (Math Prog.) - N-fold integer programming in cubic time (Math. Prog.) - Robust integer programming (Arxiv) - Huge multiway table problems (Arxiv)

39 Comprehensive development is in my monograph available electronically from my homepage (with kind permission of EMS) (excluding Robust IP and Huge Multiway Tables

Multiway Tables and Integer Programming are Fixed-Parameter Tractable

Multiway Tables and Integer Programming are Fixed-Parameter Tractable Multiway Tables and Integer Programming are Fixed-Parameter Tractable Technion Israel Institute of Technology Outline 1. Overview our theory of Graver bases for integer programming (with Berstein, De Loera,

More information

Advances in Integer Programming

Advances in Integer Programming Advances in Integer Programming Technion Israel Institute of Technology http://ie.technion.ac.il/~onn (Non)-Linear Integer Programming The problem is: min/max { f(x) : Ax b, l x u, x in Z n } with data:

More information

Nonlinear Discrete Optimization

Nonlinear Discrete Optimization Nonlinear Discrete Optimization Technion Israel Institute of Technology http://ie.technion.ac.il/~onn Billerafest 2008 - conference in honor of Lou Billera's 65th birthday (Update on Lecture Series given

More information

Algebraic and Geometric ideas in the theory of Discrete Optimization

Algebraic and Geometric ideas in the theory of Discrete Optimization Algebraic and Geometric ideas in the theory of Discrete Optimization Jesús A. De Loera, UC Davis Three Lectures based on the book: Algebraic & Geometric Ideas in the Theory of Discrete Optimization (SIAM-MOS

More information

A polynomial oracle-time algorithm for convex integer minimization

A polynomial oracle-time algorithm for convex integer minimization Math. Program., Ser. A DOI 10.1007/s10107-009-0276-7 FULL LENGTH PAPER A polynomial oracle-time algorithm for convex integer minimization Raymond Hemmecke Shmuel Onn Robert Weismantel Received: 16 October

More information

Nonlinear optimization for matroid intersection and extensions

Nonlinear optimization for matroid intersection and extensions Y. Berstein J. Lee S. Onn R. Weismantel Nonlinear optimization for matroid intersection and extensions For Tom Liebling, on the occasion of his retirement Abstract We address optimization of nonlinear

More information

Final results on P vs NP via Integer Factorization and Optimization

Final results on P vs NP via Integer Factorization and Optimization Final results on P vs NP via Integer Factorization and Optimization Abstract Yuly Shipilevsky Toronto, Ontario, Canada E-mail address: yulysh2000@yahoo.ca We reduce integer factorization problem to the

More information

P=NP via Integer factorization and Optimization

P=NP via Integer factorization and Optimization P=NP via Integer factorization and Optimization Yuly Shipilevsky Toronto, Ontario, Canada E-mail address: yulysh2000@yahoo.ca Abstract A polynomial-time algorithm for integer factorization, wherein integer

More information

Integer factorization is in P

Integer factorization is in P Integer factorization is in P Yuly Shipilevsky Toronto, Ontario, Canada E-mail address: yulysh2000@yahoo.ca Abstract A polynomial-time algorithm for integer factorization, wherein integer factorization

More information

Carathéodory Bounds for Integer Cones

Carathéodory Bounds for Integer Cones Carathéodory Bounds for Integer Cones Friedrich Eisenbrand, Gennady Shmonin Max-Planck-Institut für Informatik Stuhlsatzenhausweg 85 66123 Saarbrücken Germany [eisen,shmonin]@mpi-inf.mpg.de 22nd September

More information

Integer Quadratic Programming is in NP

Integer Quadratic Programming is in NP Alberto Del Pia 1 Santanu S. Dey 2 Marco Molinaro 2 1 IBM T. J. Watson Research Center, Yorktown Heights. 2 School of Industrial and Systems Engineering, Atlanta Outline 1 4 Program: Definition Definition

More information

P=NP via Integer Factorization and Optimization

P=NP via Integer Factorization and Optimization P=NP via Integer Factorization and Optimization Abstract Yuly Shipilevsky Toronto, Ontario, Canada E-mail address: yulysh2000@yahoo.ca We reduce integer factorization problem to the equivalent problem

More information

Complex Programming. Yuly Shipilevsky. Toronto, Ontario, Canada address:

Complex Programming. Yuly Shipilevsky. Toronto, Ontario, Canada  address: Complex Programming Yuly Shipilevsky Toronto, Ontario, Canada E-mail address: yulysh2000@yahoo.ca Abstract We introduce and suggest to research a special class of optimization problems, wherein an objective

More information

Minimizing Cubic and Homogeneous Polynomials Over Integer Points in the Plane

Minimizing Cubic and Homogeneous Polynomials Over Integer Points in the Plane Minimizing Cubic and Homogeneous Polynomials Over Integer Points in the Plane Robert Hildebrand IFOR - ETH Zürich Joint work with Alberto Del Pia, Robert Weismantel and Kevin Zemmer Robert Hildebrand (ETH)

More information

Lift-and-Project Inequalities

Lift-and-Project Inequalities Lift-and-Project Inequalities Q. Louveaux Abstract The lift-and-project technique is a systematic way to generate valid inequalities for a mixed binary program. The technique is interesting both on the

More information

Representations of All Solutions of Boolean Programming Problems

Representations of All Solutions of Boolean Programming Problems Representations of All Solutions of Boolean Programming Problems Utz-Uwe Haus and Carla Michini Institute for Operations Research Department of Mathematics ETH Zurich Rämistr. 101, 8092 Zürich, Switzerland

More information

Algorithmic Game Theory and Applications. Lecture 7: The LP Duality Theorem

Algorithmic Game Theory and Applications. Lecture 7: The LP Duality Theorem Algorithmic Game Theory and Applications Lecture 7: The LP Duality Theorem Kousha Etessami recall LP s in Primal Form 1 Maximize c 1 x 1 + c 2 x 2 +... + c n x n a 1,1 x 1 + a 1,2 x 2 +... + a 1,n x n

More information

Integer programming, Barvinok s counting algorithm and Gomory relaxations

Integer programming, Barvinok s counting algorithm and Gomory relaxations Integer programming, Barvinok s counting algorithm and Gomory relaxations Jean B. Lasserre LAAS-CNRS, Toulouse, France Abstract We propose an algorithm based on Barvinok s counting algorithm for P max{c

More information

arxiv: v1 [cs.dm] 27 Jan 2014

arxiv: v1 [cs.dm] 27 Jan 2014 Randomized Minmax Regret for Combinatorial Optimization Under Uncertainty Andrew Mastin, Patrick Jaillet, Sang Chin arxiv:1401.7043v1 [cs.dm] 27 Jan 2014 January 29, 2014 Abstract The minmax regret problem

More information

The Complexity of Maximum. Matroid-Greedoid Intersection and. Weighted Greedoid Maximization

The Complexity of Maximum. Matroid-Greedoid Intersection and. Weighted Greedoid Maximization Department of Computer Science Series of Publications C Report C-2004-2 The Complexity of Maximum Matroid-Greedoid Intersection and Weighted Greedoid Maximization Taneli Mielikäinen Esko Ukkonen University

More information

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 2003 2003.09.02.10 6. The Positivstellensatz Basic semialgebraic sets Semialgebraic sets Tarski-Seidenberg and quantifier elimination Feasibility

More information

Complex Programming. Yuly Shipilevsky. Toronto, Ontario, Canada address:

Complex Programming. Yuly Shipilevsky. Toronto, Ontario, Canada  address: Complex Programming Yuly Shipilevsky Toronto, Ontario, Canada E-mail address: yulysh2000@yahoo.ca Abstract We introduce and suggest to research a special class of optimization problems, wherein an objective

More information

1 Strict local optimality in unconstrained optimization

1 Strict local optimality in unconstrained optimization ORF 53 Lecture 14 Spring 016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Thursday, April 14, 016 When in doubt on the accuracy of these notes, please cross check with the instructor s

More information

IBM Research Report. Nonlinear Integer Programming. Otto-von-Guericke-Universität Magdeburg FMA/IMO Universitätsplatz Magdeburg Germany

IBM Research Report. Nonlinear Integer Programming. Otto-von-Guericke-Universität Magdeburg FMA/IMO Universitätsplatz Magdeburg Germany RC24820 (W0812-035) December 4, 2008 Mathematics IBM Research Report Nonlinear Integer Programming Raymond Hemmecke 1, Matthias Köppe 2, Jon Lee 3, Robert Weismantel 1 1 Otto-von-Guericke-Universität Magdeburg

More information

Algebra III Chapter 2 Note Packet. Section 2.1: Polynomial Functions

Algebra III Chapter 2 Note Packet. Section 2.1: Polynomial Functions Algebra III Chapter 2 Note Packet Name Essential Question: Section 2.1: Polynomial Functions Polynomials -Have nonnegative exponents -Variables ONLY in -General Form n ax + a x +... + ax + ax+ a n n 1

More information

Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point

Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point Gérard Cornuéjols 1 and Yanjun Li 2 1 Tepper School of Business, Carnegie Mellon

More information

MSRI Summer Graduate Workshop: Algebraic, Geometric, and Combinatorial Methods for Optimization. Part IV

MSRI Summer Graduate Workshop: Algebraic, Geometric, and Combinatorial Methods for Optimization. Part IV MSRI Summer Graduate Workshop: Algebraic, Geometric, and Combinatorial Methods for Optimization Part IV Geometry of Numbers and Rational Generating Function Techniques for Integer Programming Matthias

More information

Lecture 5. 1 Goermans-Williamson Algorithm for the maxcut problem

Lecture 5. 1 Goermans-Williamson Algorithm for the maxcut problem Math 280 Geometric and Algebraic Ideas in Optimization April 26, 2010 Lecture 5 Lecturer: Jesús A De Loera Scribe: Huy-Dung Han, Fabio Lapiccirella 1 Goermans-Williamson Algorithm for the maxcut problem

More information

Optimization of Submodular Functions Tutorial - lecture I

Optimization of Submodular Functions Tutorial - lecture I Optimization of Submodular Functions Tutorial - lecture I Jan Vondrák 1 1 IBM Almaden Research Center San Jose, CA Jan Vondrák (IBM Almaden) Submodular Optimization Tutorial 1 / 1 Lecture I: outline 1

More information

1 Solution of a Large-Scale Traveling-Salesman Problem... 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson

1 Solution of a Large-Scale Traveling-Salesman Problem... 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson Part I The Early Years 1 Solution of a Large-Scale Traveling-Salesman Problem............ 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson 2 The Hungarian Method for the Assignment Problem..............

More information

Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems

Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16:38 2001 Linear programming Optimization Problems General optimization problem max{z(x) f j (x) 0,x D} or min{z(x) f j (x) 0,x D}

More information

Copositive Programming and Combinatorial Optimization

Copositive Programming and Combinatorial Optimization Copositive Programming and Combinatorial Optimization Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria joint work with I.M. Bomze (Wien) and F. Jarre (Düsseldorf) IMA

More information

Real Symmetric Matrices and Semidefinite Programming

Real Symmetric Matrices and Semidefinite Programming Real Symmetric Matrices and Semidefinite Programming Tatsiana Maskalevich Abstract Symmetric real matrices attain an important property stating that all their eigenvalues are real. This gives rise to many

More information

Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane

Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane Alberto Del Pia Department of Industrial and Systems Engineering & Wisconsin Institutes for Discovery, University of Wisconsin-Madison

More information

Resource Constrained Project Scheduling Linear and Integer Programming (1)

Resource Constrained Project Scheduling Linear and Integer Programming (1) DM204, 2010 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 Resource Constrained Project Linear and Integer Programming (1) Marco Chiarandini Department of Mathematics & Computer Science University of Southern

More information

Umans Complexity Theory Lectures

Umans Complexity Theory Lectures Complexity Theory Umans Complexity Theory Lectures Lecture 1a: Problems and Languages Classify problems according to the computational resources required running time storage space parallelism randomness

More information

Copositive Programming and Combinatorial Optimization

Copositive Programming and Combinatorial Optimization Copositive Programming and Combinatorial Optimization Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria joint work with M. Bomze (Wien) and F. Jarre (Düsseldorf) and

More information

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations A notion of for Convex, Semidefinite and Extended Formulations Marcel de Carli Silva Levent Tunçel April 26, 2018 A vector in R n is integral if each of its components is an integer, A vector in R n is

More information

Commuting birth-and-death processes

Commuting birth-and-death processes Commuting birth-and-death processes Caroline Uhler Department of Statistics UC Berkeley (joint work with Steven N. Evans and Bernd Sturmfels) MSRI Workshop on Algebraic Statistics December 18, 2008 Birth-and-death

More information

Integer Programming. The focus of this chapter is on solution techniques for integer programming models.

Integer Programming. The focus of this chapter is on solution techniques for integer programming models. Integer Programming Introduction The general linear programming model depends on the assumption of divisibility. In other words, the decision variables are allowed to take non-negative integer as well

More information

Robust and Optimal Control, Spring 2015

Robust and Optimal Control, Spring 2015 Robust and Optimal Control, Spring 2015 Instructor: Prof. Masayuki Fujita (S5-303B) G. Sum of Squares (SOS) G.1 SOS Program: SOS/PSD and SDP G.2 Duality, valid ineqalities and Cone G.3 Feasibility/Optimization

More information

Lecture 1. Stochastic Optimization: Introduction. January 8, 2018

Lecture 1. Stochastic Optimization: Introduction. January 8, 2018 Lecture 1 Stochastic Optimization: Introduction January 8, 2018 Optimization Concerned with mininmization/maximization of mathematical functions Often subject to constraints Euler (1707-1783): Nothing

More information

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010 Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts

More information

Separation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1

Separation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1 : Some Observations Ted Ralphs 1 Joint work with: Aykut Bulut 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University MOA 2016, Beijing, China, 27 June 2016 What Is This Talk

More information

Multicommodity Flows and Column Generation

Multicommodity Flows and Column Generation Lecture Notes Multicommodity Flows and Column Generation Marc Pfetsch Zuse Institute Berlin pfetsch@zib.de last change: 2/8/2006 Technische Universität Berlin Fakultät II, Institut für Mathematik WS 2006/07

More information

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c

More information

Today: Linear Programming (con t.)

Today: Linear Programming (con t.) Today: Linear Programming (con t.) COSC 581, Algorithms April 10, 2014 Many of these slides are adapted from several online sources Reading Assignments Today s class: Chapter 29.4 Reading assignment for

More information

Integer Programming Duality

Integer Programming Duality Integer Programming Duality M. Guzelsoy T. K. Ralphs July, 2010 1 Introduction This article describes what is known about duality for integer programs. It is perhaps surprising that many of the results

More information

CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs. Instructor: Shaddin Dughmi

CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs. Instructor: Shaddin Dughmi CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs Instructor: Shaddin Dughmi Outline 1 Introduction 2 Shortest Path 3 Algorithms for Single-Source Shortest

More information

BCOL RESEARCH REPORT 07.04

BCOL RESEARCH REPORT 07.04 BCOL RESEARCH REPORT 07.04 Industrial Engineering & Operations Research University of California, Berkeley, CA 94720-1777 LIFTING FOR CONIC MIXED-INTEGER PROGRAMMING ALPER ATAMTÜRK AND VISHNU NARAYANAN

More information

Discrete Optimization 2010 Lecture 1 Introduction / Algorithms & Spanning Trees

Discrete Optimization 2010 Lecture 1 Introduction / Algorithms & Spanning Trees Discrete Optimization 2010 Lecture 1 Introduction / Algorithms & Spanning Trees Marc Uetz University of Twente m.uetz@utwente.nl Lecture 1: sheet 1 / 43 Marc Uetz Discrete Optimization Outline 1 Introduction

More information

A new family of facet defining inequalities for the maximum edge-weighted clique problem

A new family of facet defining inequalities for the maximum edge-weighted clique problem A new family of facet defining inequalities for the maximum edge-weighted clique problem Franklin Djeumou Fomeni June 2016 Abstract This paper considers a family of cutting planes, recently developed for

More information

Lecture Note 5: Semidefinite Programming for Stability Analysis

Lecture Note 5: Semidefinite Programming for Stability Analysis ECE7850: Hybrid Systems:Theory and Applications Lecture Note 5: Semidefinite Programming for Stability Analysis Wei Zhang Assistant Professor Department of Electrical and Computer Engineering Ohio State

More information

Department of Mathematics Comprehensive Examination Option I 2016 Spring. Algebra

Department of Mathematics Comprehensive Examination Option I 2016 Spring. Algebra Comprehensive Examination Option I Algebra 1. Let G = {τ ab : R R a, b R and a 0} be the group under the usual function composition, where τ ab (x) = ax + b, x R. Let R be the group of all nonzero real

More information

Roots and Coefficients Polynomials Preliminary Maths Extension 1

Roots and Coefficients Polynomials Preliminary Maths Extension 1 Preliminary Maths Extension Question If, and are the roots of x 5x x 0, find the following. (d) (e) Question If p, q and r are the roots of x x x 4 0, evaluate the following. pq r pq qr rp p q q r r p

More information

Section 0.2 & 0.3 Worksheet. Types of Functions

Section 0.2 & 0.3 Worksheet. Types of Functions MATH 1142 NAME Section 0.2 & 0.3 Worksheet Types of Functions Now that we have discussed what functions are and some of their characteristics, we will explore different types of functions. Section 0.2

More information

MATHEMATICAL ENGINEERING TECHNICAL REPORTS

MATHEMATICAL ENGINEERING TECHNICAL REPORTS MATHEMATICAL ENGINEERING TECHNICAL REPORTS Combinatorial Relaxation Algorithm for the Entire Sequence of the Maximum Degree of Minors in Mixed Polynomial Matrices Shun SATO (Communicated by Taayasu MATSUO)

More information

Convex optimization. Javier Peña Carnegie Mellon University. Universidad de los Andes Bogotá, Colombia September 2014

Convex optimization. Javier Peña Carnegie Mellon University. Universidad de los Andes Bogotá, Colombia September 2014 Convex optimization Javier Peña Carnegie Mellon University Universidad de los Andes Bogotá, Colombia September 2014 1 / 41 Convex optimization Problem of the form where Q R n convex set: min x f(x) x Q,

More information

Diophantine approximations and integer points of cones

Diophantine approximations and integer points of cones Diophantine approximations and integer points of cones Martin Henk Robert Weismantel Abstract The purpose of this note is to present a relation between directed best approximations of a rational vector

More information

Structural Grobner Basis. Bernd Sturmfels and Markus Wiegelmann TR May Department of Mathematics, UC Berkeley.

Structural Grobner Basis. Bernd Sturmfels and Markus Wiegelmann TR May Department of Mathematics, UC Berkeley. I 1947 Center St. Suite 600 Berkeley, California 94704-1198 (510) 643-9153 FAX (510) 643-7684 INTERNATIONAL COMPUTER SCIENCE INSTITUTE Structural Grobner Basis Detection Bernd Sturmfels and Markus Wiegelmann

More information

1 The linear algebra of linear programs (March 15 and 22, 2015)

1 The linear algebra of linear programs (March 15 and 22, 2015) 1 The linear algebra of linear programs (March 15 and 22, 2015) Many optimization problems can be formulated as linear programs. The main features of a linear program are the following: Variables are real

More information

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018 Section Notes 9 Midterm 2 Review Applied Math / Engineering Sciences 121 Week of December 3, 2018 The following list of topics is an overview of the material that was covered in the lectures and sections

More information

Geometric Steiner Trees

Geometric Steiner Trees Geometric Steiner Trees From the book: Optimal Interconnection Trees in the Plane By Marcus Brazil and Martin Zachariasen Part 3: Computational Complexity and the Steiner Tree Problem Marcus Brazil 2015

More information

Math 0312 EXAM 2 Review Questions

Math 0312 EXAM 2 Review Questions Name Decide whether the ordered pair is a solution of the given system. 1. 4x + y = 2 2x + 4y = -20 ; (2, -6) Solve the system by graphing. 2. x - y = 6 x + y = 16 Solve the system by substitution. If

More information

LINEAR PROGRAMMING II

LINEAR PROGRAMMING II LINEAR PROGRAMMING II LP duality strong duality theorem bonus proof of LP duality applications Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM LINEAR PROGRAMMING II LP duality Strong duality

More information

Submodular Functions Properties Algorithms Machine Learning

Submodular Functions Properties Algorithms Machine Learning Submodular Functions Properties Algorithms Machine Learning Rémi Gilleron Inria Lille - Nord Europe & LIFL & Univ Lille Jan. 12 revised Aug. 14 Rémi Gilleron (Mostrare) Submodular Functions Jan. 12 revised

More information

Notes on Dantzig-Wolfe decomposition and column generation

Notes on Dantzig-Wolfe decomposition and column generation Notes on Dantzig-Wolfe decomposition and column generation Mette Gamst November 11, 2010 1 Introduction This note introduces an exact solution method for mathematical programming problems. The method is

More information

Interior Point Methods for Mathematical Programming

Interior Point Methods for Mathematical Programming Interior Point Methods for Mathematical Programming Clóvis C. Gonzaga Federal University of Santa Catarina, Florianópolis, Brazil EURO - 2013 Roma Our heroes Cauchy Newton Lagrange Early results Unconstrained

More information

LMI Methods in Optimal and Robust Control

LMI Methods in Optimal and Robust Control LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 02: Optimization (Convex and Otherwise) What is Optimization? An Optimization Problem has 3 parts. x F f(x) :

More information

Approximate Optimal Designs for Multivariate Polynomial Regression

Approximate Optimal Designs for Multivariate Polynomial Regression Approximate Optimal Designs for Multivariate Polynomial Regression Fabrice Gamboa Collaboration with: Yohan de Castro, Didier Henrion, Roxana Hess, Jean-Bernard Lasserre Universität Potsdam 16th of February

More information

Lecture #21. c T x Ax b. maximize subject to

Lecture #21. c T x Ax b. maximize subject to COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the

More information

Chapter 1. Preliminaries

Chapter 1. Preliminaries Introduction This dissertation is a reading of chapter 4 in part I of the book : Integer and Combinatorial Optimization by George L. Nemhauser & Laurence A. Wolsey. The chapter elaborates links between

More information

Toric Varieties in Statistics

Toric Varieties in Statistics Toric Varieties in Statistics Daniel Irving Bernstein and Seth Sullivant North Carolina State University dibernst@ncsu.edu http://www4.ncsu.edu/~dibernst/ http://arxiv.org/abs/50.063 http://arxiv.org/abs/508.0546

More information

LECTURE 10 LECTURE OUTLINE

LECTURE 10 LECTURE OUTLINE LECTURE 10 LECTURE OUTLINE Min Common/Max Crossing Th. III Nonlinear Farkas Lemma/Linear Constraints Linear Programming Duality Convex Programming Duality Optimality Conditions Reading: Sections 4.5, 5.1,5.2,

More information

Research Reports on Mathematical and Computing Sciences

Research Reports on Mathematical and Computing Sciences ISSN 1342-284 Research Reports on Mathematical and Computing Sciences Exploiting Sparsity in Linear and Nonlinear Matrix Inequalities via Positive Semidefinite Matrix Completion Sunyoung Kim, Masakazu

More information

On the Relative Complexity of 15 Problems Related to 0/1-Integer Programming

On the Relative Complexity of 15 Problems Related to 0/1-Integer Programming On the Relative Complexity of 15 Problems Related to 0/1-Integer Programming Andreas S. Schulz Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139, schulz@mit.edu Summary.

More information

Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A.

Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A. . Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A. Nemirovski Arkadi.Nemirovski@isye.gatech.edu Linear Optimization Problem,

More information

Lecture 1: Introduction

Lecture 1: Introduction EE 227A: Convex Optimization and Applications January 17 Lecture 1: Introduction Lecturer: Anh Pham Reading assignment: Chapter 1 of BV 1. Course outline and organization Course web page: http://www.eecs.berkeley.edu/~elghaoui/teaching/ee227a/

More information

Integer Linear Programs

Integer Linear Programs Lecture 2: Review, Linear Programming Relaxations Today we will talk about expressing combinatorial problems as mathematical programs, specifically Integer Linear Programs (ILPs). We then see what happens

More information

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction U.C. Berkeley Handout N2 CS294: PCP and Hardness of Approximation January 23, 2006 Professor Luca Trevisan Scribe: Luca Trevisan Notes for Lecture 2 These notes are based on my survey paper [5]. L.T. Statement

More information

Linear and Integer Optimization (V3C1/F4C1)

Linear and Integer Optimization (V3C1/F4C1) Linear and Integer Optimization (V3C1/F4C1) Lecture notes Ulrich Brenner Research Institute for Discrete Mathematics, University of Bonn Winter term 2016/2017 March 8, 2017 12:02 1 Preface Continuous updates

More information

l p -Norm Constrained Quadratic Programming: Conic Approximation Methods

l p -Norm Constrained Quadratic Programming: Conic Approximation Methods OUTLINE l p -Norm Constrained Quadratic Programming: Conic Approximation Methods Wenxun Xing Department of Mathematical Sciences Tsinghua University, Beijing Email: wxing@math.tsinghua.edu.cn OUTLINE OUTLINE

More information

Approximation Basics

Approximation Basics Approximation Basics, Concepts, and Examples Xiaofeng Gao Department of Computer Science and Engineering Shanghai Jiao Tong University, P.R.China Fall 2012 Special thanks is given to Dr. Guoqiang Li for

More information

Section VI.33. Finite Fields

Section VI.33. Finite Fields VI.33 Finite Fields 1 Section VI.33. Finite Fields Note. In this section, finite fields are completely classified. For every prime p and n N, there is exactly one (up to isomorphism) field of order p n,

More information

A Sampling Kaczmarz-Motzkin Algorithm for Linear Feasibility

A Sampling Kaczmarz-Motzkin Algorithm for Linear Feasibility A Sampling Kaczmarz-Motzkin Algorithm for Linear Feasibility Jamie Haddock Graduate Group in Applied Mathematics, Department of Mathematics, University of California, Davis Copper Mountain Conference on

More information

Polyhedral Approach to Integer Linear Programming. Tepper School of Business Carnegie Mellon University, Pittsburgh

Polyhedral Approach to Integer Linear Programming. Tepper School of Business Carnegie Mellon University, Pittsburgh Polyhedral Approach to Integer Linear Programming Gérard Cornuéjols Tepper School of Business Carnegie Mellon University, Pittsburgh 1 / 30 Brief history First Algorithms Polynomial Algorithms Solving

More information

An Introduction to Proof Complexity, Part II.

An Introduction to Proof Complexity, Part II. An Introduction to Proof Complexity, Part II. Pavel Pudlák Mathematical Institute, Academy of Sciences, Prague and Charles University, Prague Computability in Europe 2009, Heidelberg 2 Overview Part I.

More information

Semidefinite Programming

Semidefinite Programming Semidefinite Programming Notes by Bernd Sturmfels for the lecture on June 26, 208, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra The transition from linear algebra to nonlinear algebra has

More information

Lecture 9: Dantzig-Wolfe Decomposition

Lecture 9: Dantzig-Wolfe Decomposition Lecture 9: Dantzig-Wolfe Decomposition (3 units) Outline Dantzig-Wolfe decomposition Column generation algorithm Relation to Lagrangian dual Branch-and-price method Generated assignment problem and multi-commodity

More information

Approximate Farkas Lemmas in Convex Optimization

Approximate Farkas Lemmas in Convex Optimization Approximate Farkas Lemmas in Convex Optimization Imre McMaster University Advanced Optimization Lab AdvOL Graduate Student Seminar October 25, 2004 1 Exact Farkas Lemma Motivation 2 3 Future plans The

More information

LEVEL MATRICES G. SEELINGER, P. SISSOKHO, L. SPENCE, AND C. VANDEN EYNDEN

LEVEL MATRICES G. SEELINGER, P. SISSOKHO, L. SPENCE, AND C. VANDEN EYNDEN LEVEL MATRICES G. SEELINGER, P. SISSOKHO, L. SPENCE, AND C. VANDEN EYNDEN Abstract. Let n > 1 and k > 0 be fixed integers. A matrix is said to be level if all its column sums are equal. A level matrix

More information

The P versus NP Problem. Ker-I Ko. Stony Brook, New York

The P versus NP Problem. Ker-I Ko. Stony Brook, New York The P versus NP Problem Ker-I Ko Stony Brook, New York ? P = NP One of the seven Millenium Problems The youngest one A folklore question? Has hundreds of equivalent forms Informal Definitions P : Computational

More information

Computability and Complexity Theory

Computability and Complexity Theory Discrete Math for Bioinformatics WS 09/10:, by A Bockmayr/K Reinert, January 27, 2010, 18:39 9001 Computability and Complexity Theory Computability and complexity Computability theory What problems can

More information

Cutting Plane Methods I

Cutting Plane Methods I 6.859/15.083 Integer Programming and Combinatorial Optimization Fall 2009 Cutting Planes Consider max{wx : Ax b, x integer}. Cutting Plane Methods I Establishing the optimality of a solution is equivalent

More information

Inverse Integer Linear Programs: Complexity and Computation

Inverse Integer Linear Programs: Complexity and Computation Inverse Integer Linear Programs: Complexity and Computation Aykut Bulut 1 Ted Ralphs 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University INFORMS Computing Society Conference,

More information

CHAPTER 2 POLYNOMIALS KEY POINTS

CHAPTER 2 POLYNOMIALS KEY POINTS CHAPTER POLYNOMIALS KEY POINTS 1. Polynomials of degrees 1, and 3 are called linear, quadratic and cubic polynomials respectively.. A quadratic polynomial in x with real coefficient is of the form a x

More information

C&O 355 Mathematical Programming Fall 2010 Lecture 2. N. Harvey

C&O 355 Mathematical Programming Fall 2010 Lecture 2. N. Harvey C&O 355 Mathematical Programming Fall 2010 Lecture 2 N. Harvey Outline LP definition & some equivalent forms Example in 2D Theorem: LPs have 3 possible outcomes Examples Linear regression, bipartite matching,

More information

Theory and Internet Protocols

Theory and Internet Protocols Game Lecture 2: Linear Programming and Zero Sum Nash Equilibrium Xiaotie Deng AIMS Lab Department of Computer Science Shanghai Jiaotong University September 26, 2016 1 2 3 4 Standard Form (P) Outline

More information

Algebraic Proof Systems

Algebraic Proof Systems Algebraic Proof Systems Pavel Pudlák Mathematical Institute, Academy of Sciences, Prague and Charles University, Prague Fall School of Logic, Prague, 2009 2 Overview 1 a survey of proof systems 2 a lower

More information

Recent Developments in Compressed Sensing

Recent Developments in Compressed Sensing Recent Developments in Compressed Sensing M. Vidyasagar Distinguished Professor, IIT Hyderabad m.vidyasagar@iith.ac.in, www.iith.ac.in/ m vidyasagar/ ISL Seminar, Stanford University, 19 April 2018 Outline

More information