Encodings in Mixed Integer Linear Programming

Size: px
Start display at page:

Download "Encodings in Mixed Integer Linear Programming"

Transcription

1 Encodings in Mixed Integer Linear Programming Juan Pablo Vielma Sloan School of usiness, Massachusetts Institute of Technology Universidad de hile, December, 23 Santiago, hile.

2 Mixed Integer er inary Formulations MIP Formulations = Model Finite lternatives x 2 n[ i= P i R d f(x,y) y x P i 2/29 9

3 Textbook Formulation f(d 3 ) f(d 2 ) f(d ) f(d 4 ) d d 2 d 3 d 4 Formulation for f(x)=z 4X 4X d i i = x, f(d i ) i = z i= 4X i= i= i =, i 3X y i =, y i 2 {, } apple y, 2 apple y + y 2 3 apple y 2 + y 3, 4 apple y 3 i= 3/29 9

4 Textbook Formulation f(d 3 ) f(d 2 ) f(d ) f(d 4 ) d d 2 d 3 d 4 Formulation for f(x)=z 4X 4X d i i = x, f(d i ) i = z i= i= 4X i= i= i =, i 3X y i =, y i 2 {, } Weak apple y, 2 apple y + y 2 3 apple y 2 + y 3, 4 apple y 3 3/29 9

5 etter Formulation f(d 3 ) f(d 2 ) f(d ) f(d 4 ) d d 2 d 3 d 4 Formulation for f(x)=z f(d )+ 3X d + (d i+ d i ) i = x, i= 3X (f(d i+ ) f(d i )) i = z i= 3 apple y 2 apple 2 apple y apple y i 2{, } 4/299

6 etter Formulation f(d 3 ) f(d 2 ) f(d ) f(d 4 ) d d 2 d 3 d 4 Formulation for f(x)=z f(d )+ 3X d + (d i+ d i ) i = x, i= 3X (f(d i+ ) i= f(d i )) i = z Integral 3 apple y 2 apple 2 apple y apple y i 2{, } 4/299

7 Solve Times in PLEX Weak Strong Mystery Transportation Problems in V., hmed and Nemhauser. 5/29 9

8 Solve Times in PLEX Weak Strong Mystery 2 s 5 s s s s Transportation Problems in V., hmed and Nemhauser. 5/29 9

9 Solve Times in PLEX Weak Strong Mystery 2 s 5 s s s s Transportation Problems in V., hmed and Nemhauser. 5/29 9

10 Outline MIP v/s constraint branching. Have your cake and eat it too formulation Step : Encoding alternatives. Step 2: ombine with strong standard formulation. Summary, Extensions and More. 6/299

11 MIP v/s constraint branching Formulating Discrete lternatives min s.t. x x 2 { i } n i= /29 9

12 MIP v/s constraint branching Formulating Discrete lternatives min x min x s.t. s.t. Xn x 2 { i } n i= i= X n i= i i = x i = 2 {, } n /29 9

13 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n 8/29 9

14 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n 8/29 9

15 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i i = x i = 2 {, } n + i= IP opt =, LP opt = 8/29 9

16 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by binary ranch-and-ound: 8/29 9

17 MIP v/s constraint branching Formulating Discrete lternatives min x Solve by binary ranch-and-ound: ranch on 2 s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = 8/29 9

18 MIP v/s constraint branching Formulating Discrete lternatives min x + s.t. Xn i= X n i= i i = x 2 =! Feasible with x = ranch on 2 i = 2 {, } n IP opt =, LP opt = Solve by binary ranch-and-ound: 8/29 9

19 MIP v/s constraint branching Formulating Discrete lternatives min x + s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by binary ranch-and-ound: 2 =! Feasible with x = ranch on 2 2 =! est ound = 8/29 9

20 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i i = x i = 2 {, } n + i= IP opt =, LP opt = Solve by binary ranch-and-ound: 2 =! Feasible with x = ranch on 2 2 =! est ound = ranch on 2, 4, 5! est ound = 8/29 9

21 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by binary ranch-and-ound: Worst case: n/2 branches to solve (i.e. 2 n/2 -and- nodes!). 8/29 9

22 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by constraint -and-: /29

23 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by constraint -and-: ranch on + 2 /29

24 MIP v/s constraint branching Formulating Discrete lternatives min x + s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by constraint -and-: ranch on =! Feasible with x = /29

25 MIP v/s constraint branching Formulating Discrete lternatives min x + s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by constraint -and-: + 2 =! Feasible with x = ranch on =! Feasible with x = /29

26 MIP v/s constraint branching Formulating Discrete lternatives min x s.t. Xn i= X n i= i i = x i = 2 {, } n IP opt =, LP opt = Solve by constraint -and-: ranch on =! Feasible with x = + 2 =! Feasible with x = Never more than one branch (2 nodes). /29

27 MIP v/s constraint branching onstraint ranching is the Solution? Ryan and Foster, 98. Discrete lternatives: SOS branching of eale and Tomlin 97. lso SOS2 (. and T, 7) and piecewise linear functions (Tomlin 98). SOS: X t i= i = or m X t i= i = i = 8i >t or i = 8i apple t Problem: Need to re-implement advanced branching selection (e.g. pseudocost ). /29 9

28 MIP v/s constraint branching inary v/s Specialized ranching Weak Integer SOS2 ranching Mystery Integer /299

29 MIP v/s constraint branching inary v/s Specialized ranching PLEX 9: asic SOS2 branching implementation (graph from Nemhauser, Keha and V. 8) Med. Large 5 s 2.5 s 75 s 37.5 s s Weak Integer SOS2 ranching Mystery Integer /299

30 MIP v/s constraint branching inary v/s Specialized ranching PLEX 9: asic SOS2 branching implementation (graph from Nemhauser, Keha and V. 8) Med. Large 5 s 2.5 s 75 s 37.5 s s PLEX : Improved SOS2 branching implementation (graph from Nemhauser, hmed and V. ) , s,5 s, s 5 s s Weak Integer SOS2 ranching Mystery Integer /299

31 MIP v/s constraint branching inary v/s Specialized ranching PLEX 9: asic SOS2 branching implementation (graph from Nemhauser, Keha and V. 8) Med. Large 5 s 2.5 s 75 s 37.5 s s PLEX : Improved SOS2 branching implementation (graph from Nemhauser, hmed and V. ) , s,5 s, s 5 s s Weak Integer SOS2 ranching Mystery Integer /299

32 Formulation Step : Encoding lternatives

33 Step : Encodings Formulation for Discrete lternatives Li and Lu 29, dams and Henry 2, V. and Nemhauser 28. Sommer, TIMS 972. b i n Log = inary Encoding Other choices of lead to standard and b i n i= incremental formulations i= = {, }log 2 n 9 3/29

34 Step : Encodings Formulation for Discrete lternatives Li and Lu 29, dams and Henry 2, V. and Nemhauser 28. Sommer, TIMS 972. b i n Log = inary Encoding Other choices of lead to standard and b i n i= incremental formulations i= = {, }log 2 n 9 3/29

35 Step : Encodings Unary Encoding = y, X 8 i= i =, 2 R 8,y2 {, } 8 m i = y i 4/299

36 Step : Encodings inary Encoding = y, X 8 i= i =, 2 R 8,y2 {, } 3 5/299

37 Step : Encodings Incremental Encoding = y, X 8 i= i =, 2 R 8,y2 {, } 7 + y y 2... y 7 6/299

38 Step : Encodings Example: Unary Encoding min x s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m 7/299

39 Step : Encodings Example: Unary Encoding min x s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m 7/299

40 Step : Encodings Example: Unary Encoding min x + s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m 7/299

41 Step : Encodings Example: Unary Encoding min x = y y 2 y 3 y 4 s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m 7/299

42 Step : Encodings Example: Unary Encoding min x s.t. Xn = y = y y 2 y 3 y 4 i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m 7/299

43 Step : Encodings Example: Unary Encoding min x s.t. Xn = y y 2 y 3 y 4 i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m y = 7/299

44 Step : Encodings Example: Unary Encoding min x s.t. Xn = y y 2 y 3 y 4 i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m y = 7/299

45 Step : Encodings Example: Unary Encoding min x = y y 2 y 3 y 4 s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m y = y 4 = 7/299

46 Step : Encodings Example: Unary Encoding min x = y y 2 y 3 y 4 s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m y = y 4 = 7/299

47 Step : Encodings Example: Unary Encoding min x ( ( = n/2 n/2 y y 2 y 3 y 4 s.t. Xn i= X n X n i= i i = x i = i= bi i = y 2 R n + y 2 {, } m Need n/2 branches 7/299

48 Step : Encodings Example: inary Encoding (... 2 k = y y 2 y 3 8/299

49 Step : Encodings Example: inary Encoding (... 2 k = y y 2 y 3 y = y 2 = 8/299

50 Step : Encodings Example: inary Encoding est ound = unless: y i = 8i (... 2 k = y y 2 y 3 y = y 2 = 8/299

51 Step : Encodings Example: inary Encoding est ound = unless: y i = 8i Need k = log 2 n... = y y 2 y 3 branches (n nodes) ( 2 k y = y 2 = 8/299

52 Step : Encodings Example: Incremental Encoding 9/299

53 9 Step : Encodings Example: Incremental Encoding 9/29 = y y 2 y 3 y 4

54 9 Step : Encodings Example: Incremental Encoding 9/29 = y y 2 y 3 y 4 y 3 =_ y 3 = =

55 y i =_ y i = Only need branch! est ound = if: 9 Step : Encodings Example: Incremental Encoding 9/29 = y y 2 y 3 y 4 y 3 =_ y 3 = =

56 Step : Encodings Induced onstraint ranching Incremental = y inary = y 2/299

57 Step : Encodings Induced onstraint ranching Incremental = y SOS ranching! = 2 = or 3 = 4 = inary = y 2/299

58 Step : Encodings Induced onstraint ranching Incremental SOS ranching = y! = 2 = or 3 = 4 = inary SOS ranching = y! = 2 = or 3 = 4 = 2/299

59 Step : Encodings Induced onstraint ranching Incremental SOS ranching = y! = 2 = or 3 = 4 = inary Odd/Even ranching = y! = 3 = or 2 = 4 = 2/299

60 Formulation Step 2: ombining with Strong Formulation

61 Step 2: Strong Formulation Long Lost Integral Formulation P i n i= polytopes x 2 n[ i= P i, lso for general polyhedra with common recession cones. nx i= X v2ext(p i ) X v2ext(p i ) v i v = x i v = nx y i = i= n y 2 {, }, y i i v Jeroslow and Lowe /299

62 Step 2: Strong Formulation ombining with lternative Encoding P i n i= polytopes x 2 n[ i= P i, lso for general polyhedra with common recession cones. nx i= X v2ext(p i ) X v2ext(p i ) v i v = x i v = nx y i = i= n y 2 {, }, y i i v Jeroslow and Lowe /299

63 Step 2: Strong Formulation ombining with lternative Encoding P i n i= polytopes x 2 n[ i= P i, lso for general polyhedra with common recession cones. nx i= nx i= nx i= X v2ext(p i ) X v2ext(p i ) X v i v = x nx v2ext(p i i= ) m y 2 {, }, b i i v = i v y i = y i v Jeroslow and Lowe /299

64 Step 2: Strong Formulation ombining with lternative Encoding P i n i= polytopes x 2 n[ i= P i, lso for general polyhedra with common recession cones. nx i= nx i= nx i= X v2ext(p i ) X v2ext(p i ) X v i v = x nx v2ext(p i i= ) m y 2 {, }, b i i v = i v y i = y i v V., hmed and Nemhauser 2; V /299

65 Step 2: Strong Formulation Univariate Transportation Problems Discontinuous Piecewise Linear Disc. PWL + Semicontinuous 25/299

66 Step 2: Strong Formulation Piecewise Linear Unary Incremental / Strong Integer inary / Mystery Integer 26/299

67 Step 2: Strong Formulation Piecewise Linear Unary Incremental / Strong Integer inary / Mystery Integer 26/299

68 Step 2: Strong Formulation Piecewise Linear + Semi ontinuous Unary Incremental / Strong Integer inary / Mystery Integer 27/299

69 Summary, Extensions and More. Effective formulations: Encode and Formulate est encoding? Why not try a few. lever combination of encodings can be useful (e.g. V. and Nemhauser 28 for multivariate piecewise linear functions) Smaller formulations for shared vertex case Need encodings with special structure. 28/29

70 More Information 29/299

71 More Information Survey: V., MIP Formulation Techniques : 29/299

72 More Information Survey: V., MIP Formulation Techniques : Next year: automatic formulations for JUMP Julia based modeling language: s simple as MPL + faster than ++ Solver independent call-backs and more! JUMP/Julia tutorial in January 29/29 9

Incremental Formulations for SOS1 Variables

Incremental Formulations for SOS1 Variables Incremental Formulations for SOS Variables Juan Pablo Vielma Massachusetts Institute of Technology joint work with Sercan Yıldız arnegie Mellon University INFORMS nnual Meeting, October 22 Phoenix, rizona

More information

Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions

Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions Juan Pablo Vielma H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Joint

More information

Mixed Integer Programming (MIP) for Causal Inference and Beyond

Mixed Integer Programming (MIP) for Causal Inference and Beyond Mixed Integer Programming (MIP) for Causal Inference and Beyond Juan Pablo Vielma Massachusetts Institute of Technology Columbia Business School New York, NY, October, 2016. Traveling Salesman Problem

More information

Advanced Mixed Integer Programming (MIP) Formulation Techniques

Advanced Mixed Integer Programming (MIP) Formulation Techniques Advanced Mixed Integer Programming (MIP) Formulation Techniques Juan Pablo Vielma Massachusetts Institute of Technology Center for Nonlinear Studies, Los Alamos National Laboratory. Los Alamos, New Mexico,

More information

Embedding Formulations and Complexity for Unions of Polyhedra

Embedding Formulations and Complexity for Unions of Polyhedra Embedding Formulations and Complexity for Unions of Polyhedra Juan Pablo Vielma Sloan School of Management, Massachusetts Institute of Technology, jvielma@mit.edu It is well known that selecting a good

More information

A note on : A Superior Representation Method for Piecewise Linear Functions

A note on : A Superior Representation Method for Piecewise Linear Functions A note on : A Superior Representation Method for Piecewise Linear Functions Juan Pablo Vielma Business Analytics and Mathematical Sciences Department, IBM T. J. Watson Research Center, Yorktown Heights,

More information

Modeling Disjunctive Constraints with a Logarithmic Number of Binary Variables and Constraints

Modeling Disjunctive Constraints with a Logarithmic Number of Binary Variables and Constraints Modeling Disjunctive Constraints with a Logarithmic Number of Binary Variables and Constraints Juan Pablo Vielma and George L. Nemhauser H. Milton Stewart School of Industrial and Systems Engineering,

More information

Solving LP and MIP Models with Piecewise Linear Objective Functions

Solving LP and MIP Models with Piecewise Linear Objective Functions Solving LP and MIP Models with Piecewise Linear Obective Functions Zonghao Gu Gurobi Optimization Inc. Columbus, July 23, 2014 Overview } Introduction } Piecewise linear (PWL) function Convex and convex

More information

Advanced Mixed Integer Programming Formulations for Non-Convex Optimization Problems in Statistical Learning

Advanced Mixed Integer Programming Formulations for Non-Convex Optimization Problems in Statistical Learning Advanced Mixed Integer Programming Formulations for Non-Convex Optimization Problems in Statistical Learning Juan Pablo Vielma Massachusetts Institute of Technology 2016 IISA International Conference on

More information

A note on : A Superior Representation Method for Piecewise Linear Functions by Li, Lu, Huang and Hu

A note on : A Superior Representation Method for Piecewise Linear Functions by Li, Lu, Huang and Hu A note on : A Superior Representation Method for Piecewise Linear Functions by Li, Lu, Huang and Hu Juan Pablo Vielma, Shabbir Ahmed and George Nemhauser H. Milton Stewart School of Industrial and Systems

More information

Modeling Disjunctive Constraints with a Logarithmic Number of Binary Variables and Constraints

Modeling Disjunctive Constraints with a Logarithmic Number of Binary Variables and Constraints Noname manuscript No. (will be inserted by the editor) Modeling Disjunctive Constraints with a Logarithmic Number of Binary Variables and Constraints Juan Pablo Vielma George L. Nemhauser the date of receipt

More information

Mixed Integer Programming (MIP) for Daily Fantasy Sports, Statistics and Marketing

Mixed Integer Programming (MIP) for Daily Fantasy Sports, Statistics and Marketing Mixed Integer Programming (MIP) for Daily Fantasy Sports, Statistics and Marketing Juan Pablo Vielma Massachusetts Institute of Technology AM/ES 121, SEAS, Harvard. Boston, MA, November, 2016. MIP & Daily

More information

Integer Programming. Wolfram Wiesemann. December 6, 2007

Integer Programming. Wolfram Wiesemann. December 6, 2007 Integer Programming Wolfram Wiesemann December 6, 2007 Contents of this Lecture Revision: Mixed Integer Programming Problems Branch & Bound Algorithms: The Big Picture Solving MIP s: Complete Enumeration

More information

Mixed Integer Linear Programming Formulation Techniques

Mixed Integer Linear Programming Formulation Techniques SIAM REVIEW Vol. 57, No. 1, pp. 3 57 c 215 Society for Industrial and Applied Mathematics Mixed Integer Linear Programming Formulation Techniques Juan Pablo Vielma Abstract. A wide range of problems can

More information

Cutting Planes and Elementary Closures for Non-linear Integer Programming

Cutting Planes and Elementary Closures for Non-linear Integer Programming Cutting Planes and Elementary Closures for Non-linear Integer Programming Juan Pablo Vielma University of Pittsburgh joint work with D. Dadush and S. S. Dey S. Modaresi and M. Kılınç Georgia Institute

More information

Split Cuts for Convex Nonlinear Mixed Integer Programming

Split Cuts for Convex Nonlinear Mixed Integer Programming Split Cuts for Convex Nonlinear Mixed Integer Programming Juan Pablo Vielma Massachusetts Institute of Technology joint work with D. Dadush and S. S. Dey S. Modaresi and M. Kılınç Georgia Institute of

More information

Possible logic functions of two variables

Possible logic functions of two variables ombinational logic asic logic oolean algebra, proofs by re-writing, proofs by perfect induction logic functions, truth tables, and switches NOT, ND, OR, NND, NOR, OR,..., minimal set Logic realization

More information

Algorithms. Outline! Approximation Algorithms. The class APX. The intelligence behind the hardware. ! Based on

Algorithms. Outline! Approximation Algorithms. The class APX. The intelligence behind the hardware. ! Based on 6117CIT - Adv Topics in Computing Sci at Nathan 1 Algorithms The intelligence behind the hardware Outline! Approximation Algorithms The class APX! Some complexity classes, like PTAS and FPTAS! Illustration

More information

MIXED INTEGER PROGRAMMING APPROACHES FOR NONLINEAR AND STOCHASTIC PROGRAMMING

MIXED INTEGER PROGRAMMING APPROACHES FOR NONLINEAR AND STOCHASTIC PROGRAMMING MIXED INTEGER PROGRAMMING APPROACHES FOR NONLINEAR AND STOCHASTIC PROGRAMMING A Thesis Presented to The Academic Faculty by Juan Pablo Vielma Centeno In Partial Fulfillment of the Requirements for the

More information

Math Models of OR: Branch-and-Bound

Math Models of OR: Branch-and-Bound Math Models of OR: Branch-and-Bound John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA November 2018 Mitchell Branch-and-Bound 1 / 15 Branch-and-Bound Outline 1 Branch-and-Bound

More information

Ellipsoidal Methods for Adaptive Choice-based Conjoint Analysis (CBCA)

Ellipsoidal Methods for Adaptive Choice-based Conjoint Analysis (CBCA) Ellipsoidal Methods for Adaptive Choice-based Conjoint Analysis (CBCA) Juan Pablo Vielma Massachusetts Institute of Technology Joint work with Denis Saure Operations Management Seminar, Rotman School of

More information

Lift-and-Project Inequalities

Lift-and-Project Inequalities Lift-and-Project Inequalities Q. Louveaux Abstract The lift-and-project technique is a systematic way to generate valid inequalities for a mixed binary program. The technique is interesting both on the

More information

15.081J/6.251J Introduction to Mathematical Programming. Lecture 24: Discrete Optimization

15.081J/6.251J Introduction to Mathematical Programming. Lecture 24: Discrete Optimization 15.081J/6.251J Introduction to Mathematical Programming Lecture 24: Discrete Optimization 1 Outline Modeling with integer variables Slide 1 What is a good formulation? Theme: The Power of Formulations

More information

Recent Advances in Mixed Integer Programming Modeling and Computation

Recent Advances in Mixed Integer Programming Modeling and Computation Recent Advances in Mixed Integer Programming Modeling and Computation Juan Pablo Vielma Massachusetts Institute of Technology MIT Center for Transportation & Logistics. Cambridge, Massachusetts, June,

More information

Integer Programming ISE 418. Lecture 13. Dr. Ted Ralphs

Integer Programming ISE 418. Lecture 13. Dr. Ted Ralphs Integer Programming ISE 418 Lecture 13 Dr. Ted Ralphs ISE 418 Lecture 13 1 Reading for This Lecture Nemhauser and Wolsey Sections II.1.1-II.1.3, II.1.6 Wolsey Chapter 8 CCZ Chapters 5 and 6 Valid Inequalities

More information

Stochastic Decision Diagrams

Stochastic Decision Diagrams Stochastic Decision Diagrams John Hooker CORS/INFORMS Montréal June 2015 Objective Relaxed decision diagrams provide an generalpurpose method for discrete optimization. When the problem has a dynamic programming

More information

Travelling Salesman Problem

Travelling Salesman Problem Travelling Salesman Problem Fabio Furini November 10th, 2014 Travelling Salesman Problem 1 Outline 1 Traveling Salesman Problem Separation Travelling Salesman Problem 2 (Asymmetric) Traveling Salesman

More information

PART 4 INTEGER PROGRAMMING

PART 4 INTEGER PROGRAMMING PART 4 INTEGER PROGRAMMING 102 Read Chapters 11 and 12 in textbook 103 A capital budgeting problem We want to invest $19 000 Four investment opportunities which cannot be split (take it or leave it) 1.

More information

A Polyhedral Study of the Semi-Continuous Knapsack Problem

A Polyhedral Study of the Semi-Continuous Knapsack Problem A Polyhedral Study of the Semi-Continuous Knapsack Problem Ismael Regis de Farias JR. Department of Industrial Engineering, Texas Tech University, ismael.de-farias@ttu.edu Ming Zhao SAS, ming.zhao@sas.com

More information

CHAPTER 3: INTEGER PROGRAMMING

CHAPTER 3: INTEGER PROGRAMMING CHAPTER 3: INTEGER PROGRAMMING Overview To this point, we have considered optimization problems with continuous design variables. That is, the design variables can take any value within a continuous feasible

More information

Integer Programming. The focus of this chapter is on solution techniques for integer programming models.

Integer Programming. The focus of this chapter is on solution techniques for integer programming models. Integer Programming Introduction The general linear programming model depends on the assumption of divisibility. In other words, the decision variables are allowed to take non-negative integer as well

More information

Search Algorithms. Analysis of Algorithms. John Reif, Ph.D. Prepared by

Search Algorithms. Analysis of Algorithms. John Reif, Ph.D. Prepared by Search Algorithms Analysis of Algorithms Prepared by John Reif, Ph.D. Search Algorithms a) Binary Search: average case b) Interpolation Search c) Unbounded Search (Advanced material) Readings Reading Selection:

More information

Computational Integer Programming Universidad de los Andes. Lecture 1. Dr. Ted Ralphs

Computational Integer Programming Universidad de los Andes. Lecture 1. Dr. Ted Ralphs Computational Integer Programming Universidad de los Andes Lecture 1 Dr. Ted Ralphs MIP Lecture 1 1 Quick Introduction Bio Course web site Course structure http://coral.ie.lehigh.edu/ ted/teaching/mip

More information

Separation Techniques for Constrained Nonlinear 0 1 Programming

Separation Techniques for Constrained Nonlinear 0 1 Programming Separation Techniques for Constrained Nonlinear 0 1 Programming Christoph Buchheim Computer Science Department, University of Cologne and DEIS, University of Bologna MIP 2008, Columbia University, New

More information

Lecture 9: Dantzig-Wolfe Decomposition

Lecture 9: Dantzig-Wolfe Decomposition Lecture 9: Dantzig-Wolfe Decomposition (3 units) Outline Dantzig-Wolfe decomposition Column generation algorithm Relation to Lagrangian dual Branch-and-price method Generated assignment problem and multi-commodity

More information

Integer program reformulation for robust branch-and-cut-and-price

Integer program reformulation for robust branch-and-cut-and-price Integer program reformulation for robust branch-and-cut-and-price Marcus Poggi de Aragão Informática PUC-Rio Eduardo Uchoa Engenharia de Produção Universidade Federal Fluminense Outline of the talk Robust

More information

Integer and Combinatorial Optimization: Introduction

Integer and Combinatorial Optimization: Introduction Integer and Combinatorial Optimization: Introduction John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA November 2018 Mitchell Introduction 1 / 18 Integer and Combinatorial Optimization

More information

Mixed Integer Programming Approaches for Experimental Design

Mixed Integer Programming Approaches for Experimental Design Mixed Integer Programming Approaches for Experimental Design Juan Pablo Vielma Massachusetts Institute of Technology Joint work with Denis Saure DRO brown bag lunch seminars, Columbia Business School New

More information

Mixed Integer Linear Programming Formulations for Probabilistic Constraints

Mixed Integer Linear Programming Formulations for Probabilistic Constraints Mixed Integer Linear Programming Formulations for Probabilistic Constraints J. P. Vielma a,, S. Ahmed b, G. Nemhauser b a Department of Industrial Engineering, University of Pittsburgh 1048 Benedum Hall,

More information

The Value function of a Mixed-Integer Linear Program with a Single Constraint

The Value function of a Mixed-Integer Linear Program with a Single Constraint The Value Function of a Mixed Integer Linear Programs with a Single Constraint MENAL GUZELSOY TED RALPHS ISE Department COR@L Lab Lehigh University tkralphs@lehigh.edu OPT 008, Atlanta, March 4, 008 Thanks:

More information

Theory and Internet Protocols

Theory and Internet Protocols Game Lecture 2: Linear Programming and Zero Sum Nash Equilibrium Xiaotie Deng AIMS Lab Department of Computer Science Shanghai Jiaotong University September 26, 2016 1 2 3 4 Standard Form (P) Outline

More information

Cutting Planes in SCIP

Cutting Planes in SCIP Cutting Planes in SCIP Kati Wolter Zuse-Institute Berlin Department Optimization Berlin, 6th June 2007 Outline 1 Cutting Planes in SCIP 2 Cutting Planes for the 0-1 Knapsack Problem 2.1 Cover Cuts 2.2

More information

Mathematical Programming Formulations for Piecewise Polynomial Functions

Mathematical Programming Formulations for Piecewise Polynomial Functions Noname manuscript No. (will be inserted by the editor) Mathematical Programming Formulations for Piecewise Polynomial Functions Bjarne Grimstad Brage Rugstad Knudsen Received: date / Accepted: date Abstract

More information

Split Cuts for Convex Nonlinear Mixed Integer Programming

Split Cuts for Convex Nonlinear Mixed Integer Programming Split Cuts for Convex Nonlinear Mixed Integer Programming Juan Pablo Vielma University of Pittsburgh joint work with D. Dadush and S. S. Dey S. Modaresi and M. Kılınç Georgia Institute of Technology University

More information

Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks

Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks E. Wanufelle 1 S. Leyffer 2 A. Sartenaer 1 Ph. Toint 1 1 FUNDP, University of Namur 2

More information

Integer Programming, Constraint Programming, and their Combination

Integer Programming, Constraint Programming, and their Combination Integer Programming, Constraint Programming, and their Combination Alexander Bockmayr Freie Universität Berlin & DFG Research Center Matheon Eindhoven, 27 January 2006 Discrete Optimization General framework

More information

Reconnect 04 Introduction to Integer Programming

Reconnect 04 Introduction to Integer Programming Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, Reconnect 04 Introduction to Integer Programming Cynthia Phillips, Sandia National Laboratories Integer programming

More information

Lifting for conic mixed-integer programming

Lifting for conic mixed-integer programming Math. Program., Ser. A DOI 1.17/s117-9-282-9 FULL LENGTH PAPER Lifting for conic mixed-integer programming Alper Atamtürk Vishnu Narayanan Received: 13 March 28 / Accepted: 28 January 29 The Author(s)

More information

Computing with multi-row Gomory cuts

Computing with multi-row Gomory cuts Computing with multi-row Gomory cuts Daniel G. Espinoza Departamento de Ingeniería Industrial, Universidad de Chile, Av. República 71, Santiago, 837-439, Chile Abstract Recent advances on the understanding

More information

of a bimatrix game David Avis McGill University Gabriel Rosenberg Yale University Rahul Savani University of Warwick

of a bimatrix game David Avis McGill University Gabriel Rosenberg Yale University Rahul Savani University of Warwick Finding all Nash equilibria of a bimatrix game David Avis McGill University Gabriel Rosenberg Yale University Rahul Savani University of Warwick Bernhard von Stengel London School of Economics Nash equilibria

More information

SOLVING INTEGER LINEAR PROGRAMS. 1. Solving the LP relaxation. 2. How to deal with fractional solutions?

SOLVING INTEGER LINEAR PROGRAMS. 1. Solving the LP relaxation. 2. How to deal with fractional solutions? SOLVING INTEGER LINEAR PROGRAMS 1. Solving the LP relaxation. 2. How to deal with fractional solutions? Integer Linear Program: Example max x 1 2x 2 0.5x 3 0.2x 4 x 5 +0.6x 6 s.t. x 1 +2x 2 1 x 1 + x 2

More information

The Ellipsoid Algorithm

The Ellipsoid Algorithm The Ellipsoid Algorithm John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA 9 February 2018 Mitchell The Ellipsoid Algorithm 1 / 28 Introduction Outline 1 Introduction 2 Assumptions

More information

Integer Programming ISE 418. Lecture 8. Dr. Ted Ralphs

Integer Programming ISE 418. Lecture 8. Dr. Ted Ralphs Integer Programming ISE 418 Lecture 8 Dr. Ted Ralphs ISE 418 Lecture 8 1 Reading for This Lecture Wolsey Chapter 2 Nemhauser and Wolsey Sections II.3.1, II.3.6, II.4.1, II.4.2, II.5.4 Duality for Mixed-Integer

More information

16.410/413 Principles of Autonomy and Decision Making

16.410/413 Principles of Autonomy and Decision Making 6.4/43 Principles of Autonomy and Decision Making Lecture 8: (Mixed-Integer) Linear Programming for Vehicle Routing and Motion Planning Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute

More information

The structure of the infinite models in integer programming

The structure of the infinite models in integer programming The structure of the infinite models in integer programming January 10, 2017 Not Again! Well, Aussois is partly responsible... Some years ago: Not Again! Well, Aussois is partly responsible... Some years

More information

Disconnecting Networks via Node Deletions

Disconnecting Networks via Node Deletions 1 / 27 Disconnecting Networks via Node Deletions Exact Interdiction Models and Algorithms Siqian Shen 1 J. Cole Smith 2 R. Goli 2 1 IOE, University of Michigan 2 ISE, University of Florida 2012 INFORMS

More information

Meta-heuristics for combinatorial optimisation

Meta-heuristics for combinatorial optimisation Meta-heuristics for combinatorial optimisation João Pedro Pedroso Centro de Investigação Operacional Faculdade de Ciências da Universidade de Lisboa and Departamento de Ciência de Computadores Faculdade

More information

Computational Complexity

Computational Complexity Computational Complexity Algorithm performance and difficulty of problems So far we have seen problems admitting fast algorithms flow problems, shortest path, spanning tree... and other problems for which

More information

A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization

A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization Sven Leyffer 2 Annick Sartenaer 1 Emilie Wanufelle 1 1 University of Namur, Belgium 2 Argonne National Laboratory, USA IMA Workshop,

More information

23. Cutting planes and branch & bound

23. Cutting planes and branch & bound CS/ECE/ISyE 524 Introduction to Optimization Spring 207 8 23. Cutting planes and branch & bound ˆ Algorithms for solving MIPs ˆ Cutting plane methods ˆ Branch and bound methods Laurent Lessard (www.laurentlessard.com)

More information

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs Computational Integer Programming Lecture 2: Modeling and Formulation Dr. Ted Ralphs Computational MILP Lecture 2 1 Reading for This Lecture N&W Sections I.1.1-I.1.6 Wolsey Chapter 1 CCZ Chapter 2 Computational

More information

Lecture 19: Interactive Proofs and the PCP Theorem

Lecture 19: Interactive Proofs and the PCP Theorem Lecture 19: Interactive Proofs and the PCP Theorem Valentine Kabanets November 29, 2016 1 Interactive Proofs In this model, we have an all-powerful Prover (with unlimited computational prover) and a polytime

More information

Extended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications

Extended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications Extended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications François Vanderbeck University of Bordeaux INRIA Bordeaux-Sud-Ouest part : Defining Extended Formulations

More information

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs Integer Programming ISE 418 Lecture 12 Dr. Ted Ralphs ISE 418 Lecture 12 1 Reading for This Lecture Nemhauser and Wolsey Sections II.2.1 Wolsey Chapter 9 ISE 418 Lecture 12 2 Generating Stronger Valid

More information

Resource Constrained Project Scheduling Linear and Integer Programming (1)

Resource Constrained Project Scheduling Linear and Integer Programming (1) DM204, 2010 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 Resource Constrained Project Linear and Integer Programming (1) Marco Chiarandini Department of Mathematics & Computer Science University of Southern

More information

Optimization Bounds from Binary Decision Diagrams

Optimization Bounds from Binary Decision Diagrams Optimization Bounds from Binary Decision Diagrams J. N. Hooker Joint work with David Bergman, André Ciré, Willem van Hoeve Carnegie Mellon University ICS 203 Binary Decision Diagrams BDDs historically

More information

Linear integer programming and its application

Linear integer programming and its application Linear integer programming and its application Presented by Dr. Sasthi C. Ghosh Associate Professor Advanced Computing & Microelectronics Unit Indian Statistical Institute Kolkata, India Outline Introduction

More information

Novel update techniques for the revised simplex method (and their application)

Novel update techniques for the revised simplex method (and their application) Novel update techniques for the revised simplex method (and their application) Qi Huangfu 1 Julian Hall 2 Others 1 FICO 2 School of Mathematics, University of Edinburgh ERGO 30 November 2016 Overview Background

More information

Network Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini

Network Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini In the name of God Network Flows 6. Lagrangian Relaxation 6.3 Lagrangian Relaxation and Integer Programming Fall 2010 Instructor: Dr. Masoud Yaghini Integer Programming Outline Branch-and-Bound Technique

More information

Solving Mixed-Integer Nonlinear Programs

Solving Mixed-Integer Nonlinear Programs Solving Mixed-Integer Nonlinear Programs (with SCIP) Ambros M. Gleixner Zuse Institute Berlin MATHEON Berlin Mathematical School 5th Porto Meeting on Mathematics for Industry, April 10 11, 2014, Porto

More information

Cutting planes from extended LP formulations

Cutting planes from extended LP formulations Cutting planes from extended LP formulations Merve Bodur University of Wisconsin-Madison mbodur@wisc.edu Sanjeeb Dash IBM Research sanjeebd@us.ibm.com March 7, 2016 Oktay Günlük IBM Research gunluk@us.ibm.com

More information

for Digital Systems Simplification of logic functions Tajana Simunic Rosing Sources: TSR, Katz, Boriello & Vahid

for Digital Systems Simplification of logic functions Tajana Simunic Rosing Sources: TSR, Katz, Boriello & Vahid SE140: omponents and Design Techniques for Digital Systems Simplification of logic functions Tajana Simunic Rosing 1 What we covered thus far: Number representations Where we are now inary, Octal, Hex,

More information

Stabilized Branch-and-cut-and-price for the Generalized Assignment Problem

Stabilized Branch-and-cut-and-price for the Generalized Assignment Problem Stabilized Branch-and-cut-and-price for the Generalized Assignment Problem Alexandre Pigatti, Marcus Poggi de Aragão Departamento de Informática, PUC do Rio de Janeiro {apigatti, poggi}@inf.puc-rio.br

More information

Discrete Optimization 2010 Lecture 8 Lagrangian Relaxation / P, N P and co-n P

Discrete Optimization 2010 Lecture 8 Lagrangian Relaxation / P, N P and co-n P Discrete Optimization 2010 Lecture 8 Lagrangian Relaxation / P, N P and co-n P Marc Uetz University of Twente m.uetz@utwente.nl Lecture 8: sheet 1 / 32 Marc Uetz Discrete Optimization Outline 1 Lagrangian

More information

Chapter 6 Constraint Satisfaction Problems

Chapter 6 Constraint Satisfaction Problems Chapter 6 Constraint Satisfaction Problems CS5811 - Artificial Intelligence Nilufer Onder Department of Computer Science Michigan Technological University Outline CSP problem definition Backtracking search

More information

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra LP Duality: outline I Motivation and definition of a dual LP I Weak duality I Separating hyperplane theorem and theorems of the alternatives I Strong duality and complementary slackness I Using duality

More information

A Hub Location Problem with Fully Interconnected Backbone and Access Networks

A Hub Location Problem with Fully Interconnected Backbone and Access Networks A Hub Location Problem with Fully Interconnected Backbone and Access Networks Tommy Thomadsen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark tt@imm.dtu.dk

More information

Nonconvex piecewise linear functions: Advanced formulations and simple modeling tools

Nonconvex piecewise linear functions: Advanced formulations and simple modeling tools Nonconvex piecewise linear functions: Advanced formulations and simple modeling tools Joey Huchette Operations Research Center, Massachusetts Institute of Technology, MA 02139, huchette@mit.edu Juan Pablo

More information

Notes on Dantzig-Wolfe decomposition and column generation

Notes on Dantzig-Wolfe decomposition and column generation Notes on Dantzig-Wolfe decomposition and column generation Mette Gamst November 11, 2010 1 Introduction This note introduces an exact solution method for mathematical programming problems. The method is

More information

Optimization Methods in Finance - Homework II (Solutions)

Optimization Methods in Finance - Homework II (Solutions) Optimization Methods in Finance - Homework II (Solutions) K. Subramani LCSEE, West Virginia University, Morgantown, WV {ksmani@csee.wvu.edu} 1 Problems 1. Consider the cone defined as: Cq r = {(x 1, x,...

More information

Integer Programming Chapter 15

Integer Programming Chapter 15 Integer Programming Chapter 15 University of Chicago Booth School of Business Kipp Martin November 9, 2016 1 / 101 Outline Key Concepts Problem Formulation Quality Solver Options Epsilon Optimality Preprocessing

More information

47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture 2 Date: 03/18/2010

47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture 2 Date: 03/18/2010 47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture Date: 03/18/010 We saw in the previous lecture that a lattice Λ can have many bases. In fact, if Λ is a lattice of a subspace L with

More information

Computational Experiments with Cross and Crooked Cross Cuts

Computational Experiments with Cross and Crooked Cross Cuts Submitted to INFORMS Journal on Computing manuscript (Please, provide the mansucript number!) Authors are encouraged to submit new papers to INFORMS journals by means of a style file template, which includes

More information

Robust Integer Programming

Robust Integer Programming Robust Integer Programming Technion Israel Institute of Technology Outline. Overview our theory of Graver bases for integer programming (with Berstein, De Loera, Hemmecke, Lee, Romanchuk, Rothblum, Weismantel)

More information

Parity Polytopes and Binarization

Parity Polytopes and Binarization Parity Polytopes and Binarization Dominik Ermel 1 and Matthias Walter 1 Otto-von-Guericke-Universität Magdeburg, dominik.ermel@st.ovgu.de RWTH Aachen University, walter@or.rwth-aachen.de March 8, 018 Abstract

More information

Operations Research Methods in Constraint Programming

Operations Research Methods in Constraint Programming Operations Research Methods in Constraint Programming John Hooker Carnegie Mellon University Prepared for Lloret de Mar, Spain June 2007 2007 Slide 1 CP and OR Have Complementary Strengths CP: Inference

More information

Integer Linear Programs

Integer Linear Programs Lecture 2: Review, Linear Programming Relaxations Today we will talk about expressing combinatorial problems as mathematical programs, specifically Integer Linear Programs (ILPs). We then see what happens

More information

Combinational Logic (mostly review!)

Combinational Logic (mostly review!) ombinational Logic (mostly review!)! Logic functions, truth tables, and switches " NOT, N, OR, NN, NOR, OR,... " Minimal set! xioms and theorems of oolean algebra " Proofs by re-writing " Proofs by perfect

More information

Linear Programming. Scheduling problems

Linear Programming. Scheduling problems Linear Programming Scheduling problems Linear programming (LP) ( )., 1, for 0 min 1 1 1 1 1 11 1 1 n i x b x a x a b x a x a x c x c x z i m n mn m n n n n! = + + + + + + = Extreme points x ={x 1,,x n

More information

Topics in Theoretical Computer Science April 08, Lecture 8

Topics in Theoretical Computer Science April 08, Lecture 8 Topics in Theoretical Computer Science April 08, 204 Lecture 8 Lecturer: Ola Svensson Scribes: David Leydier and Samuel Grütter Introduction In this lecture we will introduce Linear Programming. It was

More information

Lecture 2: Scheduling on Parallel Machines

Lecture 2: Scheduling on Parallel Machines Lecture 2: Scheduling on Parallel Machines Loris Marchal October 17, 2012 Parallel environment alpha in Graham s notation): P parallel identical Q uniform machines: each machine has a given speed speed

More information

Local Probability Models

Local Probability Models Readings: K&F 3.4, 5.~5.5 Local Probability Models Lecture 3 pr 4, 2 SE 55, Statistical Methods, Spring 2 Instructor: Su-In Lee University of Washington, Seattle Outline Last time onditional parameterization

More information

BCOL RESEARCH REPORT 07.04

BCOL RESEARCH REPORT 07.04 BCOL RESEARCH REPORT 07.04 Industrial Engineering & Operations Research University of California, Berkeley, CA 94720-1777 LIFTING FOR CONIC MIXED-INTEGER PROGRAMMING ALPER ATAMTÜRK AND VISHNU NARAYANAN

More information

Optimization of Submodular Functions Tutorial - lecture I

Optimization of Submodular Functions Tutorial - lecture I Optimization of Submodular Functions Tutorial - lecture I Jan Vondrák 1 1 IBM Almaden Research Center San Jose, CA Jan Vondrák (IBM Almaden) Submodular Optimization Tutorial 1 / 1 Lecture I: outline 1

More information

Asteroide Santana, Santanu S. Dey. December 4, School of Industrial and Systems Engineering, Georgia Institute of Technology

Asteroide Santana, Santanu S. Dey. December 4, School of Industrial and Systems Engineering, Georgia Institute of Technology for Some for Asteroide Santana, Santanu S. Dey School of Industrial Systems Engineering, Georgia Institute of Technology December 4, 2016 1 / 38 1 1.1 Conic integer programs for Conic integer programs

More information

Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming

Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming Marc Uetz University of Twente m.uetz@utwente.nl Lecture 8: sheet 1 / 32 Marc Uetz Discrete Optimization Outline 1 Intro: The Matching

More information

Operations Research Lecture 6: Integer Programming

Operations Research Lecture 6: Integer Programming Operations Research Lecture 6: Integer Programming Notes taken by Kaiquan Xu@Business School, Nanjing University May 12th 2016 1 Integer programming (IP) formulations The integer programming (IP) is the

More information

Fixed-charge transportation problems on trees

Fixed-charge transportation problems on trees Fixed-charge transportation problems on trees Gustavo Angulo * Mathieu Van Vyve * gustavo.angulo@uclouvain.be mathieu.vanvyve@uclouvain.be November 23, 2015 Abstract We consider a class of fixed-charge

More information

Automata Theory CS Complexity Theory I: Polynomial Time

Automata Theory CS Complexity Theory I: Polynomial Time Automata Theory CS411-2015-17 Complexity Theory I: Polynomial Time David Galles Department of Computer Science University of San Francisco 17-0: Tractable vs. Intractable If a problem is recursive, then

More information

Iterative Rounding and Relaxation

Iterative Rounding and Relaxation Iterative Rounding and Relaxation James Davis Department of Computer Science Rutgers University Camden jamesdav@camden.rutgers.edu March 11, 2010 James Davis (Rutgers Camden) Iterative Rounding 1 / 58

More information