A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse
|
|
- Arleen Webster
- 5 years ago
- Views:
Transcription
1 A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse Ted Ralphs 1 Joint work with Menal Güzelsoy 2 and Anahita Hassanzadeh 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University 2 SAS Institute, Advanced Analytics, Operations Research R & D INFORMS Computing Society Conference, Richmond, VA, January 11, 2015
2 Outline 1 Introduction 2 Value Function 3 Algorithms 4 Conclusions and Future Work
3 Outline 1 Introduction 2 Value Function 3 Algorithms 4 Conclusions and Future Work
4 Two-Stage Mixed Integer Optimization We have the following general formulation: where z 2SMILP = min x P 1 Ψ(x) = min x P 1 { c x + Ξ(x) }, (1) P 1 = {x X Ax = b, x 0} (2) is the first-stage feasible region with X = Z r1 + R n1 r1 +. Ξ represents the impact of future uncertainty. The canonical form employed in stochastic programming with recourse is Ξ(x) = E ω Ω [φ(h ω T ω x)], (3) φ is the second-stage value function to be defined shortly. T ω Q m2 n1 and h ω Q m2 represent the input to the second-stage problem for scenario ω Ω.
5 The Second-Stage Value Function The structure of the objective function Ψ depends primarily on the structure of the value function φ(β) = min y P q y (RP) 2(β) where P 2 (β) = {y Y Wy = β} (4) is the second-stage feasible region with respect to a given right-hand side β and Y = Z r2 + R n2 r2 +. The second-stage problem is parameterized on the unknown value β of the right-hand side. This value is determined jointly by the realized value of ω and the values of the first-stage decision variables. We assume ω follows a uniform distribution with a finite support, P 1 is compact, and E w Ω[φ(h ω T ωx)] is finite for all x X.
6 Outline 1 Introduction 2 Value Function 3 Algorithms 4 Conclusions and Future Work
7 MILP Value Function (Pure) The MILP value function is non-convex, discontinuous,and piecewise polyhedral in general. Example 1 φ(b) = min 3x x2 + 3x3 + 6x4 + 7x5 + 5x6 2 s.t. 6x 1 + 5x 2 4x 3 + 2x 4 7x 5 + x 6 = b x 1, x 2, x 3, x 4, x 5, x 6 Z +
8 MILP Value Function (Mixed) Example 2 φ(b) = min 3x x2 + 3x3 + 6x4 + 7x5 + 5x6 2 s.t. 6x 1 + 5x 2 4x 3 + 2x 4 7x 5 + x 6 = b x 1, x 2, x 3 Z +, x 4, x 5, x 6 R +
9 Mixed Integer Two-Stage Problem Example 3 min f (x 1, x 2 ) = min 3x 1 4x 2 + E[Φ MILP (ω 2x 1 0.5x 2 )] s.t. x 1 5, x 2 5 x 1, x 2 R +, (Ex.SMP) and ω {6, 12} with a uniform probability distribution.
10 Continuous and Integer Restriction of an MILP Consider the general form of the second-stage value function φ(β) = min q I y I + q C y C s.t. W I y I + W C y C = b, y Z r2 + R n2 r2 + (MILP) The structure is inherited from that of the continuous restriction: φ C (β) = min q C y C s.t. W C y C = β, y C R n2 r2 + (CR) and the similarly defined integer restriction: φ I (β) = min q I y I s.t. W I y I = β (IR) y I Z r2 +
11 Value Function of the Continuous Restriction Example 4 φ C (β) = min 6y 1 + 7y 2 + 5y 3 s.t. 2y 1 7y 2 + y 3 = β y 1, y 2, y 3 R +
12 Points of Strict Local Convexity Example 5 Theorem 1 (?) Under the assumption that {β R m2 φ I (β) < } is finite, there exists a finite set S Y such that φ(β) = min y {q I y I + φ C (β W I y I )}. (5) I S
13 Outline 1 Introduction 2 Value Function 3 Algorithms 4 Conclusions and Future Work
14 Representing the Value Function In practice, the value function can be represented in primarily two different ways. 1 On the one hand, the value function is uniquely determined by its points of strict local convexity. Embedding the value function using this representation involves explicitly listing these points and choosing one (binary variables). The corresponding continuous part of the solution can be generated dynamically or can also be represented explicitly by dual extreme points. 2 The value function can also be represented explicitly in terms of its polyhedral pieces. In this case, the points of strict local convexity are implicit and the selection is of the relevant piece or pieces. This yields a much larger representation.
15 Embedding the Value Function Algorithmically, the value function can be embedded in a number of ways. 1 If the objective functions of the inner and outer optimizations agree, we can embed the inner constraints and evaluate the value function implicitly. This amounts to solving the extensive form in the case of stochastic integer programming. For stochastic programs with many scenarios, this form can be too large to solve explicitly. 2 We can generate the value function a priori and then embed the full representation. The full representation might be very large It is likely that most of the representation is irrelevant to the computation. 3 We can dynamically generate relevant parts of the representation ala cut generation. It is also possible to take a hybrid approach in which we, e.g., generate the full representation a priori, but add parts dynamically.
16 Conceptual Algorithm for Generating the Value Function Algorithm Initialize: Let z(b) = for all b B, Γ 0 =, xi 0 = 0, S0 = {xi 0 }, and k = 0. while Γ k > 0 do: Let z(b) = min{ z, z(b; xi k )} for all b B. k k + 1. Solve Γ k = max z(b) c I x I s.t. A I x I = b x I Z r +. (SP) to obtain x k I. Set S k S k 1 {x k } end while return z(b) = z(b) for all b B.
17 Conceptual Algorithm for Generating the Value Function z f 4 f 5 f 3 f 2 f 1 b 1 b 2 b 3 b 4 b 5 d Figure: Upper bounding functions obtained at right-hand sides b i, i = 1,..., 5.
18 Formulating (SP) Surprisingly, the cut generation problem (SP) can be formulated easily as an MINLP. Γ k = max θ s.t. θ + c I x I c I xi i + (A I x I A I xi) i ν i i = 1,..., k 1 A C ν i c C i = 1,..., k 1 ν i R m i = 1,..., k 1 x I Z r +. (6)
19 Computational Results Figure: Normalized approximation gap vs. iteration number.
20 Generating the Value Function by Branch and Bound Our first algorithm was based on refining a single upper approximation (essentially a restriction of the full value function). It is also possible to construct the value function by lower approximation using branch and bound. Any branch-and-bound tree yields a lower approximation of the value function.
21 Dual Functions from Branch-and-Bound (?) Let T be set of the terminating nodes of the tree. Then in a terminating node t T we solve: φ t (b) = min c x s.t. Ax = b, l t x u t, x 0 (7) The dual at node t: φ t (b) = max {π t b + π t l t + π t u t } s.t. π t A + π t + π t c π 0, π 0 We obtain the following strong dual function: (8) where (ˆπ t, ˆπ t, ˆ π t ) is an optimal solution to the dual (8). min t T {ˆπt b + ˆπ t l t + ˆ π t u t }, (9)
22 Iterative Refinement The tree obtained from evaluating φ(b) yields a dual function strong at b. By solving for other right-hand sides, we obtain additional dual functions that can be aggregated. These additional solves can be done within the same tree, eventually yielding a single tree representing the entire function. Node 0 Node 0 x2 = 0 x2 1 x2 = 0 x2 1 Node 1 Node 2 Node 1 Node 2 x2 = 1 x2 2 Node 3 Node 4
23 Tree Representation of the Value Function Continuing the process, we eventually generate the entire value function. Consider the strengthened dual φ (β) = min t T q I t y t I t + φ t N\I t (β W It y t I t ), (10) I t is the set of indices of fixed variables, y t I t are the values of the corresponding variables in node t. φ t N\I t is the value function of the linear program at node t including only the unfixed variables. Theorem 2 Under the assumption that {β R m2 φ I (β) < } is finite, there exists a branch-and-bound tree with respect to which φ = φ.
24 Example of Value Function Tree Node 0 y3 = 0 y3 1 Node 1 Node 8 y2 = 0 y2 1 y3 = 1 y3 2 Node 2 max{ 2β, β} Node 3 Node 9 max{β + 5, g7 = 2β 1} Node 10 y2 = 1 y2 2 y3 = 2 y3 3 Node 4 max{ 2β + 14, β 1} Node 5 Node 11 max{β + 10, g9 = 2β 2} Node 12 y2 = 2 y2 3 y3 = 3 y3 4 Node 6 Node 7 max{2β + 28, β 2} 2β + 42 Node 13 max{β + 15, 2β 3} Node 14 y3 = 4 y3 5 Node 15 max{β + 20, 2β 4} Node 16 y3 = 5 y3 6 Node 17 Node 18 max{β + 25, 2β 5} β + 30
25 Correspondence of Nodes and Local Stability Regions
26 Back to Stochastic Programming: Lit Review First Stage Second Stage Stochasticity R Z B R Z B W T h q (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) (?) Current work
27 Benders Master Formulation Γ k = min c x + p ω z ω ω Ω s.t. z ω q t,ω z ω q t,ω M ω (1 u t,ω ) q t,ω (h ω T ω x) η i + α i u t,ω = 1 t T u t,ω B, x X. t T, ω Ω t T, ω Ω i I(t), t T, ω Ω ω Ω t T, ω Ω (MP)
28 Benders Master Variables Notation: T indexes the leaf nodes of the branch-and-bound tree. I(t) are the indices of the affine functions describing the LP value function associated with node t. η i, α i represents the affine function indexed by i I(t) for node t T q t,ω = max I(t) b η i + α i represents the evaluation of the value function of node t in scenario ω. u t,ω represents which of the nodes of the branch-and-bound tree is chosen as the maximum in scenario ω. z ω = min t T q t,ω represents the evaluation of the current value function approximation for scenario ω. x are the first-stage variables.
29 Overall Approach As in the classical algorithm, we alterante between solving the master problem and solving subproblems that update the current approximation (refines T). We maintain a single branch and bound tree and warm-start solution of the subproblems. This requires a solver capable of warm-starting the branch-and-bound process, as well as exporting the dual function. For this purpose, we use the SYMPHONY MILP solver, which has this capability. There are many possible variations, such as separate approximations for each scenario.
30 Example Consider where min f (x) = min 3x 1 4x 2 + s.t. x 1 + x 2 5 x Z Q(x, s) s=1 (11) Q(x, s) = min 3y y 2 + 3y 3 + 6y 4 + 7y 5 s.t. 6y 1 + 5y 2 4y 3 + 2y 4 7y 5 = h(s) 2x x 2 (12) y 1, y 2, y 3 Z +, y 4, y 5 R + with h(s) { 4, 10}.
31 Example
32 Solving the Master Problem A fundamental question is how to solve the master problem efficiently. It is a large integer program with many constraints, most of which will be redundant. It seems clear that we need to dynamically manage the LP relaxations. There are several options 1 Put constraints in to a cut pool and add them only as they are violated. 2 Add all constraints in the beginning, but aggressively remove slack ones. Our attempts have so far failed. Not having the full formulation makes branching less effective. We are currently investigating.
33 Example from the Literature Consider where f (b) = inf 1.5x 1 4x 2 + E[z(x, ω)] s.t. x 1, x 2 B 1, z(b) = inf 16y 1 19y 2 23y 3 28y R s.t. 2y 1 + 3y 2 + 4y 3 + 5y 4 R h(x) x 1 6y 1 + y 2 + 3y 3 + 2y 4 R h(x) x 2 y i B, i = 1,..., 4, R Z +. (13) (14) Here, the scenarios belong to the set {ω 1, ω 2 }, each having a probability of 0.5. The distribution of the right-hand side is (h 1 (ω 1 ), h 2 (ω 1 )) = (5, 2) and (h 1 (ω 2 ), h 2 (ω 2 )) = (10, 3).
34 Example cont. To construct larger instances, we allow the right hand sides of the two constraints to be in the set {5, 5 +, 5 + 2,..., 15} {5, 5 +, 5 + 2,..., 15} to generate 4, 9, 36, 121 scenarios with {1, 2, 5, 10}. We further extend the set by changing 15 to 20 to generate 225 scenarios with = 1. We have the size of the deterministic equivalent of the resulting problems as follows No. Scen No. Vars No. Const Table: Size of the deterministic equivalent of the test instances
35 Example cont. Static and Dynamic Cut Generation Instance Obj No. Stats. Size of Stat. Dyn. Size of Dyn. Iter. Master Time Master Time 4-Scen (27, 47) (27, 47) Scen (71, 127) (71, 127) Scen (301, 552) (277, 505) Scen (1022,1891) (986, 1807) Scen (1883, 3465) (1812, 3314) Table: Performance of the algorithm applied to test problems The third and fifth columns show the size of the master problem in the final iteration in the form of number of tree nodes (number of variables, number of constraints) respectively with static and dynamic cut generation. The fourth and sixth columns show the solution time in seconds respectively for static and dynamic cut generation.
36 SSLP Instances We apply the algorithm to the SSLP test instances from SIPLIB. The instances have the following properties. The last column shows the deterministic equivalent solution time in seconds. DEP 2nd Stage Instance cons bin int cons bin int Time (s) % Gap sslp-5-25(25) sslp-5-25(50) sslp-5-25(100) Table: The deterministic equivalent of SSLP instances where DEP and 2nd Stage correspond to the deterministic equivalent and the second stage problems and cons, bins and int respectively represent the number of constraints, binary variables and general integer variables in the corresponding problem.
37 SSLP Instances Static Cut Dynamic Cut Instance Iteration Size Time (s) % Gap Iteration Size Time (s) %Gap sslp-5-25(25) (1040, 2016) (2493, 3639) sslp-5-25(50) (1484, 2948) (2443, 3489) sslp-5-25(100) (3703, 7192) (2608, 3604) Table: Generalized Benders algorithm applied to SSLP instances The results are generated using the MILP solver SYMPHONY version 5.5. A time limit of one hour was enforced on the solution time. The Gap% column refers to the relative gap between the upper bound and lower bound of the Generalized Benders algorithm. The tests are performed on a a Linux (Debian 6.0.9) operating system running 16 AMD processors on a 800 MHz speed and 31 GB RAM, compiled with g++.
38 Outline 1 Introduction 2 Value Function 3 Algorithms 4 Conclusions and Future Work
39 Conclusions and Future Work We have developed an algorithm for the two-stage problem with general mixed integer variables in both stages. The algorithm uses the Benders framework with B&B dual functions as the optimality cuts. We need to keep the size of approximations small. Currently, we have implemented a static cut generation as well as a dynamic cut generation by allowing the constraints to be added to the master problem dynamically as needed. There are still many questions to be answered about how to make all of this as efficient as possible. We are working on making the dynamic cut generation scheme more efficient by incorporating cuts during strong branching. This is work under progress.
Generation and Representation of Piecewise Polyhedral Value Functions
Generation and Representation of Piecewise Polyhedral Value Functions Ted Ralphs 1 Joint work with Menal Güzelsoy 2 and Anahita Hassanzadeh 1 1 COR@L Lab, Department of Industrial and Systems Engineering,
More informationBilevel Integer Optimization: Theory and Algorithms
: Theory and Algorithms Ted Ralphs 1 Joint work with Sahar Tahernajad 1, Scott DeNegre 3, Menal Güzelsoy 2, Anahita Hassanzadeh 4 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University
More informationInteger Programming ISE 418. Lecture 8. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 8 Dr. Ted Ralphs ISE 418 Lecture 8 1 Reading for This Lecture Wolsey Chapter 2 Nemhauser and Wolsey Sections II.3.1, II.3.6, II.4.1, II.4.2, II.5.4 Duality for Mixed-Integer
More informationBilevel Integer Programming
Bilevel Integer Programming Ted Ralphs 1 Joint work with: Scott DeNegre 1, Menal Guzelsoy 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University Norfolk Southern Ralphs, et al.
More informationMultiobjective Mixed-Integer Stackelberg Games
Solving the Multiobjective Mixed-Integer SCOTT DENEGRE TED RALPHS ISE Department COR@L Lab Lehigh University tkralphs@lehigh.edu EURO XXI, Reykjavic, Iceland July 3, 2006 Outline Solving the 1 General
More informationThe Value function of a Mixed-Integer Linear Program with a Single Constraint
The Value Function of a Mixed Integer Linear Programs with a Single Constraint MENAL GUZELSOY TED RALPHS ISE Department COR@L Lab Lehigh University tkralphs@lehigh.edu University of Wisconsin February
More informationThe Value function of a Mixed-Integer Linear Program with a Single Constraint
The Value Function of a Mixed Integer Linear Programs with a Single Constraint MENAL GUZELSOY TED RALPHS ISE Department COR@L Lab Lehigh University tkralphs@lehigh.edu OPT 008, Atlanta, March 4, 008 Thanks:
More informationBilevel Integer Linear Programming
Bilevel Integer Linear Programming TED RALPHS SCOTT DENEGRE ISE Department COR@L Lab Lehigh University ted@lehigh.edu MOPTA 2009, Lehigh University, 19 August 2009 Thanks: Work supported in part by the
More informationStochastic Integer Programming
IE 495 Lecture 20 Stochastic Integer Programming Prof. Jeff Linderoth April 14, 2003 April 14, 2002 Stochastic Programming Lecture 20 Slide 1 Outline Stochastic Integer Programming Integer LShaped Method
More informationDecomposition Algorithms for Two-Stage Distributionally Robust Mixed Binary Programs
Decomposition Algorithms for Two-Stage Distributionally Robust Mixed Binary Programs Manish Bansal Grado Department of Industrial and Systems Engineering, Virginia Tech Email: bansal@vt.edu Kuo-Ling Huang
More informationAn Adaptive Partition-based Approach for Solving Two-stage Stochastic Programs with Fixed Recourse
An Adaptive Partition-based Approach for Solving Two-stage Stochastic Programs with Fixed Recourse Yongjia Song, James Luedtke Virginia Commonwealth University, Richmond, VA, ysong3@vcu.edu University
More informationThe L-Shaped Method. Operations Research. Anthony Papavasiliou 1 / 44
1 / 44 The L-Shaped Method Operations Research Anthony Papavasiliou Contents 2 / 44 1 The L-Shaped Method [ 5.1 of BL] 2 Optimality Cuts [ 5.1a of BL] 3 Feasibility Cuts [ 5.1b of BL] 4 Proof of Convergence
More informationDecomposition Algorithms with Parametric Gomory Cuts for Two-Stage Stochastic Integer Programs
Decomposition Algorithms with Parametric Gomory Cuts for Two-Stage Stochastic Integer Programs Dinakar Gade, Simge Küçükyavuz, Suvrajeet Sen Integrated Systems Engineering 210 Baker Systems, 1971 Neil
More informationFinancial Optimization ISE 347/447. Lecture 21. Dr. Ted Ralphs
Financial Optimization ISE 347/447 Lecture 21 Dr. Ted Ralphs ISE 347/447 Lecture 21 1 Reading for This Lecture C&T Chapter 16 ISE 347/447 Lecture 21 2 Formalizing: Random Linear Optimization Consider the
More informationOn the Value Function of a Mixed Integer Linear Program
On the Value Function of a Mixed Integer Linear Program MENAL GUZELSOY TED RALPHS ISE Department COR@L Lab Lehigh University ted@lehigh.edu AIRO, Ischia, Italy, 11 September 008 Thanks: Work supported
More informationMultistage Discrete Optimization: Introduction
Multistage Discrete Optimization Part I: Introduction Ted Ralphs 1 Joint work with Suresh Bolusani 1, Scott DeNegre 3, Menal Güzelsoy 2, Anahita Hassanzadeh 4, Sahar Tahernajad 1 1 COR@L Lab, Department
More informationColumn Generation for Extended Formulations
1 / 28 Column Generation for Extended Formulations Ruslan Sadykov 1 François Vanderbeck 2,1 1 INRIA Bordeaux Sud-Ouest, France 2 University Bordeaux I, France ISMP 2012 Berlin, August 23 2 / 28 Contents
More informationScenario Grouping and Decomposition Algorithms for Chance-constrained Programs
Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Siqian Shen Dept. of Industrial and Operations Engineering University of Michigan Joint work with Yan Deng (UMich, Google)
More informationDecomposition methods in optimization
Decomposition methods in optimization I Approach I: I Partition problem constraints into two groups: explicit and implicit I Approach II: I Partition decision variables into two groups: primary and secondary
More informationK-Adaptability in Two-Stage Mixed-Integer Robust Optimization
K-Adaptability in Two-Stage Mixed-Integer Robust Optimization Anirudh Subramanyam 1, Chrysanthos E. Gounaris 1, and Wolfram Wiesemann 2 asubramanyam@cmu.edu, gounaris@cmu.edu, ww@imperial.ac.uk 1 Department
More informationThe L-Shaped Method. Operations Research. Anthony Papavasiliou 1 / 38
1 / 38 The L-Shaped Method Operations Research Anthony Papavasiliou Contents 2 / 38 1 The L-Shaped Method 2 Example: Capacity Expansion Planning 3 Examples with Optimality Cuts [ 5.1a of BL] 4 Examples
More informationStrengthened Benders Cuts for Stochastic Integer Programs with Continuous Recourse
Strengthened Benders Cuts for Stochastic Integer Programs with Continuous Recourse Merve Bodur 1, Sanjeeb Dash 2, Otay Günlü 2, and James Luedte 3 1 Department of Mechanical and Industrial Engineering,
More informationDisconnecting Networks via Node Deletions
1 / 27 Disconnecting Networks via Node Deletions Exact Interdiction Models and Algorithms Siqian Shen 1 J. Cole Smith 2 R. Goli 2 1 IOE, University of Michigan 2 ISE, University of Florida 2012 INFORMS
More informationComputations with Disjunctive Cuts for Two-Stage Stochastic Mixed 0-1 Integer Programs
Computations with Disjunctive Cuts for Two-Stage Stochastic Mixed 0-1 Integer Programs Lewis Ntaimo and Matthew W. Tanner Department of Industrial and Systems Engineering, Texas A&M University, 3131 TAMU,
More informationParallel PIPS-SBB Multi-level parallelism for 2-stage SMIPS. Lluís-Miquel Munguia, Geoffrey M. Oxberry, Deepak Rajan, Yuji Shinano
Parallel PIPS-SBB Multi-level parallelism for 2-stage SMIPS Lluís-Miquel Munguia, Geoffrey M. Oxberry, Deepak Rajan, Yuji Shinano ... Our contribution PIPS-PSBB*: Multi-level parallelism for Stochastic
More informationFenchel Decomposition for Stochastic Mixed-Integer Programming
Fenchel Decomposition for Stochastic Mixed-Integer Programming Lewis Ntaimo Department of Industrial and Systems Engineering, Texas A&M University, 3131 TAMU, College Station, TX 77843, USA, ntaimo@tamu.edu
More informationNonconvex Generalized Benders Decomposition Paul I. Barton
Nonconvex Generalized Benders Decomposition Paul I. Barton Process Systems Engineering Laboratory Massachusetts Institute of Technology Motivation Two-stage Stochastic MINLPs & MILPs Natural Gas Production
More informationMILP reformulation of the multi-echelon stochastic inventory system with uncertain demands
MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands Axel Nyberg Åbo Aademi University Ignacio E. Grossmann Dept. of Chemical Engineering, Carnegie Mellon University,
More informationStochastic Dual Dynamic Integer Programming
Stochastic Dual Dynamic Integer Programming Jikai Zou Shabbir Ahmed Xu Andy Sun December 26, 2017 Abstract Multistage stochastic integer programming (MSIP) combines the difficulty of uncertainty, dynamics,
More informationOn the Value Function of a Mixed Integer Linear Optimization Problem and an Algorithm for its Construction
On the Value Function of a Mixed Integer Linear Optimization Problem and an Algorithm for its Construction Ted K. Ralphs and Anahita Hassanzadeh Department of Industrial and Systems Engineering, Lehigh
More informationCan Li a, Ignacio E. Grossmann a,
A generalized Benders decomposition-based branch and cut algorithm for two-stage stochastic programs with nonconvex constraints and mixed-binary first and second stage variables Can Li a, Ignacio E. Grossmann
More informationReformulation and Sampling to Solve a Stochastic Network Interdiction Problem
Network Interdiction Stochastic Network Interdiction and to Solve a Stochastic Network Interdiction Problem Udom Janjarassuk Jeff Linderoth ISE Department COR@L Lab Lehigh University jtl3@lehigh.edu informs
More informationPART 4 INTEGER PROGRAMMING
PART 4 INTEGER PROGRAMMING 102 Read Chapters 11 and 12 in textbook 103 A capital budgeting problem We want to invest $19 000 Four investment opportunities which cannot be split (take it or leave it) 1.
More informationLecture 8: Column Generation
Lecture 8: Column Generation (3 units) Outline Cutting stock problem Classical IP formulation Set covering formulation Column generation A dual perspective Vehicle routing problem 1 / 33 Cutting stock
More informationA Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization
A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization Sven Leyffer 2 Annick Sartenaer 1 Emilie Wanufelle 1 1 University of Namur, Belgium 2 Argonne National Laboratory, USA IMA Workshop,
More informationBasic notions of Mixed Integer Non-Linear Programming
Basic notions of Mixed Integer Non-Linear Programming Claudia D Ambrosio CNRS & LIX, École Polytechnique 5th Porto Meeting on Mathematics for Industry, April 10, 2014 C. D Ambrosio (CNRS) April 10, 2014
More informationDevelopment of the new MINLP Solver Decogo using SCIP - Status Report
Development of the new MINLP Solver Decogo using SCIP - Status Report Pavlo Muts with Norman Breitfeld, Vitali Gintner, Ivo Nowak SCIP Workshop 2018, Aachen Table of contents 1. Introduction 2. Automatic
More informationInteger Programming Duality
Integer Programming Duality M. Guzelsoy T. K. Ralphs July, 2010 1 Introduction This article describes what is known about duality for integer programs. It is perhaps surprising that many of the results
More informationDuality, Warm Starting, and Sensitivity Analysis for MILP
Duality, Warm Starting, and Sensitivity Analysis for MILP Ted Ralphs and Menal Guzelsoy Industrial and Systems Engineering Lehigh University SAS Institute, Cary, NC, Friday, August 19, 2005 SAS Institute
More informationCan Li a, Ignacio E. Grossmann a,
A generalized Benders decomposition-based branch and cut algorithm for two-stage stochastic programs with nonconvex constraints and mixed-binary first and second stage variables Can Li a, Ignacio E. Grossmann
More informationInteger Programming ISE 418. Lecture 13. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 13 Dr. Ted Ralphs ISE 418 Lecture 13 1 Reading for This Lecture Nemhauser and Wolsey Sections II.1.1-II.1.3, II.1.6 Wolsey Chapter 8 CCZ Chapters 5 and 6 Valid Inequalities
More informationComputational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs
Computational Integer Programming Lecture 2: Modeling and Formulation Dr. Ted Ralphs Computational MILP Lecture 2 1 Reading for This Lecture N&W Sections I.1.1-I.1.6 Wolsey Chapter 1 CCZ Chapter 2 Computational
More informationSoftware for Integer and Nonlinear Optimization
Software for Integer and Nonlinear Optimization Sven Leyffer, leyffer@mcs.anl.gov Mathematics & Computer Science Division Argonne National Laboratory Roger Fletcher & Jeff Linderoth Advanced Methods and
More informationIP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique.
IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, 31 14. You wish to solve the IP below with a cutting plane technique. Maximize 4x 1 + 2x 2 + x 3 subject to 14x 1 + 10x 2 + 11x 3 32 10x 1 +
More informationGestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA
Gestion de la production Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA 1 Contents 1 Integer Linear Programming 3 1.1 Definitions and notations......................................
More informationInteger Programming Reformulations: Dantzig-Wolfe & Benders Decomposition the Coluna Software Platform
Integer Programming Reformulations: Dantzig-Wolfe & Benders Decomposition the Coluna Software Platform François Vanderbeck B. Detienne, F. Clautiaux, R. Griset, T. Leite, G. Marques, V. Nesello, A. Pessoa,
More informationDecomposition with Branch-and-Cut Approaches for Two Stage Stochastic Mixed-Integer Programming
Decomposition with Branch-and-Cut Approaches for Two Stage Stochastic Mixed-Integer Programming by Suvrajeet Sen SIE Department, University of Arizona, Tucson, AZ 85721 and Hanif D. Sherali ISE Department,
More informationLecture 23 Branch-and-Bound Algorithm. November 3, 2009
Branch-and-Bound Algorithm November 3, 2009 Outline Lecture 23 Modeling aspect: Either-Or requirement Special ILPs: Totally unimodular matrices Branch-and-Bound Algorithm Underlying idea Terminology Formal
More informationBenders Decomposition
Benders Decomposition Yuping Huang, Dr. Qipeng Phil Zheng Department of Industrial and Management Systems Engineering West Virginia University IENG 593G Nonlinear Programg, Spring 2012 Yuping Huang (IMSE@WVU)
More informationDecomposition Algorithms for Two-Stage Chance-Constrained Programs
Mathematical Programming manuscript No. (will be inserted by the editor) Decomposition Algorithms for Two-Stage Chance-Constrained Programs Xiao Liu Simge Küçükyavuz Luedtke James Received: date / Accepted:
More informationImplementation of an αbb-type underestimator in the SGO-algorithm
Implementation of an αbb-type underestimator in the SGO-algorithm Process Design & Systems Engineering November 3, 2010 Refining without branching Could the αbb underestimator be used without an explicit
More informationPart 4. Decomposition Algorithms
In the name of God Part 4. 4.4. Column Generation for the Constrained Shortest Path Problem Spring 2010 Instructor: Dr. Masoud Yaghini Constrained Shortest Path Problem Constrained Shortest Path Problem
More informationInteger Programming. Wolfram Wiesemann. December 6, 2007
Integer Programming Wolfram Wiesemann December 6, 2007 Contents of this Lecture Revision: Mixed Integer Programming Problems Branch & Bound Algorithms: The Big Picture Solving MIP s: Complete Enumeration
More informationMixed Integer Non Linear Programming
Mixed Integer Non Linear Programming Claudia D Ambrosio CNRS Research Scientist CNRS & LIX, École Polytechnique MPRO PMA 2016-2017 Outline What is a MINLP? Dealing with nonconvexities Global Optimization
More informationDisjunctive Decomposition for Two-Stage Stochastic Mixed-Binary Programs with Random Recourse
Disjunctive Decomposition for Two-Stage Stochastic Mixed-Binary Programs with Random Recourse Lewis Ntaimo Department of Industrial and Systems Engineering, Texas A&M University, 3131 TAMU, College Station,
More information14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness.
CS/ECE/ISyE 524 Introduction to Optimization Spring 2016 17 14. Duality ˆ Upper and lower bounds ˆ General duality ˆ Constraint qualifications ˆ Counterexample ˆ Complementary slackness ˆ Examples ˆ Sensitivity
More informationLecture 8: Column Generation
Lecture 8: Column Generation (3 units) Outline Cutting stock problem Classical IP formulation Set covering formulation Column generation A dual perspective 1 / 24 Cutting stock problem 2 / 24 Problem description
More informationIntroduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 21 Dr. Ted Ralphs IE406 Lecture 21 1 Reading for This Lecture Bertsimas Sections 10.2, 10.3, 11.1, 11.2 IE406 Lecture 21 2 Branch and Bound Branch
More informationarxiv: v2 [math.oc] 31 May 2014
Chance Constrained Mixed Integer Program: Bilinear and Linear Formulations, and Benders Decomposition Bo Zeng, Yu An and Ludwig Kuznia arxiv:1403.7875v2 [math.oc] 31 May 2014 Dept. of Industrial and Management
More informationA Benders decomposition method for locating stations in a one-way electric car sharing system under demand uncertainty
A Benders decomposition method for locating stations in a one-way electric car sharing system under demand uncertainty Hatice Calik 1,2 and Bernard Fortz 1,3 1 Department of Computer Science, Université
More informationIE418 Integer Programming
IE418: Integer Programming Department of Industrial and Systems Engineering Lehigh University 2nd February 2005 Boring Stuff Extra Linux Class: 8AM 11AM, Wednesday February 9. Room??? Accounts and Passwords
More informationHighly-scalable branch and bound for maximum monomial agreement
Highly-scalable branch and bound for maximum monomial agreement Jonathan Eckstein (Rutgers) William Hart Cynthia A. Phillips Sandia National Laboratories Sandia National Laboratories is a multi-program
More informationStochastic Integer Programming An Algorithmic Perspective
Stochastic Integer Programming An Algorithmic Perspective sahmed@isye.gatech.edu www.isye.gatech.edu/~sahmed School of Industrial & Systems Engineering 2 Outline Two-stage SIP Formulation Challenges Simple
More informationMIDAS: A Mixed Integer Dynamic Approximation Scheme
MIDAS: A Mixed Integer Dynamic Approximation Scheme Andy Philpott, Faisal Wahid, Frédéric Bonnans May 7, 2016 Abstract Mixed Integer Dynamic Approximation Scheme (MIDAS) is a new sampling-based algorithm
More informationDevelopment of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks
Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks E. Wanufelle 1 S. Leyffer 2 A. Sartenaer 1 Ph. Toint 1 1 FUNDP, University of Namur 2
More informationRecoverable Robustness in Scheduling Problems
Master Thesis Computing Science Recoverable Robustness in Scheduling Problems Author: J.M.J. Stoef (3470997) J.M.J.Stoef@uu.nl Supervisors: dr. J.A. Hoogeveen J.A.Hoogeveen@uu.nl dr. ir. J.M. van den Akker
More informationMultistage Robust Mixed Integer Optimization with Adaptive Partitions
Vol. 00, No. 0, Xxxxx 0000, pp. 000 000 issn 0000-0000 eissn 0000-0000 00 0000 0001 INFORMS doi 10.187/xxxx.0000.0000 c 0000 INFORMS Multistage Robust Mixed Integer Optimization with Adaptive Partitions
More informationAn improved L-shaped method for two-stage convex 0-1 mixed integer nonlinear stochastic programs
An improved L-shaped method for two-stage convex 0-1 mixed integer nonlinear stochastic programs Can Li a, Ignacio E. Grossmann a, a Center for Advanced Process Decision-Making, Department of Chemical
More informationInteger Programming ISE 418. Lecture 12. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 12 Dr. Ted Ralphs ISE 418 Lecture 12 1 Reading for This Lecture Nemhauser and Wolsey Sections II.2.1 Wolsey Chapter 9 ISE 418 Lecture 12 2 Generating Stronger Valid
More informationMixed-Integer Nonlinear Decomposition Toolbox for Pyomo (MindtPy)
Mario R. Eden, Marianthi Ierapetritou and Gavin P. Towler (Editors) Proceedings of the 13 th International Symposium on Process Systems Engineering PSE 2018 July 1-5, 2018, San Diego, California, USA 2018
More informationFeasibility Pump Heuristics for Column Generation Approaches
1 / 29 Feasibility Pump Heuristics for Column Generation Approaches Ruslan Sadykov 2 Pierre Pesneau 1,2 Francois Vanderbeck 1,2 1 University Bordeaux I 2 INRIA Bordeaux Sud-Ouest SEA 2012 Bordeaux, France,
More informationLarge-scale optimization and decomposition methods: outline. Column Generation and Cutting Plane methods: a unified view
Large-scale optimization and decomposition methods: outline I Solution approaches for large-scaled problems: I Delayed column generation I Cutting plane methods (delayed constraint generation) 7 I Problems
More informationScenario grouping and decomposition algorithms for chance-constrained programs
Scenario grouping and decomposition algorithms for chance-constrained programs Yan Deng Shabbir Ahmed Jon Lee Siqian Shen Abstract A lower bound for a finite-scenario chance-constrained problem is given
More informationNetwork Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini
In the name of God Network Flows 6. Lagrangian Relaxation 6.3 Lagrangian Relaxation and Integer Programming Fall 2010 Instructor: Dr. Masoud Yaghini Integer Programming Outline Branch-and-Bound Technique
More informationA Lifted Linear Programming Branch-and-Bound Algorithm for Mixed Integer Conic Quadratic Programs
A Lifted Linear Programming Branch-and-Bound Algorithm for Mied Integer Conic Quadratic Programs Juan Pablo Vielma Shabbir Ahmed George L. Nemhauser H. Milton Stewart School of Industrial and Systems Engineering
More informationAn Exact Algorithm for the Steiner Tree Problem with Delays
Electronic Notes in Discrete Mathematics 36 (2010) 223 230 www.elsevier.com/locate/endm An Exact Algorithm for the Steiner Tree Problem with Delays Valeria Leggieri 1 Dipartimento di Matematica, Università
More informationStochastic Programming Models in Design OUTLINE
Stochastic Programming Models in Design John R. Birge University of Michigan OUTLINE Models General - Farming Structural design Design portfolio General Approximations Solutions Revisions Decision: European
More informationIntroduction to integer programming II
Introduction to integer programming II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects of Optimization
More informationInverse Integer Linear Programs: Complexity and Computation
Inverse Integer Linear Programs: Complexity and Computation Aykut Bulut 1 Ted Ralphs 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University INFORMS Computing Society Conference,
More information3.8 Strong valid inequalities
3.8 Strong valid inequalities By studying the problem structure, we can derive strong valid inequalities which lead to better approximations of the ideal formulation conv(x ) and hence to tighter bounds.
More informationInterior Point Algorithms for Constrained Convex Optimization
Interior Point Algorithms for Constrained Convex Optimization Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Inequality constrained minimization problems
More informationEasy and not so easy multifacility location problems... (In 20 minutes.)
Easy and not so easy multifacility location problems... (In 20 minutes.) MINLP 2014 Pittsburgh, June 2014 Justo Puerto Institute of Mathematics (IMUS) Universidad de Sevilla Outline 1 Introduction (In
More informationSome Recent Advances in Mixed-Integer Nonlinear Programming
Some Recent Advances in Mixed-Integer Nonlinear Programming Andreas Wächter IBM T.J. Watson Research Center Yorktown Heights, New York andreasw@us.ibm.com SIAM Conference on Optimization 2008 Boston, MA
More informationValid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints
Valid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints Nilay Noyan Andrzej Ruszczyński March 21, 2006 Abstract Stochastic dominance relations
More informationTwo-stage stochastic (and distributionally robust) p-order conic mixed integer programs: Tight second stage formulations
Two-stage stochastic (and distributionally robust p-order conic mixed integer programs: Tight second stage formulations Manish Bansal and Yingqiu Zhang Department of Industrial and Systems Engineering
More informationSolving Dual Problems
Lecture 20 Solving Dual Problems We consider a constrained problem where, in addition to the constraint set X, there are also inequality and linear equality constraints. Specifically the minimization problem
More informationIndicator Constraints in Mixed-Integer Programming
Indicator Constraints in Mixed-Integer Programming Andrea Lodi University of Bologna, Italy - andrea.lodi@unibo.it Amaya Nogales-Gómez, Universidad de Sevilla, Spain Pietro Belotti, FICO, UK Matteo Fischetti,
More informationwhere X is the feasible region, i.e., the set of the feasible solutions.
3.5 Branch and Bound Consider a generic Discrete Optimization problem (P) z = max{c(x) : x X }, where X is the feasible region, i.e., the set of the feasible solutions. Branch and Bound is a general semi-enumerative
More informationStochastic Programming: From statistical data to optimal decisions
Stochastic Programming: From statistical data to optimal decisions W. Römisch Humboldt-University Berlin Department of Mathematics (K. Emich, H. Heitsch, A. Möller) Page 1 of 24 6th International Conference
More informationTwo-stage integer programs with stochastic right-hand sides: a superadditive dual approach
Math. Program., Ser. B 108, 275 296 (2006) Digital Object Identifier (DOI) 10.1007/s10107-006-0711-y Nan Kong Andrew J. Schaefer Brady Hunsaker Two-stage integer programs with stochastic right-hand sides:
More informationSeparation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1
: Some Observations Ted Ralphs 1 Joint work with: Aykut Bulut 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University COLGEN 2016, Buzios, Brazil, 25 May 2016 What Is This Talk
More informationSection Notes 8. Integer Programming II. Applied Math 121. Week of April 5, expand your knowledge of big M s and logical constraints.
Section Notes 8 Integer Programming II Applied Math 121 Week of April 5, 2010 Goals for the week understand IP relaxations be able to determine the relative strength of formulations understand the branch
More informationOptimization Tools in an Uncertain Environment
Optimization Tools in an Uncertain Environment Michael C. Ferris University of Wisconsin, Madison Uncertainty Workshop, Chicago: July 21, 2008 Michael Ferris (University of Wisconsin) Stochastic optimization
More informationDisjunctive Decomposition for Two-Stage Stochastic Mixed-Binary Programs with GUB Constraints
Disjunctive Decomposition for Two-Stage Stochastic Mixed-Binary Programs with GUB Constraints Brian Keller Booz Allen Hamilton, 134 National Business Parkway, Annapolis Junction, MD 20701, USA, keller
More informationDecomposition-based Methods for Large-scale Discrete Optimization p.1
Decomposition-based Methods for Large-scale Discrete Optimization Matthew V Galati Ted K Ralphs Department of Industrial and Systems Engineering Lehigh University, Bethlehem, PA, USA Départment de Mathématiques
More informationStabilization in Column Generation: numerical study
1 / 26 Stabilization in Column Generation: numerical study Artur Pessoa 3 Ruslan Sadykov 1,2 Eduardo Uchoa 3 François Vanderbeck 2,1 1 INRIA Bordeaux, France 2 Univ. Bordeaux I, France 3 Universidade Federal
More informationSolution Methods for Stochastic Programs
Solution Methods for Stochastic Programs Huseyin Topaloglu School of Operations Research and Information Engineering Cornell University ht88@cornell.edu August 14, 2010 1 Outline Cutting plane methods
More informationStochastic Programming: Optimization When Uncertainty Matters
INFORMS New Orleans 2005 c 2005 INFORMS isbn 0000-0000 doi 10.1287/educ.1053.0000 Chapter 1 Stochastic Programming: Optimization When Uncertainty Matters Julia L. Higle Dept. of Systems and Industrial
More informationINEXACT CUTS IN BENDERS' DECOMPOSITION GOLBON ZAKERI, ANDREW B. PHILPOTT AND DAVID M. RYAN y Abstract. Benders' decomposition is a well-known techniqu
INEXACT CUTS IN BENDERS' DECOMPOSITION GOLBON ZAKERI, ANDREW B. PHILPOTT AND DAVID M. RYAN y Abstract. Benders' decomposition is a well-known technique for solving large linear programs with a special
More informationMINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms
MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms Jeff Linderoth Industrial and Systems Engineering University of Wisconsin-Madison Jonas Schweiger Friedrich-Alexander-Universität
More information