Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks

Size: px
Start display at page:

Download "Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks"

Transcription

1 Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks E. Wanufelle 1 S. Leyffer 2 A. Sartenaer 1 Ph. Toint 1 1 FUNDP, University of Namur 2 Argonne National Laboratory One-day Symposium on Optimization and Engineering, CORE, May 24th 2006

2 Outline 1 Motivations 2 Piecewise linear approximations 3 and numerical results 4

3 The considered problem Studied application Unsuitable available methods The problem of tertiary voltage control (TVC) In alternating current: power is a complex number real part = real power imaginary part = reactive power reactive power transmission causes voltage drops and losses need a regulation of the reactive power produced by each generator of an electrical network under some physical laws problem and model provided by Tractebel Engineering

4 Modelling of the problem Studied application Unsuitable available methods 8 >< >: min P k N G w k (Q k obj k ) 2 s.t. P i P ic X P ik X P ik X P ik X P ik = 0, i N ik S s i ik S e i ik T s i ik T e i Q i Q ic + a i ν 2 i Q i0 X Q ik X Q ik X Q ik X Q ik = 0, i N X ik S s i ik S e i ik T s i Q ik = K ik B ν mini ν i ν maxi, a i binary i N P mini P i P maxi, Q mini Q i Q maxi i N G r minik r ik r maxik, r ik E disc discrete ik T θ mini θ i θ maxi, i N ik T e i

5 Studied application Unsuitable available methods Modelling of the problem (continued) where P ik = ν 2 i (y ik cos(ζ ik ) + g ik ) ν i ν k y ik cos(ζ ik + θ i θ k ), Q ik = ν 2 i (y ik sin(ζ ik ) h ik ) ν i ν k y ik sin(ζ ik + θ i θ k ), P ik = ν 2 i r 2 ik y ik cos(ζ ik ) ν i ν k r ik y ik cos(ζ ik + θ i θ k ), Q ik = ν 2 i r 2 ik y ik sin(ζ ik ) ν i ν k r ik y ik sin(ζ ik + θ i θ k ), P ki = ν 2 k (y ik cos(ζ ik ) + g ik ) ν i ν k y ik cos(ζ ik + θ k θ i ), Q ki = ν 2 k (y ik sin(ζ ik ) h ik ) ν i ν k y ik sin(ζ ik + θ k θ i ), P ki = ν 2 k (y ik cos(ζ ik ) + y 0 ik cos(ζ 0ik)) ν i ν k r ik y ik cos(ζ ik + θ k θ i ), Q ki = ν 2 k (y ik sin(ζ ik ) + y 0 ik sin(ζ 0ik )) ν iν k r ik y ik sin(ζ ik + θ k θ i ), ik Si e ik Si e ik Ti e ik Ti e ki Si s ki Si s ki Ti s ki Ti s highly nonlinear, nonconvex

6 Use of discrete variables Studied application Unsuitable available methods a i : binary (i N) variables on/off r ik E disc : discrete (ik T ) e.g.: E disc = {1, 2, 3, 4, 5, 6, 7, 8, 9, 10} the transformer ratio can only be equal to some fixed values Mixed Integer NonConvex Programming problem

7 Motivation Motivations Studied application Unsuitable available methods Current approach: heuristics: Successive solutions of relaxed nonlinear problems wish to work with more reliable/robust methods Idea: use an appropriate linear approximation of the problem

8 Linear suitable function SOS approximation Decomposition of the problem How can we approximate a nonlinear component by a linear function? e.g.: sin

9 Linear suitable function SOS approximation Decomposition of the problem How can we approximate a nonlinear component by a linear function? e.g.: sin not accurate

10 Linear suitable function SOS approximation Decomposition of the problem How can we approximate a nonlinear component by a linear function? e.g.: sin piecewise linear approximation

11 Linear suitable function SOS approximation Decomposition of the problem Approximation by special ordered sets To approximate f (x) by f (x), we use f (x) f (x) = n λ i f (x i ) i=1 where x i are breakpoints, i = 1, n n x = λ i x i i=1 n λ i = 1, λ i 0, i=1 Refs: Beale, Tomlin, Martin i = 1, n

12 SOS condition: motivation Linear suitable function SOS approximation Decomposition of the problem If λ 1 0, λ 5 0 λ i = 0, i = 2,.., 4

13 SOS formulation (1 dimension) Linear suitable function SOS approximation Decomposition of the problem f (x) f (x) = n λ i f (x i ) i=1 where x i are breakpoints, i = 1,.., n n x = λ i x i i=1 n λ i = 1, λ i 0, i=1 SOS type 2 condition: At most 2 λ i can be nonzero. Moreover, these λ i must be adjacent. i = 1,..., n

14 SOS formulation (1 dimension) Linear suitable function SOS approximation Decomposition of the problem f (x) f (x) = n λ i f (x i ) i=1 where x i are breakpoints, i = 1,.., n n x = λ i x i i=1 n λ i = 1, λ i 0, i=1 i = 1,..., n At most 2 λ i can be nonzero. Moreover, these λ i must be adjacent. (LP) (LP) + branching

15 SOS formulation (2 dimensions) Linear suitable function SOS approximation Decomposition of the problem f (x, y) f (x, y) = n i=1 j=1 m λ ij f (x i, y j ) where (x i, y j ) are breakpoints, i = 1,.., n, j = 1,.., m n m x = λ ij x i y = n i=1 j=1 n i=1 j=1 i=1 j=1 m λ ij y j m λ ij = 1, λ ij 0, i = 1,..., n, j = 1,.., m At most 3 λ ij can be nonzero. Moreover, these λ ij must be adjacent on a triangle.

16 Illustration: xy Motivations Linear suitable function SOS approximation Decomposition of the problem On [ 2 : 2] [ 2 : 2] :

17 Illustration: xy Motivations Linear suitable function SOS approximation Decomposition of the problem Approximation by SOS: 3 breakpoints are used in each dimension

18 Illustration: xy Motivations Linear suitable function SOS approximation Decomposition of the problem Dividing the feasible domain into triangles

19 Linear suitable function SOS approximation Decomposition of the problem Approximation by special ordered sets (3 dimensions and more) the same reasoning could be used BUT introduction of a lot of variables into the problem: for k breakpoints in each dimension: 1 dim : k var λ 2 dim : k 2 var λ 3 dim : k 3 var λ... n dim : k n var λ Idea: decompose problem into components of 1 or 2 variables

20 Decomposition of the problem Linear suitable function SOS approximation Decomposition of the problem Computational graph for c = 4x 1 x x 2 x 4 sin(x 3 ) Decomposition of the problem into nonlinear components of 1 or 2 variables Approximation of each of these nonlinear components by new variables Computational graph not unique

21 Main components of the problem Linear suitable function SOS approximation Decomposition of the problem 3 main kinds of nonlinear components: square functions: x 2 trigonometric functions: sin(x), cos(x) bilinear functions: xy

22 Insufficient approximation Linear suitable function SOS approximation Decomposition of the problem Building of a linear approximation problem subject to SOS conditions There exists an efficient method (Martin) solution of an approximation problem the solution of that problem has little chance to be feasible for our our problem physical constraints must be absolutely satisfied use outer approximations to guarantee solution

23 Insufficient approximation Linear suitable function SOS approximation Decomposition of the problem Building of a linear approximation problem subject to SOS conditions There exists an efficient method (Martin) solution of an approximation problem the solution of that problem has little chance to be feasible for our our problem physical constraints must be absolutely satisfied use outer approximations to guarantee solution

24 Insufficient approximation Linear suitable function SOS approximation Decomposition of the problem Building of a linear approximation problem subject to SOS conditions There exists an efficient method (Martin) solution of an approximation problem the solution of that problem has little chance to be feasible for our our problem physical constraints must be absolutely satisfied use outer approximations to guarantee solution

25 Outer approximations Outer approximations Refinement of approximations Algorithm Numerical results Idea: replace each nonlinear component f by a linear domain which includes the nonlinear function.

26 Outer approximations Outer approximations Refinement of approximations Algorithm Numerical results Idea: replace each nonlinear component f by a linear domain which includes the nonlinear function. Idea recently used (Gatzke) Difference: use of linear big M approximations instead of SOS approximations

27 Determination of an outer domain Outer approximations Refinement of approximations Algorithm Numerical results For each component f, compute the approximation errors ɛ L (x i, x i+1 ) = max x [xi,x i+1 ]( f (x) f (x), 0) ɛ U (x i, x i+1 ) = max x [xi,x i+1 ](f (x) f (x), 0) and replace f (x) f (x) by f (x) ɛl (x i, x i+1 ) f (x) f (x) + ɛ U (x i, x i+1 ), x i x x i+1 on each piece

28 Too coarse approximations Outer approximations Refinement of approximations Algorithm Numerical results Results in an outer approximation BUT its solution can be very far from the true solution Need to refine the approximations

29 Refinement of approximations Outer approximations Refinement of approximations Algorithm Numerical results Use of a branch-and-bound tree: reduce the approximation interval, refine the mesh better approximations

30 Refinement of approximations Outer approximations Refinement of approximations Algorithm Numerical results Use of a branch-and-bound tree: reduce the approximation interval, refine the mesh better approximations

31 Refinement of approximations Outer approximations Refinement of approximations Algorithm Numerical results Use of a branch-and-bound tree: reduce the approximation interval, refine the mesh better approximations ideal framework to treat discrete variables 2 types of division guaranteed convergence to the global optimum in the end

32 Outer approximations Refinement of approximations Algorithm Numerical results Choices associated to the branch-and-bound process Choice of the node to refine: depth-first search Choice of the variable to divide: the variable of the starting problem leading to the largest error of approximation not on the SOS variables λ... inefficient Upper bound: the solution of the 1st linear problem is employed as starting point for the NLP problem to generate an upper bound

33 Algorithm Motivations Outer approximations Refinement of approximations Algorithm Numerical results 1 Build an outer approximation problem, (LP 0 ), for (P) k := 0 2 Propagate bounds through the computational graph and compute the approximation errors. Update (LP k ) 3 Solve (LP k ) ( x, f ) If f U the node can be cut, else if x is feasible for (P) and f ( x) < U U = f ( x), x = x and the node can be cut else choose a variable j and divide the pbm (LP k ) into 2 new subproblems 4 If the tree is completely explored: STOP else k := k + 1 choose a node which has not been examined yet and go to 2.

34 Numerical results Motivations Outer approximations Refinement of approximations Algorithm Numerical results Toy problem: (P) no discrete variables min w 1 sin w 4 s.t. 4w 1 w w 2 w 4 sin w 3 1 w 2 0.5w 2 w 4 cos w w w w 3 2π 0 w 4 2π 5 breakpoints for the trigonometric components, 3 for the others approximation problem: 69 variables and 46 constraints

35 Numerical results (continued) Outer approximations Refinement of approximations Algorithm Numerical results Nonlinear local optimization solvers available on NEOS: KO for 87.5% of the solvers Nonlinear global optimization solver, ACRS: OK but random BARON: not applicable due to sin(x), cos(x) Our method: global solution obtained (and proved) after the solution of 103 LP and 2 NLP (ɛ = 10E-6).

36 Future work More tests problems Increase the speed of convergence by improving presolve developing better rules to choose the variable to divide and the place to divide testing finer approximations (quadratic, inequalities of McCormick,...) adding cuts to the problem of approximation Introduction of discrete variables into the problem

37 Conclusion Motivations Promising approach Able to ensure convergence to the global optimum But convergence can be slow Solution of linear problems only But needs the introduction of new variables and constraints into the approximation problem

A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization

A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization Sven Leyffer 2 Annick Sartenaer 1 Emilie Wanufelle 1 1 University of Namur, Belgium 2 Argonne National Laboratory, USA IMA Workshop,

More information

Software for Integer and Nonlinear Optimization

Software for Integer and Nonlinear Optimization Software for Integer and Nonlinear Optimization Sven Leyffer, leyffer@mcs.anl.gov Mathematics & Computer Science Division Argonne National Laboratory Roger Fletcher & Jeff Linderoth Advanced Methods and

More information

Solving Mixed-Integer Nonlinear Programs

Solving Mixed-Integer Nonlinear Programs Solving Mixed-Integer Nonlinear Programs (with SCIP) Ambros M. Gleixner Zuse Institute Berlin MATHEON Berlin Mathematical School 5th Porto Meeting on Mathematics for Industry, April 10 11, 2014, Porto

More information

MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands

MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands Axel Nyberg Åbo Aademi University Ignacio E. Grossmann Dept. of Chemical Engineering, Carnegie Mellon University,

More information

Mixed Integer Non Linear Programming

Mixed Integer Non Linear Programming Mixed Integer Non Linear Programming Claudia D Ambrosio CNRS Research Scientist CNRS & LIX, École Polytechnique MPRO PMA 2016-2017 Outline What is a MINLP? Dealing with nonconvexities Global Optimization

More information

Network Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini

Network Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini In the name of God Network Flows 6. Lagrangian Relaxation 6.3 Lagrangian Relaxation and Integer Programming Fall 2010 Instructor: Dr. Masoud Yaghini Integer Programming Outline Branch-and-Bound Technique

More information

From structures to heuristics to global solvers

From structures to heuristics to global solvers From structures to heuristics to global solvers Timo Berthold Zuse Institute Berlin DFG Research Center MATHEON Mathematics for key technologies OR2013, 04/Sep/13, Rotterdam Outline From structures to

More information

Development of the new MINLP Solver Decogo using SCIP - Status Report

Development of the new MINLP Solver Decogo using SCIP - Status Report Development of the new MINLP Solver Decogo using SCIP - Status Report Pavlo Muts with Norman Breitfeld, Vitali Gintner, Ivo Nowak SCIP Workshop 2018, Aachen Table of contents 1. Introduction 2. Automatic

More information

Integer Programming. Wolfram Wiesemann. December 6, 2007

Integer Programming. Wolfram Wiesemann. December 6, 2007 Integer Programming Wolfram Wiesemann December 6, 2007 Contents of this Lecture Revision: Mixed Integer Programming Problems Branch & Bound Algorithms: The Big Picture Solving MIP s: Complete Enumeration

More information

Multiperiod Blend Scheduling Problem

Multiperiod Blend Scheduling Problem ExxonMobil Multiperiod Blend Scheduling Problem Juan Pablo Ruiz Ignacio E. Grossmann Department of Chemical Engineering Center for Advanced Process Decision-making University Pittsburgh, PA 15213 1 Motivation

More information

An Integrated Approach to Truss Structure Design

An Integrated Approach to Truss Structure Design Slide 1 An Integrated Approach to Truss Structure Design J. N. Hooker Tallys Yunes CPAIOR Workshop on Hybrid Methods for Nonlinear Combinatorial Problems Bologna, June 2010 How to Solve Nonlinear Combinatorial

More information

Implementation of an αbb-type underestimator in the SGO-algorithm

Implementation of an αbb-type underestimator in the SGO-algorithm Implementation of an αbb-type underestimator in the SGO-algorithm Process Design & Systems Engineering November 3, 2010 Refining without branching Could the αbb underestimator be used without an explicit

More information

Solving LP and MIP Models with Piecewise Linear Objective Functions

Solving LP and MIP Models with Piecewise Linear Objective Functions Solving LP and MIP Models with Piecewise Linear Obective Functions Zonghao Gu Gurobi Optimization Inc. Columbus, July 23, 2014 Overview } Introduction } Piecewise linear (PWL) function Convex and convex

More information

Branch Flow Model. Computing + Math Sciences Electrical Engineering

Branch Flow Model. Computing + Math Sciences Electrical Engineering Branch Flow Model Masoud Farivar Steven Low Computing + Math Sciences Electrical Engineering Arpil 014 TPS paper Farivar and Low Branch flow model: relaxations and convexification IEEE Trans. Power Systems,

More information

Outline. 1 Introduction. 2 Modeling and Applications. 3 Algorithms Convex. 4 Algorithms Nonconvex. 5 The Future of MINLP? 2 / 126

Outline. 1 Introduction. 2 Modeling and Applications. 3 Algorithms Convex. 4 Algorithms Nonconvex. 5 The Future of MINLP? 2 / 126 Outline 1 Introduction 2 3 Algorithms Convex 4 Algorithms Nonconvex 5 The Future of MINLP? 2 / 126 Larry Leading Off 3 / 126 Introduction Outline 1 Introduction Software Tools and Online Resources Basic

More information

Optimization Bounds from Binary Decision Diagrams

Optimization Bounds from Binary Decision Diagrams Optimization Bounds from Binary Decision Diagrams J. N. Hooker Joint work with David Bergman, André Ciré, Willem van Hoeve Carnegie Mellon University ICS 203 Binary Decision Diagrams BDDs historically

More information

GLOBAL OPTIMIZATION WITH GAMS/BARON

GLOBAL OPTIMIZATION WITH GAMS/BARON GLOBAL OPTIMIZATION WITH GAMS/BARON Nick Sahinidis Chemical and Biomolecular Engineering University of Illinois at Urbana Mohit Tawarmalani Krannert School of Management Purdue University MIXED-INTEGER

More information

Heuristics and Upper Bounds for a Pooling Problem with Cubic Constraints

Heuristics and Upper Bounds for a Pooling Problem with Cubic Constraints Heuristics and Upper Bounds for a Pooling Problem with Cubic Constraints Matthew J. Real, Shabbir Ahmed, Helder Inàcio and Kevin Norwood School of Chemical & Biomolecular Engineering 311 Ferst Drive, N.W.

More information

Disconnecting Networks via Node Deletions

Disconnecting Networks via Node Deletions 1 / 27 Disconnecting Networks via Node Deletions Exact Interdiction Models and Algorithms Siqian Shen 1 J. Cole Smith 2 R. Goli 2 1 IOE, University of Michigan 2 ISE, University of Florida 2012 INFORMS

More information

Outline. Relaxation. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Lagrangian Relaxation. Lecture 12 Single Machine Models, Column Generation

Outline. Relaxation. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Lagrangian Relaxation. Lecture 12 Single Machine Models, Column Generation Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING 1. Lagrangian Relaxation Lecture 12 Single Machine Models, Column Generation 2. Dantzig-Wolfe Decomposition Dantzig-Wolfe Decomposition Delayed Column

More information

Gestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA

Gestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA Gestion de la production Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA 1 Contents 1 Integer Linear Programming 3 1.1 Definitions and notations......................................

More information

Optimization of a Nonlinear Workload Balancing Problem

Optimization of a Nonlinear Workload Balancing Problem Optimization of a Nonlinear Workload Balancing Problem Stefan Emet Department of Mathematics and Statistics University of Turku Finland Outline of the talk Introduction Some notes on Mathematical Programming

More information

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2017 04 07 Lecture 8 Linear and integer optimization with applications

More information

Online generation via offline selection - Low dimensional linear cuts from QP SDP relaxation -

Online generation via offline selection - Low dimensional linear cuts from QP SDP relaxation - Online generation via offline selection - Low dimensional linear cuts from QP SDP relaxation - Radu Baltean-Lugojan Ruth Misener Computational Optimisation Group Department of Computing Pierre Bonami Andrea

More information

A Fast Heuristic for GO and MINLP

A Fast Heuristic for GO and MINLP A Fast Heuristic for GO and MINLP John W. Chinneck, M. Shafique, Systems and Computer Engineering Carleton University, Ottawa, Canada Introduction Goal: Find a good quality GO/MINLP solution quickly. Trade

More information

A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse

A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse Ted Ralphs 1 Joint work with Menal Güzelsoy 2 and Anahita Hassanzadeh 1 1 COR@L Lab, Department of Industrial

More information

Basic notions of Mixed Integer Non-Linear Programming

Basic notions of Mixed Integer Non-Linear Programming Basic notions of Mixed Integer Non-Linear Programming Claudia D Ambrosio CNRS & LIX, École Polytechnique 5th Porto Meeting on Mathematics for Industry, April 10, 2014 C. D Ambrosio (CNRS) April 10, 2014

More information

A New Penalty-SQP Method

A New Penalty-SQP Method Background and Motivation Illustration of Numerical Results Final Remarks Frank E. Curtis Informs Annual Meeting, October 2008 Background and Motivation Illustration of Numerical Results Final Remarks

More information

An Adaptive Partition-based Approach for Solving Two-stage Stochastic Programs with Fixed Recourse

An Adaptive Partition-based Approach for Solving Two-stage Stochastic Programs with Fixed Recourse An Adaptive Partition-based Approach for Solving Two-stage Stochastic Programs with Fixed Recourse Yongjia Song, James Luedtke Virginia Commonwealth University, Richmond, VA, ysong3@vcu.edu University

More information

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs Computational Integer Programming Lecture 2: Modeling and Formulation Dr. Ted Ralphs Computational MILP Lecture 2 1 Reading for This Lecture N&W Sections I.1.1-I.1.6 Wolsey Chapter 1 CCZ Chapter 2 Computational

More information

MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms

MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms Jeff Linderoth Industrial and Systems Engineering University of Wisconsin-Madison Jonas Schweiger Friedrich-Alexander-Universität

More information

SOLVING INTEGER LINEAR PROGRAMS. 1. Solving the LP relaxation. 2. How to deal with fractional solutions?

SOLVING INTEGER LINEAR PROGRAMS. 1. Solving the LP relaxation. 2. How to deal with fractional solutions? SOLVING INTEGER LINEAR PROGRAMS 1. Solving the LP relaxation. 2. How to deal with fractional solutions? Integer Linear Program: Example max x 1 2x 2 0.5x 3 0.2x 4 x 5 +0.6x 6 s.t. x 1 +2x 2 1 x 1 + x 2

More information

Introduction to Integer Linear Programming

Introduction to Integer Linear Programming Lecture 7/12/2006 p. 1/30 Introduction to Integer Linear Programming Leo Liberti, Ruslan Sadykov LIX, École Polytechnique liberti@lix.polytechnique.fr sadykov@lix.polytechnique.fr Lecture 7/12/2006 p.

More information

Travelling Salesman Problem

Travelling Salesman Problem Travelling Salesman Problem Fabio Furini November 10th, 2014 Travelling Salesman Problem 1 Outline 1 Traveling Salesman Problem Separation Travelling Salesman Problem 2 (Asymmetric) Traveling Salesman

More information

Cutting Planes in SCIP

Cutting Planes in SCIP Cutting Planes in SCIP Kati Wolter Zuse-Institute Berlin Department Optimization Berlin, 6th June 2007 Outline 1 Cutting Planes in SCIP 2 Cutting Planes for the 0-1 Knapsack Problem 2.1 Cover Cuts 2.2

More information

Mixed-Integer Nonlinear Programming

Mixed-Integer Nonlinear Programming Mixed-Integer Nonlinear Programming Claudia D Ambrosio CNRS researcher LIX, École Polytechnique, France pictures taken from slides by Leo Liberti MPRO PMA 2016-2017 Motivating Applications Nonlinear Knapsack

More information

Thermal Unit Commitment Problem

Thermal Unit Commitment Problem Thermal Unit Commitment Problem Moshe Potsane, Luyanda Ndlovu, Simphiwe Simelane Christiana Obagbuwa, Jesal Kika, Nadine Padayachi, Luke O. Joel Lady Kokela, Michael Olusanya, Martins Arasomwa, Sunday

More information

Applications and algorithms for mixed integer nonlinear programming

Applications and algorithms for mixed integer nonlinear programming Applications and algorithms for mixed integer nonlinear programming Sven Leyffer 1, Jeff Linderoth 2, James Luedtke 2, Andrew Miller 3, Todd Munson 1 1 Mathematics and Computer Science Division, Argonne

More information

5 Integer Linear Programming (ILP) E. Amaldi Foundations of Operations Research Politecnico di Milano 1

5 Integer Linear Programming (ILP) E. Amaldi Foundations of Operations Research Politecnico di Milano 1 5 Integer Linear Programming (ILP) E. Amaldi Foundations of Operations Research Politecnico di Milano 1 Definition: An Integer Linear Programming problem is an optimization problem of the form (ILP) min

More information

Analyzing the computational impact of individual MINLP solver components

Analyzing the computational impact of individual MINLP solver components Analyzing the computational impact of individual MINLP solver components Ambros M. Gleixner joint work with Stefan Vigerske Zuse Institute Berlin MATHEON Berlin Mathematical School MINLP 2014, June 4,

More information

Introduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 21 Dr. Ted Ralphs IE406 Lecture 21 1 Reading for This Lecture Bertsimas Sections 10.2, 10.3, 11.1, 11.2 IE406 Lecture 21 2 Branch and Bound Branch

More information

Integer and Combinatorial Optimization: Introduction

Integer and Combinatorial Optimization: Introduction Integer and Combinatorial Optimization: Introduction John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA November 2018 Mitchell Introduction 1 / 18 Integer and Combinatorial Optimization

More information

There are several approaches to solve UBQP, we will now briefly discuss some of them:

There are several approaches to solve UBQP, we will now briefly discuss some of them: 3 Related Work There are several approaches to solve UBQP, we will now briefly discuss some of them: Since some of them are actually algorithms for the Max Cut problem (MC), it is necessary to show their

More information

4y Springer NONLINEAR INTEGER PROGRAMMING

4y Springer NONLINEAR INTEGER PROGRAMMING NONLINEAR INTEGER PROGRAMMING DUAN LI Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, N. T. Hong Kong XIAOLING SUN Department of Mathematics Shanghai

More information

Preliminaries Overview OPF and Extensions. Convex Optimization. Lecture 8 - Applications in Smart Grids. Instructor: Yuanzhang Xiao

Preliminaries Overview OPF and Extensions. Convex Optimization. Lecture 8 - Applications in Smart Grids. Instructor: Yuanzhang Xiao Convex Optimization Lecture 8 - Applications in Smart Grids Instructor: Yuanzhang Xiao University of Hawaii at Manoa Fall 2017 1 / 32 Today s Lecture 1 Generalized Inequalities and Semidefinite Programming

More information

Resource Constrained Project Scheduling Linear and Integer Programming (1)

Resource Constrained Project Scheduling Linear and Integer Programming (1) DM204, 2010 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 Resource Constrained Project Linear and Integer Programming (1) Marco Chiarandini Department of Mathematics & Computer Science University of Southern

More information

Controlling variability in power systems

Controlling variability in power systems Daniel APAM Nov 17 2017 A simple example: 100 100 A simple example: 100 100 Only one solution: 200 100 200 100 100 100 A simple example: 100 100 Only one solution: 200 100 200 100 100 100 But what if the

More information

Alternative Methods for Obtaining. Optimization Bounds. AFOSR Program Review, April Carnegie Mellon University. Grant FA

Alternative Methods for Obtaining. Optimization Bounds. AFOSR Program Review, April Carnegie Mellon University. Grant FA Alternative Methods for Obtaining Optimization Bounds J. N. Hooker Carnegie Mellon University AFOSR Program Review, April 2012 Grant FA9550-11-1-0180 Integrating OR and CP/AI Early support by AFOSR First

More information

ELE539A: Optimization of Communication Systems Lecture 16: Pareto Optimization and Nonconvex Optimization

ELE539A: Optimization of Communication Systems Lecture 16: Pareto Optimization and Nonconvex Optimization ELE539A: Optimization of Communication Systems Lecture 16: Pareto Optimization and Nonconvex Optimization Professor M. Chiang Electrical Engineering Department, Princeton University March 16, 2007 Lecture

More information

Numerical Optimization. Review: Unconstrained Optimization

Numerical Optimization. Review: Unconstrained Optimization Numerical Optimization Finding the best feasible solution Edward P. Gatzke Department of Chemical Engineering University of South Carolina Ed Gatzke (USC CHE ) Numerical Optimization ECHE 589, Spring 2011

More information

where X is the feasible region, i.e., the set of the feasible solutions.

where X is the feasible region, i.e., the set of the feasible solutions. 3.5 Branch and Bound Consider a generic Discrete Optimization problem (P) z = max{c(x) : x X }, where X is the feasible region, i.e., the set of the feasible solutions. Branch and Bound is a general semi-enumerative

More information

Deterministic Global Optimization Algorithm and Nonlinear Dynamics

Deterministic Global Optimization Algorithm and Nonlinear Dynamics Deterministic Global Optimization Algorithm and Nonlinear Dynamics C. S. Adjiman and I. Papamichail Centre for Process Systems Engineering Department of Chemical Engineering and Chemical Technology Imperial

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models David Sontag New York University Lecture 6, March 7, 2013 David Sontag (NYU) Graphical Models Lecture 6, March 7, 2013 1 / 25 Today s lecture 1 Dual decomposition 2 MAP inference

More information

Lecture 23 Branch-and-Bound Algorithm. November 3, 2009

Lecture 23 Branch-and-Bound Algorithm. November 3, 2009 Branch-and-Bound Algorithm November 3, 2009 Outline Lecture 23 Modeling aspect: Either-Or requirement Special ILPs: Totally unimodular matrices Branch-and-Bound Algorithm Underlying idea Terminology Formal

More information

Discrete Inference and Learning Lecture 3

Discrete Inference and Learning Lecture 3 Discrete Inference and Learning Lecture 3 MVA 2017 2018 h

More information

IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique.

IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique. IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, 31 14. You wish to solve the IP below with a cutting plane technique. Maximize 4x 1 + 2x 2 + x 3 subject to 14x 1 + 10x 2 + 11x 3 32 10x 1 +

More information

Topics in Theoretical Computer Science April 08, Lecture 8

Topics in Theoretical Computer Science April 08, Lecture 8 Topics in Theoretical Computer Science April 08, 204 Lecture 8 Lecturer: Ola Svensson Scribes: David Leydier and Samuel Grütter Introduction In this lecture we will introduce Linear Programming. It was

More information

Decomposition-based Methods for Large-scale Discrete Optimization p.1

Decomposition-based Methods for Large-scale Discrete Optimization p.1 Decomposition-based Methods for Large-scale Discrete Optimization Matthew V Galati Ted K Ralphs Department of Industrial and Systems Engineering Lehigh University, Bethlehem, PA, USA Départment de Mathématiques

More information

Advances in Bayesian Network Learning using Integer Programming

Advances in Bayesian Network Learning using Integer Programming Advances in Bayesian Network Learning using Integer Programming Mark Bartlett and James Cussens UAI-13, 2013-07-12 Supported by the UK Medical Research Council (Project Grant G1002312) Mark Bartlett and

More information

The Pooling Problem - Applications, Complexity and Solution Methods

The Pooling Problem - Applications, Complexity and Solution Methods The Pooling Problem - Applications, Complexity and Solution Methods Dag Haugland Dept. of Informatics University of Bergen Norway EECS Seminar on Optimization and Computing NTNU, September 30, 2014 Outline

More information

Column Generation. i = 1,, 255;

Column Generation. i = 1,, 255; Column Generation The idea of the column generation can be motivated by the trim-loss problem: We receive an order to cut 50 pieces of.5-meter (pipe) segments, 250 pieces of 2-meter segments, and 200 pieces

More information

Stochastic Decision Diagrams

Stochastic Decision Diagrams Stochastic Decision Diagrams John Hooker CORS/INFORMS Montréal June 2015 Objective Relaxed decision diagrams provide an generalpurpose method for discrete optimization. When the problem has a dynamic programming

More information

Section Notes 8. Integer Programming II. Applied Math 121. Week of April 5, expand your knowledge of big M s and logical constraints.

Section Notes 8. Integer Programming II. Applied Math 121. Week of April 5, expand your knowledge of big M s and logical constraints. Section Notes 8 Integer Programming II Applied Math 121 Week of April 5, 2010 Goals for the week understand IP relaxations be able to determine the relative strength of formulations understand the branch

More information

A Decomposition-based MINLP Solution Method Using Piecewise Linear Relaxations

A Decomposition-based MINLP Solution Method Using Piecewise Linear Relaxations A Decomposition-based MINLP Solution Method Using Piecewise Linear Relaxations Pradeep K. Polisetty and Edward P. Gatzke 1 Department of Chemical Engineering University of South Carolina Columbia, SC 29208

More information

Some Recent Advances in Mixed-Integer Nonlinear Programming

Some Recent Advances in Mixed-Integer Nonlinear Programming Some Recent Advances in Mixed-Integer Nonlinear Programming Andreas Wächter IBM T.J. Watson Research Center Yorktown Heights, New York andreasw@us.ibm.com SIAM Conference on Optimization 2008 Boston, MA

More information

Scenario grouping and decomposition algorithms for chance-constrained programs

Scenario grouping and decomposition algorithms for chance-constrained programs Scenario grouping and decomposition algorithms for chance-constrained programs Yan Deng Shabbir Ahmed Jon Lee Siqian Shen Abstract A lower bound for a finite-scenario chance-constrained problem is given

More information

Optimisation and Operations Research

Optimisation and Operations Research Optimisation and Operations Research Lecture 11: Integer Programming Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/ School of Mathematical

More information

A Unified View of Piecewise Linear Neural Network Verification Supplementary Materials

A Unified View of Piecewise Linear Neural Network Verification Supplementary Materials A Unified View of Piecewise Linear Neural Network Verification Supplementary Materials Rudy Bunel University of Oxford rudy@robots.ox.ac.uk Ilker Turkaslan University of Oxford ilker.turkaslan@lmh.ox.ac.uk

More information

to work with) can be solved by solving their LP relaxations with the Simplex method I Cutting plane algorithms, e.g., Gomory s fractional cutting

to work with) can be solved by solving their LP relaxations with the Simplex method I Cutting plane algorithms, e.g., Gomory s fractional cutting Summary so far z =max{c T x : Ax apple b, x 2 Z n +} I Modeling with IP (and MIP, and BIP) problems I Formulation for a discrete set that is a feasible region of an IP I Alternative formulations for the

More information

CS Algorithms and Complexity

CS Algorithms and Complexity CS 50 - Algorithms and Complexity Linear Programming, the Simplex Method, and Hard Problems Sean Anderson 2/15/18 Portland State University Table of contents 1. The Simplex Method 2. The Graph Problem

More information

MINLP in Air Traffic Management: aircraft conflict avoidance

MINLP in Air Traffic Management: aircraft conflict avoidance MINLP in Air Traffic Management: aircraft conflict avoidance Sonia Cafieri ENAC - École Nationale de l Aviation Civile University of Toulouse France thanks to: Riadh Omheni (ENAC, Toulouse) David Rey (New

More information

New Developments on OPF Problems. Daniel Bienstock, Columbia University. April 2016

New Developments on OPF Problems. Daniel Bienstock, Columbia University. April 2016 New Developments on OPF Problems Daniel Bienstock, Columbia University April 2016 Organization: Intro to OPF and basic modern mathematics related to OPF Newer results, including basic methodologies for

More information

Feasibility Pump for Mixed Integer Nonlinear Programs 1

Feasibility Pump for Mixed Integer Nonlinear Programs 1 Feasibility Pump for Mixed Integer Nonlinear Programs 1 Presenter: 1 by Pierre Bonami, Gerard Cornuejols, Andrea Lodi and Francois Margot Mixed Integer Linear or Nonlinear Programs (MILP/MINLP) Optimize

More information

On mathematical programming with indicator constraints

On mathematical programming with indicator constraints On mathematical programming with indicator constraints Andrea Lodi joint work with P. Bonami & A. Tramontani (IBM), S. Wiese (Unibo) University of Bologna, Italy École Polytechnique de Montréal, Québec,

More information

A MIXED INTEGER DISJUNCTIVE MODEL FOR TRANSMISSION NETWORK EXPANSION

A MIXED INTEGER DISJUNCTIVE MODEL FOR TRANSMISSION NETWORK EXPANSION A MIXED INTEGER DISJUNCTIVE MODEL FOR TRANSMISSION NETWORK EXPANSION Laura Bahiense*, Gerson C. Oliveira (PUC/Rio), Mario Pereira*, Member, Sergio Granville*, Member Abstract: The classical non-linear

More information

Column Generation for Extended Formulations

Column Generation for Extended Formulations 1 / 28 Column Generation for Extended Formulations Ruslan Sadykov 1 François Vanderbeck 2,1 1 INRIA Bordeaux Sud-Ouest, France 2 University Bordeaux I, France ISMP 2012 Berlin, August 23 2 / 28 Contents

More information

Optimization in Process Systems Engineering

Optimization in Process Systems Engineering Optimization in Process Systems Engineering M.Sc. Jan Kronqvist Process Design & Systems Engineering Laboratory Faculty of Science and Engineering Åbo Akademi University Most optimization problems in production

More information

Bilinear Programming: Applications in the Supply Chain Management

Bilinear Programming: Applications in the Supply Chain Management Bilinear Programming: Applications in the Supply Chain Management Artyom G. Nahapetyan Center for Applied Optimization Industrial and Systems Engineering Department University of Florida Gainesville, Florida

More information

Generation and Representation of Piecewise Polyhedral Value Functions

Generation and Representation of Piecewise Polyhedral Value Functions Generation and Representation of Piecewise Polyhedral Value Functions Ted Ralphs 1 Joint work with Menal Güzelsoy 2 and Anahita Hassanzadeh 1 1 COR@L Lab, Department of Industrial and Systems Engineering,

More information

Benders Decomposition

Benders Decomposition Benders Decomposition Yuping Huang, Dr. Qipeng Phil Zheng Department of Industrial and Management Systems Engineering West Virginia University IENG 593G Nonlinear Programg, Spring 2012 Yuping Huang (IMSE@WVU)

More information

Strong SOCP Relaxations for the Optimal Power Flow Problem

Strong SOCP Relaxations for the Optimal Power Flow Problem Strong SOCP Relaxations for the Optimal Power Flow Problem Burak Kocuk, Santanu S. Dey, X. Andy Sun October 30, 2015 Abstract This paper proposes three strong second order cone programming (SOCP) relaxations

More information

Stochastic Dual Dynamic Integer Programming

Stochastic Dual Dynamic Integer Programming Stochastic Dual Dynamic Integer Programming Jikai Zou Shabbir Ahmed Xu Andy Sun December 26, 2017 Abstract Multistage stochastic integer programming (MSIP) combines the difficulty of uncertainty, dynamics,

More information

Optimization Exercise Set n.5 :

Optimization Exercise Set n.5 : Optimization Exercise Set n.5 : Prepared by S. Coniglio translated by O. Jabali 2016/2017 1 5.1 Airport location In air transportation, usually there is not a direct connection between every pair of airports.

More information

Chapter 6 Constraint Satisfaction Problems

Chapter 6 Constraint Satisfaction Problems Chapter 6 Constraint Satisfaction Problems CS5811 - Artificial Intelligence Nilufer Onder Department of Computer Science Michigan Technological University Outline CSP problem definition Backtracking search

More information

Indicator Constraints in Mixed-Integer Programming

Indicator Constraints in Mixed-Integer Programming Indicator Constraints in Mixed-Integer Programming Andrea Lodi University of Bologna, Italy - andrea.lodi@unibo.it Amaya Nogales-Gómez, Universidad de Sevilla, Spain Pietro Belotti, FICO, UK Matteo Fischetti,

More information

Chapter 7 Network Flow Problems, I

Chapter 7 Network Flow Problems, I Chapter 7 Network Flow Problems, I Network flow problems are the most frequently solved linear programming problems. They include as special cases, the assignment, transportation, maximum flow, and shortest

More information

Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions

Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions Juan Pablo Vielma H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Joint

More information

CHAPTER 3: INTEGER PROGRAMMING

CHAPTER 3: INTEGER PROGRAMMING CHAPTER 3: INTEGER PROGRAMMING Overview To this point, we have considered optimization problems with continuous design variables. That is, the design variables can take any value within a continuous feasible

More information

Lifted Inequalities for 0 1 Mixed-Integer Bilinear Covering Sets

Lifted Inequalities for 0 1 Mixed-Integer Bilinear Covering Sets 1 2 3 Lifted Inequalities for 0 1 Mixed-Integer Bilinear Covering Sets Kwanghun Chung 1, Jean-Philippe P. Richard 2, Mohit Tawarmalani 3 March 1, 2011 4 5 6 7 8 9 Abstract In this paper, we study 0 1 mixed-integer

More information

On handling indicator constraints in mixed integer programming

On handling indicator constraints in mixed integer programming Comput Optim Appl (2016) 65:545 566 DOI 10.1007/s10589-016-9847-8 On handling indicator constraints in mixed integer programming Pietro Belotti 1 Pierre Bonami 2 Matteo Fischetti 3 Andrea Lodi 4,5 Michele

More information

PART 4 INTEGER PROGRAMMING

PART 4 INTEGER PROGRAMMING PART 4 INTEGER PROGRAMMING 102 Read Chapters 11 and 12 in textbook 103 A capital budgeting problem We want to invest $19 000 Four investment opportunities which cannot be split (take it or leave it) 1.

More information

Integer Programming for Bayesian Network Structure Learning

Integer Programming for Bayesian Network Structure Learning Integer Programming for Bayesian Network Structure Learning James Cussens Prague, 2013-09-02 Supported by the UK Medical Research Council (Project Grant G1002312) James Cussens IP for BNs Prague, 2013-09-02

More information

Mixed-Integer PDE-Constrained Optimization

Mixed-Integer PDE-Constrained Optimization Mixed-Integer PDE-Constrained Optimization IMA Workshop on Uncertainty Quantification Pelin Cay, Bart van Bloemen Waanders, Drew Kouri, Anna Thuenen and Sven Leyffer Lehigh University, Universität Magdeburg,

More information

23. Cutting planes and branch & bound

23. Cutting planes and branch & bound CS/ECE/ISyE 524 Introduction to Optimization Spring 207 8 23. Cutting planes and branch & bound ˆ Algorithms for solving MIPs ˆ Cutting plane methods ˆ Branch and bound methods Laurent Lessard (www.laurentlessard.com)

More information

Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows

Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows Guy Desaulniers École Polytechnique de Montréal and GERAD Column Generation 2008 Aussois, France Outline Introduction

More information

is called an integer programming (IP) problem. model is called a mixed integer programming (MIP)

is called an integer programming (IP) problem. model is called a mixed integer programming (MIP) INTEGER PROGRAMMING Integer Programming g In many problems the decision variables must have integer values. Example: assign people, machines, and vehicles to activities in integer quantities. If this is

More information

Outline. Outline. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Scheduling CPM/PERT Resource Constrained Project Scheduling Model

Outline. Outline. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Scheduling CPM/PERT Resource Constrained Project Scheduling Model Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 and Mixed Integer Programg Marco Chiarandini 1. Resource Constrained Project Model 2. Mathematical Programg 2 Outline Outline 1. Resource Constrained

More information

Integer Programming for Bayesian Network Structure Learning

Integer Programming for Bayesian Network Structure Learning Integer Programming for Bayesian Network Structure Learning James Cussens Helsinki, 2013-04-09 James Cussens IP for BNs Helsinki, 2013-04-09 1 / 20 Linear programming The Belgian diet problem Fat Sugar

More information

Improvements to Benders' decomposition: systematic classification and performance comparison in a Transmission Expansion Planning problem

Improvements to Benders' decomposition: systematic classification and performance comparison in a Transmission Expansion Planning problem Improvements to Benders' decomposition: systematic classification and performance comparison in a Transmission Expansion Planning problem Sara Lumbreras & Andrés Ramos July 2013 Agenda Motivation improvement

More information

Introduction to Limits

Introduction to Limits MATH 136 Introduction to Limits Given a function y = f (x), we wish to describe the behavior of the function as the variable x approaches a particular value a. We should be as specific as possible in describing

More information