Relaxations of multilinear convex envelopes: dual is better than primal

Size: px
Start display at page:

Download "Relaxations of multilinear convex envelopes: dual is better than primal"

Transcription

1 of multilinear convex envelopes: dual is better than primal 1 LIX, École Polytechnique, Palaiseau, France June 7th, th International Symposium on Experimental Algorithms (SEA) Bordeaux (France) of multilinear convex envelopes: dual is better than p

2 1 Definitions Multilinear terms Applications of multilinear convex envelopes: dual is better than p

3 1 Definitions Multilinear terms Applications 2 of multilinear convex envelopes: dual is better than p

4 1 Definitions Multilinear terms Applications 2 3 of multilinear convex envelopes: dual is better than p

5 1 Definitions Multilinear terms Applications of multilinear convex envelopes: dual is better than p

6 Where are we? Definitions Multilinear terms Applications 1 Definitions Multilinear terms Applications of multilinear convex envelopes: dual is better than p

7 Convex sets Definitions Multilinear terms Applications Let S R n be non-empty of multilinear convex envelopes: dual is better than p

8 Convex sets Definitions Multilinear terms Applications Let S R n be non-empty Any convex set containing S is a convex relaxation of S of multilinear convex envelopes: dual is better than p

9 Convex sets Definitions Multilinear terms Applications Let S R n be non-empty Any convex set containing S is a convex relaxation of S The convex hull convs of S is the intersection of all convex relaxations of S relaxation hull of multilinear convex envelopes: dual is better than p

10 Convex functions Definitions Multilinear terms Applications Let C R n be convex and compact of multilinear convex envelopes: dual is better than p

11 Convex functions Definitions Multilinear terms Applications Let C R n be convex and compact Let f : C R be lower semicontinuous of multilinear convex envelopes: dual is better than p

12 Convex functions Definitions Multilinear terms Applications Let C R n be convex and compact Let f : C R be lower semicontinuous Any convex function underestimating f is a convex relaxation of f of multilinear convex envelopes: dual is better than p

13 Convex functions Definitions Multilinear terms Applications Let C R n be convex and compact Let f : C R be lower semicontinuous Any convex function underestimating f is a convex relaxation of f The convex envelope convf of f is the pointwise supremum of all convex underestimators of f of multilinear convex envelopes: dual is better than p

14 Definitions Definitions Multilinear terms Applications x = (x 1,...,x k ) some decision variables of multilinear convex envelopes: dual is better than p

15 Definitions Definitions Multilinear terms Applications x = (x 1,...,x k ) some decision variables Assume finite variable bounds x L x x U of multilinear convex envelopes: dual is better than p

16 Definitions Definitions Multilinear terms Applications x = (x 1,...,x k ) some decision variables Assume finite variable bounds x L x x U The function w(x) = x 1 x 2 x k is a multilinear term of multilinear convex envelopes: dual is better than p

17 Definitions Definitions Multilinear terms Applications x = (x 1,...,x k ) some decision variables Assume finite variable bounds x L x x U The function w(x) = x 1 x 2 x k is a multilinear term If k 1 vars are fixed, w is a linear function of 1 var of multilinear convex envelopes: dual is better than p

18 Definitions Definitions Multilinear terms Applications x = (x 1,...,x k ) some decision variables Assume finite variable bounds x L x x U The function w(x) = x 1 x 2 x k is a multilinear term If k 1 vars are fixed, w is a linear function of 1 var Smallest nontrivial case: w(x) = x 1 x 2 (bilinear term) of multilinear convex envelopes: dual is better than p

19 Some applications Definitions Multilinear terms Applications Process synthesis in chemical engineering (e.g., Haverly s pooling problems [Haverly; ACM SIGMAP Bull., 1978]) of multilinear convex envelopes: dual is better than p

20 Some applications Definitions Multilinear terms Applications Process synthesis in chemical engineering (e.g., Haverly s pooling problems [Haverly; ACM SIGMAP Bull., 1978]) Molecular Distance Geometry Problem (MDGP) [Liberti et al.; ITOR, JOGO, ITOR, JOGO, OPTL, 2011] of multilinear convex envelopes: dual is better than p

21 Some applications Definitions Multilinear terms Applications Process synthesis in chemical engineering (e.g., Haverly s pooling problems [Haverly; ACM SIGMAP Bull., 1978]) Molecular Distance Geometry Problem (MDGP) [Liberti et al.; ITOR, JOGO, ITOR, JOGO, OPTL, 2011] Multilinear Least-Squares (MLLS) [Paatero; JCGS, 1999] of multilinear convex envelopes: dual is better than p

22 Haverly s pooling problem Definitions Multilinear terms Applications Inputs x 11 3% Sulphur $ 6 y 11 Blend 1 Outputs 2.5% Sulphur $ 9 Demands 100 Pool x 21 1% Sulphur $ 16 y 12 y 21 2% Sulphur 1.5% Sulphur x 12 Blend $ 10 y $ Find oil routing minimizing costs and satisfying mass+sulphur balance, quantity and quality demands of multilinear convex envelopes: dual is better than p

23 Haverly s pooling problem Definitions Multilinear terms Applications Inputs x 11 3% Sulphur $ 6 y 11 Blend 1 Outputs 2.5% Sulphur $ 9 Demands 100 Pool x 21 1% Sulphur $ 16 y 12 y 21 2% Sulphur 1.5% Sulphur x 12 Blend $ 10 y $ Find oil routing minimizing costs and satisfying mass+sulphur balance, quantity and quality demands Decision variables: input quantities x, routed quantities y, percentage p of sulphur in pool of multilinear convex envelopes: dual is better than p

24 Haverly s pooling problem Definitions Multilinear terms Applications Inputs x 11 3% Sulphur $ 6 y 11 Blend 1 Outputs 2.5% Sulphur $ 9 Demands 100 Pool x 21 1% Sulphur $ 16 y 12 y 21 x 12 2% Sulphur $ 10 y 22 Blend 2 1.5% Sulphur Find oil routing minimizing costs and satisfying mass+sulphur balance, quantity and quality demands $ Decision variables: input quantities x, routed quantities y, percentage p of sulphur in pool Sulphur balance: 3x 11 +x 21 = p(y 11 +y 12 ) Quality demands (blend 1): py 11 +2y (y 11 +y 21 ) of multilinear convex envelopes: dual is better than p

25 Molecular Distance Geometry Definitions Multilinear terms Applications Known set of atoms V, determine 3D structure of multilinear convex envelopes: dual is better than p

26 Molecular Distance Geometry Definitions Multilinear terms Applications Known set of atoms V, determine 3D structure Some inter-atomic distances d ij known (NMR) of multilinear convex envelopes: dual is better than p

27 Molecular Distance Geometry Definitions Multilinear terms Applications Known set of atoms V, determine 3D structure Some inter-atomic distances d ij known (NMR) Find atomic positions x i R 3 preserving given distances given weighted graph G = (V,E,d), find embedding in R 3 of multilinear convex envelopes: dual is better than p

28 Molecular Distance Geometry Definitions Multilinear terms Applications Known set of atoms V, determine 3D structure Some inter-atomic distances d ij known (NMR) Find atomic positions x i R 3 preserving given distances given weighted graph G = (V,E,d), find embedding in R 3 of multilinear convex envelopes: dual is better than p

29 Molecular Distance Geometry Definitions Multilinear terms Applications Known set of atoms V, determine 3D structure Some inter-atomic distances d ij known (NMR) Find atomic positions x i R 3 preserving given distances given weighted graph G = (V,E,d), find embedding in R 3 Continuous quartic formulation: min ( x i x j 2 d 2 x ij )2 {i,j} E involves quadrilinear terms of multilinear convex envelopes: dual is better than p

30 Multilinear Least Squares Definitions Multilinear terms Applications Decision variables x 1,...,x n Sampled data d 1,...,d m Theoretical model: i m d i = l L i where L l {1,...,n} for all l j J l x j Minimize error Q p = d ( l L i j J l x j i m) p, where p N { } With 1 or norms, get multilinear terms of multilinear convex envelopes: dual is better than p

31 Where are we? 1 Definitions Multilinear terms Applications of multilinear convex envelopes: dual is better than p

32 Relaxing problems having multilinear terms Two ways to relax multilinear terms are presented and compared: of multilinear convex envelopes: dual is better than p

33 Relaxing problems having multilinear terms Two ways to relax multilinear terms are presented and compared: of multilinear convex envelopes: dual is better than p

34 Relaxing problems having multilinear terms Two ways to relax multilinear terms are presented and compared: of multilinear convex envelopes: dual is better than p

35 For the general case, convex envelopes for multilinear terms are available explicitly in function of x L,x U for k = 2,3 and partly k = 4 of multilinear convex envelopes: dual is better than p

36 For the general case, convex envelopes for multilinear terms are available explicitly in function of x L,x U for k = 2,3 and partly k = 4 They consist of sets of constraints to be adjoined to the Mathematical Programming formulation of multilinear convex envelopes: dual is better than p

37 For the general case, convex envelopes for multilinear terms are available explicitly in function of x L,x U for k = 2,3 and partly k = 4 They consist of sets of constraints to be adjoined to the Mathematical Programming formulation No further variables are needed of multilinear convex envelopes: dual is better than p

38 Bilinear terms: McCormick s inequalities Let W = {(w,x 1,x 2 ) w = x 1 x 2 (x 1,x 2 ) = [x L,x U ]}, then conv(w) is given by: w x L 1x 2 +x L 2x 1 x L 1x L 2 w x U 1 x 2 +x U 2 x 1 x U 1 x U 2 w x L 1x 2 +x U 2 x 1 x L 1x U 2 w x U 1 x 2 +x L 2x 1 x U 1 x L 2 Stated [McCormick; MP, 1976], proved [Al-Khayyal, Falk; MOR, 1983] of multilinear convex envelopes: dual is better than p

39 McCormick s envelopes Lower envelopes Upper envelopes Both of multilinear convex envelopes: dual is better than p

40 Special case: Fortet s linearization If x 1 and x 2 are binary variables, the McCormick s inequalities lead to the Fortet s inequalities [Fortet; RFRO, 1960]: w 0 w x 2 +x 1 1 w x 1 w x 2 The resulting reformulation is an exact linearization as shown in [Liberti; RAIRO-RO, 2009] of multilinear convex envelopes: dual is better than p

41 Trilinear case It is not as easy as bilinear convex relaxation: of multilinear convex envelopes: dual is better than p

42 Trilinear case It is not as easy as bilinear convex relaxation: the number of constraints is greater than 4 of multilinear convex envelopes: dual is better than p

43 Trilinear case It is not as easy as bilinear convex relaxation: the number of constraints is greater than 4 there are several cases, depending on sign of bounds of the variables: x L i xu i 0 [Meyer, Floudas; 2003]; mixed case [Meyer, Floudas; JOGO, 2004] of multilinear convex envelopes: dual is better than p

44 Trilinear case It is not as easy as bilinear convex relaxation: the number of constraints is greater than 4 there are several cases, depending on sign of bounds of the variables: x L i xu i 0 [Meyer, Floudas; 2003]; mixed case [Meyer, Floudas; JOGO, 2004] there are further conditions to check of multilinear convex envelopes: dual is better than p

45 Example (1): x U 1, x U 2, x U 3 0 Permute variables x 1, x 2 and x 3 such that: x U 1 x L 2x L 3 +x L 1x U 2 x U 3 x L 1x U 2 x L 3 +x U 1 x L 2x U 3 x U 1 x L 2x L 3 +x L 1x U 2 x U 3 x U 1 x U 2 x L 3 +x L 1x L 2x U 3 of multilinear convex envelopes: dual is better than p

46 Example (1): x U 1, x U 2, x U 3 0 Permute variables x 1, x 2 and x 3 such that: Lower envelope: x U 1 x L 2x L 3 +x L 1x U 2 x U 3 x L 1x U 2 x L 3 +x U 1 x L 2x U 3 x U 1 x L 2x L 3 +x L 1x U 2 x U 3 x U 1 x U 2 x L 3 +x L 1x L 2x U 3 w x L 2x L 3x 1 +x L 1x L 3x 2 +x L 1x L 2x 3 2x L 1x L 2x L 3 w x U 2 x U 3 x 1 +x U 1 x U 3 x 2 +x U 1 x U 2 x 3 2x U 1 x U 2 x U 3 w x L 2 xu 3 x 1 +x L 1 xu 3 x 2 +x U 1 xl 2 x 3 x L 1 xl 2 xu 3 xu 1 xl 2 xu 3 w x U 2 x L 3x 1 +x U 1 x L 3x 2 +x L 1x U 2 x 3 x U 1 x U 2 x L 3 x L 1x U 2 x L 3 w c 1 x 1 +x U 1 x L 3x 2 +x U 1 x L 2x 3 +x L 1x U 2 x U 3 c 1 x L 1 x U 1 x U 2 x L 3 x U 1 x L 2x U 3 w c 2 x 1 +x L 1x U 3 x 2 +x L 1x U 2 x 3 +x U 1 x L 2x L 3 c 2 x U 1 x L 1x L 2x U 3 x L 1x U 2 x L 3, where c 1 = xu 1 xu 2 xl 3 xl 1 xu 2 xu 3 xu 1 xl 2 xl 3 +xu 1 xl 2 xu 3 x U 1 xl 1 and c 2 = xl 1 xl 2 xu 3 xu 1 xl 2 xl 3 xl 1 xu 2 xu 3 +xl 1 xu 2 xl 3 x L 1 xu 1 of multilinear convex envelopes: dual is better than p

47 Example (2): x U 1, x U 2, x U 3 0 Upper envelope: w x L 2x L 3x 1 +x U 1 x L 3x 2 +x U 1 x U 2 x 3 x U 1 x U 2 x L 3 x U 1 x L 2x L 3 w x U 2 x L 3x 1 +x L 1x L 3x 2 +x U 1 x U 2 x 3 x U 1 x U 2 x L 3 x L 1x U 2 x L 3 w x L 2x L 3x 1 +x U 1 x U 3 x 2 +x U 1 x L 2x 3 x U 1 x L 2x U 3 x U 1 x L 2x L 3 w x U 2 x U 3 x 1 +x L 1x L 3x 2 +x L 1x U 2 x 3 x L 1x U 2 x U 3 x L 1x U 2 x L 3 w x L 2x U 3 x 1 +x U 1 x U 3 x 2 +x L 1x L 2x 3 x U 1 x L 2x U 3 x L 1x L 2x U 3 w x U 2 x U 3 x 1 +x L 1x U 3 x 2 +x L 1x L 2x 3 x L 1x U 2 x U 3 x L 1x L 2x U 3. of multilinear convex envelopes: dual is better than p

48 Quadrilinear terms The convex envelope is not known explicitly for quadrilinear terms Combine bilinear and trilinear envelope [Cafieri, Lee, Liberti; JOGO, 2011] Convex envelope for some cases presented in [Balram; M.Sc. Thesis, 2019] (e.g., when x L 1, xl 2, xl 3, xl 4 0, then 44 constraints are generated) of multilinear convex envelopes: dual is better than p

49 Tighter relaxations by associativity Write w = x 1 x 2 x 3 x 4 as: 1 (x 1 x 2 )x 3 x 4 (tri(bi,1,1)) 2 (x 1 x 2 x 3 )x 4 (bi(tri,1)) 3 (x 1 x 2 )(x 3 x 4 ) (bi(bi(1,1),bi(1,1))) 4 ((x 1 x 2 )x 3 )x 4 (bi(bi(bi(1,1),1),1)) of multilinear convex envelopes: dual is better than p

50 Tighter relaxations by associativity Write w = x 1 x 2 x 3 x 4 as: 1 (x 1 x 2 )x 3 x 4 (tri(bi,1,1)) 2 (x 1 x 2 x 3 )x 4 (bi(tri,1)) 3 (x 1 x 2 )(x 3 x 4 ) (bi(bi(1,1),bi(1,1))) 4 ((x 1 x 2 )x 3 )x 4 (bi(bi(bi(1,1),1),1)) Apply bilinear/trilinear envelopes, get different relaxations for w: which one is tightest? of multilinear convex envelopes: dual is better than p

51 Tighter relaxations by associativity Write w = x 1 x 2 x 3 x 4 as: 1 (x 1 x 2 )x 3 x 4 (tri(bi,1,1)) 2 (x 1 x 2 x 3 )x 4 (bi(tri,1)) 3 (x 1 x 2 )(x 3 x 4 ) (bi(bi(1,1),bi(1,1))) 4 ((x 1 x 2 )x 3 )x 4 (bi(bi(bi(1,1),1),1)) Apply bilinear/trilinear envelopes, get different relaxations for w: which one is tightest? Theorem Choose smallest number of compositions ((1)-(2) are better than (3)-(4)) of multilinear convex envelopes: dual is better than p

52 Tighter relaxations by associativity Write w = x 1 x 2 x 3 x 4 as: 1 (x 1 x 2 )x 3 x 4 (tri(bi,1,1)) 2 (x 1 x 2 x 3 )x 4 (bi(tri,1)) 3 (x 1 x 2 )(x 3 x 4 ) (bi(bi(1,1),bi(1,1))) 4 ((x 1 x 2 )x 3 )x 4 (bi(bi(bi(1,1),1),1)) Apply bilinear/trilinear envelopes, get different relaxations for w: which one is tightest? Theorem Choose smallest number of compositions ((1)-(2) are better than (3)-(4)) Some empirical indications on choosing (1) or (2) depending on bounds of multilinear convex envelopes: dual is better than p

53 Beyond quadrilinear terms envelopes for multilinear terms larger than quadrilinear: not known explicitly of multilinear convex envelopes: dual is better than p

54 Beyond quadrilinear terms envelopes for multilinear terms larger than quadrilinear: not known explicitly software as PORTA can compute the convex hull of a given set of points in R n of multilinear convex envelopes: dual is better than p

55 Beyond quadrilinear terms envelopes for multilinear terms larger than quadrilinear: not known explicitly software as PORTA can compute the convex hull of a given set of points in R n Balram s thesis reports a similar procedure to compute the convex hull (but less refined) of multilinear convex envelopes: dual is better than p

56 : preliminaries Consider the 2 k point set P: { (x L 1,...,xL k 1,xL k ), (x L 1,...,x L k 1,xU k ), (x L 1,...,xU k 1,xL k ), (x L 1,...,x U k 1,xU k ),..., (x U 1,...,xU k 1,xL k ), (x U 1,...,x U k 1,xU k ) } (i.e., all combinations of lower/upper bounds) Let w(x) = i k x i: lift P to (x,w) space, get P W R k+1 x P ( x,w( x)) P W of multilinear convex envelopes: dual is better than p

57 Dual representation of a point set Convex hull of P = {p 1,...,p m } R n is given by x R n : λ R m x = λ i p i i = 1 i m (λ i 0) i m i mλ of multilinear convex envelopes: dual is better than p

58 Dual representation of a point set Convex hull of P = {p 1,...,p m } R n is given by x R n : λ R m x = λ i p i i = 1 i m (λ i 0) i m i mλ x is a convex combination of points in P of multilinear convex envelopes: dual is better than p

59 Dual representation of a point set Convex hull of P = {p 1,...,p m } R n is given by x R n : λ R m x = λ i p i i = 1 i m (λ i 0) i m i mλ x is a convex combination of points in P Can express points in P W in function of x,w,x L,x U and of added (dual) variables λ for any k of multilinear convex envelopes: dual is better than p

60 Dual representation of a point set Convex hull of P = {p 1,...,p m } R n is given by x R n : λ R m x = λ i p i i = 1 i m (λ i 0) i m i mλ x is a convex combination of points in P Can express points in P W in function of x,w,x L,x U and of added (dual) variables λ for any k Automatically get explicit convex envelopes for multilinear terms of multilinear convex envelopes: dual is better than p

61 Dual envelopes of multilinear terms We compute the i-th point p i P in O(2 k ) as follows: i 2 k d i = ( ) i 1 2 k j mod 2 j k j k b j (0) = x L j b j (1) = x U j i.e. for all i 2 k, we have p i = (x L/U? j j k) = (b j (d ij ) j k) of multilinear convex envelopes: dual is better than p

62 Dual envelopes of multilinear terms We compute the i-th point p i P in O(2 k ) as follows: i 2 k d i = j k ( ) i 1 2 k j mod 2 j k b j (0) = x L j b j (1) = x U j i.e. for all i 2 k, we have p i = (x L/U? j j k) = (b j (d ij ) j k) We add 2 k new variables λ 0 and k +1 new constraints: j k x j = i 2 k λ i b j (d ij ) w = i 2 k λ i = 1 λ i i 2 k j k b j (d ij ) of multilinear convex envelopes: dual is better than p

63 Dual envelopes of multilinear terms We compute the i-th point p i P in O(2 k ) as follows: i 2 k d i = j k ( ) i 1 2 k j mod 2 j k b j (0) = x L j b j (1) = x U j i.e. for all i 2 k, we have p i = (x L/U? j j k) = (b j (d ij ) j k) We add 2 k new variables λ 0 and k +1 new constraints: j k x j = i 2 k λ i b j (d ij ) w = i 2 k λ i = 1 λ i i 2 k j k b j (d ij ) The projection of this feasible region on (x,w) is conv(w) of multilinear convex envelopes: dual is better than p

64 Example: bilinear term Using a matrix representation, we have: x L 1 x L 2 [ λ1 λ 2 λ 3 λ 4 ] x L 1 x U 2 x U 1 x L = [ ] x 1 x 2 2 x U 1 x U 2 of multilinear convex envelopes: dual is better than p

65 Example: bilinear term Using a matrix representation, we have: x L 1 x L 2 [ λ1 λ 2 λ 3 λ 4 ] x L 1 x U 2 x U 1 x L = [ ] x 1 x 2 2 x U 1 x U 2 x L 1 [ xl 2 λ1 λ 2 λ 3 λ 4 ] x L 1 xu 2 x U 1 xl = w 2 x U 1 xu 2 of multilinear convex envelopes: dual is better than p

66 Example: bilinear term Using a matrix representation, we have: x L 1 x L 2 [ λ1 λ 2 λ 3 λ 4 ] x L 1 x U 2 x U 1 x L = [ ] x 1 x 2 2 x U 1 x U 2 x L 1 [ xl 2 λ1 λ 2 λ 3 λ 4 ] x L 1 xu 2 x U 1 xl = w 2 x U 1 xu 2 x 1 = λ 1 x L 1 +λ 2 x L 1 +λ 3 x U 1 +λ 4 x U 1 x 2 = λ 1 x L 2 +λ 2x U 2 +λ 3x L 2 +λ 4x U 2 w = λ 1 x L 1 xl 2 +λ 2x L 1 xu 2 +λ 3x U 1 xl 2 +λ 4x U 1 xu 2 λ i = 1 i 4 of multilinear convex envelopes: dual is better than p

67 Where are we? 1 Definitions Multilinear terms Applications of multilinear convex envelopes: dual is better than p

68 Comparison between relaxations Primal envelopes Dual envelopes Original variables only 2 k added variables O(2 k ) added constraints k +1 added constraints of multilinear convex envelopes: dual is better than p

69 Comparison between relaxations Primal envelopes Dual envelopes Original variables only 2 k added variables O(2 k ) added constraints k +1 added constraints k Primal envelopes Dual envelopes 2 [McCormick] [Meyer, Floudas] [Balram] [Balram] Primal envelopes constraints: apparent growth like k2 k of multilinear convex envelopes: dual is better than p

70 Comparison between relaxations Primal envelopes Dual envelopes Original variables only 2 k added variables O(2 k ) added constraints k +1 added constraints k Primal envelopes Dual envelopes 2 [McCormick] [Meyer, Floudas] [Balram] [Balram] Primal envelopes constraints: apparent growth like k2 k O(k2 k ) vs. 2 k might yield CPU improvements of multilinear convex envelopes: dual is better than p

71 Experimental set-up Generate random multilinear NLPs P linear, bilinear, trilinear terms nonseparable Generate primal convex LP relaxation R P Generate dual convex LP relaxation Λ P Solve R P,Λ P using CPLEX, compare CPU times To get a feel about how R P,Λ P might perform in BB, add integrality constraints on primal variables, get MILP relaxations R P,Λ P Solve R P,Λ P using CPLEX, compare CPU times of multilinear convex envelopes: dual is better than p

72 Instance set 2500 random instances # variables n {10,20} n = 10: # bilinear terms β {0,10,13,17,21,25,29,33} # trilinear terms τ {0,10,22,34,46,58,71,83} n = 20: β {0,20,38,57,76,95,114,133} τ {0,20,144,268,393,517,642,766} 16 instances for each parameter combination yielding multilinear NLPs (and then MINLPs after imposing integrality on some variables) Variable bounds chosen at random, magnitude of multilinear convex envelopes: dual is better than p

73 LP relaxation test, n = 10 CPU time averages over each 16-instance block with given (n,β,τ) primal relaxation dual relaxation 0.02 CPU time [s] instance set of multilinear convex envelopes: dual is better than p

74 LP relaxation test, n = 20 CPU time averages over each 16-instance block with given (n,β,τ) primal relaxation dual relaxation CPU time [s] instance set of multilinear convex envelopes: dual is better than p

75 MILP relaxation test, n = 10 CPU time averages over each 16-instance block with given (n,β,τ) 2.5 primal relaxation dual relaxation 2 CPU time [s] instance set of multilinear convex envelopes: dual is better than p

76 MILP relaxation test, n = 20 CPU time averages over each 16-instance block with given (n,β,τ) primal relaxation dual relaxation CPU time [s] instance set of multilinear convex envelopes: dual is better than p

77 Where are we? 1 Definitions Multilinear terms Applications of multilinear convex envelopes: dual is better than p

78 Conclusion Considerations outperforms the primal when the number of variables increases of multilinear convex envelopes: dual is better than p

79 Conclusion Considerations outperforms the primal when the number of variables increases is better by far than primal for MILP of multilinear convex envelopes: dual is better than p

80 Conclusion Considerations outperforms the primal when the number of variables increases is better by far than primal for MILP is more stable (empirically CPU time increases proportionally to instance size) than primal for MILP of multilinear convex envelopes: dual is better than p

81 Conclusion Considerations outperforms the primal when the number of variables increases is better by far than primal for MILP is more stable (empirically CPU time increases proportionally to instance size) than primal for MILP These are preliminary results of multilinear convex envelopes: dual is better than p

82 Conclusion Considerations outperforms the primal when the number of variables increases is better by far than primal for MILP is more stable (empirically CPU time increases proportionally to instance size) than primal for MILP These are preliminary results Using dual relaxation within spatial Branch-and-Bound could improve computational times of multilinear convex envelopes: dual is better than p

Mixed-Integer Nonlinear Programming

Mixed-Integer Nonlinear Programming Mixed-Integer Nonlinear Programming Claudia D Ambrosio CNRS researcher LIX, École Polytechnique, France pictures taken from slides by Leo Liberti MPRO PMA 2016-2017 Motivating Applications Nonlinear Knapsack

More information

IBM Research Report. On Convex Relaxations of Quadrilinear Terms. Sonia Cafieri LIX École Polytechnique Palaiseau France

IBM Research Report. On Convex Relaxations of Quadrilinear Terms. Sonia Cafieri LIX École Polytechnique Palaiseau France RC24792 (W94-122 April 3, 29 Mathematics IBM Research Report On Convex Relaxations of Quadrilinear Terms Sonia Cafieri LIX École Polytechnique 91128 Palaiseau France Jon Lee IBM Research Division Thomas

More information

An exact reformulation algorithm for large nonconvex NLPs involving bilinear terms

An exact reformulation algorithm for large nonconvex NLPs involving bilinear terms An exact reformulation algorithm for large nonconvex NLPs involving bilinear terms Leo Liberti CNRS LIX, École Polytechnique, F-91128 Palaiseau, France. E-mail: liberti@lix.polytechnique.fr. Constantinos

More information

The Pooling Problem - Applications, Complexity and Solution Methods

The Pooling Problem - Applications, Complexity and Solution Methods The Pooling Problem - Applications, Complexity and Solution Methods Dag Haugland Dept. of Informatics University of Bergen Norway EECS Seminar on Optimization and Computing NTNU, September 30, 2014 Outline

More information

On the composition of convex envelopes for quadrilinear terms

On the composition of convex envelopes for quadrilinear terms Author manuscript, published in "Optimization, Simulation, and Control (2013) pp 1-16" DOI : 10.1007/978-1-4614-5131-0_1 On the composition of convex envelopes for quadrilinear terms Pietro Belotti, Sonia

More information

Computer Sciences Department

Computer Sciences Department Computer Sciences Department Valid Inequalities for the Pooling Problem with Binary Variables Claudia D Ambrosio Jeff Linderoth James Luedtke Technical Report #682 November 200 Valid Inequalities for the

More information

Compact relaxations for polynomial programming problems

Compact relaxations for polynomial programming problems Compact relaxations for polynomial programming problems Sonia Cafieri 1, Pierre Hansen 2,4, Lucas Létocart 3, Leo Liberti 4, and Frédéric Messine 5 1 Laboratoire MAIAA, Ecole Nationale de l Aviation Civile,

More information

Disconnecting Networks via Node Deletions

Disconnecting Networks via Node Deletions 1 / 27 Disconnecting Networks via Node Deletions Exact Interdiction Models and Algorithms Siqian Shen 1 J. Cole Smith 2 R. Goli 2 1 IOE, University of Michigan 2 ISE, University of Florida 2012 INFORMS

More information

Heuristics and Upper Bounds for a Pooling Problem with Cubic Constraints

Heuristics and Upper Bounds for a Pooling Problem with Cubic Constraints Heuristics and Upper Bounds for a Pooling Problem with Cubic Constraints Matthew J. Real, Shabbir Ahmed, Helder Inàcio and Kevin Norwood School of Chemical & Biomolecular Engineering 311 Ferst Drive, N.W.

More information

On mathematical programming with indicator constraints

On mathematical programming with indicator constraints On mathematical programming with indicator constraints Andrea Lodi joint work with P. Bonami & A. Tramontani (IBM), S. Wiese (Unibo) University of Bologna, Italy École Polytechnique de Montréal, Québec,

More information

Optimization in Process Systems Engineering

Optimization in Process Systems Engineering Optimization in Process Systems Engineering M.Sc. Jan Kronqvist Process Design & Systems Engineering Laboratory Faculty of Science and Engineering Åbo Akademi University Most optimization problems in production

More information

Valid Inequalities and Convex Hulls for Multilinear Functions

Valid Inequalities and Convex Hulls for Multilinear Functions Electronic Notes in Discrete Mathematics 36 (2010) 805 812 www.elsevier.com/locate/endm Valid Inequalities and Convex Hulls for Multilinear Functions Pietro Belotti Department of Industrial and Systems

More information

A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization

A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization A Branch-and-Refine Method for Nonconvex Mixed-Integer Optimization Sven Leyffer 2 Annick Sartenaer 1 Emilie Wanufelle 1 1 University of Namur, Belgium 2 Argonne National Laboratory, USA IMA Workshop,

More information

Solving Mixed-Integer Nonlinear Programs

Solving Mixed-Integer Nonlinear Programs Solving Mixed-Integer Nonlinear Programs (with SCIP) Ambros M. Gleixner Zuse Institute Berlin MATHEON Berlin Mathematical School 5th Porto Meeting on Mathematics for Industry, April 10 11, 2014, Porto

More information

Constraint Qualification Failure in Action

Constraint Qualification Failure in Action Constraint Qualification Failure in Action Hassan Hijazi a,, Leo Liberti b a The Australian National University, Data61-CSIRO, Canberra ACT 2601, Australia b CNRS, LIX, Ecole Polytechnique, 91128, Palaiseau,

More information

Convex Quadratic Relaxations of Nonconvex Quadratically Constrained Quadratic Progams

Convex Quadratic Relaxations of Nonconvex Quadratically Constrained Quadratic Progams Convex Quadratic Relaxations of Nonconvex Quadratically Constrained Quadratic Progams John E. Mitchell, Jong-Shi Pang, and Bin Yu Original: June 10, 2011 Abstract Nonconvex quadratic constraints can be

More information

Mixed Integer Non Linear Programming

Mixed Integer Non Linear Programming Mixed Integer Non Linear Programming Claudia D Ambrosio CNRS Research Scientist CNRS & LIX, École Polytechnique MPRO PMA 2016-2017 Outline What is a MINLP? Dealing with nonconvexities Global Optimization

More information

Scheduling and Optimization Course (MPRI)

Scheduling and Optimization Course (MPRI) MPRI Scheduling and optimization: lecture p. /6 Scheduling and Optimization Course (MPRI) Leo Liberti LIX, École Polytechnique, France MPRI Scheduling and optimization: lecture p. /6 Teachers Christoph

More information

Optimization Bounds from Binary Decision Diagrams

Optimization Bounds from Binary Decision Diagrams Optimization Bounds from Binary Decision Diagrams J. N. Hooker Joint work with David Bergman, André Ciré, Willem van Hoeve Carnegie Mellon University ICS 203 Binary Decision Diagrams BDDs historically

More information

Implementation of an αbb-type underestimator in the SGO-algorithm

Implementation of an αbb-type underestimator in the SGO-algorithm Implementation of an αbb-type underestimator in the SGO-algorithm Process Design & Systems Engineering November 3, 2010 Refining without branching Could the αbb underestimator be used without an explicit

More information

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations A notion of for Convex, Semidefinite and Extended Formulations Marcel de Carli Silva Levent Tunçel April 26, 2018 A vector in R n is integral if each of its components is an integer, A vector in R n is

More information

Benders Decomposition

Benders Decomposition Benders Decomposition Yuping Huang, Dr. Qipeng Phil Zheng Department of Industrial and Management Systems Engineering West Virginia University IENG 593G Nonlinear Programg, Spring 2012 Yuping Huang (IMSE@WVU)

More information

Duality. Geoff Gordon & Ryan Tibshirani Optimization /

Duality. Geoff Gordon & Ryan Tibshirani Optimization / Duality Geoff Gordon & Ryan Tibshirani Optimization 10-725 / 36-725 1 Duality in linear programs Suppose we want to find lower bound on the optimal value in our convex problem, B min x C f(x) E.g., consider

More information

Linear Programming. Leo Liberti. LIX, École Polytechnique. Operations research courses / LP theory p.

Linear Programming. Leo Liberti. LIX, École Polytechnique. Operations research courses / LP theory p. Operations research courses / LP theory p. 1/47 Linear Programming Leo Liberti LIX, École Polytechnique liberti@lix.polytechnique.fr Operations research courses / LP theory p. 2/47 Contents LP formulations

More information

Applications and algorithms for mixed integer nonlinear programming

Applications and algorithms for mixed integer nonlinear programming Applications and algorithms for mixed integer nonlinear programming Sven Leyffer 1, Jeff Linderoth 2, James Luedtke 2, Andrew Miller 3, Todd Munson 1 1 Mathematics and Computer Science Division, Argonne

More information

STRONG VALID INEQUALITIES FOR MIXED-INTEGER NONLINEAR PROGRAMS VIA DISJUNCTIVE PROGRAMMING AND LIFTING

STRONG VALID INEQUALITIES FOR MIXED-INTEGER NONLINEAR PROGRAMS VIA DISJUNCTIVE PROGRAMMING AND LIFTING STRONG VALID INEQUALITIES FOR MIXED-INTEGER NONLINEAR PROGRAMS VIA DISJUNCTIVE PROGRAMMING AND LIFTING By KWANGHUN CHUNG A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN

More information

Nonconvex Generalized Benders Decomposition Paul I. Barton

Nonconvex Generalized Benders Decomposition Paul I. Barton Nonconvex Generalized Benders Decomposition Paul I. Barton Process Systems Engineering Laboratory Massachusetts Institute of Technology Motivation Two-stage Stochastic MINLPs & MILPs Natural Gas Production

More information

On Solving Aircraft Conflict Avoidance Using Deterministic Global Optimization (sbb) Codes

On Solving Aircraft Conflict Avoidance Using Deterministic Global Optimization (sbb) Codes On Solving Aircraft Conflict Avoidance Using Deterministic Global Optimization (sbb) Codes Sonia Cafieri, Frédéric Messine, Ahmed Touhami To cite this version: Sonia Cafieri, Frédéric Messine, Ahmed Touhami.

More information

Minimum Linear Arrangements

Minimum Linear Arrangements Minimum Linear Arrangements Rafael Andrade, Tibérius Bonates, Manoel Câmpelo, Mardson Ferreira ParGO - Research team in Parallel computing, Graph theory and Optimization Department of Statistics and Applied

More information

arxiv: v1 [math.oc] 8 Aug 2016

arxiv: v1 [math.oc] 8 Aug 2016 Experimental validation of volume-based comparison for double-mccormick relaxations Emily Speakman, Han Yu, and Jon Lee arxiv:1608.02527v1 [math.oc] 8 Aug 2016 Department of Industrial and Operations Engineering

More information

Decomposition-based Methods for Large-scale Discrete Optimization p.1

Decomposition-based Methods for Large-scale Discrete Optimization p.1 Decomposition-based Methods for Large-scale Discrete Optimization Matthew V Galati Ted K Ralphs Department of Industrial and Systems Engineering Lehigh University, Bethlehem, PA, USA Départment de Mathématiques

More information

GLOBAL OPTIMIZATION WITH GAMS/BARON

GLOBAL OPTIMIZATION WITH GAMS/BARON GLOBAL OPTIMIZATION WITH GAMS/BARON Nick Sahinidis Chemical and Biomolecular Engineering University of Illinois at Urbana Mohit Tawarmalani Krannert School of Management Purdue University MIXED-INTEGER

More information

A Tighter Piecewise McCormick Relaxation for Bilinear Problems

A Tighter Piecewise McCormick Relaxation for Bilinear Problems A Tighter Piecewise McCormick Relaxation for Bilinear Problems Pedro M. Castro Centro de Investigação Operacional Faculdade de Ciências niversidade de isboa Problem definition (NP) Bilinear program min

More information

1 Convexity, Convex Relaxations, and Global Optimization

1 Convexity, Convex Relaxations, and Global Optimization 1 Conveity, Conve Relaations, and Global Optimization Algorithms 1 1.1 Minima Consider the nonlinear optimization problem in a Euclidean space: where the feasible region. min f(), R n Definition (global

More information

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs Integer Programming ISE 418 Lecture 12 Dr. Ted Ralphs ISE 418 Lecture 12 1 Reading for This Lecture Nemhauser and Wolsey Sections II.2.1 Wolsey Chapter 9 ISE 418 Lecture 12 2 Generating Stronger Valid

More information

IBM Research Report. Branching and Bounds Tightening Techniques for Non-Convex MINLP

IBM Research Report. Branching and Bounds Tightening Techniques for Non-Convex MINLP RC24620 (W0808-031) August 13, 2008 Mathematics IBM Research Report Branching and Bounds Tightening Techniques for Non-Convex MINLP Pietro Belotti 1, Jon Lee 2, Leo Liberti 3, François Margot 1, Andreas

More information

0-1 Reformulations of the Network Loading Problem

0-1 Reformulations of the Network Loading Problem 0-1 Reformulations of the Network Loading Problem Antonio Frangioni 1 frangio@di.unipi.it Bernard Gendron 2 bernard@crt.umontreal.ca 1 Dipartimento di Informatica Università di Pisa Via Buonarroti, 2 56127

More information

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018 Section Notes 9 Midterm 2 Review Applied Math / Engineering Sciences 121 Week of December 3, 2018 The following list of topics is an overview of the material that was covered in the lectures and sections

More information

Development of the new MINLP Solver Decogo using SCIP - Status Report

Development of the new MINLP Solver Decogo using SCIP - Status Report Development of the new MINLP Solver Decogo using SCIP - Status Report Pavlo Muts with Norman Breitfeld, Vitali Gintner, Ivo Nowak SCIP Workshop 2018, Aachen Table of contents 1. Introduction 2. Automatic

More information

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs Computational Integer Programming Lecture 2: Modeling and Formulation Dr. Ted Ralphs Computational MILP Lecture 2 1 Reading for This Lecture N&W Sections I.1.1-I.1.6 Wolsey Chapter 1 CCZ Chapter 2 Computational

More information

Introduction to Integer Linear Programming

Introduction to Integer Linear Programming Lecture 7/12/2006 p. 1/30 Introduction to Integer Linear Programming Leo Liberti, Ruslan Sadykov LIX, École Polytechnique liberti@lix.polytechnique.fr sadykov@lix.polytechnique.fr Lecture 7/12/2006 p.

More information

Outline. 1 Introduction. 2 Modeling and Applications. 3 Algorithms Convex. 4 Algorithms Nonconvex. 5 The Future of MINLP? 2 / 126

Outline. 1 Introduction. 2 Modeling and Applications. 3 Algorithms Convex. 4 Algorithms Nonconvex. 5 The Future of MINLP? 2 / 126 Outline 1 Introduction 2 3 Algorithms Convex 4 Algorithms Nonconvex 5 The Future of MINLP? 2 / 126 Larry Leading Off 3 / 126 Introduction Outline 1 Introduction Software Tools and Online Resources Basic

More information

Branch-and-Bound. Leo Liberti. LIX, École Polytechnique, France. INF , Lecture p. 1

Branch-and-Bound. Leo Liberti. LIX, École Polytechnique, France. INF , Lecture p. 1 Branch-and-Bound Leo Liberti LIX, École Polytechnique, France INF431 2011, Lecture p. 1 Reminders INF431 2011, Lecture p. 2 Problems Decision problem: a question admitting a YES/NO answer Example HAMILTONIAN

More information

Using the Johnson-Lindenstrauss lemma in linear and integer programming

Using the Johnson-Lindenstrauss lemma in linear and integer programming Using the Johnson-Lindenstrauss lemma in linear and integer programming Vu Khac Ky 1, Pierre-Louis Poirion, Leo Liberti LIX, École Polytechnique, F-91128 Palaiseau, France Email:{vu,poirion,liberti}@lix.polytechnique.fr

More information

MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands

MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands MILP reformulation of the multi-echelon stochastic inventory system with uncertain demands Axel Nyberg Åbo Aademi University Ignacio E. Grossmann Dept. of Chemical Engineering, Carnegie Mellon University,

More information

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010 Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts

More information

From structures to heuristics to global solvers

From structures to heuristics to global solvers From structures to heuristics to global solvers Timo Berthold Zuse Institute Berlin DFG Research Center MATHEON Mathematics for key technologies OR2013, 04/Sep/13, Rotterdam Outline From structures to

More information

Separation Techniques for Constrained Nonlinear 0 1 Programming

Separation Techniques for Constrained Nonlinear 0 1 Programming Separation Techniques for Constrained Nonlinear 0 1 Programming Christoph Buchheim Computer Science Department, University of Cologne and DEIS, University of Bologna MIP 2008, Columbia University, New

More information

Heuristics for nonconvex MINLP

Heuristics for nonconvex MINLP Heuristics for nonconvex MINLP Pietro Belotti, Timo Berthold FICO, Xpress Optimization Team, Birmingham, UK pietrobelotti@fico.com 18th Combinatorial Optimization Workshop, Aussois, 9 Jan 2014 ======This

More information

Integer Programming ISE 418. Lecture 13. Dr. Ted Ralphs

Integer Programming ISE 418. Lecture 13. Dr. Ted Ralphs Integer Programming ISE 418 Lecture 13 Dr. Ted Ralphs ISE 418 Lecture 13 1 Reading for This Lecture Nemhauser and Wolsey Sections II.1.1-II.1.3, II.1.6 Wolsey Chapter 8 CCZ Chapters 5 and 6 Valid Inequalities

More information

Column Generation for Extended Formulations

Column Generation for Extended Formulations 1 / 28 Column Generation for Extended Formulations Ruslan Sadykov 1 François Vanderbeck 2,1 1 INRIA Bordeaux Sud-Ouest, France 2 University Bordeaux I, France ISMP 2012 Berlin, August 23 2 / 28 Contents

More information

PERSPECTIVE REFORMULATION AND APPLICATIONS

PERSPECTIVE REFORMULATION AND APPLICATIONS PERSPECTIVE REFORMULATION AND APPLICATIONS OKTAY GÜNLÜK AND JEFF LINDEROTH Abstract. In this paper we survey recent work on the perspective reformulation approach that generates tight, tractable relaxations

More information

Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs

Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Siqian Shen Dept. of Industrial and Operations Engineering University of Michigan Joint work with Yan Deng (UMich, Google)

More information

Valid inequalities for sets defined by multilinear functions

Valid inequalities for sets defined by multilinear functions Valid inequalities for sets defined by multilinear functions Pietro Belotti 1 Andrew Miller 2 Mahdi Namazifar 3 3 1 Lehigh University 200 W Packer Ave Bethlehem PA 18018, USA belotti@lehighedu 2 Institut

More information

Reduced RLT Representations for Nonconvex Polynomial Programming Problems

Reduced RLT Representations for Nonconvex Polynomial Programming Problems Journal of Global Optimization manuscript No. (will be inserted by the editor) Reduced RLT Representations for Nonconvex Polynomial Programming Problems Hanif D. Sherali Evrim Dalkiran Leo Liberti November

More information

A Decomposition-based MINLP Solution Method Using Piecewise Linear Relaxations

A Decomposition-based MINLP Solution Method Using Piecewise Linear Relaxations A Decomposition-based MINLP Solution Method Using Piecewise Linear Relaxations Pradeep K. Polisetty and Edward P. Gatzke 1 Department of Chemical Engineering University of South Carolina Columbia, SC 29208

More information

Lecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem

Lecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem Lecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem Michael Patriksson 0-0 The Relaxation Theorem 1 Problem: find f := infimum f(x), x subject to x S, (1a) (1b) where f : R n R

More information

Software for Integer and Nonlinear Optimization

Software for Integer and Nonlinear Optimization Software for Integer and Nonlinear Optimization Sven Leyffer, leyffer@mcs.anl.gov Mathematics & Computer Science Division Argonne National Laboratory Roger Fletcher & Jeff Linderoth Advanced Methods and

More information

A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse

A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse A Benders Algorithm for Two-Stage Stochastic Optimization Problems With Mixed Integer Recourse Ted Ralphs 1 Joint work with Menal Güzelsoy 2 and Anahita Hassanzadeh 1 1 COR@L Lab, Department of Industrial

More information

Monomial-wise Optimal Separable Underestimators for Mixed-Integer Polynomial Optimization

Monomial-wise Optimal Separable Underestimators for Mixed-Integer Polynomial Optimization Monomial-wise Optimal Separable Underestimators for Mixed-Integer Polynomial Optimization Christoph Buchheim Claudia D Ambrosio Received: date / Accepted: date Abstract In this paper we introduce a new

More information

Multiperiod Blend Scheduling Problem

Multiperiod Blend Scheduling Problem ExxonMobil Multiperiod Blend Scheduling Problem Juan Pablo Ruiz Ignacio E. Grossmann Department of Chemical Engineering Center for Advanced Process Decision-making University Pittsburgh, PA 15213 1 Motivation

More information

23. Cutting planes and branch & bound

23. Cutting planes and branch & bound CS/ECE/ISyE 524 Introduction to Optimization Spring 207 8 23. Cutting planes and branch & bound ˆ Algorithms for solving MIPs ˆ Cutting plane methods ˆ Branch and bound methods Laurent Lessard (www.laurentlessard.com)

More information

Projected Perspective Reformulations for NonLinear Network Design Problems

Projected Perspective Reformulations for NonLinear Network Design Problems Projected Perspective Reformulations for NonLinear Network Design Problems Antonio Frangioni Claudio Gentile Enrico Grande Andrea Pacifici Dipartimento di Informatica, Università di Pisa Polo Universitario

More information

1 Introduction A large proportion of all optimization problems arising in an industrial or scientic context are characterized by the presence of nonco

1 Introduction A large proportion of all optimization problems arising in an industrial or scientic context are characterized by the presence of nonco A Global Optimization Method, BB, for General Twice-Dierentiable Constrained NLPs I. Theoretical Advances C.S. Adjiman, S. Dallwig 1, C.A. Floudas 2 and A. Neumaier 1 Department of Chemical Engineering,

More information

Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows

Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows Guy Desaulniers École Polytechnique de Montréal and GERAD Column Generation 2008 Aussois, France Outline Introduction

More information

3.10 Lagrangian relaxation

3.10 Lagrangian relaxation 3.10 Lagrangian relaxation Consider a generic ILP problem min {c t x : Ax b, Dx d, x Z n } with integer coefficients. Suppose Dx d are the complicating constraints. Often the linear relaxation and the

More information

MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms

MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms MINLP: Theory, Algorithms, Applications: Lecture 3, Basics of Algorothms Jeff Linderoth Industrial and Systems Engineering University of Wisconsin-Madison Jonas Schweiger Friedrich-Alexander-Universität

More information

Accelerating the Convergence of MIP-based Unit Commitment Problems

Accelerating the Convergence of MIP-based Unit Commitment Problems Accelerating the Convergence of MIP-based Unit Commitment Problems The Impact of High Quality MIP Formulations ermán Morales-España, Delft University of Technology, Delft, The Netherlands Optimization

More information

Fixed-charge transportation problems on trees

Fixed-charge transportation problems on trees Fixed-charge transportation problems on trees Gustavo Angulo * Mathieu Van Vyve * gustavo.angulo@uclouvain.be mathieu.vanvyve@uclouvain.be November 23, 2015 Abstract We consider a class of fixed-charge

More information

Lagrange duality. The Lagrangian. We consider an optimization program of the form

Lagrange duality. The Lagrangian. We consider an optimization program of the form Lagrange duality Another way to arrive at the KKT conditions, and one which gives us some insight on solving constrained optimization problems, is through the Lagrange dual. The dual is a maximization

More information

Accelerating the Convergence of Stochastic Unit Commitment Problems by Using Tight and Compact MIP Formulations

Accelerating the Convergence of Stochastic Unit Commitment Problems by Using Tight and Compact MIP Formulations Accelerating the Convergence of Stochastic Unit Commitment Problems by Using Tight and Compact MIP Formulations Germán Morales-España, and Andrés Ramos Delft University of Technology, Delft, The Netherlands

More information

Integer Programming ISE 418. Lecture 8. Dr. Ted Ralphs

Integer Programming ISE 418. Lecture 8. Dr. Ted Ralphs Integer Programming ISE 418 Lecture 8 Dr. Ted Ralphs ISE 418 Lecture 8 1 Reading for This Lecture Wolsey Chapter 2 Nemhauser and Wolsey Sections II.3.1, II.3.6, II.4.1, II.4.2, II.5.4 Duality for Mixed-Integer

More information

Shiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient

Shiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient Shiqian Ma, MAT-258A: Numerical Optimization 1 Chapter 4 Subgradient Shiqian Ma, MAT-258A: Numerical Optimization 2 4.1. Subgradients definition subgradient calculus duality and optimality conditions Shiqian

More information

Reduced rst-level representations via the reformulation-linearization technique: results, counterexamples, and computations

Reduced rst-level representations via the reformulation-linearization technique: results, counterexamples, and computations Discrete Applied Mathematics 101 (2000) 247 267 Reduced rst-level representations via the reformulation-linearization technique: results, counterexamples, and computations Hanif D. Sherali a;, Jonathan

More information

Computing Artificial Backbones of Hydrogen Atoms in order to Discover Protein Backbones

Computing Artificial Backbones of Hydrogen Atoms in order to Discover Protein Backbones Computing Artificial Backbones of Hydrogen Atoms in order to Discover Protein Backbones C. Lavor A. Mucherino L. Liberti and N. Maculan Dept. of Applied Mathematics (IMECC-UNICAMP), State University of

More information

DEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION. Part I: Short Questions

DEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION. Part I: Short Questions DEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION Part I: Short Questions August 12, 2008 9:00 am - 12 pm General Instructions This examination is

More information

A computational study of enhancements to Benders Decomposition in uncapacitated multicommodity network design

A computational study of enhancements to Benders Decomposition in uncapacitated multicommodity network design A computational study of enhancements to Benders Decomposition in uncapacitated multicommodity network design 1 Carlos Armando Zetina, 1 Ivan Contreras, 2 Jean-François Cordeau 1 Concordia University and

More information

Network Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini

Network Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini In the name of God Network Flows 6. Lagrangian Relaxation 6.3 Lagrangian Relaxation and Integer Programming Fall 2010 Instructor: Dr. Masoud Yaghini Integer Programming Outline Branch-and-Bound Technique

More information

Lagrange Relaxation: Introduction and Applications

Lagrange Relaxation: Introduction and Applications 1 / 23 Lagrange Relaxation: Introduction and Applications Operations Research Anthony Papavasiliou 2 / 23 Contents 1 Context 2 Applications Application in Stochastic Programming Unit Commitment 3 / 23

More information

Can Li a, Ignacio E. Grossmann a,

Can Li a, Ignacio E. Grossmann a, A generalized Benders decomposition-based branch and cut algorithm for two-stage stochastic programs with nonconvex constraints and mixed-binary first and second stage variables Can Li a, Ignacio E. Grossmann

More information

On the solution of molecular distance geometry problems with interval data

On the solution of molecular distance geometry problems with interval data On the solution of molecular distance geometry problems with interval data C. Lavor L. Liberti and A. Mucherino IMECC-UNICAMP, Campinas-SP, Brazil. clavor@ime.unicamp.br LIX, École Polytechnique, Palaiseau,

More information

Obtaining Tighter Relaxations of Mathematical Programs with Complementarity Constraints

Obtaining Tighter Relaxations of Mathematical Programs with Complementarity Constraints Obtaining Tighter Relaxations of Mathematical Programs with Complementarity Constraints John E. Mitchell, Jong-Shi Pang, and Bin Yu Original: February 19, 2011. Revised: October 11, 2011 Abstract The class

More information

The Ellipsoid Algorithm

The Ellipsoid Algorithm The Ellipsoid Algorithm John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA 9 February 2018 Mitchell The Ellipsoid Algorithm 1 / 28 Introduction Outline 1 Introduction 2 Assumptions

More information

Can Li a, Ignacio E. Grossmann a,

Can Li a, Ignacio E. Grossmann a, A generalized Benders decomposition-based branch and cut algorithm for two-stage stochastic programs with nonconvex constraints and mixed-binary first and second stage variables Can Li a, Ignacio E. Grossmann

More information

Part 4. Decomposition Algorithms

Part 4. Decomposition Algorithms In the name of God Part 4. 4.4. Column Generation for the Constrained Shortest Path Problem Spring 2010 Instructor: Dr. Masoud Yaghini Constrained Shortest Path Problem Constrained Shortest Path Problem

More information

Mathematical Programming techniques in Water Network Optimization

Mathematical Programming techniques in Water Network Optimization Mathematical Programming techniques in Water Network Optimization C. D Ambrosio a, A. Lodi b,, S. Wiese b, C. Bragalli c a CNRS & LIX, Ecole Polytechnique, 91128 Palaiseau CEDEX, France b DEI, University

More information

Improved Big-M Reformulation for Generalized Disjunctive Programs

Improved Big-M Reformulation for Generalized Disjunctive Programs Improved Big-M Reformulation for Generalized Disjunctive Programs Francisco Trespalacios and Ignacio E. Grossmann Department of Chemical Engineering Carnegie Mellon University, Pittsburgh, PA 15213 Author

More information

Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks

Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks Development of an algorithm for solving mixed integer and nonconvex problems arising in electrical supply networks E. Wanufelle 1 S. Leyffer 2 A. Sartenaer 1 Ph. Toint 1 1 FUNDP, University of Namur 2

More information

An MILP-MINLP decomposition method for the global optimization of a source based model of the multiperiod blending problem

An MILP-MINLP decomposition method for the global optimization of a source based model of the multiperiod blending problem An MILP-MINLP decomposition method for the global optimization of a source based model of the multiperiod blending problem Irene Lotero a, Francisco Trespalacios a, Myun-Seok Cheon b, Dimitri J. Papageorgiou

More information

Tightening a Discrete Formulation of the Quadratic Assignment Problem

Tightening a Discrete Formulation of the Quadratic Assignment Problem A publication of 1309 CHEMICAL ENGINEERING TRANSACTIONS VOL. 32, 2013 Chief Editors: Sauro Pierucci, Jiří J. Klemeš Copyright 2013, AIDIC Servizi S.r.l., ISBN 978-88-95608-23-5; ISSN 1974-9791 The Italian

More information

Gestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA

Gestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA Gestion de la production Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA 1 Contents 1 Integer Linear Programming 3 1.1 Definitions and notations......................................

More information

Feasibility Pump for Mixed Integer Nonlinear Programs 1

Feasibility Pump for Mixed Integer Nonlinear Programs 1 Feasibility Pump for Mixed Integer Nonlinear Programs 1 Presenter: 1 by Pierre Bonami, Gerard Cornuejols, Andrea Lodi and Francois Margot Mixed Integer Linear or Nonlinear Programs (MILP/MINLP) Optimize

More information

Introduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 21 Dr. Ted Ralphs IE406 Lecture 21 1 Reading for This Lecture Bertsimas Sections 10.2, 10.3, 11.1, 11.2 IE406 Lecture 21 2 Branch and Bound Branch

More information

Introduction to Integer Programming

Introduction to Integer Programming Lecture 3/3/2006 p. /27 Introduction to Integer Programming Leo Liberti LIX, École Polytechnique liberti@lix.polytechnique.fr Lecture 3/3/2006 p. 2/27 Contents IP formulations and examples Total unimodularity

More information

Volumetric Guidance for Handling Triple Products in Spatial Branch-and-Bound

Volumetric Guidance for Handling Triple Products in Spatial Branch-and-Bound Volumetric Guidance for Handling Triple Products in Spatial Branch-and-Bound by Emily E. Speakman A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy

More information

Easy and not so easy multifacility location problems... (In 20 minutes.)

Easy and not so easy multifacility location problems... (In 20 minutes.) Easy and not so easy multifacility location problems... (In 20 minutes.) MINLP 2014 Pittsburgh, June 2014 Justo Puerto Institute of Mathematics (IMUS) Universidad de Sevilla Outline 1 Introduction (In

More information

Alternative Methods for Obtaining. Optimization Bounds. AFOSR Program Review, April Carnegie Mellon University. Grant FA

Alternative Methods for Obtaining. Optimization Bounds. AFOSR Program Review, April Carnegie Mellon University. Grant FA Alternative Methods for Obtaining Optimization Bounds J. N. Hooker Carnegie Mellon University AFOSR Program Review, April 2012 Grant FA9550-11-1-0180 Integrating OR and CP/AI Early support by AFOSR First

More information

CS-E4830 Kernel Methods in Machine Learning

CS-E4830 Kernel Methods in Machine Learning CS-E4830 Kernel Methods in Machine Learning Lecture 3: Convex optimization and duality Juho Rousu 27. September, 2017 Juho Rousu 27. September, 2017 1 / 45 Convex optimization Convex optimisation This

More information

3.4 Relaxations and bounds

3.4 Relaxations and bounds 3.4 Relaxations and bounds Consider a generic Discrete Optimization problem z = min{c(x) : x X} with an optimal solution x X. In general, the algorithms generate not only a decreasing sequence of upper

More information

ADVANCES IN GLOBAL OPTIMIZATION FOR STANDARD, GENERALIZED, AND EXTENDED POOLING PROBLEMS WITH THE (EPA) COMPLEX EMISSIONS MODEL CONSTRAINTS

ADVANCES IN GLOBAL OPTIMIZATION FOR STANDARD, GENERALIZED, AND EXTENDED POOLING PROBLEMS WITH THE (EPA) COMPLEX EMISSIONS MODEL CONSTRAINTS ADVANCES IN GLOBAL OPTIMIZATION FOR STANDARD, GENERALIZED, AND EXTENDED POOLING PROBLEMS WITH THE (EPA) COMPLEX EMISSIONS MODEL CONSTRAINTS Ruth Misener, Chrysanthos E. Gounaris, and Christodoulos A. Floudas

More information