Polyhedral Results for A Class of Cardinality Constrained Submodular Minimization Problems

Size: px
Start display at page:

Download "Polyhedral Results for A Class of Cardinality Constrained Submodular Minimization Problems"

Transcription

1 Polyhedral Results for A Class of Cardinality Constrained Submodular Minimization Problems Shabbir Ahmed and Jiajin Yu Georgia Institute of Technology

2 A Motivating Problem [n]: Set of candidate investment projects c: Cost vector (of size n) b: Budget µ i, σi 2 : Mean and variance of project i return (uncorrelated) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

3 A Motivating Problem [n]: Set of candidate investment projects c: Cost vector (of size n) b: Budget µ i, σi 2 : Mean and variance of project i return (uncorrelated) Pick projects to optimize mean-variance criterion: Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

4 A Motivating Problem [n]: Set of candidate investment projects c: Cost vector (of size n) b: Budget µ i, σi 2 : Mean and variance of project i return (uncorrelated) Pick projects to optimize mean-variance criterion: min µ i x i + λ σi 2 xi 2 : c x b, x {0, 1} n i i Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

5 A Motivating Problem [n]: Set of candidate investment projects c: Cost vector (of size n) b: Budget µ i, σi 2 : Mean and variance of project i return (uncorrelated) Pick projects to optimize mean-variance criterion: min µ i x i + λ σi 2 xi 2 : c x b, x {0, 1} n i i Mean risk combinatorial optimization [Shen et al 03, Atamturk 08, Nikolova 10, Baumann et al 13] Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

6 Concave Cost Combinatorial Optimization min {d x + f (a x) : x X {0, 1} n} where f is a univariate concave function Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

7 Concave Cost Combinatorial Optimization min {d x + f (a x) : x X {0, 1} n} where f is a univariate concave function min {d x + w : w f (a x), x X {0, 1} n} Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

8 Concave Cost Combinatorial Optimization min {d x + f (a x) : x X {0, 1} n} where f is a univariate concave function min {d x + w : w f (a x), x X {0, 1} n} Goal: Polyhedral description/relaxation of conv(p X) where { } P := (w, x) R {0, 1} n : w f (a x) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

9 Concave Cost Combinatorial Optimization min {d x + f (a x) : x X {0, 1} n} where f is a univariate concave function min {d x + w : w f (a x), x X {0, 1} n} Goal: Polyhedral description/relaxation of conv(p X) where { } P := (w, x) R {0, 1} n : w f (a x) Simple case: Cardinality constraint X = {x [0, 1] n : e x K } Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

10 Submodular Functions Definition A function F : {0, 1} n R is submodular if F (x + e i ) F(x) F(y + e i ) F(y) x y, s.t. x i = y i = 0 If f is concave and a R n + then F(x) := f (a x) is submodular. F (x1,x2) = p 9x1 + 16x2 {0,0} {1,0} {0,1} {1,1} Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

11 Submodular Functions Definition A function F : {0, 1} n R is submodular if F (x + e i ) F(x) F(y + e i ) F(y) x y, s.t. x i = y i = 0 If f is concave and a R n + then F(x) := f (a x) is submodular. F (x1,x2) = p 9x1 + 16x2 {0,0} {1,0} {0,1} {1,1} Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

12 Submodular Functions Definition A function F : {0, 1} n R is submodular if F (x + e i ) F(x) F(y + e i ) F(y) x y, s.t. x i = y i = 0 If f is concave and a R n + then F(x) := f (a x) is submodular. F (x1,x2) = p 9x1 + 16x2 {0,0} {1,0} {0,1} {1,1} Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

13 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

14 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Separation/Optimization over conv(p) is easy [Edmonds 71, Lovasz 82]: Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

15 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Separation/Optimization over conv(p) is easy [Edmonds 71, Lovasz 82]: Given (w, x): Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

16 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Separation/Optimization over conv(p) is easy [Edmonds 71, Lovasz 82]: Given (w, x): 1 Sort components of x so that x (1) x (2) x (n). Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

17 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Separation/Optimization over conv(p) is easy [Edmonds 71, Lovasz 82]: Given (w, x): 1 Sort components of x so that x (1) x (2) x (n). 2 Let (i) = f ( j i a (j)) f ( j<i a (j)), i > 0, and 0 = f (0). Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

18 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Separation/Optimization over conv(p) is easy [Edmonds 71, Lovasz 82]: Given (w, x): 1 Sort components of x so that x (1) x (2) x (n). 2 Let (i) = f ( j i a (j)) f ( j<i a (j)), i > 0, and 0 = f (0). 3 Then (w, x) conv(p) 0 + i (i)x (i) w Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

19 Submodular Polyhedra P := {(w, x) : w f (a x)} is the epigraph of a submodular function Separation/Optimization over conv(p) is easy [Edmonds 71, Lovasz 82]: Given (w, x): 1 Sort components of x so that x (1) x (2) x (n). 2 Let (i) = f ( j i a (j)) f ( j<i a (j)), i > 0, and 0 = f (0). 3 Then (w, x) conv(p) 0 + i (i)x (i) w Submodular inequalities in MINLP: Atamturk et al. 08, 09, 12, Tawarmalani 10, A.+Papageorgiou 13, Bauman et al Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

20 Cardinality Constrained Submodular Polyhedra We are interested in conv(p X) where X is a cardinality constraint Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

21 Cardinality Constrained Submodular Polyhedra We are interested in conv(p X) where X is a cardinality constraint General cardinality constrained submodular minimization min{f(x) : x X} is strongly NP-hard Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

22 Cardinality Constrained Submodular Polyhedra We are interested in conv(p X) where X is a cardinality constraint General cardinality constrained submodular minimization min{f(x) : x X} is strongly NP-hard However concave cardinality constrained minimization min{f (a x) : x X} is easy (Onn 03) Combinatorial separation algorithm Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

23 Cardinality Constrained Submodular Polyhedra We are interested in conv(p X) where X is a cardinality constraint General cardinality constrained submodular minimization min{f(x) : x X} is strongly NP-hard However concave cardinality constrained minimization min{f (a x) : x X} is easy (Onn 03) Combinatorial separation algorithm Goal: Extend the submodular inequalities to incorporate cardinality constraint Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

24 Illustration w p x x2 2 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

25 Illustration 0 1 x 1 2 x 2 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

26 Illustration w x x 2 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

27 Illustration w x x 2 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

28 Results P = { } (w, x) R {0, 1} n : w f (a x) X = {x [0, 1] n : e x K } Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

29 Results P = { } (w, x) R {0, 1} n : w f (a x) X = {x [0, 1] n : e x K } Unweighted case (identical a i s): Complete description of conv(p X) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

30 Results P = { } (w, x) R {0, 1} n : w f (a x) X = {x [0, 1] n : e x K } Unweighted case (identical a i s): Complete description of conv(p X) Weighted case (general a i ): Family of facets/valid inequalities by lifting Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

31 Results P = { } (w, x) R {0, 1} n : w f (a x) X = {x [0, 1] n : e x K } Unweighted case (identical a i s): Complete description of conv(p X) Weighted case (general a i ): Family of facets/valid inequalities by lifting Computational results for mean-risk knapsack Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

32 Unweighted Case Assume a i = 1 thus f (a x) = f ( S ) where x i = 1 for all i S Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

33 Unweighted Case Assume a i = 1 thus f (a x) = f ( S ) where x i = 1 for all i S Let S := {S [n] : S K } Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

34 Unweighted Case Assume a i = 1 thus f (a x) = f ( S ) where x i = 1 for all i S Let S := {S [n] : S K } (w, x) conv(p X) ρ 0 + ρ i x i w i [n] Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

35 Unweighted Case Assume a i = 1 thus f (a x) = f ( S ) where x i = 1 for all i S Let S := {S [n] : S K } (w, x) conv(p X) ρ 0 + ρ i x i w i [n] where ρ is an optimal solution to the (dual) LP: max ρ 0 + i [n]ρ i x i s.t. ρ 0 + i S ρ i f ( S ) S S Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

36 Unweighted Case Assume a i = 1 thus f (a x) = f ( S ) where x i = 1 for all i S Let S := {S [n] : S K } (w, x) conv(p X) ρ 0 + ρ i x i w i [n] where ρ is an optimal solution to the (dual) LP: max ρ 0 + i [n]ρ i x i s.t. ρ 0 + i S ρ i f ( S ) S S The primal LP: min s.t. f ( S )P(S) S S P(S) = x i S S:i S P(S) = 1, P(S) 0 S S i [n] S S Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

37 Unweighted Case: Construction Given x X, construct a feasible solution to the dual based on order and values of x i Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

38 Unweighted Case: Construction Given x X, construct a feasible solution to the dual based on order and values of x i Gives a valid inequality Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

39 Unweighted Case: Construction Given x X, construct a feasible solution to the dual based on order and values of x i Gives a valid inequality Construct a feasible solution to the primal with equal objective value Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

40 Unweighted Case: Construction Given x X, construct a feasible solution to the dual based on order and values of x i Gives a valid inequality Construct a feasible solution to the primal with equal objective value Proves optimality Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

41 Unweighted Case: Dual Solution Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

42 Unweighted Case: Dual Solution Assume 1 =: x 0 x 1 x 2 x n (by reindexing) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

43 Unweighted Case: Dual Solution Assume 1 =: x 0 x 1 x 2 x n (by reindexing) Let z i := Kx i K 1 j=i x j for i = 0, 1,..., K Note that z i z i+1 for all i = 0, 1,..., K Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

44 Unweighted Case: Dual Solution Assume 1 =: x 0 x 1 x 2 x n (by reindexing) Let z i := Kx i K 1 j=i x j for i = 0, 1,..., K Note that z i z i+1 for all i = 0, 1,..., K Let y := n j=k x j Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

45 Unweighted Case: Dual Solution Assume 1 =: x 0 x 1 x 2 x n (by reindexing) Let z i := Kx i K 1 j=i x j for i = 0, 1,..., K Note that z i z i+1 for all i = 0, 1,..., K Let y := n j=k x j Let i 0 := argmax{0 i K 1 : z i y z i+1 } Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

46 Unweighted Case: Dual Solution Assume 1 =: x 0 x 1 x 2 x n (by reindexing) Let z i := Kx i K 1 j=i x j for i = 0, 1,..., K Note that z i z i+1 for all i = 0, 1,..., K Let y := n j=k x j Let i 0 := argmax{0 i K 1 : z i y z i+1 } The dual solution: ρ i = f (0) i = 0 f (i) f (i 1) 1 i i 0 i 0 < i n f (K ) f (i 0 ) K i 0 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

47 Unweighted Case: Dual Solution Assume 1 =: x 0 x 1 x 2 x n (by reindexing) Let z i := Kx i K 1 j=i x j for i = 0, 1,..., K Note that z i z i+1 for all i = 0, 1,..., K Let y := n j=k x j Let i 0 := argmax{0 i K 1 : z i y z i+1 } The dual solution: ρ i = f (0) i = 0 f (i) f (i 1) 1 i i 0 i 0 < i n f (K ) f (i 0 ) K i 0 Note that ρ i = i for i i 0 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

48 Unweighted Case: Validity Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

49 Unweighted Case: Validity Consider any i 0 {0,..., K 1} Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

50 Unweighted Case: Validity Consider any i 0 {0,..., K 1} Consider arbitrary S S Let S 1 = S {1,..., i 0 } and S 2 = S \ S 1 Let i 1 = S 1 and i 2 = S 2 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

51 Unweighted Case: Validity Consider any i 0 {0,..., K 1} Consider arbitrary S S Let S 1 = S {1,..., i 0 } and S 2 = S \ S 1 Let i 1 = S 1 and i 2 = S 2 Need to show: ρ 0 + i S ρ i f (S) = f (i 1 + i 2 ) ( ) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

52 Unweighted Case: Validity Consider any i 0 {0,..., K 1} Consider arbitrary S S Let S 1 = S {1,..., i 0 } and S 2 = S \ S 1 Let i 1 = S 1 and i 2 = S 2 Need to show: ρ 0 + i S ρ i f (S) = f (i 1 + i 2 ) ( ) The lhs of ( ): 0 + i S 1 i + i S 2 ρ i f (i 1 ) + i 2 f (K ) f (i 0) K i 0 by construction and validity of the usual submodular inequality corresponding to S 1 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

53 Unweighted Case: Validity (contd.) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

54 Unweighted Case: Validity (contd.) Sufficient to show that f (i 1 ) + i 2 f (K ) f (i 0) K i 0 f (i 1 + i 2 ) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

55 Unweighted Case: Validity (contd.) Sufficient to show that f (i 1 ) + i 2 f (K ) f (i 0) K i 0 f (i 1 + i 2 ) Assume i 2 > 0 otherwise we are done Rearranging f (K ) f (i 0 ) K i 0 f (i 1 + i 2 ) f (i 1 ) i 2 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

56 Unweighted Case: Validity (contd.) Sufficient to show that f (i 1 ) + i 2 f (K ) f (i 0) K i 0 f (i 1 + i 2 ) Assume i 2 > 0 otherwise we are done Rearranging f (K ) f (i 0 ) K i 0 f (i 1 + i 2 ) f (i 1 ) i 2 The above inequality can be shown using concavity of f (i) and i 1 i 0 K Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

57 Unweighted Case: Primal Solution Need to construct P(S) for all S S := {S [n] : S K } ; {1} {1, 2}. {1, 2,...,i 0 } {1, 2,...,i 0 } [ C {1, 2,...,i 0 } [ C i 0 i n Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

58 Unweighted Case: Primal Solution Need to construct P(S) for all S S := {S [n] : S K } ; {1} {1, 2}. {1, 2,...,i 0 } {1, 2,...,i 0 } [ C {1, 2,...,i 0 } [ C i 0 i n Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

59 Unweighted Case: Primal Solution Need to construct P(S) for all S S := {S [n] : S K } ; {1} {1, 2}. {1, 2,...,i 0 } {1, 2,...,i 0 } [ C {1, 2,...,i 0 } [ C i 0 i n C {i 0 +1,...,n}, C = K i 0 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

60 Unweighted Case: Primal Solution Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

61 Unweighted Case: Primal Solution P( ) = 1 x 1 P({1,..., i}) = x i x i+1 for i = 1,..., i 0 1 P({1,..., i 0 }) = z i 0 y K i 0 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

62 Unweighted Case: Primal Solution P( ) = 1 x 1 P({1,..., i}) = x i x i+1 for i = 1,..., i 0 1 P({1,..., i 0 }) = z i 0 y K i 0 Key Lemma: There exists a nonnegative solution to the following linear system C:C C Q(C) = x i, i = i 0 + 1,..., n where C = {C {i 0 + 1,..., n} : C = K i 0 } Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

63 Unweighted Case: Primal Solution P( ) = 1 x 1 P({1,..., i}) = x i x i+1 for i = 1,..., i 0 1 P({1,..., i 0 }) = z i 0 y K i 0 Key Lemma: There exists a nonnegative solution to the following linear system C:C C Q(C) = x i, i = i 0 + 1,..., n where C = {C {i 0 + 1,..., n} : C = K i 0 } P({1,..., i 0 } C) = Q(C) for all C C Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

64 Unweighted Case: Primal Solution P( ) = 1 x 1 P({1,..., i}) = x i x i+1 for i = 1,..., i 0 1 P({1,..., i 0 }) = z i 0 y K i 0 Key Lemma: There exists a nonnegative solution to the following linear system C:C C Q(C) = x i, i = i 0 + 1,..., n where C = {C {i 0 + 1,..., n} : C = K i 0 } P({1,..., i 0 } C) = Q(C) for all C C The constructed primal solution is feasible and has the same objective value as that of the dual problem Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

65 Weighted Case: Exact Lifting Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

66 Weighted Case: Exact Lifting Consider a set S [n] with S = K Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

67 Weighted Case: Exact Lifting Consider a set S [n] with S = K The usual submodular inequality 0 + i S ix i w is a facet of conv(p {x : x i = 0 j S}) Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

68 Weighted Case: Exact Lifting Consider a set S [n] with S = K The usual submodular inequality 0 + i S ix i w is a facet of conv(p {x : x i = 0 j S}) Compute coefficients of variables not in S by (sequence dependent) lifting Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

69 Weighted Case: Exact Lifting Consider a set S [n] with S = K The usual submodular inequality 0 + i S ix i w is a facet of conv(p {x : x i = 0 j S}) Compute coefficients of variables not in S by (sequence dependent) lifting Lifting problem is a concave minimization problem over a cardinality system.. solvable in O(n 3 ) [Atamturk and Naraynan 09, Onn 03] Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

70 Weighted Case: Exact Lifting Consider a set S [n] with S = K The usual submodular inequality 0 + i S ix i w is a facet of conv(p {x : x i = 0 j S}) Compute coefficients of variables not in S by (sequence dependent) lifting Lifting problem is a concave minimization problem over a cardinality system.. solvable in O(n 3 ) [Atamturk and Naraynan 09, Onn 03] Resulting (facet-defining) lifted inequality (LI): 0 + i S i x i + i S λ i x i w Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

71 Weighted Case: Approximate Lifting Sort x 1 x 2 x n Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

72 Weighted Case: Approximate Lifting Sort x 1 x 2 x n Let T i = argmax{a(t ) : T [i 1], T = K 1} for all i > K Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

73 Weighted Case: Approximate Lifting Sort x 1 x 2 x n Let T i = argmax{a(t ) : T [i 1], T = K 1} for all i > K Let γ i = f (a(t i {i})) f (a(t i )) for all i = K + 1,..., n Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

74 Weighted Case: Approximate Lifting Sort x 1 x 2 x n Let T i = argmax{a(t ) : T [i 1], T = K 1} for all i > K Let γ i = f (a(t i {i})) f (a(t i )) for all i = K + 1,..., n The approximate lifted inequality: 0 + is valid for conv(p X) K i x i + i=1 n i=k +1 γ i x i w Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

75 Weighted Case: Approximate Lifting Sort x 1 x 2 x n Let T i = argmax{a(t ) : T [i 1], T = K 1} for all i > K Let γ i = f (a(t i {i})) f (a(t i )) for all i = K + 1,..., n The approximate lifted inequality: 0 + is valid for conv(p X) K i x i + i=1 Proof: 0 γ i λ i for all i > K n i=k +1 γ i x i w Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

76 Weighted Case: Remarks on Approximate Lifting The approximate lifting inequality is a version of the unweighted inequality corresponding to i 0 = K 1 i γ i for all i > K with the inequality being strict when f is strictly monotone (e.g. square root) Can be computed in O(n log n) time Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

77 Computations: Instances Mean-risk Knapsack: min µ i x i + λ σi 2 x i : c x b, x {0, 1} n i i 1,080 unweighted and 1,080 weighted instances randomly generated (n = 50, 80, 100) Knapsack to Cardinality: Let c 1 c n and pick K such that c c K b and c c K +1 > b Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

78 Computations: Experiments Compare branch-and-cut time and nodes for Mixed Integer SOCP formulation (Replace x i by xi 2 ) [SCOP] SOCP + 5 rounds of usual submodular inequalities [Edmonds] SOCP + 5 rounds of exact separated inequalities in the unweighted case, or SOCP + 5 rounds of approximate lifted inequality in the weighted case [Lifted] Implemented in Python + Gurobi 5.6 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

79 Computations: Performance profiles (Time) SOCP Edmond Lifted SOCP Edmond Lifted Unweighted Weighted Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

80 Computations: Averages SOCP Edmonds Lifted Unweighted Time: Nodes: 221, ,444 75,811 Weighted Time: Nodes: 59,779 34,366 27,928 Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

81 Concluding Remarks P = { (w, x) R {0, 1} n : w f (a x) } X = {x [0, 1] n : e x K } Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

82 Concluding Remarks P = { (w, x) R {0, 1} n : w f (a x) } X = {x [0, 1] n : e x K } Summary: Unweighted case (identical a i s): Complete description of conv(p X) Weighted case (general a i ): Family of facets/valid inequalities by lifting Computational results for mean-risk knapsack Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

83 Concluding Remarks P = { (w, x) R {0, 1} n : w f (a x) } X = {x [0, 1] n : e x K } Summary: Unweighted case (identical a i s): Complete description of conv(p X) Weighted case (general a i ): Family of facets/valid inequalities by lifting Computational results for mean-risk knapsack Some open issues: Handle correlations x Σx by introducing new variables for cross terms Mixed integer setting Submodular relaxations of other classes of MINLP Ahmed and Yu Constrained Submodular Polyhedra MINLP / 23

Lagrangean Decomposition for Mean-Variance Combinatorial Optimization

Lagrangean Decomposition for Mean-Variance Combinatorial Optimization Lagrangean Decomposition for Mean-Variance Combinatorial Optimization Frank Baumann, Christoph Buchheim, and Anna Ilyina Fakultät für Mathematik, Technische Universität Dortmund, Germany {frank.baumann,christoph.buchheim,anna.ilyina}@tu-dortmund.de

More information

BCOL RESEARCH REPORT 07.04

BCOL RESEARCH REPORT 07.04 BCOL RESEARCH REPORT 07.04 Industrial Engineering & Operations Research University of California, Berkeley, CA 94720-1777 LIFTING FOR CONIC MIXED-INTEGER PROGRAMMING ALPER ATAMTÜRK AND VISHNU NARAYANAN

More information

Optimization of Submodular Functions Tutorial - lecture I

Optimization of Submodular Functions Tutorial - lecture I Optimization of Submodular Functions Tutorial - lecture I Jan Vondrák 1 1 IBM Almaden Research Center San Jose, CA Jan Vondrák (IBM Almaden) Submodular Optimization Tutorial 1 / 1 Lecture I: outline 1

More information

Lagrangian Relaxation in MIP

Lagrangian Relaxation in MIP Lagrangian Relaxation in MIP Bernard Gendron May 28, 2016 Master Class on Decomposition, CPAIOR2016, Banff, Canada CIRRELT and Département d informatique et de recherche opérationnelle, Université de Montréal,

More information

The moment-lp and moment-sos approaches

The moment-lp and moment-sos approaches The moment-lp and moment-sos approaches LAAS-CNRS and Institute of Mathematics, Toulouse, France CIRM, November 2013 Semidefinite Programming Why polynomial optimization? LP- and SDP- CERTIFICATES of POSITIVITY

More information

Lifting for conic mixed-integer programming

Lifting for conic mixed-integer programming Math. Program., Ser. A DOI 1.17/s117-9-282-9 FULL LENGTH PAPER Lifting for conic mixed-integer programming Alper Atamtürk Vishnu Narayanan Received: 13 March 28 / Accepted: 28 January 29 The Author(s)

More information

HW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given.

HW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given. HW1 solutions Exercise 1 (Some sets of probability distributions.) Let x be a real-valued random variable with Prob(x = a i ) = p i, i = 1,..., n, where a 1 < a 2 < < a n. Of course p R n lies in the standard

More information

Submodular Functions Properties Algorithms Machine Learning

Submodular Functions Properties Algorithms Machine Learning Submodular Functions Properties Algorithms Machine Learning Rémi Gilleron Inria Lille - Nord Europe & LIFL & Univ Lille Jan. 12 revised Aug. 14 Rémi Gilleron (Mostrare) Submodular Functions Jan. 12 revised

More information

9. Submodular function optimization

9. Submodular function optimization Submodular function maximization 9-9. Submodular function optimization Submodular function maximization Greedy algorithm for monotone case Influence maximization Greedy algorithm for non-monotone case

More information

n-step mingling inequalities: new facets for the mixed-integer knapsack set

n-step mingling inequalities: new facets for the mixed-integer knapsack set Math. Program., Ser. A (2012) 132:79 98 DOI 10.1007/s10107-010-0382-6 FULL LENGTH PAPER n-step mingling inequalities: new facets for the mixed-integer knapsack set Alper Atamtürk Kiavash Kianfar Received:

More information

An Integer Programming Approach for Linear Programs with Probabilistic Constraints

An Integer Programming Approach for Linear Programs with Probabilistic Constraints An Integer Programming Approach for Linear Programs with Probabilistic Constraints James Luedtke Shabbir Ahmed George Nemhauser Georgia Institute of Technology 765 Ferst Drive, Atlanta, GA, USA luedtke@gatech.edu

More information

Lifted Inequalities for 0 1 Mixed-Integer Bilinear Covering Sets

Lifted Inequalities for 0 1 Mixed-Integer Bilinear Covering Sets 1 2 3 Lifted Inequalities for 0 1 Mixed-Integer Bilinear Covering Sets Kwanghun Chung 1, Jean-Philippe P. Richard 2, Mohit Tawarmalani 3 March 1, 2011 4 5 6 7 8 9 Abstract In this paper, we study 0 1 mixed-integer

More information

Approximation Algorithms for Maximum. Coverage and Max Cut with Given Sizes of. Parts? A. A. Ageev and M. I. Sviridenko

Approximation Algorithms for Maximum. Coverage and Max Cut with Given Sizes of. Parts? A. A. Ageev and M. I. Sviridenko Approximation Algorithms for Maximum Coverage and Max Cut with Given Sizes of Parts? A. A. Ageev and M. I. Sviridenko Sobolev Institute of Mathematics pr. Koptyuga 4, 630090, Novosibirsk, Russia fageev,svirg@math.nsc.ru

More information

3.8 Strong valid inequalities

3.8 Strong valid inequalities 3.8 Strong valid inequalities By studying the problem structure, we can derive strong valid inequalities which lead to better approximations of the ideal formulation conv(x ) and hence to tighter bounds.

More information

informs DOI /moor.xxxx.xxxx

informs DOI /moor.xxxx.xxxx MATHEMATICS OF OPERATIONS RESEARCH Vol. 00, No. 0, Xxxxxx 20xx, pp. xxx xxx ISSN 0364-765X EISSN 1526-5471 xx 0000 0xxx informs DOI 10.1287/moor.xxxx.xxxx c 20xx INFORMS Polynomial-Time Approximation Schemes

More information

maxz = 3x 1 +4x 2 2x 1 +x 2 6 2x 1 +3x 2 9 x 1,x 2

maxz = 3x 1 +4x 2 2x 1 +x 2 6 2x 1 +3x 2 9 x 1,x 2 ex-5.-5. Foundations of Operations Research Prof. E. Amaldi 5. Branch-and-Bound Given the integer linear program maxz = x +x x +x 6 x +x 9 x,x integer solve it via the Branch-and-Bound method (solving

More information

1 Maximizing a Submodular Function

1 Maximizing a Submodular Function 6.883 Learning with Combinatorial Structure Notes for Lecture 16 Author: Arpit Agarwal 1 Maximizing a Submodular Function In the last lecture we looked at maximization of a monotone submodular function,

More information

a 1 a 2 a 3 a 4 v i c i c(a 1, a 3 ) = 3

a 1 a 2 a 3 a 4 v i c i c(a 1, a 3 ) = 3 AM 221: Advanced Optimization Spring 2016 Prof. Yaron Singer Lecture 17 March 30th 1 Overview In the previous lecture, we saw examples of combinatorial problems: the Maximal Matching problem and the Minimum

More information

March 2002, December Introduction. We investigate the facial structure of the convex hull of the mixed integer knapsack set

March 2002, December Introduction. We investigate the facial structure of the convex hull of the mixed integer knapsack set ON THE FACETS OF THE MIXED INTEGER KNAPSACK POLYHEDRON ALPER ATAMTÜRK Abstract. We study the mixed integer knapsack polyhedron, that is, the convex hull of the mixed integer set defined by an arbitrary

More information

MIXED INTEGER PROGRAMMING APPROACHES FOR NONLINEAR AND STOCHASTIC PROGRAMMING

MIXED INTEGER PROGRAMMING APPROACHES FOR NONLINEAR AND STOCHASTIC PROGRAMMING MIXED INTEGER PROGRAMMING APPROACHES FOR NONLINEAR AND STOCHASTIC PROGRAMMING A Thesis Presented to The Academic Faculty by Juan Pablo Vielma Centeno In Partial Fulfillment of the Requirements for the

More information

BCOL RESEARCH REPORT 08.02

BCOL RESEARCH REPORT 08.02 BCOL RESEARCH REPORT 08.02 Industrial Engineering & Operations Research University of California, Berkeley, CA Forthcoming in Mathematical Programming MAXIMIZING A CLASS OF SUBMODULAR UTILITY FUNCTIONS

More information

Conic optimization under combinatorial sparsity constraints

Conic optimization under combinatorial sparsity constraints Conic optimization under combinatorial sparsity constraints Christoph Buchheim and Emiliano Traversi Abstract We present a heuristic approach for conic optimization problems containing sparsity constraints.

More information

Submodular Functions: Extensions, Distributions, and Algorithms A Survey

Submodular Functions: Extensions, Distributions, and Algorithms A Survey Submodular Functions: Extensions, Distributions, and Algorithms A Survey Shaddin Dughmi PhD Qualifying Exam Report, Department of Computer Science, Stanford University Exam Committee: Serge Plotkin, Tim

More information

Cutting Plane Separators in SCIP

Cutting Plane Separators in SCIP Cutting Plane Separators in SCIP Kati Wolter Zuse Institute Berlin DFG Research Center MATHEON Mathematics for key technologies 1 / 36 General Cutting Plane Method MIP min{c T x : x X MIP }, X MIP := {x

More information

Discrete Optimization in a Nutshell

Discrete Optimization in a Nutshell Discrete Optimization in a Nutshell Integer Optimization Christoph Helmberg : [,] Contents Integer Optimization 2: 2 [2,2] Contents Integer Optimization. Bipartite Matching.2 Integral Polyhedra ( and directed

More information

Semidefinite Programming Basics and Applications

Semidefinite Programming Basics and Applications Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent

More information

Minimization and Maximization Algorithms in Discrete Convex Analysis

Minimization and Maximization Algorithms in Discrete Convex Analysis Modern Aspects of Submodularity, Georgia Tech, March 19, 2012 Minimization and Maximization Algorithms in Discrete Convex Analysis Kazuo Murota (U. Tokyo) 120319atlanta2Algorithm 1 Contents B1. Submodularity

More information

4y Springer NONLINEAR INTEGER PROGRAMMING

4y Springer NONLINEAR INTEGER PROGRAMMING NONLINEAR INTEGER PROGRAMMING DUAN LI Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, N. T. Hong Kong XIAOLING SUN Department of Mathematics Shanghai

More information

On the Polyhedral Structure of a Multi Item Production Planning Model with Setup Times

On the Polyhedral Structure of a Multi Item Production Planning Model with Setup Times CORE DISCUSSION PAPER 2000/52 On the Polyhedral Structure of a Multi Item Production Planning Model with Setup Times Andrew J. Miller 1, George L. Nemhauser 2, and Martin W.P. Savelsbergh 2 November 2000

More information

3.7 Strong valid inequalities for structured ILP problems

3.7 Strong valid inequalities for structured ILP problems 3.7 Strong valid inequalities for structured ILP problems By studying the problem structure, we can derive strong valid inequalities yielding better approximations of conv(x ) and hence tighter bounds.

More information

On deterministic reformulations of distributionally robust joint chance constrained optimization problems

On deterministic reformulations of distributionally robust joint chance constrained optimization problems On deterministic reformulations of distributionally robust joint chance constrained optimization problems Weijun Xie and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology,

More information

Robust Combinatorial Optimization under Convex and Discrete Cost Uncertainty

Robust Combinatorial Optimization under Convex and Discrete Cost Uncertainty EURO Journal on Computational Optimization manuscript No. (will be inserted by the editor) Robust Combinatorial Optimization under Convex and Discrete Cost Uncertainty Christoph Buchheim Jannis Kurtz Received:

More information

Cutting Planes for First Level RLT Relaxations of Mixed 0-1 Programs

Cutting Planes for First Level RLT Relaxations of Mixed 0-1 Programs Cutting Planes for First Level RLT Relaxations of Mixed 0-1 Programs 1 Cambridge, July 2013 1 Joint work with Franklin Djeumou Fomeni and Adam N. Letchford Outline 1. Introduction 2. Literature Review

More information

min3x 1 + 4x 2 + 5x 3 2x 1 + 2x 2 + x 3 6 x 1 + 2x 2 + 3x 3 5 x 1, x 2, x 3 0.

min3x 1 + 4x 2 + 5x 3 2x 1 + 2x 2 + x 3 6 x 1 + 2x 2 + 3x 3 5 x 1, x 2, x 3 0. ex-.-. Foundations of Operations Research Prof. E. Amaldi. Dual simplex algorithm Given the linear program minx + x + x x + x + x 6 x + x + x x, x, x. solve it via the dual simplex algorithm. Describe

More information

BCOL RESEARCH REPORT 05.03

BCOL RESEARCH REPORT 05.03 BCOL RESEARCH REPORT 05.03 Industrial Engineering & Operations Research University of California, Berkeley, CA Forthcoming in Mathematics of Operations Research THE FLOW SET WITH PARTIAL ORDER ALPER ATAMTU

More information

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra LP Duality: outline I Motivation and definition of a dual LP I Weak duality I Separating hyperplane theorem and theorems of the alternatives I Strong duality and complementary slackness I Using duality

More information

11.1 Set Cover ILP formulation of set cover Deterministic rounding

11.1 Set Cover ILP formulation of set cover Deterministic rounding CS787: Advanced Algorithms Lecture 11: Randomized Rounding, Concentration Bounds In this lecture we will see some more examples of approximation algorithms based on LP relaxations. This time we will use

More information

Sequential pairing of mixed integer inequalities

Sequential pairing of mixed integer inequalities Sequential pairing of mixed integer inequalities Yongpei Guan, Shabbir Ahmed, George L. Nemhauser School of Industrial & Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive, Atlanta,

More information

Gradient methods for minimizing composite functions

Gradient methods for minimizing composite functions Gradient methods for minimizing composite functions Yu. Nesterov May 00 Abstract In this paper we analyze several new methods for solving optimization problems with the objective function formed as a sum

More information

Submodularity in Machine Learning

Submodularity in Machine Learning Saifuddin Syed MLRG Summer 2016 1 / 39 What are submodular functions Outline 1 What are submodular functions Motivation Submodularity and Concavity Examples 2 Properties of submodular functions Submodularity

More information

Discrete (and Continuous) Optimization WI4 131

Discrete (and Continuous) Optimization WI4 131 Discrete (and Continuous) Optimization WI4 131 Kees Roos Technische Universiteit Delft Faculteit Electrotechniek, Wiskunde en Informatica Afdeling Informatie, Systemen en Algoritmiek e-mail: C.Roos@ewi.tudelft.nl

More information

Integer Programming: Cutting Planes

Integer Programming: Cutting Planes OptIntro 1 / 39 Integer Programming: Cutting Planes Eduardo Camponogara Department of Automation and Systems Engineering Federal University of Santa Catarina October 2016 OptIntro 2 / 39 Summary Introduction

More information

Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs

Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Siqian Shen Dept. of Industrial and Operations Engineering University of Michigan Joint work with Yan Deng (UMich, Google)

More information

Lecture 11 October 7, 2013

Lecture 11 October 7, 2013 CS 4: Advanced Algorithms Fall 03 Prof. Jelani Nelson Lecture October 7, 03 Scribe: David Ding Overview In the last lecture we talked about set cover: Sets S,..., S m {,..., n}. S has cost c S. Goal: Cover

More information

9. Interpretations, Lifting, SOS and Moments

9. Interpretations, Lifting, SOS and Moments 9-1 Interpretations, Lifting, SOS and Moments P. Parrilo and S. Lall, CDC 2003 2003.12.07.04 9. Interpretations, Lifting, SOS and Moments Polynomial nonnegativity Sum of squares (SOS) decomposition Eample

More information

3.10 Lagrangian relaxation

3.10 Lagrangian relaxation 3.10 Lagrangian relaxation Consider a generic ILP problem min {c t x : Ax b, Dx d, x Z n } with integer coefficients. Suppose Dx d are the complicating constraints. Often the linear relaxation and the

More information

Easy and not so easy multifacility location problems... (In 20 minutes.)

Easy and not so easy multifacility location problems... (In 20 minutes.) Easy and not so easy multifacility location problems... (In 20 minutes.) MINLP 2014 Pittsburgh, June 2014 Justo Puerto Institute of Mathematics (IMUS) Universidad de Sevilla Outline 1 Introduction (In

More information

Combinatorial Optimization

Combinatorial Optimization Combinatorial Optimization Lecture notes, WS 2010/11, TU Munich Prof. Dr. Raymond Hemmecke Version of February 9, 2011 Contents 1 The knapsack problem 1 1.1 Complete enumeration..................................

More information

Threshold Boolean Form for Joint Probabilistic Constraints with Random Technology Matrix

Threshold Boolean Form for Joint Probabilistic Constraints with Random Technology Matrix Threshold Boolean Form for Joint Probabilistic Constraints with Random Technology Matrix Alexander Kogan, Miguel A. Leeune Abstract We develop a new modeling and exact solution method for stochastic programming

More information

Dual Consistent Systems of Linear Inequalities and Cardinality Constrained Polytopes. Satoru FUJISHIGE and Jens MASSBERG.

Dual Consistent Systems of Linear Inequalities and Cardinality Constrained Polytopes. Satoru FUJISHIGE and Jens MASSBERG. RIMS-1734 Dual Consistent Systems of Linear Inequalities and Cardinality Constrained Polytopes By Satoru FUJISHIGE and Jens MASSBERG December 2011 RESEARCH INSTITUTE FOR MATHEMATICAL SCIENCES KYOTO UNIVERSITY,

More information

Sequence independent lifting for 0 1 knapsack problems with disjoint cardinality constraints

Sequence independent lifting for 0 1 knapsack problems with disjoint cardinality constraints Sequence independent lifting for knapsack problems with disjoint cardinality constraints Bo Zeng and Jean-Philippe P. Richard School of Industrial Engineering, Purdue University, 35 N. Grant Street, West

More information

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations

A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations A notion of for Convex, Semidefinite and Extended Formulations Marcel de Carli Silva Levent Tunçel April 26, 2018 A vector in R n is integral if each of its components is an integer, A vector in R n is

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models David Sontag New York University Lecture 6, March 7, 2013 David Sontag (NYU) Graphical Models Lecture 6, March 7, 2013 1 / 25 Today s lecture 1 Dual decomposition 2 MAP inference

More information

Strong Formulations of Robust Mixed 0 1 Programming

Strong Formulations of Robust Mixed 0 1 Programming Math. Program., Ser. B 108, 235 250 (2006) Digital Object Identifier (DOI) 10.1007/s10107-006-0709-5 Alper Atamtürk Strong Formulations of Robust Mixed 0 1 Programming Received: January 27, 2004 / Accepted:

More information

Symmetry and hardness of submodular maximization problems

Symmetry and hardness of submodular maximization problems Symmetry and hardness of submodular maximization problems Jan Vondrák 1 1 Department of Mathematics Princeton University Jan Vondrák (Princeton University) Symmetry and hardness 1 / 25 Submodularity Definition

More information

MIP reformulations of some chance-constrained mathematical programs

MIP reformulations of some chance-constrained mathematical programs MIP reformulations of some chance-constrained mathematical programs Ricardo Fukasawa Department of Combinatorics & Optimization University of Waterloo December 4th, 2012 FIELDS Industrial Optimization

More information

EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding

EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding Motivation Make a social choice that (approximately) maximizes the social welfare subject to the economic constraints

More information

Lagrange Relaxation and Duality

Lagrange Relaxation and Duality Lagrange Relaxation and Duality As we have already known, constrained optimization problems are harder to solve than unconstrained problems. By relaxation we can solve a more difficult problem by a simpler

More information

Dual fitting approximation for Set Cover, and Primal Dual approximation for Set Cover

Dual fitting approximation for Set Cover, and Primal Dual approximation for Set Cover duality 1 Dual fitting approximation for Set Cover, and Primal Dual approximation for Set Cover Guy Kortsarz duality 2 The set cover problem with uniform costs Input: A universe U and a collection of subsets

More information

Chance Constrained Programming

Chance Constrained Programming IE 495 Lecture 22 Chance Constrained Programming Prof. Jeff Linderoth April 21, 2003 April 21, 2002 Stochastic Programming Lecture 22 Slide 1 Outline HW Fixes Chance Constrained Programming Is Hard Main

More information

MATHEMATICAL ENGINEERING TECHNICAL REPORTS. On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis

MATHEMATICAL ENGINEERING TECHNICAL REPORTS. On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis MATHEMATICAL ENGINEERING TECHNICAL REPORTS On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis Akiyoshi SHIOURA (Communicated by Kazuo MUROTA) METR

More information

Robust Combinatorial Optimization under Budgeted-Ellipsoidal Uncertainty

Robust Combinatorial Optimization under Budgeted-Ellipsoidal Uncertainty EURO Journal on Computational Optimization manuscript No. (will be inserted by the editor) Robust Combinatorial Optimization under Budgeted-Ellipsoidal Uncertainty Jannis Kurtz Received: date / Accepted:

More information

Cutting Planes in SCIP

Cutting Planes in SCIP Cutting Planes in SCIP Kati Wolter Zuse-Institute Berlin Department Optimization Berlin, 6th June 2007 Outline 1 Cutting Planes in SCIP 2 Cutting Planes for the 0-1 Knapsack Problem 2.1 Cover Cuts 2.2

More information

Learning with Submodular Functions: A Convex Optimization Perspective

Learning with Submodular Functions: A Convex Optimization Perspective Foundations and Trends R in Machine Learning Vol. 6, No. 2-3 (2013) 145 373 c 2013 F. Bach DOI: 10.1561/2200000039 Learning with Submodular Functions: A Convex Optimization Perspective Francis Bach INRIA

More information

ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications

ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications Professor M. Chiang Electrical Engineering Department, Princeton University March

More information

Gradient methods for minimizing composite functions

Gradient methods for minimizing composite functions Math. Program., Ser. B 2013) 140:125 161 DOI 10.1007/s10107-012-0629-5 FULL LENGTH PAPER Gradient methods for minimizing composite functions Yu. Nesterov Received: 10 June 2010 / Accepted: 29 December

More information

Matroid Optimisation Problems with Nested Non-linear Monomials in the Objective Function

Matroid Optimisation Problems with Nested Non-linear Monomials in the Objective Function atroid Optimisation Problems with Nested Non-linear onomials in the Objective Function Anja Fischer Frank Fischer S. Thomas ccormick 14th arch 2016 Abstract Recently, Buchheim and Klein [4] suggested to

More information

Operations Research Methods in Constraint Programming

Operations Research Methods in Constraint Programming Operations Research Methods in Constraint Programming John Hooker Carnegie Mellon University Prepared for Lloret de Mar, Spain June 2007 2007 Slide 1 CP and OR Have Complementary Strengths CP: Inference

More information

Massachusetts Institute of Technology 6.854J/18.415J: Advanced Algorithms Friday, March 18, 2016 Ankur Moitra. Problem Set 6

Massachusetts Institute of Technology 6.854J/18.415J: Advanced Algorithms Friday, March 18, 2016 Ankur Moitra. Problem Set 6 Massachusetts Institute of Technology 6.854J/18.415J: Advanced Algorithms Friday, March 18, 2016 Ankur Moitra Problem Set 6 Due: Wednesday, April 6, 2016 7 pm Dropbox Outside Stata G5 Collaboration policy:

More information

Lecture 10 (Submodular function)

Lecture 10 (Submodular function) Discrete Methods in Informatics January 16, 2006 Lecture 10 (Submodular function) Lecturer: Satoru Iwata Scribe: Masaru Iwasa and Yukie Nagai Submodular functions are the functions that frequently appear

More information

Submodular Functions and Their Applications

Submodular Functions and Their Applications Submodular Functions and Their Applications Jan Vondrák IBM Almaden Research Center San Jose, CA SIAM Discrete Math conference, Minneapolis, MN June 204 Jan Vondrák (IBM Almaden) Submodular Functions and

More information

Relaxations and Bounds. 6.1 Optimality and Relaxations. Suppose that we are given an IP. z = max c T x : x X,

Relaxations and Bounds. 6.1 Optimality and Relaxations. Suppose that we are given an IP. z = max c T x : x X, 6 Relaxations and Bounds 6.1 Optimality and Relaxations Suppose that we are given an IP z = max c T x : x X, where X = x : Ax b,x Z n and a vector x X which is a candidate for optimality. Is there a way

More information

Submodular Functions, Optimization, and Applications to Machine Learning

Submodular Functions, Optimization, and Applications to Machine Learning Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 12 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee596b_spring_2016/ Prof. Jeff Bilmes University

More information

Lecture #21. c T x Ax b. maximize subject to

Lecture #21. c T x Ax b. maximize subject to COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the

More information

Approximation Basics

Approximation Basics Approximation Basics, Concepts, and Examples Xiaofeng Gao Department of Computer Science and Engineering Shanghai Jiao Tong University, P.R.China Fall 2012 Special thanks is given to Dr. Guoqiang Li for

More information

On the Existence of Ideal Solutions in Multi-objective 0-1 Integer Programs

On the Existence of Ideal Solutions in Multi-objective 0-1 Integer Programs On the Existence of Ideal Solutions in Multi-objective -1 Integer Programs Natashia Boland a, Hadi Charkhgard b, and Martin Savelsbergh a a School of Industrial and Systems Engineering, Georgia Institute

More information

Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions

Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions Mixed Integer Programming Models for Non-Separable Piecewise Linear Cost Functions Juan Pablo Vielma H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Joint

More information

3. Linear Programming and Polyhedral Combinatorics

3. Linear Programming and Polyhedral Combinatorics Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans April 5, 2017 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory

More information

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013 Convex Optimization (EE227A: UC Berkeley) Lecture 28 (Algebra + Optimization) 02 May, 2013 Suvrit Sra Admin Poster presentation on 10th May mandatory HW, Midterm, Quiz to be reweighted Project final report

More information

Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane

Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane Alberto Del Pia Department of Industrial and Systems Engineering & Wisconsin Institutes for Discovery, University of Wisconsin-Madison

More information

Inderjit Dhillon The University of Texas at Austin

Inderjit Dhillon The University of Texas at Austin Inderjit Dhillon The University of Texas at Austin ( Universidad Carlos III de Madrid; 15 th June, 2012) (Based on joint work with J. Brickell, S. Sra, J. Tropp) Introduction 2 / 29 Notion of distance

More information

Introduction to Semidefinite Programming I: Basic properties a

Introduction to Semidefinite Programming I: Basic properties a Introduction to Semidefinite Programming I: Basic properties and variations on the Goemans-Williamson approximation algorithm for max-cut MFO seminar on Semidefinite Programming May 30, 2010 Semidefinite

More information

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018 Section Notes 9 Midterm 2 Review Applied Math / Engineering Sciences 121 Week of December 3, 2018 The following list of topics is an overview of the material that was covered in the lectures and sections

More information

Mixed Integer Programming Solvers: from Where to Where. Andrea Lodi University of Bologna, Italy

Mixed Integer Programming Solvers: from Where to Where. Andrea Lodi University of Bologna, Italy Mixed Integer Programming Solvers: from Where to Where Andrea Lodi University of Bologna, Italy andrea.lodi@unibo.it November 30, 2011 @ Explanatory Workshop on Locational Analysis, Sevilla A. Lodi, MIP

More information

Relations between Semidefinite, Copositive, Semi-infinite and Integer Programming

Relations between Semidefinite, Copositive, Semi-infinite and Integer Programming Relations between Semidefinite, Copositive, Semi-infinite and Integer Programming Author: Faizan Ahmed Supervisor: Dr. Georg Still Master Thesis University of Twente the Netherlands May 2010 Relations

More information

CSE541 Class 22. Jeremy Buhler. November 22, Today: how to generalize some well-known approximation results

CSE541 Class 22. Jeremy Buhler. November 22, Today: how to generalize some well-known approximation results CSE541 Class 22 Jeremy Buhler November 22, 2016 Today: how to generalize some well-known approximation results 1 Intuition: Behavior of Functions Consider a real-valued function gz) on integers or reals).

More information

CO 250 Final Exam Guide

CO 250 Final Exam Guide Spring 2017 CO 250 Final Exam Guide TABLE OF CONTENTS richardwu.ca CO 250 Final Exam Guide Introduction to Optimization Kanstantsin Pashkovich Spring 2017 University of Waterloo Last Revision: March 4,

More information

The Simplex Method for Some Special Problems

The Simplex Method for Some Special Problems The Simplex Method for Some Special Problems S. Zhang Department of Econometrics University of Groningen P.O. Box 800 9700 AV Groningen The Netherlands September 4, 1991 Abstract In this paper we discuss

More information

arxiv: v1 [math.oc] 1 Jun 2015

arxiv: v1 [math.oc] 1 Jun 2015 NEW PERFORMANCE GUARANEES FOR HE GREEDY MAXIMIZAION OF SUBMODULAR SE FUNCIONS JUSSI LAIILA AND AE MOILANEN arxiv:1506.00423v1 [math.oc] 1 Jun 2015 Abstract. We present new tight performance guarantees

More information

Optimization over Sparse Symmetric Sets via a Nonmonotone Projected Gradient Method

Optimization over Sparse Symmetric Sets via a Nonmonotone Projected Gradient Method Optimization over Sparse Symmetric Sets via a Nonmonotone Projected Gradient Method Zhaosong Lu November 21, 2015 Abstract We consider the problem of minimizing a Lipschitz dierentiable function over a

More information

The Strength of Multi-row Aggregation Cuts for Sign-pattern Integer Programs

The Strength of Multi-row Aggregation Cuts for Sign-pattern Integer Programs The Strength of Multi-row Aggregation Cuts for Sign-pattern Integer Programs Santanu S. Dey 1, Andres Iroume 1, and Guanyi Wang 1 1 School of Industrial and Systems Engineering, Georgia Institute of Technology

More information

Reformulation and Decomposition of Integer Programs

Reformulation and Decomposition of Integer Programs Reformulation and Decomposition of Integer Programs François Vanderbeck 1 and Laurence A. Wolsey 2 (Reference: CORE DP 2009/16) (1) Université Bordeaux 1 & INRIA-Bordeaux (2) Université de Louvain, CORE.

More information

A packing integer program arising in two-layer network design

A packing integer program arising in two-layer network design A packing integer program arising in two-layer network design Christian Raack Arie M.C.A Koster Zuse Institute Berlin Takustr. 7, D-14195 Berlin Centre for Discrete Mathematics and its Applications (DIMAP)

More information

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs

More information

Lecture notes on the ellipsoid algorithm

Lecture notes on the ellipsoid algorithm Massachusetts Institute of Technology Handout 1 18.433: Combinatorial Optimization May 14th, 007 Michel X. Goemans Lecture notes on the ellipsoid algorithm The simplex algorithm was the first algorithm

More information

1 Submodular functions

1 Submodular functions CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: November 16, 2010 1 Submodular functions We have already encountered submodular functions. Let s recall

More information

Optimization in Process Systems Engineering

Optimization in Process Systems Engineering Optimization in Process Systems Engineering M.Sc. Jan Kronqvist Process Design & Systems Engineering Laboratory Faculty of Science and Engineering Åbo Akademi University Most optimization problems in production

More information

CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs. Instructor: Shaddin Dughmi

CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs. Instructor: Shaddin Dughmi CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs Instructor: Shaddin Dughmi Outline 1 Introduction 2 Shortest Path 3 Algorithms for Single-Source Shortest

More information

CS6999 Probabilistic Methods in Integer Programming Randomized Rounding Andrew D. Smith April 2003

CS6999 Probabilistic Methods in Integer Programming Randomized Rounding Andrew D. Smith April 2003 CS6999 Probabilistic Methods in Integer Programming Randomized Rounding April 2003 Overview 2 Background Randomized Rounding Handling Feasibility Derandomization Advanced Techniques Integer Programming

More information

Today: Linear Programming (con t.)

Today: Linear Programming (con t.) Today: Linear Programming (con t.) COSC 581, Algorithms April 10, 2014 Many of these slides are adapted from several online sources Reading Assignments Today s class: Chapter 29.4 Reading assignment for

More information