Consistency as Projection
|
|
- Darcy Harper
- 5 years ago
- Views:
Transcription
1 Consistency as Projection John Hooker Carnegie Mellon University INFORMS 2015, Philadelphia USA
2 Consistency as Projection Reconceive consistency in constraint programming as a form of projection. For eample, domain consistency, k-consistency, bounds consistency. 2
3 Consistency as Projection Define a stronger form of consistency, based on projection, that propagates through relaed decision diagrams. rather than through a domain store. J-consistency is achieved by projection onto a set J of variables. 3
4 Consistency as Projection Find J-consistency algorithms for some popular global constraints. Among, sequence, regular, SAT, alldiff. 4
5 The Big Picture Decision diagrams and optimization Relaed decision diagrams For constraint propagation, bounding, and discrete optimization Propagating J-consistency through relaed decision diagrams Achieving J-consistency 5
6 Decision Diagrams Graphical encoding of a function of Boolean (or multivalued) variables Historically used for circuit design & verification Lee (1959), Bryant (1986) Adapt to optimization and constraint programming (CP) Hadžić and JH (2006, 2007) 6
7 Decision Diagrams Eample: Stable set problem 1 Find ma-weight subset of nonadjacent vertices j = 0 j = 1 7
8 Decision Diagrams Eample: Stable set problem 1 Find ma-weight subset of nonadjacent vertices j = 0 j = 1 Each path corresponds to a feasible solution. 8
9 Decision Diagrams Eample: Stable set problem 20 1 Find ma-weight subset of nonadjacent vertices j = 0 j = Longest path (35) corresponds to an optimal solution. 9
10 Optimization in Decision Diagams We can optimize by finding a longest path in the decision diagram, but The decision diagram can grow eponentially with the problem size. 10
11 Relaed Decision Diagrams Key idea: Use relaed decision diagrams Represent a superset of the feasible set with a limited-width diagram. First used to strengthen propagation in CP solvers. Reduced 1-million-node search trees to 1 node for graph coloring (multiple alldiff) problem Andersen, Hadžić, JH, Tiedemann (2007) 11
12 Relaed Decision Diagrams Eact diagram Width = 3 9 solutions Relaed diagram Width = 2 11 solutions 12
13 Propagation Standard CP solvers use domain propagation. Domain consistency = each value in a variable s domain is part some feasible solution. Constraint 1 Reduce domains by achieving (or approimating) domain consistency Propagate domains Constraint 2 Constraint 3 Reduce domains further Reduce domains further Propagate domains 13
14 Propagation Eample with 2 constraints on 0-1 variables: nonadjacency constraint in stable set problem Reduce domains to: 1 {0} 2 {0,1} 3 {0,1} Longest path over reduced domains is 25, which is optimal for both constraints. 14
15 Propagation Eample with 2 constraints on 0-1 variables: nonadjacency constraint in stable set problem Reduce domains to: 1 {0} 2 {0,1} 3 {0,1} Longest path over reduced domains is 25, which is optimal for both constraints. However, domain propagation can be weak 15
16 Propagation Another eample: 1 2 nonadjacency constraint in stable set problem Constraints have no effect on domains. No information transmitted from one constraint to the other 16
17 Propagation Another eample: 1 2 nonadjacency constraint in stable set problem Constraints have no effect on domains. No information transmitted from one constraint to the other We can improve propagation by propagating through a relaed decision diagram. 17
18 Relaed Decision Diagrams Relaed diagram for nonadjacency constraint Diagram after propagating 1 2 Information is now transmitted between constraints. 18
19 Relaed Decision Diagrams Relaed decision diagrams also provide optimization bounds. Longest path in relaed diagram provides a bound on optimal value. Discrete relaation replaces LP relaation. Bergman, Ciré, van Hoeve, JH (2014) 19
20 Relaed Decision Diagrams Eact diagram Longest path = 35 Relaed diagram Longest path = 35 Bound is sharp in this case 20
21 Relaed Decision Diagrams Wider diagrams yield tighter bounds But take longer to build. Adjust width dynamically. 21
22 Discrete Optimization Relaed decision diagrams provide a general method for discrete optimization Solve a recursive (dynamic programming) model using a branch-and-bound algorithm. Branch on nodes in last eact layer of relaed decision diagram. rather than branching on variables. New approach to curse of dimensionality. Bergman, Ciré, van Hoeve, JH (2015) 22
23 Optimization 1 Branching in a relaed decision diagram 2 3 Diagram is eact down to here Relaed decision diagram 23
24 Optimization 1 Branching in a relaed decision diagram 2 3 Branch on nodes in this layer Relaed decision diagram 24
25 Optimization 1 Branching in a relaed decision diagram 2 3 First branch Relaed decision diagram 25
26 Optimization 1 Branching in a relaed decision diagram 2 3 Second branch Relaed decision diagram 26
27 Optimization 1 Branching in a relaed decision diagram 2 3 Third branch 4 Continue recursively 5 6 Relaed decision diagram 27
28 Average solution time (sec) Ma cut on a graph Avg. solution time vs graph density 30 vertices Optimization CPLEX MDDs Density of graph
29 Number of instances solved Ma 2-SAT Optimization Performance profile 30 variables MDDs CPLEX Computation time (sec)
30 Number of instances solved Ma 2-SAT Optimization Performance profile 40 variables MDDs CPLEX Computation time (sec)
31 Consistency Net step: Relaed decision diagrams transmit more than domain information. So let s define a stronger form of consistency than domain consistency. And propagate the results of achieving it. 31
32 Consistency Key observation: Eisting types of consistency are forms of projection. So define a stronger form of consistency based on projection. 32
33 Consistency as Projection Domain consistency Project onto each individual variable j. 33
34 Consistency as Projection Domain consistency Project onto each individual variable j. Eample: Constraint set alldiff,, a, b a, b b, c 34
35 Consistency as Projection Domain consistency Project onto each individual variable j. Eample: Constraint set alldiff,, a, b a, b b, c Solutions,, ( a, b, c) ( bac,, ) 35
36 Consistency as Projection Domain consistency Project onto each individual variable j. Eample: Constraint set Solutions Projection onto alldiff,, a, b a, b b, c,, ( a, b, c) ( bac,, ) a b 1, Projection onto 2 a b 2, Projection onto 3 3 c 36
37 Consistency as Projection Domain consistency Project onto each individual variable j. Eample: Constraint set Solutions Projection onto alldiff,, a, b a, b b, c,, ( a, b, c) ( bac,, ) This achieves domain consistency. a b 1, Projection onto 2 a b 2, Projection onto 3 3 c 37
38 Consistency as Projection Domain consistency Project onto each individual variable j. Eample: Constraint set Solutions Projection onto alldiff,, a, b a, b b, c,, ( a, b, c) ( bac,, ) This achieves domain consistency. We will regard a projection as a constraint set. a b 1, Projection onto 2 a b 2, Projection onto 3 3 c 38
39 Consistency as Projection k-consistency J = ( j j J) Can be defined: A constraint set S is k-consistent if: for every J {1,, n} with J = k 1, every assignment J = v J D j for which ( J, j ) does not violate S, and every variable j J, there is an assignment j = v j D j for which ( J, j ) = (v J,v j ) does not violate S. 39
40 Consistency as Projection k-consistency J = ( j j J) Can be defined: A constraint set S is k-consistent if: for every J {1,, n} with J = k 1, every assignment J = v J D j for which ( J, j ) does not violate S, and every variable j J, there is an assignment j = v j D j for which ( J, j ) = (v J,v j ) does not violate S. To achieve k-consistency: Project the constraints containing each set of k variables onto subsets of k 1 variables. 40
41 Consistency as Projection Consistency and backtracking: Strong k-consistency for entire constraint set avoids backtracking if the primal graph has width < k with respect to branching order. Freuder (1982) But strong k-consistency is very hard to achieve. 41
42 J-Consistency A type of consistency more directly related to projection. Constraint set S is J-consistent if it contains the projection of S onto J = ( j j J) S is domain consistent if it is { j }-consistent for each j. JH (2015) 42
43 J-Consistency J-consistency and backtracking: If we branch on variables 1, 2,, a natural strategy is to project out n, n1, until computational burden is ecessive. 43
44 Propagating J-Consistency Eample: among (, ),{ c, d},1,2 ( c) ( d), a, b, c, d alldiff,,, a, b c, d Already domain consistent for individual constraints. If we branch on 1 first, must consider all 4 branches 1 = a,b,c,d 44
45 Eample: ( c) ( d), a, b, c, d Propagating J-Consistency among (, ),{ c, d},1, alldiff,,, a, b c, d a,b,d a,b,c,d Suppose we propagate through a relaed decision diagram of width 2 for these constraints c d 52 paths from top to bottom represent assignments to 1, 2, 3, 4 36 of these are the feasible assignments. a,b c,d 45
46 Eample: ( c) ( d), a, b, c, d Propagating J-Consistency among (, ),{ c, d},1, alldiff,,, a, b c, d a,b,d a,b,c,d 52 paths from top to bottom represent assignments to 1, 2, 3, 4 36 of these are the feasible assignments. Suppose we propagate through a relaed decision diagram of width 2 for these constraints a,b c,d c d Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
47 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. Let the length of a path be number of arcs with labels in {c,d}. a,b,d c For each arc, indicate length of shortest path from top to that arc. a,b,c,d a,b c,d d Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
48 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. Let the length of a path be number of arcs with labels in {c,d}. a,b,d 0,0,1 c 1 For each arc, indicate length of shortest path from top to that arc. a,b,c,d 0,0,1,1 a,b c,d d 2 Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
49 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. Let the length of a path be number of arcs with labels in {c,d}. a,b,d 0,0,1 c 1 Remove arcs with label > 1 For each arc, indicate length of shortest path from top to that arc. a,b,c,d 0,0,1,1 a,b c,d d 2 Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
50 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. Let the length of a path be number of arcs with labels in {c,d}. a,b,d 0,0,1 c 1 Remove arcs with label > 1 For each arc, indicate length of shortest path from top to that arc. a,b,c,d 0,0,1,1 a,b c,d Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
51 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. Let the length of a path be number of arcs with labels in {c,d}. a,b,d 0,0,1 c 1 Remove arcs with label > 1 Clean up. For each arc, indicate length of shortest path from top to that arc. a,b,c,d 0,0,1,1 a,b c,d Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
52 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. Let the length of a path be number of arcs with labels in {c,d}. For each arc, indicate length of shortest path from top to that arc. a,b,d 0,0,1 a,b,c,d 0,0,1,1 a,b c,d Remove arcs with label > 1 Clean up. Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
53 Propagating J-Consistency Let s propagate the 2 nd atmost constraint in the projected alldiff through the relaed decision diagram. We need only branch on a,b,d rather than a,b,c,d a,b,d Remove arcs with label > 1 Clean up. a,b,c,d a,b c,d Projection of alldiff onto 1, 2 is alldiff, 1 2 atmost (, ),{ a, b},1 1 2 atmost (, ),{c,d},
54 Achieving J-consistency Constraint How hard to project? among sequence regular Easy and fast. More complicated but fast. Easy and basically same labor as domain consistency. SAT alldiff Efficient if conflict clauses are used as logic-based Benders cuts. Quite complicated but practical for small domains. 54
55 Projection of J-consistency for Among among (,, ), V, t, u where 1 among ( 1,, n 1), V, t, u onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise n 55
56 Eample Projection of J-consistency for Among among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u
57 Eample Projection of J-consistency for Among among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u among ( 1, 2, 3, 4 ),{ c, d},( t 1), u 1 57
58 Eample Projection of J-consistency for Among among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u among ( 1, 2, 3, 4 ),{ c, d},( t 1), u 1 among ( 1, 2, 3 ),{ c, d},( t 2), u 2 58
59 Eample Projection of J-consistency for Among among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u among ( 1, 2, 3, 4 ),{ c, d},( t 1), u 1 among ( 1, 2, 3 ),{ c, d},( t 2), u 2 among ( 1, 2),{ c, d},( t 3),min{ u 2,2} 59
60 Eample Projection of J-consistency for Among among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u among ( 1, 2, 3, 4 ),{ c, d},( t 1), u 1 among ( 1, 2, 3 ),{ c, d},( t 2), u 2 among ( 1, 2),{ c, d},( t 3),min{ u 2,2} among ( 1),{ c, d},( t 4),min{ u 2,1} 60
61 J-consistency for Among Eample Projection of among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u among ( 1, 2, 3, 4 ),{ c, d},( t 1), u 1 among ( 1, 2, 3 ),{ c, d},( t 2), u 2 among ( 1, 2),{ c, d},( t 3),min{ u 2,2} among ( 1),{ c, d},( t 4),min{ u 2,1} among (),{ c, d},( t 4),min{ u 2,0} 61
62 J-consistency for Among Eample Projection of among (,, ), V, t, u where D D D D D onto 1,, n1 is ( t 1), u 1 if D n V ( t, u) t,min{ u, n 1} if Dn V ( t 1),min{ u, n 1} otherwise a, b a, b, c a,d c, d d among ( 1,, n 1), V, t, u n among (,,,, ),{ c, d}, t, u among ( 1, 2, 3, 4 ),{ c, d},( t 1), u 1 among ( 1, 2, 3 ),{ c, d},( t 2), u 2 among ( 1, 2),{ c, d},( t 3),min{ u 2,2} among ( 1),{ c, d},( t 4),min{ u 2,1} among (),{ c, d},( t 4),min{ u 2,0} Feasible if and only if ( t 4) minu 2,0 62
63 J-Consistency for Sequence Projection is based on an integrality property. The coefficient matri of the inequality formulation has consecutive ones property. So projection of the conve hull of the feasible set is an integral polyhedron. Polyhedral projection therefore suffices. Straightforward (but tedious) application of Fourier elimination yields the projection. 63
64 J-Consistency for Sequence Projection is based on an integrality property. The coefficient matri of the inequality formulation has consecutive ones property. So projection of the conve hull of the feasible set is an integral polyhedron. Polyhedral projection therefore suffices. Straightforward (but tedious) application of Fourier elimination yields the projection. Projection onto any subset of variables is a generalized sequence constraint. Compleity of projecting out k is O(kq), where q = length of the overlapping sequences. 64
65 65
66 J-Consistency for Sequence Eample t3 t t,,, 0,1,, 1 among (,, ),{1},2,2, 4,5, To project out 6, add constraint among (,, ),{1},1,
67 J-Consistency for Sequence Eample t3 t t,,, 0,1,, 1 among (,, ),{1},2,2, 4,5, To project out 6, add constraint among (,, ),{1},1, To project out 5, add constraints among (,, ),{1},1,1 among (, ),{1},0,
68 J-Consistency for Sequence Eample t3 t t,,, 0,1,, 1 among (,, ),{1},2,2, 4,5, To project out 6, add constraint among (,, ),{1},1, To project out 5, add constraints among (,, ),{1},1,1 among (, ),{1},0, To project out 4, add constraints among ( ),{1},1,1 among (,, ),{1},1,2 among (, ),{1},0,1 among ( ),{1},0,
69 J-Consistency for Sequence Eample t3 t t,,, 0,1,, 1 among (,, ),{1},2,2, 4,5, To project out 6, add constraint among (,, ),{1},1, To project out 5, add constraints among (,, ),{1},1,1 among (, ),{1},0, To project out 4, add constraints among ( ),{1},1,1 among (,, ),{1},1,2 among (, ),{1},0,1 among ( ),{1},0, To project out 3, fi ( 1, 2 ) = (1,1) 69
70 J-Consistency for Regular Constraint Projection can be read from state transition graph. Compleity of projecting onto 1,, k for all k is O(nm 2 ), where n = number of variables, m = ma number of states per stage. 70
71 J-Consistency for Regular Constraint Projection can be read from state transition graph. Compleity of projecting onto 1,, k for all k is O(nm 2 ), where n = number of variables, m = ma number of states per stage. Shift scheduling eample Assign each worker to shift i {a,b,c} on each day i = 1,,7. Must work any given shift 2 or 3 days in a row. No direct transition between shifts a and c. Variable domains: D 1 = D 5 = {a,c}, D 2 = {a,b,c}, D 3 = D 6 = D 7 = {a,b}, D 4 = {b,c} 71
72 J-Consistency for Regular Constraint Deterministic finite automaton for this problem instance: = absorbing state Regular language epression: (((aa aaa)(bb bbb))* ((cc ccc)(bb bbb))*)*(c (aa aaa) (cc ccc)) 72
73 J-Consistency for Regular Constraint State transition graph for 7 stages Dashed lines lead to unreachable states. 73
74 J-Consistency for Regular Constraint State transition graph for 7 stages Dashed lines lead to unreachable states. Filtered domains 74
75 J-Consistency for Regular Constraint To project onto 1, 2, 3, truncate the graph at stage 4. 75
76 J-Consistency for Regular Constraint To project onto 1, 2, 3, truncate the graph at stage 4. 76
77 J-Consistency for Regular Constraint To project onto 1, 2, 3, truncate the graph at stage 4. Resulting graph can be viewed as a constraint that describes the projection. Constraint is easily propagated through a relaed decision diagram. 77
78 J-Consistency for SAT Project clause set onto J = { 1, 2, 3 }. Projection is
79 J-Consistency for SAT Use logic-based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem 1 2 Benders cut from previous iteration 79
80 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem 1 2 solution of master ( 1, 2, 3 ) = (0,1,0) Resulting subproblem 80
81 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem 1 2 solution of master ( 1, 2, 3 ) = (0,1,0) Resulting subproblem Subproblem is infeasible. ( 1, 3 )=(0,0) creates infeasibility 81
82 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem solution of master ( 1, 2, 3 ) = (0,1,0) Benders cut (nogood) Resulting subproblem Subproblem is infeasible. ( 1, 3 )=(0,0) creates infeasibility 82
83 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem solution of master ( 1, 2, 3 ) = (0,1,1) Resulting subproblem 83
84 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem solution of master ( 1, 2, 3 ) = (0,1,1) Resulting subproblem Subproblem is feasible 84
85 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem solution of master ( 1, 2, 3 ) = (0,1,1) Enumerative Benders cut Subproblem is feasible Resulting subproblem 85
86 J-Consistency for SAT Use logic based Benders decomposition Benders cuts describe projection onto master problem variables. Current Master problem solution of master ( 1, 2, 3 ) = (0,1,1) Enumerative Benders cut Resulting subproblem JH and Yan (1995) JH (2012) Continue until master is infeasible. Black Benders cuts describe projection. 86
87 J-Consistency for SAT Benders cuts = conflict clauses in a SAT algorithm Branch on 1, 2, 3 first. 87
88 J-Consistency for SAT Benders cuts = conflict clauses in a SAT algorithm Branch on 1, 2, 3 first. Conflict clauses 88
89 J-Consistency for SAT Benders cuts = conflict clauses in a SAT algorithm Branch on 1, 2, 3 first. Conflict clauses Backtrack to 3 at feasible leaf nodes 89
90 J-Consistency for SAT Benders cuts = conflict clauses in a SAT algorithm Branch on 1, 2, 3 first. Conflict clauses containing 1, 2, 3 describe projection 90
91 J-Consistency for Alldiff Constraint Projection is inherently complicated. But it can simplify for small domains. The result is a disjunction of constraint sets, each of which contains an alldiff constraint and some atmost constraints. 91
92 J-Consistency for Alldiff Constraint Eample alldiff,,,, ,,,,,,,,,,,,,, D a b c D c d e D d e f D e f g D a f g
93 J-Consistency for Alldiff Constraint Eample alldiff,,,, Projecting out 5, we get ,,,,,,,,,,,,,, D a b c D c d e D d e f D e f g D a f g a f g alldiff,,,, atmost (,,, ),{,, }, because 5 must take one of the values in {a,f,g}, leaving 2 for other i s. 93
94 J-Consistency for Alldiff Constraint Eample alldiff,,,, Projecting out 5, we get ,,,,,,,,,,,,,, D a b c D c d e D d e f D e f g D a f g a f g alldiff,,,, atmost (,,, ),{,, }, because 5 must take one of the values in {a,f,g}, leaving 2 for other i s. Projecting out 4, we note that 4 {a,f,g} or 4 {a,f,g}. If 4 {a,f,g}, we get a f g alldiff,,, atmost (,, ),{,, }, If 4 {a,f,g}, we get 4 = e, and we remove e from other domains. So the projection is D1 a, b, c alldiff 1, 2, 3 D2 c, d atmost ( 1, 2, 3 ),{ a, f, g},1 D 3 d, f 94
95 J-Consistency for Alldiff Constraint Eample alldiff,,,, ,,,,,,,,,,,,,, D a b c D c d e D d e f D e f g D a f g Projecting out 3, we get simply alldiff, 1 2 Projecting out 2, we get the original domain for 1 D1 a, b, c 95
96 96
97 Research Program Investigate projection for other global constraints. Design J-consistency maintenance algorithms (complete or incomplete) Add J-consistency maintenance to a CP solver. Along with propagation through decision diagrams. 97
98 Research Program Investigate projection for other global constraints. Design J-consistency maintenance algorithms (complete or incomplete) Add J-consistency maintenance to a CP solver. Along with propagation through decision diagrams. Congratulations! You survived 98 slides! 98
Projection, Consistency, and George Boole
Projection, Consistency, and George Boole John Hooker Carnegie Mellon University CP 2015, Cork, Ireland Projection as a Unifying Concept Projection underlies both optimization and logical inference. Optimization
More informationProjection, Inference, and Consistency
Projection, Inference, and Consistency John Hooker Carnegie Mellon University IJCAI 2016, New York City A high-level presentation. Don t worry about the details. 2 Projection as a Unifying Concept Projection
More informationProjection in Logic, CP, and Optimization
Projection in Logic, CP, and Optimization John Hooker Carnegie Mellon University Workshop on Logic and Search Melbourne, 2017 Projection as a Unifying Concept Projection is a fundamental concept in logic,
More informationStochastic Decision Diagrams
Stochastic Decision Diagrams John Hooker CORS/INFORMS Montréal June 2015 Objective Relaxed decision diagrams provide an generalpurpose method for discrete optimization. When the problem has a dynamic programming
More informationOptimization Bounds from Binary Decision Diagrams
Optimization Bounds from Binary Decision Diagrams J. N. Hooker Joint work with David Bergman, André Ciré, Willem van Hoeve Carnegie Mellon University ICS 203 Binary Decision Diagrams BDDs historically
More informationLogic, Optimization and Data Analytics
Logic, Optimization and Data Analytics John Hooker Carnegie Mellon University United Technologies Research Center, Cork, Ireland August 2015 Thesis Logic and optimization have an underlying unity. Ideas
More informationThe Separation Problem for Binary Decision Diagrams
The Separation Problem for Binary Decision Diagrams J. N. Hooker Joint work with André Ciré Carnegie Mellon University ISAIM 2014 Separation Problem in Optimization Given a relaxation of an optimization
More informationAlternative Methods for Obtaining. Optimization Bounds. AFOSR Program Review, April Carnegie Mellon University. Grant FA
Alternative Methods for Obtaining Optimization Bounds J. N. Hooker Carnegie Mellon University AFOSR Program Review, April 2012 Grant FA9550-11-1-0180 Integrating OR and CP/AI Early support by AFOSR First
More informationDecision Diagrams: Tutorial
Decision Diagrams: Tutorial John Hooker Carnegie Mellon University CP Summer School Cork, Ireland, June 2016 Decision Diagrams Used in computer science and AI for decades Logic circuit design Product configuration
More informationLessons from MIP Search. John Hooker Carnegie Mellon University November 2009
Lessons from MIP Search John Hooker Carnegie Mellon University November 2009 Outline MIP search The main ideas Duality and nogoods From MIP to AI (and back) Binary decision diagrams From MIP to constraint
More informationDecision Diagrams for Discrete Optimization
Decision Diagrams for Discrete Optimization Willem Jan van Hoeve Tepper School of Business Carnegie Mellon University www.andrew.cmu.edu/user/vanhoeve/mdd/ Acknowledgments: David Bergman, Andre Cire, Samid
More informationDecision Diagrams for Sequencing and Scheduling
Decision Diagrams for Sequencing and Scheduling Willem-Jan van Hoeve Tepper School of Business Carnegie Mellon University www.andrew.cmu.edu/user/vanhoeve/mdd/ Plan What can MDDs do for Combinatorial Optimization?
More informationA Scheme for Integrated Optimization
A Scheme for Integrated Optimization John Hooker ZIB November 2009 Slide 1 Outline Overview of integrated methods A taste of the underlying theory Eamples, with results from SIMPL Proposal for SCIP/SIMPL
More informationProjection, Consistency, and George Boole
Projection, Consistency, and George Boole J N Hooker Carnegie Mellon University, Pittsburgh, USA jh38@andrewcmuedu Abstract Although best known for his work in symbolic logic, George Boole made seminal
More informationA Framework for Integrating Optimization and Constraint Programming
A Framework for Integrating Optimization and Constraint Programming John Hooker Carnegie Mellon University SARA 2007 SARA 07 Slide Underlying theme Model vs. solution method. How can we match the model
More informationIntegrating Solution Methods. through Duality. US-Mexico Workshop on Optimization. Oaxaca, January John Hooker
Integrating Solution Methods through Duality John Hooker US-Meico Workshop on Optimization Oaaca, January 2011 Zapotec Duality mask Late classical period Represents life/death, day/night, heat/cold See
More informationOptimization in Process Systems Engineering
Optimization in Process Systems Engineering M.Sc. Jan Kronqvist Process Design & Systems Engineering Laboratory Faculty of Science and Engineering Åbo Akademi University Most optimization problems in production
More informationJob Sequencing Bounds from Decision Diagrams
Job Sequencing Bounds from Decision Diagrams J. N. Hooker Carnegie Mellon University June 2017 Abstract. In recent research, decision diagrams have proved useful for the solution of discrete optimization
More informationA Framework for Integrating Exact and Heuristic Optimization Methods
A Framework for Integrating Eact and Heuristic Optimization Methods John Hooker Carnegie Mellon University Matheuristics 2012 Eact and Heuristic Methods Generally regarded as very different. Eact methods
More informationHow to Relax. CP 2008 Slide 1. John Hooker Carnegie Mellon University September 2008
How to Relax Slide 1 John Hooker Carnegie Mellon University September 2008 Two ways to relax Relax your mind and body. Relax your problem formulations. Slide 2 Relaxing a problem Feasible set of original
More informationScheduling Home Hospice Care with Logic-Based Benders Decomposition
Scheduling Home Hospice Care with Logic-Based Benders Decomposition John Hooker Carnegie Mellon University Joint work with Aliza Heching Ryo Kimura Compassionate Care Hospice CMU Lehigh University October
More informationMDD-based Postoptimality Analysis for Mixed-integer Programs
MDD-based Postoptimality Analysis for Mixed-integer Programs John Hooker, Ryo Kimura Carnegie Mellon University Thiago Serra Mitsubishi Electric Research Laboratories Symposium on Decision Diagrams for
More informationMultivalued Decision Diagrams. Postoptimality Analysis Using. J. N. Hooker. Tarik Hadzic. Cork Constraint Computation Centre
Postoptimality Analysis Using Multivalued Decision Diagrams Tarik Hadzic Cork Constraint Computation Centre J. N. Hooker Carnegie Mellon University London School of Economics June 2008 Postoptimality Analysis
More informationAn Integrated Approach to Truss Structure Design
Slide 1 An Integrated Approach to Truss Structure Design J. N. Hooker Tallys Yunes CPAIOR Workshop on Hybrid Methods for Nonlinear Combinatorial Problems Bologna, June 2010 How to Solve Nonlinear Combinatorial
More informationarxiv: v1 [cs.cc] 5 Dec 2018
Consistency for 0 1 Programming Danial Davarnia 1 and J. N. Hooker 2 1 Iowa state University davarnia@iastate.edu 2 Carnegie Mellon University jh38@andrew.cmu.edu arxiv:1812.02215v1 [cs.cc] 5 Dec 2018
More informationOptimization Methods in Logic
Optimization Methods in Logic John Hooker Carnegie Mellon University February 2003, Revised December 2008 1 Numerical Semantics for Logic Optimization can make at least two contributions to boolean logic.
More informationGraph Coloring Inequalities from All-different Systems
Constraints manuscript No (will be inserted by the editor) Graph Coloring Inequalities from All-different Systems David Bergman J N Hooker Received: date / Accepted: date Abstract We explore the idea of
More informationInteger Programming and Branch and Bound
Courtesy of Sommer Gentry. Used with permission. Integer Programming and Branch and Bound Sommer Gentry November 4 th, 003 Adapted from slides by Eric Feron and Brian Williams, 6.40, 00. Integer Programming
More information9. Interpretations, Lifting, SOS and Moments
9-1 Interpretations, Lifting, SOS and Moments P. Parrilo and S. Lall, CDC 2003 2003.12.07.04 9. Interpretations, Lifting, SOS and Moments Polynomial nonnegativity Sum of squares (SOS) decomposition Eample
More informationDecision Diagram Relaxations for Integer Programming
Decision Diagram Relaxations for Integer Programming Christian Tjandraatmadja April, 2018 Tepper School of Business Carnegie Mellon University Submitted to the Tepper School of Business in Partial Fulfillment
More informationRepresentations of All Solutions of Boolean Programming Problems
Representations of All Solutions of Boolean Programming Problems Utz-Uwe Haus and Carla Michini Institute for Operations Research Department of Mathematics ETH Zurich Rämistr. 101, 8092 Zürich, Switzerland
More informationA Search-Infer-and-Relax Framework for Integrating Solution Methods
Carnegie Mellon University Research Showcase @ CMU Tepper School of Business 2005 A Search-Infer-and-Relax Framework for Integrating Solution Methods John N. Hooker Carnegie Mellon University, john@hooker.tepper.cmu.edu
More informationLogic-Based Benders Decomposition
Logic-Based Benders Decomposition J. N. Hooker Graduate School of Industrial Administration Carnegie Mellon University, Pittsburgh, PA 15213 USA G. Ottosson Department of Information Technology Computing
More informationEXACT ALGORITHMS FOR THE ATSP
EXACT ALGORITHMS FOR THE ATSP Branch-and-Bound Algorithms: Little-Murty-Sweeney-Karel (Operations Research, ); Bellmore-Malone (Operations Research, ); Garfinkel (Operations Research, ); Smith-Srinivasan-Thompson
More informationLift-and-Project cuts: an efficient solution method for mixed-integer programs
Lift-and-Project cuts: an efficient solution method for mied-integer programs Sebastian Ceria Graduate School of Business and Computational Optimization Research Center http://www.columbia.edu/~sc44 Columbia
More informationIntroduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 21 Dr. Ted Ralphs IE406 Lecture 21 1 Reading for This Lecture Bertsimas Sections 10.2, 10.3, 11.1, 11.2 IE406 Lecture 21 2 Branch and Bound Branch
More informationStrengthened Benders Cuts for Stochastic Integer Programs with Continuous Recourse
Strengthened Benders Cuts for Stochastic Integer Programs with Continuous Recourse Merve Bodur 1, Sanjeeb Dash 2, Otay Günlü 2, and James Luedte 3 1 Department of Mechanical and Industrial Engineering,
More informationCombining Optimization and Constraint Programming
Combining Optimization and Constraint Programming John Hooker Carnegie Mellon University GE Research Center 7 September 2007 GE 7 Sep 07 Slide 1 Optimization and Constraint Programming Optimization: focus
More informationComputational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs
Computational Integer Programming Lecture 2: Modeling and Formulation Dr. Ted Ralphs Computational MILP Lecture 2 1 Reading for This Lecture N&W Sections I.1.1-I.1.6 Wolsey Chapter 1 CCZ Chapter 2 Computational
More informationRobust Scheduling with Logic-Based Benders Decomposition
Robust Scheduling with Logic-Based Benders Decomposition Elvin Çoban and Aliza Heching and J N Hooker and Alan Scheller-Wolf Abstract We study project scheduling at a large IT services delivery center
More informationBenders decomposition [7, 17] uses a problem-solving strategy that can be generalized to a larger context. It assigns some of the variables trial valu
Logic-Based Benders Decomposition Λ J. N. Hooker Graduate School of Industrial Administration Carnegie Mellon University, Pittsburgh, PA 15213 USA G. Ottosson Department of Information Technology Computing
More informationNetwork Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini
In the name of God Network Flows 6. Lagrangian Relaxation 6.3 Lagrangian Relaxation and Integer Programming Fall 2010 Instructor: Dr. Masoud Yaghini Integer Programming Outline Branch-and-Bound Technique
More informationIntroduction to Arti Intelligence
Introduction to Arti Intelligence cial Lecture 4: Constraint satisfaction problems 1 / 48 Constraint satisfaction problems: Today Exploiting the representation of a state to accelerate search. Backtracking.
More informationInterleaved Alldifferent Constraints: CSP vs. SAT Approaches
Interleaved Alldifferent Constraints: CSP vs. SAT Approaches Frédéric Lardeux 3, Eric Monfroy 1,2, and Frédéric Saubion 3 1 Universidad Técnica Federico Santa María, Valparaíso, Chile 2 LINA, Université
More informationwith Binary Decision Diagrams Integer Programming J. N. Hooker Tarik Hadzic IT University of Copenhagen Carnegie Mellon University ICS 2007, January
Integer Programming with Binary Decision Diagrams Tarik Hadzic IT University of Copenhagen J. N. Hooker Carnegie Mellon University ICS 2007, January Integer Programming with BDDs Goal: Use binary decision
More informationIS703: Decision Support and Optimization. Week 5: Mathematical Programming. Lau Hoong Chuin School of Information Systems
IS703: Decision Support and Optimization Week 5: Mathematical Programming Lau Hoong Chuin School of Information Systems 1 Mathematical Programming - Scope Linear Programming Integer Programming Network
More informationis called an integer programming (IP) problem. model is called a mixed integer programming (MIP)
INTEGER PROGRAMMING Integer Programming g In many problems the decision variables must have integer values. Example: assign people, machines, and vehicles to activities in integer quantities. If this is
More informationOperations Research Methods in Constraint Programming
Operations Research Methods in Constraint Programming John Hooker Carnegie Mellon University Prepared for Lloret de Mar, Spain June 2007 2007 Slide 1 CP and OR Have Complementary Strengths CP: Inference
More informationDuality in Optimization and Constraint Satisfaction
Duality in Optimization and Constraint Satisfaction J. N. Hooker Carnegie Mellon University, Pittsburgh, USA john@hooker.tepper.cmu.edu Abstract. We show that various duals that occur in optimization and
More informationSolving the MWT. Recall the ILP for the MWT. We can obtain a solution to the MWT problem by solving the following ILP:
Solving the MWT Recall the ILP for the MWT. We can obtain a solution to the MWT problem by solving the following ILP: max subject to e i E ω i x i e i C E x i {0, 1} x i C E 1 for all critical mixed cycles
More informationAlgorithms. NP -Complete Problems. Dong Kyue Kim Hanyang University
Algorithms NP -Complete Problems Dong Kyue Kim Hanyang University dqkim@hanyang.ac.kr The Class P Definition 13.2 Polynomially bounded An algorithm is said to be polynomially bounded if its worst-case
More informationInteger vs. constraint programming. IP vs. CP: Language
Discrete Math for Bioinformatics WS 0/, by A. Bockmayr/K. Reinert,. Januar 0, 0:6 00 Integer vs. constraint programming Practical Problem Solving Model building: Language Model solving: Algorithms IP vs.
More informationSolving Mixed-Integer Nonlinear Programs
Solving Mixed-Integer Nonlinear Programs (with SCIP) Ambros M. Gleixner Zuse Institute Berlin MATHEON Berlin Mathematical School 5th Porto Meeting on Mathematics for Industry, April 10 11, 2014, Porto
More informationDesigning Oracles for Grover Algorithm
Designing Oracles for Grover Algorithm Homework 1. You have time until December 3 to return me this homework. 2. Please use PPT, Word or some word processor. You may send also PDF. The simulation should
More informationAn Integrated Solver for Optimization Problems
WORKING PAPER WPS-MAS-08-01 Department of Management Science School of Business Administration, University of Miami Coral Gables, FL 33124-8237 Created: December 2005 Last update: July 2008 An Integrated
More informationFinite-Domain Cuts for Graph Coloring
Finite-Domain Cuts for Graph Coloring David Bergman J N Hooker April 01 Abstract We explore the idea of obtaining valid inequalities from a finite-domain formulation of a problem, rather than a 0-1 formulation
More informationDecision Diagrams and Dynamic Programming
Decision Diagrams and Dynamic Programming J. N. Hooker Carnegie Mellon University CPAIOR 13 Decision Diagrams & Dynamic Programming Binary/multivalued decision diagrams are related to dynamic programming.
More informationLecture 7: Weak Duality
EE 227A: Conve Optimization and Applications February 7, 2012 Lecture 7: Weak Duality Lecturer: Laurent El Ghaoui 7.1 Lagrange Dual problem 7.1.1 Primal problem In this section, we consider a possibly
More informationLecture : Lovász Theta Body. Introduction to hierarchies.
Strong Relaations for Discrete Optimization Problems 20-27/05/6 Lecture : Lovász Theta Body. Introduction to hierarchies. Lecturer: Yuri Faenza Scribes: Yuri Faenza Recall: stable sets and perfect graphs
More informationSOLVING QUADRATICS. Copyright - Kramzil Pty Ltd trading as Academic Teacher Resources
SOLVING QUADRATICS Copyright - Kramzil Pty Ltd trading as Academic Teacher Resources SOLVING QUADRATICS General Form: y a b c Where a, b and c are constants To solve a quadratic equation, the equation
More informationInteger Programming ISE 418. Lecture 12. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 12 Dr. Ted Ralphs ISE 418 Lecture 12 1 Reading for This Lecture Nemhauser and Wolsey Sections II.2.1 Wolsey Chapter 9 ISE 418 Lecture 12 2 Generating Stronger Valid
More informationSection Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018
Section Notes 9 Midterm 2 Review Applied Math / Engineering Sciences 121 Week of December 3, 2018 The following list of topics is an overview of the material that was covered in the lectures and sections
More information1 Algebraic Methods. 1.1 Gröbner Bases Applied to SAT
1 Algebraic Methods In an algebraic system Boolean constraints are expressed as a system of algebraic equations or inequalities which has a solution if and only if the constraints are satisfiable. Equations
More informationInteger Linear Programming (ILP)
Integer Linear Programming (ILP) Zdeněk Hanzálek, Přemysl Šůcha hanzalek@fel.cvut.cz CTU in Prague March 8, 2017 Z. Hanzálek (CTU) Integer Linear Programming (ILP) March 8, 2017 1 / 43 Table of contents
More informationPart 4. Decomposition Algorithms
In the name of God Part 4. 4.4. Column Generation for the Constrained Shortest Path Problem Spring 2010 Instructor: Dr. Masoud Yaghini Constrained Shortest Path Problem Constrained Shortest Path Problem
More informationBoosting Set Constraint Propagation for Network Design
Boosting Set Constraint Propagation for Network Design Justin Yip 1, Pascal Van Hentenryck 1, and Carmen Gervet 2 1 Brown University, Box 1910, Providence, RI 02912, USA 2 German University in Cairo, New
More informationInexact Solution of NLP Subproblems in MINLP
Ineact Solution of NLP Subproblems in MINLP M. Li L. N. Vicente April 4, 2011 Abstract In the contet of conve mied-integer nonlinear programming (MINLP, we investigate how the outer approimation method
More informationDiscrete Optimization 2010 Lecture 7 Introduction to Integer Programming
Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming Marc Uetz University of Twente m.uetz@utwente.nl Lecture 8: sheet 1 / 32 Marc Uetz Discrete Optimization Outline 1 Intro: The Matching
More informationLecture 9: Search 8. Victor R. Lesser. CMPSCI 683 Fall 2010
Lecture 9: Search 8 Victor R. Lesser CMPSCI 683 Fall 2010 ANNOUNCEMENTS REMEMBER LECTURE ON TUESDAY! EXAM ON OCTOBER 18 OPEN BOOK ALL MATERIAL COVERED IN LECTURES REQUIRED READINGS WILL MOST PROBABLY NOT
More informationAn Integrated Method for Planning and Scheduling to Minimize Tardiness
An Integrated Method for Planning and Scheduling to Minimize Tardiness J N Hooker Carnegie Mellon University john@hookerteppercmuedu Abstract We combine mixed integer linear programming (MILP) and constraint
More informationSingle-Facility Scheduling by Logic-Based Benders Decomposition
Single-Facility Scheduling by Logic-Based Benders Decomposition Elvin Coban J. N. Hooker Tepper School of Business Carnegie Mellon University ecoban@andrew.cmu.edu john@hooker.tepper.cmu.edu September
More informationDecision Procedures An Algorithmic Point of View
An Algorithmic Point of View ILP References: Integer Programming / Laurence Wolsey Deciding ILPs with Branch & Bound Intro. To mathematical programming / Hillier, Lieberman Daniel Kroening and Ofer Strichman
More informationof a bimatrix game David Avis McGill University Gabriel Rosenberg Yale University Rahul Savani University of Warwick
Finding all Nash equilibria of a bimatrix game David Avis McGill University Gabriel Rosenberg Yale University Rahul Savani University of Warwick Bernhard von Stengel London School of Economics Nash equilibria
More informationDetermine the size of an instance of the minimum spanning tree problem.
3.1 Algorithm complexity Consider two alternative algorithms A and B for solving a given problem. Suppose A is O(n 2 ) and B is O(2 n ), where n is the size of the instance. Let n A 0 be the size of the
More informationExtended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications
Extended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications François Vanderbeck University of Bordeaux INRIA Bordeaux-Sud-Ouest part : Defining Extended Formulations
More informationCompiling Knowledge into Decomposable Negation Normal Form
Compiling Knowledge into Decomposable Negation Normal Form Adnan Darwiche Cognitive Systems Laboratory Department of Computer Science University of California Los Angeles, CA 90024 darwiche@cs. ucla. edu
More informationChapter 6 Constraint Satisfaction Problems
Chapter 6 Constraint Satisfaction Problems CS5811 - Artificial Intelligence Nilufer Onder Department of Computer Science Michigan Technological University Outline CSP problem definition Backtracking search
More informationLinear & Integer programming
ELL 894 Performance Evaluation on Communication Networks Standard form I Lecture 5 Linear & Integer programming subject to where b is a vector of length m c T A = b (decision variables) and c are vectors
More informationOn Solving Boolean Combinations of UTVPI Constraints
Journal on Satisfiability, Boolean Modeling and Computation N (007) xx-yy On Solving Boolean Combinations of UTVPI Constraints Sanjit A. Seshia Department of Electrical Engineering and Computer Sciences
More informationInteger Programming ISE 418. Lecture 13. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 13 Dr. Ted Ralphs ISE 418 Lecture 13 1 Reading for This Lecture Nemhauser and Wolsey Sections II.1.1-II.1.3, II.1.6 Wolsey Chapter 8 CCZ Chapters 5 and 6 Valid Inequalities
More informationInteger Programming, Constraint Programming, and their Combination
Integer Programming, Constraint Programming, and their Combination Alexander Bockmayr Freie Universität Berlin & DFG Research Center Matheon Eindhoven, 27 January 2006 Discrete Optimization General framework
More informationTravelling Salesman Problem
Travelling Salesman Problem Fabio Furini November 10th, 2014 Travelling Salesman Problem 1 Outline 1 Traveling Salesman Problem Separation Travelling Salesman Problem 2 (Asymmetric) Traveling Salesman
More informationInteger Programming ISE 418. Lecture 8. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 8 Dr. Ted Ralphs ISE 418 Lecture 8 1 Reading for This Lecture Wolsey Chapter 2 Nemhauser and Wolsey Sections II.3.1, II.3.6, II.4.1, II.4.2, II.5.4 Duality for Mixed-Integer
More informationSAT, NP, NP-Completeness
CS 473: Algorithms, Spring 2018 SAT, NP, NP-Completeness Lecture 22 April 13, 2018 Most slides are courtesy Prof. Chekuri Ruta (UIUC) CS473 1 Spring 2018 1 / 57 Part I Reductions Continued Ruta (UIUC)
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Chapter 5 AIMA2e Slides, Stuart Russell and Peter Norvig, Completed by Kazim Fouladi, Fall 2008 Chapter 5 1 Outline CSP examples Backtracking search for CSPs Problem structure
More informationCS256 Applied Theory of Computation
CS256 Applied Theory of Computation Compleity Classes III John E Savage Overview Last lecture on time-bounded compleity classes Today we eamine space-bounded compleity classes We prove Savitch s Theorem,
More informationDecomposition-based Methods for Large-scale Discrete Optimization p.1
Decomposition-based Methods for Large-scale Discrete Optimization Matthew V Galati Ted K Ralphs Department of Industrial and Systems Engineering Lehigh University, Bethlehem, PA, USA Départment de Mathématiques
More informationTechnische Universität München, Zentrum Mathematik Lehrstuhl für Angewandte Geometrie und Diskrete Mathematik. Combinatorial Optimization (MA 4502)
Technische Universität München, Zentrum Mathematik Lehrstuhl für Angewandte Geometrie und Diskrete Mathematik Combinatorial Optimization (MA 4502) Dr. Michael Ritter Problem Sheet 1 Homework Problems Exercise
More informationQuadratic Programming Relaxations for Metric Labeling and Markov Random Field MAP Estimation
Quadratic Programming Relaations for Metric Labeling and Markov Random Field MAP Estimation Pradeep Ravikumar John Lafferty School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213,
More informationAnnouncements. Friday Four Square! Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Did you lose a phone in my office?
N P NP Completeness Announcements Friday Four Square! Today at 4:15PM, outside Gates. Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Explore P, NP, and their connection. Did
More informationThe core of solving constraint problems using Constraint Programming (CP), with emphasis on:
What is it about? l Theory The core of solving constraint problems using Constraint Programming (CP), with emphasis on: l Modeling l Solving: Local consistency and propagation; Backtracking search + heuristics.
More informationThe two-dimensional bin-packing problem is the problem of orthogonally packing a given set of rectangles
INFORMS Journal on Computing Vol. 19, No. 1, Winter 2007, pp. 36 51 issn 1091-9856 eissn 1526-5528 07 1901 0036 informs doi 10.1287/ijoc.1060.0181 2007 INFORMS Using Decomposition Techniques and Constraint
More informationSection Notes 8. Integer Programming II. Applied Math 121. Week of April 5, expand your knowledge of big M s and logical constraints.
Section Notes 8 Integer Programming II Applied Math 121 Week of April 5, 2010 Goals for the week understand IP relaxations be able to determine the relative strength of formulations understand the branch
More informationMulti-Level Logic Optimization. Technology Independent. Thanks to R. Rudell, S. Malik, R. Rutenbar. University of California, Berkeley, CA
Technology Independent Multi-Level Logic Optimization Prof. Kurt Keutzer Prof. Sanjit Seshia EECS University of California, Berkeley, CA Thanks to R. Rudell, S. Malik, R. Rutenbar 1 Logic Optimization
More informationLogic-based Benders Decomposition
Logic-based Benders Decomposition A short Introduction Martin Riedler AC Retreat Contents 1 Introduction 2 Motivation 3 Further Notes MR Logic-based Benders Decomposition June 29 July 1 2 / 15 Basic idea
More informationINTEGER PROGRAMMING. In many problems the decision variables must have integer values.
INTEGER PROGRAMMING Integer Programming In many problems the decision variables must have integer values. Example:assign people, machines, and vehicles to activities in integer quantities. If this is the
More informationCutting Planes in SCIP
Cutting Planes in SCIP Kati Wolter Zuse-Institute Berlin Department Optimization Berlin, 6th June 2007 Outline 1 Cutting Planes in SCIP 2 Cutting Planes for the 0-1 Knapsack Problem 2.1 Cover Cuts 2.2
More informationNP-Completeness Review
CS124 NP-Completeness Review Where We Are Headed Up to this point, we have generally assumed that if we were given a problem, we could find a way to solve it. Unfortunately, as most of you know, there
More informationSolving Elementary Shortest-Path Problems as Mixed-Integer Programs
Gutenberg School of Management and Economics Discussion Paper Series Solving Elementary Shortest-Path Problems as Mixed-Integer Programs Michael Drexl and Stefan Irnich Januar 2012 Discussion paper number
More informationColumn Generation for Extended Formulations
1 / 28 Column Generation for Extended Formulations Ruslan Sadykov 1 François Vanderbeck 2,1 1 INRIA Bordeaux Sud-Ouest, France 2 University Bordeaux I, France ISMP 2012 Berlin, August 23 2 / 28 Contents
More information