Benders Decomposition

Size: px
Start display at page:

Download "Benders Decomposition"

Transcription

1 Benders Decomposton John Hooker Carnege Mellon Unversty CP Summer School Cork, Ireland, June 206

2 Outlne Essence of Benders decomposton Smple eample Logc-based Benders Inference dual Classcal LP dual Classcal Benders Eamples 2

3 Outlne Eamples Logc crcut verfcaton Plannng and dsjunctve schedulng Plannng and cumulatve schedulng Mn cost Mn makespan Mn number of late tasks Mn total tardlness Sngle-resource schedulng Home hospce care Branch and check Inference as projecton 3

4 Essence of Benders Decomposton The clever dea behnd classcal Benders works n a much more general settng. For problems that smplfy when certan varables are fed. Use classcal Benders f the resultng subproblem s a lnear programmng (LP) problem.* Same dea can be etended to any subproblem by generalzng LP dualty to nference dualty. * Generalzed Benders allows a nonlnear programmng subproblem 4

5 Essence of Benders Decomposton Master problem Solve for search varables Contans Benders cuts so far generated. F search varables Add Benders cut Subproblem Smplfed problem contans remanng varables y Solve nference dual to obtan Benders cut that ecludes solutons no better than current one.

6 Essence of Benders Decomposton The key to generalzng Benders s generalzng the dual. A soluton of the nference dual s a proof of optmalty (or nfeasblty). It proves a bound on the optmal value Gven the values of search varables as premses. It s an eplanaton of why the soluton s optmal. The same proof may yeld a bound for other values of the search values. Ths s key to obtanng Benders cuts. 6

7 Smple Eample Home $00 $200 Cty 3 Cty 4 Fnd cheapest route to a remote vllage $00 $200 Cty 2 Cty Hgh Pass By ar By bus Vllage 7

8 Smple Eample Let = flght destnaton y = bus route Fnd cheapest route (,y)

9 Let = flght destnaton y = bus route Fnd cheapest route (,y) Master problem Solve for cheapest flght subject to Benders cuts generated so far F flght Add Benders cut Subproblem Fnd cheapest bus route from arport to vllage. Use proof of optmalty to bound cost of other flghts.

10 Let = flght destnaton y = bus route Fnd cheapest route (,y) Begn wth = Cty and pose the subproblem: Fnd the cheapest route gven that = Cty. Optmal cost s $ = $330.

11 The dual problem of fndng the optmal route s to prove optmalty. The proof s that the route from Cty to the vllage must go through Hgh Pass. So cost arfare + bus from cty to Hgh Pass + $50 But ths same argument apples to Cty, 2 or 3. Ths gves us the above Benders cut.

12 Specfcally the Benders cut s cost B ( ) Cty $ $ $00 f f f Cty Cty 2,3 Cty 4 2

13 Now solve the master problem: Pck the cty to mnmze cost subject to cost B ( ) Cty $ $ $00 f f f Cty Cty 2,3 Cty 4 Clearly the soluton s = Cty 4, wth cost $00. 3

14 Now let = Cty 4 and pose the subproblem: Fnd the cheapest route gven that = Cty 4. Optmal cost s $ = $350. $250 4

15 Agan solve the master problem: Pck the cty to mnmze cost subject to cost B ( ) Cty $ $ $00 f f f Cty Cty 2,3 Cty 4 cost B 4( ) Cty $350 $0 f Cty otherwse The soluton s = Cty, wth cost $330. Because ths s equal to the value of a prevous subproblem, we are done. 5

16 Logc-Based Benders Solve problem of the form Iteraton k : Master problem mn f (, y) (, y) S Subproblem mn z z B ( ), k Mnmze cost z subject to Benders cuts Tral value k that solves master Benders cut z B ( ) k k mn f (, y) k (, y) S Solve nference dual to obtan proof of optmalty Use same proof to deduce cost bounds for other assgnments, yeldng 6 Benders cut.

17 Logc-Based Benders In any teraton, master value optmal value smallest subproblem value so far Contnue untl equalty s obtaned. Master problem Subproblem mn z z B ( ), k Mnmze cost z subject to Benders cuts Tral value k that solves master Benders cut z B ( ) k k mn f (, y) k (, y) S Solve nference dual to obtan proof of optmalty Use same proof to deduce cost bounds for other assgnments, yeldng 7 Benders cut.

18 Logc-Based Benders Benders cuts descrbe projecton of feasble set onto f all cuts are generated. Master problem Subproblem mn z z B ( ), k Mnmze cost z subject to Benders cuts Tral value k that solves master Benders cut z B ( ) k k mn f (, y) k (, y) S Solve nference dual to obtan proof of optmalty Use same proof to deduce cost bounds for other assgnments, yeldng 8 Benders cut.

19 Logc-Based Benders Substantal speedup for many applcatons. Several orders of magntude relatve to state of the art. 9

20 Logc-Based Benders Substantal speedup for many applcatons. Several orders of magntude relatve to state of the art. Some applcatons: Crcut verfcaton Chemcal batch processng (BASF, etc.) Steel producton schedulng Auto assembly lne management (Peugeot-Ctroën) Automated guded vehcles n fleble manufacturng Allocaton and schedulng of multcore processors (IBM, Toshba, Sony) Resource locaton-allocaton Stochastc resource locaton and fleet management Capacty and dstance-constraned plant locaton 20

21 Logc-Based Benders Some applcatons Transportaton network desgn Traffc dverson around blocked routes Worker assgnment n a queung envronment Sngle- and multple-machne allocaton and schedulng Permutaton flow shop schedulng wth tme lags Resource-constraned schedulng Wreless local area network desgn Servce restoraton n a network Optmal control of dynamcal systems Sports schedulng 2

22 Inference Dual An optmzaton problem mnmzes an objectve functon subject to constrants. It s solved by searchng over values of the varables. The nference dual fnds the tghtest lower bound on the objectve functon that s mpled by the constrants. It s solved by searchng over proofs.

23 Inference Dual Prmal problem: optmzaton mn f( ) S Fnd best feasble soluton by searchng over values of. ma v P S f ( ) v P Dual problem: Inference P Fnd a proof of optmal value v* by searchng over proofs P. 23

24 Inference Dual Weak dualty always holds: Mn value of prmal problem Ma value of dual problem Dfference = dualty gap 24

25 Inference Dual Strong dualty sometmes holds: Mn value of prmal problem = Ma value of dual problem P s a complete proof famly Strong dualty Complete means that the famly contans a proof for anythng that s mpled by the constrant set. 25

26 Prmal problem mn c A 0 b Classcal LP Dual Inference dual ma v A b P c 0 P P v 26

27 Prmal problem mn c A 0 b Classcal LP Dual Inference dual ma v A b P c 0 P P v Proof famly P : A b P c v 0 when Assumng A b, 0 s feasble. ua ub domnates c for some u 0 v 27

28 Prmal problem mn c A 0 b Classcal LP Dual Inference dual ma v A b P c 0 P P v Proof famly P : A b P c v 0 when Assumng A b, 0 s feasble. ua ub domnates c for some u 0 ua c ub v v 28

29 Prmal problem mn c A 0 b Classcal LP Dual Inference dual ma v A b P c 0 P P v Proof famly P : A b P c v 0 when Assumng A b, 0 s feasble. Ths s a complete nference method (due to Farkas Lemma) ua ub domnates c for some u 0 ua c ub v v 29

30 Classcal LP Dual Prmal problem mn c A 0 b Inference dual ma v A b P c 0 P P v ma v ua c ub v u 0 Proof famly P : A b P c v 0 when Assumng A b, 0 s feasble. Ths s a complete nference method (due to Farkas Lemma) ua ub domnates c for some u 0 ua c ub v v 30

31 Classcal LP Dual Prmal problem mn c A 0 b Inference dual ma ub ua c u 0 ma v ua c ub v u 0 Proof famly P : A b P c v 0 when Assumng A b, 0 s feasble. Ths s a complete nference method (due to Farkas Lemma) ua ub domnates c for some u 0 ua c ub v v 3

32 Classcal LP Dual Prmal problem mn c A 0 b Classcal LP dual ma ua u ub c 0 A strong dual due to Farkas Lemma assumng A b, 0 s feasble Proof famly P : A b P c v 0 when Assumng A b, 0 s feasble. Ths s a complete nference method (due to Farkas Lemma) ua ub domnates c for some u 0 ua c ub v v 32

33 Inference Duals Problem Inference Method Inference dual Lnear programmng Lnear combnaton + domnaton Classcal LP dual (strong) Inequalty constraned optmzaton Lnear combnaton + mplcaton Surrogate dual Inequalty constraned optmzaton Lnear combnaton + domnaton Lagrangean dual Integer programmng Chvátal-Gomory cuts Subaddtve dual (strong) 33

34 Classcal Benders Solve problem of the form Iteraton k : Master problem mn c dy A By b y, 0 Subproblem mn z z B ( ), k Tral value k Benders cut z B ( ) k mn c dy By b A y 0 k k 34

35 Classcal Benders Solve problem of the form Iteraton k : Master problem mn c dy A By b y, 0 Subproblem mn z z B ( ), k Tral value k Benders cut z B ( ) k mn c dy By b A y 0 k k Dual soluton u k proves optmalty: u k By u k ( b A k ) domnates dy v * 35

36 Classcal Benders Solve problem of the form Iteraton k : Master problem mn c dy A By b y, 0 Subproblem mn z z B ( ), k Tral value k Benders cut z B ( ) k mn c dy By b A y 0 k k Dual soluton u k proves optmalty: So k u B d and k k u ( b A ) v * u k By u k ( b A k ) domnates dy v * 36

37 Classcal Benders Solve problem of the form Iteraton k : Master problem mn c dy A By b y, 0 Subproblem mn z z B ( ), k Tral value k Benders cut z B ( ) k mn c dy By b A y 0 k k Dual soluton u k proves optmalty: So k u B d and k k u ( b A ) v * u k By u k ( b A k ) domnates dy v * But u k remans dual feasble for any, so by weak dualty k u ( b A) v 37

38 Classcal Benders Solve problem of the form Iteraton k : Master problem mn c dy A By b y, 0 Subproblem mn z z B ( ), k Tral value k Benders cut z B ( ) k mn c dy By b A y 0 k k Dual soluton u k proves optmalty: So k u B d and k k u ( b A ) v * u k By u k ( b A k ) domnates dy v * But u k remans dual feasble for any, so by weak dualty k Ths mples c u ( b A) c v z k u ( b A) v 38

39 Classcal Benders Solve problem of the form Iteraton k : Master problem mn c dy A By b y, 0 Subproblem mn z k z c u ( b A), k Tral value k Benders cut k z c u ( b A) mn c dy By b A y 0 k k Dual soluton u k proves optmalty: So k u B d and k k u ( b A ) v * u k By u k ( b A k ) domnates dy v * But u k remans dual feasble for any, so by weak dualty k Ths mples c u ( b A) c v z k u ( b A) v 39

40 Classcal Benders Benders s often referred to as row generaton. as opposed to column generaton. Row generaton s much more general. Apples to any optmzaton problem wth constrants = rows Column generaton requres columns. The constrant set must be lnear (A b, etc.)

41 Classcal Benders Benders s often referred to as row generaton. as opposed to column generaton. Row generaton s much more general. Apples to any optmzaton problem wth constrants = rows Column generaton requres columns. The constrant set must be lnear (A b, etc.) Benders s sad to be dual to Dantzg-Wolfe decomposton (a form of column generaton) True for classcal Benders. Not true for logc-based Benders. Logc-based Benders s much more general than D-W or column generaton D-W apples only to lnear programmng.

42 Eample: Logc crcut verfcaton Logc crcuts A and B are equvalent when the followng crcut s a tautology: nputs 2 A and 3 B The crcut s a tautology f the mnmum output over all 0- nputs s. 42

43 For nstance, check whether ths crcut s a tautology: and y not or y 4 nputs 2 not not or y 2 y 3 not or y and 6 y 5 3 and The subproblem s to mnmze the output when the nput s fed to a gven value. Mnmum output s only feasble output, proved by unt propagaton. 43

44 Formally, the problem s mn y6 s.t. y ( y y ) and y not or y y ( y y ) y ( y y ) 4 2 y ( ) y ( ) y ( ) 2 2 not not or y 2 y 3 not or y and 6 y 5 3 and 44

45 mn Master problem z s.t. z B ( ), k Tral nput k Benders cut z B ( ) Only one feasble soluton, trval to compute by unt propagaton k mn Subproblem y 6 s.t. y ( y y ) y ( y y ) y ( y y ) 4 2 k k k 3 y ( ) k k y ( ) 2 3 k k y ( ) 2 45

46 For eample, let the nputs be = (,0,). and 0 y not not or and 0 or y not 4 y 2 not y 3 or y and 6 y 5 To construct a Benders cut, dentfy some nputs that are suffcent to derve an output of by the same unt propagaton. Ths can be done by reasonng backward. 46

47 and 0 y For ths, t suffces that y 4 = and y 5 = not not or and 0 or y not 4 y 2 y 3 not or y and 6 y 5 47

48 For ths, t suffces that y 2 = 0. and 0 y For ths, t suffces that y 4 = and y 5 = not not or and 0 or y not 4 y 2 y 3 not or y and 6 y 5 48

49 For ths, t suffces that y 2 = 0. and 0 y For ths, t suffces that y 4 = and y 5 = not not or and 0 or y not 4 y 2 y 3 not or y and 6 y 5 For ths, t suffces that y 2 = 0. 49

50 For ths, t suffces that 2 = 0 and 3 =. For ths, t suffces that y 2 = 0. and 0 y For ths, t suffces that y 4 = and y 5 = not not or and 0 or y not 4 y 2 y 3 not or y and 6 y 5 For ths, t suffces that y 2 = 0. z So, Benders cut s

51 Now solve the master problem mn s.t. z z 2 3 One soluton s (,, ) (,0,0), z Ths produces output 0 n the net subproblem, at whch pont master and subproblem values converge. Snce mnmum output s 0, crcut s not a tautology. 5

52 Now solve the master problem mn s.t. z z 2 3 One soluton s (,, ) (,0,0), z Ths produces output 0 n the net subproblem, at whch pont master and subproblem values converge. Snce mnmum output s 0, crcut s not a tautology. Note: Ths can also be solved by classcal Benders. The subproblem can be wrtten as an LP (a Horn-SAT problem). 52

53 Eample: Plannng & Schedulng Assgn tasks to resources. Schedule tasks assgn to each resource Subject to tme wndows No overlap (dsjunctve schedulng) Approprate objectve Mn assgnment cost Mn makespan Mn number of late tasks Mn total tardness 53

54 Eample: Plannng & Schedulng Assgn tasks n master, schedule n subproblem. Can combne med nteger programmng and constrant programmng Master problem Subproblem Assgn tasks to resources to mnmze cost. Solve by med nteger programmng. Tral assgnment Benders cut z B ( ) k Schedule tasks on each resource, subject to tme wndows. Advantage: decouples by resource. 54

55 Eample: Plannng & Schedulng Objectve functon Suppose cost s based on task assgnment only. cost c, f task j assgned to resource j j j j So cost appears only n the master problem. Schedulng subproblem s a feasblty problem. 55

56 Eample: Plannng & Schedulng Objectve functon Suppose cost s based on task assgnment only. cost c, f task j assgned to resource j j j j So cost appears only n the master problem. Schedulng subproblem s a feasblty problem. Benders cuts They have the form jj ( ), all j where J s a set of tasks that create nfeasblty when assgned to resource. 56

57 Eample: Plannng & Schedulng Tme wndow relaaton For well-chosen tme ntervals [a,b], jj ( a, b) p b a, all j j p j = processng tme of task j on resource J(a,b) = { tasks wth tme wndows n [a,b] } 57

58 Eample: Plannng & Schedulng Resultng Benders decomposton: Master problem mn z z cj j Benders cuts j Relaaton Tral assgnment Benders cuts jj ( ), j Subproblem Schedule jobs on each resource. For each nfeasble resource, fnd subset J of tasks that create nfeasblty. Termnate when subproblem s feasble. 58

59 Eample: Plannng & Schedulng Problem: We typcally don t have access to nfeasblty proof n subproblem solver. So begn wth smple nogood cut jj ( ), all where J contans all tasks assgned resource. j Then strengthen cut by heurstcally removng tasks from J untl schedule on resource becomes feasble. 59

60 Problem Instances c nstances Hard for LBBD. Some resources much faster than others. Computatonal bottleneck on fastest resource. e nstances Perhaps more realstc. Resources dffer by factor of 2 n processng speed. 60

61 Epermental Desgn Solve wth LBBD Strong Benders cuts only Strengthened nogood cuts. Weak cuts wth subproblem relaaton n master. Smple nogood cuts. Strong cuts wth relaaton. 6

62 Number of nstances solved Performance profle All 80 c nstances Rela + strong cuts Rela + weak cuts Strong cuts only MILP (CPLEX) Computaton tme (sec) 62

63 Number of nstances solved Performance profle 20 c nstances wth 3 or 4 resources Rela + strong cuts Rela + weak cuts Strong cuts only MIP (CPLEX) Computaton tme (sec) 63

64 Number of nstances solved Performance profle 50 e nstances Rela + strong cuts Rela + weak cuts MIP (CPLEX) Computaton tme (sec) 64

65 Severe mbalance of master and subproblem tme, resultng n poorer performance for LBBD. c nstances, 2 resources 65

66 Subproblem blows up when more than 0 tasks per resource on average c nstances, 2 resources 66

67 Subproblem blows up when more than 0 tasks per resource on average c nstances, 3 resources 67

68 Balance between master and subproblem results n superor performance e nstances 68

69 Mld mbalance results n somewhat worse performance e nstances 69

70 Suggested Soluton Strateges Tghter subproblem relaatons Desgn tghter subproblem relaatons for the master usng subproblem varables, whose values are dscarded after master s solved Subproblem decomposton Solve subproblem wth LBBD when t grows too large. More dual nformaton Use subproblem solver that reveals proof of optmalty, perhaps resultng n stronger Benders cuts. 70

71 Cumulatve Schedulng Problems p j = processng tme of task j on resource c j = resource consumpton of task j on resource C = resources avalable on resource Resource Resource 2 C task c task 4 task 5 C 2 c 22 task 3 task 2 p p 22 Total resource consumpton C at all tmes. 7

72 mn Mn Cost Cumulatve Schedulng Master Problem: Assgn tasks to resources Formulate as MILP problem z subject to, all j j jj ( b, a) p c C ( b a), all, varous [ a, b] j j j Benders cuts cost C task task 4 task 5 Relaaton of subproblem: Energy of tasks must be at most energy avalable. a b 72

73 Mn Cost Cumulatve Schedulng Benders cuts same as for dsjunctve schedulng mn z subject to, all j j jj ( b, a) p c C ( b a), all, varous [ a, b] j j j Benders cuts cost C task task 4 task5 Relaaton of subproblem: Energy of tasks must be at most energy avalable. a b 73

74 Mn Makespan Cumulatve Schedulng Master Problem: Assgn tasks to resources Formulate as MILP problem mn subject to M j M C Benders, all j j p cuts j c makespan j j, all C task task 4 task5 Relaaton of subproblem: Energy of tasks provdes lower bound on makespan. 74

75 Mn Makespan Cumulatve Schedulng Benders cuts are based on: Lemma. If we remove tasks, s from a resource, the mnmum makespan on that resource s reduced by at most s j p j ma js d mn d j js j Assumng all deadlnes d are the same, we get the Benders cut * M M ( ) h j J h j p j Mn makespan on resource n last teraton 75

76 Why does ths work? Assume all deadlnes are the same. Add tasks,,s sequentally at end of optmal schedule for other tasks Case I: resultng schedule meets deadlne Optmal makespan for tasks s+,,m Mˆ Optmal makespan for all tasks M * Mˆ s j p j Feasble makespan for all tasks tasks s+,, m task task s M s * Mˆ pj ˆ j M M * s j p j d Deadlne for all tasks 76

77 Case II: resultng schedule eceeds deadlne Optmal makespan for tasks s+,,m Mˆ Optmal makespan for all tasks M * Mˆ s j p j Makespan no longer feasble tasks s+,, m task task s d Deadlne for all tasks M * d s and Mˆ pj d ˆ j M M * s j p j 77

78 Mn Number of Late Tasks Master problem: Assgn tasks to resources mn L subject to, all j j Benders cuts relaaton of subproblem j {0,} = f task j s assgned to resource 78

79 Benders cuts L Lˆ Lˆ Lˆ h h h L L 0, Lˆ * h * h Mn Number of Late Tasks h Lower bound on # late tasks on resource Mn # late tasks on resource (soluton of subproblem) L all * h jj L 0 h ( * h jj h j ( ), j all ), all 79

80 Benders cuts L Lˆ Lˆ Lˆ h h h L L 0, Lˆ * h * h Mn Number of Late Tasks h Lower bound on # late tasks on resource Mn # late tasks on resource (soluton of subproblem) L all * h jj L 0 h ( * h jj h j ( ), j all ), all subset of J h for whch mn # late tasks s stll L h * (found by heurstc that repeatedly solves subproblem on resource ) 80

81 Benders cuts Mn Number of Late Tasks L Lˆ Lˆ Lˆ h h h L L Lˆ * h * h h L * h 0, all jj L 0 h ( * h jj h j ( ), j Mn # late tasks on resource (soluton of subproblem) all ), all To reduce # late tasks, must remove one of the 0 tasks n J h from resource. 8

82 Benders cuts Mn Number of Late Tasks L Lˆ Lˆ Lˆ h h h L L Lˆ * h * h h L * h 0, all jj L 0 h ( * h jj h j ( ), j Mn # late tasks on resource (soluton of subproblem) all ), all subset of J h for whch mn # late tasks s stll L h * (found by heurstc that repeatedly solves subproblem on resource ) Smaller subset of J h for whch mn # late tasks s L h * (found whle runnng same heurstc) 82

83 Benders cuts Mn Number of Late Tasks L Lˆ Lˆ Lˆ h h h L L Lˆ * h * h h L * h 0, all jj L 0 h ( * h jj h j ( ), j Mn # late tasks on resource (soluton of subproblem) all ), all To reduce # late tasks by more than, must remove one of the tasks n J h from resource. 83

84 Benders cuts Mn Number of Late Tasks L Lˆ Lˆ Lˆ h h h L L Lˆ * h * h h L * h 0, all jj L 0 h ( * h jj h j ( ), j all ), all These Benders cuts are added to the master problem n each teraton h. 84

85 Mn Number of Late Tasks Relaaton of subproblem Lower bound on # late tasks on resource L L C L kj ( d c j k ) p ma { p kj ( d j ) k k k } d j, all j 85

86 L L C Mn Number of Late Tasks Relaaton of subproblem L Lower bound on # late tasks on resource kj ( d c j k ) p ma { p kj ( d j ) k k k } d j, Set of tasks assgned to resource wth deadlne at or before d j all C j task task 2 task 3 d j 86

87 L L C Mn Number of Late Tasks Relaaton of subproblem L Lower bound on # late tasks on resource kj ( d c j k ) p ma { p kj ( d j ) k k k } d j, Set of tasks assgned to resource wth deadlne at or before d j all C j task task 2 task 3 Energy = p c d j 87

88 L L C Mn Number of Late Tasks Relaaton of subproblem L Lower bound on # late tasks on resource kj ( d c j k ) p ma { p kj ( d j ) k k k } d Area of tasks assgned to resource wth deadlne at or before d j j, all C j task task 2 task 3 Energy = p c d j 88

89 Mn Number of Late Tasks Relaaton of subproblem L L C L kj ( d c j k ) p ma { p kj ( d j ) k k Lower bound on (makespan latest deadlne) k } d j, all C j task task 2 task 3 d j 89

90 Mn Number of Late Tasks Relaaton of subproblem L L C L kj ( d c j k ) p ma { p kj ( d j ) k k Lower bound on (makespan latest deadlne) k } d j, all C j task task 2 task 3 Ma processng tme d j 90

91 Mn Number of Late Tasks Relaaton of subproblem L L C L kj ( d c j k ) p ma { p kj ( d j ) k k k } d j, all j Mn # of late jobs on resource 9

92 Mn Number of Late Tasks Relaaton of subproblem Ths relaaton s added to the master problem at the outset. L L C L kj ( d c j k ) p ma { p kj ( d j ) k k k } d j, all j Mn # of late jobs on resource 92

93 Mn Tardness Cumulatve Schedulng Master problem: assgn tasks to resources mn L subject to, all j j Benders cuts relaaton I of subproblem relaaton II of subproblem j {0,} = f task j s assgned to resource 93

94 Mn Tardness Cumulatve Schedulng Benders cuts Lower bound on tardness for resource T Tˆ Tˆ Tˆ h h h T T Tˆ * h 0 h h T T * h 0 h 0, all jj jj h h ( \ Z h ( j ), j ), Mn tardness on resource (soluton of subproblem) all all 94

95 Mn Tardness Cumulatve Schedulng Benders cuts Lower bound on tardness for resource T Tˆ Tˆ Tˆ h h h T T Tˆ * h 0 h h T T * h 0 h 0, all jj jj h h ( \ Z h ( j ), j ), Mn tardness on resource (soluton of subproblem) all all To reduce tardness on resource, must remove one of the tasks assgned to t. 95

96 Mn Tardness Cumulatve Schedulng Benders cuts T Tˆ Tˆ Tˆ h h h T T Tˆ * h 0 h h T T * h 0 h 0, all jj jj h h ( \ Z h ( j ), j ), Mn tardness on resource (soluton of subproblem) all all Set of tasks that can be removed, one at a tme from resource wthout reducng mn tardness. 96

97 Mn Tardness Cumulatve Schedulng Benders cuts T Tˆ Tˆ Tˆ h h h T T Tˆ * h 0 h h T T * h 0 h 0, all jj jj h h ( \ Z h ( j ), j ), all all Set of tasks that can be removed, one at a tme from resource wthout reducng mn tardness. Mn tardness on resource when all tasks n Z h are removed smultaneously. 97

98 Mn Tardness Cumulatve Schedulng Benders cuts T Tˆ Tˆ Tˆ h h h T T Tˆ * h 0 h h T T * h 0 h 0, all jj jj h h ( \ Z h ( j ), j ), all all To reduce tardness below on resource, must remove one of the tasks n J h \ Z h Set of tasks that can be removed, one at a tme from resource wthout reducng mn tardness. 0 T h Mn tardness on resource when all tasks n Z h are removed smultaneously. 98

99 Mn Tardness Cumulatve Schedulng These Benders cuts are added to the master problem n each teraton h T Tˆ Tˆ Tˆ h h h T T Tˆ * h 0 h h T T * h 0 h 0, all jj jj h h ( j ), all ( ), all \ Z h j 99

100 Subproblem relaaton I Lower bound on total tardness for resource T T C T jj ( d k c j ) p j j d k, all k 00

101 Subproblem relaaton I T T C T Lower bound on total tardness for resource jj ( d k c j ) p j j d k, Set of tasks assgned to resource wth deadlne at or before d k all k task task 2 task 3 d k 0

102 Subproblem relaaton I T T C T Lower bound on total tardness for resource jj ( d k c j ) p j j d k Area of tasks assgned to resource wth deadlne at or before d k, all k task task 2 task 3 d k 02

103 Subproblem relaaton I Lower bound on total tardness for resource T T C T jj ( d k c j ) p j j Lower bound on total tardness d k, all k task task 2 task 3 d k 03

104 04 Lemma. Consder a mn tardness problem that schedules tasks,, n on resource, where d d n. The mn tardness T* s bounded below by n k T k T where k j k j j k d c p C T ) ( ) ( and s a permutaton of,, n such that ) ( ) ( () ) ( n n c p c p Subproblem relaaton II

105 05 Eample of Lemma j d j p j c j p j c j C task task 2 task 3 d d 2 d 3 Mn tardness = / 5 8) 6 (5 3 ) ( 0 4 6) (5 3 ) ( 0 3 (5) 3 ) ( d c p c p c p C T d c p c p C T d c p C T 2 4/3 bound on tardness Lower 3 2 T T T

106 Idea of proof For a permutaton of,,n let where T T( ) ( ) n k k k ( ) p j c j d ( ) ( ) ( k ) C j T k Let 0 (),, 0 (n) be order of jobs n any optmal soluton, so that t ) t ( ) and mn tardness s T* 0( 0 n Consder bubble sort on 0 (),, 0 (n) to obtan,,n. Let 0,, S be resultng sequence of permutatons, so that s, s+ dffer by a swap and s (j) = j. 06

107 07 Now we have T T T T T T S s s ) ( ) ( ) ( ) ( * 0 snce ) ( 0 ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( * T d c p C d c p C d p t T n j k j j j j n j k j j j j n j j j j n k j s j s k s k k j s j s n k j s j s k s k k j s j s T T T T T T T T T T 2 2 ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( swap k and k+ So 0 ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( B A b a b A A a T T T T T T s k s k s k s k s s snce A a, B b areas def. of

108 08 From the lemma, we can wrte the relaaton n k T T k k where k j k j j j k d c p C T ) ( ) ( ) ( To lnearze ths, we wrte n k T k T and k k k j k j j j k M d c p C T ) ( ) ( ) ( ) ( k j k j j k d c p C M ) ( ) ( where Wrtng relaaton II

109 Computatonal Results Random problems on 2, 3, 4 resources. Facltes run at dfferent speeds. All release tmes = 0. Mn cost and makespan problems: deadlnes same/dfferent. Tardness problems: random due date parameters set so that a few tasks tend to be late. No precedence or other sde constrants. Makes problem harder. Implement wth OPL Studo 09

110 Mn makespan, 2 resources Average of 5 nstances shown Jobs MILP CP Benders At least one problem n the 5 eceeded 7200 sec (2 hours) 0

111 Mn makespan, 3 resources Average of 5 nstances shown Jobs MILP CP Benders At least one problem n the 5 eceeded 7200 sec (2 hours)

112 Mn makespan, 4 resources Average of 5 nstances shown Jobs MILP CP Benders At least one problem n the 5 eceeded 7200 sec (2 hours) 2

113 Mn makespan, 3 resources Dfferent deadlnes Average of 5 nstances shown Jobs MILP CP Benders At least one problem n the 5 eceeded 7200 sec (2 hours) 3

114 Mn # late tasks 3 resources Smaller problems Tasks CP Tme (sec) MILP Benders Mn # late tasks ? > ? > > >

115 Mn # late tasks 3 resources Larger problems Tasks Tme (sec) MILP Benders Best soluton MILP Benders > () >7200 (2) > () > (3) 2 > (5) 2 >7200 >7200 (6) (6) > () 0 > (2) 0 > (3) > (2) ( ) = optmalty not proved 2

116 Effect of subproblem relaaton 3 resources Mn # late tasks Tasks Tme (sec) wth rela wthout rela

117 Mn total tardness 3 resources Smaller problems Tasks Tme (sec) CP MILP Benders Mn tardness > >7200 > > > > > > >

118 Mn total tardness 3 resources Larger problems Tasks Tme (sec) MILP Benders Best soluton MILP Benders >7200 >7200 (75) (37) >7200 >7200 (20) (40) >7200 >7200 (62) (46) >7200 >7200 (375) (4) > (20) 0 > (57) 0 >7200 >7200 (20) (5) >7200 >7200 (25) (7) ( ) = optmalty not proved 5

119 Effect of subproblem relaaton 3 resources Mn total tardness Tasks Tme (sec) wth rela wthout rela >7200 >7200 6

120 Sngle-Resource Schedulng Apply logc-based Benders to sngle-resource schedulng wth long tme horzons and many jobs. Decompose the problem by assgnng jobs to segments of tme horzon. Segmented problem Jobs cannot cross segment boundares (e.g., weekends). Unsegmented problem Jobs can cross segment boundares.

121 Segmented problem Benders approach s very smlar to that for the plannng and schedulng problem. Assgn jobs to tme segments rather than processors. Benders cuts are the same. segment Jobs do not overlap segment boundares

122 Segmented problem Feasblty Wde tme wndows (ndvdual nstances) 22

123 Segmented problem Feasblty Tght tme wndows (ndvdual nstances) 23

124 Segmented problem Mn makespan Wde tme wndows (ndvdual nstances) 24

125 Segmented problem Mn makespan Tght tme wndows (ndvdual nstances) 25

126 Segmented problem Mn tardness Wde tme wndows (ndvdual nstances) 26

127 Segmented problem Mn tardness Tght tme wndows (ndvdual nstances) 27

128 Unsegmented problem Master problem s more complcated. Jobs can overlap two or more segments. Master problem varables must keep track of ths. Benders cuts more sophstcated. segment Jobs can overlap segment boundares

129 Unsegmented problem Master problem: y jk varables keep track of whether job j starts, fnshes, or runs entrely n segment. jk varables keep track of how long a partal job j runs n segment.

130 Unsegmented problem Feasblty -- ndvdual nstances

131 Unsegmented problem Mn makespan ndvdual nstances

132 Sngle-resource schedulng Segmented problems: Benders s much faster for mn cost and mn makespan problems. Benders s somewhat faster for mn tardness problem.

133 Sngle-resource schedulng Segmented problems: Benders s much faster for mn cost and mn makespan problems. Benders s somewhat faster for mn tardness problem. Unsegmented problems: Benders and CP can work together. Let CP run for second. If t fals to solve the problem, t wll probably blow up. Swtch to Benders for reasonably fast soluton.

134 Home Hospce Care Assgn ades to patents. Schedule and route patent vsts for each ade Subject to tme wndows for ades and vsts Subject to ade qualfcaton requrements Weekly schedule Number of vsts per week specfed for each patent Must be same ade and tme for each vst

135 Home Hospce Care Solve wth Benders decomposton. Assgn ades to patents n master problem. Mamze number of patents served by a gven set of ades. Master Problem Solve wth MIP Benders cut Patent, day assgnments Subproblem Solve wth CP

136 Home Hospce Care Solve wth Benders decomposton. Assgn ades to patents n master problem. Mamze number of patents served by a gven set of ades. Schedule home vsts n subproblem. Cyclc weekly schedule. No vsts on weekends. Master Problem Solve wth MIP Benders cut Subproblem Solve wth CP Patent, day assgnments

137 Home Hospce Care Solve wth Benders decomposton. Assgn ades to patents n master problem. Mamze number of patents served by a gven set of ades. Schedule home vsts n subproblem. Cyclc weekly schedule. No vsts on weekends. Subproblem decouples nto a schedulng problem for each ade and each day of the week. Master Problem Solve wth MIP Benders cut Subproblem Solve wth CP Patent, day assgnments

138 Master problem = f patent j assgned to ade Home Hospce Care = f patent j scheduled = f patent j assgned to ade on day k Requred number of vsts per week

139 For a rollng schedule: Home Hospce Care Schedule new patents, drop departng patents from schedule. Provde contnuty for remanng patents as follows: Old patents served by same ade on same days. F y jk = for the relevant ades, patents, and days.

140 For a rollng schedule: Home Hospce Care Schedule new patents, drop departng patents from schedule. Provde contnuty for remanng patents as follows: Old patents served by same ade on same days. F y jk = for the relevant ades, patents, and days. Alternatve: Also served at same tme. F tme wndows to enforce ther current schedule. Alternatve: served only by same ade. F j = for the relevant ades, patents.

141 Home Hospce Care Benders cuts Use strengthened nogood cuts Fnd a smaller set of patents that create nfeasblty by re-solvng the each nfeasble schedulng problem repeatedly. Reduced set of patents whose assgnment to ade on day k creates nfeasblty

142 Home Hospce Care Aulary cuts based on symmetres. A cut for vald for ade, day k s also vald for ade on other days. Ths gves rse to a large number of cuts. The aulary cuts can be summed wthout sacrfcng optmalty. Orgnal cut ensures convergence to optmum. Ths yelds 2 cuts per ade:

143 Home Hospce Care Subproblem relaaton Include relaaton of subproblem n the master problem. Necessary for good performance. Use tme wndow relaaton for each schedulng problem. Smplest relaaton for ade and day k: Set of patents whose tme wndow fts n nterval [a, b]. Can use several ntervals.

144 Home Hospce Care Ths relaaton s very weak. Doesn t take nto account travel tmes. Improved relaaton. Basc dea: Augment vst duraton p j wth travel tme to (or from) locaton j from closest patent or ade home base. Ths s weak unless most assgnments are fed. As n rollng schedule. We partton day nto 2 ntervals. Mornng and afternoon. Smplfes handlng of ade tme wndows and home bases. All patent tme wndows are n mornng or afternoon.

145 Home Hospce Care Tme wndow relaaton for ade, day k usng ntervals [a,b], [b,c] and where Q k = {patents unassgned or assgned to ade, day k}

146 Home Hospce Care Instance generaton Start wth (suboptmal) soluton for the 60 patents F ths schedule for frst n patents. Schedule remanng 60 n patents Use 8 of the 8 ades to cover new patents As well as the old patents they already cover. Ths puts us near the phase transton.

147 Home Hospce Care

148 Home Hospce Care

149 Home Hospce Care

150 Branch and check Generate Benders cuts at certan nodes of a branchng tree Varables fed so far are search varables. Unfed varables go nto subproblem. Not the same as branch and cut. In branch and cut, the cuts contan unfed varables. In branch and check, the cuts contan fed varables. When to use? When master problem s the bottleneck. Master s solved only once, wth growng constrant set. 50

151 Inference as Projecton Project onto propostonal varables of nterest Suppose we wsh to nfer from these clauses everythng we can about propostons, 2, 3 5

152 Inference as Projecton Project onto propostonal varables of nterest Suppose we wsh to nfer from these clauses everythng we can about propostons, 2, 3 We can deduce 2 3 Ths s a projecton onto, 2, 3 52

153 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem 2 Benders cut from prevous teraton 53

154 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master 2 (, 2, 3 ) = (0,,0) Resultng subproblem 54

155 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master 2 (, 2, 3 ) = (0,,0) Resultng subproblem Subproblem s nfeasble. (, 3 )=(0,0) creates nfeasblty 55

156 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master 2 3 (,2,3) = (0,,0) Benders cut (nogood) Resultng subproblem Subproblem s nfeasble. (, 3 )=(0,0) creates nfeasblty 56

157 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master 2 (, 2, 3 ) = (0,,) 3 Resultng subproblem 57

158 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master 2 (, 2, 3 ) = (0,,) 3 Resultng subproblem Subproblem s feasble 58

159 Inference as Projecton Benders decomposton computes a projecton Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master (, 2, 3 ) = (0,,) Enumeratve Benders cut Resultng subproblem Subproblem s feasble 59

160 Inference as Projecton Benders decomposton computes a projecton Logc-based Benders cuts descrbe projecton onto master problem varables. Current Master problem soluton of master JH and Yan (995) JH (202) (, 2, 3 ) = (0,,) Enumeratve Benders cut Contnue untl master s nfeasble. Black Benders cuts descrbe projecton. Resultng subproblem 60

161 Inference as Projecton Benders cuts = conflct clauses n a SAT algorthm Branch on, 2, 3 frst. 6

162 Inference as Projecton Benders cuts = conflct clauses n a SAT algorthm Branch on, 2, 3 frst. Conflct clauses 62

163 Inference as Projecton Benders cuts = conflct clauses n a SAT algorthm Branch on, 2, 3 frst. Conflct clauses Backtrack to 3 at feasble leaf nodes 63

164 Inference as Projecton Benders cuts = conflct clauses n a SAT algorthm Branch on, 2, 3 frst. Conflct clauses contanng, 2, 3 descrbe projecton 64

165 Benders decomposton [7] was ntroduced n 962 to solve applcatons that become lnear programmng (LP) problems when certan search varables are fed. Generalzed Benders decomposton, proposed by Geoffron n 972 [25], etended the method to nonlnear programmng subproblems. Logc-based Benders decomposton (LBBD) allows the subproblem to be any optmzaton problem. LBBD was ntroduced n [32], formally developed n 2000 [33], and tested computatonally n [39]. Branch and check s ntroduced n [33] and tested computatonally n [69]. Combnatoral Benders cuts for med nteger programmng are proposed n [8]. One of the frst applcatons [43] was a plannng and schedulng problem. Updated eperments [7] show that LBBD s orders of magntude faster than state-of-the-art MIP, wth the advantage over CP even greater). Smlar results have been obtaned for varous plannng and schedulng problems [5, 2, 30, 34, 35, 37, 7]. Other successful applcatons of LBBD nclude steel producton schedulng [29], nventory management [74], concrete delvery [44], shop schedulng [3, 3, 27, 28, 59], hosptal schedulng [57], batch schedulng n chemcal plants [49, 70], computer processor schedulng [8, 9, 2, 22, 3, 46, 47, 48, 58, 62], logc crcut verfcaton [40], shft schedulng [5, 60], lock schedulng [73], faclty locaton [23, 66], space packng [20, 50], vehcle routng [9, 5, 53, 56, 6, 75], bcycle sharng [45], network desgn [24, 52, 63, 65], home health care [6], servce restoraton [26], supply chan management [68], food dstrbuton [64], queung desgn and control [67], optmal control of dynamcal systems [], propostonal satsfablty [], quadratc programmng [2, 4, 42], chordal completon [0], and sports schedulng [4, 54, 55, 72]. LBBD s compared wth branch and check n [6]. It s mplemented n the general-purpose solver SIMPL [76]. References [] F. Bacchus, S. Dalmao, and T. Ptass. Relaaton search: A smple way of managng optonal clauses. In AAAI Conference on Artfcal Intellgence [2] L. Ba, J. E. Mtchell, and J.-S. Pang. On conve quadratc programs wth lnear complementarty constrants. Computatonal Optmzaton and Applcatons, 54:57 554, 202. [3] M. A. Bajestan and J. C. Beck. Schedulng a dynamc arcraft repar shop wth lmted repar resources. Journal of Artfcal Intellgence Research, 47:35 70, 203. [4] P. Baptste, C. Le Pape, and W. Nujten. Constrant-Based Schedulng: Applyng Constrant Programmng to Schedulng Problems. Kluwer, Dordrecht, 200. [5] A. Y. Barlatt, A. M. Cohn, and O. Guskhn. A hybrdzaton of mathematcal programmng and domnance-drven enumeraton for solvng shft-selecton and task-sequencng problems. Computers and Operatons Research, 37: , 200. [6] J. C. Beck. Checkng up on branch-and-check. In D. Cohen, edtor, Prncple and Practce of Constrant Programmng (CP), volume 6308 of Lecture Notes n Computer Scence, pages 84 98, 200. [7] J. F. Benders. Parttonng procedures for solvng med-varables programmng problems. Numersche Mathematk, 4: , 962. [8] L. Benn, D. Bertozz, A. Guerr, and M. Mlano. Allocaton and schedulng for MPSoCs va decomposton and no-good generaton. In Prncples and Practce of Constrant Programmng (CP 2005), volume 3709 of Lecture Notes n Computer Scence, pages Sprnger, 2005.

166 2 [9] L. Benn, M. Lombard, M. Mantovan, M. Mlano, and M. Ruggero. Mult-stage Benders decomposton for optmzng multcore archtectures. In L. Perron and M. A. Trck, edtors, CPAIOR 2008 Proceedngs, volume 505 of Lecture Notes n Computer Scence, pages Sprnger, [0] D. Bergman and A. U. Raghunathan. A Benders approach to the mnmum chordal completon problem. In L. Mchel, edtor, CPAIOR Proceedngs, volume 9075 of Lecture Notes n Computer Scence, pages Sprnger, 205. [] A. H. Borzabad and M. E. Sadjad. Optmal control of hybrd systems by logc-based Benders decomposton. In A. Gua, C. Mahulea, M. Slva, and J. Zaytoon, edtors, Analyss and Desgn of Hybrd Systems, volume 3, pages 04 07, [2] H. Cambazard, P.-E. Hladk, A.-M. Déplanche, N. Jussen, and Y. Trnquet. Decomposton and learnng for a hard real tme task allocaton problem. In M. Wallace, edtor, Prncples and Practce of Constrant Programmng (CP 2004), volume 3258 of Lecture Notes n Computer Scence, pages Sprnger, [3] E. Çoban and J. N. Hooker. Sngle-faclty schedulng by logc-based Benders decomposton. Annals of Operatons Research, 20: , 203. [4] K. K. H. Cheung. A Benders approach for computng lower bounds for the mrrored travelng tournament problem. Dscrete Optmzaton, 6:89 96, [5] Y. Chu and Q. Xa. A hybrd algorthm for a class of resource-constraned schedulng problems. In R. Barták and M. Mlano, edtors, CPAIOR 2005 Proceedngs, volume 3524 of Lecture Notes n Computer Scence, pages Sprnger, [6] A. Cré and J. N. Hooker. A heurstc logc-based Benders method for the home health care problem. Presented at Matheurstcs 202, Angra dos Res, Brazl, 202. [7] A. A. Cré, E. Çoban, and J. N. Hooker. Med nteger programmng vs logc-based Benders decomposton for plannng and schedulng. In C. Gomes and M. Sellmann, edtors, CPAIOR 203 Proceedngs, pages , 203. [8] G. Codato and M. Fschett. Combnatoral Benders cuts for med-nteger lnear programmng. Operatons Research, 54: , [9] A. I. Corréa, A. Langevn, and L. M. Rousseau. Dspatchng and conflct-free routng of automated guded vehcles: A hybrd approach combnng constrant programmng and med nteger programmng. In J. C. Régn and M. Rueher, edtors, CPAIOR 2004 Proceedngs, volume 30 of Lecture Notes n Computer Scence, pages Sprnger, [20] J.-F. Côté, M. Dell Amco, and M. Ior. Combnatoral Benders cuts for the strp packng problem. Operatons Research, 62:643 66, 204. [2] T. O. Daves, A. R. Pearce, P. J. Stuckey, and N. Lpovetzky. Sequencng operator counts. In Internatonal Conference on Automated Plannng and Schedulng (ICAPS), pages 6 69, 205. [22] A. Emeretls, G. Theodords, P. Alefrags, and N. Voros. Mappng DAGs on heterogeneous platforms usng logc-based Benders decomposton. In IEEE Computer Socety Annual Symposum on VLSI (ISVLSI), pages IEEE, 205.

167 3 [23] M. M. Fazel-Zarand and J. C. Beck. Solvng a locaton-allocaton problem wth logc-based Benders decomposton. In I. P. Gent, edtor, Prncples and Practce of Constrant Programmng (CP 2009), volume 5732 of Lecture Notes n Computer Scence, pages , New York, Sprnger. [24] B. Gendron, R. G. Garroppo, G. Nencon, M. G. Scutellà, and L. Tavant. Benders decomposton for a locaton-desgn problem n green wreless local area networks. Electronc Notes n Dscrete Mathematcs, 4: , 203. [25] A. M. Geoffron. Generalzed Benders decomposton. Journal of Optmzaton Theory and Applcatons, 0: , 972. [26] J. Gong, E. E. Lee, J. E. Mtchell, and W. A. Wallace. Logc-based multobjectve optmzaton for restoraton plannng. In W. Chaovaltwongse, K. C. Furman, and P. M. Pardalos, edtors, Optmzaton and Logstcs Challenges n the Enterprse, pages [27] O. Guyon, P. Lemare, E. Pnson, and D. Rvreau. Solvng an ntegrated job-shop problem wth human resource constrants. Annals of Operatons Research, 23:47 7, 204. [28] I. Hamd and T. Loukl. Logc-based Benders decomposton to solve the permutaton flowshop schedulng problem wth tme lags. In Internatonal Conference on Modelng, Smulaton and Appled Optmzaton (ICMSAO), pages 7. IEEE, 203. [29] I. Harjunkosk and I. E. Grossmann. A decomposton approach for the schedulng of a steel plant producton. Computers and Chemcal Engneerng, 25: , 200. [30] I. Harjunkosk and I. E. Grossmann. Decomposton technques for multstage schedulng problems usng med-nteger and constrant programmng methods. Computers and Chemcal Engneerng, 26: , [3] P.-E. Hladk, H. Cambazard, A.-M. Déplanche, and N. Jussen. Solvng a real-tme allocaton problem wth constrant programmng. Journal of Systems and Software, 8:32 49, [32] J. N. Hooker. Logc-based Benders decomposton. In INFORMS Natonal Meetng (INFORMS 995), 995. [33] J. N. Hooker. Logc-Based Methods for Optmzaton: Combnng Optmzaton and Constrant Satsfacton. Wley, New York, [34] J. N. Hooker. A hybrd method for plannng and schedulng. Constrants, 0:385 40, [35] J. N. Hooker. An ntegrated method for plannng and schedulng to mnmze tardness. Constrants, :39 57, [36] J. N. Hooker. Integrated Methods for Optmzaton. Sprnger, [37] J. N. Hooker. Plannng and schedulng by logc-based Benders decomposton. Operatons Research, 55: , [38] J. N. Hooker. Integrated Methods for Optmzaton, 2nd ed. Sprnger, 202.

168 4 [39] J. N. Hooker and G. Ottosson. Logc-based Benders decomposton. Mathematcal Programmng, 96:33 60, [40] J. N. Hooker and H. Yan. Logc crcut verfcaton by Benders decomposton. In V. Saraswat and P. Van Hentenryck, edtors, Prncples and Practce of Constrant Programmng: The Newport Papers, pages , Cambrdge, MA, 995. MIT Press. [4] J. Hu, J. E. Mtchell, and J.-S. Pang. An LPCC approach to nonconve quadratc programs. Mathematcal Programmng, 33: , 202. [42] J. Hu, J. E. Mtchell, J.-S. Pang, K. P. Bennett, and G. Kunapul. On the global soluton of lnear programs wth lnear complementarty constrants. SIAM Journal on Optmzaton, 9:445 47, [43] V. Jan and I. E. Grossmann. Algorthms for hybrd MILP/CP models for a class of optmzaton problems. INFORMS Journal on Computng, 3: , 200. [44] J. Knable and M. Trck. A logc-based Benders approach to the concrete delvery problem. In H. Smons, edtor, CPAIOR Proceedngs, volume 845 of Lecture Notes n Computer Scence, pages Sprnger, 204. [45] C. Klomüllner, P. Papazek, B. Hu, and G. R. Radl. A cluster-frst route-second approach for balancng bcycle sharng systems. In Internatonal Conference on Computer Aded Systems Theory (EUROCAST), volume 9520 of Lecture Notes n Computer Scence, pages Sprnger, 205. [46] W. Lu, Z. Gu, J. Xu, X. Wu, and Y. Ye. Satsfablty modulo graph theory for task mappng and schedulng on multprocessor systems. IEEE Transactons on Parallel and Dstrbuted Systems, 22: , 20. [47] W. Lu, M. Yuan, X. He, Z. Gu, and X. Lu. Effcent SAT-based mappng and schedulng of homogeneous synchronous dataflow graphs for throughput optmzaton. In Real-Tme Systems Symposum, pages IEEE, [48] M. Lombard, M. Mlano, M. Ruggero, and L. Benn. Stochastc allocaton and schedulng for condtonal task graphs n mult-processor systems-on-chp. Journal of Schedulng, 3:35 345, 200. [49] C. T. Maravelas and I. E. Grossmann. Usng MILP and CP for the schedulng of batch chemcal processes. In J. C. Régn and M. Rueher, edtors, CPAIOR 2004 Proceedngs, volume 30 of Lecture Notes n Computer Scence, pages 20. Sprnger, [50] J. Maschler and G. Radl. Logc-based Benders decomposton for the 3-staged strp packng problem. In Internatonal Conference on Operatons Research (German OR Socety), 205. [5] T. Nsh, Y. Hranaka, and I. E. Grossmann. A blevel decomposton algorthm for smultaneous producton schedulng and conflct-free routng for automated guded vehcles. Computers and Operatons Research, 38: , 20. [52] B. Peterson and M. Trck. A Benders approach to a transportaton network desgn problem. In W.-J. van Hoeve and J. N. Hooker, edtors, CPAIOR 2009 Proceedngs, volume 5547 of Lecture Notes n Computer Scence, pages , New York, Sprnger.

169 5 [53] G. R. Radl, T. Baumhauer, and B. Hu. Speedng up logc-based Benders decomposton by a metaheurstc for a b-level capactated vehcle routng problem. In Internatonal Workshop on Hybrd Metaheurstcs, volume 8457 of Lecture Notes n Computer Scence, pages Sprnger, 204. [54] R. V. Rasmussen. Schedulng a trple round robn tournament for the best Dansh soccer league. European Journal of Operatonal Research, 20:795 80, [55] R. V. Rasmussen and M. A. Trck. A Benders approach to the constraned mnmum break problem. European Journal of Operatonal Research, 77:98 23, [56] S. Raz, C. Seatzu, O. Wgstrom, and B. Lennartson. Benders/gossp methods for heterogeneous mult-vehcle routng problems. In IEEE Conference on Emergng Technologes Factory Automaton (ETFA), pages 6, 203. [57] V. Roshanae, D. M. Aleman, and D. Urbach. Logc-based Benders decomposton approaches wth applcaton to operatng room schedulng. In INFORMS Natonal Meetng, 205. [58] M. Ruggero, A. Guerr, D. Bertozz, F. Polett, and M. Mlano. Communcaton-aware allocaton and schedulng framework for stream-orented mult-processor systems-on-chp. In Proceedngs of the Conference on Desgn, Automaton and Test n Europe, pages 3 8. European Desgn and Automaton Assocaton, [59] R. Sadykov. A hybrd branch-and-cut algorthm for the one-machne schedulng problem. In J. C. Régn and M. Rueher, edtors, CPAIOR Proceedngs, volume 30 of Lecture Notes n Computer Scence, pages Sprnger, [60] D. Salvagnn and T. Walsh. A hybrd MIP/CP approach for mult-actvty shft schedulng. In M. Mlano, edtor, Prncples and Practce of Constrant Programmng, volume 754 of Lecture Notes n Computer Scence, pages Sprnger, 202. [6] R. Sarmad, O. Wgström, and S. Carla. Benders/gossp methods for heterogeneous mult-vehcle routng problems. In IEEE Internatonal Conference on Emergng Technologes and Factory Automaton (ETFA), pages 6. IEEE, 203. [62] N. Satsh, K. Ravndran, and K. Keutzer. A decomposton-based constrant optmzaton approach for statcally schedulng task graphs wth communcaton delays to multprocessors. In Proceedngs of the Conference on Desgn, Automaton and Test n Europe, pages EDA Consortum, [63] S. Shen and J. C. Smth. A decomposton approach for solvng a broadcast domnaton network desgn problem. Annals of Operatons Research, 20: , 20. [64] S. Solak, C. Scherrer, and A. Ghonem. The stop-and-drop problem n nonproft food dstrbuton networks. Annals of Operatons Research, 22: , 204. [65] Z. C. Taşkın, J. C. Smth, S. Ahmed, and A. J. Schaefer. Cuttng plane algorthms for solvng a stochastc edge-partton problem. Dscrete Optmzaton, 6: , [66] S. Tarm, S. Armagan, and I. Mguel. A hybrd Benders decomposton method for solvng stochastc constrant programs wth lnear recourse. In B. Hnch, M. Carlsson, F. Fages, and F. Ross, edtors, Internatonal Workshop on Constrant Solvng and Constrant Logc Programmng (CSCLP), pages Sprnger, 2006.

An Integrated OR/CP Method for Planning and Scheduling

An Integrated OR/CP Method for Planning and Scheduling An Integrated OR/CP Method for Plannng and Schedulng John Hooer Carnege Mellon Unversty IT Unversty of Copenhagen June 2005 The Problem Allocate tass to facltes. Schedule tass assgned to each faclty. Subect

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

Planning and Scheduling to Minimize Makespan & Tardiness. John Hooker Carnegie Mellon University September 2006

Planning and Scheduling to Minimize Makespan & Tardiness. John Hooker Carnegie Mellon University September 2006 Plannng and Schedulng to Mnmze Makespan & ardness John Hooker Carnege Mellon Unversty September 2006 he Problem Gven a set of tasks, each wth a deadlne 2 he Problem Gven a set of tasks, each wth a deadlne

More information

A Search-Infer-and-Relax Framework for. Integrating Solution Methods. Carnegie Mellon University CPAIOR, May John Hooker

A Search-Infer-and-Relax Framework for. Integrating Solution Methods. Carnegie Mellon University CPAIOR, May John Hooker A Search-Infer-and-Rela Framework for Integratng Soluton Methods John Hooker Carnege Mellon Unversty CPAIOR, May 005 CPAIOR 005 Why ntegrate soluton methods? One-stop shoppng. One solver does t all. CPAIOR

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Combining Constraint Programming and Integer Programming

Combining Constraint Programming and Integer Programming Combnng Constrant Programmng and Integer Programmng GLOBAL CONSTRAINT OPTIMIZATION COMPONENT Specal Purpose Algorthm mn c T x +(x- 0 ) x( + ()) =1 x( - ()) =1 FILTERING ALGORITHM COST-BASED FILTERING ALGORITHM

More information

Global Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1

Global Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1 Slde 1 Global Optmzaton of Truss Structure Desgn J. N. Hooker Tallys Yunes INFORMS 2010 Truss Structure Desgn Select sze of each bar (possbly zero) to support the load whle mnmzng weght. Bar szes are dscrete.

More information

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem Internatonal Journal of Industral Engneerng Computatons 7 (2016) 573 584 Contents lsts avalable at GrowngScence Internatonal Journal of Industral Engneerng Computatons homepage: www.growngscence.com/ec

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Scheduling Home Hospice Care with Logic-Based Benders Decomposition

Scheduling Home Hospice Care with Logic-Based Benders Decomposition Scheduling Home Hospice Care with Logic-Based Benders Decomposition John Hooker Carnegie Mellon University Joint work with Aliza Heching Ryo Kimura Compassionate Care Hospice CMU Lehigh University October

More information

Optimization Methods for Engineering Design. Logic-Based. John Hooker. Turkish Operational Research Society. Carnegie Mellon University

Optimization Methods for Engineering Design. Logic-Based. John Hooker. Turkish Operational Research Society. Carnegie Mellon University Logc-Based Optmzaton Methods for Engneerng Desgn John Hooker Carnege Mellon Unerst Turksh Operatonal Research Socet Ankara June 1999 Jont work wth: Srnas Bollapragada General Electrc R&D Omar Ghattas Cl

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Recent Developments in Disjunctive Programming

Recent Developments in Disjunctive Programming Recent Developments n Dsjunctve Programmng Aldo Vecchett (*) and Ignaco E. Grossmann (**) (*) INGAR Insttuto de Desarrollo Dseño Unversdad Tecnologca Naconal Santa Fe Argentna e-mal: aldovec@alpha.arcrde.edu.ar

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Portfolios with Trading Constraints and Payout Restrictions

Portfolios with Trading Constraints and Payout Restrictions Portfolos wth Tradng Constrants and Payout Restrctons John R. Brge Northwestern Unversty (ont wor wth Chrs Donohue Xaodong Xu and Gongyun Zhao) 1 General Problem (Very) long-term nvestor (eample: unversty

More information

Logic, Optimization and Data Analytics

Logic, Optimization and Data Analytics Logic, Optimization and Data Analytics John Hooker Carnegie Mellon University United Technologies Research Center, Cork, Ireland August 2015 Thesis Logic and optimization have an underlying unity. Ideas

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Interconnect Optimization for Deep-Submicron and Giga-Hertz ICs

Interconnect Optimization for Deep-Submicron and Giga-Hertz ICs Interconnect Optmzaton for Deep-Submcron and Gga-Hertz ICs Le He http://cadlab.cs.ucla.edu/~hele UCLA Computer Scence Department Los Angeles, CA 90095 Outlne Background and overvew LR-based STIS optmzaton

More information

This is the Pre-Published Version.

This is the Pre-Published Version. Ths s the Pre-Publshed Verson. Abstract In ths paper we consder the problem of schedulng obs wth equal processng tmes on a sngle batch processng machne so as to mnmze a prmary and a secondary crtera. We

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Projection in Logic, CP, and Optimization

Projection in Logic, CP, and Optimization Projection in Logic, CP, and Optimization John Hooker Carnegie Mellon University Workshop on Logic and Search Melbourne, 2017 Projection as a Unifying Concept Projection is a fundamental concept in logic,

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for

More information

A FAST HEURISTIC FOR TASKS ASSIGNMENT IN MANYCORE SYSTEMS WITH VOLTAGE-FREQUENCY ISLANDS

A FAST HEURISTIC FOR TASKS ASSIGNMENT IN MANYCORE SYSTEMS WITH VOLTAGE-FREQUENCY ISLANDS Shervn Haamn A FAST HEURISTIC FOR TASKS ASSIGNMENT IN MANYCORE SYSTEMS WITH VOLTAGE-FREQUENCY ISLANDS INTRODUCTION Increasng computatons n applcatons has led to faster processng. o Use more cores n a chp

More information

Linear Feature Engineering 11

Linear Feature Engineering 11 Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19

More information

An Admission Control Algorithm in Cloud Computing Systems

An Admission Control Algorithm in Cloud Computing Systems An Admsson Control Algorthm n Cloud Computng Systems Authors: Frank Yeong-Sung Ln Department of Informaton Management Natonal Tawan Unversty Tape, Tawan, R.O.C. ysln@m.ntu.edu.tw Yngje Lan Management Scence

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

SOLVING CAPACITATED VEHICLE ROUTING PROBLEMS WITH TIME WINDOWS BY GOAL PROGRAMMING APPROACH

SOLVING CAPACITATED VEHICLE ROUTING PROBLEMS WITH TIME WINDOWS BY GOAL PROGRAMMING APPROACH Proceedngs of IICMA 2013 Research Topc, pp. xx-xx. SOLVIG CAPACITATED VEHICLE ROUTIG PROBLEMS WITH TIME WIDOWS BY GOAL PROGRAMMIG APPROACH ATMII DHORURI 1, EMIUGROHO RATA SARI 2, AD DWI LESTARI 3 1Department

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

Optimal Scheduling Algorithms to Minimize Total Flowtime on a Two-Machine Permutation Flowshop with Limited Waiting Times and Ready Times of Jobs

Optimal Scheduling Algorithms to Minimize Total Flowtime on a Two-Machine Permutation Flowshop with Limited Waiting Times and Ready Times of Jobs Optmal Schedulng Algorthms to Mnmze Total Flowtme on a Two-Machne Permutaton Flowshop wth Lmted Watng Tmes and Ready Tmes of Jobs Seong-Woo Cho Dept. Of Busness Admnstraton, Kyongg Unversty, Suwon-s, 443-760,

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

CS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang

CS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang CS DESIGN ND NLYSIS OF LGORITHMS DYNMIC PROGRMMING Dr. Dasy Tang Dynamc Programmng Idea: Problems can be dvded nto stages Soluton s a sequence o decsons and the decson at the current stage s based on the

More information

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton

More information

Maximal Margin Classifier

Maximal Margin Classifier CS81B/Stat41B: Advanced Topcs n Learnng & Decson Makng Mamal Margn Classfer Lecturer: Mchael Jordan Scrbes: Jana van Greunen Corrected verson - /1/004 1 References/Recommended Readng 1.1 Webstes www.kernel-machnes.org

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

The Multi-Inter-Distance Constraint

The Multi-Inter-Distance Constraint The Mult-Inter-Dstance Constrant Perre Ouellet Unversté Laval Département d nformatque et de géne logcel perre.ouellet.4@ulaval.ca Claude-Guy Qumper Unversté Laval Département d nformatque et de géne logcel

More information

Memetic Algorithm for Flexible Job Shop Scheduling with Preemption

Memetic Algorithm for Flexible Job Shop Scheduling with Preemption Internatonal Journal of Industral Engneerng & Producton Management (2012) March 2012, Volume 22, Number 4 pp. 331-340 http://ijiepm.ust.ac.r/ Memetc Algorthm for Flexble Job Shop Schedulng wth Preempton

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

En Route Traffic Optimization to Reduce Environmental Impact

En Route Traffic Optimization to Reduce Environmental Impact En Route Traffc Optmzaton to Reduce Envronmental Impact John-Paul Clarke Assocate Professor of Aerospace Engneerng Drector of the Ar Transportaton Laboratory Georga Insttute of Technology Outlne 1. Introducton

More information

A Hybrid MILP/CP Decomposition Approach for the Continuous Time Scheduling of Multipurpose Batch Plants

A Hybrid MILP/CP Decomposition Approach for the Continuous Time Scheduling of Multipurpose Batch Plants A Hybrd MILP/CP Decomposton Approach for the Contnuous Tme Schedulng of Multpurpose Batch Plants Chrstos T. Maravelas, Ignaco E. Grossmann Carnege Mellon Unversty, Department of Chemcal Engneerng Pttsburgh,

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

A Simple Inventory System

A Simple Inventory System A Smple Inventory System Lawrence M. Leems and Stephen K. Park, Dscrete-Event Smulaton: A Frst Course, Prentce Hall, 2006 Hu Chen Computer Scence Vrgna State Unversty Petersburg, Vrgna February 8, 2017

More information

Lecture 20: November 7

Lecture 20: November 7 0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Lecture 17: Lee-Sidford Barrier

Lecture 17: Lee-Sidford Barrier CSE 599: Interplay between Convex Optmzaton and Geometry Wnter 2018 Lecturer: Yn Tat Lee Lecture 17: Lee-Sdford Barrer Dsclamer: Please tell me any mstake you notced. In ths lecture, we talk about the

More information

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

p 1 c 2 + p 2 c 2 + p 3 c p m c 2

p 1 c 2 + p 2 c 2 + p 3 c p m c 2 Where to put a faclty? Gven locatons p 1,..., p m n R n of m houses, want to choose a locaton c n R n for the fre staton. Want c to be as close as possble to all the house. We know how to measure dstance

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Determining Transmission Losses Penalty Factor Using Adaptive Neuro Fuzzy Inference System (ANFIS) For Economic Dispatch Application

Determining Transmission Losses Penalty Factor Using Adaptive Neuro Fuzzy Inference System (ANFIS) For Economic Dispatch Application 7 Determnng Transmsson Losses Penalty Factor Usng Adaptve Neuro Fuzzy Inference System (ANFIS) For Economc Dspatch Applcaton Rony Seto Wbowo Maurdh Hery Purnomo Dod Prastanto Electrcal Engneerng Department,

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

CHAPTER 7 CONSTRAINED OPTIMIZATION 2: SQP AND GRG

CHAPTER 7 CONSTRAINED OPTIMIZATION 2: SQP AND GRG Chapter 7: Constraned Optmzaton CHAPER 7 CONSRAINED OPIMIZAION : SQP AND GRG Introducton In the prevous chapter we eamned the necessary and suffcent condtons for a constraned optmum. We dd not, however,

More information

O-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment

O-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment O-lne Temporary Tasks Assgnment Yoss Azar and Oded Regev Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978, Israel. azar@math.tau.ac.l??? Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978,

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule:

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule: 15-745 Lecture 6 Data Dependence n Loops Copyrght Seth Goldsten, 2008 Based on sldes from Allen&Kennedy Lecture 6 15-745 2005-8 1 Common loop optmzatons Hostng of loop-nvarant computatons pre-compute before

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Lecture 10 Support Vector Machines. Oct

Lecture 10 Support Vector Machines. Oct Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

10-701/ Machine Learning, Fall 2005 Homework 3

10-701/ Machine Learning, Fall 2005 Homework 3 10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM IJCMA: Vol. 6, No. 1, January-June 2012, pp. 1-19 Global Research Publcatons A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM S. Kavtha and Nrmala

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k.

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k. THE CELLULAR METHOD In ths lecture, we ntroduce the cellular method as an approach to ncdence geometry theorems lke the Szemeréd-Trotter theorem. The method was ntroduced n the paper Combnatoral complexty

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

BALANCING OF U-SHAPED ASSEMBLY LINE

BALANCING OF U-SHAPED ASSEMBLY LINE BALANCING OF U-SHAPED ASSEMBLY LINE Nuchsara Krengkorakot, Naln Panthong and Rapeepan Ptakaso Industral Engneerng Department, Faculty of Engneerng, Ubon Rajathanee Unversty, Thaland Emal: ennuchkr@ubu.ac.th

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Support Vector Machines

Support Vector Machines CS 2750: Machne Learnng Support Vector Machnes Prof. Adrana Kovashka Unversty of Pttsburgh February 17, 2016 Announcement Homework 2 deadlne s now 2/29 We ll have covered everythng you need today or at

More information

Fuzzy approach to solve multi-objective capacitated transportation problem

Fuzzy approach to solve multi-objective capacitated transportation problem Internatonal Journal of Bonformatcs Research, ISSN: 0975 087, Volume, Issue, 00, -0-4 Fuzzy aroach to solve mult-objectve caactated transortaton roblem Lohgaonkar M. H. and Bajaj V. H.* * Deartment of

More information

Department of Computer Science Artificial Intelligence Research Laboratory. Iowa State University MACHINE LEARNING

Department of Computer Science Artificial Intelligence Research Laboratory. Iowa State University MACHINE LEARNING MACHINE LEANING Vasant Honavar Bonformatcs and Computatonal Bology rogram Center for Computatonal Intellgence, Learnng, & Dscovery Iowa State Unversty honavar@cs.astate.edu www.cs.astate.edu/~honavar/

More information

Optimal Solution to the Problem of Balanced Academic Curriculum Problem Using Tabu Search

Optimal Solution to the Problem of Balanced Academic Curriculum Problem Using Tabu Search Optmal Soluton to the Problem of Balanced Academc Currculum Problem Usng Tabu Search Lorna V. Rosas-Téllez 1, José L. Martínez-Flores 2, and Vttoro Zanella-Palacos 1 1 Engneerng Department,Unversdad Popular

More information

ExxonMobil. Juan Pablo Ruiz Ignacio E. Grossmann. Department of Chemical Engineering Center for Advanced Process Decision-making. Pittsburgh, PA 15213

ExxonMobil. Juan Pablo Ruiz Ignacio E. Grossmann. Department of Chemical Engineering Center for Advanced Process Decision-making. Pittsburgh, PA 15213 ExxonMobl Multperod Blend Schedulng Problem Juan Pablo Ruz Ignaco E. Grossmann Department of Chemcal Engneerng Center for Advanced Process Decson-makng Unversty Pttsburgh, PA 15213 1 Motvaton - Large cost

More information

Mean Field / Variational Approximations

Mean Field / Variational Approximations Mean Feld / Varatonal Appromatons resented by Jose Nuñez 0/24/05 Outlne Introducton Mean Feld Appromaton Structured Mean Feld Weghted Mean Feld Varatonal Methods Introducton roblem: We have dstrbuton but

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

On a Solution of Fractional Programs via D.C. Optimization Theory

On a Solution of Fractional Programs via D.C. Optimization Theory On a Soluton of Fractonal Programs va D.C. Optmzaton Theory Tatana V. Gruzdeva Aleander S. Strekalovsky Matrosov Insttute for System Dynamcs and Control Theory of SB RAS Lermontov str., 134 664033, Irkutsk,

More information