Incremental and Encoding Formulations for Mixed Integer Programming

Size: px
Start display at page:

Download "Incremental and Encoding Formulations for Mixed Integer Programming"

Transcription

1 Incremental and Encodng Formulatons for Mxed Integer Programmng Sercan Yıldız a, Juan Pablo Velma b,c, a Tepper School of Busness, Carnege Mellon Unversty, 5000 Forbes Ave., Pttsburgh, PA 15213, Unted States b Sloan School of Management, Massachusetts Insttute of Technology, 77 Massachusetts Ave., Cambrdge, MA 02139, Unted States c Department of Industral Engneerng, Unversty of Pttsburgh, 3700 O Hara Street, Pttsburgh, PA 15261, Unted States Abstract The standard way to represent a choce between n alternatves n Mxed Integer Programmng s through n bnary varables that add up to one. Unfortunately, ths approach commonly leads to unbalanced branch-and-bound trees and dmnshed solver performance. In ths paper, we present an encodng formulaton framework that encompasses and expands exstng approaches to mtgate ths behavor. Through ths framework, we generalze the ncremental formulaton for pecewse lnear functons to any fnte unon of polyhedra wth dentcal recesson cones. Keywords: Mxed Integer Programmng, Dsjunctve Programmng, Formulatons 1. Introducton A textbook approach to selectng among n dscrete alternatves n a Mxed Integer Programmng (MIP) problem s to utlze n bnary varables {y } n wth the addtonal requrement that they add up to one. In partcular, ths s captured by the set D n := n {0, 1} n where n := { y R n + : n y = 1 }. For nstance, gven a fnte set {a 1,..., a n } R, we may model the constrant x {a 1,..., a n } Correspondng author. Tel.: Emal addresses: syldz@andrew.cmu.edu (Sercan Yıldız), jvelma@mt.edu (Juan Pablo Velma) Preprnt submtted to Elsever Aprl 1, 2013

2 va the MIP formulaton gven by x = a y, y D n. (1) Ths approach s qute smple and, as we dscuss n Secton 3, t can be easly extended to more general settngs. Unfortunately, although the approach s usually qute effectve, t has some unfavorable propertes that can slow down branch-andbound based MIP solvers. These propertes stem from the way the formulaton s affected by standard varable branchng n a branch-and-bound algorthm. Whle fxng a gven bnary varable y to one (usually denoted up-branchng) fxes all other varables to zero, fxng the same varable to zero (usually denoted downbranchng) does not mpose any constrants on the other varables (unless n = 2). It s well-known that ths behavor leads to unbalanced branch-and-bound trees and may result n long soluton tmes. To ths date, there have been three central approaches to dealng wth the branchng ssues that arse n formulatons based on D n. The frst approach replaces the usual varable branchng strategy wth a more sophstcated constrant branchng scheme [1]. For nstance, Beale and Tomln [2] ntroduced SOS1 branchng as a very effectve branchng scheme for D n and other related sets. Unfortunately, f SOS1 branchng s not mplemented usng modern technques, t can be slower than varable branchng n state-of-the-art solvers [3]. One way to crcumvent ths problem s to use bnary varables to smulate a specalzed constrant branchng scheme [4, 5]. The second approach s normally employed n schedulng problems where selectng opton corresponds to executng a certan actvty n perod. In ths settng, we can use an alternatve set of bnary varables that nstead ndcate whether the actvty s executed n perod or before. These new varables are sometmes called by-varables and lead to balanced branch-and-bound trees that can sgnfcantly reduce soluton tmes [6 12]. The thrd approach proposes to model n alternatves wth a number of bnary varables that s logarthmc n n [5, 13 17]. Ths approach tends to generate more balanced branch-and-bound trees, but, as we wll see n Secton 2, they are not mmune to mbalance ssues ether. Nevertheless, formulatons that are bult usng a logarthmc number of bnary varables usually provde a sgnfcant computatonal advantage. The encodng formulatons that we descrbe n Secton 2 provde a general framework n whch all three approaches can be vewed. In Secton 3, we use ths framework to come up wth an ncremental formulaton for the fnte unon 2

3 of polyhedra wth dentcal recesson cones. We end the paper wth a note on the selecton of encodngs n Secton 4. In the remander, we let [n] := {1,..., n} wth the understandng that [0] =. We use 0 n R n to refer to the n-dmensonal vector of all zeros and e,n R n to refer to the th n-dmensonal standard unt vector. 2. Encodng Formulatons and Branch-and-Bound The bass for our analyss wll be a reformulaton of D n whch has been part of the mathematcal programmng folklore snce at least 1972 [13] and whch has recently been re-dscovered by several authors [5, 15, 17]. Ths formulaton requres a set of vectors { b } n {0, 1}m such that b b j for any j. For any such set, t models y D n as y = 1, u = b y, u {0, 1} m, y R n +. (2) A key theoretcal strength of (2) s the tghtness of ts LP relaxaton. In ths regard, a MIP formulaton has the strongest possble property when all extreme ponts of ts LP relaxaton obey the correspondng ntegralty requrements. Such formulatons are referred to as locally deal by Padberg [18] and Padberg and Rjal [19]. We note here that (2) s locally deal for any choce of { b } n {0, 1}m as long as b b j for any j [16, 17]. Formulaton (2) may seem wasteful as t contans more varables and constrants { } than the orgnal defnton of D n. However, dependng on the choce of n b, (2) can present a computatonal advantage by sgnfcantly reducng the number of bnary varables or by leadng to more balanced branch-and-bound trees. One reason for ths advantage stems from the fact that varable branchng on u nduces a constrant branchng scheme on y n the sprt of [4, 5]. More specfcally, we have that up-branchng on the varable u j fxes y = 0 for all such that b j = 0 whle down-branchng on u j fxes y = 0 for all such that b j = 1. The effectveness of ths nduced branchng scheme wll of course depend on the choce of { b } n. We now descrbe three such choces and analyze the branchng schemes they nduce. We wll refer to the resultng formulatons as encodng formulatons snce one can thnk of { b } n as an encodng of a selecton among the alternatves n the sense that u = b f and only f alternatve s selected. 3

4 We obtan the smplest encodng when we set m = n and b = e,n. In ths case, (2) reduces to y = 1, u = y, [n], (3) u {0, 1} n, y R n +, whch s nothng more than a redundant reformulaton of D n. We can easly see that the nduced branchng scheme s just the standard varable branchng on y and, hence, we do not obtan any benefts. We refer to ths choce as the unary encodng formulaton. A more meanngful choce appears n the development of logarthmc-szed formulatons. For ease of exposton, let us assume that n = 2 k for some postve nteger k Z + although the approach can easly be adapted to more general cases as well. In ths settng, we can smply let m = k and { b } n = {0, 1}m. Ths choce transforms (2) nto a formulaton wth a logarthmc number of bnary varables whch was the orgnal case studed n [5, 13, 15, 17]. The nduced constrant branchng scheme s not qute clear, but we can easly see that t creates balanced branch-and-bound trees by observng that we have { [n] : b j = 0, b j = u j, j J } = { [n] : b j = 1, b j = u j, j J } for all j [m], J [m] \ { j } and u {0, 1} m. Here, J can be consdered as the subset of { u j} m whch has been fxed to some value at a partcular node of the branch-and-bound tree. Together wth the reduced number of varables, ths property can lead to a sgnfcant computatonal advantage. We refer to ths choce as the bnary encodng formulaton. Whle the bnary encodng formulaton nduces a non-trval branchng scheme, as noted n [5], t does not nduce the tradtonal SOS1 constrant branchng scheme. To construct a formulaton that nduces SOS1 branchng on y, we can set m = n 1, b 1 = 0 m and b = 1 e j,m for all {2,..., n}. In ths case, we have that up-branchng on the varable u j fxes y = 0 for all j whle downbranchng on u j fxes y = 0 for all > j. Thus, we recover precsely the SOS1 branchng scheme of Beale and Tomln [2]. We refer to ths choce as the ncremental encodng formulaton because t can be used to construct a formulaton for pecewse-lnear functons that s known as the ncremental model n the lterature. 4

5 To llustrate the potental advantage of the ncremental encodng formulaton, we study the behavor of a smple branch-and-bound algorthm on the dfferent formulatons of the followng smple problem. For a gven a (Z \ {0}) n such that a < a +1 for all [n 1], consder the problem mn x s.t. x {a 1,..., a n }. (4a) (4b) We can use (2) to model the dscrete alternatves constrant (4b) and usual lnear programmng trcks to lnearze the objectve functon. Applyng these technques leads us to the MIP formulaton of (4) gven by mn t s.t. (5a) x t, x t (5b) x = a y, y = 1, y R n +, (5c) u = b y, u {0, 1} m. (5d) Note that, n (5), we have modeled the dscrete alternatves constrant and lnearzed the objectve functon ndependently. Whle t s possble to construct a stronger formulaton for ths problem by consderng both aspects at the same tme, we refran from ths because our ntent here s to evaluate the effectveness of the formulatons as they would be used n practce where dfferent portons of an optmzaton problem are modeled ndependently and then combned. The followng proposton shows that the ncremental encodng formulaton never requres branchng on more than a sngle varable to solve ths problem. In contrast, there are choces of n and a for whch the unary and bnary encodng formulatons may need branchng on up to n/2 and log 2 n varables, respectvely. Proposton For any n and choce of a (Z \ {0}) n, the ncremental encodng verson of (5) can be solved by a branch-and-bound algorthm by branchng on a sngle varable. 5

6 2. If n s even, a < 0 for all n/2 and a > 0 for all > n/2, then a branchand-bound algorthm solvng the unary encodng verson of (5) requres branchng on at least n/2 varables. 3. If n s a power of two, a < 0 < a n for all n 1, then a branch-and-bound algorthm solvng the bnary encodng verson of (5) requres branchng on at least log 2 n varables. Proof. Let [n] be such that a < 0 < a +1. It s clear that the optmal soluton to (4) s ether x = a or x = a +1. Recall that, n the ncremental encodng formulaton, we have b = 0 for all and b = 1 for all >. Hence, up-branchng on the sngle varable u fxes y = 0 for all whle downbranchng on u fxes y = 0 for all >. When projected on to the x-space, the LP relaxaton of (5) n the frst branch corresponds to the nterval [a +1, a n ] and has the optmal soluton x = a +1. Smlarly, the LP relaxaton n the second branch projects down to [a 1, a ] and has the optmal soluton x = a. Ths proves Clam 1. Now, suppose a branch-and-bound algorthm can solve the unary encodng verson of (5) by branchng on the varables {u } K where K [n] and K < n/2. As we have observed before, up-branchng on the varable u fxes y = 1 and y j = 0 for all j n the unary encodng formulaton. Hence, the optmal value of (5) at any leaf reached by up-branchng on a varable u must equal a > 0. On the other hand, the LP relaxaton of (5) at the leaf reached by down-branchng on all {u } K has the optmal value 0 snce there exst dstnct, j [n] \ K such that n/2 and j > n/2 and the projecton of the LP relaxaton on to the x-space contans 0. Ths leaf could have been pruned by nether ntegralty nor bound and must stll be actve. Ths contradcton proves Clam 2. The proof of Clam 3 follows an outlne smlar to that of Clam 2. Let l := log 2 n and suppose a branch-and-bound algorthm can solve the bnary encodng verson of (5) by branchng on the varables {u } K where K [l]. At termnaton, the branch-and-bound tree has a leaf at whch u = b n s a feasble assgnment. Let j [l] \ K. Let [n] be such that b j = 1 b n j and b j = b n j for all j j. It follows that u = b s a feasble assgnment at ths leaf as well. The fact that a < 0 mples that the projecton of the LP relaxaton of (5) on to the x-space at ths leaf contans 0. Agan, we conclude that ths leaf could have been pruned by nether ntegralty nor bound. Ths completes the proof of Clam 3. 6

7 3. Incremental Formulatons An nterestng behavor of the ncremental encodng formulaton s that t naturally nduces the order u 1 u 2... u n 1. Ths orderng condton s also shared by the by-varable formulatons [6 12], whch explans why they lead to balanced branch-and-bound trees. Moreover, t s explctly mposed n other more complcated ad-hoc formulatons for pecewse-lnear functons [20 23] and probablstc constrants [24, 25]. We now show that all these formulatons can be obtaned through a generc procedure. The frst step n ths procedure s to note that we can use D n to formulate more general dscrete alternatves by usng the followng formulaton ntroduced by Lowe [26] and Jeroslow and Lowe [27]. Proposton 3.1 ([26, 27]). Let {P } n be a fnte famly of polyhedra such that there exsts { r k} R 1 k=0 Rd and { } v j V 1 Rd for [n] such that P := conv { } v j V 1 + cone { r k} R 1 for all [n]. Then a MIP formulaton of x n k=0 P s gven by x = V 1 R 1 λ j v j + µ k r k, (6a) k=0 V 1 λ j = y, [n], (6b) µ 0, λ 0, [n], y D n. (6c) Formulaton (6) s locally deal [26 28]. We can combne ths standard formulaton wth the generc encodng formulaton (2) of D n to obtan the followng generalzaton of a formulaton for pecewse-lnear functons ntroduced n [16]. Corollary 3.2. Let {P } n be a fnte famly of polyhedra such that there exsts { } R 1 r k R d and { } v j V 1 k=0 R d for [n] such that P := conv { } v j V 1 + cone { r k} R 1 for all [n]. Then a MIP formulaton of x n k=0 P s gven by 7

8 V 1 R 1 x = λ j v j + µ k r k, (7a) V 1 λ j = 1, u = k=0 V 1 b λ j, (7b) µ 0, λ 0, [n], u {0, 1} m. (7c) The fact that (7) s locally deal follows drectly from the smlar result on (2). For the specfc case of the ncremental encodng, we can use smple algebrac manpulatons to obtan the followng formulaton whch explctly consders the order property among the u varables. Proposton 3.3. Let {P } n be a fnte famly of polyhedra such that there exsts { r k} R 1 k=0 Rd and { } v j V 1 R d for [n] such that P := conv { } v j V 1 + cone { r k} R 1 for all [n]. Then a MIP formulaton of x n k=0 P s gven by n 1 x = v ( u v 0 +1 ) vv 1 + V 1 ( δ j v j ) R 1 v0 + µ k r k, k=0 (8a) u δ V 1, [n 1], (8b) V +1 1 δ j +1 u, [n 1], (8c) V 1 1 δ j 1 1, (8d) µ 0, δ 0, [n], u {0, 1} n 1. (8e) Proof. We exhbt a bjecton whch preserves the values of the x varables between ponts satsfyng (8) and the ncremental encodng verson of (7). The clam then follows from Corollary 3.2. In the rest of the proof, we refer to the ncremental encodng verson of (7) as smply (7). Let (x, u, λ, µ) be a soluton to (7). Defne u 0 := 1 and u n := 0 and observe that (7b) can be rewrtten as 8

9 u = n V 1 l=+1 λ j l for all {0, 1,..., n 1} when the vectors { b } n are chosen accordng to ncremental encodng. Let δ j := λ j for all j [V 2] and δ V 1 for all [n]. The valdty of (8b)-(8e) for (x, u, δ, µ) follows from the defnton of δ and the non-negatvty of λ. To verfy that (8a) also holds, let r = R 1 k=0 µ k r k and observe := u + λ V 1 x = = = V 1 λ j v j + r V 1 u 1 u λ j V 1 v0 + λ j v j + r V 1 (u 1 u )v 0 + λ j (v j v0 ) + r n 1 V 1 = v u (v 0 +1 v0 ) + λ j (v j v0 ) + r n 1 = v u (v 0 +1 v0 ) + V 2 δ j (v j v0 ) + 1 (δv u )(v V 1 v 0 ) + r n 1 = v u (v 0 +1 vv 1 ) + V 1 δ j (v j v0 ) + r. To prove the reverse ncluson, let ( x, ũ, δ, µ) be a soluton to (8). Defne ũ 0 := 1 and ũ n := 0 and let λ j := δ j for all j [V 2], λ V 1 := δ V 1 ũ and λ 0 := ũ 1 V 1 δ j for all [n]. It s not dffcult to see that these defntons mply ũ = n V 1 λ j l=+1 l for all {0, 1,..., n 1}. Furthermore, the equaltes n the frst part of the proof contnue to hold. Thus, ( x, ũ, λ, µ) satsfes (7a)-(7b). To complete the proof, t s enough to show that λ s non-negatve. However, ths follows drectly from ts defnton and (8b)-(8c). Formulaton (8) s locally deal. To see ths, observe that the lnear mappng defned n the proof of Proposton 3.3 s n fact a bjecton between ponts satsfyng the LP relaxatons of (8) and the ncremental encodng verson of (7). Gven 9

10 any soluton to the LP relaxaton of (8) n whch the u varables have fractonal values, ths mappng assocates wth t a soluton to the LP relaxaton of (7) wth the same u values. However, ths cannot be an extreme pont soluton to the LP relaxaton of (7) by the smple fact that (7) s locally deal. Hence, t can be expressed as the convex combnaton of other solutons to the LP relaxaton of (7). Mappng these solutons back to (8) and usng the contnuty of lnear mappngs shows that the LP relaxaton of (8) cannot have any extreme pont solutons that volate the ntegralty restrctons. Formulaton (8) generalzes a formulaton ntroduced by Wlson [23] for pecewselnear functons n two ways. Frst, t presents a drect extenson from pecewselnear functons to the unon of a fnte number of arbtrary polyhedra wth dentcal recesson cones. Second, t enjoys a broader scope of applcablty by elmnatng the need for a topologcal condton that was requred for the valdty of Wlson s formulaton. We may obtan other ncremental formulatons through the followng rather straghtforward lemma. Lemma 3.4. The ncremental encodng formulaton for y D n s equvalent to u {0, 1} n 1, u u +1, [n 2], (9a) y 1 = 1 u 1, y n = u n 1, (9b) y = u 1 u, {2,..., n 2}. Gven any formulaton that requres y D n, we can replace ths constrant wth (9a) and elmnate every occurrence of y through the relatonshps (9b)-(9c). For nstance, followng ths procedure leads us to the formulaton for probablstc constrants studed n [24, 28] from a standard formulaton ntroduced n [29 31]. We refer the readers to [28] for detals on ths specfc transformaton. 4. Creatng and Selectng Encodngs In ths paper, we have concentrated on unary, bnary and ncremental encodngs. However, encodng formulatons n the sprt of (7) can be constructed for any selecton of dstnct bnary vectors { b } n. Furthermore, even for the ncremental and bnary encodngs, there s stll a choce to be made. For nstance, there s more than one way to order all vectors n {0, 1} m to defne { b } n and dfferent orders lead to dfferent versons of the bnary encodng formulaton. Smlarly, whle the order n the defnton of { b } n s fxed for the ncremental formulaton, 10 (9c)

11 f we change the order n whch the polyhedra {P } n are ndexed, we wll also obtan dfferent varants of the ncremental verson of (7). It s beyond the scope of ths paper to analyze general encodng constructon schemes, but to llustrate the potental varety of encodngs, we now present a herarchy of encodngs that encompasses the ncremental encodng n one extreme and the bnary encodng n the other. To smplfy presentaton, we assume n the rest of ths secton that n s a power of 2. The herarchy we propose s ndexed by h { 0, 1,..., log 2 n }, whch can be consdered as the number of bts of { b } n that behave as n the bnary encodng. Let t l := n/2 l. For a gven value of h, we set m = h + t h 1 and defne the vectors { b } n Rm n the encodng as follows: For all l [h], let b l = 1 f there exsts p [ 2 l 1 ] such that {2(p 1)t l + 1,..., (2p 1)t l } and b l = 0 otherwse. For all s [t h 1], let b h+s = 1 f there exsts p [ 2 h 1 ] such that {2(p 1)t h + s + 1,..., (2p 1)t h + s} and b,h+s = 0 otherwse. Fgure 1 shows ths herarchy of encodngs n matrx form (we present a matrx whose columns are { b } n ) for n = 8 and h {0, 1, 2, 3}. Note that p ndexes the blocks of contguous 1 s n each row n the defnton above. It can be seen that settng h = 0 produces the ncremental encodng whereas settng h = log 2 n (or even h = log 2 n 1) produces the bnary encodng (a) h = (b) h = (c) h = 2 (d) h = 3 Fgure 1: Encodngs n the herarchy for n = 8. 11

12 Fnally, we note that the performance of dfferent encodngs s hard to predct and can vary wth specfc nstances. For example, [5, 16] present computatonal results whch show that formulatons for pecewse-lnear functons based on the bnary encodng can sgnfcantly outperform those based on the unary and ncremental encodngs. However, n a dfferent set of problems, [32] reports that the ncremental formulaton performs better than the bnary one. Fortunately, general encodng formulatons n the form of (7) offer a convenent way to evaluate the performance of dfferent encodng choces. Whle the ncremental formulaton (8) could have a computatonal advantage over the ncremental encodng verson of (7), the latter could provde a smpler prelmnary test to evaluate the potental advantage of mplementng the former. References [1] D. Ryan, B. Foster, An nteger programmng approach to schedulng, n: A. Wren (Ed.), Computer Schedulng of Publc Transport Urban Passenger Vehcle and Crew Schedulng, North-Holland, 1981, pp [2] E. Beale, J. Tomln, Specal facltes n a general mathematcal programmng system for non-convex problems usng ordered sets of varables, n: OR 69: Proceedngs of the Ffth Internatonal Conference on Operatonal Research, pp [3] J. Velma, A. Keha, G. Nemhauser, Nonconvex, lower semcontnuous pecewse lnear optmzaton, Dscrete Optmzaton 5 (2008) [4] J. Appleget, R. Wood, Explct-constrant branchng for solvng mxednteger programs, volume 12 of Operatons Research / Computer Scence Interfaces Seres, Kluwer, 2000, pp [5] J. Velma, G. Nemhauser, Modelng dsjunctve constrants wth a logarthmc number of bnary varables and constrants, Mathematcal Programmng 128 (2011) [6] D. Brcker, Reformulaton of specal ordered sets for mplct enumeraton algorthms wth applcatons n nonconvex separable programmng, AIIE Transactons 9 (1977) [7] E. Ln, D. Brcker, On the calculaton of true and pseudo penaltes n multple choce nteger programmng, European Journal of Operatonal Research 55 (1991)

13 [8] W. Ogryczak, A note on modelng multple choce requrements for smple mxed nteger programmng solvers, Computers & Operatons Research 23 (1996) [9] C. Souza, L. Wolsey, Schedulng Projects wth Labour Constrants, Relatóro Técnco IC-97-22, IC - UNICAMP, [10] C. Cavalcante, C. C. de Souza, M. Savelsbergh, Y. Wang, L. Wolsey, Schedulng projects wth labor constrants, Dscrete Appled Mathematcs 112 (2001) [11] R. Möhrng, A. Schulz, F. Stork, M. Uetz, On project schedulng wth rregular startng tme costs, Operatons Research Letters 28 (2001) [12] E. Ln, D. Brcker, Connectng specal ordered nequaltes and transformaton and reformulaton technque n multple choce programmng, Computers & Operatons Research 29 (2002) [13] D. Sommer, Computatonal experence wth the ophele mxed nteger code, Talk presented at the Internatonal TIMS Conference, Houston. [14] T. Ibarak, Integer programmng formulaton of combnatoral optmzaton problems, Dscrete Mathematcs 16 (1976) [15] H. L, H. Lu, Global optmzaton for generalzed geometrc programs wth mxed free-sgn varables, Operatons Research 57 (2009) [16] J. Velma, S. Ahmed, G. Nemhauser, Mxed-nteger models for nonseparable pecewse-lnear optmzaton: Unfyng framework and extensons, Operatons Research 58 (2010) [17] W. Adams, S. Henry, Base-2 expansons for lnearzng products of functons of dscrete varables, Operatons Research 60 (2012) [18] M. Padberg, Approxmatng separable nonlnear functons va mxed zeroone programs, Operatons Research Letters 27 (2000) 1 5. [19] M. Padberg, M. Rjal, Locaton, Schedulng, Desgn and Integer Programmng, volume 3 of Internatonal Seres n Operatons Research & Management Scence, Sprnger,

14 [20] H. Markowtz, A. Manne, On the soluton of dscrete programmng problems, Econometrca 25 (1957) [21] G. Dantzg, On the sgnfcance of solvng lnear-programmng problems wth some nteger varables, Econometrca 28 (1960) [22] G. Dantzg, Lnear Programmng and Extensons, Prnceton Unversty Press, Prnceton, [23] D. Wlson, Polyhedral Methods for Pecewse-Lnear Functons, Ph.D. thess, Unversty of Kentucky, Lexngton, KY, USA, [24] J. Luedtke, S. Ahmed, G. Nemhauser, An nteger programmng approach for lnear programs wth probablstc constrants, Mathematcal Programmng 122 (2010) [25] J. Velma, S. Ahmed, G. Nemhauser, Mxed nteger lnear programmng formulatons for probablstc constrants, Operatons Research Letters 40 (2012) [26] J. Lowe, Modellng wth Integer Varables, Ph.D. thess, Georga Insttute of Technology, [27] R. Jeroslow, J. Lowe, Modelng wth nteger varables, Mathematcal Programmng Studes 22 (1984) [28] J. Velma, Mxed nteger lnear programmng formulaton technques, Optmzaton Onlne (2012). HTML/2012/07/3539.html. [29] E. Balas, On the convex-hull of the unon of certan polyhedra, Operatons Research Letters 7 (1988) [30] R. Jeroslow, A smplfcaton for some dsjunctve formulatons, European Journal of Operatonal Research 36 (1988) [31] C. Blar, Representaton for multple rght-hand sdes, Mathematcal Programmng 49 (1990) 1 5. [32] B. Geßler, A. Martn, A. Mors, L. Schewe, Usng pecewse lnear functons for solvng MINLPs, n: J. Lee, S. Leyffer (Eds.), Mxed Integer Nonlnear Programmng, volume 154 of The IMA Volumes n Mathematcs and ts Applcatons, Sprnger, 2012, pp

Incremental and Encoding Formulations for Mixed Integer Programming

Incremental and Encoding Formulations for Mixed Integer Programming Incremental and Encodng Formulatons for Mxed Integer Programmng Sercan Yıldız a, Juan Pablo Velma b,c, a Tepper School of Busness, Carnege Mellon Unversty, 5000 Forbes Ave, Pttsburgh, PA 523, Unted States

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

THE SUMMATION NOTATION Ʃ

THE SUMMATION NOTATION Ʃ Sngle Subscrpt otaton THE SUMMATIO OTATIO Ʃ Most of the calculatons we perform n statstcs are repettve operatons on lsts of numbers. For example, we compute the sum of a set of numbers, or the sum of the

More information

Global Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1

Global Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1 Slde 1 Global Optmzaton of Truss Structure Desgn J. N. Hooker Tallys Yunes INFORMS 2010 Truss Structure Desgn Select sze of each bar (possbly zero) to support the load whle mnmzng weght. Bar szes are dscrete.

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Randić Energy and Randić Estrada Index of a Graph

Randić Energy and Randić Estrada Index of a Graph EUROPEAN JOURNAL OF PURE AND APPLIED MATHEMATICS Vol. 5, No., 202, 88-96 ISSN 307-5543 www.ejpam.com SPECIAL ISSUE FOR THE INTERNATIONAL CONFERENCE ON APPLIED ANALYSIS AND ALGEBRA 29 JUNE -02JULY 20, ISTANBUL

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Lecture 17 : Stochastic Processes II

Lecture 17 : Stochastic Processes II : Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Graph Reconstruction by Permutations

Graph Reconstruction by Permutations Graph Reconstructon by Permutatons Perre Ille and Wllam Kocay* Insttut de Mathémathques de Lumny CNRS UMR 6206 163 avenue de Lumny, Case 907 13288 Marselle Cedex 9, France e-mal: lle@ml.unv-mrs.fr Computer

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

Fundamental loop-current method using virtual voltage sources technique for special cases

Fundamental loop-current method using virtual voltage sources technique for special cases Fundamental loop-current method usng vrtual voltage sources technque for specal cases George E. Chatzaraks, 1 Marna D. Tortorel 1 and Anastasos D. Tzolas 1 Electrcal and Electroncs Engneerng Departments,

More information

On the correction of the h-index for career length

On the correction of the h-index for career length 1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP

FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP C O L L O Q U I U M M A T H E M A T I C U M VOL. 80 1999 NO. 1 FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP BY FLORIAN K A I N R A T H (GRAZ) Abstract. Let H be a Krull monod wth nfnte class

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

REGULAR POSITIVE TERNARY QUADRATIC FORMS. 1. Introduction

REGULAR POSITIVE TERNARY QUADRATIC FORMS. 1. Introduction REGULAR POSITIVE TERNARY QUADRATIC FORMS BYEONG-KWEON OH Abstract. A postve defnte quadratc form f s sad to be regular f t globally represents all ntegers that are represented by the genus of f. In 997

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Combining Constraint Programming and Integer Programming

Combining Constraint Programming and Integer Programming Combnng Constrant Programmng and Integer Programmng GLOBAL CONSTRAINT OPTIMIZATION COMPONENT Specal Purpose Algorthm mn c T x +(x- 0 ) x( + ()) =1 x( - ()) =1 FILTERING ALGORITHM COST-BASED FILTERING ALGORITHM

More information

SUCCESSIVE MINIMA AND LATTICE POINTS (AFTER HENK, GILLET AND SOULÉ) M(B) := # ( B Z N)

SUCCESSIVE MINIMA AND LATTICE POINTS (AFTER HENK, GILLET AND SOULÉ) M(B) := # ( B Z N) SUCCESSIVE MINIMA AND LATTICE POINTS (AFTER HENK, GILLET AND SOULÉ) S.BOUCKSOM Abstract. The goal of ths note s to present a remarably smple proof, due to Hen, of a result prevously obtaned by Gllet-Soulé,

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

Vapnik-Chervonenkis theory

Vapnik-Chervonenkis theory Vapnk-Chervonenks theory Rs Kondor June 13, 2008 For the purposes of ths lecture, we restrct ourselves to the bnary supervsed batch learnng settng. We assume that we have an nput space X, and an unknown

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +

More information

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS These are nformal notes whch cover some of the materal whch s not n the course book. The man purpose s to gve a number of nontrval examples

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

The Quadratic Trigonometric Bézier Curve with Single Shape Parameter

The Quadratic Trigonometric Bézier Curve with Single Shape Parameter J. Basc. Appl. Sc. Res., (3541-546, 01 01, TextRoad Publcaton ISSN 090-4304 Journal of Basc and Appled Scentfc Research www.textroad.com The Quadratc Trgonometrc Bézer Curve wth Sngle Shape Parameter Uzma

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

Geometry of Müntz Spaces

Geometry of Müntz Spaces WDS'12 Proceedngs of Contrbuted Papers, Part I, 31 35, 212. ISBN 978-8-7378-224-5 MATFYZPRESS Geometry of Müntz Spaces P. Petráček Charles Unversty, Faculty of Mathematcs and Physcs, Prague, Czech Republc.

More information

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem Internatonal Journal of Industral Engneerng Computatons 7 (2016) 573 584 Contents lsts avalable at GrowngScence Internatonal Journal of Industral Engneerng Computatons homepage: www.growngscence.com/ec

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

Another converse of Jensen s inequality

Another converse of Jensen s inequality Another converse of Jensen s nequalty Slavko Smc Abstract. We gve the best possble global bounds for a form of dscrete Jensen s nequalty. By some examples ts frutfulness s shown. 1. Introducton Throughout

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Supplementary Notes for Chapter 9 Mixture Thermodynamics Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information

12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA. 4. Tensor product

12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA. 4. Tensor product 12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA Here s an outlne of what I dd: (1) categorcal defnton (2) constructon (3) lst of basc propertes (4) dstrbutve property (5) rght exactness (6) localzaton

More information

Introductory Cardinality Theory Alan Kaylor Cline

Introductory Cardinality Theory Alan Kaylor Cline Introductory Cardnalty Theory lan Kaylor Clne lthough by name the theory of set cardnalty may seem to be an offshoot of combnatorcs, the central nterest s actually nfnte sets. Combnatorcs deals wth fnte

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

arxiv: v1 [quant-ph] 6 Sep 2007

arxiv: v1 [quant-ph] 6 Sep 2007 An Explct Constructon of Quantum Expanders Avraham Ben-Aroya Oded Schwartz Amnon Ta-Shma arxv:0709.0911v1 [quant-ph] 6 Sep 2007 Abstract Quantum expanders are a natural generalzaton of classcal expanders.

More information

The proximal average for saddle functions and its symmetry properties with respect to partial and saddle conjugacy

The proximal average for saddle functions and its symmetry properties with respect to partial and saddle conjugacy The proxmal average for saddle functons and ts symmetry propertes wth respect to partal and saddle conjugacy Rafal Goebel December 3, 2009 Abstract The concept of the proxmal average for convex functons

More information

Combined Wronskian solutions to the 2D Toda molecule equation

Combined Wronskian solutions to the 2D Toda molecule equation Combned Wronskan solutons to the 2D Toda molecule equaton Wen-Xu Ma Department of Mathematcs and Statstcs, Unversty of South Florda, Tampa, FL 33620-5700, USA Abstract By combnng two peces of b-drectonal

More information