subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2
|
|
- Aldous Kelley
- 5 years ago
- Views:
Transcription
1 Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables, but problem classes will differ i the implemetatio of the subrouties Brach, Approximate, ad Variable Fixig. We ow discuss some of the issues that arise whe tryig to solve a 0-1 MILP. The problem has the followig form Maximize c 1 x + c 2 y subject to A 1 x + A 2 y b x j 0, j = 1,, 1 y j = 0 or 1, j = 1,, 2 where x is a 1 -dimesioal vector of real variables, y is a 2 - dimesioal vector of biary variables, ad = The umber of structural costraits is m, ad the parameters c 1, c 2, A 1, A 2 ad b are appropriately sized arrays. Boud The most obvious relaxatio of this problem is obtaied by removig the itegrality requiremets o the biary variables. The result is a bouded variable liear program with the same format as above except the itegrality requiremets are replaced by 0 y j 1, j = 1,, 2 Assume at some poit i the eumeratio process that the sets S + k, S k ad S 0 k are available. The liear programmig relaxatio of the problem is z k UB = Maximize c 1 x + Â c 2j y j + Â c 2j jœs 0 k subject to A 1 x + A 2 y b jœs + k x j 0, j = 1,, 1
2 0 y j 1, j Œ S 0 k y j = 1, j Œ S + k y j = 0, j Œ S k where the third term i the objective fuctio is a costat, ad the last two costraits fix a subset of the biary variables to either 0 or 1. The solutio to this LP provides a upper boud to the set of solutios associated with ode k. If the problem is ifeasible, the ode ca be fathomed. Note that we ca o loger use Eq. (4) to reduce z k UB by its fractioal part ad thus obtai a more powerful boud. Because some of the variables are allowed to be oiteger, the optimal objective value may be fractioal. Approximate Obtaiig a feasible iteger solutio from the relaxed solutio is ot, i geeral, simple sice roudig will rarely produce the desired result. Of course, if the relaxed solutio has all iteger values for y, it is also feasible to the origial problem. I this case, it is cosidered as a replacemet for the icumbet y B i the Update subroutie. I ay case, whe the relaxed solutio satisfies the itegrality requiremet the ode is fathomed ad backtrackig occurs. Example 3 (Facility Locatio Problem) To illustrate this brach ad boud procedure for a 0-1 MILP we cosider the facility locatio problem discussed i Sectio 7.4. Figure 8 gives the uit costs of trasportig a commodity from each of three proposed warehouse locatios to five differet customer sites. The demad for the commodity is give at the bottom of the matrix. Customer Warehouse Demad
3 Figure 8. Data for facility locatio problem We must decide which of the three locatios should have a warehouse. The capacity of a warehouse, if built, is 30. The cost of buildig a warehouse at locatio 1, 2 or 3 is 200, 300 ad 200, respectively. The problem is a simplificatio of the oe preseted i Sectio 7.4. We use the model that defies the variables as a proportio of demad rather tha as the amout shipped. The correspodig LP relaxatio has a feasible regio that is closer to the MILP feasible regio ad provides better bouds for the fathomig test. Recall that the decisio variables are x ij = fractio of jth customer s demad met from warehouse i y i = 1 if warehouse is built at locatio i; 0 otherwise ad the model is: Miimize z = m  i =1  d j c ij x ij +  f i y i j =1 m i =1 m x ij i =1 (All demad must be met)  = 1, j = 1,, (Warehouse capacity limits)  d j x ij u i y i, i = 1,,m j =1 (Noegativity) x ij 0, i = 1,,m; j = 1,, (Itegrality) y i = 0 or 1, i = 1,,m x ij y i, i = 1,,m; j = 1,, The last set of m costraits is redudat, but its iclusio ca icrease the computatioal efficiecy of the B&B algorithm sigificatly. The idea is to explicitly limit the use of ay shippig lik whose correspodig warehouse is ot opeed. The costraits force the values of the y i variables to assume the maximum value of the amout shipped (that is, max j x ij ) from warehouse i. This produces a tighter LP feasible regio ad hece better bouds. To form the liear programmig relaxatio, the itegrality costraits are replaced by simple bouds 0 y i 1. The search tree resultig from the brach ad boud computatios is illustrated i Fig. 9. Table 9 provides the details for each iteratio. The vector y LB gives the
4 z = F relaxed solutio for the 0-1 variables with z LB the objective value. Sice we are miimizig rather tha maximizig, the LP returs a lower boud rather tha a upper boud as was the case up util ow. This meas that we must reverse the sese of the iequality i coditio (3). With this modificatio, the appropriate test for fathomig ode k becomes z k LB z B (5) The separatio variable is idetified i the colum labeled s ad was chose to be the y i closest to 0.5 amogst all fractioal y i ; that is, y s = mi i { y i 0.5 }. Whe the value of the fractio was exactly 0.5, the y s = 1 ode was explored first. Because we are solvig a mixed-iteger program, coditio (4) ca o loger be use to roud the LP objective value. z = LB +2 0 z = LB z = LB z = LB (0, 1, 1) Feasible z = B (1, 0, 1) Feasible Ifeasible Figure 9. Search tree for warehouse locatio problem z = LB 8 Ifeasible The first feasible solutio is ucovered at ode 2 yieldig a objective value z F = 910. The algorithm the backtracks to ode 3 where the LP objective value is z LB = Coditio (5) allows us to fathom this ode so we backtrack to ode 4. A secod feasible solutio is foud at ode 6 which turs out to be the optimum. This is cofirmed after examiig two more odes. A fial poit about the example is that from the data we see that the total demad is 45 ad the capacity of each warehouse is 30. Cosequetly, all solutios that specify oly oe warehouse ca be fathomed immediately without attemptig the LP relaxatio. Whe solvig iteger programs, it is importat to idetify these types of problem-depedet restrictios. They ofte occasio large reductios i the computatioal effort.
5 Table 9. B&B results for warehouse locatio problem Node, k Level, l P k z LB y LB z B y B s Actio 0 0 Ø (0, 0.5, 1) M 2 Set y 2 =1 1 1 (+2) (0, 1, 0.5) M 3 Set y 3 =3 2 2 (+2, +3) (0, 1, 1) 910 (0, 1, 1) Backtrack 3 2 (+2, 3) (1, 1, 0) 910 (0, 1, 1) Fathom ad backtrack 4 1 ( 2) (0.5, 0,1) 910 (0, 1, 1) 1 Set y 1 =1 5 2 ( 2, +1) (1, 0, 0.5) 910 (0, 1, 1) 3 Set y 3 =1 6 3 ( 2, +1, +3) (1, 0, 1) 885 (1, 0, 1) Backtrack 7 3 ( 2, +1, 3) Ifeas. 885 (1, 0, 1) Backtrack 8 2 ( 2, 1) Ifeas. 885 (1, 0, 1) Stop Additive Algorithm for the Pure 0 1 Iteger Programmig We ow preset a B&B algorithm that ca be used to solve a 0-1 iteger program without relyig o liear programmig to fid upper bouds. The approach is due to Ego Balas ad is referred to as the additive algorithm. We write the model as Maximize  j =1 c j x j subject to  a ij x j b i, i = 1,,m j =1 x j = 0 or 1, j = 1,, For reasos that will soo become apparet it is assumed that all costraits are of the less tha or equal to type. If a model is ot i this form, the followig trasformatios ca be used to achieve it. If some costrait i is of the greater tha or equal to type, make the followig substitutio.  a ij x j b i fi  a ij x j b i j =1 j =1
6 If some costrait i is a equality, replace it with the followig iequalities.  a ij x j = b i fi j=1 Ï Â j=1 Ô Ì Ô Ó a ij x j b i  a ij x j b i j=1 It is also assumed that all coefficiets c j i the objective fuctio are opositive. If c j > 0, we replace x j with 1 ^x j, where ^x j is a biary variable. This trasformatio itroduces costats o the left-had side of the costraits that must be moved to the right. Costat terms i the objective fuctio are igored durig the optimizatio but added back whe the solutio is foud. As a illustratio of the variable trasformatio step, cosider the kapsack example below. Maximize z = 5x 1 + 3x 2 + 7x 3 subject to 4x 1 + 2x 2 + 5x 3 8 x j = 0 or 1, j = 1, 2, 3 To obtai egative coefficiets i the objective, each of the variables must be trasformed. The revised problem i the form required by the algorithm is Maximize z = 5^x 1 3^x 2 7^x subject to 4^x 1 2^x 2 5^x = 3 ^x j = 0 or 1, j = 1, 2, 3 To use implicit eumeratio as the solutio techique, it is ecessary to defie a relaxatio that will provide bouds ad allow us to test for feasibility.
7 Boud A very simple relaxatio of a iteger program is oe that requires oly additio to obtai a solutio. If we are at ode k i the search tree with sets S + k, S k ad S 0 k, the problem uder cosideratio ca be writte z k UB = Maximize  jœs 0 k cj x j +  subject to  jœs 0 k jœs + k cj aij x j r i, i = 1,,m (6) x j = 0 or 1, j Œ S 0 k where the secod term i the objective fuctio is a costat -- the cotributio of the variables fixed at 1. Of course, the variables fixed at 0 do ot affect the objective fuctio. To simplify the otatio, we have itroduced r i to represet the right-had side of costrait i; that is, r i = b i  aij, i = 1,,m jœs + k The value r i is the origial right-had-side value less the coefficiets of the variables that are set to 1. Because c j 0, a relaxed solutio x k that maximizes the objective is obtaied by settig all the free variables x j = 0, j Œ S 0 k. The correspodig objective value is computed by summig the coefficiets of the variables fixed to 1; that is, z k UB = S jœs + c j. I additio, if r = k (r 1,...,r m ) 0 implyig that all the costraits are satisfied, x k is optimal to the IP at ode k. I this case, we update the icumbet by puttig z B max{z B, z k UB } ad backtrack. If some of the costraits are ot satisfied whe all free variables are set to zero, eglectig these costraits is a relaxatio of the problem. The objective value obtaied is a upper boud. The solutio to this relaxatio is always iteger, but some of the costraits i (6) may be violated. For the trasformed kapsack example, whe all variables are free at ode 0 the boud obtaied is z 0 UB = 0 (the costat 15 will be igored for the remaider of this sectio). Clearly, this is a upper boud o the
8 optimal objective value sice all the objective coefficiets are egative. Give r 1 = 3 for the costrait, we see, however, that the solutio is ot feasible. Approximate This procedure is aimed at fidig a feasible solutio at a give ode that ca be used i subsequet fathomig tests. For the additive algorithm, we simply examie the values of r i to see if each is positive. If so, a feasible solutio has bee foud. Variable Fixig For a 0-1 iteger program, various logical tests may be icluded to determie whether a particular ode i the search tree ca be fathomed because it admits o feasible solutios. Agai assume that the eumerative process has progressed to ode k ad cosider costrait i. Let t i be the sum of the egative coefficiets of the free variables. Thus t i =  mi{0, aij } jœs 0 k represets the smallest possible left-had-side value for costrait i ad is always opositive. The right-had-side value r i may be positive, zero, or egative. Whe all the r i are oegative, the solutio to the relaxatio is feasible ad optimal for the ode. If r i is egative for some costrait i ad t i > r i, there is o feasible solutio i the set represeted by the ode. This follows because costrait i caot be satisfied eve if all the free variables with egative structural coefficiets are set to 1 ad the remaiig free variables set to 0. This is oe feasibility test. If a ode fails the test, it is fathomed ad the process backtracks. For example, cosider the costrait  jœs 0 k aij x j = 6x 1 + 5x 2 + 2x 3 3x 4 12 = r i The computatios give t i = 9 > r i = 12 so ode k is fathomed. For the kapsack example at ode 0, r 1 = 3 ad t 1 = = 11 so the feasibility test is satisfied. This idicates that we must cotiue to eumerate.
9 Similar reasoig ca be used to determie whe free variables must be fixed to 1 or 0 to assure feasibility. If a ij > 0, j Œ S 0 k ad a ij + t i > r i, x j must be set to 0 for feasibility. If a ij < 0, j Œ S 0 k ad a ij + t i > r i, x j must be set to 1 for feasibility. I this maer, variables may be fixed outside the usual eumeratio process thus reducig the size of the search tree. For the kapsack example, these coditios do ot idicate that ay of the variables ca be fixed. These tests together with the simple relaxatio, ca be icorporated i a implicit eumeratio scheme to solve the pure 0-1 IP. Because oly additio is used at each step i the computatios, the full procedure is called the additive algorithm. Brach The eumeratio procedure requires that a separatio variable be chose at each live ode. Oe method is to choose the variable that most reduces the ifeasibility of the curret solutio. To implemet this idea let R k = {j : j Œ S 0 k ad a ij < 0 for some i such that r i < 0} If there is o i such that r i < 0, the ode is fathomed; otherwise, at least oe variable whose idex is a elemet of R k must equal 1 i ay feasible solutio. Therefore, we ca separate o some x j, j Œ R k, ad the brach to the successor ode correspodig to x j = 1. The followig rule chooses such a j Œ R k i a attempt to move toward feasibility. Defie m I k =  max{0, ri } i=1 to be the ifeasibility of (6). By choosig x j for brachig, the ifeasibility at the successor ode is m I k (j) =  i=1 max{0, ri + a ij } We choose x s to miimize this value; that is,
10 I k (s) = mi jœr k I k (j) For example, if the costraits at ode k are 6x 1 2x 2 + 2x 3 3 3x 1 4x 2 + x 3 2 7x 1 + 5x 2 5x 3 4 the R k = {1, 2}, I k (1) = 3 ad I k (2) = 2 so x 3 is chose as the separatio variable. Adaptig, oce agai, the depth-first rule for brachig simplifies the represetatio of the search tree. A cosequece of this rule ad of brachig to x k = 1 is that the path vector P k uiquely determies the remaiig eumeratio required. Example 4 (Kapsack Problem) Cosider the trasformed kapsack problem itroduced above. Table 10 describes the solutio obtaied with additive algorithm. At ode 0, the ifeasibility idex I 0 = 3 ad R 0 = {1, 2, 3}. Also, I 0 (1) = 0, I 0 (2) = 1 ad I 0 (3) = 0 implyig that both ^x 1 ad ^x 3 will reduce the ifeasibility to 0 if either is set to 1. We arbitrarily choose ^x 3. At ode 1, the value of r 1 is positive so a feasible solutio has bee obtaied. The algorithm thus backtracks to ode 2 where the variable fixig procedure idicates that ^x 1 should be set to 1. Brachig to ode 3 yields a secod feasible solutio with P 3 = ( 3, +1). Because all the compoets of P 3 are uderlied, the termiatio criterio is met ad the computatios cease. The optimal solutio is ˆ x = (1, 0, 0) with z B = 5. I terms of the origial problem statemet we have x = (0, 1, 1) with z IP = 10.
11 Table 10. Additive algorithm results for kapsack example Node, k Level, l P k z UB t 1 r 1 z B ˆ x B s Actio 0 0 Ø M 3 Set ^x 3 =1 1 1 (+3) (0, 0, 1) Backtrack 2 1 ( 3) (0, 0, 1) Fix variable ^x 1 = ( 3, +1) (1, 0, 0) Stop
12 13. You are usig Balas s additive algorithm to solve the followig 0-1 IP. Maximize 10x 1 5x 2 7x 3 2x 4 8x 5 11x 6 4x 7 12x 8 subject to 3x 1 x 2 5x 3 3x 4 + 2x 5 + 2x 6 + 8x 7 + 4x 8 6 2x 1 + 3x 2 + 1x 3 10x 4 + 1x 5 4x 6 6x 7 + 2x 8 9 5x 1 4x 2 10x 3 + 2x 4 2x 5 3x 6 5x 7 3x 8 8 3x 1 + 3x 2 + 4x 3 5x 4 + 5x 5 x 6 + 8x 7 4 x 8 4 x j = 0 or 1, for j = 1,,8 a. At ode 0 of the search tree, use the feasibility tests discussed at the ed of Sectio 8.3 (variable fixig) to fix as may variables as possible. Determie the first separatio variable. b. Say you are at a itermediate poit i the eumeratio process. The followig iformatio cocerig the search tree is give: P k = ( 5, +1, +2, 8) ad z B = 99,999 Execute the additive algorithm for as may iteratios as required util backtrackig is idicated. Costruct a table showig all iformatio associated with the odes created i the search tree from the curret poit forward icludig the ode reached after the backtrack operatio. 14. Cosider the 0-1 kapsack problem below. Maximize z = 84x x x x x 5 subject to 49x x x x x x j = 0 or 1, j = 1,,5 a. Solve with Balas's algorithm by had showig the implicit eumeratio tree that results. Do ot use a computer. b. Solve by had usig brach ad boud with LP relaxatio. Costruct the search tree ad show all computatios. 20. You are give the followig 0-1 iteger program.
13 Maximize 10x 1 5x 2 7x 3 2x 4 8x 5 11x 6 4x 7 12x 8 subject to 3x 1 x 2 5x 3 3x 4 + 2x 5 + 2x 6 + 8x 7 + 4x 8 6 2x 1 + 3x 2 + x 3 10x 4 + x 5 4x 6 6x 7 + 2x 8 9 5x 1 4x 2 10x 3 + 2x 4 2x 5 3x 6 5x 7 3x 8 8 3x 1 + 3x 2 + 4x 3 5x 4 + 5x 5 x 6 + 8x 7 4x 8 4 x j = 0 or 1, j = 1,,8 a. For ode 0 of the search tree, use Balas s feasibility tests to fix as may variables as possible. Determie the first separatio variable. b. Say you are at a itermediate poit i the eumeratio process. The followig iformatio cocerig the search tree is give at ode k. S + k = {1, 2}, S k = {5, 8} P k = ( 5, 1, 2, 8), z B = 99,999 Use Balas s algorithm to go as may steps as ecessary util backtrackig is idicated. Show S + k, S k, P k ad z B for all odes created i the tree icludig the ode reached after the backtrack operatio. 21. For the problem Maximize 84x x x x x 5 subject to 49x x x x x x j = 0 or 1, j = 1,,5 a. Solve with Balas's algorithm by had showig the complete search tree geerated ad all calculatios. b. Solve by had usig brach ad boud with liear programmig relaxatio at each ode. Show the complete search tree ad all computatios.
14 31. You are give the followig 0-1 iteger program for which you are usig the additive algorithm to solve. Maximize 10x 1 30x 2 20x 3 20x 4 10x 5 subject to 8x 1 12x 2 x 3 8x 4 2x x 1 7x 2 4x 3 10x 4 x x 1 x 2 8x 3 3x 4 7x 5 9 x j = 0 or 1, j = 1,,5 At the curret iteratio, the solutio sets are S = {2, 4}, S + =. a. Draw the correspodig search tree. Startig from this poit use the feasibility tests to fix as may variables as possible. Commet o the solutio obtaied. b. Cotiue iteratig ad fid the optimum.
IP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More informationInteger Linear Programming
Iteger Liear Programmig Itroductio Iteger L P problem (P) Mi = s. t. a = b i =,, m = i i 0, iteger =,, c Eemple Mi z = 5 s. t. + 0 0, 0, iteger F(P) = feasible domai of P Itroductio Iteger L P problem
More informationLinear Programming and the Simplex Method
Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationOptimization Methods: Linear Programming Applications Assignment Problem 1. Module 4 Lecture Notes 3. Assignment Problem
Optimizatio Methods: Liear Programmig Applicatios Assigmet Problem Itroductio Module 4 Lecture Notes 3 Assigmet Problem I the previous lecture, we discussed about oe of the bech mark problems called trasportatio
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationScheduling under Uncertainty using MILP Sensitivity Analysis
Schedulig uder Ucertaity usig MILP Sesitivity Aalysis M. Ierapetritou ad Zheya Jia Departmet of Chemical & Biochemical Egieerig Rutgers, the State Uiversity of New Jersey Piscataway, NJ Abstract The aim
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationChapter 4. Fourier Series
Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,
More informationTRANSPORTATION AND ASSIGNMENT PROBLEMS
Trasportatio problem TRANSPORTATION AND ASSIGNMENT PROBLEMS Example P&T Compay produces caed peas. Peas are prepared at three caeries (Belligham, Eugee ad Albert Lea). Shipped by truck to four distributig
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND
Pacific-Asia Joural of Mathematics, Volume 5, No., Jauary-Jue 20 ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND SHAKEEL JAVAID, Z. H. BAKHSHI & M. M. KHALID ABSTRACT: I this paper, the roll cuttig problem
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationDynamic Programming. Sequence Of Decisions
Dyamic Programmig Sequece of decisios. Problem state. Priciple of optimality. Dyamic Programmig Recurrece Equatios. Solutio of recurrece equatios. Sequece Of Decisios As i the greedy method, the solutio
More informationDynamic Programming. Sequence Of Decisions. 0/1 Knapsack Problem. Sequence Of Decisions
Dyamic Programmig Sequece Of Decisios Sequece of decisios. Problem state. Priciple of optimality. Dyamic Programmig Recurrece Equatios. Solutio of recurrece equatios. As i the greedy method, the solutio
More informationDifferentiable Convex Functions
Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for
More informationThe Simplex algorithm: Introductory example. The Simplex algorithm: Introductory example (2)
Discrete Mathematics for Bioiformatics WS 07/08, G. W. Klau, 23. Oktober 2007, 12:21 1 The Simplex algorithm: Itroductory example The followig itroductio to the Simplex algorithm is from the book Liear
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationParallel Vector Algorithms David A. Padua
Parallel Vector Algorithms 1 of 32 Itroductio Next, we study several algorithms where parallelism ca be easily expressed i terms of array operatios. We will use Fortra 90 to represet these algorithms.
More informationPolynomials with Rational Roots that Differ by a Non-zero Constant. Generalities
Polyomials with Ratioal Roots that Differ by a No-zero Costat Philip Gibbs The problem of fidig two polyomials P(x) ad Q(x) of a give degree i a sigle variable x that have all ratioal roots ad differ by
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationPrinciple Of Superposition
ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give
More information6.867 Machine learning, lecture 7 (Jaakkola) 1
6.867 Machie learig, lecture 7 (Jaakkola) 1 Lecture topics: Kerel form of liear regressio Kerels, examples, costructio, properties Liear regressio ad kerels Cosider a slightly simpler model where we omit
More informationSNAP Centre Workshop. Basic Algebraic Manipulation
SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)
More informationSupport vector machine revisited
6.867 Machie learig, lecture 8 (Jaakkola) 1 Lecture topics: Support vector machie ad kerels Kerel optimizatio, selectio Support vector machie revisited Our task here is to first tur the support vector
More informationSolutions for the Exam 9 January 2012
Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets
More informationInteger Programming (IP)
Iteger Programmig (IP) The geeral liear mathematical programmig problem where Mied IP Problem - MIP ma c T + h Z T y A + G y + y b R p + vector of positive iteger variables y vector of positive real variables
More informationECONOMIC OPERATION OF POWER SYSTEMS
ECOOMC OEATO OF OWE SYSTEMS TOUCTO Oe of the earliest applicatios of o-lie cetralized cotrol was to provide a cetral facility, to operate ecoomically, several geeratig plats supplyig the loads of the system.
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 15.053 Optimizatio Methods i Maagemet Sciece (Sprig 2007) Problem Set 3 Due March 1 st, 2007 at 4:30 pm You will eed 116 poits out of 137 to receive a grade of 5.
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationSimilarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall
Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig
More informationBoosting. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 1, / 32
Boostig Professor Ameet Talwalkar Professor Ameet Talwalkar CS260 Machie Learig Algorithms March 1, 2017 1 / 32 Outlie 1 Admiistratio 2 Review of last lecture 3 Boostig Professor Ameet Talwalkar CS260
More informationChimica Inorganica 3
himica Iorgaica Irreducible Represetatios ad haracter Tables Rather tha usig geometrical operatios, it is ofte much more coveiet to employ a ew set of group elemets which are matrices ad to make the rule
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationLinear Programming! References! Introduction to Algorithms.! Dasgupta, Papadimitriou, Vazirani. Algorithms.! Cormen, Leiserson, Rivest, and Stein.
Liear Programmig! Refereces! Dasgupta, Papadimitriou, Vazirai. Algorithms.! Corme, Leiserso, Rivest, ad Stei. Itroductio to Algorithms.! Slack form! For each costrait i, defie a oegative slack variable
More information3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials
Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationChapter Vectors
Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it
More informationProperties and Tests of Zeros of Polynomial Functions
Properties ad Tests of Zeros of Polyomial Fuctios The Remaider ad Factor Theorems: Sythetic divisio ca be used to fid the values of polyomials i a sometimes easier way tha substitutio. This is show by
More informationSeptember 2012 C1 Note. C1 Notes (Edexcel) Copyright - For AS, A2 notes and IGCSE / GCSE worksheets 1
September 0 s (Edecel) Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright
More informationPolynomial Functions and Their Graphs
Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively
More informationEnd-of-Year Contest. ERHS Math Club. May 5, 2009
Ed-of-Year Cotest ERHS Math Club May 5, 009 Problem 1: There are 9 cois. Oe is fake ad weighs a little less tha the others. Fid the fake coi by weighigs. Solutio: Separate the 9 cois ito 3 groups (A, B,
More information15.083J/6.859J Integer Optimization. Lecture 3: Methods to enhance formulations
15.083J/6.859J Iteger Optimizatio Lecture 3: Methods to ehace formulatios 1 Outlie Polyhedral review Slide 1 Methods to geerate valid iequalities Methods to geerate facet defiig iequalities Polyhedral
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More informationThe z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j
The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.
More informationKinetics of Complex Reactions
Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet
More informationA Block Cipher Using Linear Congruences
Joural of Computer Sciece 3 (7): 556-560, 2007 ISSN 1549-3636 2007 Sciece Publicatios A Block Cipher Usig Liear Cogrueces 1 V.U.K. Sastry ad 2 V. Jaaki 1 Academic Affairs, Sreeidhi Istitute of Sciece &
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More informationTHE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.
THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of
More informationU8L1: Sec Equations of Lines in R 2
MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie
More informationDiscrete-Time Systems, LTI Systems, and Discrete-Time Convolution
EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [
More informationLecture Overview. 2 Permutations and Combinations. n(n 1) (n (k 1)) = n(n 1) (n k + 1) =
COMPSCI 230: Discrete Mathematics for Computer Sciece April 8, 2019 Lecturer: Debmalya Paigrahi Lecture 22 Scribe: Kevi Su 1 Overview I this lecture, we begi studyig the fudametals of coutig discrete objects.
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationRay-triangle intersection
Ray-triagle itersectio ria urless October 2006 I this hadout, we explore the steps eeded to compute the itersectio of a ray with a triagle, ad the to compute the barycetric coordiates of that itersectio.
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationA New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem
This is the Pre-Published Versio. A New Solutio Method for the Fiite-Horizo Discrete-Time EOQ Problem Chug-Lu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +852-2766-7410
More information6.003 Homework #3 Solutions
6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationA NEW APPROACH TO SOLVE AN UNBALANCED ASSIGNMENT PROBLEM
A NEW APPROACH TO SOLVE AN UNBALANCED ASSIGNMENT PROBLEM *Kore B. G. Departmet Of Statistics, Balwat College, VITA - 415 311, Dist.: Sagli (M. S.). Idia *Author for Correspodece ABSTRACT I this paper I
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationMarkscheme May 2015 Calculus Higher level Paper 3
M5/5/MATHL/HP3/ENG/TZ0/SE/M Markscheme May 05 Calculus Higher level Paper 3 pages M5/5/MATHL/HP3/ENG/TZ0/SE/M This markscheme is the property of the Iteratioal Baccalaureate ad must ot be reproduced or
More informationUNIVERSITY OF CALIFORNIA - SANTA CRUZ DEPARTMENT OF PHYSICS PHYS 116C. Problem Set 4. Benjamin Stahl. November 6, 2014
UNIVERSITY OF CALIFORNIA - SANTA CRUZ DEPARTMENT OF PHYSICS PHYS 6C Problem Set 4 Bejami Stahl November 6, 4 BOAS, P. 63, PROBLEM.-5 The Laguerre differetial equatio, x y + ( xy + py =, will be solved
More informationScenario Reduction Algorithm and Creation of Multi-Stage Scenario Trees
Fakulteta za Elektrotehiko Heike Brad, Eva Thori, Christoph Weber Sceario Reductio Algorithm ad Creatio of Multi-Stage Sceario Trees OSCOGEN Discussio Paper No. 7 Cotract No. ENK5-CT-2000-00094 Project
More informationx x x Using a second Taylor polynomial with remainder, find the best constant C so that for x 0,
Math Activity 9( Due with Fial Eam) Usig first ad secod Taylor polyomials with remaider, show that for, 8 Usig a secod Taylor polyomial with remaider, fid the best costat C so that for, C 9 The th Derivative
More information7 Sequences of real numbers
40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are
More informationLinear Differential Equations of Higher Order Basic Theory: Initial-Value Problems d y d y dy
Liear Differetial Equatios of Higher Order Basic Theory: Iitial-Value Problems d y d y dy Solve: a( ) + a ( )... a ( ) a0( ) y g( ) + + + = d d d ( ) Subject to: y( 0) = y0, y ( 0) = y,..., y ( 0) = y
More informationPOSSIBILISTIC OPTIMIZATION WITH APPLICATION TO PORTFOLIO SELECTION
THE PUBLISHING HOUSE PROCEEDINGS OF THE ROMANIAN ACADEMY, Series A, OF THE ROMANIAN ACADEMY Volume, Number /, pp 88 9 POSSIBILISTIC OPTIMIZATION WITH APPLICATION TO PORTFOLIO SELECTION Costi-Cipria POPESCU,
More informationLecture 9: Hierarchy Theorems
IAS/PCMI Summer Sessio 2000 Clay Mathematics Udergraduate Program Basic Course o Computatioal Complexity Lecture 9: Hierarchy Theorems David Mix Barrigto ad Alexis Maciel July 27, 2000 Most of this lecture
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationMa 530 Infinite Series I
Ma 50 Ifiite Series I Please ote that i additio to the material below this lecture icorporated material from the Visual Calculus web site. The material o sequeces is at Visual Sequeces. (To use this li
More information6.883: Online Methods in Machine Learning Alexander Rakhlin
6.883: Olie Methods i Machie Learig Alexader Rakhli LECTURES 5 AND 6. THE EXPERTS SETTING. EXPONENTIAL WEIGHTS All the algorithms preseted so far halluciate the future values as radom draws ad the perform
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationCSE 202 Homework 1 Matthias Springer, A Yes, there does always exist a perfect matching without a strong instability.
CSE 0 Homework 1 Matthias Spriger, A9950078 1 Problem 1 Notatio a b meas that a is matched to b. a < b c meas that b likes c more tha a. Equality idicates a tie. Strog istability Yes, there does always
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get
More information1 Statement of the Game
ANALYSIS OF THE CHOW-ROBBINS GAME JON LU May 10, 2016 Abstract Flip a coi repeatedly ad stop wheever you wat. Your payoff is the proportio of heads ad you wish to maximize this payoff i expectatio. I this
More informationBertrand s Postulate
Bertrad s Postulate Lola Thompso Ross Program July 3, 2009 Lola Thompso (Ross Program Bertrad s Postulate July 3, 2009 1 / 33 Bertrad s Postulate I ve said it oce ad I ll say it agai: There s always a
More informationMath 113 Exam 3 Practice
Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This
More informationSection 1 of Unit 03 (Pure Mathematics 3) Algebra
Sectio 1 of Uit 0 (Pure Mathematics ) Algebra Recommeded Prior Kowledge Studets should have studied the algebraic techiques i Pure Mathematics 1. Cotet This Sectio should be studied early i the course
More information1 Hash tables. 1.1 Implementation
Lecture 8 Hash Tables, Uiversal Hash Fuctios, Balls ad Bis Scribes: Luke Johsto, Moses Charikar, G. Valiat Date: Oct 18, 2017 Adapted From Virgiia Williams lecture otes 1 Hash tables A hash table is a
More informationREGRESSION (Physics 1210 Notes, Partial Modified Appendix A)
REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data
More informationFirst, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So,
0 2. OLS Part II The OLS residuals are orthogoal to the regressors. If the model icludes a itercept, the orthogoality of the residuals ad regressors gives rise to three results, which have limited practical
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationProblem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t =
Mathematics Summer Wilso Fial Exam August 8, ANSWERS Problem 1 (a) Fid the solutio to y +x y = e x x that satisfies y() = 5 : This is already i the form we used for a first order liear differetial equatio,
More informationAssignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.
PHYSICS 34 QUANTUM PHYSICS II (25) Assigmet 2 Solutios 1. With respect to a pair of orthoormal vectors ϕ 1 ad ϕ 2 that spa the Hilbert space H of a certai system, the operator  is defied by its actio
More information4755 Mark Scheme June Question Answer Marks Guidance M1* Attempt to find M or 108M -1 M 108 M1 A1 [6] M1 A1
4755 Mark Scheme Jue 05 * Attempt to fid M or 08M - M 08 8 4 * Divide by their determiat,, at some stage Correct determiat, (A0 for det M= 08 stated, all other OR 08 8 4 5 8 7 5 x, y,oe 8 7 4xy 8xy dep*
More information