IP Reference guide for integer programming formulations.
|
|
- Alberta Regina Gardner
- 6 years ago
- Views:
Transcription
1 IP Referece guide for iteger programmig formulatios. by James B. Orli for ad This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more detailed explaatios, see the PowerPoit tutorial o iteger programmig. The followig are techiques for trasformig a problem described logically or i words ito a iteger program. I most cases, the trasformatio is the simplest to describe. Ufortuately, simplest is ot the same as "best." It is widely accepted that the best iteger programmig formulatios are those that result i fast solutios by iteger programmig solvers. I geeral, these are the iteger programs for which the liear programmig relaxatio provides a good boud. Sectio 1. Subset selectio problems. Ofte, models are based o selectig a subset of elemets. For example, i the kapsack problem, oe wats to select a subset of items to put ito a kapsack so as to maximize the value while ot goig over a specified weight. Or oe wats to select a subset of potetial products i which to ivest. Or, oe has a set of differet itegers, ad oe wats to select a subset that sums to a value K. I these cases, it is typical for the iteger variables to be as follows: 1 if elemet i is selected 0 otherwise. Example: kapsack/capital budgetig. I this example, there are sitems to select from. Item Cost Value Problem: choose items whose cost sums to at most 14 so as to maximize the utility. maximize 16x x 2 +12x 3 + 8x 4 +11x 5 +19x 6 Formulatio: subject to 5x 1 + 7x 2 + 4x 3 + 3x 4 + 4x 5 + 6x 6 14 {0,1} for i = 1 to 6. I geeral: Maximize the value of the selected items such that the weight is at most b. C i = value of item i for i = 1 to. a i = weight of item i for i = 1 to. b = boud o total weight. maximize c i subject to a i b {0,1} for i = 1 to.
2 Coverig ad packig problems. I some selectio problems, each item is associated with a subset of a larger set. The larger set is usually referred to as the groud set. For example, suppose that there is a collectio of sets 5 1, ", 5 where for i = 1 to 5 i is a subset of the groud set {1, 2, 3, ", m}. Associated with each set 5 i is a cost C i. 1 if i S j 1 if set S j is selected Let a ij Let x j 0 otherwise. 0 otherwise. The set packig problem is the problem of selectig the maximum cost subcollectio of sets, o two of which share a commo elemet. The set Coverig problem is the problem of selectig the miimum cost subcollectio of sets, so that each elemet i E {1, 2, ", m} is i oe of the sets. Maximize c j x j=1 j subject to a x 1 for each i {1,...,m} Set Packig Problem j=1 ij j x j {0,1} for each j {1,...,}. Miimize c j x j=1 j subject to a x 1 for each i {1,...,m} Set Coverig Problem j=1 ij j x j {0,1} for each j {1,...,}. For example, cosider the followig map of the couties of Colorado. Figure 1. The couties of Colorado. Suppose that we wat to select a miimum cardiality subset C of couties such that each couty either was i C or shared a commo boudary with a couty i C. I this case, we would let
3 5 j = {j} U {i: couty i shares a boudary with couty j}. We let C j = 1 for each j. We would the solve the mi cost coverig problem. Here is a related problem. Select the largest subset CC of couties such that o two couties of CC share a commo border. We refer to this problem as P1. Although P1 is a set packig problem (as you shall soo see) it is ot the set packig problem defied o the sets S 1, S 2, ", S. To see why ot, cosider the followig example. Suppose that couty 1 bordered o couty 2, which bordered o couty 3, but that couties 1 ad 3 had o commo border. The oe ca iclude both couty 1 ad couty 3 i CC. But 2 E S 1 S 3, ad so it would ot be possible to select S 1 ad S 3 for the set packig problem. Problem P1 ca be formulated as follows: Maximize x j=1 j subject to + x j 1 wheever a ij = 1 (i.e., i S j ) Problem P1 x j {0,1} for each j {1,...,}. Sectio 2. Modular arithmetic. I this very brief sectio, we show how to costrai a variable x to be odd or eve, ad we show how to costrait x to be a mod(b). (That is, there is a iteger q such that a + qb = x.) I each case, we eed to add a ew variable w, where w 0 ad iteger. Costrait. IP Costrait s odd. x - 2w = 1. s eve. x - 2w = 0. x = a (mod b) x - bw = a. Table 1. Modular arithmetic formulatios. Sectio 3. Simple logical costraits. Here we address differet logical costraits that ca be trasformed ito iteger programmig costraits. I the first set, we describe the logical costraits i terms of selectio of items from a subset.
4 Logical Costrait. IP Costrait If item i is selected, the item j is also selected. - x j : 0 Either item i is selected or item j is selected, but ot both. + x j = 1 Item i is selected or item j is selected or both. If item i is selected, the item j is ot selected. + x j 1 + x j : 1 If item i is ot selected, the item j is ot selected. - +x j : 0 At most oe of items i, j, ad k are selected. + x j + x k : 1 At most two of items i, j, ad k are selected. + x j + x k : 2 Exactly oe of items i, j, ad k are selected. + x j + x k = 1 At least oe of items i, j ad k are selected. + x j + x k 1 Table 2. Simple costraits ivolvig two or three biary variables. Restrictig a variable to take o oe of several values. Suppose that we wated to restrict x to be oe of the elemets {4, 8, 13}. This is accomplished as follows. x = 4 w w w 3 w 1 + w 2 + w 3 = 1 w i E {0, 1} for i = 1 to 4. If we wated to restrict x to be oe of the elemets {0, 4, 8, 13}, it suffices to use the above formulatio with the equality costrait chaged to "w 1 + w 2 + w 3 : 1." Sectio 4. Other logical costraits, ad the big M method. Biary variables that are 1 whe a costrait is satisfied. We ext cosider biary variables that are defied to be 1 if a costrait is satisfied, ad 0 otherwise. I each case, we eed bouds o how much the costrait could be violated i a solutio that satisfies every other costrait of the problem. 1 if x 1 Example 1. w 0 if x = 0. I this example, s a iteger variable. Ad suppose that we kow s bouded above by 100. (We may kow the boud o x because it is oe of the costraits of the problem. We may also kow the boud of 100 o x because it is implied by oe or more of the other costraits. For example, suppose that oe of the costraits was "3x + 4y + w : 300." We could ifer from this costrait that 3x : 300 ad thus x : 100.
5 Equivalet costrait: w : x : 100w. w E {0,1}. I ay feasible solutio, the defiitio of w is correct. If x 1, the the first costrait is satisfied whether w = 0 or w = 1, ad the secod costrait forces w to be 1. If x = 0, the the first costrait forces w to be 0, ad the secod costrait is satisfied. Example 2. w = 1 if x 7 0 otherwise. Agai, we assume here that s a iteger variable, ad that s bouded above by 100. Equivalet costraits: x : 7-7(1-w) x : w w E {0,1}. I ay feasible solutio, the defiitio of w is correct. If x 7, the the first costrait is satisfied whether w = 0 or w = 1, ad the secod costrait forces w to be 1. If x : 6, the the first costrait forces w to be 0, ad the secod costrait is satisfied. Big M: example 1. w = 1 if x 7 0 otherwise. Here we assume that s a iteger variable that is bouded from above, but we doct specify the boud. Equivalet costraits: x : 7 - M(1-w) x : 6 + Mw w E {0,1}, where M is chose sufficietly large. I this way, we doct cocer ourselves with the value of the boud. We just write M. I fact, we could have writte 7 istead of M i the first costrait, ad it would have also bee valid. But writig big M meas ot havig to thik about the best boud. The disadvatage of this approach is that the ruig time of the iteger programmig algorithm may deped o the choice of M. Choosig M very large (e.g., M = 1 trillio) will lead to valid formulatios, but the overly large value of M may slow dow the solutio procedure. Big M: example 2. w = 1 if x a 0 otherwise. Here we assume that s a iteger variable that is bouded from above, but we doct specify the boud. Equivalet costraits: x : a - M(1-w) x : (a-1) + Mw w E {0,1},
6 where M is chose sufficietly large. I ay feasible solutio, the defiitio of w is correct. If x a, the the first costrait is satisfied whether w = 0 or w = 1, ad the secod costrait forces w to be 1. If x : a-1, the the first costrait forces w to be 0, ad the secod costrait is satisfied. 1 if x a Big M: example 3. w 0 otherwise. Here we assume that s a iteger variable that is bouded from above, but we doct specify the boud. Equivalet costraits: x 5 a - M(1-w) x (a+1) + Mw w E {0,1}, where M is chose sufficietly large. I the case that w depeds o a iequality costrait ivolvig more tha oe variable, the previous two trasformatios ca modified i a straightforward maer. 1 if a i b Big M: example 4. w = 0 otherwise. Here we assume that a i is iteger valued ad is bouded from above, but we doct specify the boud. Equivalet costraits: a i b + M (1 w). a i b +1 Mw. w {0,1}. I ay feasible solutio, the defiitio of w is correct. If a b,, the the first costrait is =1 i i satisfied whether w = 0 or w = 1, ad the secod costrait forces w to be 1. If a i b +1,, the the first costrait forces w to be 0, ad the secod costrait is satisfied. At least oe of three iequalities is satisfied. Suppose that we wated to model the logical costrait that at least oe of three iequalities is satisfied. For example,
7 x x2 + 2 x 4 7 or 3 x1-5 x 2 12 or 2 x 2 + x 3 6. We the create three ew biary variables w1, w2, ad w3 ad reformulate the above costrait as the followig system of logical, liear, ad iteger costraits. x 1 If w 1 = 1, the + 4x 2 + 2x 4 7. If w2 = 1, the 3x1-5x2 12. If w3 = 1, the 2x2 + x3 6. w1 + w2 + w3 1. w {0,1} for i = 1 to 3. i This above system of costraits is equivalet to the followig. x1 + 4x2 + 2x M(1- w1) 3x 1-5x M (1- w2) 2x2 + x3 6 - M(1- w3) w + w2 + w3 1. (Usig a equality would also be valid.) w i 1 {0,1} for i = 1 to 3. At least oe of two iequalities is satisfied. I the case of two iequalities, it suffices to create a sigle ew variable w. For example, suppose that we wat to satisfy the followig logical coditio. At least oe of the followig two costraits is satisfied: x1 + 4x 2 + 2x 4 7 or 3x 1-5x 12. This logical coditio is equivalet to: x1 + 4x x Mw 3x1-5x M(1- w) w {0, 1} 2 Sectio 5. Fixed costs Here we cosider a iteger program i which there are fixed costs o variables. For example, cosider the followig iteger program: Maximize f (x 1 ) + f 2 (x 2 ) + f 3 (x 3 ) subject to 2x 1 + 4x 2 + 5x x 1 + x 2 + x x 1 + 5x 2 + 2x ad iteger for i = 1 to 3. where 52x if x 1 if x 1 30x x if x3 f 1 ( x 1 ) f (x ) f (x ) 1 0 if x = 0, if x = 0, if x = 0 3.
8 The IP formulatio is as follows: Maximize 52x 1 500w x 2 400w x 3 300w 3 subject to 2x 1 + 4x 2 + 5x x 1 + x 2 + x x 1 + 5x 2 + 2x Mw i for i = 1 to 3 0 ad iteger for i = 1 to 3. The costrait : Mw i forces w i = 1 wheever > 0. The model may look icorrect because it permits the possibility that = 0 ad w i = 1. It is true that the IP model allows more feasible solutios tha it should. However, if = 0 i a optimal solutio, the w i = 0 as well because its objective value coefficiet is less tha 0. Because the iteger program gives optimal solutios, if = 0, the w i = 0. Sectio 6. Piecewise liear fuctios. Iteger programmig ca be used to model fuctios that are piecewise liear. For example, cosider the followig fuctio. 2f 0 x 3 y 9 f 4 x 7 5+ f 8 x 9. Oe ca model y i several differet ways. Here is oe of them. We first defie two ew variables for every piece of the curve. 1 if 0 x 3 f 0 x 3 w 1 x 1 0 otherwise. 0 otherwise. 1 if 4 x 7 f 4 x 7 w 2 x 2 0 otherwise. 0 otherwise. 1 if 8 x 9 f 8 x 9 w 3 x 3 0 otherwise. 0 otherwise.
9 We complete the model as follows. IP formulatio y = 2x 1 + 9w 2 - x 2-5w 3 + x 3 0 : x 1 : 3w 1 4w 2 : x 2 : 7w 2 8w 3 : x 3 : 9w 3 w 1 + w 2 + w 3 = 1 x = x 1 + x 2 + x 3 w i E {0, 1} for i = 1 to 3. For ay choice of w 1, w 2, ad w 3, the variables x ad y are correctly defied. Sectio 7. The travelig salesma problem I this sectio, we give the stadard model for the travelig salesma problem. It has a expoetial umber of costraits, which may seem quite uusual for a iteger programmig model. We explai how it ca be implemeted so as to be practical. We assume that there are cities, ad that C ij deotes the distace from city i to city j. I this model, the followig are the variables: j 1 if city i is immediately followed by city j o the tour 0 otherwise. The formulatio is as follows: Miimize c ij j j=1 subject to j = 1 for all i = 1 to j=1 j = 1 for all j = 1 to j 1 for all S {1,2,...,} with 1 S 1 i S, j N \S j {0,1}, for all i, j = 1 to. The first set of costraits esures that there is some city that follows city i i the solutio. The secod set of costraits esures that there is some city that precedes city j i the solutio.
10 Ufortuately, there are ot eough costraits to esure that the solutio is a tour. For example, a feasible solutio to the first two sets of costraits for the six city problem cosists of x 12 = x 23 = x 31 = 1, ad x 45 = x 56 = x 64 = 1. This "solutio" to the first two sets of costraits correspods to the cycles ad A tour should be oe cycle oly. The third set of costraits guaratees the followig. For ay o-empty subset 5 of cities with S, there must be some city ot i 5 that follows some city that is i 5. This set of costraits is kow as the subtour elimiatio Costraits. With all of the costraits listed above, every feasible solutio correspods to a tour. Implemetatio details. Suppose that oe wated to solve the liear programmig relaxatio of the TSP that is, we solve the problem obtaied from the above costraits if we drop the itegrality costraits, ad merely require that j 0 for each i ad j. (We woct deal with solvig the iteger program here.) We refer to this liear program as LP. At first it appears that there is o way of solvig LP for ay large values of, say > 100. For ay TSP istace with more tha 100 cities, there are more tha differet subtour elimiatio costraits. Listig all of the costraits would take more tha all of the computer memory i the etire world. Istead, LP is solved usig a "costrait geeratio approach." LP(0) is obtaied from LP by droppig all of the subtour elimiatio costraits. A optimal solutio x 0 is obtaied for LP(0). If x 0 is feasible for LP, the it is also optimal for LP. If ot, the some subtour elimiatio costrait that x 0 violates is idetified ad added to LP(0), resultig i LP(1). ItCs ot obvious how oe ca determie a subtour elimiatio costrait that is violated, but there are efficiet approaches for fidig a violated subtour elimiatio costrait. A optimal solutio x 1 is obtaied for LP(1). If x 1 is feasible for LP, the it is also optimal for LP. If ot, the some subtour elimiatio costrait that x 1 violates is idetified ad added to LP(1), resultig i LP(2). This process cotiues util there is a optimal solutio for LP(k) for some k that is feasible for LP ad hece optimal for LP. Or else, the solver takes so much time, that it is stopped before reachig optimality. I practice, the techique works quite well, ad fids a optimal solutio for LP i a short amout of time.
11 MIT OpeCourseWare Optimizatio Methods i Maagemet Sciece Sprig 2013 For iformatio about citig these materials or our Terms of Use, visit:
TEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationOptimization Methods: Linear Programming Applications Assignment Problem 1. Module 4 Lecture Notes 3. Assignment Problem
Optimizatio Methods: Liear Programmig Applicatios Assigmet Problem Itroductio Module 4 Lecture Notes 3 Assigmet Problem I the previous lecture, we discussed about oe of the bech mark problems called trasportatio
More informationLinear Programming and the Simplex Method
Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationSolutions for the Exam 9 January 2012
Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationsubject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2
Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables,
More informationLecture 20. Brief Review of Gram-Schmidt and Gauss s Algorithm
8.409 A Algorithmist s Toolkit Nov. 9, 2009 Lecturer: Joatha Keler Lecture 20 Brief Review of Gram-Schmidt ad Gauss s Algorithm Our mai task of this lecture is to show a polyomial time algorithm which
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More informationPolynomial Functions and Their Graphs
Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively
More informationRecursive Algorithm for Generating Partitions of an Integer. 1 Preliminary
Recursive Algorithm for Geeratig Partitios of a Iteger Sug-Hyuk Cha Computer Sciece Departmet, Pace Uiversity 1 Pace Plaza, New York, NY 10038 USA scha@pace.edu Abstract. This article first reviews the
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationHashing and Amortization
Lecture Hashig ad Amortizatio Supplemetal readig i CLRS: Chapter ; Chapter 7 itro; Sectio 7.. Arrays ad Hashig Arrays are very useful. The items i a array are statically addressed, so that isertig, deletig,
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationInduction: Solutions
Writig Proofs Misha Lavrov Iductio: Solutios Wester PA ARML Practice March 6, 206. Prove that a 2 2 chessboard with ay oe square removed ca always be covered by shaped tiles. Solutio : We iduct o. For
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationClassification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc)
Classificatio of problem & problem solvig strategies classificatio of time complexities (liear, arithmic etc) Problem subdivisio Divide ad Coquer strategy. Asymptotic otatios, lower boud ad upper boud:
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationAlgebraic Geometry I
6.859/15.083 Iteger Programmig ad Combiatorial Optimizatio Fall 2009 Lecture 14: Algebraic Geometry I Today... 0/1-iteger programmig ad systems of polyomial equatios The divisio algorithm for polyomials
More informationSupport vector machine revisited
6.867 Machie learig, lecture 8 (Jaakkola) 1 Lecture topics: Support vector machie ad kerels Kerel optimizatio, selectio Support vector machie revisited Our task here is to first tur the support vector
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More information(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?
MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationQuestion 1: The magnetic case
September 6, 018 Corell Uiversity, Departmet of Physics PHYS 337, Advace E&M, HW # 4, due: 9/19/018, 11:15 AM Questio 1: The magetic case I class, we skipped over some details, so here you are asked to
More informationINFINITE SEQUENCES AND SERIES
INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES I geeral, it is difficult to fid the exact sum of a series. We were able to accomplish this for geometric series ad the series /[(+)]. This is
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 12
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract I this lecture we derive risk bouds for kerel methods. We will start by showig that Soft Margi kerel SVM correspods to miimizig
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More information3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials
Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered
More informationsin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n =
60. Ratio ad root tests 60.1. Absolutely coverget series. Defiitio 13. (Absolute covergece) A series a is called absolutely coverget if the series of absolute values a is coverget. The absolute covergece
More informationCSE 1400 Applied Discrete Mathematics Number Theory and Proofs
CSE 1400 Applied Discrete Mathematics Number Theory ad Proofs Departmet of Computer Scieces College of Egieerig Florida Tech Sprig 01 Problems for Number Theory Backgroud Number theory is the brach of
More informationThe Ratio Test. THEOREM 9.17 Ratio Test Let a n be a series with nonzero terms. 1. a. n converges absolutely if lim. n 1
460_0906.qxd //04 :8 PM Page 69 SECTION 9.6 The Ratio ad Root Tests 69 Sectio 9.6 EXPLORATION Writig a Series Oe of the followig coditios guaratees that a series will diverge, two coditios guaratee that
More informationProperties and Tests of Zeros of Polynomial Functions
Properties ad Tests of Zeros of Polyomial Fuctios The Remaider ad Factor Theorems: Sythetic divisio ca be used to fid the values of polyomials i a sometimes easier way tha substitutio. This is show by
More informationGenerating subtour elimination constraints for the Traveling Salesman Problem
IOSR Joural of Egieerig (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vol. 08, Issue 7 (July. 2018), V (I) PP 17-21 www.iosre.org Geeratig subtour elimiatio costraits for the Travelig Salesma Problem
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationInteger Programming (IP)
Iteger Programmig (IP) The geeral liear mathematical programmig problem where Mied IP Problem - MIP ma c T + h Z T y A + G y + y b R p + vector of positive iteger variables y vector of positive real variables
More informationMathematical Induction
Mathematical Iductio Itroductio Mathematical iductio, or just iductio, is a proof techique. Suppose that for every atural umber, P() is a statemet. We wish to show that all statemets P() are true. I a
More informationLinear Support Vector Machines
Liear Support Vector Machies David S. Roseberg The Support Vector Machie For a liear support vector machie (SVM), we use the hypothesis space of affie fuctios F = { f(x) = w T x + b w R d, b R } ad evaluate
More informationChapter 9: Numerical Differentiation
178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical
More information1 Hash tables. 1.1 Implementation
Lecture 8 Hash Tables, Uiversal Hash Fuctios, Balls ad Bis Scribes: Luke Johsto, Moses Charikar, G. Valiat Date: Oct 18, 2017 Adapted From Virgiia Williams lecture otes 1 Hash tables A hash table is a
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More informationMA131 - Analysis 1. Workbook 3 Sequences II
MA3 - Aalysis Workbook 3 Sequeces II Autum 2004 Cotets 2.8 Coverget Sequeces........................ 2.9 Algebra of Limits......................... 2 2.0 Further Useful Results........................
More information10.6 ALTERNATING SERIES
0.6 Alteratig Series Cotemporary Calculus 0.6 ALTERNATING SERIES I the last two sectios we cosidered tests for the covergece of series whose terms were all positive. I this sectio we examie series whose
More informationBertrand s Postulate
Bertrad s Postulate Lola Thompso Ross Program July 3, 2009 Lola Thompso (Ross Program Bertrad s Postulate July 3, 2009 1 / 33 Bertrad s Postulate I ve said it oce ad I ll say it agai: There s always a
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More informationCS 270 Algorithms. Oliver Kullmann. Growth of Functions. Divide-and- Conquer Min-Max- Problem. Tutorial. Reading from CLRS for week 2
Geeral remarks Week 2 1 Divide ad First we cosider a importat tool for the aalysis of algorithms: Big-Oh. The we itroduce a importat algorithmic paradigm:. We coclude by presetig ad aalysig two examples.
More informationLast time, we talked about how Equation (1) can simulate Equation (2). We asserted that Equation (2) can also simulate Equation (1).
6896 Quatum Complexity Theory Sept 23, 2008 Lecturer: Scott Aaroso Lecture 6 Last Time: Quatum Error-Correctio Quatum Query Model Deutsch-Jozsa Algorithm (Computes x y i oe query) Today: Berstei-Vazirii
More informationLecture 9: Hierarchy Theorems
IAS/PCMI Summer Sessio 2000 Clay Mathematics Udergraduate Program Basic Course o Computatioal Complexity Lecture 9: Hierarchy Theorems David Mix Barrigto ad Alexis Maciel July 27, 2000 Most of this lecture
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationDisjoint set (Union-Find)
CS124 Lecture 7 Fall 2018 Disjoit set (Uio-Fid) For Kruskal s algorithm for the miimum spaig tree problem, we foud that we eeded a data structure for maitaiig a collectio of disjoit sets. That is, we eed
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More information18.657: Mathematics of Machine Learning
8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 0 Scribe: Ade Forrow Oct. 3, 05 Recall the followig defiitios from last time: Defiitio: A fuctio K : X X R is called a positive symmetric
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationRank Modulation with Multiplicity
Rak Modulatio with Multiplicity Axiao (Adrew) Jiag Computer Sciece ad Eg. Dept. Texas A&M Uiversity College Statio, TX 778 ajiag@cse.tamu.edu Abstract Rak modulatio is a scheme that uses the relative order
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More information2.4 - Sequences and Series
2.4 - Sequeces ad Series Sequeces A sequece is a ordered list of elemets. Defiitio 1 A sequece is a fuctio from a subset of the set of itegers (usually either the set 80, 1, 2, 3,... < or the set 81, 2,
More informationLecture 23 Rearrangement Inequality
Lecture 23 Rearragemet Iequality Holde Lee 6/4/ The Iequalities We start with a example Suppose there are four boxes cotaiig $0, $20, $50 ad $00 bills, respectively You may take 2 bills from oe box, 3
More informationThe multiplicative structure of finite field and a construction of LRC
IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio
More informationROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND
Pacific-Asia Joural of Mathematics, Volume 5, No., Jauary-Jue 20 ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND SHAKEEL JAVAID, Z. H. BAKHSHI & M. M. KHALID ABSTRACT: I this paper, the roll cuttig problem
More informationIntroduction to Machine Learning DIS10
CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationInteger Linear Programming
Iteger Liear Programmig Itroductio Iteger L P problem (P) Mi = s. t. a = b i =,, m = i i 0, iteger =,, c Eemple Mi z = 5 s. t. + 0 0, 0, iteger F(P) = feasible domai of P Itroductio Iteger L P problem
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationMath 113, Calculus II Winter 2007 Final Exam Solutions
Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this
More informationSeptember 2012 C1 Note. C1 Notes (Edexcel) Copyright - For AS, A2 notes and IGCSE / GCSE worksheets 1
September 0 s (Edecel) Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright
More information2.4 Sequences, Sequences of Sets
72 CHAPTER 2. IMPORTANT PROPERTIES OF R 2.4 Sequeces, Sequeces of Sets 2.4.1 Sequeces Defiitio 2.4.1 (sequece Let S R. 1. A sequece i S is a fuctio f : K S where K = { N : 0 for some 0 N}. 2. For each
More informationSNAP Centre Workshop. Basic Algebraic Manipulation
SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationSubject: Differential Equations & Mathematical Modeling-III
Power Series Solutios of Differetial Equatios about Sigular poits Subject: Differetial Equatios & Mathematical Modelig-III Lesso: Power series solutios of differetial equatios about Sigular poits Lesso
More informationChapter 6 Overview: Sequences and Numerical Series. For the purposes of AP, this topic is broken into four basic subtopics:
Chapter 6 Overview: Sequeces ad Numerical Series I most texts, the topic of sequeces ad series appears, at first, to be a side topic. There are almost o derivatives or itegrals (which is what most studets
More informationThe Binomial Theorem
The Biomial Theorem Robert Marti Itroductio The Biomial Theorem is used to expad biomials, that is, brackets cosistig of two distict terms The formula for the Biomial Theorem is as follows: (a + b ( k
More informationRecitation 4: Lagrange Multipliers and Integration
Math 1c TA: Padraic Bartlett Recitatio 4: Lagrage Multipliers ad Itegratio Week 4 Caltech 211 1 Radom Questio Hey! So, this radom questio is pretty tightly tied to today s lecture ad the cocept of cotet
More informationIn algebra one spends much time finding common denominators and thus simplifying rational expressions. For example:
74 The Method of Partial Fractios I algebra oe speds much time fidig commo deomiators ad thus simplifyig ratioal epressios For eample: + + + 6 5 + = + = = + + + + + ( )( ) 5 It may the seem odd to be watig
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationSection 5.1 The Basics of Counting
1 Sectio 5.1 The Basics of Coutig Combiatorics, the study of arragemets of objects, is a importat part of discrete mathematics. I this chapter, we will lear basic techiques of coutig which has a lot of
More information