An Algebraic Approach to Constraint Satisfaction Problems

Size: px
Start display at page:

Download "An Algebraic Approach to Constraint Satisfaction Problems"

Transcription

1 An Algebrac Approach to Constrant Satsfacton Problems Igor Rvn Wolfram Research, Inc. Champagn, Illnos Ramn Zabh Computer Scence Department Stanford Unversty Stanford, Calforna Abstract A constrant satsfacton problem, or CSP, can be reformulated as an nteger lnear programmng problem. The reformulated problem can be solved va polynomal multplcaton. If the CSP has n varables whose doman sze s m, and f the equvalent programmng problem nvolves M equatons, then the number of solutons can be determned n tme Onm2 M n ). Ths surprsng lnk between search problems and algebrac technques allows us to show mproved bounds for several constrant satsfacton problems, ncludng new smply exponental bounds for determnng the number of solutons to the n-queens problem. We also address the problem of mnmzng M for a partcular CSP. 1 Introducton We are nterested n solvng certan search problems that arse n combnatorcs and n artfcal ntellgence. These problems are called Constrant Satsfacton Problems CSP s), and nclude such famlar tasks as graphcolorng and the n-queens problem. Typcally, such problems are solved va exhaustve search. We propose an alternatve method, based on convertng the CSP nto an nteger lnear programmng problem, whch can be solved va polynomal multplcaton. In secton 2 we descrbe constrant satsfacton problems and show how they can be converted nto nteger lnear programmng problems. We descrbe how to solve nteger lnear programmng problems va polynomal multplcaton n secton 3, and analyze the tme requrements of ths approach. In secton 4 we gve an example of our method, applyng t to the n-rooks problem, and show some surprsng smlartes wth standard search technques. In secton 5 we address the problem of fndng a good nteger lnear programmng equvalent of a CSP, whle n secton 6 we descrbe some extensons to our technques. Fnally, n secton 7, we derve new smply exponental bounds for the n-queens problem and the torodal n-queens problem. 2 CSP s and nteger lnear programmng 2.1 Constrant satsfacton problems Formally, a CSP has a set of varables and a doman of values, V = {v 1,v 2,...,v n } the set of varables, D = {d 1,d 2,...,d m } the set of values. Every varable x must be assgned a value d j ; such an assgnment wll be denoted v d j. A CSP also conssts of some constrants sayng whch assgnments of values to varables are compatble. We wll restrct our attenton to bnary CSP s, where the constrants nvolve only two varables. Ths s partly for smplcty, and partly because a non-bnary CSP can be converted nto a bnary CSP by the ntroducton of addtonal varables.) A soluton to the constrant satsfacton problem s an n-tuple of assgnments that satsfes all the constrants. There are several ways to formulate the task of solvng a CSP. The satsfablty problem s to determne the exstence of a soluton to a CSP. The countng problem s to determne the number of solutons. The enumeraton problem s to fnd all solutons. The countng problem s a specal case of the enumeraton problem, and the satsfablty problem s a specal case of the countng problem. Snce many NP-complete problems, such as graphcolorng, are CSP s, the satsfablty problem s easly seen to be NP-complete [Garey and Johnson, 1979]. We therefore cannot expect to solve the satsfablty, countng or enumeraton problems n polynomal tme. Typcal CSP soluton technques lke those surveyed n [Mackworth, 1987] perform an exhaustve search, backtrackng

2 through all n-tuples of assgnments. Whle these methods add some addtonal cleverness beyond brute-force search, ther worst-case runnng tme s stll Om n ). We wll concentrate on solvng the countng problem and therefore the satsfablty problem as well). Whle our methods are easly extended to the enumeraton problem see secton 6.1), our approach to the countng problem s surprsngly smple to analyze. In fact, we can do provably better than backtrack search for some problems, n the followng sense. Backtrackng counts the number of solutons by enumeratng them, and hence must take at least as much tme as the number of solutons. Our technques can determne the number of solutons wthout actually enumeratng them, so the number of solutons s not a lower bound on our runnng tme. 2.2 Convertng CSP s nto nteger lnear programmng problems Our basc approach s to turn a CSP nto an nteger lnear programmng problem. For every possble assgnment v d j we ntroduce a varable x,j. Then for every CSP varable v we have an equaton 1 j m x,j =1. 1) Ths expresses the fact that every CSP varable has exactly one value. In addton, for every set of assgnments that the constrants prohbt, we have an nequalty whch states that no more than one of these assgnments can hold at once. For example, f the par of assgnments {v d j,v k d l } s forbdden by the constrants, we wll have the nequalty x,j + x k,l 1. 2) Now consder the problem of fndng all solutons to the equatons of the form 1) and 2) over the non-negatve ntegers. It s clear that any soluton wll assgn every varable x,j ether 0 or 1.) Ths s an nteger lnear programmng problem, whch corresponds to the orgnal CSP. There are nm varables x,j, and a soluton to the set of equatons wth x,j = 1 corresponds to a soluton to the CSP contanng the assgnment v d j. 3 Solvng CSP s by multplyng polynomals An nteger lnear programmng problem s a set of lnear Dophantne nequaltes. We can use an approach based on generatng functons to determne the number of solutons. Ths nvolves multplyng out a certan polynomal, and gves us a way of solvng the orgnal CSP. 3.1 Solvng lnear Dophantne equatons A set of M lnear Dophantne equaton n N unknowns has the form N w,j x j = s, =1,...,M. 3) The x j s are the unknowns, and the w,j s and s s are non-negatve ntegers. The problem at hand s to determne the number of solutons over the non-negatve ntegers. Consder the generatng functon ΦY 1,...,Y M )= N 1 1 ). 4) M =1 Y w,j The formal parameters of ths functon are the varables Y 1,...,Y M, and on such varable s assocated wth each equaton. We need one non-trval bt of mathematcs: the number of solutons to equaton 3) s the coeffcent of M Y s 5) =1 n Φ. Ths fact was proved n [Euler, 1748], and s dscussed n [Schrjver, 1986, pages ].) 3.2 Applcatons to nteger lnear programmng Now consder the nteger lnear programmng problem correspondng to a CSP. Every w,j wll be ether 0 or 1. Assume for the moment that all the equatons are of the form 1), hence s = 1. We wll relax ths restrcton shortly.) We can count the number of solutons by fndng the coeffcent of the monomal Y = Y 1 Y 2 Y M n Φ. We apply the dentty 1 1 x = k=0 x k to equaton 4), gvng N M ΦY 1,...,Y M )= 1+ k=1 =1 Y w,j ) k. 6) We can further smplfy ths f we remember that we are only nterested n the coeffcent of Y. We can therefore gnore any term dvsble by the square of any Y terms that are not so dvsble are called square free). By a slght abuse of notaton we wll refer to the square free part of the generatng functon as Φ. We next note that M M k=1 =1 Y w,j ) k = =1 Y w,j + other terms,

3 where these latter terms are not square free and so can be dscarded. Ths gves us an expresson for Φ as a product of bnomals, namely ) N M ΦY 1,...,Y M )= 1+. 7) =1 Y w,j All we need do n order to fnd the number of solutons to the system of equatons s compute the coeffcent of Y n equaton 7). The obvous way to solve ths problem s to smply multply out Φ and look at the correct term of the result. We can do ths teratvely: we multply the frst two bnomals of Φ and throw away the terms that are not square free, then repeat wth the next bnomal, etc. We can now relax our assumpton that all the equatons are of the form 1). Suppose that nstead we have exactly one Dophantne nequalty x,j 1. 8) 1 j m Ths mplctly defnes two equaltes, one of whch has 0 on the rght hand sde, and one of whch has 1. The number of solutons to the nequalty s the sum of the number of solutons to the two mplct equaltes. At frst glance, t would seem that solvng a system wth α nequaltes would requre solvng 2 α mplct systems of equaltes. However, a closer look at the generatng functon shows that we only need to solve one of these mplct systems. Suppose that we replace each nequalty wth an equalty that has a 1 on the rght hand sde and examne the square free part of Φ. The number of solutons to each of the 2 α mplct systems of equaltes wll be the coeffcent of the approprate term of Φ. For example, suppose that there are three equatons Y 0, Y 1 and Y 2, and one nequalty ϕ 1, 9) where ϕ s a sum. The nequalty 9) mplctly asserts ϕ =0 9.0) or ϕ =1. 9.1) The number of solutons to the orgnal system whch ncluded 9)) s the sum of the number of solutons when 9) s replaced by 9.0) plus the number of solutons when 9) s replaced by 9.1). However, suppose that we smply replace 9) by 9.1) and calculate Φ. Let Y 3 be the generatng functon varable assocated wth 9.1). The number of solutons s the coeffcent of Y 0 Y 1 Y 2 Y 3 n Φ. However, the number of solutons when 9) s replaced by 9.0) s also part of Φ, namely the coeffcent of Y 0 Y 1 Y 2. We thus do not need to calculate separate generatng functons for both systems of equaltes mplctly defned by 9). We can smply replace the nequalty by an equalty wth 1 on the rght hand sde and calculate Φ. At the end, we add together coeffcents for the mplct systems of equaltes to determne the number of solutons to the orgnal problem. To summarze, we can replace the α nequaltes wth equaltes and calculate the square free part of Φ. The total number of solutons wll no longer be the coeffcent of Y, but rather the sum of 2 α coeffcents of dfferent terms. Ths justfes our earler assumpton that the nteger lnear programmng problem conssted entrely of equaltes of the form 1). 3.3 Tme requrements The tme requred to solve the CSP s the tme to multply out the polynomal Φ. We can do ths n N teratons, where on each teraton we multply a bnomal by a polynomal that represents the product thus far. Two polynomals can be multpled n tme proportonal to the product of ther sze, so we need to bound the sze of the ntermedate results. Navely, there could be as many as N M terms, snce there are MY s, and the degree of each one s potentally as hgh as N. However, remember that at each stage we wll dscard all the terms that are not square free. In algebrac termnology, ths s descrbed as dong the computaton over the polynomal rng Z[Y 1,...,Y M ]/Y1 2,...,Y2 M ) nstead of Z[Y 1,...,Y M ].) Ths gves a better bound on the number of terms. Every Y wll have degree 0 or 1, hence there are no more than 2 M terms. Summarzng, f we compute Φ teratvely we wll do N multplcatons, where each multplcaton computes the product of a bnomal and a polynomal wth no more than 2 M terms. Each multplcaton wll take tme 2 M+1, whch s O2 M ). Ths puts a bound of ON2 M ) on the total tme complexty of our algorthm. 1 We wll show n secton 6.2 how to reduce the exponent to M n n the worst case. It s worth notng that we cannot expect to fnd a polynomal tme method for determnng the value of an arbtrary coeffcent of Φ. [Schrjver, 1986] proved that nteger lnear programmng s NP-complete even when the coeffcents nvolved are restrcted to be 0 or 1. 4 An example of our approach The n-rooks problem conssts of placng n rooks on an n-by-n chessboard so no two rooks attack each other. 1 Ths analyss gnores the tme requred for scalar multplcaton. We can take ths nto account by notng that the sze of the coeffcents wll be bounded by M N, hence ther length s ON log M). So the scalar multplcaton can be done n tme ON log M logn log M) log logn log M)) [Aho et al., 1974].

4 Whle t s clear that the solutons to ths problem are the n! permutatons of n elements, ths problem has a partcularly smple encodng as an nteger lnear programmng problem, and s therefore a useful example of our approach. There are n 2 assgnments v d j for ths CSP, so we wll convert t nto a programmng problem wth n 2 varables x,j. There wll be 2n equatons. 2 The equatons specfy that there s exactly one rook n each row and each column. A typcal equaton s x 2,1 + x 2, x 2,n =1, 10) whch encodes the fact that there s exactly one rook n the 2nd column. We can number these 2n equatons so that equaton says that there s exactly one rook n the th column, and equaton n+ says that there s exactly one rook n the th row. The formal parameter Y of the generatng functon corresponds to the th constrant equaton. Applyng equaton 7), Φ s a product of n 2 bnomals. There wll be one bnomal for every square on the chessboard, and the bnomal for the square n row and column j wll be 1 + Y n+ Y j ). The number of solutons s the coeffcent of Y = Y 1 Y n Y n+1 Y 2n n the expanson of Φ. Surprsngly, there s a way of multplyng out Φ that corresponds closely to backtrack search. Suppose that we attempt to fnd all combnatons of bnomal terms whose product s Y. We can start by pckng the second.e., non-constant) term of 1 + Y n+ Y j ). Ths forces us to pck the frst constant) term of every bnomal whose second term ncludes ether Y n+ or Y j, to ensure the product s square free. Now we can pck the non-constant term of some other bnomal and contnue, untl we have produced Y. The number of such combnatons wll be the coeffcent of Y n the expanson of Φ. It s also possble that the combnaton of terms selected guarantees that no selecton of terms from the remanng bnomals wll produce Y. The smplest example of ths occurs when a term has been selected from all but one bnomal wthout producng Y, where the remanng bnomal s non-constant term does not contan the mssng Y. Ths phenomenon, whch does not occur n the n-rooks problem, wll be used to mprove our performance guarantee n secton 6.2.) Ths whole process corresponds closely to a smple search of the orgnal CSP. Choosng the non-constant term of the bnomal 1 + Y n+ Y j ) places a rook on the equvalent square, whle choosng the constant term means there s no rook on that square. The process 2 In secton 5 we wll dscuss how to fnd good encodngs. descrbed above corresponds to placng a rook on the chessboard square n row and column j, and thus ensurng there s no rook n any other square n that row or column. At the end, we wll have satsfed every constrant and produced a soluton. The alternatve outcome, where we cannot satsfy every constrant, corresponds to a falure n backtrack search. Note that the expanson of Φ does not explctly represent the solutons. In fact, whch assgnments consttute a partcular soluton s lost by ths approach, as the dentty of the bnomals s not recorded. We wll show how to explctly represent solutons n secton 6.1. However, the fact that solutons are not explctly represented s an advantage of our approach, as the number of solutons s no longer a lower bound to our runnng tme. Applyng the analyss of secton 3.3, for ths problem we have N = n 2 and M =2n, so our runnng tme s On 2 4 n ). Ths s sgnfcantly smaller than n!, the number of solutons, whch s about 4 On log n). We have just descrbed a correspondence between a way to compute the coeffcent of Y n the expanson of Φ and a smple search technque for solvng the orgnal CSP. However, searchng all the combnatons of bnomal terms s not our ntended method. We beleve t would be better to multply Φ out teratvely, as descrbed earler. Whle ths does not correspond n any obvous way to applyng backtrack search to the orgnal problem, t does seem to have some smlarty to breadth-frst technques. It may thus be susceptble to parallel mplementaton technques lke those descrbed n [Dxon and de Kleer, 1988]. 5 Fndng a good encodng A potental dffculty wth our approach s that the runnng tme s exponental n M, the number of equatons needed to encode the CSP. There can be many such encodngs, and t s mportant to be able to fnd a good one. Clearly M must be at least n, as there s an equaton of the form 1) for each CSP varable. The remanng equatons come from the constrants. The problem s to fnd a way of encodng the constrants as small number of equatons. In the smplest encodng, there s an equaton lke 9) for every par of assgnments that the constrants rule out. However, ths can be qute a lot of equatons, as the followng example llustrates. In the case where all pars of assgnments are ruled out ths wll result n n 2 m 2 equatons, whle, as we wll see, there s an encodng that results n only 1 equaton. Let us defne the assgnment graph correspondng to a partcular CSP. The nodes of the assgnment graph represent assgnments, and there s an edge between two nodes f ther assgnments are ruled out by the constrants. A clque C n ths graph corresponds to a set of parwse ncompatble assgnments. The transformaton descrbed n secton 2.2 wll produce a varable x,j for

5 every node, and wll use n 2) equatons, wth the equaton x,j + x k,l 1 expressng the fact that these two assgnments are ncompatble. However, we can descrbe the fact that all the assgnments n C are parwse ncompatble wth the sngle equaton x,j + x k,l }{{} C So we really only need one equaton for every clque. If all pars of assgnments are ncompatble, the entre assgnment graph s a clque, and so the constrants can be represented wth 1 equaton nstead of needng n 2 m 2. For the n-queens problem, the assgnment graph has a node for each square on the chessboard. Two nodes are connected f queens on the two correspondng squares would attack each other. The maxmal clques correspond to the columns, rows, dagonals and antdagonals of the chessboard. We can therefore reduce the sze of M by encodng every clque as a sngle equaton. In an optmal encodng, M can be as small as the sze of the smallest coverng by clques of the assgnment graph. Because the problem of coverng a graph by clques s NP-complete [Garey and Johnson, 1979], fndng an optmal encodng would take exponental tme. For specal cases lke the chessboard problems descrbed above, t s easy to fnd an optmal encodng, but n general we would have to settle for a sub-optmal encodng. It s also possble to phrase the problem as fndng a small vertex cover for the assgnment graph, and ths can also reduce M. 5.1 Whch CSP s have good encodngs? One obvous queston s whether there s a better characterzaton of the CSP s that have good encodngs. Whle we do not have a very good answer to ths queston, an observaton due to Bob Floyd suggests that there may be a relatonshp between the number of solutons to the CSP and the smallest possble value for M. Floyd has ponted out that a soluton to the CSP corresponds to an n-clque n the complement of the assgnment graph equvalently, an ndependent set of sze n n the assgnment graph). It s possble that work n combnatorcs wll produce a relatonshp between the number of ndependent sets of fxed sze n a graph and the sze of the smallest vertex cover. Such a relatonshp would produce a characterzaton of the CSP s where our algorthm can be expected to work well, n terms of the number of solutons. 6 Some extensons The method descrbed above reles on multplyng out the polynomal Φ defned n equaton 7). A smple modfcaton to Φ allows us to solve the enumeraton problem nstead of the countng problem. It s also possble to reduce the runnng tme of our algorthm by carefully arrangng the order n whch the bnomals comprsng Φ are multpled out. 6.1 Solvng the enumeraton problem Suppose that nstead of determnng the number of solutons to our CSP, we are nterested n enumeratng these solutons. We can stll convert the CSP nto an nteger lnear programmng problem, and solve t va polynomal multplcaton. The only dfference s that we now need to consder a slghtly dfferent functon than Φ. Recall that we start by convertng our CSP nto a set of equatons n N = mn varables, one varable per assgnment v d j. Let us ntroduce N dfferent varables α j,1 j N. Now consder a slght varaton of Φ, namely ) N M Φ 1 = 1+α j. 11) =1 Y w,j We can solve the enumeraton problem by determnng the coeffcent of Y n the expanson of Φ 1, just as we dd wth Φ. Suppose we multply out Φ 1 by selectng terms from dfferent bnomals. The α j s wll keep track of whch bnomals had ther non-constant sde selected. When we have a soluton, the coeffcent of Y wll the product of a number of the α j s, whch wll encode a soluton. When Φ 1 s multpled out completely teratvely or otherwse), the coeffcent of Y wll not be an nteger, but rather the sum of a number of dfferent products of α j s. Every such product s a soluton to the CSP, and all solutons appear as such products. 6.2 Reducng the runnng tme An observaton due to John Lampng can be used to reduce the runnng tme of our algorthm from Onm2 M ) to Onm2 M n ). Suppose that before we multply out Φ we frst try to dentfy a subset S of the bnomals comprsng Φ and a varable Y such that Y never appears outsde of the bnomals n S, and some other varable Y does not appear n S. If we had such an S and Y, we could effectvely reduce the number of varables by 1. We can do ths by frst computng the product of the bnomals n S. Ths can be grouped nto terms based on the hghest power of Y that dvdes each term S = S 0 + YS 1 + Y 2 S 2... where S s not dvsble by Y, and as usual we can dscard the non square free terms. If Y s contaned n the coeffcents) correspondng to solutons to the CSP, then we can replace S by S 1. We can then forget about Y,as t never appears n the remanng part of Φ. Snce Y dd

6 not appear n S, ths reduces the number of varables by 1. Reducng the number of varables reduces the runnng tme of our algorthm as well, whch s exponental n the number of varables. It turns out that we are guaranteed that there exst at least n such pars of S s and Y s. Ths enables us to reduce the number of varables from M to M n, whch n turn reduces our runnng tme to Onm2 M n ). There are n such S and Y pars because the encodng of a CSP wll have a sngle equaton for each CSP varable, representng the fact that the varable must be assgned exactly one value. 3 Let Y correspond to the equaton whch constrans the CSP varable v to have exactly one value, and consder the bnomals n Φ that contan Y. These are exactly the bnomals that correspond to possble values for v, so there can be only m of them. Furthermore, ths set of bnomals forms an approprate S, snce no Y correspondng to another CSP varable can appear. There are n such Y s, one per CSP varable, and these Y s wll always appear n the coeffcents) that we need to calculate. It s even possble to take advantage of such S s and Y s when Y does not necessarly appear n the requred coeffcents. Recall that ths s a result of the nteger lnear programmng equaton that corresponds to Y actually representng an nequalty, as dscussed at the end of secton 3.2.) If ths happens, we can replace S by S 0 + S 1 and stll dscard Y. Ths has the effect of summng the coeffcents that stand for the solutons to the two mplct systems of equaltes early n the computaton, rather than watng to multply Φ out before calculatng ths sum. We can thus reduce the number of varables by at least n. As we saw n secton 4, each bnomal corresponds to a possble assgnment v d j. The orderng that s guaranteed to reduce the number of varables by n corresponds to consderng all the assgnments for a fxed v before movng on to the next CSP varable. On the n-queens problem ths s equvalent to multplyng out the bnomals n row-major order. 7 Some new bounds An addtonal advantage of our approach s that we can produce non-trval upper bounds for solvng certan constrant satsfacton problems. So far, we have confned out attenton to CSP s based on placng peces on a chessboard. The classc such problem s the n-queens problem, whch was known to Gauss. The n-queens problem conssts of placng n queens on an n-by-n chessboard so that no two queens attack. A varaton of ths problem s the torodal n-queens problem, where lnes of attack between 3 An encodng that does not have ths property corresponds to a CSP whose unsatsfablty can be easly detected va arc consstency [Mackworth, 1977]. queens are consdered to wrap as f the board were a torus. The torodal n-queens problem has strctly fewer solutons than the regular) n-queens problem. To our knowledge there s no known bound for CSP search algorthms for ths problem, beyond the trval bound of n n. In fact, there s some evdence that the number of solutons to the torodal problem and hence to the regular problem) s larger than exponental [Rvn and Vard, 1989]. The torodal n-queens problem can be formulated as a smple set of equatons. There are n 2 varables x j. There are also 4n equatons, one for each column, row, dagonal top to bottom) and ant-dagonal. So we have M =4n, N = n 2. Applyng the above results, our algorthm can determne the number of solutons n tme On 2 8 n ). For the regular n-queens problem, agan N = n 2, but ths tme there are 22n 1) nequaltes for the dagonals. Ths gves us M =6n 2, and a runnng tme of On 2 32 n ). However, f we do the multplcaton n row-major order, t turns out that only 3n varables wll need to be actve at once. Ths can be seen by notng that the top row nvolves 3n constrants. Movng to the next row adds a new row constrant and removes the old row constrant. The far left square of the new row elmnates an antdagonal constrant all the squares nvolved n that constrant have been elmnated), and adds a new dagonal constrant, whle the far rght square elmnates a dagonal constrant and adds a new antdagonal constrant. Ths gves us a much better bound of On 2 8 n ). Our prelmnary experments wth ths algorthm have been promsng. 8 Conclusons We have shown a surprsng connecton between solvng search problems and multplyng certan polynomals. The performance s very smple to analyze, and we can show new bounds for several constrant satsfacton problems. Our approach also holds our the possblty of applyng sophstcated algebrac technques to constrant satsfacton problems. For example, t s possble that the coeffcent of Y n Φ can be estmated, thus provdng an approxmate count of the number of solutons. Also, complex mathematcal results lke those n [Anshel and Goldfeld, 1988] can be used to provde an upper bound on the number of solutons by studyng the generatng functon drectly, usng the theory of modular forms. Our algorthm also shares some surprsng propertes wth Sedel s method [Sedel, 1981]. Lke Sedel, we produce a method whch s easy to analyze, and whch gves a bound that s exponental n a certan parameter of the problem. Sedel s parameter f s a property of the topology of the constrant graph, whch can be shown to be O n) for planar graphs. Our parameter M s a property of the way the problem gets encoded as an n-

7 teger lnear programmng problem, whch can be shown to be lnear for varants of the n-queens problem. Sedel faces the problem of makng f small, whch n general requres exponental tme. Smlarly, we face the problem of makng M small, whch requres solvng an NP-hard problem nvolvng graph clques. The smlartes between our algorthm and Sedel s, as well as Lampng s observaton descrbed n secton 6.2, suggest that our algorthm may be vewed as dynamc programmng. We are currently explorng ths possblty [Rvn and Zabh, 1989]. [Schrjver, 1986] Alexander Schrjver. Theory of Lnear and Integer Programmng. John Wley and Sons, [Sedel, 1981] Ramund Sedel. A new method for solvng constrant satsfacton problems. In Proceedngs of IJCAI-81, Vancouver, BC, pages , August Acknowledgements We are ndebted to John Lampng and Ilan Vard for useful suggestons. Support for ths research was provded by DARPA under contract number N C Ramn Zabh s supported by a fellowshp from the Fanne and John Hertz foundaton. References [Aho et al., 1974] Alfred Aho, John Hopcroft, and Jeffrey Ullman. The Desgn and Analyss of Computer Algorthms. Addson-Wesley, [Anshel and Goldfeld, 1988] Mchael Anshel and Doran Goldfeld. Applcatons of the Hardy-Ramanujan partton theory to lnear Dophantne equatons. Unpublshed pre-prnt, [Dxon and de Kleer, 1988] Mke Dxon and Johan de Kleer. Massvely parallel assumpton-based truth mantenance. In Proceedngs of AAAI-88, St. Paul, MN, pages Amercan Assocaton for Artfcal Intellgence, Morgan Kaufmann, August [Euler, 1748] L. Euler. Introducto Analysn Infnstorum, vol. 1. M. M Bousquet, Lausanne 1748; German translaton by H. Maser: Enletung n de Analyss des Unendlchen Erster Tel, Sprnger, Berln [Garey and Johnson, 1979] Mchael Garey and Davd Johnson. Computers and Intractablty. W. H. Freeman and Company, [Mackworth, 1977] Alan Mackworth. Consstency n networks of relatons. Artfcal Intellgence, 8:99 118, [Mackworth, 1987] Alan Mackworth. Constrant satsfacton. In Stuart Shapro, edtor, Encylopeda of Artfcal Intellgence. Wley-Interscence, [Rvn and Vard, 1989] Igor Rvn and Ilan Vard. The n-queens problem. Forthcomng. [Rvn and Zabh, 1989] Igor Rvn and Ramn Zabh. An algebrac approach to constrant satsfacton problems. Forthcomng extended verson.

An Algebraic Approach to Constraint Satisfaction Problems

An Algebraic Approach to Constraint Satisfaction Problems An Algebraic Approach to Constraint Satisfaction Problems Igor Rivin Wolfram Research, Inc. Champaign, Illinois 61826 Ramin Zabih Computer Science Department Stanford University Stanford, California 94305

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

1 Generating functions, continued

1 Generating functions, continued Generatng functons, contnued. Generatng functons and parttons We can make use of generatng functons to answer some questons a bt more restrctve than we ve done so far: Queston : Fnd a generatng functon

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Combining Constraint Programming and Integer Programming

Combining Constraint Programming and Integer Programming Combnng Constrant Programmng and Integer Programmng GLOBAL CONSTRAINT OPTIMIZATION COMPONENT Specal Purpose Algorthm mn c T x +(x- 0 ) x( + ()) =1 x( - ()) =1 FILTERING ALGORITHM COST-BASED FILTERING ALGORITHM

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Section 3.6 Complex Zeros

Section 3.6 Complex Zeros 04 Chapter Secton 6 Comple Zeros When fndng the zeros of polynomals, at some pont you're faced wth the problem Whle there are clearly no real numbers that are solutons to ths equaton, leavng thngs there

More information

Exercises. 18 Algorithms

Exercises. 18 Algorithms 18 Algorthms Exercses 0.1. In each of the followng stuatons, ndcate whether f = O(g), or f = Ω(g), or both (n whch case f = Θ(g)). f(n) g(n) (a) n 100 n 200 (b) n 1/2 n 2/3 (c) 100n + log n n + (log n)

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

8.6 The Complex Number System

8.6 The Complex Number System 8.6 The Complex Number System Earler n the chapter, we mentoned that we cannot have a negatve under a square root, snce the square of any postve or negatve number s always postve. In ths secton we want

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k.

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k. THE CELLULAR METHOD In ths lecture, we ntroduce the cellular method as an approach to ncdence geometry theorems lke the Szemeréd-Trotter theorem. The method was ntroduced n the paper Combnatoral complexty

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

An efficient algorithm for multivariate Maclaurin Newton transformation

An efficient algorithm for multivariate Maclaurin Newton transformation Annales UMCS Informatca AI VIII, 2 2008) 5 14 DOI: 10.2478/v10065-008-0020-6 An effcent algorthm for multvarate Maclaurn Newton transformaton Joanna Kapusta Insttute of Mathematcs and Computer Scence,

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1 P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

THE SUMMATION NOTATION Ʃ

THE SUMMATION NOTATION Ʃ Sngle Subscrpt otaton THE SUMMATIO OTATIO Ʃ Most of the calculatons we perform n statstcs are repettve operatons on lsts of numbers. For example, we compute the sum of a set of numbers, or the sum of the

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Fundamental loop-current method using virtual voltage sources technique for special cases

Fundamental loop-current method using virtual voltage sources technique for special cases Fundamental loop-current method usng vrtual voltage sources technque for specal cases George E. Chatzaraks, 1 Marna D. Tortorel 1 and Anastasos D. Tzolas 1 Electrcal and Electroncs Engneerng Departments,

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

CHAPTER 17 Amortized Analysis

CHAPTER 17 Amortized Analysis CHAPTER 7 Amortzed Analyss In an amortzed analyss, the tme requred to perform a sequence of data structure operatons s averaged over all the operatons performed. It can be used to show that the average

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Remarks on the Properties of a Quasi-Fibonacci-like Polynomial Sequence

Remarks on the Properties of a Quasi-Fibonacci-like Polynomial Sequence Remarks on the Propertes of a Quas-Fbonacc-lke Polynomal Sequence Brce Merwne LIU Brooklyn Ilan Wenschelbaum Wesleyan Unversty Abstract Consder the Quas-Fbonacc-lke Polynomal Sequence gven by F 0 = 1,

More information

HMMT February 2016 February 20, 2016

HMMT February 2016 February 20, 2016 HMMT February 016 February 0, 016 Combnatorcs 1. For postve ntegers n, let S n be the set of ntegers x such that n dstnct lnes, no three concurrent, can dvde a plane nto x regons (for example, S = {3,

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Determinants Containing Powers of Generalized Fibonacci Numbers

Determinants Containing Powers of Generalized Fibonacci Numbers 1 2 3 47 6 23 11 Journal of Integer Sequences, Vol 19 (2016), Artcle 1671 Determnants Contanng Powers of Generalzed Fbonacc Numbers Aram Tangboonduangjt and Thotsaporn Thanatpanonda Mahdol Unversty Internatonal

More information

Canonical transformations

Canonical transformations Canoncal transformatons November 23, 2014 Recall that we have defned a symplectc transformaton to be any lnear transformaton M A B leavng the symplectc form nvarant, Ω AB M A CM B DΩ CD Coordnate transformatons,

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

O-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment

O-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment O-lne Temporary Tasks Assgnment Yoss Azar and Oded Regev Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978, Israel. azar@math.tau.ac.l??? Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978,

More information

CHAPTER 14 GENERAL PERTURBATION THEORY

CHAPTER 14 GENERAL PERTURBATION THEORY CHAPTER 4 GENERAL PERTURBATION THEORY 4 Introducton A partcle n orbt around a pont mass or a sphercally symmetrc mass dstrbuton s movng n a gravtatonal potental of the form GM / r In ths potental t moves

More information

Linear Feature Engineering 11

Linear Feature Engineering 11 Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

The internal structure of natural numbers and one method for the definition of large prime numbers

The internal structure of natural numbers and one method for the definition of large prime numbers The nternal structure of natural numbers and one method for the defnton of large prme numbers Emmanul Manousos APM Insttute for the Advancement of Physcs and Mathematcs 3 Poulou str. 53 Athens Greece Abstract

More information

Lecture Space-Bounded Derandomization

Lecture Space-Bounded Derandomization Notes on Complexty Theory Last updated: October, 2008 Jonathan Katz Lecture Space-Bounded Derandomzaton 1 Space-Bounded Derandomzaton We now dscuss derandomzaton of space-bounded algorthms. Here non-trval

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Beyond Zudilin s Conjectured q-analog of Schmidt s problem

Beyond Zudilin s Conjectured q-analog of Schmidt s problem Beyond Zudln s Conectured q-analog of Schmdt s problem Thotsaporn Ae Thanatpanonda thotsaporn@gmalcom Mathematcs Subect Classfcaton: 11B65 33B99 Abstract Usng the methodology of (rgorous expermental mathematcs

More information

The KMO Method for Solving Non-homogenous, m th Order Differential Equations

The KMO Method for Solving Non-homogenous, m th Order Differential Equations The KMO Method for Solvng Non-homogenous, m th Order Dfferental Equatons Davd Krohn Danel Marño-Johnson John Paul Ouyang March 14, 2013 Abstract Ths paper shows a smple tabular procedure for fndng the

More information

a b a In case b 0, a being divisible by b is the same as to say that

a b a In case b 0, a being divisible by b is the same as to say that Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Graph Reconstruction by Permutations

Graph Reconstruction by Permutations Graph Reconstructon by Permutatons Perre Ille and Wllam Kocay* Insttut de Mathémathques de Lumny CNRS UMR 6206 163 avenue de Lumny, Case 907 13288 Marselle Cedex 9, France e-mal: lle@ml.unv-mrs.fr Computer

More information

Lecture 2: Prelude to the big shrink

Lecture 2: Prelude to the big shrink Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson

More information

On the Repeating Group Finding Problem

On the Repeating Group Finding Problem The 9th Workshop on Combnatoral Mathematcs and Computaton Theory On the Repeatng Group Fndng Problem Bo-Ren Kung, Wen-Hsen Chen, R.C.T Lee Graduate Insttute of Informaton Technology and Management Takmng

More information

Complete subgraphs in multipartite graphs

Complete subgraphs in multipartite graphs Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G

More information

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule:

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule: 15-745 Lecture 6 Data Dependence n Loops Copyrght Seth Goldsten, 2008 Based on sldes from Allen&Kennedy Lecture 6 15-745 2005-8 1 Common loop optmzatons Hostng of loop-nvarant computatons pre-compute before

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

1 Generating functions, continued

1 Generating functions, continued Generatng functons, contnued. Exponental generatng functons and set-parttons At ths pont, we ve come up wth good generatng-functon dscussons based on 3 of the 4 rows of our twelvefold way. Wll our nteger-partton

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

1 Matrix representations of canonical matrices

1 Matrix representations of canonical matrices 1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:

More information

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm NYU, Fall 2016 Lattces Mn Course Lecture 2: Gram-Schmdt Vectors and the LLL Algorthm Lecturer: Noah Stephens-Davdowtz 2.1 The Shortest Vector Problem In our last lecture, we consdered short solutons to

More information

Finding Primitive Roots Pseudo-Deterministically

Finding Primitive Roots Pseudo-Deterministically Electronc Colloquum on Computatonal Complexty, Report No 207 (205) Fndng Prmtve Roots Pseudo-Determnstcally Ofer Grossman December 22, 205 Abstract Pseudo-determnstc algorthms are randomzed search algorthms

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

On the irreducibility of a truncated binomial expansion

On the irreducibility of a truncated binomial expansion On the rreducblty of a truncated bnomal expanson by Mchael Flaseta, Angel Kumchev and Dmtr V. Pasechnk 1 Introducton For postve ntegers k and n wth k n 1, defne P n,k (x = =0 ( n x. In the case that k

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information