Finding the Longest Similar Subsequence of Thumbprints for Intrusion Detection

Size: px
Start display at page:

Download "Finding the Longest Similar Subsequence of Thumbprints for Intrusion Detection"

Transcription

1 Fndng the Longest Smlar Subsequence of Thumbprnts for Intruson Detecton Mng D. Wan, Shou-Hsuan Stephen Huang, and Janhua Yang Department of Computer Scence, Unversty of Houston Houston, Texas, 77204, USA Emal: {mngwan, shuang, Techncal Report Number UH-CS December 13, 2005 Keywords: Networ Securty, Intruson Detecton, Thumbprnt, Smlarty, Dynamc Programmng. Abstract One way to detect ntruders on the Internet s to compare the smlarty of two thumbprnts. A thumbprnt s a summary of a connecton that characterzes the connecton. The pacet gap thumbprnt conssts of sequences of non-negatve real number representng the tme gaps between send pacets. Ths paper formalzed defntons of smlarty between two non-negatve real number sequences, by ntroducng ε-smlarty, partal sum and longest ε-smlar subsequence (LSS). Length of LSS s a measurement of smlarty between two sequences. The Longest ε-smlar Subsequence (LSS) problem s a generalzaton of the well nown Longest Common Subsequence (LCS) problem. The goal of ths paper s to fnd an optmal soluton to the LSS problem. We analyzed the property of partal sums and proposed to focus on the mnmum matched partal sum whch leads to an optmal soluton to LSS whle reduce the problem space. As the LSS problem has optmal structure, we proposed an Algorthm based on dynamc programmng technque. Tme complexty of ths algorthm s O(m 2 n 2 ). By usng a property of the partal sums, we reduced the tme complexty to O(mn(m+n)).

2 Fndng the Longest Smlar Subsequence of Thumbprnts for Intruson Detecton Mng D. Wan, Shou-Hsuan Stephen Huang, and Janhua Yang Department of Computer Scence, Unversty of Houston Houston, Texas, 77204, USA Emal: {mngwan, shuang, Abstract One way to detect ntruders on the Internet s to compare the smlarty of two thumbprnts. A thumbprnt s a summary of a connecton that characterzes the connecton. The pacet gap thumbprnt conssts of sequences of non-negatve real number representng the tme gaps between send pacets. Ths paper formalzed defntons of smlarty between two non-negatve real number sequences, by ntroducng ε-smlarty, partal sum and longest ε-smlar subsequence (LSS). Length of LSS s a measurement of smlarty between two sequences. The Longest ε- Smlar Subsequence (LSS) problem s a generalzaton of the well nown Longest Common Subsequence (LCS) problem. The goal of ths paper s to fnd an optmal soluton to the LSS problem. We analyzed the property of partal sums and proposed to focus on the mnmum matched partal sum whch leads to an optmal soluton to LSS whle reduce the problem space. As the LSS problem has optmal structure, we proposed an Algorthm based on dynamc programmng technque. Tme complexty of ths algorthm s O(m 2 n 2 ). By usng a property of the partal sums, we reduced the tme complexty to O(mn(m+n)). Index Terms Networ Securty, Intruson Detecton, Thumbprnt, Smlarty, Dynamc Programmng. 1. Introducton One way of detectng steppng-stone s by montorng a ste s ncomng and outgong traffc. In general we have the problem of determnng whether two connectons belong to the same connecton chan [ZP00]. In a recent paper, we proposed to use tme gaps between pacets as a temporal thumbprnt to dentfy a connecton [YH05]. The method requres us to compare two such thumbprnts to see f they are smlar. Even though there are effcent heurstc algorthms to compare two gap sequences, the ssue has never been studed formally. We propose a formal defnton of the problem by ntroducng ε-smlarty, partal sum and longest ε-smlar subsequence (LSS) and cast t as a generalzaton of the well nown Longest Common Subsequence (LCS) problem. It s not a trval tas to defne what s smlar n two sequences of numbers whch may dffer n length. The defnton and soluton we derve here can be used n comparng many dfferent thumbprnts. The LSS problem s much more complcated than LCS problem due to partal sums nvolved. We analyze the property of partal sums, proposed to focus on the mnmum matched partal sum (MMPS). The Longest ε-smlar Subsequence (LSS) problem has smlar optmal structure le LCS problem. Wth dynamc programmng technque, we have an O(m2n2) algorthm to fnd the optmal soluton to the LSS problem. Based on the property of partal sums as defned by ths paper, we come up wth a more effcent optmal algorthm wth tme complexty of O(mn(m+n)). Practcally, matches of very bg szed mnmum matched partal sum (MMPS), whch summed up a large number of elements together, are lely false match-ups n thumbprnt applcaton. By lmtng the sze of MMPS to a constant number s, we reduced the complexty a suboptmal soluton to O(smn). Page 1

3 The rest of ths paper s organzed as followng: In Secton 2, we proposed formal defntons. In Secton 3, we defne a partcular partal sum, whch sums up consecutve elements before one element. In Secton 4, property of LSS s studed. Dynamc programmng technque s used to solve the LSS problem. In Secton 5, a more effcent optmal algorthm and a heurstc algorthm are proposed to reduce tme complexty to O(mn(m+n)) and O(smn) respectvely. 2. Defntons The frst maor dffculty of our problem s the ssue of smlarty. The followng defntons defne the ε-smlarty between two sequences. ε-smlarty: Gven a rato ε between 0 and 1 nclusvely, and two non-negatve real number a and b, we defne a and b to be ε-smlar to each other f (a-b)/(a+b) ñ. In other words, the two numbers are wthn ε of each other proportonally (dfference dvded by the sum). We then generalze the smlarty to two sequences of the same length. Two sequences a[1..n] and b[1..n] are ε-smlar f a[] and b[] are ε-smlar for all =1,, n. Partal Sum: Gven a sequence a[1],, a[m], a partal sum of the sequence s the sum of one or more consecutve elements of the sequence, a[]+a[+1]+ +a[] for some <. Partal Sum Subsequence: A partal sum subsequence of a[1],, a[m] s a sequence of partal sum a [1], t[ ], a [m ] such that a'[ ] = where 1 ñ s[] ñ t[] ñ s[+1] ñ t[+1] ñ m for all = 1,, m -1. The = a[ ] s[ ] length of the (partal sum) subsequence s defned as m. Longest ε-smlar Subsequence (LSS): Gven two sequences of non-negatve real numbers a[1],, a[m] and b[1],, b[n], f () there exsts a (partal sum) subsequence a [1 p] of a and a subsequence b [1..p] of b, such that a and b are ε-smlar and () there are no other such sequences wth a longer length, we defne a and b as the longest ε-smlar subsequence (LSS) of a and b. The length of the longest ε-smlar can then be used to measure the smlarty of the two sequences. The smlarty rato of the two subsequences s defned as p/mn(a,b). An example of an ε-smlar subsequence (LSS) of length 4 s shown n Fgure 1 below. X: Y: Fgure 1: LSS example wth ε=0 If we choose ε=0 and s[]=t[] for all n the defnton of partal sum subsequence (. e., no non-trval partal sums allowed), the LSS becomes LCS. Therefore, the LSS problem s a generalzed LCS problem. See Fgure 2 for an LSS example that s also an LCS. X: Y: Fgure 2: LCS example Page 2

4 To solve the LSS problem, a brute-force approach s to enumerate all subsequences of a[1..m] and chec each partal sum subsequences to see f t s also a partal sum subsequence of b[1..n], eepng trac of the longest subsequence found. For a sequences of a[1..m], there are many partal sum subsequences, mang t mpractcal for long sequences. The well nown LCS problem has an O(mn) algorthm [CL01], where m and n are the lengths of the two sequences, based on Dynamc Programmng technque to fnd a soluton to the LCS problem [KC72, MP80]. Le the LCS problem, the LSS problem has an optmal-substructure property, so t s possble to use Dynamc Programmng technque to solve the problem. But, the LSS problem has partal sums nvolved, the soluton of the LSS problem s more complex than the LCS problem, the soluton to LSS problem requres more tme comparng to LCS problem. 3. Partal Sum Selecton A partal sum may contan one or many consecutve elements of a sequence. For one element of a sequence, there are many ways to defne ts partal sum startng and endng elements. Thus extra complexty wll be ntroduced. To reduce the problem space, we focus on one partcular way to defne partal sum startng and endng elements. If there s any optmal soluton to the LSS problem, there shall exst an optmal soluton consstng of partal sum selected by the defned method. We start wth defnng of the partal sum selecton and followed wth the proof of ts optmal property. Gven sequences X[1..m] and Y[1..n] and the maxmum length of partal sum s, we choose to calculate partal sums bacward startng from x and y, 1 ñ ñ m, 1 ñ ñ n. There are s number of combnatons of partal sums startng from x bacward wth maxmum length of s, such as {(x ), (x -1 +x ),, (x -s+1 +x - s+..+x )}. There are the same number of partal sums for y. The set of partal sums are defned as Partal Sums endng at x and Partal Sums endng at y respectvely. Fgure 3 shows Partal Sums endng at x and y. X: x 1 x -s x -s+1 x -1 x x m Y: y 1 y -s y -s+1 y -1 y y n Fgure 3: Partal Sums endng at x and y To chec f there s any ε-smlarty between Partal Sums endng at x and y, there are s 2 match evaluatons. It s possble that there are several partal sums beng ε-smlar at the same tme. To reduce the problem space, we don t need to consder all cases of those matched partal sums as long as we can fnd the one whch can produce the Longest ε-smlar Subsequence. The Mnmum Matched Partal Sums can produce the longest ε-smlar subsequence, thus we wll only focus on ths form of partal sum. For convenence, we denote as s ε-smlar wth and as not ε-smlar wth. Mnmum Matched Partal Sum (MMPS): Gven sequences X={x 1, x 2,, x n } and Y={y 1, y 2,, y n } and, x and x are any Partal Sum endng at x respectvely and, y and y are any Partal Sum endng at y respectvely. Let x' = x, = u = x u' = y v = y v' x' ' =, y' = y' ' =,, and where 1 m, 1 n, 0 (u,u )<, 0 (v,v )<. If x y, x y, x <x and y <y, then x and y are a par of Mnmum Matched Partal Sum (MMPS). Page 3

5 = u Fgure 4 shows two pars of ε-smlar partal sums where x ' = x s ε-smlar to y ' =, and y = u' " x = x = v' " s ε-smlar to y = y, x, y. Even though x and y are ε-smlar, but only x and = v y forms a par of Matched Partal Sum wth mnmum value, thus they are Mnmum Matched Partal Sum (MMPS) X = x 1 x 2 x -u x -u, x -1 x x +1 x m Y = y 1 y 2 y -v y -v, y -1 y y +1 y n Fgure 4: Mnmum Matched Partal Sums Theorem 1: Gven sequences X={x 1, x 2,, x m } and Y={y 1, y 2,, y n } and, x s a Partal Sums endng at x and, y s a Partal Sums endng at y. Let x' = = x, u y' = = y, where 1 m, 1 n, 0 u<, v 0 v<. x and y are par of Mnmum Matched Partal Sum (MMPS). MMPS has a property of optmal soluton to LSS problem for sequences of X and Y. Proof: MMPS have the longest prefx sequences X[1 u-1] and Y[1 v-1]. Larger Matched Partal Sums have shorter prefx subsequences. MMPS s prefx sequences have the most elements appended to shorter prefx sequences X[1 u -1] and Y[1 v -1] of other larger Matched Partal Sums. Thus t wll produce at least the same length of ε-smlar subsequence as other shorter prefx sequences. If MMPS can t produce longer ε-smlar subsequence, other matched partal sums can t do so ether. By only consderng Mnmum Matched Partal Sum endng at x and y respectvely, we avod further evaluaton of all other larger canddate Partal Sums, thus computaton tme for those canddate Partal Sums s reduced, resultng n a better performance. 4. Property and Soluton of LSS 4.1 Characterzng a Longest ε-smlar Subsequence Le the well nown LCS problem, the LSS problem has an optmal-substructure property. The natural classes of sub-problems correspond to pars of prefxes of the two nput sequences. Theorem 2 (Optmal substructure of an LSS) Let X={x 1, x 2,, x m } and Y={y 1, y 2,, y n } be sequences, and Z={z 1, z 2,, z } by any LSS of X and Y, and x m s a mnmum matched partal sum (MMPS) endng at x m, m n x' =, y m = x u 1 u m n s a MMPS endng at y n, y' n = = y v v, 1 v n. x m = x m, y n =y n f x m, y n s not a MMPS. Then there are 3 cases: 1. f x m y n, then z x m and y n, and z -1 s an LSS of X u-1 and Y v f x m y n, and z x m, mples that Z s an LSS of X m-1 and Y. 3. f x m y n, and z y n, mples that Z s an LSS of X and Y n-1. Proof: (1) If z x' m, then we could append x m y n to Z to obtan a ε-smlar subsequence of X and Y of length +1, contradctng the supposton that Z s a Longest ε-smlar subsequence of X and Y. Thus, we must have z x m y n. Now, the prefx Z -1 s length of (-1) ε-smlar subsequence of x m-u and y n-v. We wsh to show t s an LSS. Suppose for purpose of contradcton that there s a ε-smlar subsequence W of x u-1 and y v-1 wth length greater than -1. Then, appendng x m y n to W produces a ε-smlar subsequence of X and Y whose length s greater than, whch s a contradcton. Page 4

6 (2) If x ' m y' n, then Z s a ε-smlar subsequence of Xm-1 and Y. If there were a ε-smlar subsequence W of X m-1 and Y wth length greater than, then W would also be a ε-smlar subsequence X m and Y, contradctng to the assumpton that Z s an LSS of X and Y. (3) The proof s symmetrc to (2). The theorem shows that an LSS of two sequences contans an LSS of prefxes of the two sequences. Thus, the LSS problem has an optmal-substructure property. 4.2 A Recursve Soluton Snce the LSS problem has an optmal-substructure property, we could apply dynamc programmng technque to solve ths problem. To fnd LSS of X and Y, we may need to fnd the LSS s of X and Y n-1 and of X m-1 and Y. But each of these sub-problems has the same sub-sub-problem. To summarze t all, we enumerate the sub-problems: 1. f x m y n, then the sub-problem s the LSS of X u-1 and Y v-1 ; 2. f x m y n, then the sub-problem s the LSS of X m and Y n-1 or of X m-1 and Y n. Let c[,] to be the length of an LSS of the sequences X and Y. If ether =0 or =0, one of the sequences has length 0, so the LSS has length 0. The optmal substructure of LSS problem gves the recursve formula: c[,]=max{(c[u-1,v-1]+δ), c[-1,], c[,-1]} where δ=1, f x y, x' =, = x u y' = and 1 m, 1 u<, 1 n, 1 v<. = y v δ=0, otherwse As stated n the above formula, a condton n the problem restrcts whch sub-problem we may consder. When x ' y', we need to fnd the LSS of Xu-1 and Y v-1. Otherwse, we need to fnd LSS of X and Y -1 or of X -1 and Y. 4.3 Algorthm of Computng LSS Procedure LSS_Length taes two sequences X={x 1, x 2,, x m } and Y={y 1, y 2,, y n } as nputs. It stores c[, ] values n a table c[0..m, 0..n] whose entres are computed n row-maor order. The frst row and column are ntated to 0. When a ε-smlar matched Partal Sum (MMPS) s found, - b[1..m, 1..n]: stores a ponter to the optmal structure. - s[1..m, 1..n]: s[,]=0 f t s not a entry element of MMPS, otherwse 1. The procedure returns c, b, s tables. Table c[m,n] contans the length of an LSS of X and Y. The subroutne MMPS1() was called for each x and y to chec f there exsts a ε-smlar mnmum matched Partal Sum (MMPS) endng at x and y. LSS_LENGTH (X, Y) m = length[x]; n = length[y]; c = 0; for = 1 to m for =1 to n f (MMPS1(,) s true) and (c[u-1,v-1]+1 >= max(c[-1,],c[,-1])) { c[,]=c[u-1,v-1]+1; b[,] = (u-1, v-1); s[,] =1; } else { s[,] =0; Page 5

7 f c[,-1]>c[-1,] { c[,] = c[,-1]; b[,] = (, -1); } else { c[,] = c[-1,]; b[,] = c[-1,]; } } return (c,b,s) Subroutne MMPS1() checs f there s MMPS endng at x and y, bacward from mnmum partal sum to larger ones. The subroutne MMPS1() wll return the ndces of the partal sum f a Mnmum Matched Partal Sum was found, and saves runnng tme by sppng to chec all other larger Partal Sums. MMPS1(, ) for u = to 1 sum1 = sum(x[u..]); for v = to 1{ sum2 = sum(y[v..]); f (two sums are ε-smlar) return (true, u, v) } return (false,0,0) Fgure 7 shows the result of an example usng by the algorthm. The cells n row and column contans c[,], b[,], and s[,]. We combne the three tables nto one for easer dsplay. We use angle bracet to represent the ponter b[,]. The number before t s the c value and the number after t s the s value. The c value of 4 on the lowest rght corner s the length of the LSS. MMPS s are llustrated n shaded rectangle boxes. When s[,]=1, t s a vald entry for MMPS. The LSS computed n ths example s {30, 60, 90, 80}. Computng the tables taes O(mn) teratons, and for each table entry, we need to chec MMPS whch taes O(mn) tme each. Thus the total runnng tme of the algorthm s O(m 2 n 2 ). 4.4 Constructng an LSS The b and s table returned by LSS_LENGTH() can be used to construct an LSS of X={x 1, x 2,, x m } and Y={y 1, y 2,, y n }. For row and column, when s[,]=1, t s a par of vald partal sum endng at (,). Pnter b[,]=(u-1, v-1) ponts to next element n the optmal structure. The par of Partal Sums s X[u ] and Y[v ]. PRINT_LSS_X() traces the path of optmal structure, and prnts elements of partal sums of X[u ]. The followng procedure PRINT_LSS_X() runnng from rght-lower corner of b table prnts an LSS n terms of X elements n proper order: PRINT_LSS_X (X, s,, ) f (=0 or =0) return PRINT_LSS_X(X,s,b[,]) f (,) s the entry element of Partal Sum endng at x prnt Partal Sum elements end For p[,]=(u-1, v-1), then elements of partal sum endng at x s X[u ], and the elements of partal sum endng at y s Y[v ]. Page 6

8 X \ Y <1,0>0 0<1,0>0 0<1,2>0 0<1,3>0 0<1,4>0 0<1,5> <0,0>1 1<2,1>0 1<2,2>0 1<1,3>1 1<0,4>1 1<2,5> <2,0>1 1<0,1>1 1<3,2>0 1<3,3>0 2<2,4>1 2<3,5> <3,1>0 1<4,1>0 1<4,2>0 1<4,3>0 2<3,5>0 2<4,5> <3,0>1 2<2,1>1 2<5,2>0 2<5,3>0 2<3,4>1 2<5,5> <5,1>0 2<5,2>0 2<3,2>1 2<6,3>0 2<6,4>0 2<2,3> <6,1>0 2<6,2>0 2<7,2>0 3<5,2>1 3<6,3>1 3<6,5> <7,1>0 2<7,2>0 2<6,1>1 3<7,4>0 3<8,4>0 4<7,4>1 Fgure 7: The combned table computed by LSS_LENGTH on sample sequences X={10, 20, 30, 15, 15, 40, 50, 80} and Y={30, 60, 70, 20, 30, 50}. 5. More Effcent Algorthms As mentoned n Secton 4.3, LENGTH_LSS() taes O(m 2 n 2 ) tme. The algorthm s not practcal f the lengths of the sequences are large. By examnng the property of the partal sums, there s room to mprove the effcency of the algorthm. 5.1 A More Effcent Optmal Algorthm: As we descrbed n Secton 3, for Sequences X[1 m] and Y[1 n], Partal Sums endng at x are {x }, {x +x -1 }, {x +x -1 +x -2 },, Partal Sums endng at y are {y }, {y +y -1 }, {y +y -1 +y -2 },. They are n monotonous ncreasng order. Usng ths property, we can come up wth a more effcent procedure of MMPS1(). The frst step of MMPS2() puts partal sums endng at x and y nto arrays psum_x[] and psum_y[], then compares them startng from the smallest one untl a ε-smlar match found. If a match was found, returns true wth the poston of startng elements of the par of matched partal sums, otherwse returns false. Snce the two partal sum arrays are monotonously ncreasng lsts, we can use the Merge procedure [HS97] to compare elements between the two ordered lsts. Mergng two sorted lsts of szes m and n taes O(m+n) tme. MMPS2(, ) psum_x = psum_y = 0; for u= to 1 psum_x[u] = psum_x[u-1]+x[u]; for v= to 1 psum_y[v] = psum_y[v-1]+y[v]; u = ; v = ; whle(u>0 and v>0) f psum_x[u] ε-smlar to psum_y[v] return (true, u, v) else f psum_x[u] > psum_y[v] do u-- else f psum_x[u] < psum_y[v] do v-- return (false, 0, 0) The tme complexty for MMPS2() s O(m+n), thus total tme complexty for procedure LENGTH_LSS()s reduced to O(mn(m+n)). Page 7

9 5.2 A Heurstc Algorthm In comparng smlarty of thumbprnts, t s hghly unlely a true smlarty for a par of matched partal sums consstng of a large number of elements. We have experenced that a match of a par of partal sums wth 50 and 101 elements respectvely. By lmtng the sze of partal sum to s, we can come up wth a heurstc algorthm MMPS3(). The tme complexty for MMPS3() s O(s), thus the total tme complexty for LSS_LENGTH() s O(smn). Due to lmtaton of the space and ts smlarty to MMPS2(), the algorthm s not lsted here. 6. Expermental Result We test our algorthm on two thumbprnts wth sequences of 224 and 176 postve real numbers. Values of the sequence s element range between 50,000 to 4,000,000 (mcroseconds n terms of pacet gap). The program runs on a PC wth Intel s Pentum III CPU. Dfferent ε values are used to determne performance of the algorthm. The result s shown n Table 1. Average run tme s about 0.8 seconds. The result of experment 1 shows that LSS length decreases when ε decreases. When ε s very small, the LSS elements consst of large szed partals sums. For example, when ε =0, the partal sum conssts 50 elements of X, and 101 elements of Y. In thumbprnt applcaton, too large sze of partal sums may not present the true smlarty of two thumbprnts. The experment also suggested an ε around 0.1 as an deal smlarty rato. The maxmum partal sum sze of 3 to 4 agrees wth our ntuton understandng of the thumbprnts. If we lmt the sze of partal sums to a small constant number s, the tme complexty wll be decreased to O(smn). ε LSS Length Max. Partal Sum Sze Total elements of matched partal sums X Y X Y Table 1: No Sze Lmtaton on Partal Sums. (X length = 254, Y length = 176) Wth lmtng partal sum sze to s=5, we have a suboptmal soluton as shown n the Table 2. Average run tme s about 0.06 second. For large enough ε (10% or more), the solutons are actually optmal. For smaller ε, the solutons are not as good as the optmal solutons. ε LSS Length Max. Partal Sum Sze Total elements of matched partal sums X Y X Y Table 2: Maxmum Partal Sum sze s lmted to s=5. (X length = 254, Y length = 176) Page 8

10 Fgure 6 compares the optmal and the suboptmal results. For the suboptmal algorthm, wth the sze of partal sum lmted to 5, we stll can get an almost dentcal result wth optmal soluton. The beneft of heurstc algorthm s that wthout sacrfcng too much precson, the runnng tme s much faster than optmal soluton (10 tmes faster) mang t feasble for real-tme applcaton. 7. Concluson Longest ε-smlar Subsequence (LSS) problem s a generalzaton of the Longest Common Subsequence (LCS) problem. In ntruson detecton applcaton on the Internet, t may be necessary to compare two sequences of thumbprnt to see f there are smlar. In order to do so, we provded a defnton of smlarty n ths context. Even though we use a specfc thumbprnt (pacet gap) as an example, the algorthm wll apply n most other cases snce most thumbprnts consst of a sequence of numbers. By analyzed the property of partal sums, we lmted our computaton to the mnmum matched partal sum (MMPS) whch leads to our optmal soluton of LSS whle reduces problem space. Fgure 6: Experment Comparson LSS Length e-smlarty s=176 s=5 Fgure 6 Comparson of Optmal and Suboptmal solutons. Wth dynamc programmng technque, an O(m 2 n 2 ) algorthm for the optmal soluton to the LSS problem was descrbed. Based on the property of partal sums, we derved a more effcent algorthm wth tme complexty of O(mn(m+n)). Practcally, match-ups of very bg szed mnmum matched partal sum (MMPS), whch summed up a large number of elements together, are lely to be false match-ups n thumbprnt applcaton. By lmtng the sze of MMPS to a small constant number s, we wll have an algorthm wth O(smn) tme complexty. References: [ZP00] Yn Zhang, Vern Paxson, Detectng Steppng-Stone, Proceedngs of the 9 th USENIX Securty Symposum, Denver, CO, August 2000, pp [YH05] Janhua Yang, Shou-Hsuan Stephen Huang: Matchng TCP Pacets and Its Applcaton to the Detecton of Long Connecton Chans, Proceedngs of IEEE Internatonal Conference on Advanced Informaton Networng and Applcatons, March 2005, Tape, Tawan, pp [CL01] Thomas H. Cormen, Charles E. Leserson, Ronald L. Rvest and Clfford Sten. Introducton to Algorthms, Second Edton, pp The MIT Press, [KC72] V. Chvatal, D. A. Klarner, and D.E. Knuth. Selected combnatoral research programs. Techncal Report STAN-CS , Computer Scence Department, Stanford Unversty, 1972 [MP80] Wllam J. Mase and Mchael S. Paterson. A faster algorthm computng strng edt dstances, Journal of Computer and System Scence, 20(1):18-31, [HS97] Ells Horowtz, Sarta Sahn, Sanguthevar Raasearan, Computer Algorthms, pp Computer Scence Press, Page 9

Design and Analysis of Algorithms

Design and Analysis of Algorithms Desgn and Analyss of Algorthms CSE 53 Lecture 4 Dynamc Programmng Junzhou Huang, Ph.D. Department of Computer Scence and Engneerng CSE53 Desgn and Analyss of Algorthms The General Dynamc Programmng Technque

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence) /24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Graph Reconstruction by Permutations

Graph Reconstruction by Permutations Graph Reconstructon by Permutatons Perre Ille and Wllam Kocay* Insttut de Mathémathques de Lumny CNRS UMR 6206 163 avenue de Lumny, Case 907 13288 Marselle Cedex 9, France e-mal: lle@ml.unv-mrs.fr Computer

More information

On the Repeating Group Finding Problem

On the Repeating Group Finding Problem The 9th Workshop on Combnatoral Mathematcs and Computaton Theory On the Repeatng Group Fndng Problem Bo-Ren Kung, Wen-Hsen Chen, R.C.T Lee Graduate Insttute of Informaton Technology and Management Takmng

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Min Cut, Fast Cut, Polynomial Identities

Min Cut, Fast Cut, Polynomial Identities Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Introduction to Information Theory, Data Compression,

Introduction to Information Theory, Data Compression, Introducton to Informaton Theory, Data Compresson, Codng Mehd Ibm Brahm, Laura Mnkova Aprl 5, 208 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on the 3th of March 208 for a Data Structures

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

CHAPTER IV RESEARCH FINDING AND ANALYSIS

CHAPTER IV RESEARCH FINDING AND ANALYSIS CHAPTER IV REEARCH FINDING AND ANALYI A. Descrpton of Research Fndngs To fnd out the dfference between the students who were taught by usng Mme Game and the students who were not taught by usng Mme Game

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

CS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang

CS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang CS DESIGN ND NLYSIS OF LGORITHMS DYNMIC PROGRMMING Dr. Dasy Tang Dynamc Programmng Idea: Problems can be dvded nto stages Soluton s a sequence o decsons and the decson at the current stage s based on the

More information

a b a In case b 0, a being divisible by b is the same as to say that

a b a In case b 0, a being divisible by b is the same as to say that Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

A Network Intrusion Detection Method Based on Improved K-means Algorithm

A Network Intrusion Detection Method Based on Improved K-means Algorithm Advanced Scence and Technology Letters, pp.429-433 http://dx.do.org/10.14257/astl.2014.53.89 A Network Intruson Detecton Method Based on Improved K-means Algorthm Meng Gao 1,1, Nhong Wang 1, 1 Informaton

More information

Volume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2].

Volume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2]. Bulletn of Mathematcal Scences and Applcatons Submtted: 016-04-07 ISSN: 78-9634, Vol. 18, pp 1-10 Revsed: 016-09-08 do:10.1805/www.scpress.com/bmsa.18.1 Accepted: 016-10-13 017 ScPress Ltd., Swtzerland

More information

First day August 1, Problems and Solutions

First day August 1, Problems and Solutions FOURTH INTERNATIONAL COMPETITION FOR UNIVERSITY STUDENTS IN MATHEMATICS July 30 August 4, 997, Plovdv, BULGARIA Frst day August, 997 Problems and Solutons Problem. Let {ε n } n= be a sequence of postve

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Finding Primitive Roots Pseudo-Deterministically

Finding Primitive Roots Pseudo-Deterministically Electronc Colloquum on Computatonal Complexty, Report No 207 (205) Fndng Prmtve Roots Pseudo-Determnstcally Ofer Grossman December 22, 205 Abstract Pseudo-determnstc algorthms are randomzed search algorthms

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

The L(2, 1)-Labeling on -Product of Graphs

The L(2, 1)-Labeling on -Product of Graphs Annals of Pure and Appled Mathematcs Vol 0, No, 05, 9-39 ISSN: 79-087X (P, 79-0888(onlne Publshed on 7 Aprl 05 wwwresearchmathscorg Annals of The L(, -Labelng on -Product of Graphs P Pradhan and Kamesh

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Introduction to information theory and data compression

Introduction to information theory and data compression Introducton to nformaton theory and data compresson Adel Magra, Emma Gouné, Irène Woo March 8, 207 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on March 9th 207 for a Data Structures

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

U.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan 2/21/2008. Notes for Lecture 8

U.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan 2/21/2008. Notes for Lecture 8 U.C. Berkeley CS278: Computatonal Complexty Handout N8 Professor Luca Trevsan 2/21/2008 Notes for Lecture 8 1 Undrected Connectvty In the undrected s t connectvty problem (abbrevated ST-UCONN) we are gven

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

Exercises of Chapter 2

Exercises of Chapter 2 Exercses of Chapter Chuang-Cheh Ln Department of Computer Scence and Informaton Engneerng, Natonal Chung Cheng Unversty, Mng-Hsung, Chay 61, Tawan. Exercse.6. Suppose that we ndependently roll two standard

More information

A 2D Bounded Linear Program (H,c) 2D Linear Programming

A 2D Bounded Linear Program (H,c) 2D Linear Programming A 2D Bounded Lnear Program (H,c) h 3 v h 8 h 5 c h 4 h h 6 h 7 h 2 2D Lnear Programmng C s a polygonal regon, the ntersecton of n halfplanes. (H, c) s nfeasble, as C s empty. Feasble regon C s unbounded

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

An Admission Control Algorithm in Cloud Computing Systems

An Admission Control Algorithm in Cloud Computing Systems An Admsson Control Algorthm n Cloud Computng Systems Authors: Frank Yeong-Sung Ln Department of Informaton Management Natonal Tawan Unversty Tape, Tawan, R.O.C. ysln@m.ntu.edu.tw Yngje Lan Management Scence

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule:

Common loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule: 15-745 Lecture 6 Data Dependence n Loops Copyrght Seth Goldsten, 2008 Based on sldes from Allen&Kennedy Lecture 6 15-745 2005-8 1 Common loop optmzatons Hostng of loop-nvarant computatons pre-compute before

More information

arxiv:quant-ph/ Jul 2002

arxiv:quant-ph/ Jul 2002 Lnear optcs mplementaton of general two-photon proectve measurement Andrze Grudka* and Anton Wóck** Faculty of Physcs, Adam Mckewcz Unversty, arxv:quant-ph/ 9 Jul PXOWRZVNDR]QDRODQG Abstract We wll present

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

HMMT February 2016 February 20, 2016

HMMT February 2016 February 20, 2016 HMMT February 016 February 0, 016 Combnatorcs 1. For postve ntegers n, let S n be the set of ntegers x such that n dstnct lnes, no three concurrent, can dvde a plane nto x regons (for example, S = {3,

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

Lecture 5 Decoding Binary BCH Codes

Lecture 5 Decoding Binary BCH Codes Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

Dynamic Programming 4/5/12. Dynamic programming. Fibonacci numbers. Fibonacci: a first attempt. David Kauchak cs302 Spring 2012

Dynamic Programming 4/5/12. Dynamic programming. Fibonacci numbers. Fibonacci: a first attempt. David Kauchak cs302 Spring 2012 Dynamc Programmng Davd Kauchak cs32 Sprng 212 Dynamc programmng l One of the most mportant algorthm tools! l Very common ntervew queston l Method for solvng problems where optmal solutons can be defned

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

A combinatorial problem associated with nonograms

A combinatorial problem associated with nonograms A combnatoral problem assocated wth nonograms Jessca Benton Ron Snow Nolan Wallach March 21, 2005 1 Introducton. Ths work was motvated by a queston posed by the second named author to the frst named author

More information

Anti-van der Waerden numbers of 3-term arithmetic progressions.

Anti-van der Waerden numbers of 3-term arithmetic progressions. Ant-van der Waerden numbers of 3-term arthmetc progressons. Zhanar Berkkyzy, Alex Schulte, and Mchael Young Aprl 24, 2016 Abstract The ant-van der Waerden number, denoted by aw([n], k), s the smallest

More information

Uncertainty in measurements of power and energy on power networks

Uncertainty in measurements of power and energy on power networks Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:

More information

Split alignment. Martin C. Frith April 13, 2012

Split alignment. Martin C. Frith April 13, 2012 Splt algnment Martn C. Frth Aprl 13, 2012 1 Introducton Ths document s about algnng a query sequence to a genome, allowng dfferent parts of the query to match dfferent parts of the genome. Here are some

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING N. Phanthuna 1,2, F. Cheevasuvt 2 and S. Chtwong 2 1 Department of Electrcal Engneerng, Faculty of Engneerng Rajamangala

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Valuated Binary Tree: A New Approach in Study of Integers

Valuated Binary Tree: A New Approach in Study of Integers Internatonal Journal of Scentfc Innovatve Mathematcal Research (IJSIMR) Volume 4, Issue 3, March 6, PP 63-67 ISS 347-37X (Prnt) & ISS 347-34 (Onlne) wwwarcournalsorg Valuated Bnary Tree: A ew Approach

More information

Economics 101. Lecture 4 - Equilibrium and Efficiency

Economics 101. Lecture 4 - Equilibrium and Efficiency Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Lecture 4: Constant Time SVD Approximation

Lecture 4: Constant Time SVD Approximation Spectral Algorthms and Representatons eb. 17, Mar. 3 and 8, 005 Lecture 4: Constant Tme SVD Approxmaton Lecturer: Santosh Vempala Scrbe: Jangzhuo Chen Ths topc conssts of three lectures 0/17, 03/03, 03/08),

More information

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium?

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium? APPLIED WELFARE ECONOMICS AND POLICY ANALYSIS Welfare Propertes of General Equlbrum What can be sad about optmalty propertes of resource allocaton mpled by general equlbrum? Any crteron used to compare

More information

Problem Set 6: Trees Spring 2018

Problem Set 6: Trees Spring 2018 Problem Set 6: Trees 1-29 Sprng 2018 A Average dstance Gven a tree, calculate the average dstance between two vertces n the tree. For example, the average dstance between two vertces n the followng tree

More information

Perfect Competition and the Nash Bargaining Solution

Perfect Competition and the Nash Bargaining Solution Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Adjusted Control Lmts for U Charts Copyrght 207 by Taylor Enterprses, Inc., All Rghts Reserved. Adjusted Control Lmts for U Charts Dr. Wayne A. Taylor Abstract: U charts are used

More information