Stopping Set Elimination for LDPC Codes

Size: px
Start display at page:

Download "Stopping Set Elimination for LDPC Codes"

Transcription

1 Sopping Se Eliminaion for LDPC Codes Anxiao (Andrew) Jiang, Pulakesh Upadhyaya, Ying Wang, Krishna R. Narayanan Hongchao Zhou, Jin Sima, and Jehoshua Bruck Compuer Science and Engineering Deparmen, Texas A&M Universiy Elecrical and Compuer Engineering Deparmen, Texas A&M Universiy School of Informaion Science and Engineering, Shandong Universiy Elecrical Engineering Deparmen, California Insiue of Technology Absrac This work sudies he Sopping-Se Eliminaion Problem, namely, given a sopping se, how o remove he fewes erasures so ha he remaining erasures can be decoded by belief propagaion in k ieraions (including k = ). The NPhardness of he problem is proven. An approximaion algorihm is presened for k =. And efficien exac algorihms are presened for general k when he sopping ses form rees. I. INTRODUCTION In his paper, we sudy a basic heoreical problem for LDPC codes: when he erasures in a noisy LDPC codeword canno be correced by he decoder, how o remove he fewes erasures so ha he remaining erasures become decodable? The problem has several applicaions: Disribued Sorage. Disribued file sysems like HDFS have been widely used in big daa applicaions. Typically, hey sore daa in blocks, and ECCs are applied over he blocks (where each block is seen as a codeword symbol of he ECC). Binary LDPC codes are naurally an aracive candidae for disribued sorage, as hey have excellen code raes, good localiy (e.g., a missing block can be recovered by a local disk from a few neighboring blocks), and excellen compuaional simpliciy (only XOR is used for decoding, since when each block has bis, he decoding can be seen as binary LDPC codes being decoded in parallel). Meanwhile, almos all big IT companies sore muliple copies of heir daa a differen locaions. So when one sie loses some blocks in an LDPC code and canno recover hem by iself, i needs o rerieve some los blocks from oher remoe sies. Since communicaion wih remoe sies is much more cosly han accessing local disks, i is desirable o minimize he number of blocks rerieved from remoe sies as long as he remaining erasures become decodable. Saellie-o-Ground Communicaion wih Feedback. Consider saellie-o-ground communicaion, where daa (e.g., big sensing images) are pariioned ino packes (i.e., blocks), and LDPC codes are applied over he packes (similar o he case for disribued sorage). As he channel is noisy, some packes received by he ground may be un-decodable, and he ground will reques he saellie o reransmi some of hose los packes. Since he saellieo-ground communicaion can be cosly, i is desirable o minimize he number of reransmied packes. Le us define he problem more specifically. Le he LDPC code s decoder be he following widely-used ieraive beliefpropagaion (BP) algorihm: in each ieraion, use every pariycheck equaion involving exacly one erasure o decode ha erasure; and repea unil every equaion involves zero or a leas wo erasures. If he decoding fails, hen we are lef wih a sopping se, which is a se of erasures such ha every pariy-check equaion involving any of hem involves a leas wo of hem. If we represen he LDPC code by a biparie Tanner graph, hen a sopping se is a subse of variable nodes (represening erasures) such ha a check node adjacen o any of hem is adjacen o a leas wo of hem. We illusrae he average sizes of Sopping Ses for differen raw bi-erasure raes (RBERs) in Fig.. I is for an (89,756) LDPC code of rae.9 and regular degrees (d v =, d c = 9). (For RBERs near he code s decoding hreshold, he uncorrecable bi-erasure raes (UBER) afer BP decoding is shown in Fig. (a).) For RBERs in he full range from o, he average sopping-se sizes (namely, average number of un-decodable erasures afer BP-decoding) are shown in Fig. (b). I can be seen ha he average sopping-se size increases approximaely linearly (from o 89) as RBER increases from o. (a) Uncorrecable Bi Erasure Rae (UBER) Raw Bi Erasure Rae (RBER) (b) Average sopping se size Raw Bi Erasure Rae (RBER) Fig.. Saisics of an (89,756) LDPC code. (a) UBER for differen RBERs near he code s decoding hreshold. (b) Average sopping-se size for differen RBERs. The problem o sudy can now be defined formally as follows. Le G = (V C, E) be a biparie graph, where V (represening erasures) is a subse of he variable nodes in an LDPC code s Tanner graph, C is a subse of he check nodes in he same Tanner graph such ha every node in C is adjacen o a leas one node in V, and E is he se of edges in he Tanner graph wih one endpoin in V and anoher

2 endpoin in C. If every node in C has degree wo or more, hen G is called a Sopping Graph and V is called a Sopping Se. Now le k be an ineger parameer. If an ieraive BP algorihm (as inroduced earlier) ha runs on G can decode all he variable nodes in V (where every variable node in V is an erasure) wihin k ieraions, hen V is called a Decodable Se (or simply decodable); oherwise, i is a Non-Decodable Se (or simply non-decodable). (Here we inroduce he parameer k o make he problem more general, and o conrol no only he decodabiliy of erasures bu also he ime for decoding.) Noe ha a Sopping Se mus be a Non-Decodable Se, bu no vice versa. The problem we sudy, called Sopping-Se Eliminaion (SSE k ) Problem, is as follows. Definiion. Given a Sopping Graph G = (V C, E), how o remove he minimum number of variable nodes from V such ha he remaining variable nodes can be decoded by BP decoding wihin k ieraions? If he consrain on k ieraions does no exis, we can see k as and call i he SSE Problem. The res of he paper is organized as follows. In Secion II and III, we prove he NR-hardness of he SSE Problem and he SSE k Problem for finie k, respecively. In Secion IV, we presen an approximaion algorihm for he laer problem. In Secion V, we presen efficien algorihms ha reurn opimal soluions for he SSE Problem when he Sopping Ses form ree srucures. In Secion VI, we presen conclusions. Due o space limiaion, we skip some deails in proofs and analysis. Ineresed readers can refer o he full paper [] for he deails. II. NP-HARDNESS OF SSE PROBLEM In his secion, we prove ha he SSE Problem is NPhard. The proof has wo seps: firs, using he well-known Se Cover Problem, we prove ha a relaed covering problem where nearly all elemens are covered which we call he Pseudo Se Cover Problem is NP-complee; hen, we reduce he laer problem o he SSE Problem. A. NP-compleeness of Pseudo Se Cover Problem Consider he well-known Se Cover Problem. Le T = {,,, n } be a universe of n elemens. Le S, S,, S m be m subses of T such ha T = m i= S i. (Each S i is said o cover is elemens.) Le k m be a posiive ineger. The Se Cover Problem asks if here exis k subses S i, S i,, S ik such ha T = k j= S i j. We now define a Pseudo Se Cover Problem ha differs only in is quesion: i asks if here exis k subses S i, S i,, S ik such ha k j= S i j T. Theorem. The Pseudo Se Cover Problem is NP-complee. Proof: We consruc a polynomial-ime reducion from he NP-complee Se Cover Problem o he Pseudo Se Cover Problem. Le an insance of he Se Cover Problem have inpu parameers T = {,,, n }, S, S,, S m and k m as inroduced above. For he corresponding insance of he Pseudo Se Cover Problem, le is universe of elemens be T = {,,, n, n+ }, where n+ is a new elemen, and le is subses be S, S,, S m, S m+, where S m+ = { n+ }. I is simple o see ha he mapping beween he wo insances akes polynomial (in fac, linear) ime. Le us now prove he following claim: he Se Cover Problem has k subses covering all he n elemens in T if and only if he Pseudo Se Cover Problem has k subses covering a leas T = n elemens in T. Consider one direcion of he proof: suppose ha he Se Cover Problem has k subses covering all elemens of T. Then he same k subses cover exacly n elemens of T. (The only uncovered elemen is n+.) Now consider he oher direcion of he proof: suppose ha he Pseudo Se Cover Problem has k subses S i, S i,, S ik covering a leas n elemens in T. Wihou loss of generaliy (WLOG), assume ha i < i < < i k. There are hree possible cases: Case : The k subses cover all he n + elemens of T. Then i k = m +, and he remaining k subses cover all he elemens in T. By adding o he k remaining subses any oher subse in {S, S,, S m }, we ge k subses covering all elemens of T for he Se Cover Problem. Case : The k subses cover n elemens of T, including n+. Then i k = m +, and here mus be exacly one uncovered elemen in T. Say ha uncovered elemen is i, and le S j (where j m) be any subse ha conains j. (Such a subse S j mus exis.) By replacing S ik = S m+ by S j, we ge k subses ha cover all he elemens of T. Case : The k subses cover n elemens of T, bu no covering n+. Then he same k subses cover all he elemens of T. So he reducion exiss, and he conclusion holds. B. NP-hardness of SSE Problem We now prove he NP-hardness of he SSE Problem by using a reducion from he Pseudo Se Cover Problem. Le us begin wih some consrucions. Consider he biparie graph shown in Fig. (a). I consiss of four variable nodes (s i, j, u i,j and w i,j ) and hree check nodes (c i,j, c i,j and c i,j ). We denoe i by D i,j o indicae ha i connecs node s i and node j. We prove some basic propery i has on ieraive BP decoding. Lemma. In he graph D i,j ha conains he variable nodes s i, j, u i,j, w i,j as a Sopping Se, if he value of he variable node s i becomes known, he BP decoding algorihm will recover he values of all he hree remaining variable nodes. On he oher hand, if he value of he variable node j becomes known, he BP decoding algorihm will no recover he value of any of he oher hree variable nodes. Proof: If he value of s i becomes known, by using he check nodes c i,j and c i,j, he BP decoding algorihm will

3 (a) c i,j c i,j u i,j (e) (c) S S S 4 5 s s s 4 5 (d) s s s 4 5 c, c, c, c, c, c, c,4 c,4 c, c, c, c, c,4 c,4 c,5 c,5 u, w, u, w, u, w, u,4 w,4 u, w u,, w, u,4 w,4 u,5 w,5 c, c, c, c,4 c, c, c,4 c,5 (f) c j s i w i,j c i,j (b) s i j g i,j s s s 4 5 c c c Fig.. (a) A biparie graph D i,j ha connecs variable nodes s i and j. (b) A symbol for he graph D i,j. (c) An insance of he Pseudo Se Cover Problem, where T = {,,, 4, 5 } and S = {,, 4 }, S = {, }, S = {, 4, 5 }. (d) The corresponding graph G I. (e) The corresponding graph G I wih full deails. (f) The corresponding graph G II. recover he values of u i,j and w i,j, respecively. Then via he check node c i,j, i will recover he value of j. If he value of j becomes known, since c i,j has degree, he BP algorihm will no recover any more values. The graph D i,j will be viewed as a gadge ha connecs node s i wih node j. To simplify he presenaion, in he following, we ofen represen i by he symbol shown in Fig. (b), where he gae g i,j represens he five nodes (c i,j, c i,j, c i,j, u i,j, w i,j ) and heir inciden edges. The direcion of he gae g i,j indicaes he direced propery shown in he above lemma: decoding s i leads o decoding j, bu no vice versa. Consider he Pseudo Se Cover Problem wih inpu parameers T = {,,, n }, S, S,, S m and k m as inroduced earlier. To reduce i o he SSE Problem, we will map every insance of he Pseudo Se Cover Problem o some insance of he SSE Problem. Le us sar by building a biparie graph G I. We sar by assigning m+n nodes: for every subse S i (for i m) or elemen j (for j n) in he Pseudo Se Cover Problem, here is a corresponding variable node s i or j in G I. Then, whenever he Pseudo Se Cover Problem has j S i, we connec nodes s i and j by he biparie graph D i,j. The graph obained his way is G I. An example is shown below. Example 4. Le he Pseudo Se Cover Problem be T = {,,, 4, 5 } and S = {,, 4 }, S = {, }, S = {, 4, 5 }. (As k is irrelevan o he mapping, we do no specify i.) I is illusraed in Fig. (c), where here is an edge beween S i and j if and only if j S i. The corresponding graph G I is shown in boh Fig. (d) and (e), where he symbol for each D i,j is used in Fig. (d), and he full deails of G I are shown in Fig. (e). I is easy o see he correspondence beween G I and he Pseudo Se Cover Problem. We now creae a biparie graph G II as follows. Given graph G I, we add m + addiional check nodes c, c, c,, c m. For i m and j n, add an edge beween he check node c i and he variable node j. For i m, add an edge beween he check node c i and he variable node s i. The graph obained his way is G II. (For example, following Example 4, G II is as shown in Fig. (f).) In he following, we consider only cases where n >. (The case n = is rivial.) I is hen simple o see ha in G II, he degree of every check node is a leas wo. So i is a Sopping Graph, namely, an insance of he SSE Problem. Lemma 5. If for he Pseudo Se Cover Problem, here exis k subses ha cover a leas n elemens of T, hen for he corresponding graph G II, k variable nodes can be removed so ha he remaining variable nodes form a Decodable Se. Proof: Suppose ha S i, S i,, S ik are k chosen subses ha cover a leas n elemens of T. Le us remove he corresponding k variable nodes s i, s i,, s ik from he graph G II. Since removing a variable node is equivalen o urning he node from an erasure o a known value, by he direced propery of D i,j proved earlier, we know ha he BP decoding algorihm will recover he values of a leas n variable nodes among,,, n. Tha is because if an elemen j is covered by some chosen subse S ir (where r k), since he value of he variable node s ir is now known, via he gadge D ir,j, he BP decoding algorihm can recover he value of j. We now show ha he BP decoding algorihm can recover he values of all n variable nodes,,, n. From he above discussion, we know ha a mos one of hem say x is no decoded ye. So he BP algorihm can use he check node c (which has degree n) o recover he value of x as x = i n,i x i. Since he values of,,, n are all known now, for i =,,, m, he BP decoding algorihm can use he check node c i o recover he value of s i (if is value is no already known). So all he variable nodes can recover heir values. Therefore, he remaining variable nodes form a Decodable Se. When a se of variable nodes S V is removed from a Sopping Graph G = (V C, E), if he remaining nodes of V become decodable, we call S an Eliminaion Se of size S. Lemma 6. If G II has an Eliminaion Se of size k m, hen G II has an Eliminaion Se of size k ha is also a subse of {s, s,, s m }. Proof: Le X = {x, x,, x k } be an Eliminaion Se of G II, where each x i is a variable node. Le us creae a se Y = {y, y,, y k } {s,, s m } as follows. For i =,,, k, do:

4 If x i {s, s,, s m }, le y i = x i. If x i is eiher u i,j or w i,j namely, i is a variable node in he gadge D i,j (more specifically, g i,j ) ha connecs s i and j le y i = s i if s i is no in Y ye, and le y i be any node in {s, s,, s m } ha is no ye in Y oherwise. If x i = j for some j n, le s i be a node such ha here is a gadge D i,j connecing s i and j. (Such a node s i mus exis because in he Pseudo Se Cover Problem, j is covered by a leas one subse.) If s i is no in Y ye, le y i = s i ; oherwise, le y i be any node in {s, s,, s m } ha is no ye in Y. Wih he above consrucion, for any node x i in X, here exiss a node s i in Y such ha eiher s i = x i, or s i and x i exis in he same gadge D i,j for some j. By he direced propery of gadges D i,j, we see ha when he values of variable nodes in Y are known, he BP algorihm can decode all he variable nodes in X; and since s an Eliminaion Se, he BP algorihm can consequenly decode all he variable nodes in G II. So Y is an Eliminaion Se of size k ha is a subse of {s, s,, s m }. Lemma 7. If G II has an Eliminaion Se of size k {s i, s i,, s ik } {s, s,, s m }, hen for he corresponding Pseudo Se Cover Problem, he k subses S i, S i,, S ik cover a leas n elemens of T. Proof: The proof is by conradicion. Suppose ha S i, S i,, S ik cover a mos n elemens of T. Then in G II, when he values of {s i, s i,, s ik } are known, he BP algorihm can use he gadges D i,j o decode a mos n variable nodes among,,, n. Then he BP algorihm ges suck because i canno use any check node o decode any more variable node: For any check node c i (where i m), a leas wo adjacen nodes in {,,, n } are no decoded ye. So he BP algorihm canno use c i o decode more variable nodes. For any gadge D i,j ha connecs s i and j, if s i / {s i, s i,, s ik }, by he direced propery of he gadge, he BP algorihm canno use i o decode s i wheher he node j has been decoded or no. Tha means {s i, s i,, s ik } is no an Eliminaion Se, which is a conradicion. Tha leads o he conclusion. By combining he above wo lemmas, we ge: Lemma 8. If G II has an Eliminaion Se of size k m, hen for he corresponding Pseudo Se Cover Problem, here exis k subses ha cover a leas n elemens of T. We now prove our main resul here. Theorem 9. The SSE Problem is NP-hard. Proof: The SSE Problem is an opimizaion problem. Le us consider is decision problem: given a Sopping Graph G = (V C, E) and a posiive ineger k, does i have an Eliminaion Se of size k? Le us call his decision problem P sse. I is clear ha P sse NP. We have shown a mapping ha maps every insance of he Pseudo Se Cover Problem o an insance of P sse. The mapping akes polynomial ime. By combining Lemma 5 and Lemma 8, we see ha he answer o he Pseudo Se Cover Problem is yes (namely, here exis k subses ha cover a leas n elemens of T ) if and only if he answer o P sse is yes (namely, G II has an Eliminaion Se of size k). So he mapping is a polynomial-ime reducion. By Theorem, he Pseudo Se Cover Problem is NP-complee. So P sse is NP-complee, which leads o he conclusion. III. NP-HARDNESS OF SSE k PROBLEM FOR FINITE k We now consider a new quesion: if k is finie (or even a consan), does he SSE k problem become polynomialime solvable? A posiive answer seems possible a firs sigh, because having a small k pus more localized consrains on soluions. For example, if k =, o correc all remaining erasures in jus one ieraion, in he subgraph induced by he remaining variable nodes and heir adjacen check nodes, every variable node needs o be adjacen o a leas one check node of degree one. Tha is a very local propery for he biparie graph and can possibly make he problem simpler. However, our sudy below will give a negaive answer. We will prove ha even he SSE Problem is NP-hard. There have been a number of works on he node-deleion problem [], [], [4], [6], which can be generally saed as follows: find he minimum number of verices o delee from a given graph so ha he remaining subgraph saisfies a propery π. They focus on properies ha are herediary on induced subgraphs, namely, whenever a graph G saisfies π, by deleing nodes from G, he remaining subgraphs also saisfies π. However, he SSE k Problem is no herediary, because removing a check node can urn a decodable graph (he desired propery) ino an un-decodable one. We now prove he NP-hardness of he SSE Problem. We use a reducion from he NP-complee No-all-equal SAT Problem [5], defined as follows: le x, x,, x n be n Boolean variables. A lieral is eiher x i or x i (namely, he NOT of x i ) for some i {,,, n}. Le a clause be a se of hree lierals. Le S = {C, C,, C k } be a se of k clauses. The quesion is: Is here a ruh assignmen o he n Boolean variables such ha for every clause in S, he hree lierals in he clause are neiher all rue nor all false (namely, every clause has a leas one rue lieral and also a leas one false lieral)? (If he answer is yes, he problem is called saisfiable.) By convenion, rue is also represened by, and false is also represened by. We give an example of he No-allequal SAT Problem. Example. Consider he following insance of he No-allequal SAT Problem. Le n = 4 and k = 5. Le he Boolean variables be x, x, x, x 4, and le he se of clauses

5 be C = (x, x, x ), C = ( x, x, x 4 ), C = (x, x, x 4 ), C 4 = (x, x, x 4 ), C 5 = ( x, x, x ). The above insance is saisfiable because we can le he ruh assignmen be x =, x =, x =, x 4 =, x 5 =. Correspondingly, he clauses become C = (,, ), C = (,, ), C = (,, ), C 4 = (,, ), C 5 = (,, ). None of he clauses is (,, ) (namely, all rue) or (,, ) (namely, all false). A. Reducing No-all-equal SAT Problem o SSE Problem In his subsecion, we consruc a reducion ha maps every insance of he No-all-equal SAT Problem o an insance of he SSE Problem. For every Boolean variable x i of he No-all-equal SAT Problem (for i n), we creae a graph as shown in Fig. (a), which will be called he gadge V i. I is a biparie graph of hree variable nodes and hree check nodes. (Here nodes Xi and Xi represen he rue and false values of x i, respecively.) For every clause C j of he No-all-equal Problem (for j k), we creae wo graphs as shown in Fig. (b), which will be called gadges Uj and U j, respecively. (Here for =,,, nodes A j and B j represen he rue and false values of he -h lieral in clause C j, respecively.) We hen connec hem ino one larger gadge W j as shown in Fig. (c), where for =,,, wo pahs are used o connec he nodes A j and Bj. (For example, he wo pahs beween and have nodes d j, and he four check nodes by hem.) In he final graph corresponding o he insance, he gadge V i will be conneced o he res of he graph only hrough nodes Xi and Xi. So o simplify he presenaion, we someimes represen V i by he symbol in Fig. (d), where he wo inerface nodes Xi, are shown and he remaining deails are hidden. Also in he final graph, he gadge W j will be conneced o he res of he graph only hrough nodes A j, A j,,, B j, ; so we someimes represen i by he symbol in Fig. (e). We now connec he gadges for clauses o he gadges for Boolean variables. Consider a clause C j, and assume is lierals are C j = (l, l, l ). For =,,, if l = x i for some i n, we connec A j o and connec Bj o Xi (hrough some inermediae nodes) as shown in Fig. (f). Oherwise l = x i for some i n, and we connec A j o Xi and connec Bj o as shown in Fig. (g). Example. Assume ha a clause is C j = (l, l, l ) = (x, x, x 4 ). Is gadge W j is conneced o he gadges V, V, V 4 as in Fig. (h). To simplify he presenaion of he graph, we represen he connecion beween a node A j (or B j ) and a node x i (or x i ) by a recangle ha is generally denoed by he H bar. Then he graph in Fig. (h) is simplified as he presenaion in Fig. (i), which shows he connecions more clearly. However, i should be noed ha each A j, B j, x i or x i is conneced o an H bar via wo edges, no one. By now, we have consruced he whole graph ha corresponds o an insance of he No-all-equal Problem. The graph will be denoed by G sse. Le us see an example. (a) (c) (f) (h) (i) (j) X gadge V i a j X X A H y i V i p j W j (b) gadge Wj V X X V X X q j W j gadge U j gadge U j a j b j (g) V X X 4 W j V X X 4 V 4 V 4 X 4 H H H H H W A A B B B V X X X X V X 4 (d) (e) V i p j b j gadge V i V i gadge W j W j an "H" bar V X X 4 W j B j B j H H H H H H H H H H H H (k) v 5 v 9 v 5 v 4 v v v v v v 6 v v 7 v 8 v 6 v 7 v 4 v (l) v A v v v 4 v 5 v 6 v 7 v8 v 9 v v v v v 4 v 5 v 6 v 7 W A A B B B Fig.. (a) The gadge corresponding o a Boolean variable x i, for i =,,, n. (b) Two gadges corresponding o a clause C j, for j =,,, k. (c) The conneced gadge corresponding o a clause C j, for j =,,, k. (d) Symbol for V i. (e) Symbol for W j. (f) Connec clause gadge o Boolean variable gadge: case one. (g) Connec clause gadge o Boolean variable gadge: case wo. (h) An example of connecing a clause gadge o variable gadges. (i) Simplified represenaion of he graph in (h). (j) The graph G sse corresponding o he No-all-equal Problem where n = 4, k =, C = (x, x, x 4 ), C = (x, x, x ), where gadges are represened by symbols. (k) A Sopping Tree G = (V C, E). (l) Is BFS (Breadh-Firs Search) ree G BF S. V 4 X 4 q j

6 Example. For he No-all-equal Problem, le n = 4 and k =. Le he wo clauses be C = (x, x, x 4 ), C = (x, x, x ). Then he corresponding graph G sse is shown in Fig. (j), where is gadges are represened by symbols for clariy. I is easy o see ha G sse is a biparie graph, where every check node has degree more han one. (Specifically, every check node has degree wo.) So G sse is a Sopping Graph. The subsequen analysis will prove ha he No-all-equal SAT Problem is saisfiable if and only if G sse has an Eliminaion Se of size n+k such ha afer is nodes are removed, he BP algorihm can decode he remaining variable nodes in jus one ieraion. B. Properies of Reducion The mapping from any insance of he No-all-equal SAT Problem o a graph G sse has been shown. We now analyze is properies. Due o space limiaion, we only presen skeches of proofs. For deailed proofs, please see []. Le he biparie graph G sse be G sse = (V sse C sse, E sse ), where V sse is he se of variable nodes, C sse is he se of check nodes, and E sse is he se of edges. We now define he conceps of Inerface Nodes, One-Ieraion Eliminaion Se and Canonical Eliminaion Se. Definiion. Le I sse {X j i i n, j } { i i k, j } {Bj i i k, j } be a subse of variable nodes in G sse. Every node in I sse is called an Inerface Node. (As an example, he inerface nodes are shown as circles in Fig. (j).) Definiion 4. Le T V sse be a se of variable nodes in G sse. If afer removing T from G sse, he BP algorihm can decode he remaining variable nodes in one ieraion, hen T is called a One-Ieraion Eliminaion Se. If T is a one-ieraion eliminaion se and T I sse, hen T is called a Canonical Eliminaion Se. Lemma 5. If G sse has a One-Ieraion Eliminaion Se of α nodes, hen G sse also has a Canonical Eliminaion Se of a mos α nodes. Skeches of proof: Le F V sse be a One-Ieraion Eliminaion Se of α nodes. We will prove he exisence of a Canonical Eliminaion Se ˆF Isse wih ˆF α nodes. Noe ha he nodes in G sse are in hree kinds of gadges: gadge V i, gadge W j, or H bar. (See Fig. (j) for an illusraion.) The main idea of he proof is o ransform F ino ˆF by swiching nodes of F o inerface nodes. For example, consider a gadge V i (for i n). (See Fig. (a) for an illusraion.) Noe ha Xi and X i are is only wo nodes connecing o nodes ouside V i in G sse. If y i F, Xi F and X i F, we can delee y i from F and sill ge a one-ieraion eliminaion se, because y i s wo neighboring check nodes already have degree afer Xi and Xi are removed from G sse. If y i F, Xi / F and Xi / F, we can replace y i by Xi and sill ge a one-ieraion eliminaion se, because afer Xi is removed from G sse, boh Xi and y i will have a neighboring check of degree, and more edges will be removed in he par of he graph G sse ha is ouside V i. Similar analysis can be applied o oher cases of V i and o oher gadges (W j and H bar) o show ha non-inerface nodes in F can be eiher deleed or replaced by inerface nodes o ge ˆF. Tha leads o he conclusion. Some properies of Canonical Eliminaion Ses are shown in he nex lemma. We firs define endpoins of an H bar. Definiion 6. Le u be any node in {A j j k, } {Bj j k, }, and le v be any node in {Xi i n} {X i i n}. If u and v are conneced by an H bar, hen hey are called he wo endpoins of ha H bar. Example 7. In Fig. (f), he endpoins of H bars are (A j, ) and (B j, X i ). In In Fig. (g), such endpoin pairs are (A j, X i ) and (B j, ). Lemma 8. For he graph G sse, a Canonical Eliminaion Se F has he following properies: () Propery : For i =,, n, eiher Xi F or X i F ; () Propery : For j =,,, k and =,,, eiher A j F or Bj F ; () Propery : For j =,,, k, F {A j, A j, } and F {Bj, B j, } ; (4) Propery 4: If u and v are he wo endpoins of an H bar, hen eiher u F or v F. Skeches of proof: For he gadge V i (see Fig. (a)), if neiher X i nor X i is in F, hen he BP algorihm canno decode y i in one ieraion since boh of y i s neighboring check nodes will have degree. So Propery is rue. The oher hree properies can be proved similarly. Corollary 9. If F is a One-Ieraion Eliminaion Se of G sse, hen F n + k. Proof: If F is a Canonical Eliminaion Se, by Propery and Propery in Lemma 8, we ge F n+k. Then by Lemma 5, he same conclusion holds for any One-Ieraion Eliminaion Se. Definiion. Le F be a Canonical Eliminaion Se of G sse. If F = n + k, hen F is called an Ideal Eliminaion Se of G sse. (Here Ideal means of minimum possible size. Noe ha an Ideal Eliminae Se may or may no exis for G sse.) The nex lemma easily follows from Lemma 8. Lemma. An Ideal Eliminaion Se F of G sse has hese properies: () Propery : For i =,,, n, eiher Xi or X i is in F, bu no boh; () Propery : For j =,,, k and =,,, eiher A j or B j is in F, bu no boh; () Propery : For j =,,, k, in he se {A j, A j, }, a leas one node is in F, and a leas one node is no in F. The same is rue for he se {Bj, B j, }; (4) Propery 4: If u and v are he wo endpoins of an H bar, hen eiher u or v is in F, bu no boh.

7 Given an Ideal Eliminaion Se of G sse, we can consruc a soluion o he No-all-equal SAT Problem as follows. Definiion. Le F be an Ideal Eliminaion Se of G sse. A corresponding soluion Sol(F ) for he No-all-equal SAT Problem is consruced as follows: i n, he Boolean variable x i = (namely, x i is rue) if and only if X i F. Clearly, in he above soluion Sol(F ), a Boolean variable x i = (namely, x i is false) if and only if X i F. Lemma. Le F be an Ideal Eliminaion Se of G sse, and le Sol(F ) be is corresponding soluion o he No-all-equal SAT Problem. Then for j k and, he -h lieral in he clause C j is rue if and only if A j / F. Proof: Le lj denoe he -h lieral in he clause C j. Consider wo cases: Case : lj is x i for some i n. In his case, by he consrucion of G sse, A j is conneced o by an H bar. lj is rue if and only if F, which by Propery 4 of Lemma happens if and only if A j / F. Case : lj is x i for some i n. In his case, by he consrucion of G sse, A j is conneced o X i by an H bar. lj is rue if and only if x i is false, which happens if and only if Xi F, which by Propery 4 of Lemma happens if and only if A j / F. So in boh cases, he conclusion holds. Lemma 4. If F is an Ideal Eliminaion Se of G sse, hen Sol(F ) is a saisfying soluion o he No-all-equal SAT Problem. Proof: For j k, le A j F and A j / F. By Propery of Lemma, such wo inegers, {,, } exis. Consider he clause C j. By Lemma, he -h lieral of C j is false, and -h lieral of C j is rue. So for he No-allequal SAT Problem, every clause has a leas one rue lieral and a leas one false lieral. So Sol(F ) is a saisfying soluion o he No-all-equal SAT Problem. The above lemma is useful for he scenario where G sse has a One-Ieraion Eliminaion Se of n + k nodes. We now consider anoher possible scenario: he No-all-equal SAT Problem is saisfiable. Given a saisfying soluion o he No-all-equal SAT Problem, we can consruc an Ideal Eliminaion Se of G sse. We firs define he corresponding se. Definiion 5. Le π be a saisfying soluion o he No-allequal SAT Problem; ha is, wih he soluion π, every clause has a leas one rue lieral and a leas one false lieral. A corresponding se of nodes, F(π), in G sse is consruced as follows: For i =,,, n, if x i = in he soluion π, hen X i F(π) and X i / F(π); oherwise, X i / F(π) and X i F(π). For j =,,, k and =,,, if he -h lieral of clause C j is rue given he soluion π, hen A j / F(π) and Bj F(π); oherwise, A j F(π) and B j / F(π). Lemma 6. Le π be a saisfying soluion o he No-all-equal SAT Problem. Then F(π) is an Ideal Eliminaion Se of G sse. Skeches of proof: We firs prove he asserion: F(π) is an One-Ieraion Eliminaion Se of G sse. Consider he gadge V i, for i n. (See Fig. (a).) By he consrucion of F(π), eiher Xi or X i is in F(π). Eiher way, afer he node in F(π) is removed, he oher wo variable nodes in V i will have neighboring check nodes of degree. The oher gadges (W j and H bar) can be analyzed similarly. So he asserion holds. Then i can be seen ha all he nodes in F(π) are Inerface Nodes and F(π) = n + k. So F(π) is an Ideal Eliminaion Se of G sse. Theorem 7. The SSE Problem is NP-hard. Skeches of proof: By Lemmas 5, 4, 6 and Corollary 9, he No-all-equal SAT Problem is saisfiable if and only if he corresponding SSE Problem has a one-ieraion eliminaion se of size n + k. IV. APPROXIMATION ALGORITHM FOR SSE PROBLEM In his secion, we presen an approximaion algorihm for he SSE problem, for Sopping Graphs whose degrees of variable nodes and check nodes are upper bounded by d v and d c, respecively. Is approximaion raio is d v (d c ). (Clearly, he same resul also applies o regular (d v, d c ) LDPC codes and irregular codes wih he same consrain on maximum degrees.) Noe ha he opimizaion objecive is o minimize he size of he eliminaion se (namely, he number of removed variable nodes). So he approximaion raio means he maximum raio of he size of an eliminaion se produced by he approximaion algorihm o he size of an opimal (i.e., minimum) eliminaion se. Definiion 8. In he Sopping Graph G = (V C, E), v V, define is variable-node neighborhood as Λ(v) {u V {v} c C such ha (u, c) E and (v, c) E}. Tha is, every variable node in Λ(v) shares a common neighboring check node wih v. The algorihm will assign hree colors o variable nodes: Iniially, every variable node is of he color whie. I means ha his variable node canno be decoded by one ieraion of BP-decoding ye. As he algorihm proceeds, if a variable node s color urns black, i means he algorihm has included i in he Eliminaion Se (namely, he algorihm has removed i). As he algorihm proceeds, if a variable node s color urns gray, i means he variable node is no ye removed, bu i will be decodable afer one ieraion of BP decoding. The algorihm works as follows: () as iniializaion, make every variable node whie; () choose an arbirary whie

8 variable node v. Le U v denoe he se of variable nodes in Λ(v) ha are currenly whie or gray; urn he colors of he nodes in U v o black, and urn he color of v o gray. For every check node c ha is conneced o a leas one variable node in U v, check if exacly one of c s neighboring variable node is whie and all c s oher neighboring variable nodes are black; if so, urn ha neighboring variable node s color from whie o gray. () repea he previous sep unil all variable nodes are eiher black or gray. Then reurns he se of black variable nodes as he Eliminaion Se. The algorihm can be shown o have ime complexiy O(d vd c V ). We now analyze he approximaion raio of he algorihm. Say ha he algorihm uses oally ieraions o idenify a sequence of whie variable nodes ˆv, ˆv,, ˆv in he Sopping Graph G = (V C, E), and urns he variable nodes in Uˆv, Uˆv,, Uˆv black. Le us define a sequence of subgraphs G, G,, G accordingly. Definiion 9. Le G = G. For i =,,,, le G i be obained from G i by removing he nodes in Uˆvi {ˆv i } {check nodes adjacen o ˆv i } and heir inciden edges. Noe ha for i =,,,, in he i-h ieraion, he algorihm removes only he variable nodes in Uˆvi (namely, urning hem black) from he subgraph G i, no ˆv i or is adjacen check nodes. (I urns ˆv i o gray.) However, once Uˆvi is removed, all he nodes in Λ(ˆv i ) are removed, so ˆv i and is adjacen check nodes become disconneced from he res of he graph (which is G i ). Therefore i becomes sufficien o consider he SSE Problem for G i in he nex ieraion, and i can be seen ha ˆv i+, Uˆvi+, {check nodes adjacen o ˆv i+ }, ˆv i+, Uˆvi+, {check nodes adjacen o ˆv i+ },, ˆv, Uˆv, {check nodes adjacen o ˆv } are all nodes in G i. Lemma. For i =,,,, every one-ieraion eliminaion se for G i conains a leas one variable node in Uˆvi+ {ˆv i+ }. Proof: Consider a one-ieraion eliminaion se S for G i. Eiher ˆv i+ S, or ˆv i+ needs o be decodable in one ieraion afer S is removed. The laer requires ˆv i+ o have a neighboring check node c such ha all c s oher neighboring variable nodes in G i are included in S, and hose nodes are all in Uˆvi+. Tha leads o he conclusion. Lemma. For i =,,,, le α i denoe he minimum size of a one-ieraion eliminaion se for G i. Then α i i. Proof: The proof is by inducion, bu in he reverse order for i (i.e, from i =, down o ). When i =, clearly α i i =, so he conclusion holds for he base case. Now assume ha he conclusion holds for α, α,, α i+, and consider he case for α i. Consider an opimal (i.e., minimum-sized) one-ieraion eliminaion se S for G i. Define Y S (Uˆvi+ {ˆv i+ }). By Lemma, S removes a leas one variable node in {ˆv i+ }, so Y. Le G be he biparie graph Uˆvi+ obained by removing he variable nodes in Y from G i (and heir inciden edges), and le α denoe he minimum size of a one-ieraion eliminaion se for G. Then α i = S = Y + α α +. G i+ is obained from G i by removing he variable nodes in Uˆvi+ {ˆv i+ }, which is a superse of Y. So G i+ can also be obained from G by removing he variable nodes in (Uˆvi+ {ˆv i+ }) Y. So α i+ α. By he inducion assumpion, we ge α i+ (i + ). By combining he above resuls, we ge α i α + α i+ + (i + ) + = i. Theorem. Le d v and d c denoe he maximum degrees of variable nodes and check nodes, respecively, in he Sopping Graph G = (V C, E). Then he above algorihm has an approximaion raio of d v (d c ). Proof: By seing i = in Lemma, we ge α, namely, any one-ieraion eliminaion se for G removes a leas variable nodes. The algorihm removes he nodes in Uˆv Uˆv Uˆv, whose size is i= Uˆv i = i= Uˆv i i= Λ(ˆv i) d v (d c ). So he approximaion raio is a mos d v (d c ). V. ALGORITHM FOR SSE k AND SSE PROBLEMS In his secion, we presen an algorihms for he SSE k Problem for general k, including k =, when he Sopping Graph is a ree (or a fores). The algorihm oupus an opimal soluion and has linear ime complexiy. The Sopping Graph G = (V C, E) can be a ree, especially when he RBER is low. In his case, we call G a Sopping Tree. Noe ha if G is a fores, he SSE k Problem can be solved for each of is ree componens independenly. Given a Sopping Tree G = (V C, E), we can pick an arbirary variable node v V as he roo, run Breadh-Firs Search (BFS) on G saring wih v, and label he nodes of G by v, v,, v V + C based on heir order of discovery in he BFS. (Noe ha he roo node v is labelled by v, and siblings nodes in he BFS ree always have consecuive labels.) We denoe he resuling BFS ree by G BF S. For any non-roo node v in G BF S, le π(v) denoe is paren. Le G sub denoe he subree of G BF S obained his way: if we remove he subree rooed a π(v V + C ) from G BF S, he remaining subgraph is G sub. Example. A Sopping Tree and is BFS ree are shown in Fig. (k) and (l), respecively. (Noe ha he node labels v, v,, v 7 in Fig. (k) are no known a priori; insead, hey are obained afer we run BFS on he graph wih v as is roo.) Here v V + C = v 7, π(v 7 ) = v, and G sub is he subree in he dashed circle in Fig. (l). The algorihm firs runs BFS on G o ge he ree G BF S ha labels nodes by v, v,, v V + C, where v is he roo. Then i processes he nodes in he reverse order of heir labels, and keeps reducing he SSE k Problem acually, a more general form of he SSE k Problem, which shall be called he

9 gsse k Problem o smaller and smaller subrees. Le us now define his gsse k Problem. Definiion 4. [gsse k Problem] Le G = (V C, E) be a Sopping Graph. and le k be a non-negaive ineger. Every variable node v V is associaed wih wo parameers δ(v) {,,, k, } and ω(v) {,,, k, } saisfying he condiion ha eiher δ(v) = or ω(v) =, bu no boh; and when he BP decoder runs on G, v s value can be recovered (namely, v can become a non-erasure) by he end of he δ(v)-h ieraion auomaically (namely, wihou any help from neighboring check nodes). Then, how o remove he minimum number of variable nodes from V such ha for every remaining variable node v wih ω(v) k, i can be correced by he BP decoder in no more han ω(v) ieraions? (By defaul, if ω(v) =, v has o be removed from V because he BP decoder sars wih he s ieraion.) A soluion o he gsse k Problem (namely, he se of removed nodes) is called a g-eliminaion Se. We see ha if δ(v) = and ω(v) = k for every v V, hen he gsse k Problem is idenical o he SSE k Problem. In G BF S, le τ {,,, V + C } denoe he minimum ineger such ha v τ eiher is a sibling of v V + C or is v V + C iself. (So v τ, v τ+,, v V + C are siblings.) Define P {i τ i V + C, ω(v i ) k} and Q {i τ i V + C, δ(v i ) k}. Since v V, eiher δ(v) or ω(v) is bu no boh, P and Q form a pariion of he se {τ, τ +,, V + C }. By convenion, for he empy se, we say max i δ(v i ) = max i ω(v i ) =. We firs make some observaions. Lemma 5. Suppose max i P ω(v i ) > max i Q δ(v i ). Le i be an ineger in P such ha ω(v i ) = max i P ω(v i ). Then here exiss a minimum-sized g-eliminaion Se for G BF S ha includes he nodes in {v i i P, i i } bu no v i. Proof: Any g-eliminaion Se for G BF S has o include a leas P nodes in {v i i P} because oherwise he un-included nodes in {v i i P} will never be correced. I is an opimal sraegy o include he P nodes in {v i i P, i i } in he g-eliminaion Se because heir ω(v i ) values impose more resricive requiremens han ω(v i ) does. Now le T be a g-eliminaion Se for G BF S ha includes all he nodes in {v i i P, i i }. If v i T, we can replace i by π(π(v V + C )) in T and ge anoher g-eliminaion Se T for G BF S, wih T T (since π(π(v V + C )) may already be in T ). (Noe ha wih T, since max i P ω(v i ) > max i Q δ(v i ), he check node π(v V + C ) can help correc v i by ieraion max i Q δ(v i ) + max i P ω(v i ) = ω(v i ); and since π(π(v V + C )) T, he BP decoding in G sub becomes independen of he subree rooed a π(v V + C ).) So here exiss a minimum-sized g-eliminaion Se for G BF S ha includes he nodes in {v i i P, i i } bu no v i. Lemma 6. Suppose max i P ω(v i ) max i Q δ(v i ). Then here exiss a minimum-sized g-eliminaion Se for G BF S ha conains all he nodes in {v i i P}. Proof: If P =, he conclusion auomaically holds. If P = and max i P ω(v i ) =, any g-eliminaion Se for G BF S has o include {v i i P}, so he conclusion also holds. Now consider he case where max i P ω(v i ) >. Le T be a minimum-sized g-eliminaion Se for G BF S. T has o include a leas P nodes in {v i i P} because oherwise he un-included nodes in {v i i P} canno be correced (using he check node π(v V + C )). If T = P, he le j P be an ineger such ha v j / T. If T {v i i Q} =, hen v j canno be correced by ieraion ω(v j ) max i P ω(v i ) max i Q δ(v i ) because no all nodes in {v i i Q} will be correced by ieraion ω(v j ), so his is an impossible case. So T {v i i Q}. Le m Q be an ineger such ha v m T ; hen we can replace v m by v j in T and ge anoher g- Eliminaion Se T for G BF S because v m helps decoding more han v j : v m can be correced auomaically. Since T = T and {v i i P} T, he conclusion holds. The nex wo lemmas show how o reduce he gsse Problem from G BF S o is subree G sub. In some cases, in he derived gsse Problem for G sub, he values of δ(π(π(v V + C ))) and ω(π(π(v V + C ))) in G sub may be differen from heir original values in G BF S ; and in such cases, o avoid confusion, we will denoe he ree G sub by Ĝ sub. Lemma 7. Suppose max i P ω(v i ) max i Q δ(v i ). Consider five cases: ) Case : If Q > and max i Q δ(v i ) = k, le S be a minimum-sized g-eliminaion Se for G sub. ) Case : If Q >, max i Q δ(v i ) < k and δ(π(π(v V + C ))) k, le S be a minimum-sized g- Eliminaion Se for Ĝ sub where δ(π(π(v V + C ))) is changed o min{δ(π(π(v V + C ))), max i Q δ(v i ) + }. ) Case : If Q > and ω(π(π(v V + C ))) max i Q δ(v i ) < k, le S be a minimum-sized g- Eliminaion Se for G sub. 4) Case 4: If Q > and max i Q δ(v i ) < ω(π(π(v V + C ))) k, le S be a minimum-sized g- Eliminaion Se for Ĝ sub where δ(π(π(v V + C ))) is changed o max i Q δ(v i ) + and ω(π(π(v V + C ))) is changed o. 5) Case 5: If Q =, here are wo sub-cases: () if ω(π(π(v V + C ))) =, le S be a minimumsized g-eliminaion Se for G sub ; () oherwise, le S be a minimum-sized g-eliminaion Se for Ĝ sub where δ(π(π(v V + C ))) is changed o and ω(π(π(v V + C ))) is changed o. Then S {v i i P} is a minimum-sized g-eliminaion Se for G BF S. Proof: By Lemma 6, here exiss a minimum-sized g- Eliminaion Se for G BF S ha conains all he nodes in {v i i P}. Now consider only minimum-sized g-eliminaion Ses for

10 G BF S ha conain all he nodes in {v i i P}. See he nodes in {v i i P} as removed (because nodes in an Eliminaion Se are removed before decoding begins); hen o prove he conclusion, we jus need o prove his asserion: when P =, S is a minimum-sized g-eliminaion Se for G BF S. For Case, since max i Q δ(v i ) = k, he subree rooed a π(v V + C ) canno help correc he node π(π(v V + C )) in he firs k ieraions. Every node v wih ω(v) is in G sub and has ω(v) k. So finding a minimum-sized g-eliminaion Se for G BF S is equivalen o finding such as se for G sub. So he asserion holds. For Case, if we compare G sub and Ĝsub, we see ha hey differ only in heir values of δ(π(π(v V + C ))). (For Ĝ sub, ha value is min{δ(π(π(v V + C ))), max i Q δ(v i ) + }.) Now observe he check node π(v V + C ) and is neighboring variable nodes: when BP decoder runs on G BF S, all he nodes in {v i i Q} can be correced auomaically by ieraion max i Q δ(v i ) < k; so by using he check node π(v V + C ), he node π(π(v V + C )) can be correced by ieraion max i Q δ(v i ) + k. Tha is equivalen o urning δ(π(π(v V + C ))) ino min{δ(π(π(v V + C ))), max i Q δ(v i ) + } and urning G sub ino Ĝsub when i comes o BP decoding. Tha leads o he asserion. The remaining hree cases can be proved similarly. (For deails, please see [].) Lemma 8. Suppose max i P ω(v i ) > max i Q δ(v i ). Le i be an ineger in P such ha ω(v i ) = max i P ω(v i ). Consider wo cases: ) Case : If max i P ω(v i ) > δ(π(π(v V + C ))), le S be any minimum-sized g-eliminaion Se for G sub. ) Case : If max i P ω(v i ) δ(π(π(v V + C ))), le S be any minimum-sized g-eliminaion Se for Ĝ sub where δ(π(π(v V + C ))) is changed o and ω(π(π(v V + C ))) is changed o min{ω(π(π(v V + C ))), max i P ω(v i ) }. Then S {v i i P, i i } is a minimum-sized g-eliminaion Se for G BF S. Proof: By Lemma 5, here exiss a minimum-sized g- Eliminaion Se for G BF S ha includes he nodes in {v i i P, i i } bu no v i. Le T be such a minimum-sized g- Eliminaion Se for G BF S. For Case, when he g-eliminaion Se for G BF S is T, he subree rooed a he check node π(v V + C ) canno help correc he node π(π(v V + C )). Insead, hose nodes of T ha are in G sub will be a g-eliminaion Se for G sub, and he BP decoder will correc he un-removed nodes in G sub (wihin each of heir required number of ieraions ω(v)). If π(π(v V + C )) T, he check node π(v V + C ) will correc v i in he s ieraion; oherwise, he BP decoder will correc π(π(v V + C )) in a mos δ(π(π(v V + C ))) ieraions, so π(v V + C ) will correc v i in a mos δ(π(π(v V + C )))+ ω(v i ) ieraions. Since T s size is minimized, he number of nodes of T ha are in G sub is also minimized. Tha leads o he conclusion. For Case, when he g-eliminaion Se for G BF S is T, he BP decoder needs o correc he node π(π(v V + C )) by ieraion max i P ω(v i ) < δ(π(π(v V + C ))) because only hen will he check node π(v V + C ) help correc he node v i by ieraion max i P ω(v i ) = ω(v i ). Tha is equivalen o urning ω(π(π(v V + C ))) ino min{ω(π(π(v V + C ))), max i P ω(v i ) }, urning δ(π(π(v V + C ))) ino and urning G sub ino Ĝsub when i comes o BP decoding. Tha leads o he conclusion. We can design an algorihm for SSE k as follows: () run BFS on G o ge G BF S and as iniializaion, le ω(v) = k and δ(v) = for every v V ; () use Lemma 7 and 8 repeaedly o reduce he graph in he gsse Problem from G BF S o is subree G sub (or Ĝsub), and hen o smaller and smaller subrees in he same way, unil he subree conains only he roo node v ; during his reducion process, more and more nodes (namely eiher {v i i P} in Lemma 7 or {v i i P, i i } in Lemma 8) are included in he Eliminaion Se; () in he las sep, when he subree conains only v, include v in he Eliminaion Se if and only if ω(v ) k a ha momen. The above algorihm can be implemened by processing he nodes in he reverse order of heir labels from v V + C back o v and has ime complexiy O( V + C ). Due o space consrains, we omi is pseudo code here. We can see ha i reurns an opimal (i.e., minimum-sized) k-ieraion Eliminaion Se of G = (V C, E). For he special case of k =, he algorihm can be simplified: for every check node, include all bu one of is children in he Eliminaion Se S; also include v in S. For is deails, please see []. VI. CONCLUSIONS This paper sudies he Sopping-Se Eliminaion Problem moivaed by several applicaions. The NP-hardness of boh SSE and SSE Problems is proven. An approximaion algorihm is presened for he SSE Problem. And linearime algorihms ha reurn opimal soluions are presened for he SSE and SSE k Problems when he Sopping Ses have ree srucures. REFERENCES [] B. Addis, M. D. Summa and A. Grosso, Removing Criical Nodes from a Graph: Complexiy Resuls and Polynomial Algorihms for he Case of Bounded Treewidh, available a hp : // online.org/db F ILE//7/.pdf. [] T. Fujio, Approximaing Node-Deleion Problems for Marodial Properies, in Journal of Algorihms, vol., pp. 7, 999. [] A. Jiang, P. Upadhyaya, Y. Wang, K. R. Narayanan, H. Zhou, J. Sima and J. Bruck, Sopping Se Eliminaion for LDPC Codes, available a hp : //faculy.cse.amu.edu/ajiang/sse.pdf. [4] M. Kumar, S. Mishra, N. S. Devi and S. Saurabh, Approximaion Algorihms for Node Deleion Problems on Biparie Graphs wih Finie Forbidden Subgraph Characerizaion, in Theoreical Compuer Science, vol. 56, pp. 9 96, 4. [5] T. J. Schaefer, The Complexiy of Saisfiabiliy Problems, in Proc. h Annual ACM Symposium on Theory of Compuing, pp. 6 6, 978. [6] M. Yannakakis, Node-Deleion Problems on Biparie Graphs, in SIAM Journal on Compuing, vol., no., pp. 7, May 98.

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Journal of Discrete Algorithms. Approximability of partitioning graphs with supply and demand

Journal of Discrete Algorithms. Approximability of partitioning graphs with supply and demand Journal of Discree Algorihms 6 2008) 627 650 Conens liss available a ScienceDirec Journal of Discree Algorihms www.elsevier.com/locae/jda Approximabiliy of pariioning graphs wih supply dem Takehiro Io

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

Notes for Lecture 17-18

Notes for Lecture 17-18 U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up

More information

Approximation Algorithms for Unique Games via Orthogonal Separators

Approximation Algorithms for Unique Games via Orthogonal Separators Approximaion Algorihms for Unique Games via Orhogonal Separaors Lecure noes by Konsanin Makarychev. Lecure noes are based on he papers [CMM06a, CMM06b, LM4]. Unique Games In hese lecure noes, we define

More information

Longest Common Prefixes

Longest Common Prefixes Longes Common Prefixes The sandard ordering for srings is he lexicographical order. I is induced by an order over he alphabe. We will use he same symbols (,

More information

Spring Ammar Abu-Hudrouss Islamic University Gaza

Spring Ammar Abu-Hudrouss Islamic University Gaza Chaper 7 Reed-Solomon Code Spring 9 Ammar Abu-Hudrouss Islamic Universiy Gaza ١ Inroducion A Reed Solomon code is a special case of a BCH code in which he lengh of he code is one less han he size of he

More information

Some Ramsey results for the n-cube

Some Ramsey results for the n-cube Some Ramsey resuls for he n-cube Ron Graham Universiy of California, San Diego Jozsef Solymosi Universiy of Briish Columbia, Vancouver, Canada Absrac In his noe we esablish a Ramsey-ype resul for cerain

More information

PCP Theorem by Gap Amplification

PCP Theorem by Gap Amplification PCP Theorem by Gap Amplificaion Bernhard Vesenmayer JASS 2006 Absrac The PCP Theorem provides a new classificaion of NP. Since he original proof by [AS98], several new proofs occured. While he firs proof

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

Math 334 Fall 2011 Homework 11 Solutions

Math 334 Fall 2011 Homework 11 Solutions Dec. 2, 2 Mah 334 Fall 2 Homework Soluions Basic Problem. Transform he following iniial value problem ino an iniial value problem for a sysem: u + p()u + q() u g(), u() u, u () v. () Soluion. Le v u. Then

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

Logic in computer science

Logic in computer science Logic in compuer science Logic plays an imporan role in compuer science Logic is ofen called he calculus of compuer science Logic plays a similar role in compuer science o ha played by calculus in he physical

More information

Matlab and Python programming: how to get started

Matlab and Python programming: how to get started Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

EXERCISES FOR SECTION 1.5

EXERCISES FOR SECTION 1.5 1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Solutions for Assignment 2

Solutions for Assignment 2 Faculy of rs and Science Universiy of Torono CSC 358 - Inroducion o Compuer Neworks, Winer 218 Soluions for ssignmen 2 Quesion 1 (2 Poins): Go-ack n RQ In his quesion, we review how Go-ack n RQ can be

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu ON EQUATIONS WITH SETS AS UNKNOWNS BY PAUL ERDŐS AND S. ULAM DEPARTMENT OF MATHEMATICS, UNIVERSITY OF COLORADO, BOULDER Communicaed May 27, 1968 We shall presen here a number of resuls in se heory concerning

More information

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 17

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 17 EES 16A Designing Informaion Devices and Sysems I Spring 019 Lecure Noes Noe 17 17.1 apaciive ouchscreen In he las noe, we saw ha a capacior consiss of wo pieces on conducive maerial separaed by a nonconducive

More information

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004 ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform

More information

CHAPTER 12 DIRECT CURRENT CIRCUITS

CHAPTER 12 DIRECT CURRENT CIRCUITS CHAPTER 12 DIRECT CURRENT CIUITS DIRECT CURRENT CIUITS 257 12.1 RESISTORS IN SERIES AND IN PARALLEL When wo resisors are conneced ogeher as shown in Figure 12.1 we said ha hey are conneced in series. As

More information

SOLUTIONS TO ECE 3084

SOLUTIONS TO ECE 3084 SOLUTIONS TO ECE 384 PROBLEM 2.. For each sysem below, specify wheher or no i is: (i) memoryless; (ii) causal; (iii) inverible; (iv) linear; (v) ime invarian; Explain your reasoning. If he propery is no

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Stationary Distribution. Design and Analysis of Algorithms Andrei Bulatov

Stationary Distribution. Design and Analysis of Algorithms Andrei Bulatov Saionary Disribuion Design and Analysis of Algorihms Andrei Bulaov Algorihms Markov Chains 34-2 Classificaion of Saes k By P we denoe he (i,j)-enry of i, j Sae is accessible from sae if 0 for some k 0

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Chapter 7: Solving Trig Equations

Chapter 7: Solving Trig Equations Haberman MTH Secion I: The Trigonomeric Funcions Chaper 7: Solving Trig Equaions Le s sar by solving a couple of equaions ha involve he sine funcion EXAMPLE a: Solve he equaion sin( ) The inverse funcions

More information

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion

More information

Removing Useless Productions of a Context Free Grammar through Petri Net

Removing Useless Productions of a Context Free Grammar through Petri Net Journal of Compuer Science 3 (7): 494-498, 2007 ISSN 1549-3636 2007 Science Publicaions Removing Useless Producions of a Conex Free Grammar hrough Peri Ne Mansoor Al-A'ali and Ali A Khan Deparmen of Compuer

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

A NOTE ON THE STRUCTURE OF BILATTICES. A. Avron. School of Mathematical Sciences. Sackler Faculty of Exact Sciences. Tel Aviv University

A NOTE ON THE STRUCTURE OF BILATTICES. A. Avron. School of Mathematical Sciences. Sackler Faculty of Exact Sciences. Tel Aviv University A NOTE ON THE STRUCTURE OF BILATTICES A. Avron School of Mahemaical Sciences Sacler Faculy of Exac Sciences Tel Aviv Universiy Tel Aviv 69978, Israel The noion of a bilaice was rs inroduced by Ginsburg

More information

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1. Roboics I April 11, 017 Exercise 1 he kinemaics of a 3R spaial robo is specified by he Denavi-Harenberg parameers in ab 1 i α i d i a i θ i 1 π/ L 1 0 1 0 0 L 3 0 0 L 3 3 able 1: able of DH parameers of

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

Lecture 23: I. Data Dependence II. Dependence Testing: Formulation III. Dependence Testers IV. Loop Parallelization V.

Lecture 23: I. Data Dependence II. Dependence Testing: Formulation III. Dependence Testers IV. Loop Parallelization V. Lecure 23: Array Dependence Analysis & Parallelizaion I. Daa Dependence II. Dependence Tesing: Formulaion III. Dependence Tesers IV. Loop Parallelizaion V. Loop Inerchange [ALSU 11.6, 11.7.8] Phillip B.

More information

INDEPENDENT SETS IN GRAPHS WITH GIVEN MINIMUM DEGREE

INDEPENDENT SETS IN GRAPHS WITH GIVEN MINIMUM DEGREE INDEPENDENT SETS IN GRAPHS WITH GIVEN MINIMUM DEGREE JAMES ALEXANDER, JONATHAN CUTLER, AND TIM MINK Absrac The enumeraion of independen ses in graphs wih various resricions has been a opic of much ineres

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

Sublogarithmic Distributed MIS Algorithm for Sparse Graphs using Nash-Williams Decomposition

Sublogarithmic Distributed MIS Algorithm for Sparse Graphs using Nash-Williams Decomposition Sublogarihmic Disribued MIS Algorihm for Sparse Graphs using Nash-Williams Decomposiion [Exended Absrac] ABSTRACT Leonid Barenboim Deparmen of Compuer Science, Ben-Gurion Universiy of he Negev, Beer-Sheva,

More information

THE MATRIX-TREE THEOREM

THE MATRIX-TREE THEOREM THE MATRIX-TREE THEOREM 1 The Marix-Tree Theorem. The Marix-Tree Theorem is a formula for he number of spanning rees of a graph in erms of he deerminan of a cerain marix. We begin wih he necessary graph-heoreical

More information

Efficient Computation of Balanced Structures

Efficient Computation of Balanced Structures Efficien Compuaion of Balanced Srucures David G. Harris, Ehab Morsy, Gopal Pandurangan, Peer Robinson, and Aravind Srinivasan Absrac. Basic graph srucures such as maximal independen ses (MIS s) have spurred

More information

Morning Time: 1 hour 30 minutes Additional materials (enclosed):

Morning Time: 1 hour 30 minutes Additional materials (enclosed): ADVANCED GCE 78/0 MATHEMATICS (MEI) Differenial Equaions THURSDAY JANUARY 008 Morning Time: hour 30 minues Addiional maerials (enclosed): None Addiional maerials (required): Answer Bookle (8 pages) Graph

More information

On the Advantage over a Random Assignment*

On the Advantage over a Random Assignment* On he Advanage over a Random Assignmen* Johan Håsad, 1, S. Venkaesh 2, 1 Nada, KTH, SE-100 44 Sockholm, Sweden; e-mail: johanh@nada.kh.se 2 DIMACS Cener, CoRE Building, Rugers Universiy, 96 Frelinghuysen

More information

We just finished the Erdős-Stone Theorem, and ex(n, F ) (1 1/(χ(F ) 1)) ( n

We just finished the Erdős-Stone Theorem, and ex(n, F ) (1 1/(χ(F ) 1)) ( n Lecure 3 - Kövari-Sós-Turán Theorem Jacques Versraëe jacques@ucsd.edu We jus finished he Erdős-Sone Theorem, and ex(n, F ) ( /(χ(f ) )) ( n 2). So we have asympoics when χ(f ) 3 bu no when χ(f ) = 2 i.e.

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018 MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren

More information

A Hop Constrained Min-Sum Arborescence with Outage Costs

A Hop Constrained Min-Sum Arborescence with Outage Costs A Hop Consrained Min-Sum Arborescence wih Ouage Coss Rakesh Kawara Minnesoa Sae Universiy, Mankao, MN 56001 Email: Kawara@mnsu.edu Absrac The hop consrained min-sum arborescence wih ouage coss problem

More information

15. Vector Valued Functions

15. Vector Valued Functions 1. Vecor Valued Funcions Up o his poin, we have presened vecors wih consan componens, for example, 1, and,,4. However, we can allow he componens of a vecor o be funcions of a common variable. For example,

More information

Optimal Server Assignment in Multi-Server

Optimal Server Assignment in Multi-Server Opimal Server Assignmen in Muli-Server 1 Queueing Sysems wih Random Conneciviies Hassan Halabian, Suden Member, IEEE, Ioannis Lambadaris, Member, IEEE, arxiv:1112.1178v2 [mah.oc] 21 Jun 2013 Yannis Viniois,

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Electrical and current self-induction

Electrical and current self-induction Elecrical and curren self-inducion F. F. Mende hp://fmnauka.narod.ru/works.hml mende_fedor@mail.ru Absrac The aricle considers he self-inducance of reacive elemens. Elecrical self-inducion To he laws of

More information

Variational Iteration Method for Solving System of Fractional Order Ordinary Differential Equations

Variational Iteration Method for Solving System of Fractional Order Ordinary Differential Equations IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728, p-issn: 2319-765X. Volume 1, Issue 6 Ver. II (Nov - Dec. 214), PP 48-54 Variaional Ieraion Mehod for Solving Sysem of Fracional Order Ordinary Differenial

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Reading from Young & Freedman: For this topic, read sections 25.4 & 25.5, the introduction to chapter 26 and sections 26.1 to 26.2 & 26.4.

Reading from Young & Freedman: For this topic, read sections 25.4 & 25.5, the introduction to chapter 26 and sections 26.1 to 26.2 & 26.4. PHY1 Elecriciy Topic 7 (Lecures 1 & 11) Elecric Circuis n his opic, we will cover: 1) Elecromoive Force (EMF) ) Series and parallel resisor combinaions 3) Kirchhoff s rules for circuis 4) Time dependence

More information

KINEMATICS IN ONE DIMENSION

KINEMATICS IN ONE DIMENSION KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t M ah 5 2 7 Fall 2 0 0 9 L ecure 1 0 O c. 7, 2 0 0 9 Hamilon- J acobi Equaion: Explici Formulas In his lecure we ry o apply he mehod of characerisics o he Hamilon-Jacobi equaion: u + H D u, x = 0 in R n

More information

More Digital Logic. t p output. Low-to-high and high-to-low transitions could have different t p. V in (t)

More Digital Logic. t p output. Low-to-high and high-to-low transitions could have different t p. V in (t) EECS 4 Spring 23 Lecure 2 EECS 4 Spring 23 Lecure 2 More igial Logic Gae delay and signal propagaion Clocked circui elemens (flip-flop) Wriing a word o memory Simplifying digial circuis: Karnaugh maps

More information

Chapter 6. Systems of First Order Linear Differential Equations

Chapter 6. Systems of First Order Linear Differential Equations Chaper 6 Sysems of Firs Order Linear Differenial Equaions We will only discuss firs order sysems However higher order sysems may be made ino firs order sysems by a rick shown below We will have a sligh

More information

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed 535 SOFT-DECSON THRESHOLD DECODNG OF CONVOLUTONAL CODES R.M.F. Goodman*, B.Sc., Ph.D. W.H. Ng*, M.S.E.E. Sunnnary Exising majoriy-decision hreshold decoders have so far been limied o his paper a new mehod

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

Comments on Window-Constrained Scheduling

Comments on Window-Constrained Scheduling Commens on Window-Consrained Scheduling Richard Wes Member, IEEE and Yuing Zhang Absrac This shor repor clarifies he behavior of DWCS wih respec o Theorem 3 in our previously published paper [1], and describes

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Basic Circuit Elements Professor J R Lucas November 2001

Basic Circuit Elements Professor J R Lucas November 2001 Basic Circui Elemens - J ucas An elecrical circui is an inerconnecion of circui elemens. These circui elemens can be caegorised ino wo ypes, namely acive and passive elemens. Some Definiions/explanaions

More information

Learning Objectives: Practice designing and simulating digital circuits including flip flops Experience state machine design procedure

Learning Objectives: Practice designing and simulating digital circuits including flip flops Experience state machine design procedure Lab 4: Synchronous Sae Machine Design Summary: Design and implemen synchronous sae machine circuis and es hem wih simulaions in Cadence Viruoso. Learning Objecives: Pracice designing and simulaing digial

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

RC, RL and RLC circuits

RC, RL and RLC circuits Name Dae Time o Complee h m Parner Course/ Secion / Grade RC, RL and RLC circuis Inroducion In his experimen we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors.

More information

Particle Swarm Optimization

Particle Swarm Optimization Paricle Swarm Opimizaion Speaker: Jeng-Shyang Pan Deparmen of Elecronic Engineering, Kaohsiung Universiy of Applied Science, Taiwan Email: jspan@cc.kuas.edu.w 7/26/2004 ppso 1 Wha is he Paricle Swarm Opimizaion

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

Timed Circuits. Asynchronous Circuit Design. Timing Relationships. A Simple Example. Timed States. Timing Sequences. ({r 6 },t6 = 1.

Timed Circuits. Asynchronous Circuit Design. Timing Relationships. A Simple Example. Timed States. Timing Sequences. ({r 6 },t6 = 1. Timed Circuis Asynchronous Circui Design Chris J. Myers Lecure 7: Timed Circuis Chaper 7 Previous mehods only use limied knowledge of delays. Very robus sysems, bu exremely conservaive. Large funcional

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

Echocardiography Project and Finite Fourier Series

Echocardiography Project and Finite Fourier Series Echocardiography Projec and Finie Fourier Series 1 U M An echocardiagram is a plo of how a porion of he hear moves as he funcion of ime over he one or more hearbea cycles If he hearbea repeas iself every

More information

A Note on Superlinear Ambrosetti-Prodi Type Problem in a Ball

A Note on Superlinear Ambrosetti-Prodi Type Problem in a Ball A Noe on Superlinear Ambrosei-Prodi Type Problem in a Ball by P. N. Srikanh 1, Sanjiban Sanra 2 Absrac Using a careful analysis of he Morse Indices of he soluions obained by using he Mounain Pass Theorem

More information

Solutions from Chapter 9.1 and 9.2

Solutions from Chapter 9.1 and 9.2 Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

Online Convex Optimization Example And Follow-The-Leader

Online Convex Optimization Example And Follow-The-Leader CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion

More information

GOAL: A Parsimonious Geographic Routing Protocol for Large Scale Sensor Networks

GOAL: A Parsimonious Geographic Routing Protocol for Large Scale Sensor Networks TRANSACTIONS ON PARALLEL AND DISTRIBUTED COMPUTING, VOL. X, NO. X, SEPTEMBER 2 : A Parsimonious Geographic Rouing Proocol for Large Scale Sensor Neworks Myounggyu Won, Wei Zhang and Radu Soleru Absrac

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Seminar 4: Hotelling 2

Seminar 4: Hotelling 2 Seminar 4: Hoelling 2 November 3, 211 1 Exercise Par 1 Iso-elasic demand A non renewable resource of a known sock S can be exraced a zero cos. Demand for he resource is of he form: D(p ) = p ε ε > A a

More information

Extremal colorings and independent sets

Extremal colorings and independent sets Exremal colorings and independen ses John Engbers Aysel Erey Ocober 17, 2017 Absrac We consider several exremal problems of maximizing he number of colorings and independen ses in some graph families wih

More information

Error Correction and Partial Information Rewriting for Flash Memories

Error Correction and Partial Information Rewriting for Flash Memories Error Correcion and Parial Informaion Rewriing for Flash Memories Yue Li, Anxiao (Andrew) Jiang, and Jehoshua Bruck Texas A&M Universiy, College Saion, TX 7783, USA California Insiue of Technology, Pasadena,

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,

More information

Lecture 4 Notes (Little s Theorem)

Lecture 4 Notes (Little s Theorem) Lecure 4 Noes (Lile s Theorem) This lecure concerns one of he mos imporan (and simples) heorems in Queuing Theory, Lile s Theorem. More informaion can be found in he course book, Bersekas & Gallagher,

More information

Two-level lot-sizing with inventory bounds

Two-level lot-sizing with inventory bounds Two-level lo-sizing wih invenory bounds Siao-Leu Phourasamay, Safia Kedad-Sidhoum, Fanny Pascual Sorbonne Universiés, UPMC Univ Paris 06, CNRS, LIP6 UMR 7606, 4 place Jussieu 75005 Paris. {siao-leu.phourasamay,safia.kedad-sidhoum,fanny.pascual}@lip6.fr

More information

Continuous Time. Time-Domain System Analysis. Impulse Response. Impulse Response. Impulse Response. Impulse Response. ( t) + b 0.

Continuous Time. Time-Domain System Analysis. Impulse Response. Impulse Response. Impulse Response. Impulse Response. ( t) + b 0. Time-Domain Sysem Analysis Coninuous Time. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 1. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 2 Le a sysem be described by a 2 y ( ) + a 1

More information

Math 315: Linear Algebra Solutions to Assignment 6

Math 315: Linear Algebra Solutions to Assignment 6 Mah 35: Linear Algebra s o Assignmen 6 # Which of he following ses of vecors are bases for R 2? {2,, 3, }, {4,, 7, 8}, {,,, 3}, {3, 9, 4, 2}. Explain your answer. To generae he whole R 2, wo linearly independen

More information

arxiv: v1 [stat.ml] 26 Sep 2012

arxiv: v1 [stat.ml] 26 Sep 2012 Reversible MCMC on Markov equivalence classes of sparse direced acyclic graphs arxiv:1209.5860v1 [sa.ml] 26 Sep 2012 Yangbo He 1, Jinzhu Jia 2 and Bin Yu 3 1 School of Mahemaical Sciences and Cener of

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

Staircase Codes for Secret Sharing with Optimal Communication and Read Overheads

Staircase Codes for Secret Sharing with Optimal Communication and Read Overheads Saircase Codes for Secre Sharing wih Opimal Communicaion and Read Overheads Rawad Biar, Salim El Rouayheb ECE Deparmen, IIT, Chicago rbiar@hawkiiedu, salim@iiedu Absrac We sudy he communicaion efficien

More information

Computer-Aided Analysis of Electronic Circuits Course Notes 3

Computer-Aided Analysis of Electronic Circuits Course Notes 3 Gheorghe Asachi Technical Universiy of Iasi Faculy of Elecronics, Telecommunicaions and Informaion Technologies Compuer-Aided Analysis of Elecronic Circuis Course Noes 3 Bachelor: Telecommunicaion Technologies

More information