Analysis of Bipartite Graph Codes on the Binary Erasure Channel

Size: px
Start display at page:

Download "Analysis of Bipartite Graph Codes on the Binary Erasure Channel"

Transcription

1 Anayss of Bpartte Graph Codes on the Bnary Erasure Channe Arya Mazumdar Department of ECE Unversty of Maryand, Coege Par ema: Abstract We derve densty evouton equatons for codes on bpartte graphs BG codes for the bnary erasure channe BEC We study the cases of oca codes beng ntroduced on ony one sde of the graph Generazed LDPC codes as we as on both sdes Each oca code s assumed to correct up to umber of erasures one ess than ts dstance We defne and enumerate stoppng sets for BG codes, whch serves an mportant too for anayss of decodng threshods on the BEC I INTRODUCTION Tanner s constructon of codes on graphs 3] assumes that oca constrants codes are mposed on the subsets of edges ncdent to every vertex of the graph A varant of ths constructon was consdered n 3], 7] where the graph was assumed bpartte wth one sde formed of varabe nodes and the other sde wth oca codes such as the one-error-correctng Hammng codes Ths cass of codes was termed Generazed Low Densty Party Chec GLDPC codes Codes on bpartte graphs n whch oca code constrants are mposed on both sdes and the symbos transmtted correspond to graph s edges were studed n 2] and umber of foow-up wors Ths constructon s caed bpartte-graph BG codes Weght dstrbuton of the versons of BG-codes dscussed was computed n 3], 7], 2] Later wors consdered other versons of ths constructon, such as codes constructed from protographs and computed ther weght dstrbutons 5], or anayzed ther performance wth ext charts 4] Let GV V 2, E be a bpartte graph In the standard constructon of LDPC codes, every u V corresponds to a varabe bt and every v V 2 corresponds to a v, v, 2] snge party-chec code C 2, where v s the degree of v Snce the varabe bt s repcated on every edge eavng the correspondng varabe node u V, we can thn of a u, u, ] repetton code C assocated wth the varabe node u where u s ts degree n G Repacng the code C 2 wth genera near bnary codes whch may be dfferent for dfferent vertces v, we obtan GLDPC codes of 3], 7] these papers assumed Hammng codes at every chec vertex If n addton the code C s repaced by nontrva near bnary codes dfferent vertces may have dfferent codes, we obtan the famy of genera BG codes Theoretca anayss of BG codes prevousy was performed usng graph expanson see 2] and ater wors Our purpose n ths paper s to anayze them under message passng decodng Densty evouton equatons aow us to compute the decodng error probabty for teratve decodng These equatons for an ensembe of LDPC codes for the bnary erasure channe BEC are found n ] and descrbed n greater deta n 0] Wth the hep of these equatons t was aso shown that f the channe erasure probabty s beow some threshod, teratve decodng used on an average code n the ensembe defned by random graphs corrects erasures n the receved vector n a but a sma fracton of transmssons Concentraton anayss performed n ] shows that the probabty of devaton from the average approaches zero exponentay wth the code s ength Paper 4] ntroduced stoppng sets as a combnatora too to characterze decodng faures and estmate the threshod of the message-passng agorthm earer these confguratons were consdered n 5] The dstrbuton of stoppng sets for reguar LDPC codes was found n 8] whch aso used t to estmate the boc error probabty of LDPC codes The paper s organzed as foows In Secton II, we fnd densty evouton equatons on the BEC for the ensembe of BG codes We consder separatey the cases when non-trva oca codes are ntroduced n ony one sde and both sdes of the graph To decode the oca codes we empoy bounded dstance decodng, assumng that each oca code corrects d erasures where d s ts dstance From the densty evouton equatons we obtan the threshod of teratve decodng for both cases We aso fnd an upper bound on the threshod by dervng a stabty condton smar to the one dscussed n 0] In Secton III we defne and enumerate stoppng sets for the reguar ensembe of BG codes Agan we consder the cases of generazed LDPC and douby generazed LDPC codes separatey empoyng the decodng descrbed above We show that the average boc erasure probabty of the ensembe approaches zero at east poynomay n the boc ength n f the erasure probabty of the channe p s ess than some threshod p th, smar to the standard LDPC codes n 8] For p < p th the man contrbuton to the boc erasure probabty s from stoppng sets of sze subnear n n whe the contrbuton from neary-szed stoppng sets decnes exponentay n n Secton IV concudes the paper

2 II DENSITY EVOLUTION EQUATIONS AND THRESHOLD Our anayss w be performed assumng the Tree Channe defned n 0] Asymptotc convergence of the bt error probabty of BG codes to that of the tree channe can be proved smary to that of the standard LDPC codes A Chec-sde generazed BG code Consder transmsson over the BECp wth GLDPC codes Our goa s to derve the densty evouton equatons for ther teratve decodng under whch n every even-numbered teraton a the oca codes at the chec nodes are decoded n parae up to ther mnmum dstance Suppose that the ensembe s characterzed by the degree dstrbutons λ and ρ, where λ s a vector whose th entry λ s the fracton of edges ncdent to varabe nodes of degree and ρ s a matrx n whch ρ,d refers to the fracton of edges ncdent to chec nodes of degree whose oca codes have dstance d We assume that there exst near codes of engths equa to the degrees of the vertces gven by ρ Otherwse the code ensembe can be defned n the same way as standard rreguar LDPC ensembes Ths remar aso appes to genera BG codes beow Denote fp, x p λ,d x x ρ,d d 2 0 Denote by x the average erasure probabty of a bt after teratons Theorem x satsfes the the foowng recurrence: x 0 p, x fp, x,, 2, Proof: The proof s done by nducton wth x 0 p servng as ts base We compute the average erasure probabty of a bt after teratons Consder a chec node of degree and oca code mnmum dstance d Consder the message gong out from ths node It w be an erasure f at east d ncomng messages among the remanng edges are erasures The probabty of ths event equas d 2 x x, 0 as x s the probabty of erasure after the th teraton The probabty that the edge s ncdent to a vertex v V 2 of degree and oca mnmum dstance d equas ρ,d Therefore, the probabty that the message sent aong ths edge to the varabe node s an erasure equas d 2 ] ρ,d x x,d 0 d 2 ρ,d x x,d 0 On the varabe sde consder ode of degree Ths node w send an erasure va an edge f the ncomng messages on a the other edges are erasures and the receved bt tsef was an erasure whch happens wth probabty p d 2 ρ,d x x,d 0 The probabty that an edge comng out from a varabe node of degree s λ Together wth the above ths mpes the theorem Our next goa s to examne some propertes of the functon fp, x Lemma fp, x s ncreasng on both arguments for p, x 0, ] Proof: It s obvous that fp, x s ncreasng on p To show that fp, x s ncreasng on x t suffces to prove that the quantty d 2 ν,d x x x 0 s decreasng on x 0, ] for a, d We have dν d x d 2 x x dx 0 d 2 x x 2 0 d 2 x x d x x d 2 x x ] d + x d 2 x d 0, d 2 whch proves the cam Let P p be the average probabty of erasure after teratons for the ensembe f the channe erasure probabty s p The next two cams foow drecty as a consequence of Lemma Ther proofs are smar to those for LDPC codes 0], Ch 3 Lemma 2 If P p 0 as, and p p, then P p 0 as Moreover, x s monotone n Theorem 2 P p converges to the nearest root of the equaton x fp, x as

3 Usng Lemma 2 we can defne the threshod of teratve decodng for the erasure channe Defnton Consder the ensembe of GLDPC codes characterzed by the degree dstrbuton λ, ρ The threshod probabty p λ, ρ s defned as p λ, ρ sup {p 0, ] : P p 0 as } Theorem 2 provdes the foowng characterzaton of the threshod p λ, ρ sup {p 0, ] : x fp, x has no soutons n 0, ]} nf {p 0, ] : x fp, x has a souton n 0, ]} To determne the threshod numercay we pot fp, x x The argest vaue of p for whch the entre curve s beow the x-axs gves us the threshod Stabty Condton: We have x fp, x fp, 0 + x fp, 0x + Ox 2 Assume that there are no nodes of degree, so fp, 0 0 By a cacuaton smar to the proof of Lemma, we have fp, 0 x p λ,d pλ 2 ρ,2 whch gves ρ,d d + x d 2 x d x0 d 2 x pλ 2 ρ,2 x + Ox 2 2 Notce that the ony contrbuton to the near term comes from chec nodes whose oca codes have dstance 2 Ths gves a condton for the fxed pont at 0 beng stabe Formay speang, we have Theorem 3 If pλ 2 ρ,2 > then m P p > 0 On the other hand f pλ 2 ρ,2 <, then there exsts ζ > 0 such that m P p 0 for a p 0, ζ Coroary p λ, ρ λ 2 ρ,2 3 B Genera BG code We now consder the ensembe of BG codes wth oca constrants ntroduced on both sdes of the graph G used on the BECp In contrast to the LDPC code constructon, the bts of the transmsson are assocated wth the edges of G Our purpose s to derve densty evouton equatons for message passng decodng assumng that the oca codes are decoded up to ther dstance The ensembe s characterzed by two matrces λ and ρ The, dth entry of λ ρ denotes the fracton of edges ncdent to a eft resp, rght node of degree whose oca code has dstance d Let f λ p, x p d 2 λ,d x x,d 0 and f ρ p, x p,d x x ρ,d d 2 0 We w assume that one teraton of decodng conssts of decodng a the rght codes n parae, updatng the bt vaues on the eft and decodng a the eft codes n parae Theorem 4 The erasure probabty x of a bt after teratons of message passng decodng satsfes the foowng recurrence: x 0 p, y f ρ p, x, x f λ p, y Proof: The proof agan goes by nducton Its base hods true by defnton Suppose that the statement s true up to teratons Let y be the probabty of erasure beng sent to the eft sde aong a randomy chosen edge n the th teraton Ceary, an edge w carry an erasure to eft f t was erased n transmsson and the rght decodng nvovng t dd not recover ts vaue Thus, y p d 2 ρ,d x x,d 0 The expresson for x foows mmedatey Lemma 3 The functon gp, x f λ p, f ρ p, x s ncreasng n both arguments for p, x 0, ] Proof: From Lemma t foows that both f λ p, x and f ρ p, x are ncreasng functons of p and x 0, ] Let P 2 p be the ensembe-average probabty of erasure after teratons We have the foowng: Lemma 4 If P 2 p 0 as, and p p, then P 2 p 0 as Moreover, x s monotonc n Theorem 5 P 2 p converges to the nearest root of the equaton x gp, x, as Defnton 2 Consder a BG code characterzed by the dstrbutons λ, ρ The threshod probabty p λ, ρ equas p λ, ρ sup {p 0, ] : P 2 p 0 as } 4 The threshod probabty can be characterzed as foows: p λ, ρ sup {p 0, ] : x gp, x has no souton n 0, ]} nf {p 0, ] : x gp, x has a souton n 0, ]}

4 Stabty Condton: Wrtng out a quadratc Tayor poynoma for g we obtan x gp, x gp, 0 + x gp, 0x + Ox 2 We get gp, 0 f λ p, f ρ p, 0 0 Moreover, whch gves x p 2 x gp, 0 f λp, f ρ p, 0f ρp, 0 f λp, 0f ρp, 0 p λ,2 λ 2 p ρ 2 ρ,2 x + Ox 2 5 Agan ony oca codes wth mnmum dstance 2 contrbute to the near term We have the foowng stabty condton for the fxed pont at 0, Theorem 6 If p 2 λ,2 ρ,2 x > then m P 2 p > 0 On the other hand f p2 λ,2 ρ,2 x <, then there s ζ > 0 such that m P 2 p 0 for a p 0, ζ An upper bound on the threshod probabty s gven n the next coroary Coroary 2 p λ, ρ C Ext Charts λ,2 ρ,2 An anayss of threshod probabty can aso be done usng the ext charts For the defnton of ext functon we refer the reader to Chapter 3 of 0] In the foowng anayss we consder b-reguar bpartte graph codes wth constant eft degree be and rght degree The anayss though can be easy generazed to rreguar bpartte graph wth a gven degree dstrbuton Let us assume that we have the codes C, ] and C, 2 ] on the eft and rght nodes respectvey Moreover we assume that, these codes are chosen from an ensembe of random near codes of the same parameters An anayss smar to the one beow appears n 9] The ext functon of a near code wth parameters n, ] n an erasure channe s gven by Equaton 40 of ], H n, x n n x g x n g g gẽ g,n, n g + ẽ g,n, ] 6 where, ẽ h,n, s the unnormazed nformaton functon defned n 6] for a code wth parameters n, ] For random near codes wth parameters n, ], the expected nformaton functon s gven by, Eẽ h,n, n h h h n r ] r r0 ] n h r ] 2 rn h +r where a r] s the Gaussan bnoma coeffcent defned by ] r a 2 a 2 r 2 r 2 Consder transmsson over BECp In ths case the ext functon from the eft hand sde of the bpartte graph to an edge s H E x H, x 7 The ext functon from the rght hand vertces, H E2,p s H E2,p x ph, 2 px 8 Ext Chart of BG Code wth 24,8 random near oca codes on BEC H E x H x E2,035 H E2,042 x H E2,045 x x Fg The Ext Chart for a Bpartte Graph Code wth random near component codes In Fg we have potted the ext chart for a bpartte graph code wth parameters 24 and 2 8 The ext functons are average of a near codes of parameters 24, 8] The fgure shows the chart for a channe wth erasure probabtes p 035, p 042 and p 045 From the ext chart anayss, the threshod probabty for the above mentoned code s gven by p 045 The code has rate > III STOPPING SETS AND THEIR ENUMERATION Let us defne stoppng sets n the context of teratve decodng on the BEC Defnton 3 A subset of edges s caed a stoppng set f erasures n these edges submtted to the next teraton

5 of teratve decodng are not recovered n ths teraton By defnton, empty set s a stoppng set For GLDPC codes stoppng sets can be equvaenty defned as subsets of varabe nodes The set of stoppng sets w be denoted by Γ Consder an ensembe of BG codes of ength n Defne the normazed ensembe-average stoppng set dstrbuton γα, α 0, ] as foows Let γα m n E {S Γ : S αn} ] 9 n n p th sup{p : max γα α 0,] p α + αh hp] < 0} 0 α where, h s the bnary entropy functon n nats Let P B C n, p be the boc erasure probabty of a code C n from the ensembe on the BECp Theorem 7 Let p < p th Then such that EP B C n, p] E {S Γ : S } ]p +exp Θn where the expectaton s over the ensembe of BG codes of ength n and m n n 0 For standard LDPC codes ths resut appears n 8] The proof for the generazed case s competey anaogous Moreover t s nown that for reguar LDPC codes, the rght-hand sde of goes to 0 poynomay wth n We w show that the same hods for genera BG codes and w aso fnd an expresson for γα These resuts mpy a computabe bound on the threshod for boc error rate of BG codes The quanttatve defnton of stoppng sets depends on the oca decodng empoyed adopted n the teratve agorthm In our resuts beow we agan assume that a oca code can correct up to d erasures, where d s ts dstance In the foowng we consder reguar BG codes wth eft degree and rght degree Moreover we assume that a the oca codes on one sde are the same t suffces to assume that they have the same mnmum dstance or are decoded up to the same number of erasure Extenson of the resuts to the case of rreguar BG codes wth gven eft and rght degree dstrbutons as we as dfferent code dstances s straghtforward athough the resuts become more cumbersome A GLDPC codes Consder reguar GLDPC codes wth eft degree and rght degree Let V 2 and V be the sets of chec nodes and varabe nodes respectvey Let d denote the mnmum dstance of the oca codes at the vertces v V In each teraton these codes are decoded up to d erasures Denote by N R S the neghborhood n V 2 of a subset of vertces S V From Defnton 3 we have the foowng Defnton 4 A stoppng set S V s a subset of vertces such that any vertex v N R S s connected to at east d vertces n S Accordng to the above defnton, the set of stoppng sets s cosed under the unon operaton So every subset of varabe nodes has a unque maxma stoppng set whch can be an empty set If Ω V s the set of bts varabe nodes erased n transmsson, then the set of erasures whch remans when the decoder stops s equa to the unque maxma stoppng set contaned n Ω Theorem 8 The expected number of stoppng sets of sze s n the reguar ensembe of GLDPC codes s gven by, E {S Γ : S s} ] coef n s + x d x n s n, x s ] where coeffx, x denotes the coeffcent of x n fx 2 Proof: Let E be the set of edges of G Gven a chec node c the number of ways of choosng of ts socets s coef+x, x The number of ways of choosng of ts socets such that 0 or d equas coef + x d x, x So the number of ways of choosng e chec node socets from a the socets of V 2, such that every chec node connected to the socets s connected to at east d of them, s gven by coef+x d x ] V2, x e Let U V, U s The number of edges ncdent to U s e s The probabty that these e edges are such that U becomes a stoppng set equas P ru Γ coef + x d coef E e + x d x ] V2, x e ] x n, x s n s Fnay there are n s ways of choosng U, whch proves the theorem Theorem 9 The normazed average stoppng set dstrbuton s gven by x 0 γα n + d x α 0 where x 0 s the postve souton of the equaton α + d hα, 3 α x 0 0 Proof: From the defnton of γα we have

6 n γα m n n n αn coef + x d n α n ] x n, x α ] n hα + m n coef n n d ] x n, x α n hα + m n n + x x d,x d+,,x : d xα n n x d, x d+,, x, n d x d x Let y x n Notcng that the above sum contans umber of terms poynoma n n and usng asymptotc propertes of mutnoma coeffcents, we have γα hα + hy d, y d+,, y, y + d max y d,y d+,,y : d yα d y n where hz,, z t t z n/z Evauatng the maxmum, we obtan the cam of the theorem Next et us use the above resuts to estmate the threshod of boc error rate for teratve decodng of GLDPC codes We need the foowng emma Lemma 5 Let < m and d >, then d ] coef + x 2 x m, x d m + d 2 3 Proof: The proof proceeds n the same way of countng as n Lemma 8 of 8], whch gves a smar statement for d 2 Except generazng ths, we use the foowng bound, d m d + m d Theorem 0 Let p 0, ], then E {S Γ : S } ]p O n /d such that m n n 0 4 Proof: We use the bound of the above emma as foows, s s s E {S Γ : S s} ]p s n s n s coef + x d s d n s ] x n, x s s + n s 2 3 s d n s whch can be bounded above by decreasng geometrc sequences, for a on Therefore, E {S Γ : S s} ]p s O n /d s whch proves the theorem The above theorem aong wth Equaton estabshes p th as the threshod of boc erasure probabty beow whch the expected boc erasure probabty goes to 0 wth n Numerca vaues of p th can be easy computed from Equatons 0 and 3 B Genera BG codes Consder reguar BG codes wth eft degree and rght degree Let E be the set of edges of G, E n V V 2 Consder the ensembe of graphs obtaned by connectng the vertces n V wth the vertces n V 2 usng a permutatons on the set of n edges Denote by d and d 2 the oca dstances at the vertces of V and V 2, respectvey In teratons, the oca codes w be decoded to correct d erasures, where d d or d 2 as approprate Defnton 5 Let S E be a subset of edges and et V S and V 2 S be the sets of eft and rght nodes to whch they are ncdent Then S s caed a stoppng set f every u V S has S-degree at east d n S and every v V 2 S has S- degree at east d 2 As before, the set of stoppng sets s cosed under tang the unon Therefore, every subset of edges has a unque maxma stoppng set whch can be an empty set If Ω E s the subset of bts erased n transmsson, then the set of erasures whch remans when the decoder stops s equa to the unque maxma stoppng set of Ω Theorem The expected number of stoppng sets of sze s n the, -breguar ensembe of BG codes s gven by E {S Γ : S s} ] 2 coef + x d x n, x s ] n s Proof: Consder an s-subset U E From Theorem 8, the number of ways of choosng s rght node socets from a the socets of V 2, such that every rght node connected to the socets s connected to at east d 2 of them, s gven by p s p s

7 coef+x d 2 x ] V2, x s A smar expresson can be found for the eft sde If the graph s chosen randomy then the events of U satsfyng the constrants on the eft sde and the rght sde are ndependent So we have P ru Γ] 2 coef + x d n s 2 ] x n, x s because V n and V 2 n Snce there are n s ways of choosng U, ths competes the proof Theorem 2 The normazed average stoppng set dstrbuton s gven by γα 2 n + ] d x x α hα where x,, 2 s the postve souton of the equaton α + α x 0 d Proof: From the defnton of γα we have, γα m n n 2 coef + x d n n αn hα + m n 2 n coef + x n d ] x n, x αn x n, x αn ] We proceed the same way as Theorem 9, obtanng γα hα + 2 hy d, y d +,, y, max y d,y d +,,y : d y α d y + d y n Evauatng the maxmum, we obtan the statement of the theorem Theorem 3 Let p 0, ], then E {S Γ : S } ]p O n /d /d 2 such that m n n 0 5 Proof: We use the bound of the Lemma 5, to have, s E {S Γ : S s} ]p s p s s 2 coef + x d s n s x n, x s ] 2 s d s + n 2 3 s s d n s p s whch can be bounded from above by decreasng geometrc sequences for on Therefore, a E {S Γ : S s} ]p s O n /d /d2 s From, f the erasure probabty satsfes p < p th, the expected boc error probabty goes to 0 wth n We can compute p th numercay usng Equaton 0 and Theorem 2 IV CONCLUDING REMARKS We notce from both equatons 2 and 5, that for an ensembe of BG codes wth oca code mnmum dstance at east 3, the near terms dsappear, mang x Ox 2 Ths means that the fxed pont of densty evouton equatons at 0 s aways stabe n these cases In case of conventona LDPC codes, the stabty condton mposes an upper bound on the threshod probabty, but n an ensembe of BG codes wth oca code mnmum dstance at east 3 no such constrant s mposed on the threshod If we tae an ensembe of graphs wth gven degree dstrbuton and consder GLDPC codes on t, we obtan a better threshod from the densty evoutons compared to that of LDPC codes on the same ensembe The same appes for the threshod p th for the average boc error probabty Consder a breguar ensembe of bpartte graphs wth eft and rght degrees and respectvey For GLDPC codes, f the rate of the oca codes at the chec node s fxed at R L, then the overa rate of the code s R L, whch s ower than LDPC codes on the same graph Thus the better decodng threshod of these codes s at the expense of decreasng the rate For a genera BG code on a breguar graph, the overa rate s R +R 2, where codes of rate R and R 2 are used on the eft and rght nodes respectvey These codes have better rate and threshods compared to GLDPC codes 2 The stoppng set dstrbuton above s derved n the context of bounded dstance decodng If we now the ran dstrbuton of the oca codes, then t s aso possbe to fnd the stoppng set dstrbuton under ML decodng at the vertces For a gven vertex v et C v be the oca code assocated wth t Denote by Ev and N L v, respectvey the set of edges ncdent to v and the set of varabe nodes connected to v The

8 defntons of stoppng sets n ths case shoud be modfed as foows Defnton 6 Stoppng sets for GLDPC codes wth oca ML decodng: Let S V and et N R S be the set of chec nodes connected to S S s caed a stoppng set f for every v N R S the set of edges N L v \ S does not contan an nformaton set of C v Defnton 7 Stoppng sets for genera BG codes wth oca ML decodng: A subset S E s caed a stoppng set f for any u V S, the set Eu \ S does not contan an nformaton set of C u, and for any v V 2 S, the set Ev\S does not contan an nformaton set of C v 5] V V Zyabov and M S Pnser, Compexty of Decodng Low-Densty Codes n Transmsson Over a Channe wth Erasures, Prob Inform Trans, Vo 0, no, 974, 5 28 In a future wor, we pan to study the performance of BG codes under message passng decodng on the bnary symmetrc channe and other dscrete channes Acnowedgement The author s gratefu to Aexander Barg for numerous hepfu dscussons Ths research s supported n part by NSF grant CCF05524 REFERENCES ] A Ashhmn, G Kramer and S ten Brn, Extrnsc Informaton Transfer Functons: Mode and Erasure Channe Propertes, IEEE Transactons on Informaton Theory, Vo 50, No, November ] A Barg and G Zémor, Dstance Propertes of Expander Codes, IEEE Transactons on Informaton Theory, Vo 52, No, January ] J Boutros, O Pother and G Zémor, Generazed Low Densty Tanner Codes, Proceedngs of IEEE Internatona Conference on Communcatons ICC, Vo, Vancouver, BC, Canada, 999, pp ] C D, D Proett, I E Teatar, T J Rchardson and R L Urbane, Fnte-Length Anayss of Low Densty Party-Chec Codes on Bnary Erasure Channe, IEEE Transactons on Informaton Theory, Vo 48, No 6, June ] D Dvsaar, Ensembe Weght Enumerators for Protograph LDPC codes, Proceedngs of IEEE Internatona Symposum on Informaton Theory ISIT, Seatte, USA, Juy, 2006, pp ] T Heeseth, T Kove and V I Levenshten, On the Informaton Functon of an Error-Correctng Code, IEEE Transactons on Informaton Theory, Vo 43, No 2, March 997 7] M Lentmaer and K Sh Zgangrov, On Generazed Low Densty Party Chec Codes Based on Hammng Component Codes, IEEE Communcaton Letters, Vo 3, No 8, 999 8] A Ortsy, K Vswanathan and J Zhang, Stoppng Set Dstrbuton of LDPC code ensembes, IEEE Transactons on Informaton Theory, Vo 5, No 3, March ] E Paon, M Fossorer and M Chan Anayss of Generazed LDPC Codes wth Random Component Codes for the Bnary Erasure Channe, Internatona Symposum on Informaton Theory and ts Appcatons ISITA, Seou, Korea, October 29 - November, ] T J Rchardson and R L Urbane, Modern Codng Theory, avaabe onne at ] T J Rchardson, M A Shoroah and R L Urbane, Desgn of Capacty-Approachng Irreguar Low-Densty Party-Chec Codes, IEEE Transactons on Informaton Theory, Vo 47, No 2, February ] M Spser and D A Speman, Expander Codes, IEEE Transactons on Informaton Theory, Vo 42, No 6, November 996 3] R M Tanner, A Recursve Approach to Low Compexty Codes, IEEE Transactons on Informaton Theory, Vo IT-26, No 5, September 98 4] Y Wang and M Fossorer, Douby Generazed LDPC codes, Proceedngs of IEEE Internatona Symposum on Informaton Theory ISIT, Seatte, USA, Juy, 2006, pp

Analysis of Non-binary Hybrid LDPC Codes

Analysis of Non-binary Hybrid LDPC Codes Anayss of Non-bnary Hybrd LDPC Codes Luce Sassate and Davd Decercq ETIS ENSEA/UCP/CNRS UMR-5 954 Cergy, FRANCE {sassate,decercq}@ensea.fr Abstract Ths paper s egbe for the student paper award. In ths paper,

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

LOW-DENSITY Parity-Check (LDPC) codes have received

LOW-DENSITY Parity-Check (LDPC) codes have received IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 59, NO. 7, JULY 2011 1807 Successve Maxmzaton for Systematc Desgn of Unversay Capacty Approachng Rate-Compatbe Sequences of LDPC Code Ensembes over Bnary-Input

More information

Cyclic Codes BCH Codes

Cyclic Codes BCH Codes Cycc Codes BCH Codes Gaos Feds GF m A Gaos fed of m eements can be obtaned usng the symbos 0,, á, and the eements beng 0,, á, á, á 3 m,... so that fed F* s cosed under mutpcaton wth m eements. The operator

More information

Associative Memories

Associative Memories Assocatve Memores We consder now modes for unsupervsed earnng probems, caed auto-assocaton probems. Assocaton s the task of mappng patterns to patterns. In an assocatve memory the stmuus of an ncompete

More information

On the Power Function of the Likelihood Ratio Test for MANOVA

On the Power Function of the Likelihood Ratio Test for MANOVA Journa of Mutvarate Anayss 8, 416 41 (00) do:10.1006/jmva.001.036 On the Power Functon of the Lkehood Rato Test for MANOVA Dua Kumar Bhaumk Unversty of South Aabama and Unversty of Inos at Chcago and Sanat

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory Advanced Scence and Technoogy Letters Vo.83 (ISA 205), pp.60-65 http://dx.do.org/0.4257/ast.205.83.2 Research on Compex etworks Contro Based on Fuzzy Integra Sdng Theory Dongsheng Yang, Bngqng L, 2, He

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Complete subgraphs in multipartite graphs

Complete subgraphs in multipartite graphs Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G

More information

MARKOV CHAIN AND HIDDEN MARKOV MODEL

MARKOV CHAIN AND HIDDEN MARKOV MODEL MARKOV CHAIN AND HIDDEN MARKOV MODEL JIAN ZHANG JIANZHAN@STAT.PURDUE.EDU Markov chan and hdden Markov mode are probaby the smpest modes whch can be used to mode sequenta data,.e. data sampes whch are not

More information

Lower bounds for the Crossing Number of the Cartesian Product of a Vertex-transitive Graph with a Cycle

Lower bounds for the Crossing Number of the Cartesian Product of a Vertex-transitive Graph with a Cycle Lower bounds for the Crossng Number of the Cartesan Product of a Vertex-transtve Graph wth a Cyce Junho Won MIT-PRIMES December 4, 013 Abstract. The mnmum number of crossngs for a drawngs of a gven graph

More information

Lecture 5 Decoding Binary BCH Codes

Lecture 5 Decoding Binary BCH Codes Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture

More information

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem. Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Optimum Selection Combining for M-QAM on Fading Channels

Optimum Selection Combining for M-QAM on Fading Channels Optmum Seecton Combnng for M-QAM on Fadng Channes M. Surendra Raju, Ramesh Annavajjaa and A. Chockangam Insca Semconductors Inda Pvt. Ltd, Bangaore-56000, Inda Department of ECE, Unversty of Caforna, San

More information

Interference Alignment and Degrees of Freedom Region of Cellular Sigma Channel

Interference Alignment and Degrees of Freedom Region of Cellular Sigma Channel 2011 IEEE Internatona Symposum on Informaton Theory Proceedngs Interference Agnment and Degrees of Freedom Regon of Ceuar Sgma Channe Huaru Yn 1 Le Ke 2 Zhengdao Wang 2 1 WINLAB Dept of EEIS Unv. of Sc.

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

Randić Energy and Randić Estrada Index of a Graph

Randić Energy and Randić Estrada Index of a Graph EUROPEAN JOURNAL OF PURE AND APPLIED MATHEMATICS Vol. 5, No., 202, 88-96 ISSN 307-5543 www.ejpam.com SPECIAL ISSUE FOR THE INTERNATIONAL CONFERENCE ON APPLIED ANALYSIS AND ALGEBRA 29 JUNE -02JULY 20, ISTANBUL

More information

L-Edge Chromatic Number Of A Graph

L-Edge Chromatic Number Of A Graph IJISET - Internatona Journa of Innovatve Scence Engneerng & Technoogy Vo. 3 Issue 3 March 06. ISSN 348 7968 L-Edge Chromatc Number Of A Graph Dr.R.B.Gnana Joth Assocate Professor of Mathematcs V.V.Vannaperuma

More information

corresponding to those of Heegaard diagrams by the band moves

corresponding to those of Heegaard diagrams by the band moves Agebra transformatons of the fundamenta groups correspondng to those of Heegaard dagrams by the band moves By Shun HORIGUCHI Abstract. Ths paper gves the basc resut of [1](1997),.e., a hande sdng and a

More information

Refined Coding Bounds for Network Error Correction

Refined Coding Bounds for Network Error Correction Refned Codng Bounds for Network Error Correcton Shenghao Yang Department of Informaton Engneerng The Chnese Unversty of Hong Kong Shatn, N.T., Hong Kong shyang5@e.cuhk.edu.hk Raymond W. Yeung Department

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Assignment 2. Tyler Shendruk February 19, 2010

Assignment 2. Tyler Shendruk February 19, 2010 Assgnment yler Shendruk February 9, 00 Kadar Ch. Problem 8 We have an N N symmetrc matrx, M. he symmetry means M M and we ll say the elements of the matrx are m j. he elements are pulled from a probablty

More information

MATH 5707 HOMEWORK 4 SOLUTIONS 2. 2 i 2p i E(X i ) + E(Xi 2 ) ä i=1. i=1

MATH 5707 HOMEWORK 4 SOLUTIONS 2. 2 i 2p i E(X i ) + E(Xi 2 ) ä i=1. i=1 MATH 5707 HOMEWORK 4 SOLUTIONS CİHAN BAHRAN 1. Let v 1,..., v n R m, all lengths v are not larger than 1. Let p 1,..., p n [0, 1] be arbtrary and set w = p 1 v 1 + + p n v n. Then there exst ε 1,..., ε

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION European Journa of Mathematcs and Computer Scence Vo. No. 1, 2017 ON AUTOMATC CONTNUTY OF DERVATONS FOR BANACH ALGEBRAS WTH NVOLUTON Mohamed BELAM & Youssef T DL MATC Laboratory Hassan Unversty MORO CCO

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

LECTURE 21 Mohr s Method for Calculation of General Displacements. 1 The Reciprocal Theorem

LECTURE 21 Mohr s Method for Calculation of General Displacements. 1 The Reciprocal Theorem V. DEMENKO MECHANICS OF MATERIALS 05 LECTURE Mohr s Method for Cacuaton of Genera Dspacements The Recproca Theorem The recproca theorem s one of the genera theorems of strength of materas. It foows drect

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

Planar maps and continued fractions

Planar maps and continued fractions Batz 2010 p. 1/4 Planar maps and contnued fractons n collaboraton wth Jéréme Boutter 1 3 3 2 0 3 1 maps and dstances: generaltes Batz 2010 p. 2/4 Batz 2010 p. 3/4 degree of a face = number of ncdent edge

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Image Classification Using EM And JE algorithms

Image Classification Using EM And JE algorithms Machne earnng project report Fa, 2 Xaojn Sh, jennfer@soe Image Cassfcaton Usng EM And JE agorthms Xaojn Sh Department of Computer Engneerng, Unversty of Caforna, Santa Cruz, CA, 9564 jennfer@soe.ucsc.edu

More information

Nested case-control and case-cohort studies

Nested case-control and case-cohort studies Outne: Nested case-contro and case-cohort studes Ørnuf Borgan Department of Mathematcs Unversty of Oso NORBIS course Unversty of Oso 4-8 December 217 1 Radaton and breast cancer data Nested case contro

More information

Dynamic Systems on Graphs

Dynamic Systems on Graphs Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Exercise Solutions to Real Analysis

Exercise Solutions to Real Analysis xercse Solutons to Real Analyss Note: References refer to H. L. Royden, Real Analyss xersze 1. Gven any set A any ɛ > 0, there s an open set O such that A O m O m A + ɛ. Soluton 1. If m A =, then there

More information

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks Shengyang Sun, Changyou Chen, Lawrence Carn Suppementary Matera: Learnng Structured Weght Uncertanty n Bayesan Neura Networks Shengyang Sun Changyou Chen Lawrence Carn Tsnghua Unversty Duke Unversty Duke

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

n ). This is tight for all admissible values of t, k and n. k t + + n t

n ). This is tight for all admissible values of t, k and n. k t + + n t MAXIMIZING THE NUMBER OF NONNEGATIVE SUBSETS NOGA ALON, HAROUT AYDINIAN, AND HAO HUANG Abstract. Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what

More information

G : Statistical Mechanics

G : Statistical Mechanics G25.2651: Statstca Mechancs Notes for Lecture 11 I. PRINCIPLES OF QUANTUM STATISTICAL MECHANICS The probem of quantum statstca mechancs s the quantum mechanca treatment of an N-partce system. Suppose the

More information

Geometric drawings of K n with few crossings

Geometric drawings of K n with few crossings Geometrc drawngs of K n wth few crossngs Bernardo M. Ábrego, Slva Fernández-Merchant Calforna State Unversty Northrdge {bernardo.abrego,slva.fernandez}@csun.edu ver 9 Abstract We gve a new upper bound

More information

Asymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation

Asymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation Nonl. Analyss and Dfferental Equatons, ol., 4, no., 5 - HIKARI Ltd, www.m-har.com http://dx.do.org/.988/nade.4.456 Asymptotcs of the Soluton of a Boundary alue Problem for One-Characterstc Dfferental Equaton

More information

Min Cut, Fast Cut, Polynomial Identities

Min Cut, Fast Cut, Polynomial Identities Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

On the Stopping Distance and the Stopping Redundancy of Codes

On the Stopping Distance and the Stopping Redundancy of Codes On the Stoppng Dstance and the Stoppng Redundancy of Codes Moshe Schwartz Unversty of Calforna San Dego La Jolla, CA 92093, U.S.A. moosh@everest.ucsd.edu Abstract It s now well known that the performance

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Volume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2].

Volume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2]. Bulletn of Mathematcal Scences and Applcatons Submtted: 016-04-07 ISSN: 78-9634, Vol. 18, pp 1-10 Revsed: 016-09-08 do:10.1805/www.scpress.com/bmsa.18.1 Accepted: 016-10-13 017 ScPress Ltd., Swtzerland

More information

How to Find Good Finite-Length Codes: From Art Towards Science

How to Find Good Finite-Length Codes: From Art Towards Science How to Fnd Good Fnte-Length Codes: From Art Towards Scence Abdelazz Amraou Andrea Montanar and Ruedger Urbanke arxv:cs.it/6764 v 3 Jul 26 Abstract We explan how to optmze fnte-length LDPC codes for transmsson

More information

Appendix B. Criterion of Riemann-Stieltjes Integrability

Appendix B. Criterion of Riemann-Stieltjes Integrability Appendx B. Crteron of Remann-Steltes Integrablty Ths note s complementary to [R, Ch. 6] and [T, Sec. 3.5]. The man result of ths note s Theorem B.3, whch provdes the necessary and suffcent condtons for

More information

Lecture 10: May 6, 2013

Lecture 10: May 6, 2013 TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,

More information

COXREG. Estimation (1)

COXREG. Estimation (1) COXREG Cox (972) frst suggested the modes n whch factors reated to fetme have a mutpcatve effect on the hazard functon. These modes are caed proportona hazards (PH) modes. Under the proportona hazards

More information

DIOPHANTINE EQUATIONS WITH BINOMIAL COEFFICIENTS AND PERTURBATIONS OF SYMMETRIC BOOLEAN FUNCTIONS

DIOPHANTINE EQUATIONS WITH BINOMIAL COEFFICIENTS AND PERTURBATIONS OF SYMMETRIC BOOLEAN FUNCTIONS DIOPHANTINE EQUATIONS WITH BINOMIAL COEFFICIENTS AND PERTURBATIONS OF SYMMETRIC BOOLEAN FUNCTIONS FRANCIS N CASTRO, OSCAR E GONZÁLEZ, AND LUIS A MEDINA Abstract Ths work presents a study of perturbatons

More information

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Supplementary Notes for Chapter 9 Mixture Thermodynamics Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

Math 217 Fall 2013 Homework 2 Solutions

Math 217 Fall 2013 Homework 2 Solutions Math 17 Fall 013 Homework Solutons Due Thursday Sept. 6, 013 5pm Ths homework conssts of 6 problems of 5 ponts each. The total s 30. You need to fully justfy your answer prove that your functon ndeed has

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

A finite difference method for heat equation in the unbounded domain

A finite difference method for heat equation in the unbounded domain Internatona Conerence on Advanced ectronc Scence and Technoogy (AST 6) A nte derence method or heat equaton n the unbounded doman a Quan Zheng and Xn Zhao Coege o Scence North Chna nversty o Technoogy

More information

Problem Do any of the following determine homomorphisms from GL n (C) to GL n (C)?

Problem Do any of the following determine homomorphisms from GL n (C) to GL n (C)? Homework 8 solutons. Problem 16.1. Whch of the followng defne homomomorphsms from C\{0} to C\{0}? Answer. a) f 1 : z z Yes, f 1 s a homomorphsm. We have that z s the complex conjugate of z. If z 1,z 2

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

3. Stress-strain relationships of a composite layer

3. Stress-strain relationships of a composite layer OM PO I O U P U N I V I Y O F W N ompostes ourse 8-9 Unversty of wente ng. &ech... tress-stran reatonshps of a composte ayer - Laurent Warnet & emo Aerman.. tress-stran reatonshps of a composte ayer Introducton

More information

EGR 544 Communication Theory

EGR 544 Communication Theory EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Statistical Mechanics and Combinatorics : Lecture III

Statistical Mechanics and Combinatorics : Lecture III Statstcal Mechancs and Combnatorcs : Lecture III Dmer Model Dmer defntons Defnton A dmer coverng (perfect matchng) of a fnte graph s a set of edges whch covers every vertex exactly once, e every vertex

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Delay tomography for large scale networks

Delay tomography for large scale networks Deay tomography for arge scae networks MENG-FU SHIH ALFRED O. HERO III Communcatons and Sgna Processng Laboratory Eectrca Engneerng and Computer Scence Department Unversty of Mchgan, 30 Bea. Ave., Ann

More information

First Year Examination Department of Statistics, University of Florida

First Year Examination Department of Statistics, University of Florida Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve

More information

The L(2, 1)-Labeling on -Product of Graphs

The L(2, 1)-Labeling on -Product of Graphs Annals of Pure and Appled Mathematcs Vol 0, No, 05, 9-39 ISSN: 79-087X (P, 79-0888(onlne Publshed on 7 Aprl 05 wwwresearchmathscorg Annals of The L(, -Labelng on -Product of Graphs P Pradhan and Kamesh

More information

Random Walks on Digraphs

Random Walks on Digraphs Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected

More information

Graph Reconstruction by Permutations

Graph Reconstruction by Permutations Graph Reconstructon by Permutatons Perre Ille and Wllam Kocay* Insttut de Mathémathques de Lumny CNRS UMR 6206 163 avenue de Lumny, Case 907 13288 Marselle Cedex 9, France e-mal: lle@ml.unv-mrs.fr Computer

More information

THE METRIC DIMENSION OF AMALGAMATION OF CYCLES

THE METRIC DIMENSION OF AMALGAMATION OF CYCLES Far East Journa of Mathematca Scences (FJMS) Voume 4 Number 00 Pages 9- Ths paper s avaabe onne at http://pphm.com/ournas/fms.htm 00 Pushpa Pubshng House THE METRIC DIMENSION OF AMALGAMATION OF CYCLES

More information

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,

More information

Finite Length Weight Enumerator Analysis of Braided Convolutional Codes

Finite Length Weight Enumerator Analysis of Braided Convolutional Codes Fnte Length Weght Enumerator Analyss of Braded Convolutonal Codes Saeedeh Moloud, Mchael Lentmaer, and Alexandre Graell Amat Department of Electrcal and Informaton Technology, Lund Unversty, Lund, Sweden

More information

First day August 1, Problems and Solutions

First day August 1, Problems and Solutions FOURTH INTERNATIONAL COMPETITION FOR UNIVERSITY STUDENTS IN MATHEMATICS July 30 August 4, 997, Plovdv, BULGARIA Frst day August, 997 Problems and Solutons Problem. Let {ε n } n= be a sequence of postve

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Self-complementing permutations of k-uniform hypergraphs

Self-complementing permutations of k-uniform hypergraphs Dscrete Mathematcs Theoretcal Computer Scence DMTCS vol. 11:1, 2009, 117 124 Self-complementng permutatons of k-unform hypergraphs Artur Szymańsk A. Paweł Wojda Faculty of Appled Mathematcs, AGH Unversty

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

Entropy of Markov Information Sources and Capacity of Discrete Input Constrained Channels (from Immink, Coding Techniques for Digital Recorders)

Entropy of Markov Information Sources and Capacity of Discrete Input Constrained Channels (from Immink, Coding Techniques for Digital Recorders) Entropy of Marov Informaton Sources and Capacty of Dscrete Input Constraned Channels (from Immn, Codng Technques for Dgtal Recorders). Entropy of Marov Chans We have already ntroduced the noton of entropy

More information

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

General viscosity iterative method for a sequence of quasi-nonexpansive mappings Avalable onlne at www.tjnsa.com J. Nonlnear Sc. Appl. 9 (2016), 5672 5682 Research Artcle General vscosty teratve method for a sequence of quas-nonexpansve mappngs Cuje Zhang, Ynan Wang College of Scence,

More information

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities Supplementary materal: Margn based PU Learnng We gve the complete proofs of Theorem and n Secton We frst ntroduce the well-known concentraton nequalty, so the covarance estmator can be bounded Then we

More information

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA RESEARCH ARTICLE MOELING FIXE OS BETTING FOR FUTURE EVENT PREICTION Weyun Chen eartment of Educatona Informaton Technoogy, Facuty of Educaton, East Chna Norma Unversty, Shangha, CHINA {weyun.chen@qq.com}

More information