A Comparison of ARA- and Protograph-Based LDPC Block and Convolutional Codes

Size: px
Start display at page:

Download "A Comparison of ARA- and Protograph-Based LDPC Block and Convolutional Codes"

Transcription

1 A Comparson of ARA- and Protograph-Based LDPC Block and Convolutonal Codes Danel J. Costello, Jr., Al Emre Pusane Department of Electrcal Engneerng Unversty of Notre Dame Notre Dame, IN 46556, U.S.A. {Costello.2, Chrstopher R. Jones, Darush Dvsalar Jet Propulson Laboratory Pasadena, CA U.S.A. {crjones, Abstract ARA- and protograph-based LDPC codes are capable of achevng error performance smlar to randomly constructed codes whle enjoyng several mplementaton advantages as a result of ther structure. LDPC convolutonal codes can be derved from these codes through an unwrappng process. In ths paper, we revew the unwrappng process as well as the ppelne decoder that allows contnuous decodng of LDPC convolutonal codes. Computer smulatons are then used to demonstrate that the unwrapped convolutonal codes acheve a convolutonal gan n error performance. We conjecture that ths s due to the concatenaton of many constrant lengths worth of receved symbols n the ppelne decodng process. The consequences of ths mproved performance are examned n terms of factors related to decoder mplementaton: processor sze, memory requrements, and decodng delay (latency). Fnally, gven dentcal protograph kernels, we compare derved block and convolutonal codes based on the above measures. I. INTRODUCTION The convolutonal counterparts of low-densty partycheck (LDPC) block codes, LDPC convolutonal codes, were frst proposed n [1]. Analogous to LDPC block codes, LDPC convolutonal codes are defned by sparse party-check matrces, whch allow them to be decoded usng teratve message-passng algorthms. The socalled ppelne decoder, that s typcally used to decode these codes, employs several small dentcal processors that perform the message-passng decodng teratons n parallel. In [2], the frst two authors presented a general comparson of LDPC block and convolutonal codes, nvestgatng several practcal encodng and decodng aspects of these codes. In ths paper, we extend that work by lookng specfcally at LDPC convolutonal codes derved from ARA- and Protograph-Based LDPC block codes. II. PRELIMINARIES We start wth a bref defnton of a rate R = b/c bnary LDPC convolutonal code C. (A more detaled descrpton can be found n [1].) Let u [0,t 1] = [u 0,u 1,...,u t 1 ], (1) where u = (u (1), u (2),..., u (b) ), 0 < t, t Z +, and u ( ) GF(2), be an nformaton sequence. The encoder maps ths sequence nto the code sequence v [0,t 1] = [v 0,v 1,...,v t 1 ], (2) where v = (v (1), v (2),..., v (c) ), 0 < t, t Z +, and v ( ) GF(2). A code sequence v [0, ] satsfes the equaton where, for all t t, 2 H T [t,t ] = 6 4 v [0, ] H T [0, ] = 0, (3) H T 0 (t) HT (t + ms) 0 ms 0 H T 0 (t + 1) HT ms (t + ms + 1) H T 0 (t ) H T ms (t + m s) s a transposed party check matrx, also called the syndrome former of the convolutonal code C. The submatrces H (t), = 0, 1,, m s, are bnary (c b) c submatrces gven by H (t) = h (1,1) (t) h (1,c) (t).. (t) h (c b,c) (t) h (c b,1) They satsfy the followng propertes: 1) H (t) = 0, < 0 and > m s, t. 2) There s a t such that H ms (t) 0.. (4) 3

2 Varable nodes Edge types Check nodes protograph Copy 3 tmes Permute the edges 2 Fg. 1. Copy and permute operaton for a protograph to generate larger graphs. 3) H 0 (t) 0 and has full rank t. We call m s the syndrome former memory and ν s = (m s + 1) c s the overall constrant length. These parameters determne the heght of the nonzero dagonal regon of H T [0, ]. The sparsty of the syndrome former s ensured by demandng that ts columns have very low Hammng weght,.e., w H (h ) << (m s +1) c, Z +, where h denotes the -th column of H T [0, ]. The code s sad to be regular f ts syndrome former H T [0, ] has exactly J ones n every row and K ones n every column, startng from the (m s (c b)+1)-th column. The other entres are zeros. We refer to a code wth these propertes as an (m s, J, K)-regular LDPC convolutonal code, and we note that n general the code s tme-varyng and has rate R = 1 J/K. An (m s, J, K)-regular tme-varyng LDPC convolutonal code s perodc wth perod T f H (t) s perodc,.e., H (t) = H (t + T),, t, and f H (t) = H,, t, the code s tme-nvarant. We wll descrbe a constructon technque, smlar to the one gven n [1], for dervng a perodcally tmevaryng party-check matrx H [0, ] from the partycheck matrx of an LDPC block code n Secton V. The LDPC convolutonal codes consdered n ths paper are derved from the well-known classes of ARA- and protograph-based LDPC block codes. III. ARA-BASED LDPC CODES A protograph [3] s a Tanner graph wth a relatvely small number of nodes. A protograph G = (V, C, E) conssts of a set of varable nodes V, a set of check nodes C, and a set of edges E. Each edge e E connects a varable node v e V to a check node c e C. Parallel edges are permtted, so the mappng e (v e, c e ) V C s not necessarly 1:1. As a smple example, we consder the protograph shown n Fg. 1. Ths graph conssts of 3 varable nodes and 2 check nodes, connected by 5 edges. In ths example we have 5 edge types,.e., each edge n the base protograph represents an edge type. For mult-edge LDPC codes, a group of edges (the number of edges n each group can be dfferent) represents an edge type. For unstructured rregular LDPC codes, there s only one edge type. Havng the base protograph, we can obtan a larger graph by a copy-and-permute operaton as shown n Fg. 1. Ths operaton conssts of frst makng N copes of the protograph and then permutng the endponts of each edge type among the N varable and N check nodes connected to the set of N edges coped from the same edge type n the protograph. The derved or lfted graph s the graph of a code N tmes as large as the code correspondng to the protograph, wth the same rate and the same dstrbuton of varable and check node degrees. As can be seen from the protograph representaton n the fgures, those varable nodes, say n trans nodes, that are connected to the channel (transmtted nodes) wll be shown as dark flled crcles. Those varable nodes that are not connected to the channel (punctured nodes or not transmtted nodes) wll be depcted by blank crcles. The check nodes wll be depcted by crcles wth a plus sgn nsde. The code rate for the protograph s R = nv nc n trans, provded that the party check matrx of the derved or lfted graph s full rank. As an example, consder the rate-1/2 systematc repeat-accumulate (RA) code wth repetton 3 shown n Fg. 2. n p u t n p u t Fg. 2. R e p e a t 3 p r o t o g r a p h o f R A C o d e T h r e s h o l d d B a c c u m u l a t o r Protograph for a rate 1/2 RA code. In [4] t was shown that the threshold can be further mproved by precodng the repetton code wth an accumulator. The desgn of the precoder n [4] was guded by an analyss of the extrnsc sgnal-to-nose rato (SNR) behavor of repetton codes and punctured accumulator codes usng densty evoluton. The use of a rate-1 accumulator as a precoder dramatcally mproves the extrnsc SNR behavor of a repetton 3 outer code n the hgh extrnsc SNR regon and hence mproves the teratve decodng threshold of the overall code. An RA code wth an accumulator precoder s called an Accumulate-Repeat-Accumulate (ARA) code [4]. An

3 example of a smple rate-1/2 ARA code and ts correspondng threshold s shown n Fg. 3. The ARA encoder n Fg. 3 uses a punctured accumulator as the precoder. n p u t p r e c o d e r Fg. 3. n p u t p r o t o g r a p h o f A R A c o d e T h r e s h o l d d B R e p e a t 3 a c c u m Protograph for a rate-1/2 ARA code. u l a t o r In an ARA code protograph the number of degree 2 varable nodes s equal to the number of nner checks (checks that are connected to these degree 2 varable nodes). If we decrease the number of degree 2 varable nodes wth respect to nner checks, then the ensemble asymptotc mnmum dstance of the code may grow wth n. For example, f we replace 50% of the degree 2 varable nodes wth degree 3 varable nodes, then the mnmum dstance grows wth n. We call such constructed codes ARJA [5] [6] codes because the nner accumulator now has a Jagged appearance. The protograph of a rate-1/2 AR4JA code and ts correspondng threshold s shown n Fg. 4. We call ths protograph AR 4 JA due to the repetton by 4 on the rght hand sde of the punctured degree-6 varable node. nput precoder (accumulator) Fg. 4. nput protograph Threshold 0.62 db repetton The rate-1/2 AR4JA protograph. Jagged accumulator IV. DECODING OF LDPC CONVOLUTIONAL CODES LDPC convolutonal codes can be teratvely decoded usng a message-passng algorthm. Although the correspondng Tanner graph has an nfnte number of nodes, the dstance between two varable nodes that are connected to the same check node s lmted by the syndrome former memory. Ths allows contnuous decodng wth a decoder that operates on a fnte wndow sldng along the receved sequence, smlar to a Vterb decoder wth fnte path memory [7], [8]. The decodng of two varable nodes that are at least (m s + 1) tme unts apart can be performed ndependently, snce the correspondng bts cannot partcpate n the same partycheck equaton. Ths allows the parallelzaton of the I C teratons by employng I C ndependent dentcal processors workng on dfferent regons of the Tanner graph smultaneously. A ppelne decoder that s based on ths dea was ntroduced by Jménez-Felström and Zgangrov n [1]. The operaton of ths decoder on the Tanner graph for a smple tme-nvarant rate R = 1/3 LDPC convolutonal code wth m s = 2 s shown n Fg. 5. Assumng c receved symbols enter the ppelne decoder per unt tme, t takes I C (m s + 1) tme unts for ths c-tuple to reach the output of the decoder, where a decson on these symbols s made. Thus, once a decodng delay of I C (m s + 1) tme unts has elapsed, the decoder produces a contnuous output stream,.e., at each tme unt, c newly receved symbols enter the decoder and c decoded bts leave t. The I C processors perform the I C decodng teratons n parallel. At each tme unt, the -th processor begns by actvatng the frst column of (c b) check nodes n ts operatng regon and then proceeds to actvate the last column of c varable nodes that are about to leave the operatng regon. A check node actvaton s the step where the check node collects all the ncomng messages from ts neghborng varable nodes, calculates the outgong messages, and sends the new messages to each neghborng varable node. Correspondngly, durng a varable node actvaton, all the ncomng messages to a varable node from the neghborng check nodes are collected and the new outgong messages are calculated. Then the new messages are sent to each neghborng check node. Ths message passng schedule corresponds to a parallel message passng schedule of a block code decoder where all varable nodes are updated at once and then all check nodes are actvated. We wll dscuss a bass for comparson between LDPC block and convolutonal decodng n Secton VI. V. DERIVATION OF CONVOLUTIONAL CODES FROM BLOCK CODES In ths secton, we present a graphcal unwrappng procedure based on the bnary party-check matrx H of an arbtrary LDPC block code. In order to derve a perodcally tme-varyng LDPC convolutonal code of rate R = b/c from an LDPC block code, we cut the bnary party-check matrx H of the

4 Proc.1 Proc.2 Proc.(I c 1) Proc.I c r (0) t m s v (0) t I(ms+1)+1 r (1) t v (1) t I(ms+1)+1 r (2) t v (2) t I(ms+1)+1 decodng wndow (sze = I C (m s + 1) ) varable node check node Fg. 5. The Tanner graph of an R=1/3 LDPC convolutonal code and an llustraton of ppelne decodng. underlyng block code along the dagonal n steps of sze (c b) c. Next, we remove the upper-dagonal porton and paste t to the bottom of the lower-dagonal porton. The resultng dagonal shaped matrx s then repeated ndefntely, gvng us the party-check matrx H conv of a tme-varyng convolutonal code wth perod T = m s + 1. We refer to ths cuttng and pastng operaton as the unwrappng procedure. In general, f we start from an (n, J, K)-regular LDPC block code of length n and rate R 1 J/K, we obtan an (m s, J, K)-regular LDPC convolutonal code wth rate R = b/c = 1 J/K and syndrome former memory m s = (n/c) 1,.e., overall constrant length ν s = n. Ths procedure s llustrated n Fg. 6, where we derve a rate R = 1/3, (6, 2, 3)- regular LDPC convolutonal code from a rate R = 8/21, (21, 2, 3)-regular LDPC block code, where n ths case the H matrx of the block code contans one redundant row. The unwrappng step sze of (c b) c produces a rate R = b/c convolutonal code. Smlarly, a step sze of (c b)k ck, where 0 < ck n and k Z +, produces a rate bk/bc code. The specal case of ck = n, for example, corresponds to repeatng the orgnal block code ndefntely, and s therefore of no practcal sgnfcance. On the other hand, ths specal case helps to show the connecton between the block and convolutonal codes and llustrates that by decreasng the value of k we arrve at a more convolutonal structure. Although the above example uses regular LDPC block codes as the startng pont of the unwrappng procedure, there s, n general, no constrant on the row and column weghts of the party-check matrces, and the derved tme-varyng convolutonal code has the exact same node degree dstrbuton as that of the underlyng block code. In other words, the unwrappng procedure preserves the degree dstrbuton durng the cuttng and pastng (and also the repeatng) steps, so the same approach can be employed to derve rregular LDPC convolutonal codes from rregular LDPC block codes. VI. DECODING COMPARISONS In ths secton, we compare several aspects of decodng LDPC convolutonal and block codes. A. Computatonal Complexty Let C check (C var ) denote the number of computatons requred for a degree-k (J) check (varable) node update. Regardless of the code structure, C check and C var depend only on the values J and K. For a rate R = b/c, (m s, J, K)-regular LDPC convolutonal code and a ppelne decoder wth I C teratons/processors, at every tme nstant each processor actvates c b check nodes and c varable nodes. The computatonal complexty per decoded bt s therefore gven by C conv bt = ((c b) C check + c C var ) I C /c (5) = ((1 R) C check + C var ) I C, whch s ndependent of the constrant length ν s.

5 (a) (b) Fg. 6. Dervng a tme-varyng LDPC convolutonal code from an LDPC block code: (a) H matrx for the block code, (b) H conv matrx for the convolutonal code after unwrappng. Smlarly, the decodng complexty for a rate R 1 J/K, (n, J, K)-regular LDPC block code wth I B teratons s gven by C block bt = (n J K C check + n C var ) I B /n (6) = ( J K C check + C var ) I B = ((1 R) C check + C var ) I B, whch s agan ndependent of the code length n. Thus the dfference n computatonal complexty between block and convolutonal codes (on a per decoded bt bass) s gven by the rato I B /I C. B. Internal Observaton Memory The sldng wndow decoder mplementaton of an LDPC convolutonal code requres the storage of I C ν s symbols. However, snce decodng can be carred out by ppelnng I C dentcal ndependent parallel processors, each operatng on only ν s symbols, the smaller sze of the ndvdual processors may be useful n smplfyng hardware desgn and reducng routng congeston. For an LDPC block code of length n, the processor must be capable of storng all n symbols. C. Internal Edge Memory For the ppelne decoder, we need a storage element for each edge n the correspondng Tanner graph. Thus a total of I C (J) ν s storage elements are requred for I C teratons of decodng. Smlarly, we need n (J) storage elements for the decodng of an LDPC block code of length n. D. Decodng Delay (Latency) and External Observaton Memory Let T s denote the tme between the arrval of successve symbols,.e., the symbol rate s 1/T s. Then the maxmum tme from the arrval of a symbol untl t s decoded n the ppelne decoder s conv o = ((c 1) + (m s + 1) c I C ) T s. (7) The frst term (c 1) n (7) represents the tme between the arrval of the frst and last of the c encoded symbols output by a rate R = b/c convolutonal encoder n each encodng nterval. The domnant second term (m s + 1) c I C s the tme each symbol spends n the decodng wndow. Snce c symbols are loaded nto the decoder smultaneously, the ppelne decoder requres a buffer to hold the frst (c 1) symbols. Wth LDPC block codes, data s typcally transmtted n a sequence of blocks. Dependng on the data rate and the processor speed, several scenaros are possble. We consder the best case for block codes,.e., each block s decoded by the tme the last bt of the next block arrves. Ths results n an nput-output delay of = 2n T s. Note that the block decoder needs a buffer to hold the n 1 symbols that arrve before the next block s complete. Ths scenaro s overly optmstc snce some blocks wll consume sgnfcantly more than the average number of teratons to decode, and therefore more than n symbols should be accommodated n the decoder s nput buffer. Fogal, Dolnar, and Andrews [9] have shown an addtonal block of storage reduces the lkelhood of buffer overflow below typcal frame error rates at operatng SNR s of nterest. Therefore, we block o choose block o = 3n T s as an upper bound on block code decodng latency.

6 VII. A BASIS FOR COMPARISON As noted n the prevous secton, there are many ways to compare possble decoder realzatons for LDPC block and convolutonal codes. However, no one approach tells the whole story. Ths s due n part to the very dfferent structures of block and convolutonal codes. In fact, even before the LDPC codng era, t has always been a controversal topc to determne how best to compare block and convolutonal codes. Notons such as trells complexty, mnmum dstance bounds, and error exponents have all been employed to ths end. Smlarly, t s very hard to determne an deal bass of comparson between LDPC block and convolutonal codes. In the fnal analyss, any comparson must be a functon of the partcular applcaton, e.g., whle a large storage requrement or processor sze mght not be problems for moble communcatons, a large latency may be undesrable, especally for real-tme voce transmsson. In ths paper, we choose a comparson method based on decoded bt error rate (BER) performance. For each of the code constructons, we target a specfc channel SNR at a fxed dstance from the teratve decodng threshold of the employed code famly. We then compare LDPC block and convolutonal codes that acheve the same BER and/or frame error rate (FER) performance at ths SNR based on the crtera presented n the prevous secton. VIII. COMPARISON OF BLOCK AND CONVOLUTIONAL CODES BUILT FROM THE AR4JA PROTOGRAPH Our comparson begns wth the AR4JA protograph of Secton III. Before constructng ether convolutonal or block LDPC codes, we expand the graph of Fg. 4 by a factor of 4 to remove double edges. Ths workng base graph s gven the name AR4JAx4. The constructon of two unque 1 LDPC convolutonal codes s descrbed n Fgs. 7(a)(b). In both cases, a block code s frst derved va expanson by a factor of 128, Fg. 7(a), and expanson by a factor of 125, Fg. 7(b). The number of rows and columns n the transposed party-check matrx of each of these block codes s ndcated n the fgure. Note that permutatons assocated wth the aforementoned expansons (x4, x125, x128) were performed usng the well-known progressve edge growth technque [10]. The performance of these two block codes s denoted by the k = 1000 and k = 1024 curves n Fg These convolutonal codes are unque, but are constructed to acheve relatvely comparable convolutonal LDPC codes m +1=512 copes s m +1=125 copes s T H blk= T H blk= m s+1=512 copes m s elements Perodc repetton of m s+1 elements from top row Elements n orgnal block matrx (2560x1536) Elements n syndrome former matrx H T m s+1=125 copes (a) m s elements Perodc repetton of m s+1 elements from top row Elements n orgnal block matrx (2500x1500) Elements n syndrome former matrx H T (b) Fg. 7. Dervng an LDPC convolutonal code from an LDPC block code: (a) AR4JAx4x128, k=1024, n=2048 (+ 512 punctured nodes) protograph unwrappng. (b) AR4JAx4x125 protograph unwrappng. These two block codes (wth k roughly 1000) are unwrapped to form LDPC convolutonal codes, agan followng the parameters denoted n Fg. 7. For nstance, the AR4JAx4x128 (Fg. 7(a)) block code s broken nto sub-blocks of sze c = 5 and c b = 3, whle the AR4JAx4x125 (Fg. 7(b)) block code s broken nto subblocks of sze c = 20 and c b = 12. Note that the latter dmensons adhere to those nherent n the AR4JAx4 base graph. An addtonal factor s that the AR4JA code has all degree-6 nodes punctured (see Fg. 4). Therefore, n terms of transmtted nodes, Fg. 7(a) has c trans = 4 and rate R = (c (c b))/c trans = 1/2. Smlarly, Fg. 7(b) has c trans = 16 and rate R = (c (c b))/c trans = 1/2. Much of the nterest assocated wth LDPC convolutonal codes stems from the ncrease n codng gan that can be obtaned through smple perodc repetton, by a factor of I C, of graphs lke those shown

7 AR4JAx4x125 Conv AR4JAx4x128 Conv AR4JAx4x2048 Blk Complexty Per Decoded Bt [2-nput Ops] 12I C=1202I C=1202I B=436 Observaton Memory [Depth] ν si C= ν si C= n=40960 Edge Storage Memory [Depth] ν sj avgi C= ν sj avgi C= nj avg= Latency [T s] ν si C= ν si C= n= TABLE I COMPLEXITY MEASURES FOR CONVOLUTIONAL AND BLOCK LDPC CODES BUILT FROM IDENTICAL PROTOGRAPHS WITH COMPARABLE BER VS. SNR PERFORMANCE. n Fgs. 7(a)(b) (I C = 2 n the fgure). For nstance, whle the performance of the block codes underlyng the convolutonal codes n Fgs. 7(a)(b) s gven by the crcle and square marked lnes n Fg. 8, perodc repetton by a factor of I C = 100 of the unwrapped versons of these block codes yelds the performance shown by the damond and pentagram marked lnes n the same fgure. At a BER=10 6, nearly a full decbel of performance s ganed wthout the expense of any addtonal rate whatsoever. A man motvaton of ths paper s to examne whether or not the cost of the performance ganed by convolutonal constrant length repetton s more or less than the cost of the gan assocated wth further expanson of the underlyng block code. Note that the performance of any code constructed va repetton of the AR4JA protograph can do no better than the protograph s threshold, whch s E b /N o = 0.62 db. Based on the smulaton results shown n Fg. 8, we see that the performance of AR4JAx4x2048 (the AR4JAx4 base graph expanded va crculant permutaton by a factor of 2048, whch has k = and n trans = (n = 40960)) concdes nearly exactly wth the performance of the I C = 100 unwrapped convolutonal codes at E b /N o = 1.0 db and BER = In addton, the average number of teratons, I B = 36.3, performed by the block decoder s gven for ths SNR and others across an operatng regon of nterest n Fg. 9. We can apply the complexty analyss outlned for regular codes n Secton VI to AR4JA based codes wth a few addtonal assumptons. Frst, let the parameters K and J (the constrant and varable node degrees) be denoted by K avg = 5 and J avg = 3. Second, assume that a degree K avg constrant node requres C check = 2K avg 2-nput operatons to perform an update; smlarly a degree J avg varable node requres C var = 2J avg 2-nput operatons (see, for nstance, [11]). Gven these assumptons, we refer the reader to Table I. Wthout basng results to one approach over the other, the results n the table assume that all varable nodes n BER E b /N o (db) Conv AR4JAx4x125 (c = 20 b = 8 m s = 124) I C = 100 Conv AR4JAx4x128 (c = 5 b = 2 m s = 511) I C = 100 Blk AR4JA (k = 1000) Imax = 200 Blk AR4JA (k = 1024) Imax = 200 Blk AR4JA (k = 16384) Imax = 200 Fg. 8. Rate-1/2 convolutonal and block LDPC codes based on the AR4JA protograph. the code are transmtted and must be buffered n the decodng process. For essentally equal performance the block code requres 6 tmes less nternal observaton and edge storage memory and ncurs at worst (due to the upper bound of 3n on block code latency) 2 tmes less decodng latency. Table I also shows that the block code requres 2.57 tmes fewer computatons per decoded bt than the convolutonal code, where we note that the number of computatons performed s proportonal to the number of teratons. (Because of the dentcal graph connectvty of the LDPC block codes and the LDPC convolutonal codes derved from them, they perform the same number of computatons f they use the same number of teratons.) However, for the smulaton results shown n Fg. 8, the LDPC convolutonal codes employed a

8 Avg. Iteratons Blk AR4JA (k = 16384) Avg. Iter processors may allow for hgher clock frequences and provde hgher throughputs than s possble wth a sngle block decoder. We note that ppelned LDPC block decoders can also be desgned to use ndvdual processors, wth each processor performng only a fracton of the total number of teratons. In ths case, however, the block code would lose the storage memory and decodng latency advantages noted above compared to ther convolutonal counterparts E b /N o (db) Fg. 9. Average decodng teratons vs. SNR for Rate-1/2 AR4JA wth k = constant number of I C = 100 teratons, whle the LDPC block codes made use of a syndrome-based stoppng rule to decrease ther average number of teratons to I B = 36.3, wth the maxmum number of teratons fxed at I B = 200. Ths leads to the dfference n the number of requred computatons noted above. As a result of the extended graph of LDPC convolutonal codes, stoppng rules are not as obvous as for LDPC block codes. One such stoppng rule has been proposed, however, n [12], where the average number of teratons can be reduced wthout affectng the error performance. Usng ths rule, the ndependent processors n the ppelne decoder can sometmes be put nto a sleep mode n order to save computatons. Adjustng the above computatonal comparson to take advantage of ths ppelne decodng stoppng rule s currently beng nvestgated. We note that the sze of a ppelne decodng processor s roughly 1/I C tmes that any of the convolutonal decoder complexty measures n Table I. Convolutonal LDPC codes utlzng a ppelne decoder therefore lend themselves to a fne granularty that allows a trade-off between performance and complexty. The smulaton results of Fg. 8 ndcate that t s possble to acheve low error rate performance by keepng the processor sze ν s relatvely small whle ncreasng the number of processors I C. (In Fg. 8, for example, the convolutonal code processor s only 1/16 the sze of the block code processor.) The resultng cascade of relatvely small IX. CONCLUSION An advantage of the convolutonal structure s that performance can easly be ganed by smply addng more constrant length multples (teratons I C ) at the decoder wthout changng the encodng structure at all. Also, the natural ppelne structure of the convolutonal decoder facltates the realzaton of low error rates and potentally hgh throughputs by desgnng a processor of relatvely modest sze and replcatng t n the ppelne. However, f one has a partcular target error rate n mnd, desgnng a dedcated block code acheves the desred result wth less latency and reduced memory requrements. We are currently ntatng a practcal hardware-based complexty comparson of the LDPC codes presented n ths paper. Ths ncludes realzatons of the LDPC block decodng and ppelned LDPC convolutonal decodng archtectures on feld programmable gate arrays (FPGAs) and applcaton specfc ntegrated crcuts (ASICs). These realzatons wll provde further nsght nto the comparsons presented n ths paper, ncludng determnng possble practcal mplementaton bottlenecks n terms of memory and logc element usage. ACKNOWLEDGMENT Ths work was supported n part by NSF Grants CCR , CCF , NASA Grant NNG05GH73G, and at the Jet Propulson Laboratory / Calforna Insttute of Technology under a contract wth NASA. REFERENCES [1] A. Jménez-Feltström and K. Sh. Zgangrov, Tme-varyng perodc convolutonal codes wth low-densty party-check matrx, IEEE Trans. Inform. Theory, vol. IT-45, pp , Sept [2] D. J. Costello, Jr., A. E. Pusane, S. Bates, and K. Sh. Zgangrov, A comparson between LDPC block and convolutonal codes, n Proc. Informaton Theory and Applcatons Workshop, (San Dego, CA, USA), February [3] J. Thorpe, Low densty party check (LDPC) codes constructed from protographs, JPL IPN Progress Report, pp , August 2003.

9 [4] A. Abbasfar, D. Dvsalar, and K. Yao, Accumulate repeat accumulate codes, n Proc. IEEE Int. Symp. Inf. Theory, (Dallas, TX, USA), July [5] D. Dvsalar, S. Dolnar, and C. Jones, Protograph based LDPC codes wth mnmum dstance growng lnearly wth block sze, n Proc. IEEE Global Communcatons Conference (GlobeCom), (St. Lous, MO, USA), Nov [6] D. Dvsalar, S. Dolnar, and C. Jones, Low-rate LDPC codes wth smple protograph structure, n Proc. IEEE Int. Symp. Inf. Theory, (Adelade, South Australa, Australa), June [7] R. Johannesson and K. Sh. Zgangrov, Fundamentals of Convolutonal Codng. Pscataway, NJ: IEEE Press, [8] S. Ln and D. J. Costello, Jr., Error Control Codng. Englewood Clffs, NJ: Prentce-Hall, 2nd ed., [9] S. Fogal, S. Dolnar, and K. Andrews, Buffer analyss for LDPC decoders, n Submtted to ISIT, [10] X. Y. Hu, E. Eleftherou, and D. M. Arnold, Progressve edgegrowth Tanner graphs, n Proc. IEEE Global Telecommun. Conf., (San Antono, TX), pp , Nov [11] C. Jones, E. Valles, M. Smth, and J. Vllasenor, Approxmatemn* constrant node updatng for LDPC code decodng, n Proc. IEEE Mltary Communcatons Conference (MILCOM), (Boston, Massachusetts, USA), Oct [12] A. E. Pusane, A. Jménez-Feltström, A. Srdharan, M. Lentmaer, K. Sh. Zgangrov, and D. J. Costello, Jr., Implementaton aspects of LDPC convolutonal codes, submtted to IEEE Trans. Commun., Nov

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Finite Length Weight Enumerator Analysis of Braided Convolutional Codes

Finite Length Weight Enumerator Analysis of Braided Convolutional Codes Fnte Length Weght Enumerator Analyss of Braded Convolutonal Codes Saeedeh Moloud, Mchael Lentmaer, and Alexandre Graell Amat Department of Electrcal and Informaton Technology, Lund Unversty, Lund, Sweden

More information

TOPICS MULTIPLIERLESS FILTER DESIGN ELEMENTARY SCHOOL ALGORITHM MULTIPLICATION

TOPICS MULTIPLIERLESS FILTER DESIGN ELEMENTARY SCHOOL ALGORITHM MULTIPLICATION 1 2 MULTIPLIERLESS FILTER DESIGN Realzaton of flters wthout full-fledged multplers Some sldes based on support materal by W. Wolf for hs book Modern VLSI Desgn, 3 rd edton. Partly based on followng papers:

More information

Low Complexity Soft-Input Soft-Output Hamming Decoder

Low Complexity Soft-Input Soft-Output Hamming Decoder Low Complexty Soft-Input Soft-Output Hammng Der Benjamn Müller, Martn Holters, Udo Zölzer Helmut Schmdt Unversty Unversty of the Federal Armed Forces Department of Sgnal Processng and Communcatons Holstenhofweg

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM An elastc wave s a deformaton of the body that travels throughout the body n all drectons. We can examne the deformaton over a perod of tme by fxng our look

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Department of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification

Department of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification Desgn Project Specfcaton Medan Flter Department of Electrcal & Electronc Engneeng Imperal College London E4.20 Dgtal IC Desgn Medan Flter Project Specfcaton A medan flter s used to remove nose from a sampled

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

DC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms

DC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms Proceedngs of the 5th WSEAS Internatonal Conference on Telecommuncatons and Informatcs, Istanbul, Turkey, May 27-29, 26 (pp192-197 DC-Free Turbo Codng Scheme Usng MAP/SOVA Algorthms Prof. Dr. M. Amr Mokhtar

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Queueing Networks II Network Performance

Queueing Networks II Network Performance Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Temperature. Chapter Heat Engine

Temperature. Chapter Heat Engine Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

A Simple Inventory System

A Simple Inventory System A Smple Inventory System Lawrence M. Leems and Stephen K. Park, Dscrete-Event Smulaton: A Frst Course, Prentce Hall, 2006 Hu Chen Computer Scence Vrgna State Unversty Petersburg, Vrgna February 8, 2017

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

Feb 14: Spatial analysis of data fields

Feb 14: Spatial analysis of data fields Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

S Advanced Digital Communication (4 cr) Targets today

S Advanced Digital Communication (4 cr) Targets today S.72-3320 Advanced Dtal Communcaton (4 cr) Convolutonal Codes Tarets today Why to apply convolutonal codn? Defnn convolutonal codes Practcal encodn crcuts Defnn qualty of convolutonal codes Decodn prncples

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Lossless Compression Performance of a Simple Counter- Based Entropy Coder

Lossless Compression Performance of a Simple Counter- Based Entropy Coder ITB J. ICT, Vol. 5, No. 3, 20, 73-84 73 Lossless Compresson Performance of a Smple Counter- Based Entropy Coder Armen Z. R. Lang,2 ITB Research Center on Informaton and Communcaton Technology 2 Informaton

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Analysis of Queuing Delay in Multimedia Gateway Call Routing

Analysis of Queuing Delay in Multimedia Gateway Call Routing Analyss of Queung Delay n Multmeda ateway Call Routng Qwe Huang UTtarcom Inc, 33 Wood Ave. outh Iseln, NJ 08830, U..A Errol Lloyd Computer Informaton cences Department, Unv. of Delaware, Newark, DE 976,

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

CHAPTER 17 Amortized Analysis

CHAPTER 17 Amortized Analysis CHAPTER 7 Amortzed Analyss In an amortzed analyss, the tme requred to perform a sequence of data structure operatons s averaged over all the operatons performed. It can be used to show that the average

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

Introduction to Information Theory, Data Compression,

Introduction to Information Theory, Data Compression, Introducton to Informaton Theory, Data Compresson, Codng Mehd Ibm Brahm, Laura Mnkova Aprl 5, 208 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on the 3th of March 208 for a Data Structures

More information

CHALMERS, GÖTEBORGS UNIVERSITET. SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS. COURSE CODES: FFR 135, FIM 720 GU, PhD

CHALMERS, GÖTEBORGS UNIVERSITET. SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS. COURSE CODES: FFR 135, FIM 720 GU, PhD CHALMERS, GÖTEBORGS UNIVERSITET SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS COURSE CODES: FFR 35, FIM 72 GU, PhD Tme: Place: Teachers: Allowed materal: Not allowed: January 2, 28, at 8 3 2 3 SB

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or Sgnal Compresson Sgnal Compresson Entropy Codng Entropy codng s also known as zero-error codng, data compresson or lossless compresson. Entropy codng s wdely used n vrtually all popular nternatonal multmeda

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

High-Speed Decoding of the Binary Golay Code

High-Speed Decoding of the Binary Golay Code Hgh-Speed Decodng of the Bnary Golay Code H. P. Lee *1, C. H. Chang 1, S. I. Chu 2 1 Department of Computer Scence and Informaton Engneerng, Fortune Insttute of Technology, Kaohsung 83160, Tawan *hpl@fotech.edu.tw

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Analysis of the Magnetomotive Force of a Three-Phase Winding with Concentrated Coils and Different Symmetry Features

Analysis of the Magnetomotive Force of a Three-Phase Winding with Concentrated Coils and Different Symmetry Features Analyss of the Magnetomotve Force of a Three-Phase Wndng wth Concentrated Cols and Dfferent Symmetry Features Deter Gerlng Unversty of Federal Defense Munch, Neubberg, 85579, Germany Emal: Deter.Gerlng@unbw.de

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Analytical Chemistry Calibration Curve Handout

Analytical Chemistry Calibration Curve Handout I. Quck-and Drty Excel Tutoral Analytcal Chemstry Calbraton Curve Handout For those of you wth lttle experence wth Excel, I ve provded some key technques that should help you use the program both for problem

More information

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA 14 th Internatonal Users Conference Sesson: ALE-FSI Statstcal Energy Analyss for Hgh Frequency Acoustc Analyss wth Zhe Cu 1, Yun Huang 1, Mhamed Soul 2, Tayeb Zeguar 3 1 Lvermore Software Technology Corporaton

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys

More information

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder. PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information