Performance of Concatenated Channel Codes

Size: px
Start display at page:

Download "Performance of Concatenated Channel Codes"

Transcription

1 1 Performance of Concatenated Channel Codes and Orthogonal Space-Tme Block Codes Harsh Shah, Ahmadreza Hedayat, and Ara Nosratna Department of Electrcal Engneerng, Unversty of Texas at Dallas, Rchardson, TX Emal:

2 2 Abstract In ths paper we analyze the performance of an mportant class of MIMO systems, that of orthogonal space-tme block codes concatenated wth channel codng. Ths system confguraton s attractve because of ts smple and well-understood desgn crtera. We study spatally ndependent fadng as well as correlated fadng that may arse from the proxmty of transmt or receve antennas. We consder the effects of tme correlaton and present a general analyss for the case where both spatal and temporal correlatons exst n the system. We present analyses for a varety of channel codes, ncludng convolutonal codes, turbo codes, TCM, and MTCM, under quas-statc and fast Raylegh fadng as well as Rcan fadng. Smulatons verfy the valdty of our analyss. I. INTRODUCTION Space-tme block codes (STBC) provde dversty but have lttle or no codng gan, therefore n practce t s often necessary to use them n conjuncton wth channel codng (see Fgure 1). Unlke space-tme trells codes [1], where codng gan and dversty are provded by the same code, the concatenated approach dvdes the overall problem such that two dstnct codes are used: the STBC provdes dversty, whle the channel code provdes codng gan. The overall decoder conssts of two separable decodng operatons, where the space-tme component has a smple, lnear form, leadng to a less complex soluton. Ths structure has been accepted, e.g., n the WCDMA standard [2]. In ths paper, we analyze the performance of concatenated channel codes and orthogonal space-tme block codes. A summary of past work n ths area s as follows. Borran et al. [3] and Gong and Ben Letaef [4] dscuss desgn ssues of concatenated channel codes and orthogonal space-tme block codes. Bauch and Hagenauer [5] gve analytcal evaluaton of error probablty wthout consderng the effect of block fadng (whch s typcally assumed for STBC decodng). Uysal and Georghades [6] gve error bounds for MTCM-STBC under Rcan fadng, but nterleavng does not appear n ther error analyss. Schulze [7] gves unon bounds for channel codes and Alamout sgnalng for..d and temporally correlated channels, wthout consderng block fadng. None of the above mentoned works dscusses spatally correlated fadng. La and Mandyam [8] smulate concatenated convolutonal/turbo codes wth two temporally and spatally correlated transmt antennas (one receve antenna) n the framework of WCDMA, but they do not present bounds or analytcal results.

3 3 Channel Encoder Interleaver Space-Tme Block Encoder Space-Tme Block Decoder Denterleaver Channel Decoder Fg. 1. Concatenated channel code and space-tme block code Our ntent s to present an analyss that s general and comprehensve. We extend exstng results as well as present new ones. In partcular, (1) we nclude the effects of block fadng n our analyss, (2) the analyss s general wth respect to the number of transmt and receve antennas, (3) we derve error bounds for the case of..d. fadng as well as spatally correlated or temporally correlated channels, (4) we present results for a varety of channel codes ncludng convolutonal codes, turbo codes, TCM and MTCM, and (5) we analyze n the presence of fast fadng and quas-statc fadng n Raylegh and Rcan channels. Our methodology s to construct a SISO equvalent representaton of the channel, resultng n a block fadng channel. We employ the moment generatng functon approach of [9] to derve bounds on the bt- and frame-error probabltes. We use a random (unform) nterleaver to overcome the problem of nterleaver-dependent error probabltes [10], [11]. The organzaton of the paper s as follows. We brefly explan the orthogonal space-tme block codes and the resultant equvalent channel n Secton II. In Secton III, we develop the tools for our boundng technque and analyze the concatenated system under..d. fadng, spatally correlated fadng, and spato-temporally correlated fadng. Secton IV gves analytcal bounds for non-bnary modulatons (TCM and MTCM). In Secton V we extend the analytcal bounds for the case of Rcan channel. In Secton VI we provde smulatons to gauge the accuracy of the bounds and to demonstrate the effect of correlatons. II. SYSTEM MODEL We consder a codng-dversty scheme where a channel code and a STBC are used as shown n Fgure 1. The channel code can be a sngle code or a concatenated code. The channel encoder converts a sequence of k nformaton bts to n coded bts. Each coded bt s modulated by a sgnal wth unt energy. Ths s further encoded by the space tme block encoder wth n T transmt antennas. The recever employs n R receve antennas and combnes ther output optmally. We

4 4 consder a frequency non-selectve fadng channel, where the output of the channel s gven by y = H s + n, where y s n R 1 receved sgnal vector, s s the modulated n T 1 vector transmtted over n T transmt antennas, and n s n R 1..d. Gaussan nose at the receve antennas. The channel matrx s represented by H whose elements h j are the complex Gaussan channel coeffcents for the par of transmt antenna and receve antenna j. A space-tme block code s desgned such that the components of each codeword, despte mutual nterference over the wreless channel, can be separated at the decoder [12]. For example, n the case of two-transmt and one-receve antenna orgnally ntroduced n [13], the unmodulated sequence s arranged n blocks of two symbols, (c 0, c 1 ), and modulated as follows s(c 0) s(c 1 ), s (c 1 ) s (c 0 ) where the columns correspond to transmt antennas and the rows correspond to tme. Assumng that channel coeffcents h 11 and h 21, known to the recever, are constant over the transmsson of one block, t s possble to recover the transmtted symbols wthout nterference at the recever va lnear decodng and obtan a dversty order of two: s(c ) = ( h h 12 2 )s(c ) + n [13]. In a STBC wth n T transmt antennas, t s assumed that the channel coeffcents h j reman fxed through n T consecutve ntervals [13], [12]. Hence, the channel s block fadng wth block length n T. The outer code n our concatenated system also sees a block fadng channel, although the statstcs of the channel have been altered by the mappng nduced by the STBC encoder and decoder. We now proceed to dscuss ths equvalent channel n more detal. The multple-nput multple output (MIMO) channel, drven by an orthogonal STBC, can be represented by an equvalent sngle-nput sngle-output (SISO) channel. Assumng the recever combnes the receved sgnals from n R antennas optmally, the MIMO channel can be represented as an equvalent SISO block fadng channel wth fadng coeffcent: h eq = 1 n T n R h j n 2. (1) T Alternatvely, we can wrte the equvalent SNR =1 j=1 γ = γ H 2, (2)

5 5 No Interleaver Best Interleaver Unform Interleaver Parwse Error Probablty E /N (db) b 0 Fg. 2. Domnant event (d=5) of a convolutonal code, Alamout sgnalng wth 1-Rx antenna, n block..d. Raylegh fadng where denotes the Frobenus norm, γ = 1 R ce b n T N 0 s the average SNR per nformaton bt per transmt antenna, and R c s the code rate. If the nose components of the actual channel are ndependent, so are the nose components of the equvalent channel [5], [3]. The transmtted power s scaled by the number of transmt antennas to keep the total transmtted power constant. The equvalent fadng coeffcent follows a generalzed Raylegh dstrbuton [14]. The resultant nstantaneous SNR per bt, γ, follows ch-square dstrbuton wth degree of freedom 2n T n R [5]. The problem s now reduced to the analyss of a block fadng SISO channel whch s no longer Raylegh, but rather follows a generalzed Raylegh dstrbuton. Spatally correlated and temporally correlated channels, whch we also consder n ths paper, further modfy the probablty dstrbuton. Here t s approprate to make a note on nterleavng. Some coded space-tme transmsson systems, e.g. [4], have been proposed that do not nclude nterleavng between the outer and nner codes. However, our smulatons show that the codes of [4] can be mproved by over 2.5dB at FER= wth an nterleaver (see Secton VI, Fgure 8). In vew of these gans and the relatvely low cost of nterleavng, t s mportant to nclude nterleavng n the analyss of coded space-tme systems. Interleavng, however, necesstates a cumbersome book-keepng for calculatng parwse error probabltes. To manage ths complexty and to avod nterleaver-dependent probabltes, we use the concept of a unform random nterleaver. To demonstrate the effcacy of ths approach,

6 6 Fgure 2 shows the parwse error probablty (PEP) of the domnant error event of a convolutonal code concatenated wth Alamout sgnalng (Hammng dstance 5). The (averaged) unform nterleaver gves a good approxmaton to the best nterleaver n realstc sgnal-to-nose ratos. 1 The usage of random unform nterleavng was frst proposed by Benedetto and Montors [10] for the analyss of turbo codes and has also been used by Zummo and Stark [11] to explore the effects of channel nterleavers. III. PERFORMANCE ANALYSIS The unon bound for the bt error rate of a lnear block code C(n, k) s P b k n w d and the unon bound for the frame error rate s P e k w d w n A w,dp (d) (3) n A w,d P (d), where A w,d s the multplcty of the codewords wth nput weght w and output weght d. The coeffcents A w,d form the nput-output weght enumeratng functon (IOWEF) of C. The parwse error probablty (PEP), P (d), s defned as the probablty of an error event wth Hammng weght d. To calculate bt- and block-error probabltes for ndvdual channels, we need to obtan correspondng PEP s P (d), to whch the remander of ths paper s dedcated. The performance of channel codes n block fadng envronments s studed n [15], [16], [11]. The orgnal analyss n [16] requres a generalzed weght enumeratng functon of the channel code (or generalzed transfer functon for convolutonal codes), whch depends on the order of transmtted bts of a codeword and s therefore affected by nterleavng. To address ths ssue we apply the concept of random (unform) nterleavng, n a manner closely followng Zummo and Stark [11]. The length of the coded sequence (frame length) s denoted by n. The length of a fadng block s l, thus the number of fadng blocks n each coded frame s F = n/l. We now need to determne how the error bts are dstrbuted among dfferent blocks,.e., how much error weght s present n each fadng block. To characterze that, we buld a hstogram of weghts 1 At very large SNR bad nterleavers wll domnate, hence averagng over all nterleavers wll eventually dverge from the best nterleaver at arbtrarly large SNR. Nevertheless, t s an excellent approxmaton at moderate SNR.

7 7 as follows: assume the number of blocks that have weght m s f m, and consder the vector f = (f 0,..., f w ) where w = mn(l, d). A gven vector f s a vald hstogram f f m = F and mfm = d. Now, usng the unform nterleavng concept, one may average the PEP over all vald error patterns (hstograms) [11] P (d) = E f [P (d f)] = F F/2 f 1 =1 f 2 =1... F/w f w=1 P (d f)p(f), where p(f) s the weght of occurrence of the pattern f, and E s the expectaton operator. A. PEP based on Moment Generatng Functons Assumng the all-zero codeword s transmtted, the PEP of a codeword wth weght d gven the pattern f of the fadng blocks, s w P (d f, γ) = Q 2 m m=1 f m γ m, =1. (4) Here we have collected terms correspondng to blocks wth equal weght patterns. Thus γ m, s the SNR for the -th block that has weght m (there are a total of f m blocks wth weght m). 2 Representng Q-functon n ts alternatve form [9], the PEP condtoned on the block fadng pattern f s P (d f, γ) = 1 π π 2 0 exp ( 1 sn 2 θ w m m=1 f m =1 γ m, ) dθ. Averagng the above condtonal PEP over the nstantaneous SNR γ, and assumng γ m, are ndependent, P (d f) = E γ [P (d f, γ)] = 1 π π 2 0 w m=1 =1 f m 0 ( exp mγ m, sn 2 θ ) p γ (γ m, ) dγ m, dθ. The nner ntegral s the moment generatng functon (MGF) of γ, Φ(s) = E[e sγ ], evaluated at s = m/ sn 2 θ. Snce γ m, follow the same statstcs we can wrte P (d f) = 1 π π 2 0 w [ ( Φ m )] fm dθ. (5) sn 2 θ m=1 2 Note that the subscrpts of h j refer to transmtter and recever j, whereas the subscrpts of γ m, are temporal subscrpts wth reference to the block fadng patterns. Each case should be clear from the context.

8 8 B. Independent Fadng If the entres of the channel matrx H are ndependent, the resultng SNR s the sum of n T n R ndependent exponental varables and hence has a ch-square dstrbuton wth the pdf [9] p γ (γ) = 1 (D 1)! γ D γd 1 exp( γ/ γ), where D = n T n R. The MGF of ths pdf s gven by [9] Usng ths MGF n (5) we obtan the followng bound for P (d f) P (d f) = 1 π Φ γ (s) = (1 s γ) D. (6) 1 2 π 2 0 w m=1 ( 1 + m γ ) fmd dθ (7) sn 2 θ w (1 + m γ) fmd, m=1 where the last nequalty s the Chernoff bound. One may also obtan the correspondng result for quas-statc Raylegh fadng by the settng F = 1 whch s equvalent to m = d, f m = 1. C. Spatally Correlated Fadng If the antenna elements n ether the transmtter or the recever are not far enough apart, the fadng coeffcents h j wll be correlated. We do not assume any specfc structure for the correlaton of fadng coeffcents, and the analyss s general n that sense. We do assume that the correlaton structure s statonary (tme-nvarant). We frst present a useful model for the correlated fadng coeffcents. Ths result s not new, but we state t nevertheless to set the stage for the developments to come. Lemma 1: Consder a random matrx H wth..d. entres, and two determnstc, postve sem defnte matrces A and B of approprate sze, and assume H = A 1/2 H B 1/2. Then H can be equvalently represented thus: vec(h) = R 1/2 vec( H), (8) where vec( ) s the vectorzng operator and R = E[vec(H)vec(H) H ] = B A, the Kronecker product of B and A.

9 9 Proof: Easly follows va the denttes: (A B) T = A T B T, vec(axb) = (B T A)vec(X), (A B)(C D) = AC BD. Ths s closely related to an exstng correlaton model [17] where A and B represent the correlaton matrces at the transmtter and recever sde, respectvely. In other words, H = R 1/2 Tx H R 1/2 Rx. However, for our purposes, the followng untary transformaton s more useful vec(h) = R 1/2 s vec( H) = UΛ 1/2 vec( H), where R s = UΛU H. For future reference, t s useful to remember Λ = Λ T x Λ Rx. Now to the key decorrelatng result: Lemma 2: The moment generatng functon of γ s gven by Φ γ (s) = n T n R =1 j=1 ( 1 sλ (t) where λ (t) and are egenvalues of R Tx and R Rx respectvely. Proof: H 2 = vec(h) H vec(h) = vec( H) H Λvec( H) = n T =1 n R j=1 j γ ) 1, (9) λ (t) j h j 2. (10) From (2) and (10), γ = γ H 2 = γ The MGF of γ s Φ γ (s) = E { exp ( s γ H 2)} = n T =1 n R j=1 n T n R =1 j=1 E λ (t) j h j 2. { ( exp s γ λ (t) j h j 2 )}.

10 10 Each term n the last expresson s the moment generatng functon of an exponental random varable. Substtuton gves (9). We can now substtute n (5) to obtan P (d f) = 1 π 1 2 π 2 0 w w n T n R m=1 =1 j=1 n T n R ( m=1 =1 j=1 ( 1 + mλ(r) 1 + mλ (t) j sn 2 θ γ ) fm dθ (11) j γ ) fm. (12) Usng ths formula, t s nstructve to consder two extreme cases: uncorrelated and fully correlated channels. In the case of uncorrelated channel, λ (t) = j = 1 for all, j, and the formula reduces to (7), as expected. In the case of fully correlated channel, the correlaton matrx s rank defcent and we have λ (t) 1 = n T, 1 = n R, and all other λ (t) = j = 0. Thus the above moment generatng functon reduces to Φ γ (s) = (1 sd γ) 1, (13) whch shows no dversty, but a receve gan of D = n T n R (recall that γ = 1 n T R ce b N 0 ). D. Temporal and Spatal Correlaton For varous reasons such as long data blocks or long fadng perods, t may not be practcal to use nterleavers to remove the channel memory. In such cases, we need to analyze the system wth channel memory, a task whch we undertake n ths secton. We assume that the coherence tme s much greater than n T symbols, so that the channel remans effectvely constant over each STBC block and lnear decodng s possble. Assumng a gven error event has weght d, we must concentrate on the channel matrx at tme nstances {k 1,..., k d } where the error event has nonzero value. Let the channel matrx at tme k be denoted as H and defne H = [vec(h 1 ) vec(h 2 )... vec(h d )]. Each H may be spatally correlated; the spatal correlatons are modeled by a matrx R s as before. We assume the statstcs to be statonary (tme-nvarant), therefore only one spatal correlaton matrx suffces. We model the temporal correlaton of the channel by R t, that s, R t (, j) = E[vec(H ) H vec(h j )]. Therefore, H can be modeled as H = R 1/2 s H R 1/2 t, (14)

11 11 where, H s a (nt n R ) d matrx wth..d. elements. Usng Lemmas 1 and 2, we can wrte the MGF of d n T n R correlated exponental varables as Φ γ (s) = d n T n R k=1 =1 j=1 (1 s µ k λ (t) j ) 1, (15) where µ are egenvalues of R t. Usng ths, we can calculate the parwse error probablty P (d) = 1 ( π/2 d n T n R 1 + γµ ) kλ (t) 1 j π sn 2 dθ (16) θ d k=1 =1 j=1 k=1 =1 j=1 n T n R ( 1 + µ k λ (t) j γ ) 1. (17) It s easy to see that for the specal case of quas-statc fadng, (R t ) j = 1 for all and j, therefore µ 1 = d and all other µ k = 0, and the equaton reduces to the famlar PEP for the quas-statc fadng, where there s no tme dversty but there s a codng gan of d. IV. PERFORMANCE ANALYSIS WITH MULTILEVEL MODULATION We now proceed to the analyss of a concatenaton of TCM or MTCM wth space-tme block codes. The desgn of TCM and MTCM for space-tme block codes has been addressed n [4] and [3]. Followng the same steps as before, we need to consder error patterns f (hstograms) n a manner smlar to Secton III. Because the errors can assume multple values (more than two), the constructon of the patterns, albet straght forward, s cumbersome. In the nterest of brevty we omt the detals. In a 2 m -ary modulaton, the parwse condtonal probablty of error between the all-zero codeword and a codeword e s gven by f j P (0 e f, γ) = Q 2 γ j, α j, (18) j =1 where j s the ndex of block patterns and γ j, s the nstantaneous SNR per bt for -th block n fadng pattern j. We have defned an aggregate dstance metrc α j for each block pattern j, calculated by α j = 2 m k v j,k d 2 (s k, s 0 ),

12 12 where v j,k s the multplcty of symbol s k n the block pattern ndexed by j. Averagng over γ, we fnd the PEP expresson P (0 e f) = 1 π π/2 0 ( [Φ γ α )] fj j dθ. (19) 2 sn 2 θ j For the useful class of unform error probablty (UEP) codes, where the reference codeword can always be chosen as the all-zero codeword [9], [18], the unon bound on frame error probablty s P e e 0 π 1 2 π 0 2 (m 1) cl j ) 2 m =1 Φ γ ( v j,d 2 fj (c l s, s ) 2 sn 2 dθ, (20) θ where c l s a symbol that belongs to the frst level of set-parttonng of the 2 m -ary modulaton [18]. Note that v j, and f j depend on the error word e, but the dependence has been suppressed n the formula above for notatonal smplcty. To calculate the unon bound n the case of spatally and temporally..d. fadng, the moment generatng functon (6) s substtuted n (20). To calculate the unon bound n the case of spatally correlated fadng, we nsert the moment generatng functon (9) nto (19). The unon bound n the case of temporally correlated channel requres a lttle twst. In the prevous cases, the equvalent SNR was a functon of H only, therefore decorrelatng H smplfed the MGF expressons. However, n the case of temporal correlatons, the effectve SNR s expressed as γ = d k=1 n T =1 n R j=1 h j (k) 2 δ 2 k, (21) where δ k s the Eucldean dstance of the error event at k-th error poston. Obvously decorrelatng H no longer works. Defne D = dag(δ 1,..., δ d ) and note that γ = HD 2, where H = [vec(h 1 ) vec(h 2 )... vec(h d )]. To obtan a sum of ndependent SNR components, we must dagonalze the autocorrelaton of HD. γ = HD 2 = = d k=1 d k=1 n T =1 n T =1 n R j=1 n R j=1 h j (k) 2 δ 2 k h j (k) 2 λ (t) j ˆµ k.

13 13 Recall that the spatal and temporally correlated H s modeled as H = R 1/2 s H R 1/2 t, where H has..d. entres and R s and R t are the spatal and temporal correlaton matrces, respectvely. It follows that ˆµ k are the egenvalues of DR t D. Therefore we can stll use equatons (15) and (19) except we should substtute ˆµ k for µ k. 3 V. PERFORMANCE UNDER RICIAN FADING In ths secton we consder the Rcan fadng channels wth parameter K descrbng the rato of the energy of the lne-of-sght component to the multpath component. 4 For the uncorrelated Rcan channel, the moment generatng functon of γ = γ H 2 s gven by [9] ( ) D ( ) D 1 + K Ks γ Φ γ (s) = exp. 1 + K s γ 1 + K s γ By usng ths MGF wth equaton (19), the PEP for the fast fadng Rcan channel and multlevel modulaton s gven by P (0 e) = 1 π π/2 0 [ ( 1 + K 1 + K + α j γ exp 2 sn 2 θ j K γα j 2 sn 2 θ 1 + K + γα j 2 sn 2 θ )] D dθ. (22) For the case of spatally correlated fadng, the MGF can be once agan derved usng Lemmas 1 and 2 of Secton III-C, Φ γ (s) = n T n R =1 j=1 (1 + K) 1 + K sλ (t) exp j γ ( Ksλ (t) j γ 1 + K sλ (t) j γ ), (23) where λ (t) and are the egenvalues of transmt and receve correlaton matrces R Tx and R Rx respectvely. Expressons (23) and (20) drectly yeld the desred bounds on error probablty. In the case where temporal as well as spatal correlaton s present, t s straghtforward to show that the moment generatng functon s expressed as follows Φ γ (s) = d n T n R k=1 =1 j=1 (1 + K) 1 + K sµ k λ (t) exp j γ ( K s µk λ (t) 1 + K sµ k λ (t) j γ j γ where µ k are the egenvalues of temporal correlaton matrx R t. Once agan, n combnaton wth (20), the desred bounds are obtaned. 3 The dstncton s unnecessary n the case of bnary codes wth BPSK, because n that case δ k = 1 on all error postons. 4 As long as the sze of antenna arrays are much smaller than the dstance between transmtter and recever, physcal arguments lead to the concluson that K s constant across the entres of the channel gan matrx. ),

14 Bound 1 Tx Bound 2 Tx ρ t.0 Bound 2 Tx ρ t.7 Sm 1 Tx Sm 2 Tx ρ t.7 Sm 2 Tx ρ t.0 Bt Error Rate E b /N 0 (db) Fg. 3. Convolutonal code, block..d. Raylegh Fadng, 2-Tx and 1-Rx antennas VI. RESULTS We evaluated unon bounds for convolutonal and turbo codes wth BPSK modulaton, and for 4-state, 8-PSK TCM and MTCM codes. The STBC for two-transmt antenna used here s the Alamout scheme [13]. In all fgures, dashed lnes denote smulatons, whle sold lnes denote bounds. In the case of two antennas, R Tx and R Rx are each fully defned by a sngle correlaton coeffcent ρ t for transmt antenna and ρ r for receve antenna. To evaluate analytcal expressons, we calculated the IOWEF of the codes based on the approach of [19]. A random nterleaver s placed between the channel code and STBC. We evaluate exact expressons for parwse error probablty. We begn by presentng our results for convolutonal codes. For ths experment, we used a four-state rate 1/2 code wth generator functon G(D) = (1 + D 2, 1 + D 2 + D 3 ). Each frame contans k = 100 nformaton bts (200 BPSK symbols). Ths code s concatenated wth Alamout STBC (one receve antenna). The results are shown n Fgure 3. When there s no correlaton between antennas, the dversty s two. When the correlaton between transmt antennas s ρ t = 0.7, the dversty remans the same, but the loss n codng gan s about 1.5dB at BER= We next consder a system wth two transmt and two receve antennas wth spatal correlatons ρ t = 0.7 and ρ r = 0.5 (Fgure 4). We observe that receve dversty mproves the overall performance, but the loss due to antenna correlatons s more than 2dB at BER=10 5. In

15 15 Bt Error Rate Bound 2 Tx 2 Rx ρ t ρ r Bound 2 Tx 2 Rx ρ t.7 ρ r.5 Sm 2 Tx 2 Rx ρ t.7 ρ r.5 Sm 2 Tx 2 Rx ρ t ρ r Bound 1 Tx Sm 1 Tx E /N (db) b 0 Fg. 4. Convolutonal code, block..d. Raylegh Fadng, 2-Tx and 2-Rx antennas Bt Error Rate 10 0 Bound 2 Tx ρ t Bound 2 Tx ρ t.7 Sm 2 Tx ρ t Sm 2 Tx ρ t.7 Sm 1 Tx Bound 1 Tx E /N (db) b 0 Fg. 5. Convolutonal code, 2-Tx and 1-Rx antennas, tme correlated Raylegh Fadng, F d T s = 0.1 our fnal experment wth convolutonal codes (Fgure 5) we demonstrate the effect of temporal correlaton modeled va Bessel functons [20] wth f d T s = 0.1 (obvously wth no nterleavng). For turbo coded experments we use a rate-1/3 code wth four-state consttuent recursve convolutonal codes wth the generator functon G(D) = (1, 1+D 2 1+D+D 2 ). Fgure 6 shows the performance of turbo code concatenated wth Alamout sgnalng and one receve antenna. Each frame has 500 nformaton bts (1500 BPSK symbols). We use suboptmal teratve (MAP) decodng of turbo codes wth 12 teratons. The degradaton due to transmt antenna correlaton

16 Bound 1 Tx Bound 2 Tx ρ t Bound 2 Tx ρ t.7 Sm 1 Tx Sm 2 Tx ρ t Sm 2 Tx ρ t.7 Bt Error Rate E b /N 0 (db) Fg. 6. Turbo code, block..d. Raylegh Fadng 2-Tx and 1-Rx antennas Bound 1Tx Sm 1Tx Bound 2Tx ρ t.7 Sm 2Tx ρ t.7 Bound 2Tx ρ t sm 2Tx ρ t Bt Error Rate E /N (db) b 0 Fg. 7. TCM, 2-Tx and 1-Rx antennas, block..d. Raylegh fadng of ρ t = 0.7 s about 0.8 db at BER = We see that the unon bounds cross the smulaton curves. Ths phenomenon, whch has been prevously reported n the lterature [19], s due n part to the usage of teratve decodng nstead of ML decodng. Our TCM experments use a code from [4] whose trells s shown n Fgure 7. In ths experment, the system has two transmt and one receve antenna, and frame length s 130 symbols (260 nformaton bts). We have used partal nput-output weght enumeratng functon (IOWEF) to calculate the upper bounds; the results appear n Fgure 7. The performance loss due to an-

17 Bound, no nterlever Sm, no nterleaver [4] Bound, S random nterleaver Sm, S random nterleaver Frame Error Rate E /N (db) b 0 Fg. 8. TCM, 2-Tx and 1-Rx antennas, block..d. Raylegh fadng Sm 2 Tx ρ t Bound 2 Tx ρ t Sm 2Tx ρ t.7 Bound 2Tx ρ t.7 Bt Error Rate E /N (db) b 0 Fg. 9. TCM, 2-Tx and 1-Rx antennas, quas-statc Raylegh fadng tenna correlaton of ρ t = 0.7 s about 1.2 db at BER = To demonstrate the mportance of nterleavng, Fgure 8 gves the frame error rate n the case of two transmt and one receve antennas under..d. fadng (condtons smlar to [4]). We use a S-random nterleaver wth S=4. Interleavng gves a gan of 2.5 db at FER=, n addton to a hgher dversty that gves rse to even more mpressve gans at hgher SNR. In Fgure 9 we repeat the experment under a quas-statc Raylegh fadng channel. The unon bounds n the case of quas-statc channels are tght only f the dversty order s hgh, and the probablty of deep fades s low [5]. To get a rel-

18 Sm 1Tx Bound 1Tx Sm 2Tx ρ t Bound 2Tx ρ t Sm 2Tx ρ t.7 Bound 2Tx ρ t.7 Bt Error Rate E /N (db) b 0 Fg. 10. MTCM, 2-Tx and 1-Rx antennas, block..d. Raylegh Fadng Sm 2Tx ρ t Bound 2Tx ρ t Sm 2Tx ρ t.7 Bound 2Tx ρ t.7 Bt Error Rate E /N (db) b 0 Fg. 11. MTCM, 2-Tx and 1-Rx antennas, quas-statc Raylegh Fadng atvely tghter bound, we use the lmt-before-averagng method of [16], but as reported n [16] the bounds are stll not as tght as the fast fadng bounds. Our MTCM experments use a 4-state, 8-PSK code from [18], concatenated wth Alamout sgnalng, wth frame length of 100 symbols (200 nformaton bts). Agan, we use only the partal IOWEF to calculate upper bounds. Fgure 10 shows that a spatal correlaton of ρ t = 0.7 results n a 1dB loss at hgh SNR. We repeat ths experment under quas-statc fadng (Fgure 11). As mentoned before, the quas-statc bounds are not as tght as the fast fadng bounds.

19 Bound 1Tx Sm 1Tx Bound 2Tx ρ t.7 Sm 2Tx ρ t.7 Bound 2Tx ρ t Sm 2Tx ρ t Bt Error Rate E /N (db) b 0 Fg. 12. TCM, 2-Tx and 1-Rx antennas, block..d. Rcan fadng K = 5dB Fnally, we show results for the performance of space-tme coded TCM n Rcan fadng (Fgure 12). The Rcan fadng parameter s K = 5dB, and there are two transmt and one receve antennas. The loss due to a transmt antenna correlaton of ρ t = 0.7 s around 1dB. VII. CONCLUSION Ths work presents performance analyss for systems consstng of concatenaton of channel codes and space-tme block codes. Such systems are of theoretcal and practcal nterest. We use the concept of a unform nterleaver n the context of block fadng channel to calculate bt error probabltes. Ths analyss s performed both for the case of spatally uncorrelated fadng, as well as spatally correlated fadng due to proxmty of transmt or receve antennas. We also consder jont spato-temporal correlaton. We gve results for wde varety of codes and several type of fadng channels. Smulatons verfy the accuracy of the analyss. REFERENCES [1] V. Tarokh, N. Seshard, and A. Calderbank, Space-tme codes for hgh data rate wreless communcaton: Performance crtera and code constructon, IEEE Trans. Inform. Theory, vol. 44, no. 2, pp , March [2] 3rd Generaton Partnershp Project 3G TS , Multplexng and channel codng (FDD). [3] M. Borran, M. Memarzadeh, and B. Aazhang, Desgn of coded modulaton schemes for orthogonal transmt dversty, submtted for publcaton n IEEE transacton on Communcatons, May [4] Y. Gong and K. B. Letaef, Concatenated space-tme block codng wth trells coded modulaton n fadng channels, IEEE Transactons on Wreless Communcatons, vol. 1, no. 4, pp , Oct 2002.

20 20 [5] G. Bauch and J. Hagenauer, Analytcal evaluaton of space-tme transmt dversty wth FEC-codng, n Proc. IEEE GLOBECOM, San Antono, TX, November 2001, pp [6] M. Uysal and C. Georghades, Upper bounds on the BER performance of MTCM-STBC schemes over shadowed Rcan fadng channels, n Proc. IEEE Vehcular Technology Conference, 2002, pp [7] H. Schulze, Performance analyss of concatenated spacetme codng wth two transmt antennas, vol. 2, no. 4, pp , July [8] J. La and N. B. Mandayam, Performance of turbo coded WCDMA wth downlnk space-tme block codng n correlated fadng channels, accepted for publcaton n IEEE transacton on wreless communcatons,2002. [9] M. K. Smon and M.-S. Aloun, Dgtal Communcaton over Fadng Channels: A Unfed Approach to Performance Analyss. New York: John Wley and Sons, [10] S. Benedetto and G. Montors, Unvelng turbo codes: Some results on parallel concatenated codng schemes, IEEE Trans. Inform. Theory, vol. 42, no. 2, pp , March [11] S. A. Zummo and W. E. Stark, Performance analyss of coded systems over block fadng channels, n Proc. IEEE Vehcular Technology Conference, 2002, pp [12] V. Tarokh, H. Jafarkhan, and A. Calderbank, Space-tme block codes from orthogonal desgns, IEEE Trans. Inform. Theory, vol. 45, no. 5, pp , July [13] S. M. Alamout, A smple transmt dversty technque for wreless communcatons, IEEE J. Select. Areas Commun., vol. 16, no. 8, pp , October [14] J. G. Proaks, Dgtal Communcatons, 3rd ed. New York: McGraw-Hll, [15] R. Knopp and P. A. Humblet, On codng for block fadng channels, IEEE Trans. Inform. Theory, vol. 46, no. 1, pp , Jan [16] E. Malkamäk and H. Leb, Evaluatng the performance of convolutonal codes over block fadng channels, IEEE Trans. Inform. Theory, vol. 45, no. 5, pp , July [17] C. Chuah, D.Tse, J. Kahn, and R. Valenzuela, Capacty scalng n mmo wreless systems under correlated fadng, IEEE Trans. Inform. Theory, vol. 48, no. 3, pp , March [18] S. H. Jamal and T. Le-Ngoc, Coded Modulaton Technques for Fadng Channels. Massachusetts: Kluwer Academc Publshers, [19] S. Benedetto, D. Dvsalar, G. Montors, and F. Pollara, Seral concatenaton of nterleaved codes: performance analyss, desgn, and teratve decodng, IEEE Trans. Inform. Theory, vol. 44, no. 3, pp , May [20] G. L. Stüber, Moble Communcaton. Kluwer Academc Publshers, 2001.

IT has been demonstrated recently [1], [2] that multipleinput

IT has been demonstrated recently [1], [2] that multipleinput 26 IEEE TRANSACTIONS ON WIRELESS COUNICATIONS, VOL. 6, NO. 6, JUNE 27 Space Tme Codes n Keyhole Channels: Analyss and Desgn Shahab Sanaye, ember, IEEE, Ahmadreza Hedayat, ember, IEEE, and Ara Nosratna,

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

Iterative Multiuser Receiver Utilizing Soft Decoding Information

Iterative Multiuser Receiver Utilizing Soft Decoding Information teratve Multuser Recever Utlzng Soft Decodng nformaton Kmmo Kettunen and Tmo Laaso Helsn Unversty of Technology Laboratory of Telecommuncatons Technology emal: Kmmo.Kettunen@hut.f, Tmo.Laaso@hut.f Abstract

More information

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder. PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

The optimal delay of the second test is therefore approximately 210 hours earlier than =2.

The optimal delay of the second test is therefore approximately 210 hours earlier than =2. THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Lecture 5 Decoding Binary BCH Codes

Lecture 5 Decoding Binary BCH Codes Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Low Complexity Soft-Input Soft-Output Hamming Decoder

Low Complexity Soft-Input Soft-Output Hamming Decoder Low Complexty Soft-Input Soft-Output Hammng Der Benjamn Müller, Martn Holters, Udo Zölzer Helmut Schmdt Unversty Unversty of the Federal Armed Forces Department of Sgnal Processng and Communcatons Holstenhofweg

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Outage Probability of Macrodiversity Reception in the Presence of Fading and Weibull Co- Channel Interference

Outage Probability of Macrodiversity Reception in the Presence of Fading and Weibull Co- Channel Interference ISSN 33-365 (Prnt, ISSN 848-6339 (Onlne https://do.org/.7559/tv-67847 Orgnal scentfc paper Outage Probablty of Macrodversty Recepton n the Presence of Fadng and Webull Co- Channel Interference Mloš PERIĆ,

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system. Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

MIMO Systems and Channel Capacity

MIMO Systems and Channel Capacity MIMO Systems and Channel Capacty Consder a MIMO system wth m Tx and n Rx antennas. x y = Hx ξ Tx H Rx The power constrant: the total Tx power s x = P t. Component-wse representaton of the system model,

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Multipath richness a measure of MIMO capacity in an environment

Multipath richness a measure of MIMO capacity in an environment EUROEA COOERATIO I THE FIELD OF SCIETIFIC AD TECHICAL RESEARCH EURO-COST SOURCE: Aalborg Unversty, Denmark COST 73 TD 04) 57 Dusburg, Germany 004/Sep/0- ultpath rchness a measure of IO capacty n an envronment

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Signal space Review on vector space Linear independence Metric space and norm Inner product

Signal space Review on vector space Linear independence Metric space and norm Inner product Sgnal space.... Revew on vector space.... Lnear ndependence... 3.3 Metrc space and norm... 4.4 Inner product... 5.5 Orthonormal bass... 7.6 Waveform communcaton system... 9.7 Some examples... 6 Sgnal space

More information

A Comparison between Weight Spectrum of Different Convolutional Code Types

A Comparison between Weight Spectrum of Different Convolutional Code Types A Comparson between Weght Spectrum of fferent Convolutonal Code Types Baltă Hora, Kovac Mara Abstract: In ths paper we present the non-recursve systematc, recursve systematc and non-recursve non-systematc

More information

Goodness of fit and Wilks theorem

Goodness of fit and Wilks theorem DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Digital Modems. Lecture 2

Digital Modems. Lecture 2 Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera

More information

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem. Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from

More information

Chapter 5 Multilevel Models

Chapter 5 Multilevel Models Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Outage and Diversity of Linear Receivers in Flat-Fading MIMO Channels

Outage and Diversity of Linear Receivers in Flat-Fading MIMO Channels Outage and Dversty of Lnear Recevers n Flat-Fadng IO Channels Ahmadreza Hedayat ember, IEEE, and Ara Nosratna Senor ember, IEEE Abstract Ths correspondence studes lnear recevers for IO channels under frequency-nonselectve

More information

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

IRO0140 Advanced space time-frequency signal processing

IRO0140 Advanced space time-frequency signal processing IRO4 Advanced space tme-frequency sgnal processng Lecture Toomas Ruuben Takng nto account propertes of the sgnals, we can group these as followng: Regular and random sgnals (are all sgnal parameters determned

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding tle Lnear dsperson code wth an orthogonal row structure for smplfyng sphere decodng Author(s) Da XG; Cheung SW; Yuk I Ctaton he 0th IEEE Internatonal Symposum On Personal Indoor and Moble Rado Communcatons

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1 C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Representation theory and quantum mechanics tutorial Representation theory and quantum conservation laws

Representation theory and quantum mechanics tutorial Representation theory and quantum conservation laws Representaton theory and quantum mechancs tutoral Representaton theory and quantum conservaton laws Justn Campbell August 1, 2017 1 Generaltes on representaton theory 1.1 Let G GL m (R) be a real algebrac

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information

Implicit Integration Henyey Method

Implicit Integration Henyey Method Implct Integraton Henyey Method In realstc stellar evoluton codes nstead of a drect ntegraton usng for example the Runge-Kutta method one employs an teratve mplct technque. Ths s because the structure

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

TLCOM 612 Advanced Telecommunications Engineering II

TLCOM 612 Advanced Telecommunications Engineering II TLCOM 62 Advanced Telecommuncatons Engneerng II Wnter 2 Outlne Presentatons The moble rado sgnal envronment Combned fadng effects and nose Delay spread and Coherence bandwdth Doppler Shft Fast vs. Slow

More information

BER Analysis of QAM with Transmit Diversity in Rayleigh Fading Channels

BER Analysis of QAM with Transmit Diversity in Rayleigh Fading Channels BER Analyss of QAM wth Transmt Dversty n Raylegh Fadng Channels M. Surendra Raju,A. Ramesh and A. Chockalngam Inslca Semconductors Inda Pvt. Ltd.,Bangalore 56000,INDIA Department of ECE,Unversty of Calforna,San

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

OFDM is a good candidate for wireless multimedia communication

OFDM is a good candidate for wireless multimedia communication Detecton of OFDM-CPM Sgnals over Multpath Channels Imran A. Tasadduq and Raveendra K. Rao Department of Electrcal & Computer Engneerng Elborn College, 11 Western Road The Unversty of Western Ontaro London,

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Homework Assignment 3 Due in class, Thursday October 15

Homework Assignment 3 Due in class, Thursday October 15 Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.

More information

Rate Constrained Power Control in Space-Time Coded Fading Ad-Hoc Networks

Rate Constrained Power Control in Space-Time Coded Fading Ad-Hoc Networks Rate Constraned Power Control n Space-Tme Coded Fadng Ad-Hoc Networks Homayoun Yousef zadeh Lynn Zheng Hamd Jafarkhan Department of EECS, UCI [hyousef, llzheng,hamdj]@uc.edu Outlne Problem Descrpton Lterature

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

Lecture 4: Universal Hash Functions/Streaming Cont d

Lecture 4: Universal Hash Functions/Streaming Cont d CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected

More information

STAT 511 FINAL EXAM NAME Spring 2001

STAT 511 FINAL EXAM NAME Spring 2001 STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1 Homework 4 Problem Capacty wth CSI only at Recever: C = log det I + E )) s HH H N M T R SS = I) SVD of the Channel Matrx: H = UΣV H = [U 1 U ] [ Σr ] [V 1 V ] H Capacty wth CSI at both transmtter and

More information

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient 58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),

More information

), it produces a response (output function g (x)

), it produces a response (output function g (x) Lnear Systems Revew Notes adapted from notes by Mchael Braun Typcally n electrcal engneerng, one s concerned wth functons of tme, such as a voltage waveform System descrpton s therefore defned n the domans

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information