Robust transceiver design for AF MIMO relay systems with column correlations

Size: px
Start display at page:

Download "Robust transceiver design for AF MIMO relay systems with column correlations"

Transcription

1 Ttle Robust transcever desgn for AF MIMO relay systems wth column correlatons Author(s) Xng, C; Fe, Z; Wu, YC; Ma, S; Kuang, J Ctaton The 0 IEEE Internatonal Conference on Sgnal rocessng, Communcatons and Computng (ICSCC), X'an, Chna, 4-6 September 0. In IEEE ICSCC roceedngs, 0, p. -6 Issued Date 0 URL Rghts IEEE Internatonal Conference on Sgnal rocessng, Communcatons and Computng roceedngs. Copyrght IEEE.

2 Robust Transcever Desgn for AF MIMO Relay Systems wth Column Correlatons Chengwen Xng, Zesong Fe, Yk-Chung Wu, Shaodan Ma and Jngg Kuang School of Informaton and Electroncs, Bejng Insttute of Technology, Bejng, Chna Emal: {zesongfe, Department of Electrcal and Electronc Engneerng, The Unversty of Hong Kong, Hong Kong Emal: Abstract In ths paper, we nvestgate the robust transcever desgn for dual-hop amplfy-and-forward (AF) MIMO relay systems wth Gaussan dstrbuted channel estmaton errors. Ag at maxmzng the mutual nformaton under mperfect channel state nformaton (CSI), source precoder at source and forwardng matrx at the relay are jontly optmzed. Usng some elegant attrbutes of matrx-monotone functons, the structures of the optmal solutons are derved frst. Then based on the derved structure an teratve waterfllng soluton s proposed. Several exstng algorthms are shown to be specal cases of the proposed soluton. Fnally, the effectveness of the proposed robust desgn s demonstrated by smulaton results. I. INTRODUCTION Cooperatve communcaton s one of the key parts of the future communcaton protocols, as the deployment of relays can mprove lnk equalty, extend coverage range and mtgate nference. In general, there are varous relay strateges whch are casted nto three man categores,.e., amplfy-andforward (AF), decode-and-forward (DF) and compressed-andforward (CF). Among these relayng strateges, AF strategy whch has the lowest complexty s most sutable for practcal mplementaton. It s also well-establshed that adoptng multple antennas has a potental to mprove overall wreless system performance. In order to reap both benefts promsed by cooperatve communcaton and mult-nput mult-output (MIMO) systems, lnear transcever desgn for AF MIMO relayng systems has been wdely researched n [] [5]. Generally, speakng there are two man knds of crtera for transcever desgn: capacty maxmzaton and mean-square-error (MSE) mzaton. Jont desgn of relay forwardng matrx and destnaton equalzer for mzng MSE s dscussed n [] and [3]. Furthermore, jont desgn of source precoder relay forwardng matrx and destnaton equalzer for mzng MSE s nvestgated n [5]. The capacty maxmzaton transcever desgn has been dscussed n [], [5]. In most of prevous works, channel state nformaton (CSI) s assumed to be perfectly known. However, ths assumpton cannot be met n practce. Channel estmaton errors are always nevtable and drastcally degrades system performance. It Ths research work was supported n part by Ercsson and Sno- Swedsh IMT-Advanced and Beyond Cooperatve rogram under Grant No.008DFA780. s well known that robust desgns can reduce or mtgate the negatve effects ntroduced by mperfect CSI. Ths s also the motvaton of our work. In ths paper, we jontly optmze source precoder matrx and relay forwardng matrx for mutual nformaton maxmzaton under channel estmaton errors. Based on the propertes of matrx-monotone functons, the optmal structure of robust transcevers s derved. Then, an teratve water-fllng soluton s proposed. Fnally, the numercal result shows the performance advantage of the proposed robust desgn. The followng notatons are used throughout ths paper. Boldface lowercase letters denote vectors, whle boldface uppercase letters denote matrces. The notaton Z H denotes the Hermtan of the matrx Z, and Tr(Z) s the trace of the matrx Z. The notaton Z / s the Hermtan square root of the postve sem-defnte matrx Z, such that Z / Z / = Z and Z / s also a Hermtan matrx. For a rectangular dagonal matrx Λ, Λ denotes the man dagonal elements are n decreasng order and Λ denotes the man dagonal elements are n ncreasng order. For two Hermtan matrces, C ર D means that C D s a postve sem-defnte matrx. The symbol λ (Z) represents the th largest egenvalue of Z. II. SYSTEM MODEL AND ROBLEM FORMULATION A. Transmtted and Receved Sgnals In our work, a dual-hop AF MIMO relay system s nvestgated, n whch there s one source wth N S antennas, one relay wth M R receve antennas and N R transmt antennas, and one destnaton wth M D antennas. Because of deep fadng, the drect lnk between the source and destnaton s not taken nto account. At the frst hop, the source transmts data to the relay. The receved sgnal at the relay s denoted as x = H sr s + n () where H sr s the MIMO channel matrx between the source and the relay, and s the precoder matrx at the source. The vector s s the N data vector transmtted by the source wth the covarance matrx R s = E{ss H } = I N. Furthermore, n s the addtve Gaussan nose vector wth correlaton matrx R n = σ I MR. At the relay, the receved sgnal x s multpled by a forwardng matrx F. Then the resultant sgnal s transmtted

3 to the destnaton. The receved sgnal y at the destnaton can be wrtten as y = H rd FH sr s + H rd Fn + n, () where H rd s the MIMO channel matrx between the relay and the destnaton, and n s the addtve Gaussan nose vector at the second hop wth covarance matrx R n = σi MD.In order to guarantee the transmtted data s can be recovered at the destnaton, t s assumed that N S, M R, N R, and M D are greater than or equal to N [3]. When channel estmaton errors are taken nto account, the dual-hop channels read as H sr = H sr +ΔH sr, H rd = H rd +ΔH rd, (3) where H sr and H rd are the channel estmates and ΔH sr and ΔH rd are the correspondng estmaton errors wth zero-mean Gaussan dstrbuted entres. Addtonally, the estmaton errors are ndependent wth each other as the channels are separately estmated. Referrng to estmaton errors, the followng wdely used Kronecker structure s adopted [6], [7] ΔH sr = Σ / sr H W,sr Ψ / sr ΔH rd = Σ / rd H W,rdΨ / rd, (4) where the entres of H W,sr and H W,rd are dentcal and ndependent dstrbuted (..d.) wth zero mean and unt varance. The column correlaton matrces (Ψ sr and Ψ rd ) and the row correlaton matrces (Σ sr and Σ rd ) are detered by tranng sequences and channel estmators [8]. To the best of the authors knowledge, for a general case even for a pontto-pont MIMO system, there s no closed-form soluton. In ths paper, we focus on the case wth column correlatons only.e., Σ sr = α I, Σ rd = α I, (5) as ths case corresponds to a practcal lnear mum mean square error (LMMSE) channel estmator [8]. B. roblem Formulaton At the destnaton, a lnear equalzer G s adopted to detect the data vector s. The mean-square-error (MSE) matrx s E{(Gy s)(gy s) H }, where the expectaton s taken wth respect to random data, channel estmaton errors, and nose. In [9], t s shown that E{(Gy s)(gy s) H } = G( H rd FR x F H H H rd + K )G H + I N ( H H H srf H H H rdg H ) (G H rd F H sr ), (6) where matrces R x and K are defned as R x E{xx H } = H sr H H H sr + K K Tr( H Ψ sr )Σ sr + R n K Tr(FR x F H Ψ rd )Σ rd + R n. (7) It s obvous that R x s the covarance matrx of the receved sgnal at the relay. Usng lnear Bayesan theory, the LMMSE equalzer at the destnaton equals to G =( H rd F H sr ) H ( H rd FR x F H H H rd + K ), (8) based on whch the MSE matrx n (6) s rewrtten as Φ MSE (F, ) =I ( H rd F H sr ) H ( H rd FR x F H H H rd + K ) ( H rd F H sr ) (9) Capacty s one of the most mportant and wdely used performance metrcs for transcever desgns. Gven the receved plots n channel estmaton as y and y, the channel capacty s denoted as I(s; y y, y ), whch s the condtonal mutual nformaton based on known y and y [7]. To the best of our knowledge, the exact capacty for MIMO channels wth estmaton errors at both ends s largely open even for pontto-pont MIMO systems [7]. To proceed, a common logc s to derve and use bounds.e., lower bound or upper bound. Snce we am to maxmze channel capacty, lower bound s more meanngful than upper bound. In Appendx A t has been proved that log Φ MSE (F, ) I(s; y y, y ). (0) Ths s a wdely-establshed lower bound [7] and becomes tghter as estmaton errors are smaller. As a result, the robust transcever desgn for maxmzng mutual nformaton s formulated as F, log Φ MSE(F, ) s.t. Tr(FR x F H ) r Tr() s. () Based on the defnton of R x n (7), R x s a functon of. In order to smplfy the analyss, we defne a new varable F FK / (K / H sr H H H srk / + I /, () Π ) based on whch FR x F H = F F H and the two constrants nvolved n () become ndependent. Meanwhle, the MSE matrx n (9) s correspondngly rewrtten as Φ MSE ( F, ) =I ( H rd FΠ / K / K / H H rd + K ) ( H rd FΠ / H sr ) H ( H rd F F H H sr ). (3) Fnally, the optmzaton problem for the robust desgn becomes F, log Φ MSE ( F, ) s.t. Tr( F F H ) r Tr() s. (4) In the followng, the optmal solutons of (4) wll be dscussed n detals. III. OTIMAL SOLUTIONS In our work, we nvestgate the optmzaton problem (4) from matrx-monotone functon vewpont. The dea of utlzng the propertes of matrx-monotone functons to desgn MIMO transcevers has been address n [0]. In ths paper, we extend ths dea to robust transcever desgns for a AF MIMO relayng system.

4 Defnton : A matrx-monotone functon s defned as g( ) whch maps a matrx varable from a subsect of postve semdefnte matrces to a real number. If g( ) s a monotoncally decreasng matrx-monotone functon on postve sem-defnte matrces, t satsfes A ર B ર 0 g(a) g(b). (5) On the other hand, when g( ) a monotoncally ncreasng matrx-monotone, t means g( ) s a monotoncally decreasng matrx-monotone functon [0]. In the followng we focus our attenton on a knd of optmzaton problems wth a decreasng matrx-monotone functon as objectve, whch s formulated as ( g X H H H HX ) X η x s.t. Tr(XX H ) η x =Tr(XX H Ψ)α + σn. (6) Solvng the optmzaton problem (6), two mportant solutons are derved and are the bass for the followng dervatons. Concluson : The optmal soluton of (6) satsfes Tr(XX H )=Tr[XX H (α Ψ + σni)]/η x =. (7) Defnng the untary matrx V H and rectangular dagonal matrx Λ H based on the followng sngular value decomposton H(α Ψ + σni) / = U H Λ H VH H wth Λ H, (8) the optmal soluton of the optmzaton problem (6) has followng structure X opt = η x (α Ψ + σni) / V H Λ X U H Ξ wth Λ T XΛ T HΛ H Λ X, and η x = σn/{ αtr[vh(α H Ψ + σni) / Ψ(α Ψ + σni) / V H Λ X Λ T X]}, (9) where U Ξ s an untary matrx and Λ X s a rectangular dagonal matrx wth real dagonal elements. roof: See Appendx B. Concluson : For a complex matrx A and a postve defne matrx N, based on followng egen-decomposton AN A H = U ANA Λ ANA VANA H wth Λ ANA (0) when the objectve functon s g ( X H H H ) HX/η x =log A H (X H H H HX/η x + I) A + N () the untary matrx U Ξ n (9) equals to U Ξ = U ANA. () Defnng N X = {Rank(H H H), Rank(AA H )}, Λ x n (9) has the structure of [ ] Λ Λ x = x 0, (3) 0 0 where Λ x s a N X N X dagonal matrx. roof: See Appendx C. A. The structure of optmal F In ths secton the structure of optmal F s derved. Based on the matrx nverson lemma, the MSE matrx n (3) can be rewrtten as Φ MSE ( F, ) =(Π / K / (Π / K / A H sr ) H ( F H H H rdk H rd F + I) H H sr )+( H H srk H sr + I) N based on whch for any gven the optmzaton problem wth respect to F becomes as F log A H ( F H H H rdk H rd F + I) A + N s.t. Tr( F F H ) r K =Tr( F F H Ψ rd )Σ rd + σn I. (4) Defnng untary matrces U and V based on the followng sngular value decomposton K / H sr = U Λ V H wth Λ, (5) we have the followng egen-decomposton A N AH = U Λ Λ T U H wth Λ Λ T. (6) Together wth the followng sngular value decomposton H rd (α r Ψ rd + σn ) / = U rd Λ rd Vrd H wth Λ rd, and based on Conclusons and, the optmal F has the followng structure F = η f (α r Ψ rd + σ n I) / V rd,n Λ F UH,N wth Λ F Λ rd Λ F and η f = σn /{ α Tr[Vrd,N(α H r Ψ rd + σn I) / Ψ rd (α r Ψ rd + σ n I) / V rd,n Λ F]}, (7) where Λ F s a N N dagonal matrx. Meanwhle, for the optmal F the followng constrant s fulflled Tr( F F H )=Tr[ F F H (α r Ψ rd + σn I)]/η f = r. (8) B. The structure of optmal In the followng, t wll be proved that gven the structure of F the optmzaton problem for s the same as that for F. Usng the optmal structure of F, wehave ( F H H H rdk H rd F + I) =(U,N Λ F Λ rd Λ F UH,N + I). Usng the followng substtuton Λ ( Λ F Λ rd Λ F + I), (9) and the matrx nverson lemma agan, the MSE matrx can be reformulated as Φ MSE( F, ) =V (I Λ ) / V H ( H H H srk H sr + I) Notce that Σ rd = α I. V (I Λ ) / V H + V Λ V H. (30) A F N F

5 Therefore, the optmzaton problem wth respectve to s equvalent to log A H F (H H H srk H sr + I) A F + N F s.t. Tr( H ) s, K =Tr( H Ψ sr )Σ sr + σ n I. (3) Based on the defntons of A F and N F, t can be derved that has the followng egen-decomposton AH F A F N F A F N F AH F = V Λ F Λ rd Λ F VH. (3) Together wth followng sngular value decomposton, H sr (α s Ψ sr + σ n I) / = U sr Λ sr V H sr (33) and usng Conclusons and 3, the optmal has the followng structure = η p (α s Ψ sr + σ n I) / V sr,n Λ V H wth Λ Λ Λ sr and η p = σn /{ α Tr[Vsr,N H (α s Ψ sr + σn I) / Ψ sr (α s Ψ sr + σ n I) / V sr,n Λ ]}, (34) where Λ a N N dagonal matrx. Consderng that as there are no constrants on V, V can be an arbtrary N N untary matrx. Based on Concluson, t can be concluded that the optmal satsfes Tr( H )=Tr[ H (α s Ψ sr + σ n I)]/η p = s. (35) Substtutng (34) nto (5), t can be derved that U,N = U sr,n and then the optmal structure of F s F = η f (α r Ψ rd + σ n I) / V rd,n Λ F UH sr,n. (36) Based on the optmal structure gven by (34) and (36) and wth regard to the fact that η p and η f are detered by Λ and Λ F, respectvely, the left unknown varables are only Λ and Λ F. C. roposed Solutons for Λ F and Λ Based on (8) and (35), the optmzaton problem (4) also equals to F, s.t. log Φ MSE ( F, ) Tr[ F F H (α r Ψ rd + σ n I)]/η f = r Tr[ H (α s Ψ sr + σ n I)]/η p = s. (37) Furthermore, wth the followng dagonal matrces Λ sr =dag{λ sr, } Λ rd =dag{λ rd, } Λ F =dag{f } Λ =dag{p } (38) 3 Notce that Σ sr = α I. and substtutng (34) and (36) nto (37), the optmzaton problem (37) can be rewrtten as f,p s.t. N f log λ rd, + p λ sr, + (p = λ sr, +)(f λ rd, +) f = r p = s. (39) Wth respectve to the fact the problem (39) s nherently nonconvex and dffcult to solve, an teratve water-fllng soluton s proposed n ths paper. When p s are fxed, f s can be computed as + p f λ sr, + = (p λ sr, ) + 4p λ sr, λ rd, μ f λ rd, λ rd, (40) where μ f 0 s the Lagrange multpler whch makes f = r. On the other hand, when f s are fxed p s can be computed as + f p λ rd, + = (f λ rd, ) + 4f λ rd, λ sr, μ p λ sr, λ sr, (4) where μ p 0 s the Lagrange multpler whch makes p = s. Specal cases: Several exstng algorthms can be consdered as specal cases of our proposed soluton. When CSI s perfectly known and = I, the proposed soluton for F reduces to that n []. When CSI s perfectly known, the proposed soluton for and F reduces to that gven n [5]. When the second hop channel s an dentty matrx and noseless, the proposed soluton for source precoder desgn reduces to that gven n [7]. IV. SIMULATION RESULTS AND DISCUSSIONS In ths secton, smulaton results are presented to assess the performance of the proposed algorthm and for the purpose of comparson, the algorthm based on the estmated channel only (wthout takng the channel errors nto account) [5]. In the followng, we consder an AF MIMO relay system where the source, relay and destnaton are equpped wth same number of antennas,.e., N S = M R = N R = M D = 4. The channels H sr and H rd are randomly generated accordng to..d. Gaussan dstrbuton. To estmate the channels, a practcal LMMSE estmaton algorthm s adopted [8]. For the tranng sequence D, a famous exponental correlaton matrx s used to descrbe the correlaton matrx of D,.e., DD H R ρ where [R ρ ] j = ρ j. As a result, Σ sr = Σ rd = I and Ψ sr = Ψ rd = (I 4 +SNR EST R α ) where SNR EST s the sgnal-to-nose rato (SNR) n channel estmaton process [8] 4. In the smulaton, for data transmsson process the SNR 4 The detaled dervaton s gven n [8]

6 Sum rate (Bts/Hz/S) The proposed robust desgn The algorthm based on estmated CSI only /SNR =0.004 EST /SNR =0.0 EST /SNR EST = SNR (db) Fg.. Sum rates of dfferent algorthms when ρ =0.5. where ŝ s an arbtrary estmate of s ncludng LMMSE estmate. It should be ponted out that as CSI s not perfectly known, ŝ = s. Notce that s s the condtonal mean and thus we have E{(s s)( s ŝ) H } = 0 (44) based on whch the rght hand sde of (43) also equals to E{(s s)(s s) H } + E{( s ŝ)( s ŝ) H } = E{(s s + s ŝ)(s s + s ŝ) H } = E{(s ŝ)(s ŝ) H }. (45) Substtutng (45) nto (43), we have Cov(s y, y, y ) E{(s ŝ)(s ŝ) H } = Φ MSE (F, ). (46) It s also well-known that wth fxed covarance matrx, Gaussan dstrbuton has the maxmum entropy. Therefore, t s concluded that at relay s defned as s /σ, and the SNR at destnaton s defned as r /σ. For smplcty, t s also assumed that s /σ = r /σ. Each pont n the followng fgure s an average of 0000 ndependent channel realzatons. Fg. shows the sum rates of dfferent algorthms ncludng the proposed robust desgn and ts counterpart based on estmated CSI only when ρ = 0.5. It can be seen that the performance of the proposed robust desgn s always better than that of the desgn based estmated on CSI only. Furthermore, as the channel estmaton SNR decreases the performance gan of the robust desgn becomes larger. H(s y, y, y ) E{log πecov(s y, y, y ) } log πeφ MSE (F, ), based on whch, an lower bound of the capacty (4) s I(y; s y, y ) (47) V. CONCLUSIONS Robust mutual nformaton maxmzaton transcever desgn H(s) log πeφ MSE (F, ) = log Φ MSE (F, ). (48) The fnal equalty comes from the fact R s = I. for dual-hop AF MIMO relay systems was nvestgated. Wth AENDIX B Gaussan dstrbuted channel errors the precoder at the source ROOF OF CONCLUSION and forwardng matrx at the relay were jontly desgned. The structures of the optmal solutons were derved frst, whch As g( ) s a matrx monotoncally decreasng functon, t dfferentates our work from the exstng works. For the unknown can be proven that for the optmal soluton the power constrant dagonal matrces, a well-known teratve water-fllng soluton was proposed. The smulaton result demonstrated the performance advantage of our robust desgn. s always actve,.e., Tr(XX H )= [0]. As a result, we have the followng relatonshp. η x = αtr(xx H Ψ)+σn AENDIX A = αtr(xx H Ψ)+σn Tr(XX H )/ LOWER BOUND OF CAACITY = Denotng y and y as the receved plots n the separate =Tr(XX H (α Ψ + σni))/. (49) dual hop channel estmatons, the capacty between the source and destnaton equals to From (49), the constrant of the optmzaton problem (6) equals to I(s; y y, y )=H(s y, y ) H(s y, y, y ) (4) Tr(XX H )=Tr[XX H (α Ψ + σni)]/η x =, (50) =H(s) based on whch the optmzaton problem (6) s equvalent to where H(s y, y ) denotes the condtonal entropy of s when ( y and y are known and H(s y, y, y ) s the condtonal g X H H H H ) X X entropy of s when y, y and y are known. As y and y are η x ndependent wth s, H(s y, y )=H(s). The second term on s.t. Tr[XX H (α Ψ + σni)]/η x =. (5) the rght hand sde of (4) wll be dscussed n the followng. Then, defnng a new varable Denotng s = E y,y,y {s} as the condtonal mean and based on the defnton of covarance matrx, the condtonal X =/ η x (α Ψ + σni) / X, (5) covarance matrx satsfes the optmzaton problem (5) s further reformulated as Cov(s y, y, y )=E{(s s)(s s) H ( ) } g X H (α Ψ + σni) / H H H(α Ψ + σni) / X E{(s s)(s s) H } + E{( s ŝ)( s ŝ) H } X (43) s.t. Tr( X X H )=. (53)

7 For any gven X, based on the followng sngular decompostons H(α Ψ + σni) / X = V Ξ Λ Ξ U H Ξ wth Λ Ξ H(α Ψ + σni) / = U H Λ H VH H wth Λ H, (54) postve sem-defnte matrces M and N.e., M + N (λ (M)+λ (N)) [], we drectly have log A H (X H H H HX/η x + I) A + N log N + log[λ (AN A H )+λ (X H H H HX/η x + I)] there exsts a matrx X satsfyng X = V H Λ X U H Ξ (55) wth/bλ H Λ X = Λ Ξ (56) where Λ X s a dagonal matrx wth the same rank as Λ Ξ and b s a scalar whch makes Tr( X X H )= hold. Based on Lemma n [], the followng nequalty holds X H (α Ψ + σni) / H H H(α Ψ + σni) / X ર X H (α Ψ + σni) / H H H(α Ψ + σni) / X. (57) Together wth the fact that g( ) s a matrx monotoncally decreasng functon, the followng nequalty holds g( X H (α Ψ + σni) / H H H(α Ψ + σni) / X) g( X H (α Ψ + σni) / H H H(α Ψ + σni) / X). (58) Therefore, t s concluded that the optmal X has the structure gven by (55). Furthermore, based on the defnton of X (5), the optmal X has the followng structure X opt = η x (α Ψ + σ ni) / V H Λ X U H Ξ (59) where Λ X s a dagonal matrx. In (59) η x s unknown ether. In order to solve η x, substtute the structure of X n (59) nto the defnton of η x n (6), and then we get the followng equaton η x =Tr(XX H Ψ)α + σ n = η x αtr[v H X(α Ψ + σ ni) / Ψ(α Ψ + σ ni) / V X Λ X Λ T X]+σ n. (60) Ths s a smple lnear functon of η p, and η p can be easly solved to be η x = σ n/{ αtr[v H X(α Ψ + σ ni) / Ψ(α Ψ + σ ni) / V X Λ X Λ T X]}. (6) AENDIX C ROOF OF CONCLUSION The objectve functon n () can be reformulated as log A H (X H H H HX/η x + I) A + N =log N A H (X H H H HX/η x + I) AN + I =log N +log (X H H H HX/η x + I) AN A H + I =log N +log AN A H +(X H H H HX/η x + I) log (X H H H HX/η x + I) (6) where the second equalty s based on the fact that AB + I = BA + I. Usng the matrx nequalty that for two log[λ (X H H H HX/η x + I)]. (63) Together wth the optmal structure gven by Concluson, n order to make the equalty n (63) hold the followng equaton holds U Ξ = U ANA. (64) In lght of the fact that power s never loaded to the egenchannels wth zero magntudes [], the dagonal matrx Λ x has the followng structure Λ x = [ Λ x ], (65) where Λ x s a N X N X dagonal matrx and N X = {Rank(H H H), Rank(AA H )}. REFERENCES [] O. Munoz-Medna, J. Vdal, and A. Agustn, Lnear transcever desgn n nonregeneratve relays wth channel state nformaton, IEEE Trans. Sgnal rocess., vol. 55, no. 6, pp , June 007. [] X. Tang and Y. Hua, Optmal desgn of non-regeneratve MIMO wreless relays, IEEE Trans. Wreless Commun., vol. 6, no. 4, pp , Apr [3] W. Guan and H. Luo, Jont MMSE transcever desgn n nonregeneratve MIMO relay systems, IEEE Commun. Lett., vol., no. 7, pp , July 008. [4] R. Mo and Y. Chew, recoder desgn for non-regeneratve MIMO relay systems, IEEE Trans. Wreless Commun., vol. 8, no. 0, pp , Oct [5] Y. Rong, X. Tang, and Y. Hua, A unfed framework for optmzng lnear nonregeneratve multcarrer MIMO relay communcaton systems, IEEE Trans. Sgnal rocess., vol. 57, no., pp , Dec [6] X. Zhang, D.. alomar, and B. Ottersten, Statstcally robust desgn of lnear MIMO transcevers, IEEE Trans. Sgnal rocess., vol. 56, no. 8, pp , Aug [7] M. Dng and S. D. Blosten, Maxmum mutual nformaton desgn for MIMO systems wth mperfect channel knowledge, IEEE Trans. Infor. Theory, vol. 56, no. 0, pp , Oct. 00. [8] C. Xng, S. Ma, Y.-C. Wu, and T.-S. Ng, Transcever desgn for dual-hop nonregeneratve MIMO-OFDM relay systems under channel uncertantes, IEEE Trans. Sgnal rocess., vol. 58, no., pp , Dec. 00. [9] C. Xng, S. Ma, and Y.-C. Wu, Robust jont desgn of lnear relay precoder and destnaton equalzer for dual-hop amplfy-and-forward MIMO relay systems, IEEE Trans. Sgnal rocess., vol. 58, no. 4, pp , Apr. 00. [0] E. Jorsweck and H. Boche, Majorzaton and Matrx-Monotone Functons n Wreless Communcatons. Now ublshers, 007. [] D.. alomar, J. M. Coff, and M. A. Lagunas, Jont Tx-Rx beamforg desgn for multcarrer MIMO channels: A unfed framework for convex optmzaton, IEEE Trans. Sgnal rocess., vol. 5, no. 9, pp , Sep [] A. W. Marshall and I. Olkn, Inequaltes: Theory of Majorzaton and Its Applcatons. New York: Academc ress, 979.

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Joint source and relay design for MIMO multi-relay systems using projected gradient approach

Joint source and relay design for MIMO multi-relay systems using projected gradient approach Todng et al EURASIP Journal on Wreless Communcatons and Networkng 04, 04:5 http://jwcneuraspjournalscom/content/04//5 RESEARC Open Access Jont source and relay desgn for MIMO mult-relay systems usng projected

More information

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 66, NO. 10, OCTOBER

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 66, NO. 10, OCTOBER IEEE TRANSACTIONS ON VEICULAR TECNOLOGY, VOL. 66, NO. 10, OCTOBER 2017 8979 Robust MMSE Transcever Desgn for Nonregeneratve Multcastng MIMO Relay Systems Lenn Gopal, Member, IEEE, Yue Rong, Senor Member,

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

MIMO Systems and Channel Capacity

MIMO Systems and Channel Capacity MIMO Systems and Channel Capacty Consder a MIMO system wth m Tx and n Rx antennas. x y = Hx ξ Tx H Rx The power constrant: the total Tx power s x = P t. Component-wse representaton of the system model,

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor Prncpal Component Transform Multvarate Random Sgnals A real tme sgnal x(t can be consdered as a random process and ts samples x m (m =0; ;N, 1 a random vector: The mean vector of X s X =[x0; ;x N,1] T

More information

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Hidden Markov Models

Hidden Markov Models Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

e - c o m p a n i o n

e - c o m p a n i o n OPERATIONS RESEARCH http://dxdoorg/0287/opre007ec e - c o m p a n o n ONLY AVAILABLE IN ELECTRONIC FORM 202 INFORMS Electronc Companon Generalzed Quantty Competton for Multple Products and Loss of Effcency

More information

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding tle Lnear dsperson code wth an orthogonal row structure for smplfyng sphere decodng Author(s) Da XG; Cheung SW; Yuk I Ctaton he 0th IEEE Internatonal Symposum On Personal Indoor and Moble Rado Communcatons

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Control of Uncertain Bilinear Systems using Linear Controllers: Stability Region Estimation and Controller Design

Control of Uncertain Bilinear Systems using Linear Controllers: Stability Region Estimation and Controller Design Control of Uncertan Blnear Systems usng Lnear Controllers: Stablty Regon Estmaton Controller Desgn Shoudong Huang Department of Engneerng Australan Natonal Unversty Canberra, ACT 2, Australa shoudong.huang@anu.edu.au

More information

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1 Homework 4 Problem Capacty wth CSI only at Recever: C = log det I + E )) s HH H N M T R SS = I) SVD of the Channel Matrx: H = UΣV H = [U 1 U ] [ Σr ] [V 1 V ] H Capacty wth CSI at both transmtter and

More information

Unified Subspace Analysis for Face Recognition

Unified Subspace Analysis for Face Recognition Unfed Subspace Analyss for Face Recognton Xaogang Wang and Xaoou Tang Department of Informaton Engneerng The Chnese Unversty of Hong Kong Shatn, Hong Kong {xgwang, xtang}@e.cuhk.edu.hk Abstract PCA, LDA

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

Channel Estimation of MIMO Relay Systems With Multiple Relay Nodes

Channel Estimation of MIMO Relay Systems With Multiple Relay Nodes Receved September 21, 2017, accepted November 12, 2017, date of publcaton November 20, 2017, date of current verson December 22, 2017. Dgtal Object Identfer 10.1109/ACCESS.2017.2775202 Channel Estmaton

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Parameter Estimation for Dynamic System using Unscented Kalman filter

Parameter Estimation for Dynamic System using Unscented Kalman filter Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function A Local Varatonal Problem of Second Order for a Class of Optmal Control Problems wth Nonsmooth Objectve Functon Alexander P. Afanasev Insttute for Informaton Transmsson Problems, Russan Academy of Scences,

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly

More information

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization Sum Capacty of Multuser MIMO Broadcast Channels wth Block Dagonalzaton Zukang Shen, Runhua Chen, Jeffrey G. Andrews, Robert W. Heath, Jr., and Bran L. Evans The Unversty of Texas at Austn, Austn, Texas

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Linear precoding via conic optimization for fixed MIMO receivers

Linear precoding via conic optimization for fixed MIMO receivers Lnear precodng va conc optmzaton for fxed MIMO recevers Am Wesel, Yonna C Eldar, and Shlomo Shama (Shtz) Department of Electrcal Engneerng Technon - Israel Insttute of Technology June 8, 004 Abstract We

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

CRITICAL POINT ANALYSIS OF JOINT DIAGONALIZATION CRITERIA. Gen Hori and Jonathan H. Manton

CRITICAL POINT ANALYSIS OF JOINT DIAGONALIZATION CRITERIA. Gen Hori and Jonathan H. Manton CRITICAL POINT ANALYSIS OF JOINT DIAGONALIZATION CRITERIA Gen Hor and Jonathan H Manton Bran Scence Insttute, RIKEN, Satama 351-0198, Japan hor@bspbranrkengojp Department of Electrcal and Electronc Engneerng,

More information

Radar Trackers. Study Guide. All chapters, problems, examples and page numbers refer to Applied Optimal Estimation, A. Gelb, Ed.

Radar Trackers. Study Guide. All chapters, problems, examples and page numbers refer to Applied Optimal Estimation, A. Gelb, Ed. Radar rackers Study Gude All chapters, problems, examples and page numbers refer to Appled Optmal Estmaton, A. Gelb, Ed. Chapter Example.0- Problem Statement wo sensors Each has a sngle nose measurement

More information

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method Journal of Electromagnetc Analyss and Applcatons, 04, 6, 0-08 Publshed Onlne September 04 n ScRes. http://www.scrp.org/journal/jemaa http://dx.do.org/0.46/jemaa.04.6000 The Exact Formulaton of the Inverse

More information

FUll-duplex (FD) is a promising technique to increase

FUll-duplex (FD) is a promising technique to increase 1 Jont Relay-User Beamformng Desgn n Full-Duplex Two-Way Relay Channel Zhgang Wen, Shua Wang, Xaoqng Lu, and Junwe Zou arxv:1610.04974v1 cs.it] 17 Oct 2016 Abstract A full-duplex two-way relay channel

More information

CSCE 790S Background Results

CSCE 790S Background Results CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Systems of Equations (SUR, GMM, and 3SLS)

Systems of Equations (SUR, GMM, and 3SLS) Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ

More information

THE ARIMOTO-BLAHUT ALGORITHM FOR COMPUTATION OF CHANNEL CAPACITY. William A. Pearlman. References: S. Arimoto - IEEE Trans. Inform. Thy., Jan.

THE ARIMOTO-BLAHUT ALGORITHM FOR COMPUTATION OF CHANNEL CAPACITY. William A. Pearlman. References: S. Arimoto - IEEE Trans. Inform. Thy., Jan. THE ARIMOTO-BLAHUT ALGORITHM FOR COMPUTATION OF CHANNEL CAPACITY Wllam A. Pearlman 2002 References: S. Armoto - IEEE Trans. Inform. Thy., Jan. 1972 R. Blahut - IEEE Trans. Inform. Thy., July 1972 Recall

More information

Deriving the X-Z Identity from Auxiliary Space Method

Deriving the X-Z Identity from Auxiliary Space Method Dervng the X-Z Identty from Auxlary Space Method Long Chen Department of Mathematcs, Unversty of Calforna at Irvne, Irvne, CA 92697 chenlong@math.uc.edu 1 Iteratve Methods In ths paper we dscuss teratve

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

3.1 ML and Empirical Distribution

3.1 ML and Empirical Distribution 67577 Intro. to Machne Learnng Fall semester, 2008/9 Lecture 3: Maxmum Lkelhood/ Maxmum Entropy Dualty Lecturer: Amnon Shashua Scrbe: Amnon Shashua 1 In the prevous lecture we defned the prncple of Maxmum

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

Natural Language Processing and Information Retrieval

Natural Language Processing and Information Retrieval Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

CLOUD Radio Access Network (C-RAN) is an emerging

CLOUD Radio Access Network (C-RAN) is an emerging 7402 EEE TRANSACTONS ON NFORMATON THEORY VOL. 62 NO. 2 DECEMBER 206 On the Optmal Fronthaul Compresson and Decodng Strateges for Uplnk Cloud Rado Access Networks Yuhan Zhou Member EEE YnfeXuStudent Member

More information

Clock Synchronization in WSN: from Traditional Estimation Theory to Distributed Signal Processing

Clock Synchronization in WSN: from Traditional Estimation Theory to Distributed Signal Processing Clock Synchronzaton n WS: from Tradtonal Estmaton Theory to Dstrbuted Sgnal Processng Yk-Chung WU The Unversty of Hong Kong Emal: ycwu@eee.hku.hk, Webpage: www.eee.hku.hk/~ycwu Applcatons requre clock

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

763622S ADVANCED QUANTUM MECHANICS Solution Set 1 Spring c n a n. c n 2 = 1.

763622S ADVANCED QUANTUM MECHANICS Solution Set 1 Spring c n a n. c n 2 = 1. 7636S ADVANCED QUANTUM MECHANICS Soluton Set 1 Sprng 013 1 Warm-up Show that the egenvalues of a Hermtan operator  are real and that the egenkets correspondng to dfferent egenvalues are orthogonal (b)

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

The Quadratic Trigonometric Bézier Curve with Single Shape Parameter

The Quadratic Trigonometric Bézier Curve with Single Shape Parameter J. Basc. Appl. Sc. Res., (3541-546, 01 01, TextRoad Publcaton ISSN 090-4304 Journal of Basc and Appled Scentfc Research www.textroad.com The Quadratc Trgonometrc Bézer Curve wth Sngle Shape Parameter Uzma

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Homework Notes Week 7

Homework Notes Week 7 Homework Notes Week 7 Math 4 Sprng 4 #4 (a Complete the proof n example 5 that s an nner product (the Frobenus nner product on M n n (F In the example propertes (a and (d have already been verfed so we

More information

Relevance Vector Machines Explained

Relevance Vector Machines Explained October 19, 2010 Relevance Vector Machnes Explaned Trstan Fletcher www.cs.ucl.ac.uk/staff/t.fletcher/ Introducton Ths document has been wrtten n an attempt to make Tppng s [1] Relevance Vector Machnes

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Comparison of Wiener Filter solution by SVD with decompositions QR and QLP

Comparison of Wiener Filter solution by SVD with decompositions QR and QLP Proceedngs of the 6th WSEAS Int Conf on Artfcal Intellgence, Knowledge Engneerng and Data Bases, Corfu Island, Greece, February 6-9, 007 7 Comparson of Wener Flter soluton by SVD wth decompostons QR and

More information

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

General viscosity iterative method for a sequence of quasi-nonexpansive mappings Avalable onlne at www.tjnsa.com J. Nonlnear Sc. Appl. 9 (2016), 5672 5682 Research Artcle General vscosty teratve method for a sequence of quas-nonexpansve mappngs Cuje Zhang, Ynan Wang College of Scence,

More information

Lecture 10: May 6, 2013

Lecture 10: May 6, 2013 TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,

More information

Conjugacy and the Exponential Family

Conjugacy and the Exponential Family CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information