Alternating Optimization for Capacity Region of Gaussian MIMO Broadcast Channels with Per-antenna Power Constraint

Size: px
Start display at page:

Download "Alternating Optimization for Capacity Region of Gaussian MIMO Broadcast Channels with Per-antenna Power Constraint"

Transcription

1 Alternatng Optmzaton for Capacty Regon of Gaussan MIMO Broadcast Channels wth Per-antenna Power Constrant Thuy M. Pham, Ronan Farrell, and Le-Nam Tran Department of Electronc Engneerng, Maynooth Unversty, Maynooth, Co. Kldare, Ireland Emal: {mnhthuy.pham, ronan.farrell, arxv: v2 [cs.it] 17 May 2017 Abstract Ths paper characterzes the capacty regon of Gaussan MIMO broadcast channels (BCs) wth per-antenna power constrant (PAPC). Whle the capacty regon of MIMO BCs wth a sum power constrant (SPC) was extensvely studed, that under PAPC has receved less attenton. A reason s that effcent solutons for ths problem are hard to fnd. The goal of ths paper s to devse an effcent algorthm for determnng the capacty regon of Gaussan MIMO BCs PAPC, whch s scalable to the problem sze. To ths end, we frst transform the weghted sum capacty maxmzaton problem, whch s nherently nonconvex wth the nput covarance matrces, nto a convex formulaton n the dual multple access channel by mnmax dualty. Then we derve a computatonally effcent algorthm combnng the concept of alternatng optmzaton and successve convex approxmaton. The proposed algorthm acheves much lower complexty compared to an exstng nterorpont method. Moreover, numercal results demonstrate that the proposed algorthm converges very fast under varous scenaros. Index Terms MIMO, mnmax dualty, drty paper codng, alternatng optmzaton, successve convex optmzaton. I. INTRODUCTION Snce ts nventon n the md-90s [1], [2], multple-nput multple-output (MIMO) technology has been adopted n all modern moble wreless networs. From a system desgn perspectve, one of the most fundamental problems s to compute the capacty of the system of nterest. For a sngle user MIMO (SU-MIMO) channel, poneer studes proved that the capacty can be acheved by Gaussan nput sgnalng [1], [2]. For multuser MIMO scenaros, the semnal wor of [3] showed that drty-paper codng (DPC) n fact acheves the entre capacty regon of Gaussan MIMO broadcast channels (BCs). The partcular case of the sum capacty of MIMO BCs was studed n several poneer studes ncludng [3] [7], The capacty of MIMO systems s nvestgated along wth a certan type of constrant on the nput covarance matrces. In ths regard, we remar that all papers mentoned above assume a sum power constrant (SPC), and ths usually leads to effcently computatonal algorthms. For the sum-capacty computaton, Vswanathan et al. [8] appled a steepest descend method, whle Yu [9] proposed a dual decomposton-based algorthm. In ths lne of research, Jndal et al. presented a sum power teratve water-fllng algorthm by explotng the MAC- BC dualty. The entre capacty regon of MIMO BCs wth a SPC was characterzed n [10], [11], usng conjugate gradent projecton (CGP)- and pre-condtoned gradent projectonbased approaches. Whle SPC has been wdely consdered, t s less appealng n realty due to the fact that each antenna s usually equpped wth a dfferent power amplfer, whch has ts own power budget. Despte ts practcal and fundamental mportance, the research on effcent methods for computng the capacty regon of Gaussan MIMO BCs has been qute lmted. For SU-MIMO, ths problem was solved n [12], [13] by the socalled mode-droppng algorthm. In [3], t was shown that DPC stll acheves the full capacty regon of the MIMO BC under PAPC. However, fndng the DPC regon wth PAPC s more numercally dffcult than wth a SPC. In fact, no closed-form desgn has been reported for the computaton of the capacty regon of the MIMO BC PAPC. To the best of our nowledge, the only attempt to characterze the entre capacty regon of the MIMO BC PAPC was made n [14]. Specfcally, the authors n [14] establshed a modfed dualty between the MAC and BC and transformed the nput optmzaton problem n the BC nto a mnmax optmzaton problem n the dual MAC. Then resultng program s solved by a standard barrer nteror-pont routne. Thus, as a common property for the class of second order optmzaton methods, the algorthm proposed n [14] has computatonal complexty that does not favor large-scale antenna systems whch are envsoned n next wreless communcatons generatons. In ths paper, we determne the capacty regon of MIMO BCs under PAPC. In partcular, the problem of nterest s also nown as weghted sum rate maxmzaton (WSRMax) for MIMO BCs. As mentoned earler, the capacty regon can be acheved by DPC, but the resultng WSRMax problem s nonconvex. As a standard step, we apply the mnmax dualty presented n [14] to transform the WSRMax problem nto a mnmax program. However, unle [14] whch solves the resultng mnmax problem by a barrer nterorpont method, we tae advantage of the problem specfcs to propose an effcent algorthm that blends the concept of alternatng optmzaton (AO) and successve convex approxmaton (SCA). Especally, n each teraton of the proposed algorthm, closed-form expressons based on conjugate gradent projecton (CGP) method are derved. As a result, the complexty of the proposed algorthm s much lower than that of the barrer method n [14], and scales lnearly wth the

2 number of users n the system, mang t partcularly sutable for large-scale networs. Numercal experments are carred out to demonstrate that the proposed algorthm can converge rapdly, especally for networs of hgh sgnal-to-nose rato, and the number of teratons requred for convergence s qute nsenstve to the number of users. The remander of the paper s organzed as follows. The system model s descrbed n Secton II followed by the proposed algorthm n Secton III. Secton IV provdes the complexty analyss of the proposed algorthm whle Secton V presents the numercal results. Fnally, we conclude the paper n Secton VI. Notaton: Standard notatons are used n ths paper. Bold lower and upper case letters represent vectors and matrces, respectvely. I defnes an dentty matrx, of whch the sze can be easly nferred from the context; C M N denotes the space of M N complex matrces; H and H T are Hermtan and normal transpose of H, respectvely; H,j s the (, j)th entry of H; H s the determnant of H; ran(h) stands for the ran of H; dag(x) denotes the dagonal matrx wth dagonal elements beng x. II. SYSTEM MODEL Consder a K-user MIMO BC where the base staton and each user have N and M antennas, respectvely. The channel matrx for user s denoted by H. Let s be the composte sgnal that combnes the data for all users n the downln. Then, the receved sgnal at user s expressed as y = H s + z (1) where z s the Gaussan nose wth dstrbuton CN (0, I M ). When DPC s appled to acheve the capacty regon, for a gven user, the nterference caused by users j < s completely canceled wthout affectng the optmalty. As a result, the WSRMax under PAPC s formulated as maxmze {S 0} w log I+H =1 SH [S ], P, I+H 1 =1 SH where S s the nput covarance matrx for the th user, P s the power constrant on antenna, and w s the weghtng factor assgned to user. Wthout loss of optmalty, we assume that 0 < w 1 w 2... w K n the followng. Snce (2) s a nonconvex problem, solvng t drectly s not a good opton. However, we can explot the MAC-BC dualty to transform (2) nto mnmax program n the dual MAC whch can be solved effcently by the novel AO as presented n the next secton. III. PROPOSED SOLUTION (2) and w = 1 Applyng the modfed MAC-BC dualty ntroduced n [15], we can equvalently rewrte (2) as the followng mnmax optmzaton problem mn max Q 0 { S 0} log Q + = H S H w K log Q tr( S ) = P, tr(qp) = P, Q : dagonal where = w w 1 0, P N =1 P ; { S } and Q are nput covarance and nose covarance matrces n the dual MAC, respectvely. As shown n [15], the objectve n (3) s convex wth Q 0 and concave wth { S 0}. Thus, there exsts a saddle pont for (3), whch also solves (2). The mnmax formulaton n (3) also suggests a way to fnd { S } and Q by AO. However, a pure AO algorthm s not guaranteed to converge. In fact, a counterexample was already gven n [16]. In what follows, we propose an teratve algorthm based on combnng AO and SCA, of whch convergence can be proved. Let { S n } be the soluton to the followng maxmzaton problem n the nth teraton maxmze { S 0} log Q n + = H S H tr( S ) = P. The above maneuver s nothng but a standard routne of optmzng { S } when Q s held fxed. Problem (4) can be solved by off-the-shelf nteror-pont convex solvers but the complexty s not affordable for large-scale systems. In our numercal experments, all of nown (free and commercal) solvers fal to solve (4) on a relatvely powerful destop PC for N 100, regardless of the number of users. That s, nterorpont methods are not an effcent approach to solvng (4) for massve MIMO technques whch are lely to be adopted n 5G systems. To overcome ths shortcomng, we now present an effcent method to solve (4) based on the CGP framewor. To proceed, let S = { S S 0, tr( S ) = P } be the feasble set of (4). The man operaton of a CGP method s to project a gven { S } onto S. Our motvaton s that the projecton of { S } onto S can be reduced to a projecton of a resultng vector onto a canoncal smplex, whch can be computed effcently. The projecton of { S } onto the feasble set S s formulated as Ṡ S 2 F {Ṡ 0} (5) K tr(ṡ) = P. Let U D U = S be the EVD of S, where U s untary and D s dagonal. Then we can wrte Ṡ = U Ḋ U for some Ḋ 0. Snce U s untary, t holds that tr(ṡ) = tr(ḋ) and that Ṡ S F = Ḋ D F. That s to say, (5) s equvalent to {Ḋ 0} Ḋ D 2 F tr(ḋ) = P. (3) (4) (6)

3 It s easy to see that Ḋ must be dagonal to the objectve of (6). Next let d = dag(ḋ), d = dag( D ), d = [ d T 1, d T 2,..., d T K ]T, and d = [ d T 1, d T 2,..., d T K ]T. Then (6) can be reduced to 1 2 d d 2 2 d 0 (7) 1 M d = P where M = 1 M. It s now clear that (7) s the projecton onto a canoncal smplex and effcent algorthms (smlar to water-fllng algorthms) can be found n [17]. The complete descrpton of the proposed CGP method for solvng (4) s provded n Algorthm 1. We note that smlar approaches were also presented n [10], [11]. Algorthm 1: The proposed CGP algorthm for solvng (4). Input: P, ǫ > 0 1 Intalzaton: τ = 1 + ǫ, m = 0, { S 0 } S. 2 whle (τ > ǫ) do 3 Calculate the conjugate gradent G m. 4 Choose an approprate postve scalar s m and create S m = S m + sm Gm. 5 Project S m onto S to obtan Ṡm. 6 Choose approprate step sze α m and set S m+1 = S m + αm (Ṡm S m ). 7 τ = tr( f( S m ) ( S m+1 S m )). 8 m := m end Output: S as the optmal soluton to (4). Another man step of a CGP method s the computaton of the conjugated gradent of the objectve, as requred n lne 3 of Algorthm 1. The conjugate gradent, denoted as G m, can be calculated as follows. Frst, we compute the gradent of the objectve n (4) as ) 1 f( S ) = H j (Q + H S H H. (8) j=1 =j Then the conjugate gradent drecton s gven by G m = f( S m ) + β m Gm 1 (9) where the parameter β m s the Fletcher choce of deflecton [18] { 0 m = 0 β m = f( S m (10) ) 2 m 1 tr(( G m 1 ) f( S m 1 )) For the step sze n lne 6 of Algorthm 1, we perform an Armjo lne search [19] to determne approprate value. For the mportance case of the sum capacty of the MIMO BC, we note that more effcent approaches to solvng (4) do exst. In fact, n ths case (4) becomes maxmze { S 0} log Q n + =1 H S H tr( S ) = P. (11) We remar that (11) s equvalent to the problem of fndng the sum-capacty of a MAC wth a SPC for whch the sum power teratve water-fllng proposed n [20] or the dual decomposton method n [9] have been shown to be partcularly computatonally effcent. We now turn our attenton to the problem of fndng Q n+1. If a pure AO method s followed, we arrve at the optmzaton problem below: Q 0 log Q + = H S H w K log Q tr(qp) = P (12) However, as mentoned n [14] and also observed n [16], the convergence of such a nave AO method s not guaranteed. The novelty of our proposed AO algorthm s that, nstead of optmzng the orgnal objectve n (12) whch can lead to fluctuatons, we opt to an upper bound of the objectve n (12). Ths s n lght of the SCA prncple, and wll lead to a monotonc convergence as shown n the Appendx. To ths end, by nvong the concavty of logdet functon, we have the followng nequalty log Q + = H S n H log Φ n + tr( Φ n ( Q Q n )) (13) where Φ n = Q n + = H S n H, Φ n (Φ n ) 1. Thus, usng the above upper bound, Q n+1 s found to be the optmal soluton to the followng problem ( ) K Q 0 w K tr Φ n Q log Q (14) tr(qp) = P. Snce Q n (14) s dagonal,.e., Q = dag(q), we can rewrte (14) as N q>0 =1 φn q log q N =1 P (15) q = P, ] where φ n = [ w K Φ n,,.e., φn s the th dagonal element of w K Φ n. By settng the dervatve of Lagrangan functon of (15) to zero, we obtan 1 q = φn + γp (16) where γ 0 s the soluton of the equaton N P φn + γp = P. (17) =1 Denote g(γ) = N K P =1 P. It s easy to see that φn +γp g(γ) s decreasng wth γ. When γ = 0, snce q 1 we have N φn P P q = P. (18) =1 φn =1 Therefore, (17) always has a unque soluton, whch can found effcently, e.g., by the bsecton or Newton method. The proposed algorthm based on AO s summarzed n Algorthm 2. N

4 The man pont of Algorthm 2 s to elmnate the possble png-pong effect of the obtaned objectve by the use of the nequalty n (13). The convergence proof of Algorthm 2 s provded n the Appendx. Note that the error tolerance τ of Algorthm 2 s only computed for n 1. Algorthm 2: Proposed algorthm for the computaton of the capacty regon of a MIMO BC based on AO. Input: Q := Q 0 dagonal matrx of postve elements, ǫ > 0 1 Intalzaton: Set n := 0 and τ = 1 + ǫ. 2 whle (τ > ǫ) do 3 Solve (4) and denote the optmal soluton by { S n } 4 For n 1 compute τ = f DPC (Q n, { S n }) f DPC (Q n 1, { S n 1 }), where f DPC ( ) denotes the objectve n (3). 5 For each, compute Φ n = (Q n + = H S n H ) 1. 6 Solve (14) to fnd Q n+1. 7 n := n end Output: Use the obtaned { S n }K and the BC-MAC transformaton n [5] to fnd the optmal soluton to (2). IV. COMPLEXITY ANALYSIS In ths secton, we analyze the complexty estmaton of the proposed algorthm n terms of the number of flops. The results of flop countng for typcal matrx operatons such as EVD, matrx nverson are taen from [21] and [22]. Moreover,we treat every complex operaton as 6 real flops as consdered n [22], [23]. In the complexty analyss presented below, we only consder the man operatons of hgh complexty n the overall complexty. A. Complexty of Algorthm 2 Algorthm 2 has two ey procedures, one for fndng { S } and one for fndng Q. Of all steps n Algorthm 1, the computaton of the conjugate gradent drecton gven n (8) has the largest computaton cost. Smlarly, the complexty for fndng Q s mostly due to the computaton of Φ n defned n (13). Therefore, the per-teraton complexty of Algorthm 2 s O(KN 3 ). That s, the complexty of the proposed algorthm ncreases lnearly wth the number of users. B. Complexty of the Barrer Interor-Pont Method n [14] The method presented n [14] s based on solvng the KKT condton for (3). To fnd the gradent w.r.t each nput covarance matrx for the logdet functon, the complexty s 6N 3. Then, to fnd a Newton drecton, ths algorthm stll needs to solve a lnear system of M(M + 1)/2 unnowns, whch requres 6( KM(M+1) 2 + 3N) 3 flops. 1 In total, the perteraton complexty s O(K 2 N 3 + K 3 M 6 ). 1 Here we assume M = M for all to smplfy the notaton. TABLE I PER-ITERATION COMPLEXITY COMPARISON Algorthms Per-teraton complexty Algorthm 2 O(KN 3 ) Barrer nteror-pont method [14] O(K 2 N 3 + K 3 M 6 ) The complexty comparson s summarzed n Table I. We remar that the complexty of Algorthm 2 ncreases lnearly wth the number of users K, whch was also acheved n [20] for the sum-capacty wth SPC. Thus, Algorthm 2 scales much better than the barrer nteror-pont method n [14] wth the number of users. V. NUMERICAL RESULTS Ths secton provdes numercal results to verfy the proposed algorthm. If not otherwse mentoned, the number of transmt antennas at the BS s set to N = 5 and the number of receve antennas at each user s set to M = 2 for all.. The total power P s vared from a low value to a hgh one to nvestgate the convergence rate of the proposed algorthm.the power constrant for each transmt antenna s set equally. The ntal value Q 0 n the proposed algorthm s set to the dentty matrx. An error tolerance of ǫ = 10 6 s selected as the stoppng crteron for the proposed algorthm. In the frst smulaton, we plot the convergence of the proposed algorthm for dfferent value of the total transmt power for a set of randomly generated channel realzatons. As can be seen, Fg. 1 shows that the convergence of the proposed algorthm s strctly monotonc as proved n the Appendx. An nterestng observaton s that the number of teratons decreases when the total power ncreases. As mentoned n the complexty analyss, the proposed algorthm has a desrable property,.e., the per-teraton complexty ncreases lnearly wth the number of users K. Ths s an attractve property n the system of a large number of users whch s usually the case for a massve MIMO setup. However, t s dffcult, f not mpossble, to analyze the convergence rate of the proposed algorthm wth K by analytcal expressons. Instead, we study the convergence property of the proposed algorthm wth K by numercal experments. For the purpose, we plot n Fg. 2 the average number of teratons requred by the proposed algorthm to converge. As can be seen, the number of teratons for the proposed algorthm to converge s relatvely nsenstve to K. It s worth notng that for smlar setups, the nteror-pont method n [14] requres at least 60 teratons to converge, whle the proposed algorthm only taes 4 teratons even n the case of 50 users. Ths promsng characterstc of the proposed algorthm maes t sutable for studyng the capacty regon of massve MIMO systems where the number of transmt antennas and/or the number of users can be very large. Ths pont wll be further elaborated n the next numercal experment. Tang the advantage that the proposed algorthm has low complexty, n the last numercal experment we characterze the capacty regon of a massve MIMO system wth PAPC. In

5 Dualty gap P = 0 db P = 10 db P = 20 db R2 4 2 ZF, PAPC DPC, PAPC DPC, SPC Average number of teratons Iteraton Fg. 1. Convergence behavor of the proposed algorthm wth K = P = 0 db P = 20 db Number of users Fg. 2. Average number of teratons versus number of users. partcular, we also consder achevable rate regon of the wellnown ZF scheme [24], [25]. The purpose s to understand the performance of ZF (whch s thought to be sub-optmal) n comparson wth the capacty achevng codng scheme under some realstc channel models. To ths end we consder a smple urban scenaro usng WINNER II B1 channel model [26], where a base staton, equpped wth N = 128 antennas, s located at the center of the cell and sngle-antenna recevers are dstrbuted randomly. The total power at the BS s P = 46 dbm and each antenna s equal power constrant,.e., P = P/N for = 1, 2,..., 128. As can be seen clearly n Fg. 3, there s a remarable gap between the achevable rate regon of ZF and the capacty regon, especally when the number of users ncreases. Ths bascally mples that ZF s stll far from optmal for a practcal number of transmt antennas. Our observaton opens research opportuntes n the future to stre the balance between optmal performance by DPC and low-complexty by ZF. VI. CONCLUSIONS In ths paper, we have consdered the problem of computng the capacty regon of Gaussan MIMO BCs PAPC. R R 1 (a) Number of users K = 2 ZF, PAPC DPC, PAPC DPC, SPC R 1 (b) Number of users K = 8 Fg. 3. Comparson of capacty regon of a massve MIMO setup wth N = 128 and M = 1 for all. For the case K = 8 users, the capacty regon s projected on the frst two users. Towards ths end, the problem of WSRMax wth PAPC has been solved by a low-complexty algorthm. We have frst converted the noncovex problem of MIMO BC nto an equvalent mnmax problem n the correspondng dual MAC. Then a novel AO algothm has been proposed to solve the resultng mmmax program n combnaton wth the successve convex optmzaton prncple. In partcular, all the computaton n the proposed algorthm s based on closed-form expressons. In addton, the smulaton results have demonstrated a fast and stable convergence of the proposed algorthm, even for large-scale settngs. ACKNOWLEDGEMENTS Ths wor was supported by a research grant from Scence Foundaton Ireland and s co-funded by the European Regonal Development Fund under Grant 13/RC/2077.

6 APPENDIX For notatonal convenence, we denote Q {Q Q : dagonal, Q 0, tr(qp) = P }, ˆ = w K. Snce the functon log Q + = H S H s jontly concave wth Q and { S }, the followng nequalty holds ˆ log Q + H S H = ˆ log Q n + H S n H + + = } {{ } Φ n ( ) ˆ tr Φ n (Q Qn ) ˆ K = H ( S S n )) (19) for all Q Q and { S } S. The above nequalty comes from the frst order approxmaton of log Q+ = H S H around the pont (Q n, { S n }). Substtute Q := Qn+1 and S := nto the above equalty, we have S n+1 ˆ log Q n+1 + H n+1 S H = ˆ (log Φ n + tr(φ n (Qn+1 Q n )) + = H ( S n+1 S n )) ). (20) Snce { S n } = arg max log Q n + = H S H, { S } S the optmalty condton results n ˆ K = H ( S S n )) 0 (21) for all { S } S. For { S } = { S n+1 } the above nequalty s equal to ˆ whch leads to K = H ( S n+1 S n )) 0 (22) ˆ log Q n+1 + H n+1 S H = ˆ (log Φ n + tr( Φ n (Qn+1 Q n ) )). (23) Subtract both sdes of the above nequalty by log Q n+1 results n ˆ log Q n+1 + H n+1 S H log Q n+1 = } {{ } f DPC (Q n+1,{ S n+1 }) ˆ (log Φ n +tr( Φ n (Qn+1 Q n ) )) log Q n+1. Snce Q n+1 solves (14) t holds that (24) ˆ (log Φ n + tr( Φ n (Qn+1 Q n ) )) log Q n+1 ˆ (log Φ n + tr( Φ n (Q Qn ) )) log Q (25) for all Q Q. For the specal case Q := Q n, the nequalty above s reduced to ˆ (log Φ n + tr ( Φ n (Qn+1 Q n ) )) log Q n+1 ˆ log Φ n log Q n. (26) } {{ } f DPC (Q n,{ S n }) Combnng (24) and (26) results n f DPC (Q n, { S n }) f DPC (Q n+1, { S n+1 }). It s easy to see that {f DPC (Q n, { S n })} s bounded above, and thus {f DPC (Q n, { S n })} s convergent. We also note that (13) s strct f Q Q n. Consequently, the sequence {f DPC (Q n, { S n })} s strctly decreasng unless t s convergent. Therefore, the contnuty of f DPC ( ) and the compactness of S and Q mply lm f DPC (Q n, { S n n }) = f DPC (Q, { S }). REFERENCES [1] E. Telatar, Capacty of mult-antenna Gaussan channels, Eur. Trans. Telecommun, vol. 10, pp , Nov [2] G. J. Foschn and M. J. Gans, On lmts of wreless communcatons n a fadng envronment when usng multple antennas, Wreless Pers.Commun, vol. 6, pp , Mar [3] H. Wengarten, Y. Stenberg, and S. S. Shama, The capacty regon of the Gaussan multple-nput multple-output broadcast channel, IEEE Trans. Inf. Theory, vol. 52, no. 9, pp , Sep [4] G. Care and S. Shama, On the achevable throughput of a multantenna Gaussan broadcast channel, IEEE Trans. Inf. Theory, vol. 49, no. 7, pp , Jul [5] S. Vshwanath, N. Jndal, and A. Goldsmth, Dualty, achevable rates and sum-rate capacty of Gaussan MIMO broadcast channels, IEEE Trans. Inf. Theory, vol. 49, pp , Oct [6] P. Vswanath and D. Tse, Sum capacty of the vector Gaussan broadcast channel and upln-downln dualty, IEEE Trans. Inf. Theory, vol. 49, no. 8, pp , Aug [7] W. Yu and J. Coff, Sum capacty of Gaussan vector broadcast channels, IEEE Trans. Inf. Theory, vol. 50, no. 9, pp , Sep [8] H. Vswanathan, S. Venatesan, and H. Huang, Downln capacty evaluaton of cellular networs wth nown-nterference cancellaton, IEEE J. Sel. Areas Commun., vol. 21, no. 5, pp , Jun

7 [9] W. Yu, Sum-capacty computaton for the Gaussan vector broadcast channel va dual decomposton, IEEE Trans. Inf. Theory, vol. 52, no. 2, pp , Feb [10] J. Lu, Y. T. Hou, and H. D. Sheral, On the maxmum weghted sumrate of MIMO Gaussan broadcast channels, n Proc. IEEE ICC, May 2008, pp [11] R. Hunger, D. A. Schmdt, M. Joham, and W. Utschc, A general covarance-based optmzaton framewor usng orthogonal projectons, n Proc. IEEE SPAWC, Jul. 2008, pp [12] M. Vu, MIMO capacty wth per-antenna power constrant, n Proc. IEEE GLOBECOM, Dec. 2011, pp [13], The capacty of MIMO channels wth per-antenna power constrant, CoRR, vol. abs , [14] W. Yu and T. Lan, Transmtter optmzaton for the mult-antenna downln wth per-antenna power constrants, IEEE Trans. Sgnal Process., vol. 55, no. 6, pp , Jun [15] W. Yu, Upln-downln dualty va mnmax dualty, IEEE Trans. Inf. Theory, vol. 52, no. 2, pp , Feb [16] T. M. Pham, R. Farrell, and L.-N. Tran, Revstng the MIMO capacty wth per-antenna power constrant: Fxed-pont teraton and alternatng optmzaton, IEEE Trans. Sgnal Process., submtted. [17] L. Condat, Fast projecton onto the smplex and the l 1 ball, Mathematcal Programmng, Seres A, vol. 158, no. 1, pp , July [18] R. Fletcher, Practcal Methods of Optmzaton, 2nd ed. New Yor, NY, USA: Wley-Interscence, [19] L. Armjo, Mnmzaton of functons havng Lpschtz contnuous frst partal dervatves. Pacfc J. Math., vol. 16, no. 1, pp. 1 3, [20] N. Jndal, W. Rhee, S. Vshwanath, S. Jafar, and A. Goldsmth, Sum power teratve water-fllng for mult-antenna Gaussan broadcast channels, IEEE Trans. Inf. Theory, vol. 51, no. 4, pp , Apr [21] G. H. Golub and C. F. V. Loan, Matrx Computatons, 3rd ed. The John Hopns Unv. Press, [22] Z. Shen, R. Chen, J. Andrews, J. Heath, R.W., and B. Evans, Low complexty user selecton algorthms for multuser MIMO systems wth bloc dagonalzaton, IEEE Trans. Sgnal Process., vol. 54, no. 9, pp , Sep [23] L.-N. Tran, M. Bengtsson, and B. Ottersten, Iteratve precoder desgn and user schedulng for bloc-dagonalzed systems, IEEE Trans. Sgnal Process., vol. 60, no. 7, pp , Jul [24] Q. Spencer, A. Swndlehurst, and M. Haardt, Zero-forcng methods for downln spatal multplexng n multuser MIMO channels, IEEE Trans. Sgnal Process., vol. 52, no. 2, pp , Feb [25] K. Karaayal, R. Yates, G. Foschn, and R. Valenzuela, Optmum zero-forcng beamformng wth per-antenna power constrants, n Proc. IEEE ISIT 2007, Jun. 2007, pp [26] P. Kyöst, J. Menlä, L. Hentlä, X. Zhao, T. Jämsä, C. Schneder, M. Narandzć, M. Mlojevć, A. Hong, J. Yltalo, V.-M. Holappa, M. Alatossava, R. Bulttude, Y. de Jong, and T. Rautanen, Wnner II channel models, tech. rep. D1.1.2 V1.2, IST WINNER II, 2007.

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

Conjugate Gradient Projection Approach for MIMO Gaussian Broadcast Channels

Conjugate Gradient Projection Approach for MIMO Gaussian Broadcast Channels Conjugate Gradent Projecton Approach for MIMO Gaussan Broadcast Channels Ja Lu Y. Thomas Hou Sastry Kompella Hanf D. Sheral Department of Electrcal and Computer Engneerng, Vrgna Tech, Blacksburg, VA 4061

More information

Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels

Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels Conjugate Gradent Projecton Approach for Mult-Antenna Gaussan Broadcast Channels Ja Lu, Y. Thomas Hou, and Hanf D. Sheral Department of Electrcal and Computer Engneerng Department of Industral and Systems

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

On the Maximum Weighted Sum-Rate of MIMO Gaussian Broadcast Channels

On the Maximum Weighted Sum-Rate of MIMO Gaussian Broadcast Channels Ths full text paper was peer revewed at the drecton of IEEE Communcatons Socety subject matter experts for publcaton n the ICC 2008 proceedngs On the Maxmum Weghted Sum-Rate of MIMO Gaussan Broadcast Channels

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization Sum Capacty of Multuser MIMO Broadcast Channels wth Block Dagonalzaton Zukang Shen, Runhua Chen, Jeffrey G. Andrews, Robert W. Heath, Jr., and Bran L. Evans The Unversty of Texas at Austn, Austn, Texas

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

6.854J / J Advanced Algorithms Fall 2008

6.854J / J Advanced Algorithms Fall 2008 MIT OpenCourseWare http://ocw.mt.edu 6.854J / 18.415J Advanced Algorthms Fall 2008 For nformaton about ctng these materals or our Terms of Use, vst: http://ocw.mt.edu/terms. 18.415/6.854 Advanced Algorthms

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation Two-Way and Multple-Access Energy Harvestng Systems wth Energy Cooperaton Berk Gurakan, Omur Ozel, Jng Yang 2, and Sennur Ulukus Department of Electrcal and Computer Engneerng, Unversty of Maryland, College

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

EXTENSION OF SEDJOCO AND ITS USE IN A COMBINATION OF MULTICAST AND COORDINATED MULTI-POINT SYSTEMS

EXTENSION OF SEDJOCO AND ITS USE IN A COMBINATION OF MULTICAST AND COORDINATED MULTI-POINT SYSTEMS EXTENSION OF SEDJOCO AND ITS USE IN A COMBINATION OF MULTICAST AND COORDINATED MULTI-POINT SYSTEMS Yao Cheng 1, Are Yeredor 2, and Martn Haardt 1 1 Communcatons Research Laboratory 2 School of Electrcal

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

MIMO Systems and Channel Capacity

MIMO Systems and Channel Capacity MIMO Systems and Channel Capacty Consder a MIMO system wth m Tx and n Rx antennas. x y = Hx ξ Tx H Rx The power constrant: the total Tx power s x = P t. Component-wse representaton of the system model,

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

1 Matrix representations of canonical matrices

1 Matrix representations of canonical matrices 1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:

More information

Lecture 21: Numerical methods for pricing American type derivatives

Lecture 21: Numerical methods for pricing American type derivatives Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)

More information

Antenna Combining for the MIMO Downlink Channel

Antenna Combining for the MIMO Downlink Channel Antenna Combnng for the IO Downlnk Channel arxv:0704.308v [cs.it] 0 Apr 2007 Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of nnesota nneapols, N 55455, USA Emal: nhar@umn.edu Abstract

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

IV. Performance Optimization

IV. Performance Optimization IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

General viscosity iterative method for a sequence of quasi-nonexpansive mappings Avalable onlne at www.tjnsa.com J. Nonlnear Sc. Appl. 9 (2016), 5672 5682 Research Artcle General vscosty teratve method for a sequence of quas-nonexpansve mappngs Cuje Zhang, Ynan Wang College of Scence,

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

On a direct solver for linear least squares problems

On a direct solver for linear least squares problems ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1 Homework 4 Problem Capacty wth CSI only at Recever: C = log det I + E )) s HH H N M T R SS = I) SVD of the Channel Matrx: H = UΣV H = [U 1 U ] [ Σr ] [V 1 V ] H Capacty wth CSI at both transmtter and

More information

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence. Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm

More information

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function A Local Varatonal Problem of Second Order for a Class of Optmal Control Problems wth Nonsmooth Objectve Functon Alexander P. Afanasev Insttute for Informaton Transmsson Problems, Russan Academy of Scences,

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium?

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium? APPLIED WELFARE ECONOMICS AND POLICY ANALYSIS Welfare Propertes of General Equlbrum What can be sad about optmalty propertes of resource allocaton mpled by general equlbrum? Any crteron used to compare

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

On Spatial Capacity of Wireless Ad Hoc Networks with Threshold Based Scheduling

On Spatial Capacity of Wireless Ad Hoc Networks with Threshold Based Scheduling On Spatal Capacty of Wreless Ad Hoc Networks wth Threshold Based Schedulng Yue Lng Che, Ru Zhang, Y Gong, and Lngje Duan Abstract arxv:49.2592v [cs.it] 9 Sep 24 Ths paper studes spatal capacty n a stochastc

More information

FUll-duplex (FD) is a promising technique to increase

FUll-duplex (FD) is a promising technique to increase 1 Jont Relay-User Beamformng Desgn n Full-Duplex Two-Way Relay Channel Zhgang Wen, Shua Wang, Xaoqng Lu, and Junwe Zou arxv:1610.04974v1 cs.it] 17 Oct 2016 Abstract A full-duplex two-way relay channel

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

Lagrange Multipliers Kernel Trick

Lagrange Multipliers Kernel Trick Lagrange Multplers Kernel Trck Ncholas Ruozz Unversty of Texas at Dallas Based roughly on the sldes of Davd Sontag General Optmzaton A mathematcal detour, we ll come back to SVMs soon! subject to: f x

More information

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression 11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

On the Global Linear Convergence of the ADMM with Multi-Block Variables

On the Global Linear Convergence of the ADMM with Multi-Block Variables On the Global Lnear Convergence of the ADMM wth Mult-Block Varables Tany Ln Shqan Ma Shuzhong Zhang May 31, 01 Abstract The alternatng drecton method of multplers ADMM has been wdely used for solvng structured

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Inexact Alternating Minimization Algorithm for Distributed Optimization with an Application to Distributed MPC

Inexact Alternating Minimization Algorithm for Distributed Optimization with an Application to Distributed MPC Inexact Alternatng Mnmzaton Algorthm for Dstrbuted Optmzaton wth an Applcaton to Dstrbuted MPC Ye Pu, Coln N. Jones and Melane N. Zelnger arxv:608.0043v [math.oc] Aug 206 Abstract In ths paper, we propose

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

Linear precoding via conic optimization for fixed MIMO receivers

Linear precoding via conic optimization for fixed MIMO receivers Lnear precodng va conc optmzaton for fxed MIMO recevers Am Wesel, Yonna C Eldar, and Shlomo Shama (Shtz) Department of Electrcal Engneerng Technon - Israel Insttute of Technology June 8, 004 Abstract We

More information

University of Alberta. Library Release Form. Title of Thesis: Joint Bandwidth and Power Allocation in Wireless Communication Networks

University of Alberta. Library Release Form. Title of Thesis: Joint Bandwidth and Power Allocation in Wireless Communication Networks Unversty of Alberta Lbrary Release Form Name of Author: Xaowen Gong Ttle of Thess: Jont Bandwdth and Power Allocaton n Wreless Communcaton Networks Degree: Master of Scence Year ths Degree Granted: 2010

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Rethinking MIMO for Wireless Networks: Linear Throughput Increases with Multiple Receive Antennas

Rethinking MIMO for Wireless Networks: Linear Throughput Increases with Multiple Receive Antennas Retnng MIMO for Wreless etwors: Lnear Trougput Increases wt Multple Receve Antennas ar Jndal Unversty of Mnnesota Unverstat Pompeu Fabra Jont wor wt Jeff Andrews & Steven Weber MIMO n Pont-to-Pont Cannels

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

The Two-User Gaussian Fading Broadcast Channel

The Two-User Gaussian Fading Broadcast Channel The Two-User Gaussan Fadng Broadcast Channel Amn Jafaran Lab of Informatcs, Networks & Communcatons LINC Department of Electrcal & Computer Engneerng Unversty of Texas at Austn Austn, TX 787, USA Emal:

More information

Least squares cubic splines without B-splines S.K. Lucas

Least squares cubic splines without B-splines S.K. Lucas Least squares cubc splnes wthout B-splnes S.K. Lucas School of Mathematcs and Statstcs, Unversty of South Australa, Mawson Lakes SA 595 e-mal: stephen.lucas@unsa.edu.au Submtted to the Gazette of the Australan

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information