On the Maximum Weighted Sum-Rate of MIMO Gaussian Broadcast Channels

Size: px
Start display at page:

Download "On the Maximum Weighted Sum-Rate of MIMO Gaussian Broadcast Channels"

Transcription

1 Ths full text paper was peer revewed at the drecton of IEEE Communcatons Socety subject matter experts for publcaton n the ICC 2008 proceedngs On the Maxmum Weghted Sum-Rate of MIMO Gaussan Broadcast Channels Ja Lu, Y Thomas Hou, and Hanf D Sheral Bradley Department of Electrcal and Computer Engneerng Grado Department of Industral and Systems Engneerng Vrgna Polytechnc Insttute and State Unversty, Blacksburg, VA 2406 Abstract In ths paper, we nvestgate the maxmum weghted sum-rate problem MWSR of MIMO Gaussan broadcast channels MIMO-BC We propose an effcent algorthm that employs conjugate gradent projectons CGP to solve the MWSR problem The proposed CGP offers provable convergence By deflectng gradent drecton to ts Hessan conjugate, CGP enjoys a superlnear convergence rate Also, CGP has a modest memory requrement It only needs the soluton nformaton from the prevous step More mportantly, CGP s able to solve the MWSR problem wth arbtrary number of antennas on both sdes of a MIMO-BC I INTRODUCTION The capacty regon of multple-nput multple-output broadcast channels MIMO-BC has receved great attenton n recent years MIMO-BC belongs to the class of nondegraded broadcast channels, for whch the capacty regon s a wellknown hard problem [] Recently, Wegarten et al [2] proved that drty paper codng DPC acheves the entre capacty regon of MIMO-BC Moreover, by uplnk-downlnk dualty [3], the nonconvex MIMO-BC capacty regon wth respect to the downlnk nput covarance matrces can be transformed to ts dual MIMO multple access channel MIMO-MAC capacty regon wth a sum power constrant Snce the capacty regon of the dual MIMO-MAC s convex wth respect to the uplnk nput covarance matrces, effcent optmzaton for MIMO-BC becomes possble In ths paper, we nvestgate the maxmum weghted sumrate problem MWSR of MIMO-BC Important applcatons of MWSR arse from cross-layer optmzaton for MIMObased ad hoc networks [4] and stablzng the transmsson buffers to guarantee farness for MIMO-based cellular downlnks [5] The MWSR problem of MIMO-BC s the general case of the maxmum sum-rate problem MSR, whch has been solved by a number of algorthms such as the mnmax method MM [6], the gradent method GD [7], the Lagrangan dual decomposton LDD method [8], and the teratve water-fllng methods IWF [9] However, IWF, MM, and LDD cannot be readly appled to solve MWSR In [5], Kobayash et al extended IWF to solve the MWSR problem and proposed some modfcatons to IWF M-IWF to handle scalablty ssue However, ther algorthm s only vald for the case where each recever s equpped wth sngle antenna For general scenaros where recevers are equpped wth multple antennas, only GD s readly applcable However, GD does not fully take advantage of the gradent nformaton and may not converge under some crcumstances The lmtatons of these exstng algorthms motvate us to desgn an effcent, robust, and scalable algorthm to solve the MWSR problem of large MIMO-BC systems wth arbtrary number of antennas Our man contrbuton n ths paper s that we desgn an effcent algorthm to solve the MWSR problem based on conjugate gradent projecton CGP approach Our algorthm s nspred by [0], where Ye et al used a gradent projecton method to fnd a local optmum of the maxmum sum-rate for Gaussan MIMO Interference Channels MIMO-IC However, unlke [0], we propose to use conjugate gradent drectons nstead of gradent drectons to reduce the zgzaggng phenomenon so as to speed up convergence Also, snce the MWSR problem of MIMO-BC can be transformed nto an equvalent convex problem, our CGP method can determne the global optmum of MIMO-BC For the semdefnte cone projecton subproblem, we develop a rgorous algorthm based on Lagrangan dualty Our proposed CGP has the followng attractve features CGP offers provable convergence Unlke M-IWF, whch s only vald for cases where each recever has a sngle antenna, CGP can handle arbtrary number of antennas on both sdes of a MIMO-BC CGP enjoys a superlnear convergence rate Also, per teraton complexty of CGP s OK, where K s the number of users CGP has a modest memory requrement: t only needs the soluton nformaton from the prevous step The remander of ths paper s organzed as follows In Secton II, we present the network model and the problem formulaton Secton III ntroduces the key components n of CGP, ncludng the computaton of conjugate gradents and solvng projecton subproblem In Secton IV, we analyze the complexty of CGP and present numercal results Secton V concludes ths paper II SYSTEM MODEL AND PROBLEM FORMULATION We begn wth ntroducng notaton We use boldface to denote matrces and vectors For a complex-valued matrx A, A denote the conjugate transpose of A and Tr{A} denotes the trace of A WeletI denote an dentty matrx wth dmenson determned from the context A 0 represents that A s Hermtan and postve semdefnte PSD Dag{A A n } /08/$ IEEE

2 Ths full text paper was peer revewed at the drecton of IEEE Communcatons Socety subject matter experts for publcaton n the ICC 2008 proceedngs denotes the block dagonal matrx wth matrces A,,A n on ts man dagonal Suppose that a MIMO Gaussan broadcast channel has K users, the transmtter has n t antennas, and each of the K users s equpped wth n r antennas The channel matrx for user s denoted as H C nr nt It has been shown n [2] that the capacty regon of a MIMO-BC s equal to the drtypaper codng DPC rate regon Suppose that users,,k are encoded sequentally, then the DPC rate of user can be computed as [3] K I + H C DPC j= S j H S = log K I + H j=+ S, j where S C nt nt, =,,K,arethedownlnk nput covarance matrces and S {S,S K } denotes the collecton of all the downlnk covarance matrces The MWSR problem can be wrtten as follows: Maxmze w C DPC S subject to S 0, =,,K 2 TrS P, where w s the weght assgned to user, P represents the maxmum transmt power It s evdent that 2 s a nonconvex optmzaton problem snce the DPC rate equaton n s a nonconvex functon of the nput covarance matrces S,,S K However, from the uplnk-downlnk dualty theorem [3], we know that the rates achevable n a MIMO- BC are also achevable n ts dual MIMO-MAC That s, gven a feasble S, there exsts a set of feasble uplnk nput covarance matrces for ts dual MIMO-MAC, denoted by Q, such that C MAC Q =C DPC S Thus, 2 s equvalent to the followng MWSR problem of the dual MIMO-MAC wth a sum power constrant: Maxmze w C MAC Q subject to Q 0, =,,K C MAC Q C MAC P, H 3, =,,K TrQ P, where Q C nr nr, =,,K, are the uplnk nput covarance matrces, Q {Q,Q K } represents the collecton of all the uplnk covarance matrces, and C MAC P, H represents the capacty regon of the dual MIMO-MAC, and can be determned by C MAC P, H = S C Q log I + S H Q H, Conv C,,C K S {,,K},, 4 TrQ P, Q 0, where Conv represents the convex hull operaton When the dual MIMO-MAC s Gaussan, the convex hull operaton can be dropped [] H The capacty regon of a MIMO-MAC can be acheved by successve decodng [] However, n order to determne the capacty regon of a MIMO-MAC, K! possble successve decodng orders may need to be enumerated, whch makes the problem ntractable f the number of users s large We gve the followng result, whch shows that such an enumeraton can ndeed be avoded Theorem The MWSR problem n 3 can be solved by the followng equvalent optmzaton problem: Maxmze subject to w π w π log I + K j= H Q H TrQ P max Q 0, =,,K, where w π0 0, π s a permutaton of the set {,,K} such that w π w πk e, π =j represents the th poston n permutaton π s user j Proof Snce the objectve functon s monotoncally ncreasng, the optmal soluton of 3 must be acheved on the boundary of the capacty regon We assume that the weghts are not dentcal Otherwse, the MWSR s reduced to a scaled MSR problem, where the optmal soluton s trvally acheved at any of the K! corner ponts of the capacty regon As a result, the optmal soluton s acheved n a subregon on the boundary of the capacty regon under one of the K! decodng order [] Furthermore, snce such a subregon conssts of all corner ponts wth the same decodng order under all feasble power allocatons, the optmal soluton must be acheved at a corner pont correspondng to some decodng order and some power allocaton Suppose that π s the optmal decodng order It s easy to see that, for the MWSR problem, the objectve gradent at every pont on the boundary of the capacty regon s [ wπ w π2 w πk ] T Snce the objectve functon of 3 s lnear and the capacty regon s convex, 3 s a convex programmng problem wth non-empty feasble regon, whch means Slater condtons holds cf [] As a result, KKT condton s necessary and suffcent for optmalty For smplcty, we drop the superscrpt MAC and smply refer the rates n the dual MIMO-MAC as C Note that n successve decodng wth decodng order π, the actve rate vector constrants at a corner pont correspondng to π are C πk log I + H πk Q πk H πk, C πk + C πk log I +, =K H π Q π H π C π + + C πk + C πk log I +, H π Q π H π 5 6

3 Ths full text paper was peer revewed at the drecton of IEEE Communcatons Socety subject matter experts for publcaton n the ICC 2008 proceedngs where Q π, =, 2,,K represent the optmal nput covarance matrces that acheve the maxmum weghted sumrate Thus, by KKT condton, we have w π w πk w πk 0 = u 0 0 +u 2 + +u K where u 0, Solvng for u n 7, we have u K = w π u K = w π+ w π,, 2,,K Snce u 0, t then follows that w π w π2 w πk, 7 Snce the constrants n 6 are tght at optmalty, we have C πk = log I + H πk Q πk H πk, 8 C π = log I + H πk Q πk H πk j= log I + H πk Q πk H πk, 9 j=+ for =, 2,,K Summng up all w π C π and after rearrangng the terms, t can be readly verfed that w π C π = w π w π log I + H Q H 0 j= It then follows that the MWSR problem of the dual MIMO- MAC s equvalent to maxmzng 0 wth the sum power constrant, e, the optmzaton problem n 5 One mportant observaton from 5 s that, snce log s a concave functon for postve semdefnte matrces [], 5 s a convex optmzaton problem wth respect to the uplnk nput covarance matrces Q π,,q πk However, although standard convex optmzaton tools can be used to solve 5, t s consderably more complex than a customdesgned method that explots the specal structure of the problem III SOLVING MWSR USING CONJUGATE GRADIENT PROJECTION To solve 5, we propose an effcent algorthm based on conjugate gradent projecton CGP, whch utlzes an mportant concept called Hessan conjugate to deflect the gradent drecton In dong so, we can acheve an asymptotc superlnear convergence rate [], whch s close to that of quas- Newton methods, eg, BFGS method The convergence proof of CGP reles on provng the closedness of the algorthmc maps for fndng conjugate gradent drectons and performng projectons, respectvely Due to space lmtaton, we refer readers to [] for detals The CGP pseudo-code for solvng 5 s shown n Algorthm Algorthm CGP Method for Solvng MWSR Intalzaton: Choose the ntal condtons Q 0 =[Q 0, Q0 2,,Q0 K ]T Let k =0 Man Loop: Calculate the gradents G k, =, 2,,K as follows: Ḡ =2H [ j wπ w π I + H πk Q πkh πk H 2 Deflect the gradents usng Fletcher and Reeves choce of deflecton: ρ k = Ḡk 2 Ḡk 2 3 Choose an approprate step sze s k LetQ k = Q k + s k G k, for =, 2,,K 4 Let Q k be the projecton of Q k onto Ω + P, whereω + P {Q, =,,K Q 0, Tr{Q } P } 5 Choose approprate step sze α k LetQ k+ Q k, =, 2,,K = Q k + α k k Q 6 k = k + If the maxmum absolute value of the elements n Q k Q k <ɛ,for =, 2,,L, then stop; else go to step Due to the complexty of the objectve functon n 5, we adopt Armjo Rule nexact lne search to avod excessve objectve functon evaluatons, whle stll enjoyng provable convergence [] We now consder two major components n the CGP framework: how to compute the conjugate gradent drecton G ; and 2 how to project Q k onto the set Ω + P {Q,,,K : Q 0, Tr{Q } P } A Computng the Conjugate Gradents For convenence, we denote the objectve functon of 5 as JQ To compute the gradent Ḡ Q JQ, the frst step s to compute the partal dervatve of JQ wth respect to Q The computaton of partal dervatves of JQ reles on the followng equaton from matrx dfferental calculus ln A+BXC X = [ CA + BXC B ] T [0], [2] Frst of all, we can compute the partal dervatve of the th term n the summaton of JQ wth respect to Q, j, as follows: K w π w π log I + H πk Q πkh πk Q = w π w π H I + H πk Q πkh πk H Note that for gradent Ḡ, only the frst j terms n JQ nvolve Q From the defnton z fz =2 fz/ z T

4 Ths full text paper was peer revewed at the drecton of IEEE Communcatons Socety subject matter experts for publcaton n the ICC 2008 proceedngs [3], we obtan [ j Ḡ =2H wπ w π I + H πk Q πkh πk H Although the s seemngly qute complex, we can n fact explot the specal summaton structure to reduce ts computatonal complexty when mplementng CGP Note that the most computatonally heavy part n the expresson of Ḡ s the summaton of the terms n the form of H πk Q πkh πk Under drect computaton, we wll have j2k + j/2 tmes of such addtons for these terms Fortunately, most of these terms n the summaton occur repeatedly when j vares Therefore, we can store a runnng sum n the form of I + H πk Q πkh πk Then, startng out from j = K and reducng j by one subsequently, we only need to compute such addton once n each teraton The conjugate gradent drecton n the k th teraton can be computed as G k = Ḡk + ρ kg k We adopt the Fletcher and Reeves choce of deflecton [], whch can be computed as ρ k = Ḡk 2/ Ḡk 2 After such deflecton, we obtaned the so-called Hessan-conjugate of The beneft of usng Hessan conjugate deflecton s that we can reduce the zgzaggng phenomenon encountered n the conventonal gradent projecton method, and acheve an asymptotc superlnear convergence rate [] Also, n CGP, we do not need to store a Hessan approxmaton matrx as n quas-newton methods, whose sze s usually large G k B Constraned Semdefnte Cone Projecton The goal of the projecton subproblem n CGP s to fnd a projecton on a constraned semdefnte cone for Q, Snce G s Hermtan, we have that Q k = Qk + s kg k s Hermtan as well Then, the projecton problem becomes how to smultaneously project K Hermtan matrces onto the set Ω + P max {Q l : l Tr{Q l} P max, Q l 0, l =,,K} We construct a block dagonal matrx D = Dag { } Q π Q πk C K n r K n r It s easy to recognze that Q Ω + P max, j =,,K, f and only f TrD = j= Tr Q Pmax and D 0 In our projecton, gven a block dagonal matrx D n,wewsh to fnd a matrx D n Ω + P max such that Dn mnmzes D n D n F, where F denotes Frobenus norm, e, equvalently, we solve the followng optmzaton problem Mnmze 2 D D 2 F subject to Tr D P max, D 0 2 Note that ths problem s a convex mnmzaton problem and we can solve ths mnmzaton problem by solvng ts Lagrangan dual Assocatng Hermtan matrx X to the constrant D 0 and µ to the constrant Tr D Pmax, we can wrte the Lagrangan as gx,µ = mn D{/2 D D 2 F TrX D +µtr D Pmax } Snce gx,µ s an unconstraned convex quadratc mnmzaton problem, we can compute the mnmzer of the Lagrangan by smply settng ts frst dervatve wth respect to D to zero, e, D D X + µi =0 Notng that X = X, wehave D = D µi + X Substtutng D back nto the Lagrangan and after some algebrac smplfcatons, we can rewrte the Lagrangan dual problem as Maxmze 2 D µi + X 2 F µp max + 2 D 2 subject to X 0,µ 0 3 In semdefnte programmng, 3 s referred to as matrx nearness problems [4], [5] Generc matrx nearness problems are hard to solve Fortunately, thanks to the pecewse quadratc structure n 3, t s possble to solve 3 effcently Due to space lmtaton, we refer readers to [6] for more detals IV PERFORMANCE AND COMPLEXITY COMPARISONS In ths secton, we compare CGP wth other exstng algorthms Among these algorthms, the mnmax method MM [6] s more complex than the others havng the lnear complexty and s not readly applcable for MWSR The Lagrangan dual decomposton method LDD [8] conssts of nested teratve loops n solvng the Lagrangan dual n each teraton and therefore has a non-determnstc complexty per teraton The teratve water-fllng methods IWF n [9] do not scale well as the number of users ncreases because the most recently updated soluton n each teraton only accounts for a fracton of /K n the effectve channels computaton Also, IWF cannot be drectly used to solve MWSR Kobayash et al proposed modfcatons of IWF M-IWF for solvng MWSR They also came up wth a new averagng update scheme to address the scalablty ssue of IWF However, as ndcated by Kobayash et al, M-IWF can only handle the case when each recever n a MIMO-BC has only one antenna The gradent method GD n [7] also uses the gradent nformaton to gude the search of optmal soluton Let v and λ be the prncpal egenvector of unt norm and prncpal egenvalue for Q, respectvely, =, 2,,KLetj = arg maxλ,,λ K The terate of GD s updated as Q k+ where the movng drecton s = Q k + t d k, d k =[ Q k, Qk 2, Q k j + P v j v j, Qk K ]T, and the step-sze t s determned by the followng lne search t = arg max J tqk,, tqk j + tp v 0 t j v j,, tq k K, where the nterval 0 t ensures that the searchng stays n the feasble regon The drecton d k s obtaned by v j v j projected onto the hyperplane TrQk =P, whch, although related to the gradent at Q k, s very dfferent to

5 Ths full text paper was peer revewed at the drecton of IEEE Communcatons Socety subject matter experts for publcaton n the ICC 2008 proceedngs our approach In essence, v j v j s a rank-one update to Qk j, as opposed to the full-rank update n CGP In fact, GD s a varant of Zoutendjk method, for whch the convergence s not guaranteed as the algorthmc map of Zoutendjk method s not closed [] Fg shows a equal-weghted 0-user equalweghted MIMO-BC example where GD fals to converge to the optmal soluton Sum Rate nats/s/hz GD CGP Number of Iteratons Fg A 0-user MIMO-BC channel wth n t = n r =4where GD fals to converge to the optmal soluton It can also be seen from Fg that CGP s very effcent It only takes 20 teratons to reach to the global optmum In fact, t can be shown that, by usng conjugate gradent drectons, CGP acheves an asymptotc superlnear convergence rate V CONCLUSION In ths paper, we nvestgated the maxmum weghted sumrate problem MWSR of MIMO Gaussan broadcast channels MIMO-BC We proposed an effcent algorthm called conjugate gradent projectons CGP to solve the MWSR problem The proposed CGP has provable convergence Wth approprate deflectons for gradents, CGP enjoys an asymptotc superlnear convergence rate Also, CGP has a modest memory requrement, whch only needs the soluton nformaton from the prevous step Another attractve feature of CGP s that t can handle arbtrary number of antennas on both sdes of a MIMO-BC [3] S Vshwanath, N Jndal, and A Goldsmth, Dualty, achevable rates, and sum-rate capacty of MIMO broadcast channels, IEEE Trans Inf Theory, vol 49, no 0, pp , Oct 2003 [4] J Lu, Y T Hou, and H D Sheral, Routng and power allocaton for mesh networks wth MIMO Gaussan broadcast channels, n Proc IEEE ICC, Bejng, Chna, May9-23, 2008 [5] M Kobayash and G Care, An teratve water-fllng algorthm for maxmum weghted sum-rate of Gaussan MIMO-BC, IEEE J Sel Areas Commun, vol 24, no 8, pp , 2006 [6] T Lan and W Yu, Input optmzaton for mult-antenna broadcast channels and per-antenna power constrants, n Proc IEEE GLOBECOM, vol, Dallas, TX, USA, Nov 2004, pp [7] H Vswanathan, S Venkatesan, and H Huang, Downlnk capacty evaluaton of cellular networks wth known-nterference cancellaton, IEEE J Sel Areas Commun, vol 2, no 5, pp 802 8, Jun 2003 [8] W Yu, Sum-capacty computaton for the gaussan vector broadcast channel va dual decomposton, IEEE Trans Inf Theory, vol 52, no 2, pp , Feb 2006 [9] N Jndal, W Rhee, S Vshwanath, S A Jafar, and A Goldsmth, Sum power teratve water-fllng for mult-antenna Gaussan broadcast channels, IEEE Trans Inf Theory, vol 5, no 4, pp , Apr 2005 [0] S Ye and R S Blum, Optmzed sgnalng for MIMO nterference systems wth feedback, IEEE Trans Sgnal Process, vol 5, no, pp , Nov 2003 [] M S Bazaraa, H D Sheral, and C M Shetty, Nonlnear Programmng: Theory and Algorthms, 3rd ed New York, NY: John Wley & Sons Inc, 2006 [2] J R Magnus and H Neudecker, Matrx Dfferental Calculus wth Applcatons n Statstcs and Economcs New York: Wley, 999 [3] S Haykn, Adaptve Flter Theory Englewood Clffs, NJ: Prentce-Hall, 996 [4] J Malck, A dual approach to semdefnte least-squares problems, SIAM Journal on Matrx Analyss and Applcatons, vol 26, no, pp , Sep 2005 [5] S Boyd and L Xao, Least-squares covarance matrx adjustment, SIAM Journal on Matrx Analyss and Applcatons, vol 27, no 2, pp , Nov 2005 [6] J Lu, Y T Hou, and H D Sheral, Conjugate gradent projecton approach for MIMO Gaussan broadcast channels, n Proc IEEE Internatonal Symposum on Informaton Theory ISIT, Nce, France, Jun24-29, 2007, pp [7] J Lu, Y T Hou, Y Sh, and H Sheral, On the capacty of multuser MIMO networks wth nterference, IEEE Trans Wreless Commun, vol 7, no 2, pp , Feb 2008 ACKNOWLEDGEMENTS The work of YT Hou and J Lu has been supported n part by the Natonal Scence Foundaton NSF under Grant CNS and Offce of Naval Research ONR under Grant N The work of HD Sheral has been supported n part by NSF Grant CMMI REFERENCES [] T M Cover and J A Thomas, Elements of Informaton Theory New York: John Wley & Sons, Inc, 99 [2] H Wengarten, Y Stenberg, and S Shama, The capacty regon of the Gaussan multple-nput multple-output broadcast channel, IEEE Trans Inf Theory, vol 52, no 9, pp , Sep 2006

Conjugate Gradient Projection Approach for MIMO Gaussian Broadcast Channels

Conjugate Gradient Projection Approach for MIMO Gaussian Broadcast Channels Conjugate Gradent Projecton Approach for MIMO Gaussan Broadcast Channels Ja Lu Y. Thomas Hou Sastry Kompella Hanf D. Sheral Department of Electrcal and Computer Engneerng, Vrgna Tech, Blacksburg, VA 4061

More information

Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels

Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels Conjugate Gradent Projecton Approach for Mult-Antenna Gaussan Broadcast Channels Ja Lu, Y. Thomas Hou, and Hanf D. Sheral Department of Electrcal and Computer Engneerng Department of Industral and Systems

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels

Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels Conjugate Gradient Projection Approach for Multi-Antenna Gaussian Broadcast Channels Jia Liu Y. Thomas Hou Hanif D. Sherali The Bradley Department of Electrical and Computer Engineering The Grado Department

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

Alternating Optimization for Capacity Region of Gaussian MIMO Broadcast Channels with Per-antenna Power Constraint

Alternating Optimization for Capacity Region of Gaussian MIMO Broadcast Channels with Per-antenna Power Constraint Alternatng Optmzaton for Capacty Regon of Gaussan MIMO Broadcast Channels wth Per-antenna Power Constrant Thuy M. Pham, Ronan Farrell, and Le-Nam Tran Department of Electronc Engneerng, Maynooth Unversty,

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

1 Derivation of Point-to-Plane Minimization

1 Derivation of Point-to-Plane Minimization 1 Dervaton of Pont-to-Plane Mnmzaton Consder the Chen-Medon (pont-to-plane) framework for ICP. Assume we have a collecton of ponts (p, q ) wth normals n. We want to determne the optmal rotaton and translaton

More information

6.854J / J Advanced Algorithms Fall 2008

6.854J / J Advanced Algorithms Fall 2008 MIT OpenCourseWare http://ocw.mt.edu 6.854J / 18.415J Advanced Algorthms Fall 2008 For nformaton about ctng these materals or our Terms of Use, vst: http://ocw.mt.edu/terms. 18.415/6.854 Advanced Algorthms

More information

IV. Performance Optimization

IV. Performance Optimization IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation Two-Way and Multple-Access Energy Harvestng Systems wth Energy Cooperaton Berk Gurakan, Omur Ozel, Jng Yang 2, and Sennur Ulukus Department of Electrcal and Computer Engneerng, Unversty of Maryland, College

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16 STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor Prncpal Component Transform Multvarate Random Sgnals A real tme sgnal x(t can be consdered as a random process and ts samples x m (m =0; ;N, 1 a random vector: The mean vector of X s X =[x0; ;x N,1] T

More information

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence. Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm

More information

On a direct solver for linear least squares problems

On a direct solver for linear least squares problems ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Appendix B. The Finite Difference Scheme

Appendix B. The Finite Difference Scheme 140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton

More information

Lecture 17: Lee-Sidford Barrier

Lecture 17: Lee-Sidford Barrier CSE 599: Interplay between Convex Optmzaton and Geometry Wnter 2018 Lecturer: Yn Tat Lee Lecture 17: Lee-Sdford Barrer Dsclamer: Please tell me any mstake you notced. In ths lecture, we talk about the

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or

More information

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function A Local Varatonal Problem of Second Order for a Class of Optmal Control Problems wth Nonsmooth Objectve Functon Alexander P. Afanasev Insttute for Informaton Transmsson Problems, Russan Academy of Scences,

More information

14 Lagrange Multipliers

14 Lagrange Multipliers Lagrange Multplers 14 Lagrange Multplers The Method of Lagrange Multplers s a powerful technque for constraned optmzaton. Whle t has applcatons far beyond machne learnng t was orgnally developed to solve

More information

Maximal Margin Classifier

Maximal Margin Classifier CS81B/Stat41B: Advanced Topcs n Learnng & Decson Makng Mamal Margn Classfer Lecturer: Mchael Jordan Scrbes: Jana van Greunen Corrected verson - /1/004 1 References/Recommended Readng 1.1 Webstes www.kernel-machnes.org

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information

Distributed Non-Autonomous Power Control through Distributed Convex Optimization

Distributed Non-Autonomous Power Control through Distributed Convex Optimization Dstrbuted Non-Autonomous Power Control through Dstrbuted Convex Optmzaton S. Sundhar Ram and V. V. Veeravall ECE Department and Coordnated Scence Lab Unversty of Illnos at Urbana-Champagn Emal: {ssrnv5,vvv}@llnos.edu

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Fisher Linear Discriminant Analysis

Fisher Linear Discriminant Analysis Fsher Lnear Dscrmnant Analyss Max Wellng Department of Computer Scence Unversty of Toronto 10 Kng s College Road Toronto, M5S 3G5 Canada wellng@cs.toronto.edu Abstract Ths s a note to explan Fsher lnear

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13 CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization Sum Capacty of Multuser MIMO Broadcast Channels wth Block Dagonalzaton Zukang Shen, Runhua Chen, Jeffrey G. Andrews, Robert W. Heath, Jr., and Bran L. Evans The Unversty of Texas at Austn, Austn, Texas

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Topic 5: Non-Linear Regression

Topic 5: Non-Linear Regression Topc 5: Non-Lnear Regresson The models we ve worked wth so far have been lnear n the parameters. They ve been of the form: y = Xβ + ε Many models based on economc theory are actually non-lnear n the parameters.

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Lecture 5 Decoding Binary BCH Codes

Lecture 5 Decoding Binary BCH Codes Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture

More information

CHALMERS, GÖTEBORGS UNIVERSITET. SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS. COURSE CODES: FFR 135, FIM 720 GU, PhD

CHALMERS, GÖTEBORGS UNIVERSITET. SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS. COURSE CODES: FFR 135, FIM 720 GU, PhD CHALMERS, GÖTEBORGS UNIVERSITET SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS COURSE CODES: FFR 35, FIM 72 GU, PhD Tme: Place: Teachers: Allowed materal: Not allowed: January 2, 28, at 8 3 2 3 SB

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

10-701/ Machine Learning, Fall 2005 Homework 3

10-701/ Machine Learning, Fall 2005 Homework 3 10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

A SEPARABLE APPROXIMATION DYNAMIC PROGRAMMING ALGORITHM FOR ECONOMIC DISPATCH WITH TRANSMISSION LOSSES. Pierre HANSEN, Nenad MLADENOVI]

A SEPARABLE APPROXIMATION DYNAMIC PROGRAMMING ALGORITHM FOR ECONOMIC DISPATCH WITH TRANSMISSION LOSSES. Pierre HANSEN, Nenad MLADENOVI] Yugoslav Journal of Operatons Research (00) umber 57-66 A SEPARABLE APPROXIMATIO DYAMIC PROGRAMMIG ALGORITHM FOR ECOOMIC DISPATCH WITH TRASMISSIO LOSSES Perre HASE enad MLADEOVI] GERAD and Ecole des Hautes

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

Joint Scheduling and Resource Allocation in CDMA Systems

Joint Scheduling and Resource Allocation in CDMA Systems TO APPEAR IEEE TRANSACTIONS ON INFORMATION THEORY Jont Schedulng and Resource Allocaton n CDMA Systems Vjay G. Subramanan, Randall A. Berry, and Rajeev Agrawal Abstract In ths paper, the schedulng and

More information

Joint Scheduling and Resource Allocation in CDMA Systems

Joint Scheduling and Resource Allocation in CDMA Systems ACCEPTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 1 Jont Schedulng and Resource Allocaton n CDMA Systems Vjay G. Subramanan, Randall A. Berry, and Rajeev Agrawal Abstract We consder schedulng and resource

More information