CHANNEL state information (CSI) has a significant impact

Size: px
Start display at page:

Download "CHANNEL state information (CSI) has a significant impact"

Transcription

1 Ffty-second Annual Allerton Conference Allerton House, UIUC, Illnos, USA October 1-3, 2014 Ergodc Capacty Under Channel Dstrbuton Uncertanty Sergey Loyka, Charalambos D. Charalambous and Ioanna Ioannou Abstract The mpact of channel dstrbuton uncertanty on the performance of fadng channels s studed. The compound capacty of a class of ergodc fadng channels subject to channel dstrbuton uncertanty s obtaned, for arbtrary nose and nomnal channel dstrbuton. The saddle-pont property s establshed, so that the compound capacty equals to the worst-case channel capacty, whch s characterzed as 1-D convex optmzaton problem. The propertes of worst-case mutual nformaton and channel dstrbuton are studed. Closed-form solutons are obtaned n the asymptotc regmes of small and large uncertanty, and an error floor effect s establshed n the latter case. The known results for the ergodc capacty of the Gaussan MIMO channel under..d. Raylegh fadng are shown to hold under the channel dstrbuton uncertanty as well. I. INTRODUCTION CHANNEL state nformaton CSI) has a sgnfcant mpact on channel performance as well as code desgn to acheve that performance. Ths effect s especally pronounced for wreless channels, due to ther dynamc nature, lmtatons of a feedback lnk, channel estmaton errors etc. [1][2]. When only ncomplete or naccurate CSI s avalable, performance analyss and codng technques have to be modfed properly. The mpact of channel uncertanty has been extensvely studed snce late 1950s [3]-[5]; see [2] for an extensve lterature revew up to late 1990s. Snce channel estmaton s done at the recever Rx) and then transmtted to the transmtter Tx) va a lmted f any) feedback lnk, most studes concentrate on lmted CSI avalable at the Tx end assumng full CSI at the Rx end. There are several typcal approaches to ths problem. In the compound channel model, the channel s unknown to the Tx but s known to belong to a certan class of channels. A member of the channel uncertanty class s selected at the begnnng and held constant durng the entre transmsson, thus modelng a scenaro wth lttle dynamcs channel coherence tme sgnfcantly exceeds the codeword duraton [1][6]). A more dynamc approach s that of the arbtrary-varyng channel, where the channel s allowed to vary from symbol to symbol beng unknown to the Tx [2]. Incomplete CSI at the Tx end can be addressed by assumng that the channel s not known but ts dstrbuton s known to the Tx, the so-called channel dstrbuton nformaton CDI) [1][6]. However, complete knowledge of CDI can be S. Loyka s wth the School of Electrcal Engneerng and Computer Scence, Unversty of Ottawa, Ontaro, Canada, K1N 6N5, e-mal: sergey.loyka@eee.org I. Ioannou and C.D. Charalambous are wth the ECE Department, Unversty of Cyprus, 75 Kallpoleos Avenue, P.O. Box 20537, Ncosa, 1678, Cyprus, e-mal: aoannak@yahoo.gr, chadcha@ucy.ac.cy questoned on the same grounds as complete CSI: when only a lmted sample set s avalable always a practcalty), channel dstrbuton can be obtaned wth lmted accuracy only especally at the dstrbuton tals); lmted feedback lnk dctates quantzaton of the estmated CDI before transmsson, thus ntroducng the quantzaton nose; presence of nose and channel dynamcs makes any estmate naccurate to a certan degree. Ths motvates us to study the mpact of naccurate channel dstrbuton nformaton on system performance. In the context of non-ergodc fadng channels such study has been reported n [7], where the man performance metrc was the outage probablty. It was demonstrated that naccurate CDI lmts the achevable outage probablty: ncreasng the SNR over a certan threshold does not reduce the outage probablty,.e. an error floor effect. The key parameter characterzng the error floor effect s the dstance between the nomnal estmated) and true dstrbutons as measured by the relatve entropy, regardless of any other channel specfcs e.g. nomnal CDI, nose dstrbuton etc.). In the present paper, we carry out a smlar nvestgaton for ergodc settngs,.e. assumng that the channel s subject to an ergodc fadng process so that the man performance metrc s ergodc capacty [1]. However, snce ncomplete naccurate) CDI s assumed, the standard results on ergodc capacty [1][6] do not apply as certan achevable performance have to be demonstrated for the whole class of dstrbutons, not just for a sngle one. We accomplsh ths usng the standard compound channel approach [1][2] - properly extended to the ergodc settng. Ths allows us to establsh the operatonal meanng of the max-mn ergodc mutual nformaton MI), where mn s over all channel dstrbutons n the uncertanty class and max s over all feasble nput dstrbutons, as the largest achevable rate under the CDI uncertanty. Frst, the worst-case ergodc MI s characterzed as a 1- D convex optmzaton problem; ts propertes are studed and asymptotc analytcal solutons small/large uncertanty regmes) are obtaned n closed forms. An error floor effect s establshed n the large-uncertanty regme: the worst-case MI and thus the compound capacty cannot be ncreased by ncreasng SNR but rather more accurate channel estmaton s requred to accomplsh ths. Our analyss of the smalluncertanty regme answers quanttatvely the queston how accurate s the perfect CDI?. Then, an operatonal meanng of the worst-case MI as the largest achevable rate for a gven nput dstrbuton s establshed and the correspondng compound channel capacty s shown to be the max-mn MI where the mn n over class of /14/$ IEEE 779

2 channels and max s over the nput dstrbuton); a number of ts propertes are also establshed. The saddle-pont property s shown to hold, so that the compound channel capacty equals to the worst-case channel capacty, from whch ts gametheoretc nterpretaton follows. These results are further extended to contnuous fadng dstrbutons and an AWGN MIMO channel s consdered subject to any untary-nvarant fadng of whch..d. Raylegh fadng s a specal case). The optmal sgnalng s shown to be sotropc Gaussan, thus extendng the correspondng result n [11] n several drectons from..d. Raylegh to any untary-nvarant fadng; from a sngle fadng channel to a compound channel settng to accommodate channel dstrbuton uncertanty; the same optmal sgnalng s shown to hold under the total as well as per-antenna power constrants, thus demonstratng that no advantage s ganed by tradng off the power among the Tx antennas). II. CHANNEL MODEL Let x and y be the channel nput and output respectvely, and h be the channel state all can be sequences). Assume that the full channel state nformaton CSI) s avalable at the recever but not the transmtter see e.g. [1][6] for a detaled motvaton of ths assumpton) and that the channel nput x and state h are ndependent of each other. For any channel state and nput dstrbuton px), the channel s characterzed by ts nstantaneous) mutual nformaton MI) Ix; y, h) = Ix; y h), where, followng [1][6], we have augmented the output wth the channel state snce t s known at the Rx) and have used the ndependence of x and h. We wll further assume that the channel s subject to an ergodc fadng characterzed by ts probablty dstrbuton f. For a fnte-state channel, h {h 1,..., h m }, f s the probablty of h = h, and I = Ix; y h ) s the nstantaneous) mutual nformaton supported by channel realzaton h under gven nput dstrbuton px); wthout loss of generalty, assume decreasng orderng I 1 I 2... I m unless otherwse ndcated, we assume that not all I are the same). The ergodc mutual nformaton supported by ths channel s Ix; y f) = f I 1) whch s also a functon of f = {f 1...f m }. When f s known to the Tx, ths s also the largest achevable rate for a gven nput dstrbuton px) [1]. Ergodc channel model s sutable n scenaros wth sgnfcant channel dynamcs so that a sngle codeword spans many dfferent channel realzatons and an encoder can take advantage of t [1][6]. However, n many practcal scenaros, complete knowledge of channel dstrbuton f may be not avalable at the transmtter, due to e.g. naccuracy n estmatng f at the recever due to fnte sample sze or estmaton nose); lmted quantzed) feedback lnk quantzaton nose); outdated estmate, so that the true channel dstrbuton f dffers from ts estmate f 0 avalable at the transmtter. To model ths CDI uncertanty naccuracy), consder the scenaro where the transmtter has only partal CDI. Namely, t knows that the true f s wthn a certan dstance of the nomnal estmated) known f 0. We use the relatve entropy as a measure of the dstance between two dstrbutons, so that all feasble dstrbutons f satsfy the followng nequalty: f = {f 1...f m } : Df f 0 ) = f ln f f 0 d, 2) where f 0 = {f } s a nomnal known) dstrbuton and d 0 determnes the sze of the dstrbuton uncertanty set. Smlar approach has been adopted n [7] to characterze the mpact of channel dstrbuton uncertanty on the performance of non-ergodc quas-statc) fadng channels, where the man performance metrcs are outage probablty for a gven target rate) or outage capacty for a gven outage probablty). Whle the value of relatve entropy as a measure of dstance between two dstrbutons s well-known [12], t wll become clear from the present study that d s a crtcal parameter that characterzes the loss n performance due to the channel dstrbuton uncertanty as well. We wll not assume any partcular nose or channel dstrbuton except for examples) so that our results are general and apply to any such dstrbuton. III. WORST-CASE ERGODIC MUTUAL INFORMATION Under a gven px), the worst-case ergodc mutual nformaton for the CDI uncertanty set n 2) s gven by I w = mn Ix; y f) 3) Df f 0) d Its operatonal meanng wll be establshed n the next secton: when the nomnal dstrbuton f 0 and radus d are known at the transmtter, ths s the largest achevable rate under the worst-case fadng channel for a gven px) and s a functon of f 0 and d). The Theorem below gves ts characterzaton as a 1-D convex optmzaton problem. Theorem 1: For a gven nput dstrbuton px) and arbtrary nomnal fadng dstrbuton f 0, the worst-case ergodc mutual nformaton I w n 3) can be expressed as a scalar convex optmzaton problem: I w = max s ln s 0 ) f 0 e I/s + d and the maxmzng s can be found as a unque soluton of the followng equaton F s) = f 0 I s ei/s f ln f 0e I/s 0 e I/s = d 5) f d ln 1. The worst-case mnmzng) fadng dstrbuton s f 4) f = f 0e I/s f 0e I/s, 6) 780

3 so that I w = If d ln 1, s = 0 and f 0I e I/s f 0e I/s 7) f 1...f m 1 = 0, f m = 1, I w = I m 8).e. all the probablty mass s on the weakest channel and the worst-case ergodc MI equals to that of a weakest channel realzaton. If d = 0, then f = f 0 and the correspondng worst-case MI s that under the nomnal dstrbuton: I w = I 0 = f 0I, so that n general I m I w I 0 9) Proof: see Appendx. We now proceed to establsh a number of propertes of F s) n 5), whch reflect on correspondng solutons. Proposton 1: The functon F s) has the followng propertes: 1) F s) s ncreasng: F s) 0, wth strct nequalty unless s = or 0 or all I are the same. 2) Its lmtng values are F ) = 0, F 0 ) = ln 1, so that 3) 0 F s) ln 1 for s 0. Note that d = ln 1 s the threshold radus, beyond whch the worst-case ergodc capacty equals to the pontwse nstantaneous) worst-case capacty and the worst-case fadng dstrbuton puts all the mass on the weakest channel realzaton. A. Asymptotc regmes Let us now study the worst-case MI n 2 asymptotc regmes, where more nsghts can be obtaned. Proposton 2: Consder the small uncertanty regme d 0. The worst-case ergodc MI can be approxmated as follows: I w = I 0 2dσ I + o d) 10) where σi 2 = f 0I 2 I2 0 s the varance of the nstantaneous MI under the nomnal fadng dstrbuton. Proof: Based on the standard tools of asymptotc analyss [14]. Note that, n ths regme, the worst-case MI decreases proportonally to the standard devaton of the nstantaneous MI under the nomnal fadng dstrbuton), the proportonalty coeffcent beng 2d, and that ncreasng I results n smaller f.,.e. weaker channels get larger weghts. Large uncertanty regme: ths corresponds to d ln, whch s consdered n Theorem 1 n 8). Note that n ths regme further ncrease n d beyond ln ) does not result n any decrease n I w, as the lower bound n 9) s already acheved. If I m = 0 for any SNR.e. zero-gan channel realzaton) and d ln, then I w = 0 regardless of the SNR, so that the worst-case MI and thus the compound channel capacty, whch cannot exceed the worst-case MI under the optmal nput dstrbuton) cannot be ncreased by ncreasng the SNR n the large-uncertanty regme,.e. there s an error floor effect nduced by the channel dstrbuton uncertanty. More accurate channel estmaton.e. smaller d) s requred to ncrease the worst-case MI n ths case. B. Propertes of the worst-case channel dstrbuton and MI We study below the propertes of the worst-case MI. Snce the proofs follow mostly n a standard way from Theorem 1, they are omtted due to the page lmt. Proposton 3: The worst-case MI I w d) as a functon of radus d has the followng propertes: 1) I w d) s a convex functon of d, strctly so unless d ln 1. 2) I w d) s a decreasng functon of d, strctly so unless d ln 1, I w d 1 ) > I w d 2 ) d 1 < d 2 < ln 1. 11) 3) Its boundary values are as follows: I w 0) = I 0, I w d ln 1 ) = I m. 12) Proposton 4: The worst-case MI s an ncreasng functon of I, = 1...m, strctly so f d < ln. Proposton 5: Under the assumed nstantaneous MI orderng I 1 I 2.. I m, the normalzed worst-case fadng dstrbuton α = f /f 0 s ncreasng n : α 1 α 2.. α m. If I < I j and d < ln, then α > α j. Corollary 5.1: If the nomnal fadng dstrbuton s unform, f 01 = f 02 =.. =, the worst-case fadng dstrbuton s ncreasng n : f 1 f 2.. f m. If I < I j and d < ln, then f > f j. Corollary 5.2: If f 0 = 0, then f = 0. If d < ln, then f = 0 f and only f f 0 = 0. IV. OPTIMIZING OVER THE INPUT DISTRIBUTION The next step s to optmze the worst-case MI over the nput dstrbuton to obtan the compound channel capacty. The followng Theorem establshes the operatonal meanng of ths max-mn MI. Ths corresponds to exstence of a sngle code operatng over the whole class of fadng dstrbutons. Theorem 2: Consder an ergodc fadng channel, whose dstrbuton f s not known at the Tx, but s known to belong to a convex set S and assume that the set of all feasble nput dstrbutons px) s convex. Its compound channel capacty C c s the same as the worst-case channel capacty C w, = sup nf C c a) px) f S Ix; y f)b) = nf sup f S px) Ix; y f) = C w 13) Proof: The proof s done n 4 steps, as outlned below: 1) Assume frst that S s of fnte cardnalty. In ths case, a) follows from Han s compound channel capacty theorem see theorems and 5 n [8]) by consderng fadng dstrbuton f as a channel state. 2) When S s a convex polyhedron, a) follows from 1) and the fact that any code that works for fnte-cardnalty set {f } also works for ts convex envelope α f. 781

4 3) When S s an arbtrary convex set, evoke 2) and use a sequence of ncreasngly fner nner/outer polyhedral approxmatons as n e.g. [13]. 4) b) follows from Von Neumann mn-max Theorem [9][10]. Applyng ths theorem to the settng n the prevous secton, one obtans the followng. Theorem 3: Consder the compound ergodc fadng channel n 2) when the transmtter knows f 0 and d but not f, and the recever has full CSI. Assume that the set of feasble nput dstrbutons px) s convex and compact e.g. average or maxmum power constrant). The compound ergodc channel capacty n ths settng s gven by C = max px) mn Df f 0) d Ix; y f) = mn max Df f 0) d px) Ix; y f) = C w 14).e. the compound capacty equals to the worst-case channel capacty C w and the saddle-pont property holds for any feasble px) and f, Ix; y f ) C = Ix ; y f ) Ix ; y f) 15) where x denotes the nput under ts optmal dstrbuton p x) and p, f ) s a saddle pont. The nequaltes n 15) have a well-known game-theoretc nterpretaton: the Tx chooses p x) and the adversary nature) chooses f ; nether player can devate from ths optmal strategy wthout ncurrng a penalty. We are now n a poston to obtan the compound channel capacty n the asymptotc regmes. Proposton 6: Consder the large-uncertanty regme d ln. The compound channel capacty n ths regme s gven by C = max I m 16) px).e. desgnng a sngle code for the whole class of fadng channels s equvalent to desgnng a code for a weakest channel realzaton n ths regme. Proof: Follows from 14) and 8). Proposton 7: Consder the small-uncertanty regme as n Proposton 2. The compound channel capacty n ths regme s gven by C = max px) {I 0 2dσ I } + o d) 17) max px) I 0 18) where 2nd approxmaton holds when d 1 ) 2 I0. 19) 2 Proof: Follows from 10) and 14). In fact, 19) answers the queston how accurate s the perfect CDI? : when 19) holds, the CDI uncertanty s neglgble and thus the CDI can be consdered perfect. Note that optmzng desgnng a code for) the nomnal MI I 0 s σ I not optmal n general as t does not necessarly optmze σ I ), but s optmal when uncertanty s neglgble as n 19), so that one can recycle known optmal dstrbutons codes) n ths small-uncertanty regme. On the other hand, one can recycle known dstrbutons codes) for a weakest channel realzaton n the large uncertanty regme. Usng the general nequalty I m I w I 0, one obtans the general bounds on the compound ergodc capacty. Proposton 8: The compound ergodc capacty of a fntestate fadng channel can be bounded as follows max I m C max I 0 20) px) px) and the bounds are tght: the lower bound s attaned n the large uncertanty regme d ln, and the upper bound s attaned n the small-uncertanty regme d 1 2 I 0/σ I ) 2. We would lke to pont out that the above results are general enough to apply to arbtrary nomnal fadng dstrbuton and arbtrary nose not necessarly Gaussan). V. CONTINUOUS FADING DISTRIBUTIONS Here we consder a contnuous fadng dstrbuton. The results follow from the fnte-state case by usng ntegrals nstead of the sums and calculus of varatons to establsh optmalty). In partcular, the worst-case MI can be characterzed as n Theorem 1 wth ntegrals nstead of the sums and a number of ts propertes mmc those for the fnte-state channels. In the asymptotc regmes, one obtans the followng. Proposton 9: Consder the small uncertanty regme d 0. When all moments of Ih) are bounded, the worst-case ergodc MI can be approxmated as follows: I w = I 0 2dσ I + o d) 21) where σ 2 I = f 0 h)i 2 h)dh I 2 0 s the varance of the nstantaneous MI under the nomnal fadng dstrbuton. Large uncertanty regme: ths corresponds to d ln when there s a pont mass at h = h m so that I w = I m f d ln. When there s no such mass, I w I m as d, whch corresponds to 0. A. An example: Gaussan MIMO channel In ths secton, we consder an example of ergodc Gaussan MIMO fadng channel when the nomnal fadng dstrbuton s untary-nvarant. In the specal case of..d. Raylegh fadng, ts capacty has been establshed n [11] and the optmal sgnallng s sotropc Gaussan. Our example extends ths n two drectons: ) we consder a class of fadng channels thus allowng channel dstrbuton uncertanty, and ) we allow the nomnal dstrbuton to be any untary-nvarant one, of whch..d. Raylegh fadng s a specal case. The key result s that the optmal sgnalng s stll sotropc Gaussan, exactly as n [11]. The channel model s y = Hx + ξ 22) where x, y are the nput and output sgnals, ξ s AWG nose, ξ CN0, I), where I s the dentty matrx, and H s the 782

5 channel matrx. Under gven channel dstrbuton fh), ts ergodc capacty, under the total power constrant trr P T, s [11] Cf) = max fh) ln I + HRH + dh 23) trr P T where R = xx + s the covarance of x, ) + denotes Hermtan conjugaton and denotes determnant; we have also used the fact that Gaussan sgnalng s optmal snce the nose s Gaussan. When the channel dstrbuton s uncertan and belongs to the class n 2), the compound capacty becomes C = max mn trr P T Df f 0) d fh) ln I + HRH + dh 24) The followng Proposton characterzes t for a broad class of nomnal fadng dstrbutons. Proposton 10: Consder an ergodc-fadng AWGN MIMO channel as n 22) whose fadng dstrbuton belongs to the class n 2) and assume that the nomnal fadng dstrbuton f 0 H) s rght untary nvarant,.e. f 0 H) = f 0 HU) for any untary U. The compound channel capacty s { C = max s ln s 0 } I + γhh + s 1 f 0 H)dH + d 25) where m s the number of transmt antennas, γ = P T /m s the per-antenna SNR,.e. an optmal covarance R = γi, so that sotropc Gaussan sgnalng s optmal. Ths holds under the total as well as per-antenna power constrants: trr P T or r P T /m, where r s -th dagonal entry of R. Whle ths optmal sgnalng s the same as n the case of..d. Raylegh-fadng channel n [11], the present result extends [11] n three drectons: a class of fadng dstrbutons s consdered, rather than a sngle one, thus allowng fadng dstrbuton uncertanty typcal n wreless communcatons;..d. Raylegh fadng n [11] s extended to any rght-untary-nvarant dstrbuton, of whch any sphercallysymmetrc and thus..d. Ralegh fadngs are just specal cases; the same optmal sgnalng and capacty are shown to hold under the total as well as the per-antenna power constrants; snce the per-antenna power constrant r P T /m mples the total power constrant trr P T but not vce-versa, ths ndcates that nothng s ganed by allowng transmtters to trade-off the power under an ergodc, untary-nvarant fadng. Ths may have mportant applcatons n mult-user systems. VI. APPENDIX: PROOF OF THEOREM 1 The Lagrangan for the optmzaton problem n 3) s L = ) ) f I + λ f ln f d + µ f 1 f 0 26) and the correspondng KKT condtons are L = I + λ ln f ) µ = 0, 27) f f ) 0 λ f ln f d = 0, λ 0, f = 1. 28) f 0 It s straghtforward to see that the problem s convex snce the objectve Ix; y f) n 1) s lnear n f and the constrant n 2) s convex) and the Slater s condton holds for any d > 0), so that the KKT condtons are suffcent for optmalty [9]. Combnng 27) wth the constrant f = 1 one obtans, after some manpulatons, the mnmzng dstrbuton f = f 0e I/λ f, 29) I/λ 0e Usng ths n 26), one obtans, after some manpulatons, the Lagrange dual functon Lλ): ) Lλ) = λ ln f 0 e I/λ + d, λ 0 30) Snce the dualty gap s zero, the problem n 3) s equvalent to ts dual, I w = max Lλ) 31) λ 0 Changng the dual varable s = λ results n 4). To prove 5), let Qs) = s ln ) f 0 e I/s + d and observe that F s) = d Qs). Furthermore, 32) Qs) = F s) 0 33) Ths clearly demonstrates that Qs) s concave and, thus, the problem n 4) s convex strctly so, unless s = 0 or all I are the same, so that the soluton s unque), and that F s) s ncreasng unless s = or 0 ), so that the equaton n 5) has a unque soluton f d ln, whch corresponds to the maxmzer n 4) note that Qs) = 0 F s) = d) and can be easly found numercally usng any sutable algorthm e.g. bsecton or Newton decent method [9]). 5) can also be obtaned from complementary slackness n 28) when λ > 0. If d > ln, then Qs) = d F s) > 0 from Proposton 1) so that s = 0 and 8) follows. The same soluton apples when d = ln. REFERENCES [1] E. Bgler, J. Proaks, and S. Shama, Fadng Channels: Informaton- Theoretc and Communcatons Aspects, IEEE Trans. Inform. Theory, vol. 44, No. 6, pp , Oct [2] A. Lapdoth and P. Narayan, Relable Communcaton Under Channel Uncertanty, IEEE Trans. Inform. Theory, vol. 44, No. 6, Oct [3] L. Dobrushn, Optmal nformaton Transmsson through a channel wth unknown parameters, Radotekhnka Electronka, vol. 4, pp , [4] D. Blackwell, L. Breman, and A. J. Thomasan, The capacty of a class of channels, Ann. Math. Statst., vol. 30, pp , December

6 [5] W. L. Root, P. P. Varaya, Capacty of Classes of Gaussan Channels, SIAM J. Appl. Math., vol. 16, no. 6, pp , Nov [6] G. Care and K. Kumar, Informaton Theoretc Foundatons of Adaptve Coded Modulaton, Proceedngs of the IEEE, vol. 95, no. 12, pp , Dec [7] I. Ioannou, C.D. Charalambous, S. Loyka, Outage Probablty Under Channel Dstrbuton Uncertanty, IEEE Transactons on Informaton Theory, vol. 58, no. 11, pp , Nov [8] T. S. Han, Informaton-Spectrum Method n Informaton Theory, New York: Sprnger, [9] S. Boyd, L. Vandenberghe, Convex Optmzaton, Cambrdge Unversty Press, [10] K. Fan, Mnmax Theorems, Proceedngs of the Natonal Academy of Scence, vol.39, pp.42-47, [11] E. Telatar, Capacty of mult-antenna Gaussan channels, Eur. Trans. Telecomm. ETT, vol. 10, no. 6, pp , Nov [12] T.M. Cover, J.A. Thomas, Elements of Informaton Theory, Wley, New York, [13] R. Horst et al, Introducton to Global Optmzaton, Kluwer, Dordrecht, [14] M.A. Efgrafov, Asymptotc Expansons and Entre Functons, Moscow: GITTL,

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

MIMO Systems and Channel Capacity

MIMO Systems and Channel Capacity MIMO Systems and Channel Capacty Consder a MIMO system wth m Tx and n Rx antennas. x y = Hx ξ Tx H Rx The power constrant: the total Tx power s x = P t. Component-wse representaton of the system model,

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006)

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006) ECE 534: Elements of Informaton Theory Solutons to Mdterm Eam (Sprng 6) Problem [ pts.] A dscrete memoryless source has an alphabet of three letters,, =,, 3, wth probabltes.4,.4, and., respectvely. (a)

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Convex Optimization. Optimality conditions. (EE227BT: UC Berkeley) Lecture 9 (Optimality; Conic duality) 9/25/14. Laurent El Ghaoui.

Convex Optimization. Optimality conditions. (EE227BT: UC Berkeley) Lecture 9 (Optimality; Conic duality) 9/25/14. Laurent El Ghaoui. Convex Optmzaton (EE227BT: UC Berkeley) Lecture 9 (Optmalty; Conc dualty) 9/25/14 Laurent El Ghaou Organsatonal Mdterm: 10/7/14 (1.5 hours, n class, double-sded cheat sheet allowed) Project: Intal proposal

More information

On mutual information estimation for mixed-pair random variables

On mutual information estimation for mixed-pair random variables On mutual nformaton estmaton for mxed-par random varables November 3, 218 Aleksandr Beknazaryan, Xn Dang and Haln Sang 1 Department of Mathematcs, The Unversty of Msssspp, Unversty, MS 38677, USA. E-mal:

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

General viscosity iterative method for a sequence of quasi-nonexpansive mappings Avalable onlne at www.tjnsa.com J. Nonlnear Sc. Appl. 9 (2016), 5672 5682 Research Artcle General vscosty teratve method for a sequence of quas-nonexpansve mappngs Cuje Zhang, Ynan Wang College of Scence,

More information

Lecture 14: Bandits with Budget Constraints

Lecture 14: Bandits with Budget Constraints IEOR 8100-001: Learnng and Optmzaton for Sequental Decson Makng 03/07/16 Lecture 14: andts wth udget Constrants Instructor: Shpra Agrawal Scrbed by: Zhpeng Lu 1 Problem defnton In the regular Mult-armed

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Quantum and Classical Information Theory with Disentropy

Quantum and Classical Information Theory with Disentropy Quantum and Classcal Informaton Theory wth Dsentropy R V Ramos rubensramos@ufcbr Lab of Quantum Informaton Technology, Department of Telenformatc Engneerng Federal Unversty of Ceara - DETI/UFC, CP 6007

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent

More information

Lagrange Multipliers Kernel Trick

Lagrange Multipliers Kernel Trick Lagrange Multplers Kernel Trck Ncholas Ruozz Unversty of Texas at Dallas Based roughly on the sldes of Davd Sontag General Optmzaton A mathematcal detour, we ll come back to SVMs soon! subject to: f x

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium?

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium? APPLIED WELFARE ECONOMICS AND POLICY ANALYSIS Welfare Propertes of General Equlbrum What can be sad about optmalty propertes of resource allocaton mpled by general equlbrum? Any crteron used to compare

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

1 The Mistake Bound Model

1 The Mistake Bound Model 5-850: Advanced Algorthms CMU, Sprng 07 Lecture #: Onlne Learnng and Multplcatve Weghts February 7, 07 Lecturer: Anupam Gupta Scrbe: Bryan Lee,Albert Gu, Eugene Cho he Mstake Bound Model Suppose there

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

Minimax Optimal Control of Stochastic Uncertain Systems with Relative Entropy Constraints

Minimax Optimal Control of Stochastic Uncertain Systems with Relative Entropy Constraints [IEEE Trans. Aut. Control, 45, 398-412, 2000] Mnmax Optmal Control of Stochastc Uncertan Systems wth Relatve Entropy Constrants Ian R. Petersen Matthew R. James Paul Dupus Abstract Ths paper consders a

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

Cognitive Access Algorithms For Multiple Access Channels

Cognitive Access Algorithms For Multiple Access Channels 203 IEEE 4th Workshop on Sgnal Processng Advances n Wreless Communcatons SPAWC) Cogntve Access Algorthms For Multple Access Channels Ychuan Hu and Alejandro Rbero, Department of Electrcal and Systems Engneerng,

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

A note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights

A note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights ACTA ET COMMENTATIONES UNIVERSITATIS TARTUENSIS DE MATHEMATICA Volume 7, Number 2, December 203 Avalable onlne at http://acutm.math.ut.ee A note on almost sure behavor of randomly weghted sums of φ-mxng

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

Perfect Competition and the Nash Bargaining Solution

Perfect Competition and the Nash Bargaining Solution Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange

More information

Secret Communication using Artificial Noise

Secret Communication using Artificial Noise Secret Communcaton usng Artfcal Nose Roht Neg, Satashu Goel C Department, Carnege Mellon Unversty, PA 151, USA {neg,satashug}@ece.cmu.edu Abstract The problem of secret communcaton between two nodes over

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

SIO 224. m(r) =(ρ(r),k s (r),µ(r))

SIO 224. m(r) =(ρ(r),k s (r),µ(r)) SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Probability Theory (revisited)

Probability Theory (revisited) Probablty Theory (revsted) Summary Probablty v.s. plausblty Random varables Smulaton of Random Experments Challenge The alarm of a shop rang. Soon afterwards, a man was seen runnng n the street, persecuted

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Exercise Solutions to Real Analysis

Exercise Solutions to Real Analysis xercse Solutons to Real Analyss Note: References refer to H. L. Royden, Real Analyss xersze 1. Gven any set A any ɛ > 0, there s an open set O such that A O m O m A + ɛ. Soluton 1. If m A =, then there

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

On Spatial Capacity of Wireless Ad Hoc Networks with Threshold Based Scheduling

On Spatial Capacity of Wireless Ad Hoc Networks with Threshold Based Scheduling On Spatal Capacty of Wreless Ad Hoc Networks wth Threshold Based Schedulng Yue Lng Che, Ru Zhang, Y Gong, and Lngje Duan Abstract arxv:49.2592v [cs.it] 9 Sep 24 Ths paper studes spatal capacty n a stochastc

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models

More information

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control A ower Bound on SIR Threshold for Call Admsson Control n Multple-Class CDMA Systems w Imperfect ower-control Mohamed H. Ahmed Faculty of Engneerng and Appled Scence Memoral Unversty of ewfoundland St.

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Answers Problem Set 2 Chem 314A Williamsen Spring 2000

Answers Problem Set 2 Chem 314A Williamsen Spring 2000 Answers Problem Set Chem 314A Wllamsen Sprng 000 1) Gve me the followng crtcal values from the statstcal tables. a) z-statstc,-sded test, 99.7% confdence lmt ±3 b) t-statstc (Case I), 1-sded test, 95%

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata TC XVII IMEKO World Congress Metrology n the 3rd Mllennum June 7, 3,

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

find (x): given element x, return the canonical element of the set containing x;

find (x): given element x, return the canonical element of the set containing x; COS 43 Sprng, 009 Dsjont Set Unon Problem: Mantan a collecton of dsjont sets. Two operatons: fnd the set contanng a gven element; unte two sets nto one (destructvely). Approach: Canoncal element method:

More information

Statistics Chapter 4

Statistics Chapter 4 Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation Two-Way and Multple-Access Energy Harvestng Systems wth Energy Cooperaton Berk Gurakan, Omur Ozel, Jng Yang 2, and Sennur Ulukus Department of Electrcal and Computer Engneerng, Unversty of Maryland, College

More information

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com

More information

Pricing and Resource Allocation Game Theoretic Models

Pricing and Resource Allocation Game Theoretic Models Prcng and Resource Allocaton Game Theoretc Models Zhy Huang Changbn Lu Q Zhang Computer and Informaton Scence December 8, 2009 Z. Huang, C. Lu, and Q. Zhang (CIS) Game Theoretc Models December 8, 2009

More information

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Perron Vectors of an Irreducible Nonnegative Interval Matrix Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

p(z) = 1 a e z/a 1(z 0) yi a i x (1/a) exp y i a i x a i=1 n i=1 (y i a i x) inf 1 (y Ax) inf Ax y (1 ν) y if A (1 ν) = 0 otherwise

p(z) = 1 a e z/a 1(z 0) yi a i x (1/a) exp y i a i x a i=1 n i=1 (y i a i x) inf 1 (y Ax) inf Ax y (1 ν) y if A (1 ν) = 0 otherwise Dustn Lennon Math 582 Convex Optmzaton Problems from Boy, Chapter 7 Problem 7.1 Solve the MLE problem when the nose s exponentally strbute wth ensty p(z = 1 a e z/a 1(z 0 The MLE s gven by the followng:

More information