LINK ADAPTATION FOR INTERFERENCE ALIGNMENT WITH IMPERFECT CSIT

Size: px
Start display at page:

Download "LINK ADAPTATION FOR INTERFERENCE ALIGNMENT WITH IMPERFECT CSIT"

Transcription

1 2014 IEEE Internatonal Conference on Acoustc, Speech and Sgnal Processng (ICASSP) LINK ADAPTATION FOR INTERFERENCE ALIGNMENT WITH IMPERFECT CSIT Mohsen Rezaee, Mehrdad Tak, Maxme Gullaud Insttute of Telecommuncatons, Venna Unversty of Technology, Venna, Austra e-mal: Electrcal Engneerng Department, Unversty of Isfahan, Isfahan, Iran e-mal: ABSTRACT In ths paper lnk adaptaton for nterference algnment (IA) based on mperfect channel state nformaton (CSI) s nvestgated. We consder a MIMO nterference channel where the transmt and receve spaces are determned by IA. We look at mzng a weghted sum of the average rates provded that a certan set of bt-error-rate and power constrants are satsfed by dynamcally adjustng codng, modulaton and powers. The problem s qute general and ntractable. We resort to some approxmatons and provde smulatons to show the accuracy of the approxmatons n the regmes wth practcal nterest. 1. INTRODUCTION Interference algnment (IA) has receved a lot of attenton due to ts promsng performance mprovement over orthogonal schemes. It has been shown that as long as a set of feasblty condtons are satsfed, IA can acheve the mum achevable DoF n a K-user constant MIMO IC [1]. A few papers have nvestgated the effect of mperfect channel state nformaton at the transmtter (CSIT) on the performance of IA [2 6]. However, an mproved IA-based scheme that accounts for the mperfect CSIT s stll mssng. Even though methods have been proposed to reduce the CSIT requrement [7], we need to contan the effect of the resdual nterference caused by mperfect CSIT and look for methods that can deal wth ths resdual nterference properly. Lnk adaptaton methods can be very helpful to deal wth resdual nterference and explotng the drect channels. Lnk adaptaton mproves the performance of a wreless lnk by adjustment of the rate and/or power at the TX based on the estmated CSI fed back from the RX [8]. Extensve research has been done on lnk adaptaton for pont-to-pont lnks. Dscrete rate lnk adaptaton for practcal systems s ntroduced n [8] by usng adaptve modulaton (AM) and s extended to adaptve modulaton and codng (AMC) n [9]. In ths paper we consder a MIMO IC where the transmt and receve spaces are determned by IA. Consderng practcal modulaton schemes, we use adaptve modulaton, codng and power (AMCP) to mze a weghted sum of the average rates whle havng a sumpower constrant across the users and ensurng that the bt-error-rate (BER) for decodng every stream n the network remans below a certan threshold. Smulaton results are provded to compare the proposed scheme wth the orthogonal transmsson scheme. 1 Ths work was supported by the FP7 projects HIATUS (grant ) and Newcom# Network of Excellence n Wreless Communcatons and by the Austran Scence Fund (FWF) through grant NFN SISE (S106). 1 Notaton: Nonbold letters represent scalar quanttes (talcs denote ran- 2. SYSTEM MODEL Consder an nterference channel n whch K TXs communcate wth ther respectve RXs over a shared medum. For smplcty we assume that every TX s equpped wth N t antennas whle every RX has N r antennas. Data symbols are spatally precoded at the TXs. Let d denote the number of data streams sent by each TX. Our results can be extended to more general confguratons as long as the feasblty condtons for IA [1] are satsfed. The receved sgnal at RX reads y = H V x + H jv jx j + n (1) j n whch H j C Nr N t s the channel matrx between TX j and RX, V j C Nt d and x j C d are the precodng matrx and the data vector of TX j, respectvely. Furthermore, n CN (0, σ 2 I Nr ) s the addtve nose at RX. Assumng E{x x H } = dag( P (1),..., P (d)), = 1,..., K, the covarance matrx of the sgnal transmtted by user s gven by Q = V dag( P (1),..., P (d))v H. We assume that all V are truncated untary matrces, therefore the transmt power for user s tr (Q ) = d P l=1 (l) = P. 3. INTERFERENCE ALIGNMENT WITH IMPERFECT CSIT Assumng that perfect global CSI s avalable at every TX, the precoders V, = 1... K should be desgned to algn the nterference at each RX nto a N r d dmensonal space, n order to acheve d nterference-free dmensons per user. A soluton to the IA problem exsts (see [1] and more recently [10, 11] for feasblty crtera here we wll assume that the dmensons and the consdered channel realzatons are such that the problem s feasble) ff there exst full rank precodng matrces V j, j = 1,..., K and projecton matrces U C Nr d, = 1,..., K such that U H H jv j = 0, j {1,..., K}, j, ) rank (U H H V = d. dom varables), boldface lowercase and uppercase letters ndcate vectors and matrces, respectvely. The trace, conjugate, transpose, Hermtan transpose of a matrx or vector are denoted by tr( ), ( ), ( ) T, ( ) H respectvely. The expectaton operator s represented by E{ }. A dagonal matrx s represented by dag( ). Absolute value of a scalar s denoted by. The mth element of a vector a and the (m, n)th element of a matrx A are denoted by a(m) and A(m, n) respectvely. The complex crcularly symmetrc Gaussan dstrbuton wth mean r and varance σ 2 s denoted by CN (r, σ 2 ). Fnally var(.) shows the varance of ts argument random varable. (2) /14/$ IEEE 6208

2 We focus on the frst condton n (2) snce the second condton s satsfed almost surely when the channel entres are drawn ndependently from a contnuous dstrbuton. It s clear that any truncated untary matrx that has the same column space as V also fulflls (2) and the same argument holds for the RX flters. Ths means that we can assume wthout loss of generalty that the equvalent drect channels,.e., U H H V for = 1,..., K are dagonal. When the CSIT s not perfect at the TXs, the IA flters desgned based on mperfect CSIT are denoted by truncated untary matrces ˆV and Û where Û H Ĥ j ˆVj = 0, j {1,..., K}, j, (3) where the estmated channels are denoted by Ĥj. Smlar to the perfect CSI scenaro, we assume that the flters are such that the drect equvalent channels whch we denote by Ĝ ÛH Ĥ ˆV for = 1,..., K, are dagonal. Usng the desgned precoders, the receved sgnal after projecton by the receve flters can be wrtten as r = ÛH y = G x + G jx j + ÛH n (4) j where G = ÛH H ˆV and G j = ÛH H j ˆVj. Clearly the second term s due to the nterference leakage from other users whch s caused by desgnng the flters based on mperfect CSI. Also the equvalent channel G for each user s not dagonal anymore whch ntroduces nter-stream nterference. To smplfy the notaton, we denote the qth dagonal elements of G and Ĝ by Gq and Ĝq respectvely, for q = 1,..., d. 4. STATISTICAL MODEL OF THE CSIT We assume that the entres of the true channels H j and the channel estmates avalable at the TX sde Ĥj are modeled as complex Gaussan random varables wth zero mean and varance j. We assume the followng CSI mperfecton model, H j = ρ 0 Ĥ j + 1 ρ 2 0Ej (5) where we have assumed that the entres of the perturbaton matrx E j have the same dstrbuton as the true channel and they are ndependent from the entres of Ĥj. Wth ths model the parameter ρ 0 represents the correlaton between the true channel elements and the estmated ones. Denotng the real and magnary parts of H j by X j and Y j respectvely and that of Ĥj by ˆX j and Ŷj respectvely, due to the crcular symmetry, the entres of the real matrces are ndependent from the magnary matrces. Further, we have E{H j(m, n) Ĥj(m, n)} = ρ0ĥj(m, n) E{ H j(m, n) 2 Ĥj(m, n)} = (1 ρ0)2 j + ρ 2 0 Ĥj(m, n) IA WITH AMCP USING IMPERFECT CSIT In the context of lnk adaptaton, transmsson rate and power of the TX s adjusted dependng on the nstantaneous channel condton. There are two dfferent approaches for lnk adaptaton n the lterature namely, contnuous and dscrete lnk adaptaton. In the frst case, capacty achevng codes wth vanshng error probablty are employed and t s assumed that the rate can be adjusted contnuously accordng to the channel condton. In ths case f we denote the equvalent channel gan, the average power of nose (and nterference) and the transmsson power by h eq, δ eq and p respectvely, then the spectral effcency of the lnk s equal to log 2 (1 + ps eq) (bt/sec/hz) (6) where s eq = heq 2 δ eq s the equvalent SINR of the lnk. In the context of dscrete lnk adaptaton, adaptve codng s used along wth adaptve modulaton whch mproves the performance sgnfcantly. In ths method, M + 1 transmsson modes are consdered where every mode m corresponds to a par of modulaton and codng confguraton and fnally provdes a transmsson rate denoted by R m. The rates for dfferent modes are sorted as 0 = R 0 < R 1 <... < R M. Mode 0 represents the case where no nformaton s transmtted. In mode m the BER s approxmated by the followng expresson [12]: p e(ps eq, R m) = A mexp( A mps eq), m = 0,..., M, s eq 0 (7) where A m and A m are constants that are determned by the transmsson mode. Ths model s based on approxmatng the BER curve whch s realzed usng Monte Carlo smulaton over a large range of SNR. The process s repeated for every mode m whch yelds the parameters A m and A m va curve fttng. In transmsson mode m, the mnmum requred SINR to ensure a mum BER of B 0 s denoted by g B0 (m),.e., where g B0 (m) 1 A m ps eq g B0 (m) p e(ps eq, m) B 0 (8) ln( B 0 A m ) for B 0 mn (1/2, A m). If the CSI s not perfect, drect use of mperfect CSI nstead of the true CSI n IA and AMCP wll be hghly sub-optmal. Based on our assumptons, snce the avalable CSI at each TX s a degraded verson of the true CSI, therefore the IA and lnk adaptaton methods should be revsted takng the effect of the resdual nterference nto account. Here we present a new scheme where AMCP s performed usng mperfect CSIT to mprove IA performance Problem Formulaton Accordng to Secton 2, every TX has d data streams. For stream q of user, we denote the average power of nterference and nose whch affects ths stream by δ q. Furthermore, the nstantaneous true SINR and the estmate of the nstantaneous SINR (whch s avalable at the transmtters) are denoted respectvely by γ q = Gq 2 δ q and ˆγ q = Ĝq 2 δ q. The nstantaneous rate and power for stream q of user are denoted by k q = Φ(ˆγ q ) and pq = Ψ(ˆγ q ) respectvely, for 1 K and 1 q d. Based on the avalable CSIT at the TXs (Ĥj,, j), the TXs choose the precoders ˆV j accordng to (3), whle the rate and power are determned by the mappngs Φ( ) and Ψ( ) whch should be desgned such that the average sum-power s at most P 0 and the BER at each RX s less or equal to B 0, whle a weghted sum of the average rates s mzed. The weghts for dfferent users are denoted by ω, = 1,..., K. Wth these defntons, the 6209

3 overall optmzaton problem can be formulated as follows K d ω Φ( ),Ψ( ) =1 q=1 K =1 q=1 Eˆγ q {Φ(ˆγq )} d q Eˆγ {Ψ(ˆγq )} P0 q Eˆγ,γq{pe(Ψ(ˆγq )γq, Φ(ˆγq ))} B0,, q. Solvng the exact optmzaton problem n (9) s ntractable especally snce the optmzaton s performed usng mperfect nformaton about the channels. We dvde the optmzaton problem n (9) nto the followng three steps Effect of Imperfect CSI on IA Here we nvestgate the propertes of the resdual nterference affectng the decodng of every stream when the precoders are desgned usng IA. For smplcty we defne ˆv,q and û,q as the qth column of ˆV and Û respectvely. Therefore from (4) we have r (q) = G q x(q) + I,q + I,q + n q where G q = û H,qH ˆv,q s the qth dagonal element of G, I,q = 1 l d û H,qH ˆv,l x (l) l q s the nterference from other streams of the same user, I,q = j û H,qH j ˆVjx j (9) s the nterference from other users and n q = û H,qn s the equvalent nose for ths stream. If the channels are perfectly known (Ĥj = Hj,, j), then the terms I,q and I,q wll be zero due to the algnment equatons. In the followng, we derve the statstcal propertes of G q (gven the nformaton about Ĝ q ) whch can be used to derve the statstcs of the true SINR. Then we derve the power of each nterference term dependng on the level of mperfectness of the channels controlled by ρ Statstcs of the drect channel power gan It can be shown that G q 2 and Ĝq 2 are approxmately dstrbuted as exponental random varables (ths holds exactly n the snglestream case) [13]. Henceforth we work under the assumpton that G q 2 and Ĝq 2 are exponentally dstrbuted wth parameter 1. Note that the value of Ĝq s the estmaton of the drect channel gan at the transmtter and ths value s used to have an nstantaneous estmate of the SINR Calculatng the power of nterference plus nose In ths part we calculate the power of nterference plus nose for every stream at each RX. Clearly, assumng Û, ˆV, Ĥj, j are gven, I,q s a sum of d 1 random varables and I,q s a sum of K 1 random varables. It can be shown that every two dstnct elements of I,q, I,q and n q are ndependent. Ths gves δ q = E{ I,q 2 } + E{ I,q 2 } + E{ n q 2 }. (10) It can be shown that the power of the nterference terms s E{ I,q 2 } = (1 ρ 2 0) P (l), E{ I,q 2 } = (1 ρ 2 0) j 1 l d l q j 1 l d (11) P (l). (12) Also t s clear that the nose varance wll not change after projecton by the (truncated untary) receve flters Statstcs of γ q condtoned on ˆγ q In the consdered lnk adaptaton method, transmsson rate and power are desgned based on the SINR of the lnk. Snce only ˆγ q s avalable at the TX, n order to do lnk adaptaton, we need to fnd the relatonshp between γ q and ˆγ q or, more precsely, the statstcs of γ q gven ˆγ q should be determned. We know that G q 2 and Ĝq 2 and hence γ q and ˆγ q have exponental dstrbuton approxmately. The pdf of two correlated exponental random varables reads { } f q (x1 x2) = 1 ρ x 2 γ ˆγq Γ q exp (13) (1 ρ) 1 ρ ˆΓ q { } { } 2 ρ x2 x1 I 0 1 ρ Γ qˆγ x1 exp q Γ q (1 ρ) where Γ q E{γ q } and ˆΓ q E{ˆγ q }, therefore Γq = ˆΓ q =. Also t can be shown that the correlaton σ 2 +E{ I,q 2 }+E{ I,q 2 } coeffcent s equal to ρ = ρ 2 0 [13] Pont-to-Pont Lnk wth Imperfect CSIT Pont-to-Pont Lnk wth average power and BER constrants Denotng the true SINR and the estmated SINR by γ and ˆγ respectvely and Γ and ˆΓ ther respectve expectatons, the condtonal dstrbuton f γ ˆγ s accordng to (13). The goal s to desgn the transmsson scheme usng adaptve power and rate p = Ψ(ˆγ) and k = Φ(ˆγ) whch are functons of the estmated SINR. The desgn parameters are the functons Ψ( ) and Φ( ) such that the average rate s mzed whle the average power and average BER constrants are satsfed as formulated n the followng optmzaton problem E{Φ(ˆγ)} Φ( ),Ψ( ) E{Ψ(ˆγ)} P (C 1) E γ,ˆγ {p e(ψ(ˆγ)γ, Φ(ˆγ))} B 0. (C 2) (14) Condton (C 2) s complcated and nstead we enforce the same condton for any nstance of ˆγ,.e., E γ{p e(pγ, k) ˆγ} B 0. By satsfyng ths condton, (C 2) s always satsfed. Lemma 1 Defnng A 0 = (A 1,, A M), to satsfy the BER condton (C 2) t s suffcent to have g B 0 (m) Q 1 ˆγ+Q 2 Ψ(ˆγ), where Q 1 = ρ 2 0 ΓˆΓ and Q 2 = (1 ρ 2 0)Γln( B 0 A 0 ). Proof: See [13]. Consderng the lmtaton on the transmt power (condton C 1), Lemma 1 gves Ψ(ˆγ) = g B 0 (m) Q 1 ˆγ+Q 2. Clearly when ρ 0 1 (more accurate channels), we get (8) whch was derved for perfect channels. Smlar to [9], where lnk adaptaton s performed usng perfect SINR estmates, we dvde the range of ˆγ usng thresholds t m, 0 m M such that when ˆγ [t m, t m+1) then the transmsson rate s chosen to be R m. Therefore the optmzaton problem (14) can be reformulated as {t m} M m=0 m=0 M tm+1 R m fˆγ (ˆγ)dˆγ M g B0 () =0 t m t+1 t fˆγ(ˆγ) Q 1ˆγ + Q 2 dˆγ P. (15) 6210

4 Note that we have mplctly ncluded the BER constrant. Usng the Lagrangan method we can show that the optmal thresholds are gven by t m = λ (gb0 (m) g B0 (m 1)) R m R m 1 Q 2, 0 m M (16) Q 1 The Lagrangan multpler λ s computed such that the power constrant s satsfed wth equalty Approxmaton of the average rate n a pont-to-pont lnk Inspred by the Gaussan channel, we approxmate the average rate achevable n the lnk by E{k} = L 1 log(1 + L 2ΓP ) where L 1 and L 2 are functons of the transmsson modes m, mum error probablty B 0 and the CSI uncertanty parameter ρ 0. We have used a curve-fttng method to fnd the values for L 1 and L 2. We verfed the accuracy of ths approxmaton compared to the actual average rate va extensve smulatons (see [13]) Optmzaton of the approxmate average rates Usng the approxmated closed-form expresson for the average rate we equvalently look at the followng problem P (q), 1 K, 1 q d K =1 q=1 K =1 ω d K (q) q=1 (17) d P (q) P 0 where K (q) = L 1 log(1 + L 2Γ q P (q)) E{k q }. Note that Γq s also a functon of the average powers. The above problem s a non-convex constraned optmzaton problem. We resort to numercal optmzaton methods to fnd a (locally) optmum soluton. The optmzaton problem s solved usng the actve-set method [14]. We used the standard MATLAB mplementaton. Therefore, we fnd the average powers to be assgned to dfferent streams of dfferent users. After fndng the average powers, the nstantaneous rates and powers can be chosen ndependently for each stream smlar to the pont-topont scenaro dscussed n the prevous subsecton. 6. ORTHOGONAL TRANSMISSION IN THE K-USER MIMO IC USING AMCP Due to the mperfectness of the CSI and sub-optmalty of IA, t s natural to ask whether we are better off performng IA rather than smply usng an orthogonal resource-sharng transmsson scheme. In orthogonal transmsson we assume that the channel resources (tme/bandwdth) are dvded equally among dfferent users n the network. In order to have a far comparson wth the proposed scheme, we consder a smlar problem where we look for mzng a weghted sum of the average rates of the users whle havng a total transmsson power constrant P 0 and a mum average BER of B 0. Here we have K pont-to-pont MIMO lnks where for each lnk d = mn(n t, N r) parallel streams are transmtted. Therefore we wll have a smlar optmzaton problem except that the flters are not determned by IA equatons but they are chosen such that the drect channels are dagonalzed. It should be noted that n ths case every RX only has to consder nter-stream nterference when computng the SINR dstrbuton. Smlar to the case of nterferng transmsson we can fnd the statstcs of the SINR and proceed wth solvng the problem. Sum of spectral effcences (bt/sec/hz) IA, α=3 Orthogonal, α=3 IA, α=5 Orthogonal, α=5 IA, α=7 Orthogonal, α= Doppler frequency Fg. 1. Rate comparson for dfferent values of Doppler and dstance, K = 5, N t = N r = 3 7. SIMULATION RESULTS To evaluate the performance of the proposed scheme, we use the AMC modes defned n the IEEE a standard. In ths settng there are 8 dfferent modes each of whch s assocated to a partcular modulaton and codng par. These modes provde the set of rates {0,.5,.75, 1, 1.5, 2, 3, 4}. The parameters of the BER estmaton accordng to (7) are extracted from [12]. We assume that the TXs and the RXs are placed such that the dstance between TX j and RX equals α 2 + ( j) 2 β 2 and the varance of the channel entres equals E{ H j 2 Ψ } = j = 0 where Ψ (α 2 +( j) 2 β 2 ) 0, α 1.5 and β are constants. α s the dstance between a par of TX and RX. We assume that the TXs and the RXs are equpped wth the same number of antennas and that the weghts for dfferent users are equal (ω j = 1, j). Also we set β = 1 and a total power constrant of P 0 = 1 s consdered and the nose varance s 0.1. Even though the uncertanty model ntroduced prevously s qute general, we assume n ths secton that the mperfecton s ntroduced by feedback latency and Doppler effects. The mum Doppler frequency s denoted by f d and the delay between the current transmsson and channel estmaton at the RX s denoted by T d. Accordng to the Jakes model [15], the coeffcent ρ 0 s derved from ρ 0 = J 0(2πf d T d ) where J 0( ) s the Bessel functon of the frst knd of order 0. Further, we assume that α s related to T d as T d = 10 4 α n our settng. In Fgure 1, assumng K = 3, N t = N r = 4 and d = 2, the sum rate s plotted for dfferent values of Doppler f d and for dfferent values of dstance α. Clearly, by ncreasng the Doppler and dstance, the CSI becomes more outdated and t degrades the overall performance. It s evdent that the proposed scheme outperforms the orthogonal scheme. 8. CONCLUSION Interference algnment based on mperfect CSI was nvestgated. We consdered a MIMO nterference channel where the transmt and receve spaces are determne by IA. We looked at mzng a weghted sum of the average rates provded that a certan set of bterror-rate and power constrants are satsfed by choosng approprate modulaton codng and powers. 6211

5 9. REFERENCES [1] C. M. Yets, T. Gou, S. A. Jafar, and A. H. Kayran, On feasblty of nterference algnment n MIMO nterference networks, IEEE Trans. Sgnal Processng, vol. 58, no. 9, pp , Sep [2] R. Tresch and M. Gullaud, Cellular nterference algnment wth mperfect channel knowledge, n Proc. IEEE Internatonal Conference on Communcatons (ICC), Dresden, Germany, Jun [3] O. El Ayach and R. W. Heath, Interference algnment wth analog channel state feedback, IEEE Trans. Wreless Commun., vol. 11, no. 2, pp , Feb [4] S. H. Park, H. Park, Y. D. Km, and I. Lee, Regularzed nterference algnment based on weghted sum-mse crteron for MIMO nterference channels, n Proc. IEEE Int. Conf. Commun., Cape Town, South Afrca, May [5] B. Nosrat-Makoue, J. Andrews, and R. Heath, A smple SINR characterzaton for lnear nterference algnment over uncertan MIMO channels, n Proc. IEEE Int. Symp. Inf. Theory (ISIT), Austn, TX, June [6] H. M. B. Xe, Y. L and A. Nosratna, Adaptve nterference algnment wth CSI uncertanty, IEEE Trans. Comm., vol. 61, no. 2, pp , Feb [7] M. Rezaee and M. Gullaud, Lmted feedback for nterference algnment n the K-user MIMO nterference channel, n Proc. IEEE Inf. Theory. Workshop (ITW), Lausanne, Swtzerland, [8] S. T. Chung and A. J. Goldsmth, Degrees of freedom n adaptve modulaton: a unfed vew, IEEE Trans. Commun., vol. 49, no. 9, pp , Sep [9] K. J. Hole, H. Holm, and G. E. Oen, Adaptve multdmensonal coded modulaton over flat fadng channels, IEEE J. Select. Areas Commun., vol. 18, [10] M. Razavyayn, G. Lyubeznk, and Z.-Q. Luo, On the degrees of freedom achevable through nterference algnment n a MIMO nterference channel, IEEE Trans. Sgnal Processng, vol. 60, no. 2, [11] G. Bresler, D. Cartwrght, and D. Tse, Settlng the feasblty of nterference algnment for the MIMO nterference channel: the symmetrc square case, Apr. 2011, preprnt, [12] J. S. Harsn and F. Lahout, QoS constraned throughput optmzaton for jont adaptve transmsson wth ARQ over blockfadng channels, IET Communcatons, vol. 3, no. 6, pp , Jun [13] M. Tak, M. Rezaee, and M. Gullaud, Adaptve modulaton and codng for nterference algnment wth mperfect CSIT, Submtted to Trans. Wreless Comm, [14] J. Nocedal and S. J. Wrght, Numercal optmzaton. Sprnger Verlag, Berln, New York, 2nd edton, [15] W. C. Jakes, Mcrowave Moble Communcaton. NY: Wley,

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor Prncpal Component Transform Multvarate Random Sgnals A real tme sgnal x(t can be consdered as a random process and ts samples x m (m =0; ;N, 1 a random vector: The mean vector of X s X =[x0; ;x N,1] T

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

An Upper Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control

An Upper Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control An Upper Bound on SINR Threshold for Call Admsson Control n Multple-Class CDMA Systems wth Imperfect ower-control Mahmoud El-Sayes MacDonald, Dettwler and Assocates td. (MDA) Toronto, Canada melsayes@hotmal.com

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

8 : Learning in Fully Observed Markov Networks. 1 Why We Need to Learn Undirected Graphical Models. 2 Structural Learning for Completely Observed MRF

8 : Learning in Fully Observed Markov Networks. 1 Why We Need to Learn Undirected Graphical Models. 2 Structural Learning for Completely Observed MRF 10-708: Probablstc Graphcal Models 10-708, Sprng 2014 8 : Learnng n Fully Observed Markov Networks Lecturer: Erc P. Xng Scrbes: Meng Song, L Zhou 1 Why We Need to Learn Undrected Graphcal Models In the

More information

Distributed Non-Autonomous Power Control through Distributed Convex Optimization

Distributed Non-Autonomous Power Control through Distributed Convex Optimization Dstrbuted Non-Autonomous Power Control through Dstrbuted Convex Optmzaton S. Sundhar Ram and V. V. Veeravall ECE Department and Coordnated Scence Lab Unversty of Illnos at Urbana-Champagn Emal: {ssrnv5,vvv}@llnos.edu

More information

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding tle Lnear dsperson code wth an orthogonal row structure for smplfyng sphere decodng Author(s) Da XG; Cheung SW; Yuk I Ctaton he 0th IEEE Internatonal Symposum On Personal Indoor and Moble Rado Communcatons

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

Lecture 3: Probability Distributions

Lecture 3: Probability Distributions Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Digital Modems. Lecture 2

Digital Modems. Lecture 2 Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

Cognitive Access Algorithms For Multiple Access Channels

Cognitive Access Algorithms For Multiple Access Channels 203 IEEE 4th Workshop on Sgnal Processng Advances n Wreless Communcatons SPAWC) Cogntve Access Algorthms For Multple Access Channels Ychuan Hu and Alejandro Rbero, Department of Electrcal and Systems Engneerng,

More information

Statistical pattern recognition

Statistical pattern recognition Statstcal pattern recognton Bayes theorem Problem: decdng f a patent has a partcular condton based on a partcular test However, the test s mperfect Someone wth the condton may go undetected (false negatve

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

An Analytical Model for Interference Alignment in Multi-hop MIMO Networks

An Analytical Model for Interference Alignment in Multi-hop MIMO Networks 1 An Analytcal Model for Interference Algnment n Mult-hop MIMO Networks Huacheng Zeng, Student Member, IEEE, Y Sh, Senor Member, IEEE, Y. Thomas Hou, Fellow, IEEE, Wenng Lou, Fellow, IEEE, Sastry Kompella,

More information

STAT 3008 Applied Regression Analysis

STAT 3008 Applied Regression Analysis STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1 P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the

More information

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control A ower Bound on SIR Threshold for Call Admsson Control n Multple-Class CDMA Systems w Imperfect ower-control Mohamed H. Ahmed Faculty of Engneerng and Appled Scence Memoral Unversty of ewfoundland St.

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Radar Trackers. Study Guide. All chapters, problems, examples and page numbers refer to Applied Optimal Estimation, A. Gelb, Ed.

Radar Trackers. Study Guide. All chapters, problems, examples and page numbers refer to Applied Optimal Estimation, A. Gelb, Ed. Radar rackers Study Gude All chapters, problems, examples and page numbers refer to Appled Optmal Estmaton, A. Gelb, Ed. Chapter Example.0- Problem Statement wo sensors Each has a sngle nose measurement

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation Two-Way and Multple-Access Energy Harvestng Systems wth Energy Cooperaton Berk Gurakan, Omur Ozel, Jng Yang 2, and Sennur Ulukus Department of Electrcal and Computer Engneerng, Unversty of Maryland, College

More information

Hidden Markov Models

Hidden Markov Models Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Lecture 2: Prelude to the big shrink

Lecture 2: Prelude to the big shrink Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson

More information

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities Supplementary materal: Margn based PU Learnng We gve the complete proofs of Theorem and n Secton We frst ntroduce the well-known concentraton nequalty, so the covarance estmator can be bounded Then we

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Laboratory 1c: Method of Least Squares

Laboratory 1c: Method of Least Squares Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly

More information

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

A Comparative Study for Estimation Parameters in Panel Data Model

A Comparative Study for Estimation Parameters in Panel Data Model A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Feb 14: Spatial analysis of data fields

Feb 14: Spatial analysis of data fields Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s

More information

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006)

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006) ECE 534: Elements of Informaton Theory Solutons to Mdterm Eam (Sprng 6) Problem [ pts.] A dscrete memoryless source has an alphabet of three letters,, =,, 3, wth probabltes.4,.4, and., respectvely. (a)

More information

Laboratory 3: Method of Least Squares

Laboratory 3: Method of Least Squares Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

Distributed Transmit Diversity in Relay Networks

Distributed Transmit Diversity in Relay Networks Dstrbuted Transmt Dversty n Relay etworks Cemal Akçaba, Patrck Kuppnger and Helmut Bölcske Communcaton Technology Laboratory ETH Zurch, Swtzerland Emal: {cakcaba patrcku boelcske}@nareeethzch Abstract

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Explicit and Implicit Temperature Constraints in Energy Harvesting Communications

Explicit and Implicit Temperature Constraints in Energy Harvesting Communications Explct and Implct Temperature Constrants n Energy Harvestng Communcatons Abdulrahman Baknna, Omur Ozel 2, and Sennur Ulukus Department of Electrcal and Computer Engneerng, Unversty of Maryland, College

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information