Antenna Combining for the MIMO Downlink Channel

Size: px
Start display at page:

Download "Antenna Combining for the MIMO Downlink Channel"

Transcription

1 Antenna Combnng for the IO Downlnk Channel arxv: v [cs.it] 0 Apr 2007 Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of nnesota nneapols, N 55455, USA Emal: nhar@umn.edu Abstract A multple antenna downlnk channel where lmted channel feedback s avalable to the transmtter s consdered. If each recever has only a sngle antenna, the transmt antenna array can be used to transmt separate data streams to multple recevers only f the transmtter has very accurate channel knowledge,.e., f there s hgh-rate channel feedback from each recever. In ths work t s shown that channel feedback requrements can be sgnfcantly reduced f each recever has a small number of antennas and approprately combnes ts antenna outputs. A novel combnng method that mnmzes channel quantzaton error at each recever, and thereby mnmzes mult-user nterference, s proposed and analyzed. Ths technque s shown to outperform tradtonal technques such as maxmum-rato combnng because mnmzaton of nterference power s more crtcal than maxmzaton of sgnal power n the multple antenna downlnk. Analyss s provded to quantfy the feedback savngs, and the technque s seen to work well wth user selecton algorthms and s also robust to recever estmaton error. I. INTRODUCTION ult-user IO technques such as zero-forcng beamformng allow for smultaneous transmsson of multple data streams,.e., spatal multplexng, n the multple transmt antenna downlnk channel even when each recever (moble) has only a sngle antenna []. owever, the transmtter must have accurate channel state nformaton (CSI) n order to utlze such technques. In the practcally motvated fnte rate feedback model, each moble feeds back a fnte number of bts regardng ts channel nstantaton at the begnnng of each block or frame. When each moble has a sngle receve antenna, the feedback bts are determned by quantzng the channel vector to one of 2 B quantzaton vectors and feedng back the correspondng ndex. Whle a relatvely small number of feedback bts suffce to obtan near-perfect

2 CSIT performance n a pont-to-pont ISO (multple-nput, sngle-output) channel [2][3], consderably more feedback s requred n a multple transmt antenna, sngle receve antenna (per moble) downlnk channel. In fact, the per moble feedback must be scaled wth the number of transmt antennas as well as the system SNR n downlnk channels n order to acheve rates close to those achevable wth perfect CSIT. In [4], t s shown that the followng scalng of feedback bts B = P db, () 3 where P represents the SNR and the number of transmt antennas, suffces to mantan a maxmum gap of 3 db (equvalent to bps/z per moble) between perfect CSIT and lmted feedback performance n an d Raylegh block-fadng channel when the transmtter uses zero-forcng beamformng, a low-complexty but near-capacty technque for the IO downlnk. Ths feedback load can be qute large for even reasonable sze systems: for example, 0 feedback bts per moble are requred n a 4 transmt antenna system operatng at 0 db. In such a system the transmtter emts multple beams and uses ts channel knowledge to select beamformng vectors (.e., beam drectons) such that nulls are created at certan users: the beam ntended for the frst moble s chosen to create a null (or a near null) at all other mobles, and so forth. Inaccurate channel knowledge leads to naccurate nullng whch translates drectly nto mult-user nterference and reduced throughput. As a result, channel quantzaton error s the crtcal factor n the IO downlnk. In ths paper, we propose a novel receve antenna combnng technque, dubbed quantzaton-based combnng (QBC), that can be used by multple-antenna moble devces to reduce quantzaton error and thereby reduce the requred channel feedback load. Each moble lnearly combnes the receved sgnals on ts N antennas to produce a sngle output, thereby creatng an effectve sngle receve antenna channel at each moble. The resultng vector channel s quantzed and fed back, and transmsson s then performed as n a multple transmt, sngle receve antenna downlnk channel. When QBC s used, the combner weghts are chosen to produce the effectve sngle antenna channel that can be quantzed wth mnmal error. Tradtonal combnng technques such as the maxmum-rato based technque descrbed n [5] for pont-to-pont IO channels wth lmted channel feedback maxmze receved sgnal power but generally do not mnmze channel quantzaton error. Snce channel quantzaton error s so crtcal n the IO downlnk channel, quantzaton-based combnng leads to better performance by mnmzng quantzaton error (.e., nterference power) possbly at the expense of channel (.e., sgnal) power. Our analyss shows that ths combnng technque reduces the feedback requred from the expresson

3 2 n () to approxmately B N P db, (2) 3 where N s the number of antennas at each moble. Although feedback must stll be ncreased wth SNR, the rate of ths ncrease s decreased by approprately performng antenna combnng. For example, employng QBC at each moble reduces the feedback n a 4 transmt antenna system at 0 db from 0 bts to 7 bts f each moble has two antennas (N = 2). The remander of ths paper s organzed as follows: In Secton II we ntroduce the system model and some prelmnares. In Secton III we descrbe a smple antenna selecton method that leads drectly nto Secton IV where the much more powerful quantzaton-based combnng technque s descrbed n detal. In Secton V we analyze the throughput and feedback requrements of QBC. In Secton VI we compare QBC to other combnng technques (e.g., RC) and also consder the effect of user selecton and recever estmaton error, and fnally we conclude n Secton VII. Notaton: We use lower-case boldface to denote vectors, upper-case boldface for matrces, and the symbol ( ) for the conjugate transpose. The norm of vector x s denoted x. II. SYSTE ODEL AND PRELIINARIES We consder a K moble (recever) downlnk channel n whch the transmtter (access pont) has antennas, and each of the mobles has N antennas. The receved sgnal at the -th antenna s gven by: y = h x + n, =,...,NK (3) where h,h 2,...,h KN are the channel vectors (wth h C ) descrbng the KN receve antennas, x C s the transmtted vector, and n,...,n NK are ndependent complex Gaussan nose terms wth unt varance. Note that moble has access to sgnals y,...,y N, moble 2 has access to y N+,...,y 2N, and the -th moble has access to y ( )N+,...,y N. There s a transmt power constrant of P,.e. the nput must satsfy E[ x 2 ] P. We use to denote the concatenaton of the -th moble s channels,.e. = [h ( )N+ h N ]. We consder a block fadng channel wth ndependent Raylegh fadng from block to block and therefore the entres of each channel vector are d complex Gaussan wth unt varance. Each of the mobles s assumed to have perfect and nstantaneous knowledge of ts own channel, although we analyze the effect of relaxng ths assumpton n Secton VI-D. In ths work we study only the ergodc capacty, or the long-term average throughput. For smplcty of exposton we assume that the number of mobles

4 3 s equal to the number of transmt antennas,.e., K =. The results can easly be extended to the case where K <, and the proposed technque can be combned wth user selecton when K >, as dscussed n Secton VI-C. Furthermore, we assume that the number of moble antennas s less than the number of transmt antennas (N < ) because mult-user IO loses much of ts advantage over pont-to-pont technques when N. A. Fnte Rate Feedback odel In the fnte rate feedback model, each moble quantzes ts channel to B bts and feeds back the bts perfectly and nstantaneously to the transmtter at the begnnng of each block [5][6]. Vector quantzaton s performed usng a codebook C of 2 B -dmensonal unt norm vectors C {w,...,w 2 B}, and each moble quantzes ts channel to the quantzaton vector that forms the mnmum angle to t [5] [6]: and feeds the quantzaton ndex back to the transmtter. ĥ = arg mn sn 2 ( (h,w)), (4) w=w,...,w 2 B For analytcal tractablty, we study systems usng random vector quantzaton (RVQ) n whch each of the 2 B quantzaton vectors s ndependently chosen from the sotropc dstrbuton on the - dmensonal unt sphere and where each moble uses an ndependently generated codebook [2]. We analyze performance averaged over random codebooks; smlar to Shannon s random codng argument, there always exsts at least one quantzaton codebook that performs as well as the ensemble average. B. Zero-Forcng Beamformng After recevng the quantzaton ndces from each of the mobles, the AP can use zero-forcng beamformng (ZFBF) to transmt data to the users. Let us agan consder the N = scenaro, where the channels are the vectors h,...,h. When ZFBF s used, the transmtted sgnal s defned as x = = x v, where each x s a scalar (chosen complex Gaussan wth power P/) ntended for the -th moble, and v C s the beamformng vector for the -th moble. Snce the transmtter does not have perfect CSI, ZFBF must be performed based on the quantzatons nstead of the actual channels. The beamformng vectors v,...,v are chosen as the normalzed rows of the matrx [ĥ ĥ],.e., they satsfy v = for all and ĥ v j = 0 for all j. If all mult-user nterference s treated as addtonal nose, the resultng SINR at the -th recever s gven by: SINR = P h v 2 + j P h v j 2. (5)

5 4 The coeffcent that determnes the amount of nterference receved at moble from the beam ntended for moble j, h v j 2, s easly seen to be an ncreasng functon of moble s quantzaton error. C. IO Downlnk wth Sngle Antenna obles In [4] the IO downlnk channel wth sngle antenna mobles (N = ) s analyzed assumng that ZFBF s performed on the bass of (RVQ-based) fnte rate feedback. The basc result of [4] s that: [ R FB (P) R CSIT (P) log 2 ( ( )]) + P E sn 2 (ĥ,h ) (6) where R FB (P) and R CSIT (P) are the ergodc per-user throughput wth feedback and wth perfect CSIT, [ ( )] respectvely, and the quantty E sn 2 (ĥ,h ) s the expected quantzaton error. The expected quantzaton error can be accurately upper bounded by 2 B and therefore the throughput loss due to ( ) lmted feedback s upper bounded by log 2 + P 2 B, whch s an ncreasng functon of the SNR P. If the number of feedback bts (per moble) s scaled wth P accordng to: B = ( )log 2 P P db, 3 then the dfference between R FB (P) and R CSIT (P) s upper bounded by bps/z at all SNR s, or equvalently the power gap s at most 3 db. As the remander of the paper shows, quantzaton-based combnng sgnfcantly reduces the quantzaton error (more precsely, t ncreases the exponental rate at whch quantzaton error goes to zero as B s ncreased) and therefore decreases the rate at whch B must be ncreased as a functon of SNR. III. ANTENNA SELECTION FOR REDUCED QUANTIZATION ERROR In ths secton we descrbe a smple antenna selecton method that reduces channel quantzaton error. Descrpton of ths technque s prmarly ncluded for expostory reasons, because the smple concept of antenna selecton naturally extends to the more complex (and powerful) QBC technque. In pont-topont IO, the receve antenna wth the largest channel gan s selected, whle n the IO downlnk the antenna wth the smallest quantzaton error s selected. The vector channel correspondng to each receve antenna s separately quantzed, and the antenna wth mnmum error s selected. To be more explct, consder the operaton performed at the frst moble, whch has channel matrx = [h h N ] and a sngle quantzaton codebook consstng of 2 B quantzaton vectors w,...,w 2 B. The moble frst ndvdually quantzes the N vector channels h,...,h N that correspond to ts N receve antennas: ĝ l = arg mn sn 2 ( (h l,w)) l =,...,N, (7) w=w,...,w 2 B

6 5 and then selects the antenna wth the mnmum quantzaton error: j = arg mn l=,...,n sn2 ( (h l,ĝ l )), (8) and feeds back the quantzaton ndex correspondng to ĝ j. The moble uses only antenna j for recepton, and thus the system s effectvely transformed nto a IO downlnk wth sngle receve antennas. Due to the ndependence of the channel and quantzaton vectors, choosng the best of N channel quantzatons s statstcally equvalent to quantzng a sngle vector channel usng a codebook of sze N 2 B. Therefore, antenna selecton effectvely ncreases the quantzaton codebook sze from 2 B to N 2 B, and a system usng antenna selecton wth N antennas per moble and a codebook of sze 2 B (.e., B feedback bts per moble) acheves the same throughput as a sngle receve antenna downlnk channel wth B+log 2 N feedback bts per moble. Thus, antenna selecton reduces the requred feedback by log 2 N bts per moble as compared to a sngle receve antenna system. IV. QUANTIZATION-BASED COBINING In ths secton we descrbe the quantzaton-based combnng (QBC) technque that reduces channel quantzaton error by approprately combnng receve antenna outputs. We consder a lnear combner at each moble, whch effectvely converts each multple antenna moble nto a sngle antenna recever. The combner structure for a 3 user channel wth 3 transmt antennas ( = 3) and 2 antennas per moble (N = 2) s shown n Fg.. Each moble lnearly combnes ts N outputs, usng approprately chosen combner weghts, to produce a scalar output (denoted by y eff ). The effectve channel descrbng the channel from the transmt antenna array to the effectve output of the -th moble (y eff ) s smply a lnear combnaton of the N vectors descrbng the N receve antennas. After choosng combnng weghts the moble quantzes the effectve channel vector and feeds back the approprate quantzaton ndex. Only the effectve channel output s used to receve data, and thus each moble effectvely has only one antenna. The key to the technque s to choose combner weghts that produce an effectve channel that can be quantzed very accurately; such a choce must be made on the bass of both the channel vectors and the quantzaton codebook. Ths s qute dfferent from maxmum rato combnng, where the combner weghts and quantzaton vector are chosen such that receved sgnal power s maxmzed but quantzaton error s generally not mnmzed. Note that the antenna selecton technque descrbed n the prevous secton corresponds to choosng the effectve channel from the set (h,...,h N ), whle QBC allows the effectve channel to be an arbtrary lnear combnaton of these N vectors.

7 6 γ, eff y γ,2 2 γ 2, eff y 2 γ 2,2 3 γ 3, eff y 3 γ 3,2 Fg.. Effectve Channel for = K = 3, N = 2 System A. General Descrpton Let us consder the effectve receved sgnal at the frst moble for some choce of combner weghts, whch we denote as γ = (γ,,...,γ,n ). In order to mantan a nose varance of one, the combner weghts are constraned to have unt norm: γ =. The (scalar) combner output, denoted y eff, s: N N y eff = γ,l y l = γ,l (h l x + n l ) l= = l= ( N l= γ,l h l ) = (h eff ) x + n, x + N γ,l n k where n = N l= γ,l n k s unt varance complex Gaussan nose because γ =. The effectve channel vector h eff s smply a lnear combnaton of the vectors h,...,h N : N h eff = γ,l h l = γ. Snce γ can be any unt norm vector, h eff by h,...,h N,.e., n span( ). l= l= can be n any drecton n the N-dmensonal subspace spanned Because quantzaton error s so crtcal to performance, the objectve s to choose combner weghts that yeld an effectve channel that can be quantzed wth mnmal error, wthout any regard to the effectve channel norm. The quantzaton error correspondng to effectve channel h eff s mn sn 2 ( (h eff,w ) ). =,...,2 B Therefore, the optmal choce of the effectve channel s the soluton to: mn h eff mn sn 2 ( (h eff,w ) ), (9) =,...,2 B By well known propertes of d Raylegh fadng, the matrx s full rank wth probablty one [7].

8 7 where h eff s allowed to be n any drecton n span( ). Once the optmal effectve channel s determned, the combner weghts γ can be determned through a smple pseudo-nverse operaton. Snce the expresson for the optmum effectve channel gven n (9) conssts of two mnmzatons, wthout loss of optmalty the order of the mnmzaton can be swtched to gve: mn =,...,2 B mn h eff sn 2 ( (h eff,w ) ), (0) For each quantzaton vector w, the nner mnmzaton fnds the effectve channel vector n span( ) that forms the mnmum angle wth w : mn h eff sn 2 ( (h eff,w ) ). () By basc geometrc prncples, the mnmzng h eff s smply the projecton of w on span( ). The soluton to () s therefore the sne squared of the angle between w and ts projecton on span( ), whch s referred to as the angle between w and the subspace. As a result, the best quantzaton vector,.e., the soluton of (0), s the vector that forms the smallest angle between tself and span( ). The optmal effectve channel s the (scaled) projecton of ths partcular quantzaton vector onto span( ). In order to perform quantzaton, the angle between each quantzaton vector and span( ) must be computed. If q,...,q N form an orthonormal bass for span( ) and Q [q q N ], then sn 2 ( (w, span( ))) = Q w 2. Therefore, moble s quantzed channel, denoted ĥ, s: ĥ = arg mn w=w,...,w 2 B (w, span( )) = arg max Q w=w w 2. (2),...,w 2 B Once the quantzaton vector has been selected, t only remans to choose the combner weghts. The projecton of ĥ on span( ), whch s equal to Q Q ĥ, s scaled by ts norm to produce the unt norm vector s proj. The drecton specfed by s proj has the mnmum quantzaton error amongst all drectons n span( ), and therefore the effectve channel should be chosen n ths drecton Frst we fnd the vector u C N such that u = s proj, and then scale to get γ. Snce s proj s n span( ), u s unquely determned by the pseudo-nverse of : u = ( ) s proj, (3) and the combner weght vector γ s the normalzed verson of u : γ = u u. The quantzaton procedure s llustrated for a N = 2 channel n Fg. 2. In the fgure the span of the two channel vectors s shown along wth the chosen quantzaton vector h, ts projecton on the channel subspace, and the correspondng effectve channel.

9 8 Fg. 2. Quantzaton procedure for a two antenna moble B. Algorthm Summary We now summarze the quantzaton-based combnng procedure performed at the -th moble: ) Fnd an orthonormal bass, denoted q,...,q N, for span( ) and defne Q [q q N ]. 2) Fnd the quantzaton vector closest to the channel subspace: ĥ = arg max Q w=w w 2. (4),...,w 2 B 3) Determne the drecton of the effectve channel by projectng ĥ onto span( ). = Q Q Q Q ĥ. (5) 4) Compute the combner weght vector γ : ( ) γ = s proj ( ) s proj. (6) s proj Each moble performs these steps, feeds back the ndex of ts quantzed channel ĥ, and then lnearly combnes ts N receved sgnals usng vector γ to produce ts effectve channel output y eff wth h eff ĥ = (h eff ) x+n = γ. Note that the transmtter need not be aware of the number of receve antennas or of the detals of ths procedure because the downlnk channel appears to be a sngle receve antenna channel from the transmtter s perspectve; ths clearly eases the mplementaton burden of QBC. V. TROUGPUT ANALYSIS Quantzaton-based combnng converts the multple transmt, multple receve antenna downlnk channel nto a multple transmt, sngle receve antenna downlnk channel wth channel vectors h eff,...,heff and channel quantzatons ĥ ĥ. After recevng the quantzaton ndces from each of the mobles, the transmtter performs zero-forcng beamformng (as descrbed n Secton II-B) based on the channel quantzatons. The resultng SINR at the -th moble s gven by: SINR = P (heff ) v 2 + j P (heff ) v j 2. (7)

10 9 We are nterested n the long-term average throughput, and thus the quantty E[log 2 ( + SINR )]. A. Prelmnary Calculatons We frst determne the dstrbuton of the quantzaton error and the effectve channel vectors wth respect to both the random channels and random quantzaton codebooks. Lemma : The quantzaton error sn 2 ( (ĥ,h eff )), s the mnmum of 2 B ndependent beta ( N,N) random varables. Proof: If the columns of N matrx Q form an orthonormal bass for span( ), then cos 2 ( (w j, span( )) = Q w j 2 for any quantzaton vector. Snce the bass vectors and quantzaton vectors are sotropcally chosen and are ndependent, ths quantty s the squared norm of the projecton of a random unt norm vector n C onto a random N-dmensonal subspace, whch s descrbed by the beta dstrbuton wth parameters N and N [8]. By the propertes of the beta dstrbuton, sn 2 ( (w j, span( )) = cos 2 ( (w j, span( )) s beta ( N,N). Fnally, the ndependence of the quantzaton and channel vectors mples ndependence of the 2 B random varables. h Lemma 2: The normalzed effectve channels eff h eff,..., h eff h eff are d sotropc vectors n C. h Proof: From the earler descrpton of QBC, note that eff, whch s the projecton of the best h eff = sproj quantzaton vector onto span( ). Snce each quantzaton vector s chosen sotropcally, ts projecton s sotropcally dstrbuted wthn the subspace. Furthermore, the best quantzaton vector s chosen based solely on the angle between the quantzaton vector and ts projecton. Thus s proj n span( ). Snce ths subspace s also sotropcally dstrbuted, the vector s proj s sotropcally dstrbuted s sotropcally dstrbuted n C. Fnally, the ndependence of the quantzaton and channel vectors from moble to moble mples ndependence of the effectve channel drectons. Lemma 3: The quantty h eff 2 s χ 2 2( N+). Proof: Usng the notaton from Secton IV-A, the norm of the effectve channel s gven by: h eff 2 = γ 2 u = u 2 = u 2 u 2 = sproj 2 u 2 = u 2, (8) where we have used the defntons h eff = γ and γ = u u, and the fact that u satsfes u = s proj. Therefore, n order to characterze the norm of the effectve channel t s suffcent to characterze u 2. The N-dmensonal vector u s the set of coeffcents that allows s proj, the normalzed projecton of the chosen quantzaton vector, to be expressed as a lnear combnaton of the columns of (.e., the channel vectors). Because s proj s sotropcally dstrbuted n span( ) (Lemma 2), f we change coordnates to any (N-dmensonal) bass for span( ) we can assume wthout loss of generalty that the projecton of

11 0 the quantzaton vector s [ 0 0] T. Therefore, the dstrbuton of u 2 s the same as the dstrbuton of. Snce the N N matrx [( ] s Wshart dstrbuted wth degrees of freedom, ths ), quantty s well-known to be χ 2 2( N+) ; see [9] for a proof. Accordng to Lemma 3, the norm of the effectve channel has the same dstrbuton as that of a ( N + )-dmensonal random vector nstead of a -dmensonal vector. An arbtrary lnear combnaton (wth unt norm) of the N channel vectors would result n another d complex Gaussan -dmensonal vector, whose squared norm s χ 2 2, but the weghts defnng the effectve channel are not arbtrary due to the nverse operaton. owever, ths reducton n channel norm only slghtly reduces performance and s compensated by the effect of reduced quantzaton error. B. Sum Rate Performance Relatve to Perfect CSIT In order to study the beneft of QBC, we compare the acheved sum rate, denoted R QBC (P), to the sum rate acheved usng zero-forcng beamformng on the bass of perfect CSIT n an transmt antenna, sngle receve antenna downlnk channel, denoted R CSIT (P). We use the sngle receve antenna downlnk wth perfect CSIT as the benchmark nstead of the N receve antenna perfect CSIT downlnk channel because the proposed method effectvely utlzes only a sngle receve antenna per moble. In a sngle receve antenna IO downlnk wth perfect CSIT, the zero-forcng beamformng vectors (denoted v ZF, ) can be chosen perfectly orthogonal to all other channels. Thus, the SNR of each user s as gven n (5) wth zero nterference terms n the denomnator. The resultng average rate s gven by: [ ( R CSIT (P) = E log 2 + P )] h v ZF, 2. The sum rate acheved wth QBC s gven by: R QBC (P) = E,W [ log 2 ( + )] P (heff ) v 2 + j P. (heff ) v j 2 Followng the procedure n [4], the rate gap R(P) s defned as the dfference between the per-user throughput acheved wth perfect CSIT and wth feedback-based QBC: R(P) R CSIT (P) R QBC (P). (9) Smlar to Theorem of [4], we can upper bound ths throughput loss: Theorem : The per-user throughput loss s upper bounded by: ( ) ( ) ) N+ R(P) log l 2 e + log 2 (+P E[sn 2 ( (ĥ,h eff ))] l= N+ Proof: See Appendx.

12 The frst term n the expresson s the throughput loss due to the reduced norm of the effectve channel, whle the second (more sgnfcant) term, whch s an ncreasng functon of P, s due to quantzaton error. In order to quantfy ths rate gap, t clearly s necessary to bound the expected quantzaton error. By Lemma, the quantzaton error s the mnmum of 2 B d beta( N,N) random varables. Furthermore, a general result on ordered statstcs appled to the beta dstrbuton gves [8, Chapter 4.I.B]: E[sn 2 ( (ĥ,h eff ))] F ( 2 B ) where F X (x) s the CDF of a beta ( N,N) random varable, and F ( ) s ts nverse. The CDF s gven by: F X (x) = N =0 ( ) x N+ ( x) N + N X ( ) x N, N where the approxmaton s the result of keepng only the lowest order x term and droppng ( x) terms; ths s vald for small values of x. Usng ths we get the followng approxmaton: ( ) E[sn 2 ( (ĥ,h eff ))] 2 B N N. (20) N The accuracy of ths approxmaton s later verfed by our numercal results. Pluggng ths approxmaton nto the upper bound n Theorem we get: ( ) R(P) log l 2 e + log 2 (+P l= N+ ( N+ ) 2 B N ( ) ) N N If the number of feedback bts B s fxed, the resdual quantzaton error causes the system to become nterference lmted as the SNR s taken to nfnty (see [4, Theorem 2] for a formal proof when N = ). Thus, B must be approprately scaled wth the SNR n order to avod ths lmtaton. Indeed, f B s scaled such that the quantzaton error decreases as P, the rate gap n (2) can be kept constant. Such a scalng of feedback bts leads to a bounded throughput loss relatve to perfect CSIT, and also ensures that the full multplexng gan () s acheved. In order to determne ths scalng, we smply set the approxmaton of R(P) n (2) equal to a rate constant log 2 b and solve for B as a functon of P. Thus, a per-moble rate loss of at most log 2 b s mantaned f B s scaled accordng to: ( B N ( N)log 2 P ( N)log 2 c ( N)log 2 N+ N ( P db ( N)log 3 2 c ( N)log 2 N+ ) ( log 2 N ) log 2 ( N ), (2) ), (22) where c = b e (P ) l= N+ l. Note that a per user rate gap of log 2 b = bps/z s equvalent to a 3 db gap n the sum rate curves.

13 2 30 Capacty (bps/z) Perfect CSIT Zero Forcng ~ 3 db Lmted FB (N=,2,3) SNR (db) Fg. 3. Sum rate of = K = 6 downlnk channel The sum rate of a 6 transmt antenna downlnk channel ( = 6) s plotted n Fg. 3. The perfect CSIT zero-forcng curve s plotted along wth the rates acheved usng fnte rate feedback wth the feedback load scaled wth SNR accordng to (22) for N =,2 and 3; the actual feedback loads are plotted n Fgure 4 for the dfferent values of N. For N = 2 and N = 3 QBC s performed and the fact that the throughput curves are approxmately 3 db away from the perfect CSIT curve verfy the accuracy of the approxmatons used to derve the feedback scalng expresson n (22). In ths system, the feedback savngs at 20 db s 7 and 2 bts, respectvely, for 2 and 3 receve antennas. All numercal results n the paper are generated usng the method descrbed n Appendx II. VI. DISCUSSION AND EXTENSIONS In ths secton we hghlght the advantages of quantzaton-based combnng relatve to other combnng technques, evaluate the performance of QBC n conjuncton wth user selecton, and analyze the effect of nosy recever channel estmates. A. Comparson wth Sngle Receve Antenna Systems The frst pont of reference s the sngle receve antenna (N = ) IO downlnk. As dscussed n Secton II-C, scalng feedback accordng to B = 3 P db mantans a 3 db gap from perfect CSIT throughput. If compared wth the feedback scalng for QBC, descrbed n (22), notce that n both cases feedback must be ncreased lnearly wth SNR, but that the slope of ths ncrease s 3 when mobles have only a sngle antenna compared to a slope of N 3 for antenna combnng. If we compute the

14 3 35 Requred Feedback (bts) N= N=2 N= SNR (db) Fg. 4. Feedback Requrements for = K = 6 downlnk channel dfference between the N = feedback load and the QBC feedback load, we can quantfy how much less feedback s requred to acheve the same throughput (3 db away from a sngle receve antenna downlnk wth perfect CSIT) f QBC s used wth N antennas/moble: QBC (N) = B B N N ( ) P db + log 3 2 (N )log N 2 e. The feedback reducton s an ncreasng functon of the SNR, and can be qute sgnfcant for even moderate SNR values and system szes; Fgure 4 llustrates these savngs when = 6. Perhaps a more useful method to understand ths feedback reducton s to consder the number of channel symbols devoted to feedback. Consder the feedback model ntroduced n [0] where each moble transmts ts feedback bts over an orthogonal AWGN channel wth the same SNR as the downlnk channel (P ); ths s reasonable when the average SNR s due prmarly to path loss. The capacty of ths feedback channel s log 2 ( + P) bts/symbol, and transmttng B = 3 P db ( )log 2 P bts requres approxmately channel symbols per moble. On the other hand, QBC requres ( N)log 2 P + O() bts and thus only N channel symbols are requred. As a result, quantzaton-based combnng effectvely reduces the number of channel symbols that must be reserved for feedback by N ; ths savngs s on a per-moble bass and thus can be substantal for moderate and large systems. B. Alternate Combnng Technques In addton to antenna selecton and QBC, another combnng method s to select the quantzaton vector that maxmzes receved power, as proposed n [5] for pont-to-pont IO channels. Ths method

15 4 roughly corresponds to maxmum rato combnng, and selects the quantzaton vector accordng to: ĥ = arg max w=w w 2. (23),...,w 2 B Ths technque s referred to as RC. If beamformng vector w s used by the transmtter, then receved sgnal power s maxmzed by usng the maxmum rato combnng weghts γ = weghts yeld the followng effectve channel: h eff = γ = w w. w w [5]. These When the number of feedback bts s not very small, wth hgh probablty the quantzaton vector that maxmzes w 2 s the vector that s closest to the egenvector correspondng to the maxmum egenvalue of. To see ths, consder the maxmzaton of w when w s constraned to have unt norm but need not be selected from a fnte codebook. Ths corresponds to the classcal defnton of the matrx norm, and the optmzng w s n the drecton of the maxmum sngular value of. When B s not too small, the quantzaton error s very small and as a result the soluton to (23) s extremely close to 2. As a result, selectng the quantzaton vector accordng to the crtera n (23) s essentally equvalent to drectly fndng the quantzaton vector that s closest to the drecton of the maxmum sngular value of. To drectly perform ths, the moble frst selects the combner weghts γ such that the effectve channel h eff = γ s n the drecton of the maxmum sngular value, whch corresponds to selectng γ equal to the egenvector correspondng to the maxmum egenvalue of the N N matrx, and then fnds the quantzaton vector closest to h eff. The effectve channel norm satsfes h eff 2 = 2, whch can be reasonably approxmated as a scaled verson of a χ 2 2N random varable []. Therefore the norm of the effectve channel s large, but notce that the quantzaton procedure reduces to standard vector quantzaton, for whch the error s roughly 2 B. In Fgure 5, numercally computed values of the quantzaton error (log 2 (E[sn 2 ( (h eff,ĥ))]) are shown for QBC, antenna selecton, RC (correspondng to equaton 23), and drect quantzaton of the maxmum egenvector, along wth approxmaton 2 B as well as the approxmaton from (20), for a = 4, N = 2 channel. Note that the error of QBC s very well approxmated by (20), and the exponental rate of decrease of the other technques are all well approxmated by 2 B. Each combnng technque transforms the multple receve antenna channel nto a sngle receve antenna downlnk channel wth a possbly modfed effectve channel norm and a possbly modfed quantzaton error. These technques are summarzed n Table I. The key pont s that only QBC changes the exponent of the quantzaton error, whch determnes the rate at whch feedback must be ncreased wth SNR. As a

16 5 0 Log (base 2) of Quantzaton Error RC Selecton Approxmaton Approxmaton QBC Feedback Bts (B) Fg. 5. Quantzaton Error for Dfferent Combnng Technques ( = 4, N = 2) Effectve Channel Norm Quantzaton Error Sngle RX Antenna (N = ) χ B/( ) Antenna Selecton χ (B+log 2 N)/( ) RC max egenvalue 2 B/( ) QBC χ 2 2( N+) 2 B/( N) TABLE I SUARY OF COBINING TECNIQUES result, QBC requres N feedback channel symbols, whle all of the other technques requre symbols. When comparng these technques note that the computatonal complexty of QBC and RC are essentally the same: QBC and RC requre computaton of Q w 2 and w 2, respectvely. In Fgure 6 fve dfferent throughput curves for a 4 transmt antenna, 2 receve antenna ( = 4, N = 2) system are shown: ZF on the bass of perfect CSIT (ZF-CSIT), QBC, antenna selecton, RC, and the throughput of a N = system (no combnng). In ths plot, B s scaled accordng to (22),.e., roughly as ( N)log 2 P ; n the feedback model descrbed earler, ths s equvalent to usng approxmately N symbols per moble for feedback. As predcted by (22), the QBC throughput curve s approxmately a 3 db shft of the perfect CSIT curve. The other three throughput curves (antenna selecton, RC, and N = ) all lag sgnfcantly behnd, partcularly at hgh SNR. Ths s because the ( N)log 2 P scalng of feedback s smply not suffcent to mantan good performance f these technques are used. To be

17 6 8 Throughput (bps/z) RC ZF CSIT QBC Ant. Selecton 2 Sngle Antenna SNR (db) Fg. 6. Dfferent Combnng Technques: = 4, N = 2, B scaled wth SNR 8 6 Throughput (bps/z) RC QBC SNR (db) ZF CSIT Sngle Antenna Ant. Selecton Fg. 7. Dfferent Combnng Technques: = 4, N = 2, B = 0 more precse, the quantzaton error goes to zero slower than P whch results n a reducton n the slope (.e., multplexng gan) of these curves. In Fgure 7 throughput curves for the same system are shown for B = 0 (fxed). At low SNR s, RC actually performs better than QBC because sgnal power s more mportant than quantzaton error (.e., nterference power). owever, as the SNR s ncreased QBC begns to outperform RC because of the decreased quantzaton error.

18 7 30 Throughput (bps/z) ZF CSIT QBC RC Ant. Selecton SNR (db) Fg. 8. Combnng and User Selecton: = 4, N = 2, K = 20, B scaled wth SNR C. User Selecton The throughput of zero-forcng based IO downlnk channels can be sgnfcantly ncreased by transmttng to an ntellgently selected subset of mobles [2]. In order to maxmze throughput, users wth nearly orthogonal channels and wth large channel magntudes are selected, and waterfllng can be performed across the channels of the selected users to further ncrease throughput. In [3] a lowcomplexty greedy algorthm that selects users and performs waterfllng s proposed. In Fgure 8 the throughput of a 20 moble system wth 4 transmt antennas ( = 4) and 2 antennas per moble (N = 2) s plotted for a system usng the user selecton algorthm from [3]. The number of feedback bts s scaled wth SNR accordng to (22) and n addton to the purely drectonal nformaton captured by the quantzaton vector, we assume that perfect, (unquantzed) knowledge of the channel norm h eff s provded to the transmtter. 2 Although the throughput analyss of Secton V does not rgorously apply here, we see that the same behavor s observed even when user selecton s performed: the QBC throughput curve s approxmately 3 db away from the perfect CSIT throughput curve. The dfferent combnng technques are approxmately equvalent at low SNR s because wth hgh probablty the user selecton algorthm selects only one user at these SNR level s, but as the SNR s ncreased the QBC begns to sgnfcantly outperform the other technques because of the reduced quantzaton error. 2 Performance can be further ncreased by also feedng back the quantzaton error, but ths does not provde a sgnfcant beneft for the number of users consdered here.

19 8 D. Effect of Recever Estmaton Error In ths secton we analyze antenna combnng performed on the bass of mperfect recever CSI and show that QBC performs well even under realstc models for recever estmaton error. Note that the analyss here follows that gven n [0], where the effect of mperfect CSIR s analyzed for IO downlnk channels wth sngle antenna mobles and quantzed channel feedback. We consder the scenaro where a shared plot sequence s used to tran the mobles. If β downlnk plots are used (β plots per transmt antenna), channel estmaton at the -th moble s performed on the bass of observaton G = βp + n. The SE estmate of s Ĝ = βp +βp G, and the true channel matrx can be wrtten as the sum of the SE estmate and ndependent estmaton error: = Ĝ + e, (24) where e s whte Gaussan nose, ndependent of the estmate Ĝ, wth per-component varance ( + βp). After computng the channel estmate Ĝ, the moble performs QBC on the bass of the estmate Ĝ to determne the combnng vector γ. As a result, the quantzaton vector ĥ very accurately quantzes the vector Ĝγ, whch s the moble s estmate of the effectve channel output, whle the actual effectve channel s gven by h eff = γ. For smplcty we assume that coherent communcaton s possble, and therefore the long-term average throughput s agan E[log 2 ( + SINR )] where the same expresson for SINR gven n (7) apples 3. As a result, recever estmaton error further degrades the CSI provded to the transmtter. The general throughput analyss n Secton V stll apples, and n partcular, the rate gap upper bound gven n Theorem stll holds f the expected quantzaton error takes nto account the effect of recever nose. Rather than dealng drectly wth the expected quantzaton error E[sn 2 ( (ĥ,h eff ))], t s easer to nstead analyze the nterference term E [ (h eff ) v j 2], whch descrbes how much nterference moble receves from the sgnal ntended for moble j. If we return to the proof of Theorem, we can see that the rate gap upper bound can also be stated n terms of these nterference terms: ( ) ( + log 2 R log 2 e l= N+ l + P E [ (h eff ) v j 2]). (25) Usng the representaton of the channel matrx gven n (24), we can wrte the nterference term as: (h eff ) v j = ( γ ) v j = (Ĝ γ ) vj + (e γ ) v j. 3 We have effectvely assumed that each moble can estmate the phase and SINR at the effectve channel output. In practce ths could be accomplshed va a second round of plots that are transmtted usng the chosen beamformng vectors and receved at the effectve channel outputs, as descrbed n [0].

20 9 The frst term n the sum s statstcally dentcal to the nterference term when there s perfect CSIR, whle the second term represents the addtonal nterference due to the recever estmaton error. Because the nose and the channel estmate are each zero-mean and are ndependent we have: E [ [ (h eff ) v j 2] ) 2] [ (e ] = E (Ĝ γ vj + E γ ) 2 v j The frst term comes from the perfect CSIR analyss and s equal to the product of and the expected quantzaton error wth perfect CSIR. Because γ and v j are each unt norm and e s ndependent of these two vectors, the quantty (e γ ) v j s (zero-mean) complex Gaussan wth varance ( + βp). Usng the approxmaton for quantzaton error from (20) and pluggng nto (25), we then get the followng approxmaton to the rate gap when there s recever estmaton error: ( ) ( ( ) N+ R(P) log 2 e + log l 2 +P 2 B N l= N+ ( ) N N + β where we have approxmated ( + βp) (βp). Comparng ths expresson to (2) we see that estmaton error leads only to the ntroducton of an addtonal β ) term. If feedback s scaled accordng to (22) the rate loss f log 2 (b + β ) rather than log 2 (b). Snce downlnk plots are shared, ncreasng β s generally not too expensve from a system resource pont of vew; plots can also be transmtted at an ncreased power level as s done n Wax [4]. In Fgure 9 the throughput of a 4 moble system wth = 4 and N = 2 s plotted for perfect CSIT/CSIR and for QBC performed on the bass of perfect CSIR (β = ) and mperfect CSIR for β = and β = 2. Estmaton error causes non-neglgble degradaton, but the loss decreases rather quckly wth β., VII. CONCLUSION The performance of mult-user IO technque such as zero-forcng beamformng crtcally depend on the accuracy of the channel state nformaton provded to the transmtter. In ths paper, we have shown that an nnovatve receve antenna combnng technque can be used to reduce channel quantzaton error n fnte-rate feedback IO downlnk channels, and thus sgnfcantly reduce channel feedback requrements. Unlke tradtonal maxmum-rato combnng technques that maxmze receved sgnal power, the proposed quantzaton-based combnng technque mnmzes quantzaton error, whch translates nto mnmzaton of mult-user nterference power. Because mult-user IO systems are so senstve to nterference power, ths technque can sgnfcantly outperform standard combnng, partcularly at moderate and hgh SNR s.

21 Throughput (bps/z) Perfect CSIT & CSIR Combnng & Perfect CSIR SNR (db) RX Error: Beta = 2 RX Error: Beta = Fg. 9. Combnng wth Imperfect CSIR: = 4, N = 2, K = 4, B scaled wth SNR Antenna combnng s just one method by whch multple moble antennas can be used n the IO downlnk. It s also possble to transmt multple streams to each moble, or to use receve antennas for nterference cancellaton f the structure of the transmtted sgnal s known to the moble. It remans to be seen whch of these technques s most benefcal n practcal wreless systems when channel feedback resources and complexty requrements are carefully accounted for. APPENDIX I PROOF OF TEORE Pluggng the rate expressons nto the defnton of (P), we have (P) = a + b where [ ( a = E log 2 + P )] h v ZF, 2 E,W log 2 + b = E,W log 2 + j P (heff ) v j 2 P (heff ) v j 2 j= To upper bound a, we frst defne the normalzed vectors h = h / h and note that the norm and drectons of h and of h eff h eff = h eff / h eff, and are ndependent. Usng ths, we derve the followng

22 2 lower bound to the second term n a : [ ( P E,W log 2 + (heff ) v j 2 E,W log 2 + P )] (heff ) v 2 j= h eff [ ( = E,W log 2 + P heff 2 v 2 )] = E [ log 2 ( + P X β h 2 h vzf, 2 )] (26) where X β s β( N+,N ). Snce the beamformng vector v ZF, s chosen orthogonal to the ( ) other channel vectors {h j } j, each of whch s an d sotropc vector, t s sotropc and s ndependent of the channel drecton h. Due to Lemma 2 the same s also true of v and h eff, and therefore we can substtute h vzf, 2 for (h eff ) v 2. Fnally, note that the product X β h 2 s χ 2 2( N+) because h 2 s χ 2 2, and therefore X β h 2 and h eff 2 have the same dstrbuton. Usng (26) we get [ ( a E log 2 + P )] [ ( )] h 2 h vzf, 2 P E log 2 + X β h 2 h vzf, 2 [ ( + P = E log h 2 h )] vzf, 2 2 P + X β h 2 h vzf, 2 [ ( P E log h 2 h )] vzf, 2 2 P X β h 2 h vzf, 2 E [log 2 (X β )] ( ) = log 2 e, l l= N+ where the last lne follows from E [log 2 (X β )] = E[log 2 χ 2 2 ] E[log 2 χ 2 2( N+) ] and the expressons n [7]. Fnally, we upper bound b usng Jensen s nequalty: b log 2 + E P (heff ) v j 2 j ( = log 2 + ( ) P E [ (h eff ) 2] E [ (h eff ) v j 2]) log 2 ( + P ( = log 2 + P N + ( )( N + ) E [ (h eff ) v j 2]) E [ sn 2 ( ( h eff,h ))] ). where the fnal step uses Lemma 2 of [4] to get E [ (h eff ) v j 2] = E [ sn 2 ( ( h eff,h ))].

23 22 APPENDIX II GENERATION OF NUERICAL RESULTS Brute force smulaton of RVQ s extremely computatonally complex because t requres generatng a codebook of 2 B quantzaton vectors and then multplyng each of these vectors wth a projecton matrx. For B larger than 5 or 20, ths becomes nfeasble wth standard processors and software (e.g., ATLAB). owever, the statstcs of RVQ can be exploted to exactly smulate the quantzaton process: ) Draw a realzaton of the quantzaton error Z, whch has a known CDF (Lemma ) that can be numercally nverted. 2) Draw a realzaton of the correspondng quantzaton vector accordng to: ( ) ĥ = Z u + Zs where u s chosen sotropcally n span( ) and s s chosen sotropcally n the nullspace of span( ), wth u, s ndependent. These steps exactly emulate step of quantzaton-based combnng at each moble, after whch combner weghts are chosen (whch determne the effectve channels) and the zero-forcng procedure s performed. Note that the same procedure can be used to smulate antenna selecton, quantzaton of the maxmum egenvector, and no combnng (N = ). owever, t does not appear that a smlar technque can be used for RC, and as a result all RC results are generated usng brute force RVQ. REFERENCES [] G. Care and S. Shama, On the achevable throughput of a multantenna Gaussan broadcast channel, IEEE Trans. Inform. Theory, vol. 49, no. 7, pp , July [2] W. Santpach and. ong, Asymptotc capacty of beamformng wth lmted feedback, n Proceedngs of Int. Symp. Inform. Theory, July 2004, p [3] D. Love, R. eath, W. Santpach, and. ong, What s the value of lmted feedback for IO channels? IEEE Communcatons agazne, vol. 42, no. 0, pp , Oct [4] N. Jndal, IO broadcast channels wth fnte rate feedback, IEEE Trans. on Inform. Theory, vol. 52, no., pp , [5] D. Love, R. eath, and T. Strohmer, Grassmannan beamformng for multple-nput multple-output wreless systems, IEEE Trans. Inform. Theory, vol. 49, no. 0, pp , Oct [6] K. ukkavll, A. Sabharwal, E. Erkp, and B. Aazhang, On beamformng wth fnte rate feedback n multple-antenna systems, IEEE Trans. Inform. Theory, vol. 49, no. 0, pp , Oct [7] A. Tulno and S. Verdu, Random matrx theory and wreless communcatons, Foundatons and Trends n Communcatons and Informaton Theory, vol., no., [8] A. K. Gupta and S. Nadarajah, andbook of Beta Dstrbuton and Its Applcatons. CRC, 2004.

24 23 [9] J. Wnters, J. Salz, and R. Gtln, The mpact of antenna dversty on the capacty of wreless communcaton systems, IEEE Trans. on Communcatons, vol. 42, no. 234, pp , 994. [0] G. Care, N. Jndal,. Kobayash, and N. Ravndran, Quantzed vs. analog feedback for the IO downlnk: A comparson between zero-forcng based achevable rates, n Proceedngs of Int. Symp. Inform. Theory, June [] A. Paulraj, D. Gore, and R. Nabar, Introducton to Space-Tme Wreless Communcatons. Cambrdge Unversty Press, [2] T. Yoo and A. Goldsmth, On the optmalty of multantenna broadcast schedulng usng zero-forcng beamformng, IEEE Journal on Selected Areas n Communcatons, vol. 24, no. 3, pp , [3] G. Dmc and N. Sdropoulos, On Downlnk Beamformng wth Greedy User Selecton: Performance Analyss and Smple New Algorthm, vol. 53, no. 0, pp , October [4] J. G. Andrews, A. Ghosh, and R. uhamed, Fundamentals of WAX: Understandng Broadband Wreless Networkng. Prentce all, 2007.

A Feedback Reduction Technique for MIMO Broadcast Channels

A Feedback Reduction Technique for MIMO Broadcast Channels A Feedback Reducton Technque for MIMO Broadcast Channels Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of Mnnesota Mnneapols, MN 55455, USA Emal: nhar@umn.edu Abstract A multple antenna

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1 Homework 4 Problem Capacty wth CSI only at Recever: C = log det I + E )) s HH H N M T R SS = I) SVD of the Channel Matrx: H = UΣV H = [U 1 U ] [ Σr ] [V 1 V ] H Capacty wth CSI at both transmtter and

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

MIMO Systems and Channel Capacity

MIMO Systems and Channel Capacity MIMO Systems and Channel Capacty Consder a MIMO system wth m Tx and n Rx antennas. x y = Hx ξ Tx H Rx The power constrant: the total Tx power s x = P t. Component-wse representaton of the system model,

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

Feb 14: Spatial analysis of data fields

Feb 14: Spatial analysis of data fields Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s

More information

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system. Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence) /24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Secret Communication using Artificial Noise

Secret Communication using Artificial Noise Secret Communcaton usng Artfcal Nose Roht Neg, Satashu Goel C Department, Carnege Mellon Unversty, PA 151, USA {neg,satashug}@ece.cmu.edu Abstract The problem of secret communcaton between two nodes over

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

Rethinking MIMO for Wireless Networks: Linear Throughput Increases with Multiple Receive Antennas

Rethinking MIMO for Wireless Networks: Linear Throughput Increases with Multiple Receive Antennas Retnng MIMO for Wreless etwors: Lnear Trougput Increases wt Multple Receve Antennas ar Jndal Unversty of Mnnesota Unverstat Pompeu Fabra Jont wor wt Jeff Andrews & Steven Weber MIMO n Pont-to-Pont Cannels

More information

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm NYU, Fall 2016 Lattces Mn Course Lecture 2: Gram-Schmdt Vectors and the LLL Algorthm Lecturer: Noah Stephens-Davdowtz 2.1 The Shortest Vector Problem In our last lecture, we consdered short solutons to

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1 C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned

More information

Lecture 4 Hypothesis Testing

Lecture 4 Hypothesis Testing Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

On the achievable rates of multiple antenna broadcast channels with feedback-link capacity constraint

On the achievable rates of multiple antenna broadcast channels with feedback-link capacity constraint Chen et al. EURASI Journal on Wreless Communcatons and Networkng 2, 2:2 http://jwcn.euraspjournals.com/content/2//2 RESEARCH Open Access On the achevable rates of multple antenna broadcast channels wth

More information

Eigenvalues of Random Graphs

Eigenvalues of Random Graphs Spectral Graph Theory Lecture 2 Egenvalues of Random Graphs Danel A. Spelman November 4, 202 2. Introducton In ths lecture, we consder a random graph on n vertces n whch each edge s chosen to be n the

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or Sgnal Compresson Sgnal Compresson Entropy Codng Entropy codng s also known as zero-error codng, data compresson or lossless compresson. Entropy codng s wdely used n vrtually all popular nternatonal multmeda

More information

The optimal delay of the second test is therefore approximately 210 hours earlier than =2.

The optimal delay of the second test is therefore approximately 210 hours earlier than =2. THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple

More information

SIO 224. m(r) =(ρ(r),k s (r),µ(r))

SIO 224. m(r) =(ρ(r),k s (r),µ(r)) SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small

More information

Lecture 4: Constant Time SVD Approximation

Lecture 4: Constant Time SVD Approximation Spectral Algorthms and Representatons eb. 17, Mar. 3 and 8, 005 Lecture 4: Constant Tme SVD Approxmaton Lecturer: Santosh Vempala Scrbe: Jangzhuo Chen Ths topc conssts of three lectures 0/17, 03/03, 03/08),

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo

More information

Transform Coding. Transform Coding Principle

Transform Coding. Transform Coding Principle Transform Codng Prncple of block-wse transform codng Propertes of orthonormal transforms Dscrete cosne transform (DCT) Bt allocaton for transform coeffcents Entropy codng of transform coeffcents Typcal

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information