Interference suppression in the presence of quantization errors

Size: px
Start display at page:

Download "Interference suppression in the presence of quantization errors"

Transcription

1 Forty-Seventh Annul Allerton Conference Allerton House, UIUC, Illinois, USA September - October, 009 Interference suppression in the presence of quntiztion errors Omr Bkr Mrk Johnson Rghurmn Mudumbi Upmnyu Mdhow Electricl Engineering nd Computer Sciences, UC Berkeley, Berkeley, CA 9470 Electricl nd Computer Engineering, University of Iow, Iow City, IA 54 Electricl nd Computer Engineering, UC Snt Brbr, Snt Brbr, CA 96 Emil:{ombkr, mjohnson}@eecsberkeleyedu, rmudumbi@engineeringuiowedu, mdhow@eceucsbedu Abstrct Multi-element ntenns offer the possibility of incresing the sptil reuse of wireless spectrum by nulling out interfering signls However, the interference suppression performnce is highly sensitive to smll errors in the gins pplied to the ntenn elements In this pper, we exmine in detil the effect of one specific source of error tht rises from quntizing rry weights We show tht simple pproch bsed on sclr quntiztion tht ignores the correltion of the quntiztion errors fils to fully utilize the interference suppression cpbility of the rry: the residul interference level does not decrese with the number of ntenns Unfortuntely, the optimum pproch to computing the weights involves vector quntiztion over spce tht grows exponentilly with the number of ntenns nd number of quntiztion bits, nd is therefore computtionlly intrctble We propose insted simple suboptiml method tht greedily optimizes the SIR, coefficient-by-coefficient Simultions show tht this greedy pproch provides substntil SIR gins over the nive pproch, with SIR growing polynomilly in the number of ntenns We derive nlyticl bounds tht indicte tht even lrger SIR gins (exponentil in the number of ntenns) re potentilly chievble, so tht finding trctble lgorithms tht improve upon our suboptiml pproch is n importnt open problem I INTRODUCTION The use of multiple ntenns offers the potentil of significntly improving the performnce nd cpcity of interferencelimited wireless communiction systems, with pplictions including sptil multiplexing over point-to-point link, multipcket reception, nd uncoordinted spectrum shring mong different networks Stndrd interference suppression techniques include bemforming using the zero-forcing (ZF) or liner minimum men-squred error (MMSE) criterion In modern mostly digitl trnsceiver rchitectures, bemforming is typiclly implemented digitlly, using quntized weight vectors In this pper, we exmine the effect of such coefficient quntiztion on interference suppression performnce, specificlly focusing on the performnce of quntized versions of ZF receive bemformer which steers nulls in the direction of the interfering signls Since the MMSE bemformer tends to the ZF bemformer t high signl-to-noise rtio (SNR), we expect our results to lso pply, t lest qulittively, to the Omr Bkr s reserch is sponsored by fellowship from King Abdullh University of Science nd Technology MMSE bemformer in regimes where interference, rther thn noise, is the dominnt impirment We find tht quntiztion of the bemforming weights cn drmticlly degrde interference suppression performnce if performed in nive fshion, which could severely limit our bility to exploit the lrge sptil multiplexing gins tht re theoreticlly vilble with multiple ntenns Specificlly, while the contribution of the desired signl to the bemformer output is highly robust to quntiztion error in the bemforming weights, fr more precise control of the weights is required to effectively steer nulls Indeed, it is cler tht, with probbility one, perfect nulling of even single interferer is no longer possible Wht we would still hope for, however, is tht the Signl to Interference Rtio (SIR) scles up s quickly s possible with N, the number of ntenns, nd degrdes s slowly s possible with K, the number of interferers Our min results re summrized s follows: ) A nive strtegy of coefficient-by-coefficient quntiztion of the ZF bemforming weights hs poor performnce: the SINR scles s N/K, s it would for sptil mtched filter Tht is, we obtin the combining gins for the desired signl, but incresing the number of degrees of freedom N does not led to ny improved scling in the residul interference power t the output of the bemformer ) We provide nlyticl estimtes tht indicte tht we should be ble to perform much better thn the nive strtegy An upper bound implies tht the SINR could potentilly grow exponentilly fst with N, while pessimistic estimte indictes tht the SINR should grow t lest s fst s N This motivtes the serch for improvements to the nive sclr quntiztion strtegy 3) We propose suboptiml vector quntiztion strtegy in which ech coefficient is optimized sequentilly to mximize SINR, strting from the nive solution This greedy sequentil strtegy yields substntil gins in SINR over the nive strtegy, demonstrting the polynomil growth of the kind predicted by the pessimistic nlyticl estimtes 4) We provide extensive simultion results for vrious strtegies While optiml vector quntiztion of the /09/$ IEEE 6

2 bemforming weights is computtionlly infesible for lrge N, exhustive serch for smll N is found to perform significntly better thn the greedy sequentil strtegy, possibly even leding to exponentil dependence on N Finding computtionlly efficient vector quntiztion lgorithms tht cn pproch the performnce of the optiml solution therefore remins n importnt open problem Relted Work To the best of our knowledge, this pper is the first systemtic exmintion of the effect of quntiztion of ntenn weights on interference suppression However, quntiztion in MIMO wireless systems hs been extensively studied in mny contexts in previous work The most notble exmple of this is the work on the design of codebooks in chnnels with limited chnnel-stte feedbck [], [], where the gol is to find trnsmit bemforming vectors tht mximize the desired signl contribution t the receiver This problem hs been shown to be relted to the problem of sphere-pcking in Grssmnin mnifold [3], nd the geometry of vectors on the multi-dimensionl hypersphere proves to be importnt to understnding the codebook design problem [4] Outline: In Section II, we describe simple interference suppression problem nd show tht nive sclr quntiztion incurs severe performnce penlty Section III contins nlyticl estimtes of the performnce tht cn be chieved with vector quntiztion, with optimistic estimtes predicting exponentil gins of SIR with N nd pessimistic estimtes predicting polynomil gins In Section IV, we describe n lgorithm tht cn significntly improve the performnce using greedy sequentil vector quntiztion strtegy Extensive simultion results re provided in Section V, while Section VI contins our conclusions II THE INTERFERENCE SUPPRESSION PROBLEM We begin by considering multi-ntenn receive bemforming system, where the gol is to mximize the rry gin in the direction of desired trnsmitter In this section, we nlyze the effect of errors in the choice of ntenn weights For clrity we focus on simple setup where receiver with N element ntenn rry receives the desired [ signl tht hs the (complex bsebnd) chnnel gin h 0 = h0 [], h 0 [], h 0 [N] ] nd n interfering signl with [ chnnel gin h = h [], h [], h [N] ], where the components of the chnnels h 0 nd h re drwn from iid complex Gussin distributions, ie Ryleigh fding This cn be redily generlized to multiple interferers nd to Ricin or Line-of-Sight (LOS) chnnels, nd we lter present some simultion results to show tht the sme ides extend to more generl scenrios Indeed, we give rguments tht show tht Ryleigh fding chnnel represents worst-cse scenrio when deling with quntized weights A similr nlysis lso pplies to trnsmit rry tht seeks to minimize its interference t given loctions We focus on the receive rry in this pper for clrity We will denote sclrs in lower cse, vectors in bold lower cse, nd mtrices in bold upper cse A Problem sttement We begin by presenting quick review of the theory behind the computtion of optiml bemforming weights The incoming signl t the input of the rry y[n] is the sum of the desired signl nd interference nd noise: y[n] = h 0 d[n] + h d [n] + v[n] where d[n] is the desired signl, d [n] is the interfering signl, nd v[n] is the white noise vector t the receiver with vrince For simplicity, we shll ssume tht the desired nd interfering signls hve the sme power, ie they re drwn from Ryleigh distributions with the sme vrince, which we set to unity without loss of generlity Using rry weights w, w =, the signl t the output of the rry will be w H y[n] nd the resulting output SINR is given by: SINR out = wh h 0 w H h + where ( ) H denotes the complex conjugte trnspose In the bsence of interference, the output signl to noise rtio (SNR) is mximized by choosing w opt = h 0 h 0, SNR opt = h 0 Note tht when verged over the fding chnnel gin h 0, the SNR vries s E [ SNR opt ] = E[ h 0 ] N In other words, the SNR increses linerly with the number of ntenns N Physiclly, lrger rry permits higher ntenn directivities which ccount for this increse Note tht the effective noise power w H v σv does not increse with N When n interferer is present, complete interference rejection cn be chieved by choosing bemforming weight vector w tht is the projection of the desired vector h 0 onto the subspce orthogonl to the interference vector h : () w opt = w projection = h 0 h H h h h H h 0 () If we let θ = cos ( h H h0 h 0 h ) be the ngle between the desired nd interference chnnel vectors 3, we cn write the SNR from the projection bemformer s SNR opt = h 0 sin θ When verged over the fding chnnel gins h 0, h, we still get liner increse in SNR with N: E [ SNR opt ] = E[ h 0 sin θ ] N 3 Note tht θ is n ngle in N-dimensionl spce, nd does not correspond to physicl direction (3) (4) 6

3 The finl inequlity in (4) is bsed on the observtion tht E [ sin ] θ, which is derived in Eqution (8) in Appendix I The projection-bsed bemformer () does not tke noise into ccount In generl, mximizing the output SINR does not necessrily require complete interference rejection; reducing the interference to the noise level my be sufficient Optimizing the output SINR leds to the Minimum Vrince Distortionless Response (MVDR) bemformer [5] If we define the noise+interference correltion mtrix R N+I = h h H + σνi N where I N is the N N identity mtrix, then the output SINR cn be mximized by choosing w opt : w opt = w MVDR = R N+I h 0 h H 0 R N+I h 0 The denomintor in (5) is normlizing fctor When the interference power is much lrger thn the noise power, both projection nd MVDR yield virtully identicl results This is typiclly the cse in bndwidth-limited wireless links nd we focus on this cse exclusively in this pper; therefore the resulting SINR is still pproximtely given by (3) nd its vrition with N by (4) B Effect of errors in weights In prctice the weights tht re ctully pplied to the rry elements my differ from the optiml desired weights from () for mny resons such s errors in chnnel estimtion, clibrtion errors nd quntiztion effects Let ŵ be the weight pplied to the rry We will ssume tht ŵ = (wopt+ w) (w opt+ w) where the rel nd imginry prts (in-phse nd qudrture) of ech component of the weight error vector w re iid zero men rndom vribles with vrince N σ w Remrk Since ny scled version of the vector w yields the sme SINR, we constrin w to be unit vector, ie w =, in order to eliminte this mbiguity In prctice, the weight pplied to ech ntenn element usully vries between fixed limits, eg (, ), nd this weight is quntized to fixed number of bits Thus the vrince of ech component of the quntiztion error vector w is lso fixed However, becuse of the scle invrince of the SINR, we choose to impose the unit vector constrint for nlyticl convenience (insted of the fixed dynmic rnge constrint) As result, the components of w scle s N, nd the vrince of the quntiztion noise lso scles inversely with N since quntiztion error vries proportionlly with the dynmic rnge of the elements of w itself In other words, E [ w ] = σw independent of N Intuitively, the errors w result in ŵ deviting from w opt by n ngle θ ( w = cos w optŵ ) H This devition will result in reduction in the signl strength in the desired direction s well s n increse in the interference power, since ŵ will no longer be orthogonl to the interference subspce The desired power is proportionl to cosθ w, nd the increse in interference (lekge) is proportionl to sinθ w (See Figure ) For smll ngles θ w, we cn use the stndrd pproximtions sinθ w θ w nd cosθ w This explins why nulls re more (5) sensitive thn peks to phse nd mplitude errors, since sinθ chnges more rpidly thn cosθ when θ is smll Fig The optimum bemforming vector w opt cn be viewed s projection of the desired signl onto the subspce orthogonl to the interference subspce The distorted bemforming vector ŵ opt cn be decomposed into two orthogonl components: ŵ opt = ŵopt +ŵ opt ŵ opt, which is prllel to w opt, represents the potentil loss in bemforming gin, nd is proportionl to cos θ ŵopt, which is orthogonl to wopt, represents the potentil lekge into the interference subspce, nd is proportionl to sinθ Tking the errors w into ccount, we cn updte () for the SNR in the bsence of interference s SNR = ŵh h 0 ŵ = wh opth 0 + w H h 0 SNR opt ( w ) (6) This implies tht the SNR verged over the fding still scles s N: E [ SNR ] α E [ ] SNR opt (7) with t most only constnt fctor loss α = E [ ( w ) ] ( σw ) due to the errors Now, let us consider the effect of the weight errors w on the zero-forcing bemformer in the presence of n interferer The SINR is given by ŵ H h 0 SINR = ŵ H h + ŵ σv h0 sinθ + w H h 0 = w H (8) h + ( + w )σv where θ is defined s in (3) The numertor of (8) when verged over the weight errors w nd the fding coefficients h 0 nd h is lower-bounded by N +σ w which scles linerly with N, nd the verged denomintor equls σw +(+σ w )σ v, which is independent of N Thus the rtio of verge signl to interference nd noise powers scles linerly with N This seems good considering tht the SNR in the no-interferer cse given by (7) lso scles linerly with N Note however tht the verge interference power given by the denomintor of (8) does not decrese with N even though the degrees of freedom for interference 63

4 cncelltion increses This is strkly unlike the sitution without weight errors, where lrger number of ntenns permits the complete nulling of lrger number of interferers This indictes tht there might be some suboptimlity in the scling behvior in (8) We show next tht, indeed, much better scling behvior cn be obtined by dopting more optiml pproch III IMPROVING INTERFERENCE SUPPRESSION We now consider the problem of computing the optiml weights in the presence of quntiztion errors Let us represent the i th component of vector x by x[i], eg the weight pplied to ntenn element i is w[i] Let B be the number of quntiztion bits, ie the I nd Q components of ech weight element is quntized to one of B levels There re then N w = BN totl weights vilble from which to choose 4 Let W be the set of these weight vectors We cn then formulte the problem of computing the optiml weight s SINR mximiztion problem: ŵ H h 0 w opt = rg mx ŵ W ŵ H h + ŵ σv Remrk It is not trivil tsk to compre two lgorithms bsed on their SINR performnce If one lgorithm outperforms nother for every possible reliztion of the desired nd interference chnnels, then it is clerly better However, such definition is too stringent to be useful, nd in prctice, we my hve to settle for compring some verges At first glnce, it seems s if the nturl choice would be to compre the verge SINR, ie E [ SINR ] ; however this mesure suffers from some fundmentl disdvntges First of ll, it is rther unwieldy nlyticlly Secondly, the verge cn be dominted by smll number of chnnel reliztions where the SINR becomes very lrge We therefore choose different mesure: the rtio of verge signl power to verge interference power (we neglect noise): SINR = E[ ŵh h 0 ] E[ ŵ H h ] A An pproximte lower bound on chievble SIR The problem of choosing the optiml weight w cn lso be considered s problem of choosing the optiml w We hve seen from (8) tht the verge signl power scles linerly with N in the presence of the errors w However, s we hve seen, the verge interference power is independent of N if the components of w re chosen independently We show next tht if the components of w re chosen dependently of ech other, the interference power cn be mde to decrese significntly with N Given n interference vector h, our gol is to understnd the term w H h Let us first consider simpler problem For n interference vector h, suppose we simply wish to minimize u H h, where u tkes ll possible vlues in U = 4 Note tht some of these weight vectors my be scled versions of others, nd therefore N w is ctully n upper-bound on the number of distinct weight vectors vilble to choose from N {, +} N (ie the elements of U re binry vectors normlized to unit norm) Let Z(u) = u H h Note tht Z(u) CN(0, ) for ny u U since the fding coefficients of h re ssumed to be CN(0, ) Note lso tht Z(u ), Z(u ) re jointly proper complex Gussin with covrince (nd normlized correltion) equl to u H u Let us now choose subset U o of U which forms n orthonorml bsis in N dimensions: the Wlsh-Hdmrd codes Then {Z(u) : u U o } re N uncorrelted, nd hence independent, CN(0, ) rndom vribles The corresponding powers { Z(u),u U o } re therefore exponentil rndom vribles with men one The minimum interference power cn now be upper bounded s P min = min u U Z(u) min u U o Z(u) (9) It is esy to show tht the minimum of N iid exponentil rndom vribles of men one is n exponentil rndom vrible with men N Thus, for our simplified model, the interference power scles down t lest s fst s N with N Let us now return to our originl problem Consider Z( w) w H h For ech coefficient of the ZF weight vector, suppose tht we restrict ourselves to two options: round both I nd Q coefficients up or round them both down Thus, if the quntiztion intervl is, the corresponding coefficient of w is being set to ( X) or X, respectively, where X is the distnce of the unquntized coefficient from the bottomleft edge of the quntiztion bin in which it flls Thus, if we let + indicte rounding down coefficient, nd - indicte rounding up, there re N possible choices of w with this strtegy, which mp to the vectors in U = N {, +} N considered in our prior simplified exmple While the Wlsh- Hdmrd vectors u i no longer yield uncorrelted Gussin rndom vribles Z(b i ) when the distribution of the X s re tken into ccount, since U is n N-dimensionl vector spce, it is lwys possible to find set of bsis vectors v i which yield uncorrelted rndom vribles Z(v i ) nd for which (9) holds This leds us to expect tht the minimum interference power here will lso fll off t lest s fst s N B A geometric upper-bound on chievble SIR Consider the N-dimensionl hypersphere generted by the I nd Q coefficients of the unit vector x corresponding to the weight errors, ie x = w [ R( w[]), I( w[]), R( w[]), I( w[]), ] We wnt to choose x so s to minimize the interference power given by w H h w x H h, from the set X of vilble vectors x: x opt = rg min x X xh h (0) We cn lso obtin n upper-bound on the chievble SIR by ssuming tht the vector x tht minimizes the interference power lso simultneously chieves the mximum possible signl power Intuitively, when the number of ntenns increses, we expect the minimum interference power s given in (0) to 64

5 decrese for two resons First, s the dimensionlity of the vector spce of the weight vectors increses, rndomly chosen vector is more orthogonl to the interference vector (this is explined more precisely in Appendix I) Second, the number of quntized weight vectors to choose from increses exponentilly with N We now quntify these fctors nd obtin n upper bound on the interference suppression cpbility of n rry Without loss of generlity, we ssume tht the interference vector h is ligned with one of the coordinte xes Let θ x = θ x Our be the ngle between h nd x nd let φ x gol is to find x such tht φ x is s smll s possible If x is chosen rndomly nd uniformly on the unit hypersphere, the probbility density function of φ x is given by (see Appendix I): f φ (φ x ) = cos N φ ( x F, 3 N ; 3 () ; ) where F (, ; ; ) is the Guss hypergeometric function [6] Consider the cumultive distribution function corresponding to () given by F φ (φ) = Pr( φ x φ) φ φ f φ (φ x )dφ x From (6) we hve tht F φ (φ) is n incresing function of N for ny φ [0, ] Thus we hve F φ (φ) F 0 (φ) φ () Finlly if ll N w BN vilble weight vectors re ssumed to be distributed uniformly over the surfce of the unit hypersphere, there exists t lest one vector x such tht F φ (φ x ) N w Therefore using () we conclude tht t lest one weight vector x exists such tht φ x N w +BN (3) nd the verge interference power corresponding to this vector x is upper-bounded by E [ h w sin φ x ] σ w 4BN which decreses exponentilly with N The key ssumption in the bove derivtion is tht the vilble weight vectors x re distributed uniformly over the hypersphere with respect to ny rbitrry interference vector h This ssumption is too optimistic; more relistic ssumption is tht the weight vectors re uniformly distributed over hypercube Intuitively there re very few sprse weight vectors in X, wheres most vilble vectors hve significnt (non-zero) coefficients over lrge proportion of ntenn elements Thus for instnce n interference vector tht is highly sprse is difficult to suppress To tke n extreme exmple, n interference vector tht is zero everywhere except single ntenn element will be difficult to suppress 5 5 This is dependent on the ssumption tht none of the weight vectors in the codebook contin coefficients equl to zero Therefore it is not cler how tight the bound in (3) is Also, the bove resoning leds us to expect tht the verge interference suppression performnce will depend strongly on the fding distribution, eg the Ryleigh distribution is more likely to give unblnced or sprse vectors thn line-ofsight distribution We leve more detiled explortion of these ides to future work IV CONSTRUCTIVE ALGORITHMS FOR INTERFERENCE SUPPRESSION We hve seen tht the nive pproch to quntizing the ntenn weight vector, bsed on pplying sclr quntizer to ech coefficient independently, does not chieve the optimum interference suppression On the other hnd, becuse there is totl of BN possible quntized vectors, implementing n optiml vector quntizer by exhustively serching through the set of reconstruction levels hs computtionl cost tht is exponentil in the number of ntenns nd the number of quntiztion bits Thus, vector quntiztion by exhustive serch is infesible in prcticl scenrios We propose insted simple, suboptiml vector quntiztion scheme which is bsed on coordinte descent optimiztion This scheme substntilly improves over the nive method, yet hs computtionl cost tht is liner in the number of ntenns The suboptiml scheme greedily quntizes the weight vector by serching through the set of reconstruction levels for ech element individully, insted of jointly s in the exhustive serch lgorithm We begin by computing n initil weight vector This cn be done in severl wys, such s pplying sclr quntizer to the optiml MVDR weights given by (5), pplying sclr quntizer to the desired chnnel response h 0 (mtched filter), or even rndomly drwing vector from the set of vlid quntized weights Our simultions show tht initilizing with quntized version of the optiml weights or the mtched filter yield fr superior results to using rndom initiliztion In most of our simultions, we used the mtched filter Next, we serch through ll B vlid reconstruction levels of the first coefficient, while keeping the other N coefficients fixed The vlue which mximizes the output SINR is chosen s the quntized vlue of the first coefficient We then proceed to quntize the second coefficient, keeping the first coefficient fixed t its quntized vlue nd coefficients 3 through N fixed t their initil vlues, by similr serch This method is pplied to ech of the N coefficients of w, yielding suboptiml, vector quntized weight vector The coordinte descent quntizer hs computtionl cost of N B We note tht the output of this quntizer depends on both the method of selecting the initil vector nd the order in which the coefficients re quntized V SIMULATION RESULTS In this section, we provide numericl results tht verify the nlysis of this pper, nd compre the performnce of the vrious quntiztion schemes 65

6 A Generl errors in ntenn weights Figure () demonstrtes the reltionship between interference power fter bem-nulling nd the men squre error in the ntenn weights The plot compres the cse where independent Gussin noise is dded to the rel nd imginry components of the optiml weight vector to the cse where the noise is dded to the mgnitude nd phse, s well s compring the Ryleigh nd LOS chnnels In this simultion there were N = 00 ntenns nd K = 0 interferers The results show tht the interference lekge is directly proportionl to the totl error power, nd does not depend on whether the error is modeled s dditive in the Crtesin or polr coordintes The chnnel hs very little effect on the performnce B Sclr quntiztion of ntenn weights In this section, we present numericl results of the nive, sclr quntiztion scheme With sclr quntiztion, the vrince of the quntiztion noise grows s σ w B nd therefore the SIR is proportionl to N K B Figure (b) shows the SIR (normlized by the number of ntenns, N) s function of N, with the number of interferers fixed t K = 0 nd the quntizer size fixed t B = 4 bits Figure (c) shows the SIR (multiplied by K) s function of K, with N = 000 nd B = 4 These plots demonstrte tht the SIR is linerly proportionl to N/K for the sclr quntiztion method The slight downwrd slope in (c) is due to the fct tht for fixed number of ntenns, s the dimension of the interference subspce increses more of the desired signl lies in tht subspce Hence, the signl power tht is orthogonl to the interference begins to decrese Figure (d) shows the SIR s function of B, with N = 000 nd K = 0 The slope of the curve closely mtches the predicted gin of 6dB for ech quntiztion bit C Vector quntiztion of ntenn weights We lso simulted the coordinte descent vector quntizer, to quntify the performnce nd demonstrte the gins over sclr quntiztion While it is difficult to extrpolte the exct dependence of the SIR on the vribles, N, K, nd B (or if they re even seprble); the generl trend seems to show tht the SIR grows polynomilly in N, polynomilly in K, nd exponentilly in B Figure 3() shows the SIR s function of the number of ntenns, for vrious chnnels nd quntizer bit rtes,with K = 5 interferers The quntizer ws initilized by pplying sclr quntizer to the mtched filter In contrst to the simulted performnce of the sclr quntizer in Figure (b) where SIR/N ws constnt, we see tht for the coordinte descent vector quntizer SIR/N grows super-linerly Thus, the SIR grows fster thn qudrticlly with the number of ntenns Figure 3(b) shows tht the verge interference power (scled by the number of ntenns) is slightly decresing in the sme simultion Thus, the verge interference power with vector quntiztion decreses slightly fster thn linerly with N This is in contrst to the sclr quntizer, where the interference power ws constnt Therefore, the signl strength continues to grow linerly Thus, the coordinte descent method does not cuse significnt reduction in SNR Figure 3(c) shows the quntity K SIR s function of the number of interferers K, with N = 00 ntenns nd B = bit quntizer The plot shows tht the SIR is decresing slightly fster thn by fctor of /K Tken together, Figures 3() nd (c) imply tht for the coordinte descent vector quntizer, the SIR is proportionl to (N/K) α, with α slightly greter thn Recll tht with sclr quntiztion the SIR ws proportionl to N/K The functionl dependence of SIR on N nd K through the rtio N/K is corroborted by Figure 3(d), which shows tht the SIR is constnt when N is vried nd K is set to N/4 The dependence of the coordinte descent method on the number of quntiztion bits is presented in Figure 3(e) Just s in sclr quntiztion, the SIR grows exponentilly in the bit rte, with gin of pproximtely 6 db per bit Finlly, we lso simulted the performnce of the exhustive serch vector quntizer Figure 3(g) shows the SIR in db s function of N, with K = nd one bit quntiztion Figure 3(h) shows the SIR in db s function of K, with N = 0 nd B = bit quntiztion While the computtionl complexity of the exhustive serch method presents n obstcle to providing more extensive simultions, it ppers tht the SIR (in liner units) grows exponentilly in N nd decreses exponentilly in K Thus, there my still be significnt gp between this optiml vector quntizer nd the coordinte descent lgorithm, where SIR grew polynomilly in N/K This potentil gin motivtes future work on computtionlly efficient vector quntizers tht outperform coordinte descent D Bemforming gin While we hve focused in this work on the effect of vrious quntiztion schemes on SIR, the bemforming gin cn lso be improved Figure (e) shows the normlized rry gin of the sclr quntizer, s well s the exhustive serch nd coordinte descent vector quntizers, when ll phses were quntized to two levels The gp between vector nd sclr quntiztion is smller becuse bemforming is more robust to errors thn interference rejection, nd thus the nive method does not incur lrge penlty E Effect of noise Up to this point, we hve neglected ll sources of error other thn quntiztion However, in prctice there my be smll dditionl noise due to vrious hrdwre imperfections or therml vritions Figure 3(f) shows the SIR s function of the vrince of uniform rndom vrible tht is dded to ech component of the ntenn weight vector fter quntiztion The plot shows tht the performnce of the coordinte descent method is still superior to the nive sclr quntiztion scheme VI CONCLUSION We hve shown tht coefficient quntiztion in digitl receiver implementtions cn hve profound effect on the 66

7 verge interferer power (db) IQ error/ryleigh Phse-Amp error/ryleigh IQ error/los Phse-Amp error/los SIR/N (db) K* σ w (db) number of interferers (K) () (b) (c) normlized rry gin sclr quntizer exhustive serch vector quntizer coordinte descent vector quntizer number of bits (B) (d) (e) Fig () Simulted interference power s function of errors in the weight vector (b)-(d) Simulted effect of sclr quntiztion on the performnce of the MVDR bemnulling scheme s function of the number of ntenns N, the number of interferers K, nd the number of quntiztion bits B (e) Comprison of the bemforming gin with sclr, exhustive serch vector, nd coordinte descent vector quntizers performnce of interference-limited multi-ntenn systems In prticulr, quntiztion of bemforming weights criticlly ffects interference suppression performnce, nd must be performed crefully in order to exploit the degrees of freedom gins from using n incresed number of ntenns While our suboptiml greedy sequentil strtegy provides lrge gins over the nive sclr quntiztion strtegy, our nlyticl estimtes indicte tht it might be possible to do much better Importnt open problems include refinement of the nlysis to provide tight upper nd lower bounds on SIR scling, nd devising efficient dptive nd non-dptive lgorithms for finding the quntized weights tht pproch the performnce of the optiml quntized weights APPENDIX I DISTRIBUTION OF THE ANGLE WITH RESPECT TO AN INTERFERENCE VECTOR We strt with the well-known formul for the re of surfce element of d-dimensionl unit hypersphere [7], [8]: ds = sin d θ d dθ d sin d 3 θ d 3 dθ d 3 sinθ dθ dθ 0 where θ d, θ d 3,, θ, θ 0 re the d ngulr coordintes of the hyper-sphericl coordinte system If we ssume (without loss of generlity) tht the interference vector is ligned with one of the coordinte xes, then θ x θ d is the ngle mde by the unit vector x on the surfce element bove with the interference vector If the unit vector is ssumed to be distributed uniformly on the surfce of the hypersphere, then the probbility density of the ngle is proportionl to the re element ie f θ (θ x ) sin d θ d It is more convenient for us to work with the trnsformed ngle φ x = θ x, nd we then hve for the probbility density of φ x : f φ (φ x ) = sin d ( φ ) x sin d ( φ ) x dφx cos d φ x 0 sind φ x dφ x Define I n (t) = t 0 sinn x dx We hve the identity ( I n (t) cost F, n ; 3 ; cos t ) where F (, ; ; ) is the Guss hypergeometric function However, it is more convenient to use the recursive formul: I n (t) sinn t cost n We then hve Pr( φ x φ) = Pr ( φ < φ x From (4), we hve I n ( ) n (4) in (5) we hve + n n I n (t) (4) n I n ( ) = I n (φ) I n ( ) (5) ), nd further using Pr( φ x φ) = sinn φcosφ ( (n )I n ( ) + I ) n (φ) I n ( ) (6) We see from (6) tht the cumultive probbility distribution (CDF) of φ x, F (n) (φ) = Pr( φ x φ) is n incresing function of n From this, we hve Pr( φ x φ) > φ x Finlly we hve the following lemm: Lemm Let F (x), F (x) be two probbility distributions 67

8 SIR/N bit coordinte descent/ryleigh -bit coordinte descent/ryleigh -bit coordinte descent/los 0log(N*(verge interferer power)) bit coordinte descent/ryleigh -bit coordinte descent/los SIR*K (db) bit coordinte-descent/ryleigh -bit coordinte-descent/los bit coordinte descent/los -bit coordinte descent/ryleigh number of interferers (K) () (b) (c) 45 coordinte descent/ryleigh 8 -bit coordinte descent -bit sclr quntizer number of ntenns (N=4K) number of bits (B) noise (db) (d) (e) (f) 90 -bit exhustive serch/los -bit exhustive serch/los (g) number of interferers (K) (h) Fig 3 ()-(f) Simulted performnce of the coordinte descent vector quntizer (g)-(h) Simulted performnce of the exhustive serch vector quntizer (CDFs) in n intervl [, b] such tht F (x) F (x), x [, b] nd let g(x) be non-incresing, differentible function in [, b] Then E F [g(x)] E F [g(x)] Proof Since g(x) is non-incresing, differentible function, we hve g (x) 0, x [, b] Consider E F [g(x)] = = b g(x)df (x) [ g(x)f (x) g(b) g(b) ] b b b b g (x)f (x) dx g (x)f (x) dx (7) g (x)f (x) dx E F [g(x)] where we used integrtion by prts in (7) From the bove lemm with g(x) = cos x in [0, ] nd (6) then n < n we get E F (n )[sin θ x ] E F (n )[cos φ x ] < E F (n )[sin θ x ] (8) REFERENCES [] D J Love, R W Heth, W Sntipch, nd M L Honig, Wht is the vlue of limited feedbck for MIMO chnnels? IEEE Communictions Mgzine, vol 4, no 0, pp 54 59, October 004 [] K Mukkvilli, A Sbhrwl, B Azhng, nd E Erkip, Performnce limits on bemforming with finite rte feedbck for multiple ntenn systems, in Thirty-Sixth Asilomr Conference on Signls, Systems nd Computers, vol, November 00, pp [3] L Zheng nd D N C Tse, Sphere pcking in the Grssmnn mnifold: geometric pproch to the noncoherent multi-ntenn chnnel, in IEEE Interntionl Symposium on Informtion Theory, June 000, p 364 [4] D J Love nd R W Heth, Multi-mode precoding using liner receivers for limited feedbck MIMO systems, in IEEE Interntionl Conference on Communictions, vol, June 004, pp [5] D Mnolkis, V Ingle, nd S Kogon, Sttisticl nd Adptive Signl Processing: Spectrl Estimtion, Signl Modeling, Adptive Filtering nd Arry Processing McGrw-Hill, 000 [6] E W Weisstein, Hypergeometric function, Wolfrm MthWorld [Online] Avilble: html [7] J S Hicks nd R F Wheeling, An efficient method for generting uniformly distributed points on the surfce of n n-dimensionl sphere, Communictions of the ACM, vol, no 4, pp 7 9, 959 [8] Hypergeometric function, Mthemtics Wiki [Online] Avilble: http: //wwwmthemticsthetngentbundlenet/wiki/sphericl\ coordintes If we set n = 0, this gives E F (n)[sin θ x ] > 68

Review of Calculus, cont d

Review of Calculus, cont d Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some

More information

Interference suppression in the presence of quantization errors

Interference suppression in the presence of quantization errors Interference suppression in the presence of quantization errors Omar Bakr Mark Johnson Raghuraman Mudumbai Upamanyu Madhow Electrical Engineering and Computer Sciences, UC Berkeley, Berkeley, CA 947 Electrical

More information

Numerical integration

Numerical integration 2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter

More information

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by. NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with

More information

CMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature

CMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature CMDA 4604: Intermedite Topics in Mthemticl Modeling Lecture 19: Interpoltion nd Qudrture In this lecture we mke brief diversion into the res of interpoltion nd qudrture. Given function f C[, b], we sy

More information

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn

More information

Lecture 14: Quadrature

Lecture 14: Quadrature Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl

More information

Math 1B, lecture 4: Error bounds for numerical methods

Math 1B, lecture 4: Error bounds for numerical methods Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the

More information

Review of Gaussian Quadrature method

Review of Gaussian Quadrature method Review of Gussin Qudrture method Nsser M. Asi Spring 006 compiled on Sundy Decemer 1, 017 t 09:1 PM 1 The prolem To find numericl vlue for the integrl of rel vlued function of rel vrile over specific rnge

More information

p-adic Egyptian Fractions

p-adic Egyptian Fractions p-adic Egyptin Frctions Contents 1 Introduction 1 2 Trditionl Egyptin Frctions nd Greedy Algorithm 2 3 Set-up 3 4 p-greedy Algorithm 5 5 p-egyptin Trditionl 10 6 Conclusion 1 Introduction An Egyptin frction

More information

Math 270A: Numerical Linear Algebra

Math 270A: Numerical Linear Algebra Mth 70A: Numericl Liner Algebr Instructor: Michel Holst Fll Qurter 014 Homework Assignment #3 Due Give to TA t lest few dys before finl if you wnt feedbck. Exercise 3.1. (The Bsic Liner Method for Liner

More information

New Expansion and Infinite Series

New Expansion and Infinite Series Interntionl Mthemticl Forum, Vol. 9, 204, no. 22, 06-073 HIKARI Ltd, www.m-hikri.com http://dx.doi.org/0.2988/imf.204.4502 New Expnsion nd Infinite Series Diyun Zhng College of Computer Nnjing University

More information

W. We shall do so one by one, starting with I 1, and we shall do it greedily, trying

W. We shall do so one by one, starting with I 1, and we shall do it greedily, trying Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)

More information

Best Approximation. Chapter The General Case

Best Approximation. Chapter The General Case Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given

More information

The Regulated and Riemann Integrals

The Regulated and Riemann Integrals Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue

More information

The steps of the hypothesis test

The steps of the hypothesis test ttisticl Methods I (EXT 7005) Pge 78 Mosquito species Time of dy A B C Mid morning 0.0088 5.4900 5.5000 Mid Afternoon.3400 0.0300 0.8700 Dusk 0.600 5.400 3.000 The Chi squre test sttistic is the sum of

More information

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz

More information

Numerical Analysis: Trapezoidal and Simpson s Rule

Numerical Analysis: Trapezoidal and Simpson s Rule nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =

More information

Data Assimilation. Alan O Neill Data Assimilation Research Centre University of Reading

Data Assimilation. Alan O Neill Data Assimilation Research Centre University of Reading Dt Assimiltion Aln O Neill Dt Assimiltion Reserch Centre University of Reding Contents Motivtion Univrite sclr dt ssimiltion Multivrite vector dt ssimiltion Optiml Interpoltion BLUE 3d-Vritionl Method

More information

Lecture 19: Continuous Least Squares Approximation

Lecture 19: Continuous Least Squares Approximation Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for

More information

Math 426: Probability Final Exam Practice

Math 426: Probability Final Exam Practice Mth 46: Probbility Finl Exm Prctice. Computtionl problems 4. Let T k (n) denote the number of prtitions of the set {,..., n} into k nonempty subsets, where k n. Argue tht T k (n) kt k (n ) + T k (n ) by

More information

Exam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1

Exam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1 Exm, Mthemtics 471, Section ETY6 6:5 pm 7:4 pm, Mrch 1, 16, IH-115 Instructor: Attil Máté 1 17 copies 1. ) Stte the usul sufficient condition for the fixed-point itertion to converge when solving the eqution

More information

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS. THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem

More information

5.7 Improper Integrals

5.7 Improper Integrals 458 pplictions of definite integrls 5.7 Improper Integrls In Section 5.4, we computed the work required to lift pylod of mss m from the surfce of moon of mss nd rdius R to height H bove the surfce of the

More information

Best Approximation in the 2-norm

Best Approximation in the 2-norm Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion

More information

1 Online Learning and Regret Minimization

1 Online Learning and Regret Minimization 2.997 Decision-Mking in Lrge-Scle Systems My 10 MIT, Spring 2004 Hndout #29 Lecture Note 24 1 Online Lerning nd Regret Minimiztion In this lecture, we consider the problem of sequentil decision mking in

More information

221B Lecture Notes WKB Method

221B Lecture Notes WKB Method Clssicl Limit B Lecture Notes WKB Method Hmilton Jcobi Eqution We strt from the Schrödinger eqution for single prticle in potentil i h t ψ x, t = [ ] h m + V x ψ x, t. We cn rewrite this eqution by using

More information

Continuous Random Variables

Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht

More information

MATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1

MATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1 MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further

More information

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus Unit #9 : Definite Integrl Properties; Fundmentl Theorem of Clculus Gols: Identify properties of definite integrls Define odd nd even functions, nd reltionship to integrl vlues Introduce the Fundmentl

More information

The Wave Equation I. MA 436 Kurt Bryan

The Wave Equation I. MA 436 Kurt Bryan 1 Introduction The Wve Eqution I MA 436 Kurt Bryn Consider string stretching long the x xis, of indeterminte (or even infinite!) length. We wnt to derive n eqution which models the motion of the string

More information

221A Lecture Notes WKB Method

221A Lecture Notes WKB Method A Lecture Notes WKB Method Hmilton Jcobi Eqution We strt from the Schrödinger eqution for single prticle in potentil i h t ψ x, t = [ ] h m + V x ψ x, t. We cn rewrite this eqution by using ψ x, t = e

More information

Monte Carlo method in solving numerical integration and differential equation

Monte Carlo method in solving numerical integration and differential equation Monte Crlo method in solving numericl integrtion nd differentil eqution Ye Jin Chemistry Deprtment Duke University yj66@duke.edu Abstrct: Monte Crlo method is commonly used in rel physics problem. The

More information

Chapter 3 Polynomials

Chapter 3 Polynomials Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling

More information

Lecture 1. Functional series. Pointwise and uniform convergence.

Lecture 1. Functional series. Pointwise and uniform convergence. 1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is

More information

Predict Global Earth Temperature using Linier Regression

Predict Global Earth Temperature using Linier Regression Predict Globl Erth Temperture using Linier Regression Edwin Swndi Sijbt (23516012) Progrm Studi Mgister Informtik Sekolh Teknik Elektro dn Informtik ITB Jl. Gnesh 10 Bndung 40132, Indonesi 23516012@std.stei.itb.c.id

More information

Taylor Polynomial Inequalities

Taylor Polynomial Inequalities Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil

More information

Fig. 1. Open-Loop and Closed-Loop Systems with Plant Variations

Fig. 1. Open-Loop and Closed-Loop Systems with Plant Variations ME 3600 Control ystems Chrcteristics of Open-Loop nd Closed-Loop ystems Importnt Control ystem Chrcteristics o ensitivity of system response to prmetric vritions cn be reduced o rnsient nd stedy-stte responses

More information

Numerical Integration

Numerical Integration Chpter 5 Numericl Integrtion Numericl integrtion is the study of how the numericl vlue of n integrl cn be found. Methods of function pproximtion discussed in Chpter??, i.e., function pproximtion vi the

More information

X Z Y Table 1: Possibles values for Y = XZ. 1, p

X Z Y Table 1: Possibles values for Y = XZ. 1, p ECE 534: Elements of Informtion Theory, Fll 00 Homework 7 Solutions ll by Kenneth Plcio Bus October 4, 00. Problem 7.3. Binry multiplier chnnel () Consider the chnnel Y = XZ, where X nd Z re independent

More information

Week 10: Line Integrals

Week 10: Line Integrals Week 10: Line Integrls Introduction In this finl week we return to prmetrised curves nd consider integrtion long such curves. We lredy sw this in Week 2 when we integrted long curve to find its length.

More information

4.4 Areas, Integrals and Antiderivatives

4.4 Areas, Integrals and Antiderivatives . res, integrls nd ntiderivtives 333. Ares, Integrls nd Antiderivtives This section explores properties of functions defined s res nd exmines some connections mong res, integrls nd ntiderivtives. In order

More information

3.4 Numerical integration

3.4 Numerical integration 3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,

More information

8 Laplace s Method and Local Limit Theorems

8 Laplace s Method and Local Limit Theorems 8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved

More information

Recitation 3: More Applications of the Derivative

Recitation 3: More Applications of the Derivative Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech

More information

Math 8 Winter 2015 Applications of Integration

Math 8 Winter 2015 Applications of Integration Mth 8 Winter 205 Applictions of Integrtion Here re few importnt pplictions of integrtion. The pplictions you my see on n exm in this course include only the Net Chnge Theorem (which is relly just the Fundmentl

More information

Abstract inner product spaces

Abstract inner product spaces WEEK 4 Abstrct inner product spces Definition An inner product spce is vector spce V over the rel field R equipped with rule for multiplying vectors, such tht the product of two vectors is sclr, nd the

More information

g i fφdx dx = x i i=1 is a Hilbert space. We shall, henceforth, abuse notation and write g i f(x) = f

g i fφdx dx = x i i=1 is a Hilbert space. We shall, henceforth, abuse notation and write g i f(x) = f 1. Appliction of functionl nlysis to PEs 1.1. Introduction. In this section we give little introduction to prtil differentil equtions. In prticulr we consider the problem u(x) = f(x) x, u(x) = x (1) where

More information

1 The Lagrange interpolation formula

1 The Lagrange interpolation formula Notes on Qudrture 1 The Lgrnge interpoltion formul We briefly recll the Lgrnge interpoltion formul. The strting point is collection of N + 1 rel points (x 0, y 0 ), (x 1, y 1 ),..., (x N, y N ), with x

More information

Advanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004

Advanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004 Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when

More information

Chapter 5 : Continuous Random Variables

Chapter 5 : Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll

More information

Tests for the Ratio of Two Poisson Rates

Tests for the Ratio of Two Poisson Rates Chpter 437 Tests for the Rtio of Two Poisson Rtes Introduction The Poisson probbility lw gives the probbility distribution of the number of events occurring in specified intervl of time or spce. The Poisson

More information

13: Diffusion in 2 Energy Groups

13: Diffusion in 2 Energy Groups 3: Diffusion in Energy Groups B. Rouben McMster University Course EP 4D3/6D3 Nucler Rector Anlysis (Rector Physics) 5 Sept.-Dec. 5 September Contents We study the diffusion eqution in two energy groups

More information

STUDY GUIDE FOR BASIC EXAM

STUDY GUIDE FOR BASIC EXAM STUDY GUIDE FOR BASIC EXAM BRYON ARAGAM This is prtil list of theorems tht frequently show up on the bsic exm. In mny cses, you my be sked to directly prove one of these theorems or these vrints. There

More information

An approximation to the arithmetic-geometric mean. G.J.O. Jameson, Math. Gazette 98 (2014), 85 95

An approximation to the arithmetic-geometric mean. G.J.O. Jameson, Math. Gazette 98 (2014), 85 95 An pproximtion to the rithmetic-geometric men G.J.O. Jmeson, Mth. Gzette 98 (4), 85 95 Given positive numbers > b, consider the itertion given by =, b = b nd n+ = ( n + b n ), b n+ = ( n b n ) /. At ech

More information

Tutorial 4. b a. h(f) = a b a ln 1. b a dx = ln(b a) nats = log(b a) bits. = ln λ + 1 nats. = log e λ bits. = ln 1 2 ln λ + 1. nats. = ln 2e. bits.

Tutorial 4. b a. h(f) = a b a ln 1. b a dx = ln(b a) nats = log(b a) bits. = ln λ + 1 nats. = log e λ bits. = ln 1 2 ln λ + 1. nats. = ln 2e. bits. Tutoril 4 Exercises on Differentil Entropy. Evlute the differentil entropy h(x) f ln f for the following: () The uniform distribution, f(x) b. (b) The exponentil density, f(x) λe λx, x 0. (c) The Lplce

More information

1 Linear Least Squares

1 Linear Least Squares Lest Squres Pge 1 1 Liner Lest Squres I will try to be consistent in nottion, with n being the number of dt points, nd m < n being the number of prmeters in model function. We re interested in solving

More information

ECO 317 Economics of Uncertainty Fall Term 2007 Notes for lectures 4. Stochastic Dominance

ECO 317 Economics of Uncertainty Fall Term 2007 Notes for lectures 4. Stochastic Dominance Generl structure ECO 37 Economics of Uncertinty Fll Term 007 Notes for lectures 4. Stochstic Dominnce Here we suppose tht the consequences re welth mounts denoted by W, which cn tke on ny vlue between

More information

Theoretical foundations of Gaussian quadrature

Theoretical foundations of Gaussian quadrature Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of

More information

Student Activity 3: Single Factor ANOVA

Student Activity 3: Single Factor ANOVA MATH 40 Student Activity 3: Single Fctor ANOVA Some Bsic Concepts In designed experiment, two or more tretments, or combintions of tretments, is pplied to experimentl units The number of tretments, whether

More information

Hybrid Digital-Analog Coding for Interference Broadcast Channels

Hybrid Digital-Analog Coding for Interference Broadcast Channels Hybrid Digitl-Anlog Coding for Interference Brodcst Chnnels Ahmd Abou Sleh, Fdy Aljji, nd Wi-Yip Chn Queen s University, ingston, O, 7L 36 Emil: hmd.bou.sleh@queensu.c, fdy@mst.queensu.c, chn@queensu.c

More information

Improper Integrals. Type I Improper Integrals How do we evaluate an integral such as

Improper Integrals. Type I Improper Integrals How do we evaluate an integral such as Improper Integrls Two different types of integrls cn qulify s improper. The first type of improper integrl (which we will refer to s Type I) involves evluting n integrl over n infinite region. In the grph

More information

A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007

A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007 A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H Thoms Shores Deprtment of Mthemtics University of Nebrsk Spring 2007 Contents Rtes of Chnge nd Derivtives 1 Dierentils 4 Are nd Integrls 5 Multivrite Clculus

More information

Conservation Law. Chapter Goal. 5.2 Theory

Conservation Law. Chapter Goal. 5.2 Theory Chpter 5 Conservtion Lw 5.1 Gol Our long term gol is to understnd how mny mthemticl models re derived. We study how certin quntity chnges with time in given region (sptil domin). We first derive the very

More information

Jim Lambers MAT 169 Fall Semester Lecture 4 Notes

Jim Lambers MAT 169 Fall Semester Lecture 4 Notes Jim Lmbers MAT 169 Fll Semester 2009-10 Lecture 4 Notes These notes correspond to Section 8.2 in the text. Series Wht is Series? An infinte series, usully referred to simply s series, is n sum of ll of

More information

UNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3

UNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 UNIFORM CONVERGENCE Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 Suppose f n : Ω R or f n : Ω C is sequence of rel or complex functions, nd f n f s n in some sense. Furthermore,

More information

Multi-Armed Bandits: Non-adaptive and Adaptive Sampling

Multi-Armed Bandits: Non-adaptive and Adaptive Sampling CSE 547/Stt 548: Mchine Lerning for Big Dt Lecture Multi-Armed Bndits: Non-dptive nd Adptive Smpling Instructor: Shm Kkde 1 The (stochstic) multi-rmed bndit problem The bsic prdigm is s follows: K Independent

More information

Lecture Note 9: Orthogonal Reduction

Lecture Note 9: Orthogonal Reduction MATH : Computtionl Methods of Liner Algebr 1 The Row Echelon Form Lecture Note 9: Orthogonl Reduction Our trget is to solve the norml eution: Xinyi Zeng Deprtment of Mthemticl Sciences, UTEP A t Ax = A

More information

In-Class Problems 2 and 3: Projectile Motion Solutions. In-Class Problem 2: Throwing a Stone Down a Hill

In-Class Problems 2 and 3: Projectile Motion Solutions. In-Class Problem 2: Throwing a Stone Down a Hill MASSACHUSETTS INSTITUTE OF TECHNOLOGY Deprtment of Physics Physics 8T Fll Term 4 In-Clss Problems nd 3: Projectile Motion Solutions We would like ech group to pply the problem solving strtegy with the

More information

Non-Linear & Logistic Regression

Non-Linear & Logistic Regression Non-Liner & Logistic Regression If the sttistics re boring, then you've got the wrong numbers. Edwrd R. Tufte (Sttistics Professor, Yle University) Regression Anlyses When do we use these? PART 1: find

More information

Numerical Integration. 1 Introduction. 2 Midpoint Rule, Trapezoid Rule, Simpson Rule. AMSC/CMSC 460/466 T. von Petersdorff 1

Numerical Integration. 1 Introduction. 2 Midpoint Rule, Trapezoid Rule, Simpson Rule. AMSC/CMSC 460/466 T. von Petersdorff 1 AMSC/CMSC 46/466 T. von Petersdorff 1 umericl Integrtion 1 Introduction We wnt to pproximte the integrl I := f xdx where we re given, b nd the function f s subroutine. We evlute f t points x 1,...,x n

More information

ODE: Existence and Uniqueness of a Solution

ODE: Existence and Uniqueness of a Solution Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =

More information

AP Calculus Multiple Choice: BC Edition Solutions

AP Calculus Multiple Choice: BC Edition Solutions AP Clculus Multiple Choice: BC Edition Solutions J. Slon Mrch 8, 04 ) 0 dx ( x) is A) B) C) D) E) Divergent This function inside the integrl hs verticl symptotes t x =, nd the integrl bounds contin this

More information

Ordinary differential equations

Ordinary differential equations Ordinry differentil equtions Introduction to Synthetic Biology E Nvrro A Montgud P Fernndez de Cordob JF Urchueguí Overview Introduction-Modelling Bsic concepts to understnd n ODE. Description nd properties

More information

S. S. Dragomir. 2, we have the inequality. b a

S. S. Dragomir. 2, we have the inequality. b a Bull Koren Mth Soc 005 No pp 3 30 SOME COMPANIONS OF OSTROWSKI S INEQUALITY FOR ABSOLUTELY CONTINUOUS FUNCTIONS AND APPLICATIONS S S Drgomir Abstrct Compnions of Ostrowski s integrl ineulity for bsolutely

More information

Euler, Ioachimescu and the trapezium rule. G.J.O. Jameson (Math. Gazette 96 (2012), )

Euler, Ioachimescu and the trapezium rule. G.J.O. Jameson (Math. Gazette 96 (2012), ) Euler, Iochimescu nd the trpezium rule G.J.O. Jmeson (Mth. Gzette 96 (0), 36 4) The following results were estblished in recent Gzette rticle [, Theorems, 3, 4]. Given > 0 nd 0 < s

More information

Consequently, the temperature must be the same at each point in the cross section at x. Let:

Consequently, the temperature must be the same at each point in the cross section at x. Let: HW 2 Comments: L1-3. Derive the het eqution for n inhomogeneous rod where the therml coefficients used in the derivtion of the het eqution for homogeneous rod now become functions of position x in the

More information

LECTURE NOTE #12 PROF. ALAN YUILLE

LECTURE NOTE #12 PROF. ALAN YUILLE LECTURE NOTE #12 PROF. ALAN YUILLE 1. Clustering, K-mens, nd EM Tsk: set of unlbeled dt D = {x 1,..., x n } Decompose into clsses w 1,..., w M where M is unknown. Lern clss models p(x w)) Discovery of

More information

Chapter 0. What is the Lebesgue integral about?

Chapter 0. What is the Lebesgue integral about? Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous

More information

MAT 168: Calculus II with Analytic Geometry. James V. Lambers

MAT 168: Calculus II with Analytic Geometry. James V. Lambers MAT 68: Clculus II with Anlytic Geometry Jmes V. Lmbers Februry 7, Contents Integrls 5. Introduction............................ 5.. Differentil Clculus nd Quotient Formuls...... 5.. Integrl Clculus nd

More information

Reinforcement learning II

Reinforcement learning II CS 1675 Introduction to Mchine Lerning Lecture 26 Reinforcement lerning II Milos Huskrecht milos@cs.pitt.edu 5329 Sennott Squre Reinforcement lerning Bsics: Input x Lerner Output Reinforcement r Critic

More information

Probabilistic Investigation of Sensitivities of Advanced Test- Analysis Model Correlation Methods

Probabilistic Investigation of Sensitivities of Advanced Test- Analysis Model Correlation Methods Probbilistic Investigtion of Sensitivities of Advnced Test- Anlysis Model Correltion Methods Liz Bergmn, Mtthew S. Allen, nd Dniel C. Kmmer Dept. of Engineering Physics University of Wisconsin-Mdison Rndll

More information

How can we approximate the area of a region in the plane? What is an interpretation of the area under the graph of a velocity function?

How can we approximate the area of a region in the plane? What is an interpretation of the area under the graph of a velocity function? Mth 125 Summry Here re some thoughts I ws hving while considering wht to put on the first midterm. The core of your studying should be the ssigned homework problems: mke sure you relly understnd those

More information

1. Gauss-Jacobi quadrature and Legendre polynomials. p(t)w(t)dt, p {p(x 0 ),...p(x n )} p(t)w(t)dt = w k p(x k ),

1. Gauss-Jacobi quadrature and Legendre polynomials. p(t)w(t)dt, p {p(x 0 ),...p(x n )} p(t)w(t)dt = w k p(x k ), 1. Guss-Jcobi qudrture nd Legendre polynomils Simpson s rule for evluting n integrl f(t)dt gives the correct nswer with error of bout O(n 4 ) (with constnt tht depends on f, in prticulr, it depends on

More information

Goals: Determine how to calculate the area described by a function. Define the definite integral. Explore the relationship between the definite

Goals: Determine how to calculate the area described by a function. Define the definite integral. Explore the relationship between the definite Unit #8 : The Integrl Gols: Determine how to clculte the re described by function. Define the definite integrl. Eplore the reltionship between the definite integrl nd re. Eplore wys to estimte the definite

More information

MIXED MODELS (Sections ) I) In the unrestricted model, interactions are treated as in the random effects model:

MIXED MODELS (Sections ) I) In the unrestricted model, interactions are treated as in the random effects model: 1 2 MIXED MODELS (Sections 17.7 17.8) Exmple: Suppose tht in the fiber breking strength exmple, the four mchines used were the only ones of interest, but the interest ws over wide rnge of opertors, nd

More information

potentials A z, F z TE z Modes We use the e j z z =0 we can simply say that the x dependence of E y (1)

potentials A z, F z TE z Modes We use the e j z z =0 we can simply say that the x dependence of E y (1) 3e. Introduction Lecture 3e Rectngulr wveguide So fr in rectngulr coordintes we hve delt with plne wves propgting in simple nd inhomogeneous medi. The power density of plne wve extends over ll spce. Therefore

More information

Math& 152 Section Integration by Parts

Math& 152 Section Integration by Parts Mth& 5 Section 7. - Integrtion by Prts Integrtion by prts is rule tht trnsforms the integrl of the product of two functions into other (idelly simpler) integrls. Recll from Clculus I tht given two differentible

More information

State space systems analysis (continued) Stability. A. Definitions A system is said to be Asymptotically Stable (AS) when it satisfies

State space systems analysis (continued) Stability. A. Definitions A system is said to be Asymptotically Stable (AS) when it satisfies Stte spce systems nlysis (continued) Stbility A. Definitions A system is sid to be Asymptoticlly Stble (AS) when it stisfies ut () = 0, t > 0 lim xt () 0. t A system is AS if nd only if the impulse response

More information

Math 61CM - Solutions to homework 9

Math 61CM - Solutions to homework 9 Mth 61CM - Solutions to homework 9 Cédric De Groote November 30 th, 2018 Problem 1: Recll tht the left limit of function f t point c is defined s follows: lim f(x) = l x c if for ny > 0 there exists δ

More information

NOTES ON HILBERT SPACE

NOTES ON HILBERT SPACE NOTES ON HILBERT SPACE 1 DEFINITION: by Prof C-I Tn Deprtment of Physics Brown University A Hilbert spce is n inner product spce which, s metric spce, is complete We will not present n exhustive mthemticl

More information

19 Optimal behavior: Game theory

19 Optimal behavior: Game theory Intro. to Artificil Intelligence: Dle Schuurmns, Relu Ptrscu 1 19 Optiml behvior: Gme theory Adversril stte dynmics hve to ccount for worst cse Compute policy π : S A tht mximizes minimum rewrd Let S (,

More information

A. Limits - L Hopital s Rule ( ) How to find it: Try and find limits by traditional methods (plugging in). If you get 0 0 or!!, apply C.! 1 6 C.

A. Limits - L Hopital s Rule ( ) How to find it: Try and find limits by traditional methods (plugging in). If you get 0 0 or!!, apply C.! 1 6 C. A. Limits - L Hopitl s Rule Wht you re finding: L Hopitl s Rule is used to find limits of the form f ( x) lim where lim f x x! c g x ( ) = or lim f ( x) = limg( x) = ". ( ) x! c limg( x) = 0 x! c x! c

More information

f(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral

f(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral Improper Integrls Every time tht we hve evluted definite integrl such s f(x) dx, we hve mde two implicit ssumptions bout the integrl:. The intervl [, b] is finite, nd. f(x) is continuous on [, b]. If one

More information

Construction of Gauss Quadrature Rules

Construction of Gauss Quadrature Rules Jim Lmbers MAT 772 Fll Semester 2010-11 Lecture 15 Notes These notes correspond to Sections 10.2 nd 10.3 in the text. Construction of Guss Qudrture Rules Previously, we lerned tht Newton-Cotes qudrture

More information

ROBUST ADAPTIVE BEAMFORMER WITH FEASIBILITY CONSTRAINT ON THE STEERING VECTOR

ROBUST ADAPTIVE BEAMFORMER WITH FEASIBILITY CONSTRAINT ON THE STEERING VECTOR ROBUST ADAPTIVE BEAMFORMER WITH FEASIBILITY CONSTRAINT ON THE STEERING VECTOR Wenyi Zhng nd Bhskr D. Ro Deprtment of Electricl nd Computer Engineering University of Cliforni, Sn Diego L Joll, CA 92093-0407,

More information

Synoptic Meteorology I: Finite Differences September Partial Derivatives (or, Why Do We Care About Finite Differences?

Synoptic Meteorology I: Finite Differences September Partial Derivatives (or, Why Do We Care About Finite Differences? Synoptic Meteorology I: Finite Differences 16-18 September 2014 Prtil Derivtives (or, Why Do We Cre About Finite Differences?) With the exception of the idel gs lw, the equtions tht govern the evolution

More information

Lecture 1: Introduction to integration theory and bounded variation

Lecture 1: Introduction to integration theory and bounded variation Lecture 1: Introduction to integrtion theory nd bounded vrition Wht is this course bout? Integrtion theory. The first question you might hve is why there is nything you need to lern bout integrtion. You

More information

Duality # Second iteration for HW problem. Recall our LP example problem we have been working on, in equality form, is given below.

Duality # Second iteration for HW problem. Recall our LP example problem we have been working on, in equality form, is given below. Dulity #. Second itertion for HW problem Recll our LP emple problem we hve been working on, in equlity form, is given below.,,,, 8 m F which, when written in slightly different form, is 8 F Recll tht we

More information

MATH 144: Business Calculus Final Review

MATH 144: Business Calculus Final Review MATH 144: Business Clculus Finl Review 1 Skills 1. Clculte severl limits. 2. Find verticl nd horizontl symptotes for given rtionl function. 3. Clculte derivtive by definition. 4. Clculte severl derivtives

More information