Joint Optimization of Rate Allocation and BLAST Ordering to Minimize Outage Probability

Size: px
Start display at page:

Download "Joint Optimization of Rate Allocation and BLAST Ordering to Minimize Outage Probability"

Transcription

1 Join Opimizaion of Rae Allocaion and BLAST Ordering o Minimize Ouage Probabiliy Arumugam Kannan, Badri Varadarajan and John R. Barry School of Elecrical and Compuer Engineering Georgia Insiue of Technology, Alana, GA USA {aru, badri, barry}@ece.gaech.edu Absrac We consider a wireless communicaion sysem over a muliple-inpu muliple-oupu Rayleigh-fading channel wih successive-cancellaion deecion. The ouage probabiliy of such a sysem is srongly dependen on wo choices: he order in which he layers are deeced, and he rae-allocaion sraegy a he ransmier. We propose he rae-alized ordering algorihm, a generalizaion of he BLAST ordering algorihm ha is shown o minimize ouage probabiliy. We furher opimize he allocaion of rae and energy a he ransmier, for a variey of receiver ordering sraegies. Finally, we joinly opimize he receiver ordering and ransmier rae and energy allocaions. Our main conclusion is ha, for a wide range of daa raes and SNR, he ouage probabiliy is minimized by a combinaion of rae-alized ordering and a parially uniform rae and energy (PURE) allocaion sraegy. The joinly opimum sysem ouperforms he Bell Labs layered space-ime (BLAST) archiecure by 5 db a 8 b/s/hz and an ouage probabiliy of 0 3, when operaing over a 4-inpu 4-oupu Rayleigh-fading channel. Also, he joinly opimum sysem shows an improvemen of.5 db over a recenly proposed combinaion of opimum allocaion and fixed ordering. I. INTRODUCTION The use of muliple ransmi and receive anennas in wireless communicaion sysems offers dramaic muliplexing and diversiy gains, enabling high specral efficiencies and low error raes over wireless fading channels. The ransmier and receiver should be appropriaely designed o exploi he gains offered by muliple-inpu, muliple-oupu (MIMO) sysems. Furher, sysem design should aim for low compuaional complexiy. The BLAST archiecure [][2] achieves a high muliplexing gain by ransmiing independen daa sreams, possibly coded, from each ransmi anenna. The BLAST receiver employs he ordered successive cancellaion (SC) decoding algorihm, which maximizes he minimum SNR among all sages of decoding. The SC receiver is much less complex han he opimum join ML decoder, bu i does no fully exploi he diversiy gain offered by he MIMO channel. Consequenly, he BLAST sysem suffers from high error raes, even a high SNR. This research was suppored in par by Naional Science Foundaion grans CCR and CCR The error performance of he SC decoder can be improved by rae and energy allocaion across he various anennas. Ideally, he opimum allocaion is obained hrough a feedback pah from receiver o ransmier, where eiher he channel iself or he opimum allocaion, compued by he receiver, is fed back [3][4][5]. Transmier allocaion sraegies based on receiver feedback are effecive, bu such feedback is no always available in pracical sysems. Insead of relying on feedback, one can allocae raes and energies based on he saisics [6][7] of he random channel, which may be known o he ransmier even if he insananeous channel is no. The loading sraegy ha minimizes he error probabiliy, for he fixed case where he receiver performs no ordering, was obained in [6]. The ouage capaciy of such a sysem was analyzed in [8]. A sraegy which selecs a subse of he ransmi anennas based on channel saisics was shown [9][0] considerably improve he performance of he convenional BLAST sysem. However, he joinly opimal ransmier receiver srucure has no ye been explored. In his work, we aim o minimize ouage probabiliy. The ouage probabiliy is a lower bound on he word error rae achievable by a coded MIMO sysem. The bound is igh when he ouer error-correcing ouer code is powerful, in he sense ha i approaches capaciy over an AWGN channel. In his paper, we propose he rae-alized ordering algorihm, which minimizes he ouage probabiliy for any given ransmier loading sraegy. Second, we obain he ransmier rae and energy allocaion ha minimizes he ouage probabiliy wih rae-alized ordering. Our main conclusion is ha, for a wide range of daa raes and SNR, he ouage probabiliy is minimized by a parially uniform rae and energy (PURE) allocaion sraegy, which disribues he available rae and energy uniformly over a fracion of he available ransmi anennas. This paper is organized as follows. In Secion II, we describe he channel model, and he sysem archiecure. In Secion III, we review he BLAST ordering algorihm, propose our new rae-alized variaion and prove is opimaliy. In Secion IV, we discuss he problem of opimum rae allocaion for each receiver ordering algorihm. The analysis is suppored by simulaion resuls in Secion V. Finally, Secion VI summarizes our conclusions.

2 II. SYSTEM MODEL AND BACKGROUND We consider a MIMO sysem wih ransmi and r receive anennas, wih he assumpion ha r. In keeping wih he BLAST archiecure [], independen daa sreams are ransmied on each ransmi anenna. Before ransmission, each daa sream is encoded by an error-correcing code ha is designed o approach capaciy on an AWGN channel. The i-h daa sream carries an informaion rae of R i b/s/hz wih an average energy of E i. The oal daa rae is R = R i, and he i = average ransmi energy is E = E i. i = We assume ha he channel is linear, fla-fading and quasisaic, so ha he received vecor a he k-h signaling inerval is: y k = Hx k + n k. () The elemens of he r noise vecor n k are independen, circularly symmeric Gaussian random variables wih zero mean and variance N 0 so ha E[n k n l *] = δ k l N 0 I r, where A* denoes conjugae ranspose of A. The r channel marix H is assumed o be a random Rayleigh fading marix, is enries being independen, circularly symmeric complex Gaussian random variables wih zero mean and uni variance. The receiver knows H, bu he ransmier has no informaion abou H. Under hese assumpions, he SNR per receive anenna is given by S = E/N 0. In his paper, we focus on receivers which employ he successive cancellaion (SC) decoding algorihm []. SC decoders decode one daa sream a a ime, subracing ou he esimaed conribuion of previously decoded daa sreams, and nulling ou inerference from undecoded sreams. An imporan degree of freedom in he design of SC decoders is he choice of he order in which he sreams are decoded. Le i j denoe he index of he symbol decoded in he ( i j-h sage. To decode all he symbols { j ) xˆ } in he i j -h daa k sream, he SC decoder cancels off he esimaed conribuion from he previously deeced daa sreams o obain ( j r ) k = y k h il xˆ k, (2) l = where h i denoes he i-h column of he channel marix H. If previous decisions are correc, hen ( j {r ) k } conains conribuions only from he sream of ineres i j, and inerference from he undecoded sreams. To null ou he inerference, he SC decoder uses he nulling vecor w j, defined as he firs row of he Moore-Penrose inverse of he marix [h ij, h ij +,, h i ] []. Using he nulling vecor, he SC decoder obains he j-h decision sream, d ( j ) k = w j *r ( j ) k. Assuming perfec decision feedback, he channel model reduces o ( i j ) x k j ( i l ) d k ( j ) = + w j *n k. (3) The equivalen channel (3) is an AWGN channel wih noise variance N 0 w j 2 ( i. The esimaes { j ) } of he i h xˆ j daa sream ( j are obained from {d ) k k }. We now proceed o quanify he error probabiliy of he SC decoder, as a funcion of {R i }, {E i } and he decision ordering vecor i =[i, i 2,, i ] T. For convenience, define he inverse ordering vecor j =[j, j 2,, j ] T such ha q = j iq for q =, 2,,. The effecive channel corresponding o he i-h symbol has a noise variance equal o N 0 /γ i, where γ i is he SNR scaling facor given by γ i = / w 2 ji. Recall ha he i-h daa sream has an average energy E i, hence he insananeous SNR of he effecive channel is E i γ i /N 0, and he insananeous capaciy is log 2 ( + E i γ i /N 0 ). Since each daa sream is assumed o have a capaciy-achieving code, i is incorrecly decoded if and only if an ouage occurs, i.e., if and only if: log 2 ( + E i γ i /N 0 ) < R i, (4) or equivalenly if and only if γ i is less han /, where SNR i is he rae-alized SNR of he i-h daa sream, as defined by Forney []: SNR i E i N 0 SNR i = (5) 2 R i For noaional convenience, we define =. The rae-alized SNR characerizes he error performance of he sysem beer han jus he SNR, since i capures he effec of he daa rae. The overall SC decoder is a bank of parallel scalar decoders for each sream. If all daa sreams are ouage-free, he SC decoder is also error-free. However, if any of he sreams is in ouage, he SC decoder is in ouage, and hence has a non-zero probabiliy of frame error. Consequenly, he frame-error rae of he coded sysem is upper-bounded by he ouage probabiliy SNR i P o (i, { }) = Pr γ ji < (6) ρ i = i In he following secions, we will discuss problem of minimizing he ouage probabiliy by he opimal choice of {R i }, {E i } and he ordering vecor i. III. RECEIVER DESIGN: CHOICE OF ORDERING ALGORITHM For every insance of he channel H, he receiver uses an ordering algorihm o compue i, which in urn deermines he SNR scaling facors { γ i }. Averaging over H, he ordering algorihm deermines he probabiliy disribuion of he SNR scaling vecor Γ =[γ, γ 2, γ ] T, and hence he ouage probabiliy. In his secion, we discuss hree possible ordering algorihms and derive he ouage probabiliy for each.

3 III-A. Fixed Ordering The simples ordering algorihm is fixed ordering, where he sreams are decoded simply in he increasing order of heir index, i.e., i = j = [, 2,, ] T, irrespecive of H. In his case, i is well known [2] ha he SNR scaling facors { γ i } are independen. Thus, he ouage probabiliy (6) reduces o P fixed ({ }) = Pr[γ i ---- ]. (7) i = Furher, from [2], γ i has a χ 2 -disribuion wih 2(r + i) degrees of freedom, hence r + i Pr[γ i ] = exp (8) l! l l = 0 ρ i Subsiuing (8) in (7) gives a closed form expression for he ouage probabiliy of fixed ordering. III-B. BLAST Ordering The BLAST ordering algorihm [] can be summarized as follows. Given H, he firs sream o be decoded, i, is chosen as he one wih he nulling vecor of leas magniude, i.e., he maximum pos-nulling SNR. The nex sream, i 2, is chosen o maximize γ 2, among he remaining choices, and so on. I was shown in [] ha his greedy ordering algorihm is also globally opimum, as saed below. Remark. For sages j =, 2, he BLAST ordering algorihm chooses i j so as o achieve he maximum value of γ j among he j + possibiliies. In he process, i also maximizes he minimum of SNR scaling facors, namely min(γ, γ 2,, γ ). The SNR scaling facors γ, γ 2,, γ produced by BLAST ordering are no muually independen. Therefore, obaining a closed form expression for he densiy funcion of Γ is an open problem. However, he following properies hold for he ordering vecor i and he SNR scaling vecor Γ. Theorem. For a Rayleigh fading channel, he ordering vecor i and he SNR scaling vecor Γ produced by he BLAST ordering algorihm are independen. Furher, i is uniformly disribued over he se of all permuaions of [, 2,, ] T. In Secion IV-B, we will use he above facs o derive a simple expression for he union bound on he ouage probabiliy (6). III-C. Rae-Normalized Ordering In his secion, we propose he rae-alized (RN) ordering algorihm which minimizes he ouage probabiliy for any given ransmier rae allocaion. Firs, noe from (6) ha an ouage occurs if and only if min( γ j j ) across all he decoding sages is less han uniy. From his observaion, we sae he following lemma. Lemma 3.. To minimize he ouage probabiliy (6), he ordering vecor i should be chosen o ensure ha min( γ j j ) is maximized over j =, 2,,. Theorem 2. A every sage of decoding j =, 2,,, he rae-alized ordering algorihm chooses i j so as o achieve he maximum value of γ j j among he j + possibiliies. In he process, i maximizes he minimum of γ j j across all daa sreams. Proof: Le he scaled channel marix be H = HD, where D is a diagonal marix, whose j-h diagonal enry is d jj = j. If he QR decomposiion of H is given by H = QR, hen he scaled channel marix can be wrien as H = QRD = QR. I is well known [3] ha he SNR scaling facors resuling from SC decoding of H are equal o he squared diagonal enries of R. Therefore, he SNR scaling facor for he scaled channel H is simply γ j = R 2 jj d 2 jj = γ ρ j ij. Hence, he minimum of γ j is maximized by employing he usual BLAST ordering algorihm of [] on H insead of H. Combining Lemma 3. and Theorem 2, we conclude ha he rae-alized ordering algorihm minimizes he ouage probabiliy among all possible ordering algorihms. IV. TRANSMITTER DESIGN: OPTIMAL RATE AND ENERGY ALLOCATION In his secion, we discuss he ransmier opimizaion problem, namely o choose he {R i } and {E i } o minimize he ouage probabiliy a a given SNR under he consrains ha i = R i =R and i = E i =E. We begin by saing he following remark abou he opimum energy allocaion holds for all ordering algorihms. Remark 2. Suppose {R i * } and {E i * } are he rae and energy allocaions ha minimize he ouage probabiliy (6). They are relaed by: E * 2 R i * i E = (9) R 2 j * j = This is easily proved using Lagrange mulipliers. The proof is omied due o space consrains. The implicaion is ha he ransmier opimizaion is simplified o one of choosing only he daa raes {R i }, wih he opimum energies E i auomaically deermined by (9). Thus, he number of variables o be opimized is reduced from 2 o. IV-A. Fixed Ordering Transmier opimizaion for fixed ordering has already been solved [6] excep ha he relaion (9) beween he opimum energy and rae allocaions was no used. The opimum allocaion is deermined by a random search followed by consrained gradien descen over he space of all possible daa raes {R i } ha sum up o R. For example,

4 consider a 4-inpu, 4-oupu MIMO sysem operaing a a daa rae of R =8 b/s/hz and an SNR of S =5dB. Numerical opimizaion yields he opimum daa rae allocaion o be {R i }={0,.3,2.99,3.70}. From (9), he corresponding energy allocaion is {E i /E} = {0, 0.25, 0.36, 0.39}. Noe ha he sreams deeced laer carry a higher daa rae han sreams deeced early. This resul is inuiively saisfying because, from (7) and (8), he diversiy order of he j-h deeced sream is r + j. I is inuiively pleasing ha a higher fracion of he available bis are loaded ino sreams wih higher diversiy orders. IV-B. BLAST Ordering As saed in Secion III-B, he SNR scaling facors produced by he BLAST ordering algorihm are dependen, and no closed-form expression is known for heir probabiliy disribuion and hence he ouage probabiliy. Insead, we sugges using he union bound in (6) o perform ransmier opimizaion. From (6), i is clear ha he ouage probabiliy is bounded by P UB ({ }, j) = Pr γ ji < (0) i = Each erm in he summaion can be spli ino an average over he sage j i in which he i-h sream is decoded, giving Pr γ ji < ---- = Pr(j i = k)pr[γ k < ---- j i = k]. () k = Theorem saes ha j i is uniformly disribued over {, }, hence Pr( j i = k)=/. Also from Theorem, he SNR scaling facor is independen of j i, hus condiioning on j i does no change he disribuion of γ k. Thus, () simplifies o Pr γ ji < ---- = - F k, (2) ---- k = where we define he lef-coninuous cumulaive disribuion funcions by F k ( x ) = Pr[γ k < x] for k =, 2,,. Le F( x ) denoe he average of hese disribuion funcions over he symbols. From (2), Pr[ γ ji < / ] = F(/ ). Subsiuing in (0), we ge he union bound on he ouage probabiliy o be P UB-BLAST ({ }) = F. (3) i = ρ ---- i An analyical expression for F( x ) is no known in closed form, so even he simplified union bound (3) canno be evaluaed as is. However, he funcion F( x ) can be numerically esimaed as follows. A large number of Rayleigh fading marices are generaed, he BLAST algorihm is run for each one, and he resuling { γ i } are rounded off o preseleced bins. Averaging his discree approximaion of he disribuion funcion of { γ i }, we ge a discree approximaion o F( x ). Noe ha (3) is jus he sum of he same funcion evaluaed for each of he erms {/ }. This implies ha BLAST ordering reas all he daa sreams idenically i.e., if he daa raes and energies of wo sreams i and i are equal, hen hey make he same conribuion F(/ ) o he union bound (3). From his observaion, i is emping o conclude ha he minimizing soluion is o allocae idenical daa raes and energies, R/ and E/ respecively, o all he sreams. However, his conclusion is no valid because he funcion F( x ) is no necessarily convex. For example, consider a 4-inpu, 4-oupu MIMO sysem operaing a 8 b/s/hz a an SNR of 20 db. For his sysem, we numerically esimaed F( x ) and performed a random search for he opimum rae allocaion. The uniform allocaion yielded a union bound (3) equal o However, he opimum allocaion was found o be he parially uniform rae allocaion {0,0,4,4}, which disribues he rae uniformly over wo of he four ransmi anennas. This allocaion yielded a union bound of.0 0 3, which is significanly lower. Based on numerical experimens, we make he following conjecure abou he opimal allocaion. Conjecure. The union bound for he BLAST-ordered SC decoder is minimized by a parially uniform rae and energy (PURE) allocaion, wih K sreams carrying a daa rae of R/K and energy of E/K, and he remaining K daa sreams carrying zero daa rae and zero energy. Hence, numerical opimizaion reduces o finding he opimal number of acive sreams K {, 2,, }. The opimum value is ypically less han a high SNR, and i decreases wih increasing SNR. This can be explained inuiively by he fac he diversiy order is he key deerminan of error performance a high SNR, and reducing he number of acive inpus implies ha he diversiy gain of he SC decoded sysem is enhanced. IV-C. Rae-Normalized Ordering We now aim o find he opimum rae and energy allocaion a he ransmier when he receiver employs he RN ordering algorihm of Secion III-C. The analyical expression for ouage probabiliy wih RN ordering is inracable. Even he union bound is inracable, because he disribuions of Γ and j for he RN ordering algorihm depend on he rae allocaions. However, based on heurisic observaions, we make he following conjecure regarding he opimum daa rae allocaion. Conjecure 2. The opimum daa rae allocaion for he rae-alized ordering algorihm is eiher he opimum allocaion for he case of fixed ordering, or a parially uniform rae and energy (PURE) allocaion, where K inpus carry a rae of R/K each, and he res carry zero daa rae.

5 According o Conjecure 2, one can resric he search for he opimum daa rae allocaion o + possibiliies. Of paricular ineres in Conjecure 2 is he fac ha a parially uniform allocaion is ofen he opimum soluion for RN ordering. I was discussed in Secion IV-B ha a PURE allocaion is opimum for BLAST ordering. Noe ha, wih a PURE allocaion, RN ordering amouns exacly o BLAST ordering and for his reason, he PURE allocaion is expeced o be a good soluion for RN ordering. V. N UMERICAL RESULTS In his secion we presen numerical resuls for a 4 4 MIMO sysem operaing a R =8b/s/Hz, assuming independen Rayleigh fading. We firs consider a fixed ordering [6], and quanify he benefis of opimizing he rae and energy allocaions. A S = 20 db wih a fixed ordering, he opimal raes and energies are {0, 0, 3.63, 4.37}, and {0, 0, 0.49E, 0.5E}, respecively, which leads o an ouage probabiliy of In comparison, a uniform rae allocaion wih fixed ordering gives an ouage probabiliy of 0.20, abou fify imes larger. Fig. compares he error performance of hree ordering sraegies a R = 8 b/s/hz: he fixed ordering, he convenional BLAST ordering, and he rae-alized ordering. All hree sysems use he same rae allocaion {R i }={0,.3,2.99,3.70}, which is a good candidae for comparison since i minimizes he ouage probabiliy of he fixed-ordering decoder a S =5dB. I is seen from Fig. ha he rae-alized ordering ouperforms he opimized fixed ordered sysem by.5 db and BLAST ordering by 2 db a an ouage probabiliy of 0 3. Fig. 2 shows he advanage of opimizing he rae and energy allocaions a he ransmier. The lowes curve shows he error performance wih rae-alized ordering and opimized ransmier allocaions, while he nex-lowes curve shows he performance wih a fixed ordering and opimized allocaions. The rae allocaions for boh cases are calculaed anew a each SNR so as o minimize ouage probabiliy. Hence, hese curves represen he bes possible ouage probabiliy ha can be achieved. For example, he parially uniform allocaion wih K =3 is opimal for rae-alized ordering a S = 5 db, while he parially uniform allocaion wih K =2 is opimal for RN ordering a S =20dB and 25 db. Comparing he lower wo curves in Fig. 2, we see ha ransmier-opimized rae-alized ordering ouperforms ransmier-opimized fixed ordered receiver by.5 db a an ouage probabiliy of 0 3, underlining he imporance of join opimizaion of he ransmier and receiver. Also included in Fig. 2, for he sake of comparison, is he upper gray curve, which shows he performance of a convenional BLAST sysem wih uniform allocaions a he ransmier. I is seen ha he joinly opimal sysem ouperforms convenional BLAST by 5 db a an ouage probabiliy of 0 3. VI. CONCLUSIONS We sudied he BLAST sysem wih successive cancellaion decoding wih he objecive of minimizing he ouage probabiliy. We proposed he rae-alized ordered deecor and proved ha i minimizes he ouage probabiliy. We invesigaed he opimal rae and energy allocaions o minimize he ouage probabiliy for he differen varians of he SC decoder. We argued ha he parially uniform rae and UNIFORM ALLOCATION 0 0 TX-OPTIMIZED ALLOCATION BLAST ORDERING OUTAGE PROBABILITY BLAST ORDERING RATE NORMALIZED ORDERING FIXED ORDERING OUTAGE PROBABILITY FIXED ORDERING RATE-NORMALIZED ORDERING SNR (db) Fig.. Comparison of ordering algorihms for {R i } = {0.00,.3, 2.98, 3.69} for a 4-inpu, 4-oupu Rayleigh fading channel a R =8 b/s/hz SNR (db) Fig. 2. Comparison of ransmier opimized SC decoders for a 4- inpu, 4-oupu Rayleigh fading channel a R =8 b/s/hz.

6 energy (PURE) allocaion is he minimizing soluion for BLAST-ordered deecion. In he case of he rae-alized ordered decoder, we proposed a rule for rae and power allocaion o minimize he ouage probabiliy based on parial analyical resuls. Simulaion resuls show ha joinly opimizing he ransmier and receiver, wihou any form of channel feedback, improves he performance of SC decoders significanly. The fac ha a PURE allocaion is ofen he opimum soluion wih RN ordering validaes he imporance of anenna selecion schemes wih SC decoding. Inuiively, anenna selecion wih SC decoding amouns o reducing he muliplexing gain of he MIMO sysem in order o improve he diversiy order. Our resuls show he imporance of achieving he righ rade-off in order o minimize he ouage probabiliy of he SC decoder. Appendix : Proof of Theorem The BLAST ordering algorihm can be viewed as a funcion Ψ(H) of he channel marix H, which oupus he pair (i, Γ). Lemma 6.. For a given channel marix H, suppose Ψ(H) = (i, Γ). Then, for all column permuaion marices, Π, Ψ(HΠ) = (Π Τ i, Γ). (4) Proof: Suppose he symbol x q corresponding o i = q was decoded in he firs sage wih channel H, he same symbol, re-labelled as i = q, where i = Π T i will be decoded in he firs sage wih he permued channel HΠ. Clearly, he value of he maximum SNR scaling facor remains unchanged for ha sage, since i corresponds o he same symbol. Similarly, proceeding hrough he sages k = {2, 3,, }, i is clear ha he SNR scaling facors remain invarian o he permuaion, and ha muliplying H by Π amouns o re-labelling he index of he symbols, as deermined by Π. I is well known ha permuing he columns of Rayleigh fading marices does no change heir disribuion. More precisely, he following resul holds. Lemma 6.2. Suppose H is a Rayleigh fading marix. Then, for all column permuaion marices Π, he random marix H = HΠ is idenical in disribuion o H, since H is circularly symmeric. From Lemma 6.2, HΠ is idenical in disribuion o H. Using Lemma 6., we arrive a he following corollary. Furher, from Corollary, noe ha join densiy funcion of (i, Γ) saisfies p(i, Γ) = p(π Τ i, Γ). Now, using Bayes rule and he fac i is uniformly disribued over! possibiliies, we obain he following expression for he join densiy funcion. p(i, Γ) = --- p(γ i) (5)! In paricular, p(i, Γ) = p(π T i, Γ) p(γ i) = p(γ Π T i) for all Π, implying ha Γ and i are independen. This proves he second claim of Theorem. VII. REFERENCES [] P. W. Wolniansky, G. J. Foschini, G. D. Golden, R. A. Valenzuela, V- BLAST: An Archiecure for Realizing Very High Daa Raes Over he Rich-Scaering Wireless Channel, Proc. ISSSE-98, Pisa, Ialy, Sep. 29, 998. [2] G. D. Golden, G. J. Foschini, R. A. Valenzuela, P. W. Wolniansky, Deecion Algorihm and Iniial Laboraory Resuls using he V- BLAST Space-Time Communicaion Archiecure, Elecronics Leers, Vol. 35, No., Jan. 7, 999, pp [3] S. T. Chung, A. Lozano and H. C. Huang, Approaching eigenmode BLAST channel capaciy using V-BLAST wih rae and power feedback, in Proc. VTC 200, Alanic Ciy, Oc [4] S. H. Nam and K. B. Lee, Transmi power allocaion for an exended V-BLAST sysem, Proc. IEEE PIMRC 2002, Sep. 2002, pp [5] R. W. Heah Jr., S. Sandhu, and A. J. Paulraj, Anenna Selecion for spaial muliplexing sysems wih linear receivers, IEEE Communicaion Leers, vol. 5, no. 4, pp 42-44, April 200. [6] N. Prasad and M. K. Varanasi, Ouage Analysis and Opimizaion for Muliaccess/V-BLAST Archiecure over MIMO Rayleigh Fading Channels, 4s Annual Alleron Conf. on Comm. Conrol, and Compu., Monicello, IL, Oc., [7] T. Guess, H. Zhang, and T. V. Kochiev, The ouage capaciy of BLAST for MIMO channels, in Proc. IEEE Inl. Conf. on Communicaions, Anchorage, Alaska, May [8] H. Zhang and T. Guess, Asympoical analysis of he ouage capaciy of rae-ailored BLAST, Proc. IEEE Globecom Vol. 4, Dec pp [9] Ravi Narasimhan, Spaial Muliplexing wih ransmi anenna and consellaion selecion for correlaed MIMO fading channels, IEEE Transacions on Signal Processing, Special Issue on MIMO Wireless Communicaions, vol. 5, no., pp , Nov [0] D. A. Gore, R. W. Heah Jr. and A. J. Paulraj, Saisical anenna selecion for spaial muliplexing sysems, IEEE In. Conf. On Communicaions, vol. pp , [] G. D. Forney Jr. and M. V. Eyuboglu, Combined Equalizaion and Coding using Precoding, IEEE Communicaions Magazine, Dec. 99. [2] R. J. Muirhead, Aspecs of Mulivariae Saisical Theory, John Wiley & Sons, 982. [3] J. R. Barry, E. A. Lee, D. G. Messerschmi, Digial Communicaion, Third Ediion, Kluwer Academic Publishers, Corollary. Ψ(HΠ) = (Π Τ i, Γ) is idenical in disribuion o Ψ(H) = (i, Γ). From Corollary, since Π Τ i is idenical in disribuion o i, we conclude ha i is uniformly disribued over all permuaions of [, 2,, ] T, as saed in Theorem.

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2 Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.

More information

EE3723 : Digital Communications

EE3723 : Digital Communications EE373 : Digial Communicaions Week 6-7: Deecion Error Probabiliy Signal Space Orhogonal Signal Space MAJU-Digial Comm.-Week-6-7 Deecion Mached filer reduces he received signal o a single variable zt, afer

More information

st semester. Kei Sakaguchi

st semester. Kei Sakaguchi 0 s semeser MIMO Communicaion Sysems #5: MIMO Channel Capaciy Kei Sakaguchi ee ac May 7, 0 Schedule ( s half Dae Tex Conens # Apr. A-, B- Inroducion # Apr. 9 B-5, B-6 Fundamenals

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM Name: UNIVERSIY OF CALIFORNIA College of Engineering Deparmen of Elecrical Engineering and Compuer Sciences Professor David se EECS 121 FINAL EXAM 21 May 1997, 5:00-8:00 p.m. Please wrie answers on blank

More information

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data Chaper 2 Models, Censoring, and Likelihood for Failure-Time Daa William Q. Meeker and Luis A. Escobar Iowa Sae Universiy and Louisiana Sae Universiy Copyrigh 1998-2008 W. Q. Meeker and L. A. Escobar. Based

More information

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques Resource Allocaion in Visible Ligh Communicaion Neworks NOMA vs. OFDMA Transmission Techniques Eirini Eleni Tsiropoulou, Iakovos Gialagkolidis, Panagiois Vamvakas, and Symeon Papavassiliou Insiue of Communicaions

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Testing for a Single Factor Model in the Multivariate State Space Framework

Testing for a Single Factor Model in the Multivariate State Space Framework esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

Approximation Algorithms for Unique Games via Orthogonal Separators

Approximation Algorithms for Unique Games via Orthogonal Separators Approximaion Algorihms for Unique Games via Orhogonal Separaors Lecure noes by Konsanin Makarychev. Lecure noes are based on he papers [CMM06a, CMM06b, LM4]. Unique Games In hese lecure noes, we define

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Single-Pass-Based Heuristic Algorithms for Group Flexible Flow-shop Scheduling Problems

Single-Pass-Based Heuristic Algorithms for Group Flexible Flow-shop Scheduling Problems Single-Pass-Based Heurisic Algorihms for Group Flexible Flow-shop Scheduling Problems PEI-YING HUANG, TZUNG-PEI HONG 2 and CHENG-YAN KAO, 3 Deparmen of Compuer Science and Informaion Engineering Naional

More information

Object tracking: Using HMMs to estimate the geographical location of fish

Object tracking: Using HMMs to estimate the geographical location of fish Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

Suboptimal MIMO Detector based on Viterbi Algorithm

Suboptimal MIMO Detector based on Viterbi Algorithm Proceedings of he 7h WSEAS Inernaional Conference on ulimedia Sysems & Signal Processing, Hangzhou, China, April 5-7, 007 9 Subopimal IO Deecor based on Vierbi Algorihm Jin Lee and Sin-Chong Park Sysem

More information

Mean-square Stability Control for Networked Systems with Stochastic Time Delay

Mean-square Stability Control for Networked Systems with Stochastic Time Delay JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455

More information

System of Linear Differential Equations

System of Linear Differential Equations Sysem of Linear Differenial Equaions In "Ordinary Differenial Equaions" we've learned how o solve a differenial equaion for a variable, such as: y'k5$e K2$x =0 solve DE yx = K 5 2 ek2 x C_C1 2$y''C7$y

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Scheduling of Crude Oil Movements at Refinery Front-end

Scheduling of Crude Oil Movements at Refinery Front-end Scheduling of Crude Oil Movemens a Refinery Fron-end Ramkumar Karuppiah and Ignacio Grossmann Carnegie Mellon Universiy ExxonMobil Case Sudy: Dr. Kevin Furman Enerprise-wide Opimizaion Projec March 15,

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

Longest Common Prefixes

Longest Common Prefixes Longes Common Prefixes The sandard ordering for srings is he lexicographical order. I is induced by an order over he alphabe. We will use he same symbols (,

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

Problem Formulation in Communication Systems

Problem Formulation in Communication Systems Problem Formulaion in Communicaion Sysems Sooyong Choi School of Elecrical and Elecronic Engineering Yonsei Universiy Inroducion Problem formulaion in communicaion sysems Simple daa ransmission sysem :

More information

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1. Roboics I April 11, 017 Exercise 1 he kinemaics of a 3R spaial robo is specified by he Denavi-Harenberg parameers in ab 1 i α i d i a i θ i 1 π/ L 1 0 1 0 0 L 3 0 0 L 3 3 able 1: able of DH parameers of

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach 1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Lecture 2 October ε-approximation of 2-player zero-sum games

Lecture 2 October ε-approximation of 2-player zero-sum games Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

Math 315: Linear Algebra Solutions to Assignment 6

Math 315: Linear Algebra Solutions to Assignment 6 Mah 35: Linear Algebra s o Assignmen 6 # Which of he following ses of vecors are bases for R 2? {2,, 3, }, {4,, 7, 8}, {,,, 3}, {3, 9, 4, 2}. Explain your answer. To generae he whole R 2, wo linearly independen

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Optimal Paired Choice Block Designs. Supplementary Material

Optimal Paired Choice Block Designs. Supplementary Material Saisica Sinica: Supplemen Opimal Paired Choice Block Designs Rakhi Singh 1, Ashish Das 2 and Feng-Shun Chai 3 1 IITB-Monash Research Academy, Mumbai, India 2 Indian Insiue of Technology Bombay, Mumbai,

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models.

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models. Technical Repor Doc ID: TR--203 06-March-203 (Las revision: 23-Februar-206) On formulaing quadraic funcions in opimizaion models. Auhor: Erling D. Andersen Convex quadraic consrains quie frequenl appear

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Joint Transmitter-Reciever Optimization for Multiple Input Multiple Output (MIMO) Systems

Joint Transmitter-Reciever Optimization for Multiple Input Multiple Output (MIMO) Systems Join Transmier-Reciever Opimizaion for Muliple Inpu Muliple Oupu (MIMO Sysems eun Chul WANG and wang Bo (Ed LEE School of Elecrical Engineering, Seoul Naional Universiy, OREA Absrac Muliple ransmi (Tx

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

CHAPTER 2 Signals And Spectra

CHAPTER 2 Signals And Spectra CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par

More information

Optimal Server Assignment in Multi-Server

Optimal Server Assignment in Multi-Server Opimal Server Assignmen in Muli-Server 1 Queueing Sysems wih Random Conneciviies Hassan Halabian, Suden Member, IEEE, Ioannis Lambadaris, Member, IEEE, arxiv:1112.1178v2 [mah.oc] 21 Jun 2013 Yannis Viniois,

More information

Sequential Importance Resampling (SIR) Particle Filter

Sequential Importance Resampling (SIR) Particle Filter Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,

More information

Research Article SER Performance of Enhanced Spatial Multiplexing Codes with ZF/MRC Receiver in Time-Varying Rayleigh Fading Channels

Research Article SER Performance of Enhanced Spatial Multiplexing Codes with ZF/MRC Receiver in Time-Varying Rayleigh Fading Channels e Scienific World Journal, Aricle ID 537272, 2 pages hp://dx.doi.org/0.55/204/537272 Research Aricle SER Performance of Enhanced Spaial Muliplexing Codes wih ZF/MRC Receiver in Time-Varying Rayleigh Fading

More information

SOLUTIONS TO ECE 3084

SOLUTIONS TO ECE 3084 SOLUTIONS TO ECE 384 PROBLEM 2.. For each sysem below, specify wheher or no i is: (i) memoryless; (ii) causal; (iii) inverible; (iv) linear; (v) ime invarian; Explain your reasoning. If he propery is no

More information

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction On Mulicomponen Sysem Reliabiliy wih Microshocks - Microdamages Type of Componens Ineracion Jerzy K. Filus, and Lidia Z. Filus Absrac Consider a wo componen parallel sysem. The defined new sochasic dependences

More information

The expectation value of the field operator.

The expectation value of the field operator. The expecaion value of he field operaor. Dan Solomon Universiy of Illinois Chicago, IL dsolom@uic.edu June, 04 Absrac. Much of he mahemaical developmen of quanum field heory has been in suppor of deermining

More information

Regularized Blind Detection for MIMO Communications

Regularized Blind Detection for MIMO Communications Regularized Blind Deecion for MIMO Communicaions Yuejie Chi, Yiyue Wu and Rober Calderbank Deparmen of Elecrical Engineering Princeon Universiy Princeon, NJ 08544, USA Email: ychi, yiyuewu, calderbk@princeon.edu

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19 Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Staircase Codes for Secret Sharing with Optimal Communication and Read Overheads

Staircase Codes for Secret Sharing with Optimal Communication and Read Overheads Saircase Codes for Secre Sharing wih Opimal Communicaion and Read Overheads Rawad Biar, Salim El Rouayheb ECE Deparmen, IIT, Chicago rbiar@hawkiiedu, salim@iiedu Absrac We sudy he communicaion efficien

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar CONROL OF SOCHASIC SYSEMS P.R. Kumar Deparmen of Elecrical and Compuer Engineering, and Coordinaed Science Laboraory, Universiy of Illinois, Urbana-Champaign, USA. Keywords: Markov chains, ransiion probabiliies,

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

The Arcsine Distribution

The Arcsine Distribution The Arcsine Disribuion Chris H. Rycrof Ocober 6, 006 A common heme of he class has been ha he saisics of single walker are ofen very differen from hose of an ensemble of walkers. On he firs homework, we

More information

Retrieval Models. Boolean and Vector Space Retrieval Models. Common Preprocessing Steps. Boolean Model. Boolean Retrieval Model

Retrieval Models. Boolean and Vector Space Retrieval Models. Common Preprocessing Steps. Boolean Model. Boolean Retrieval Model 1 Boolean and Vecor Space Rerieval Models Many slides in his secion are adaped from Prof. Joydeep Ghosh (UT ECE) who in urn adaped hem from Prof. Dik Lee (Univ. of Science and Tech, Hong Kong) Rerieval

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

Orientation. Connections between network coding and stochastic network theory. Outline. Bruce Hajek. Multicast with lost packets

Orientation. Connections between network coding and stochastic network theory. Outline. Bruce Hajek. Multicast with lost packets Connecions beween nework coding and sochasic nework heory Bruce Hajek Orienaion On Thursday, Ralf Koeer discussed nework coding: coding wihin he nework Absrac: Randomly generaed coded informaion blocks

More information

Global Optimization for Scheduling Refinery Crude Oil Operations

Global Optimization for Scheduling Refinery Crude Oil Operations Global Opimizaion for Scheduling Refinery Crude Oil Operaions Ramkumar Karuppiah 1, Kevin C. Furman 2 and Ignacio E. Grossmann 1 (1) Deparmen of Chemical Engineering Carnegie Mellon Universiy (2) Corporae

More information

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu ON EQUATIONS WITH SETS AS UNKNOWNS BY PAUL ERDŐS AND S. ULAM DEPARTMENT OF MATHEMATICS, UNIVERSITY OF COLORADO, BOULDER Communicaed May 27, 1968 We shall presen here a number of resuls in se heory concerning

More information

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC his documen was generaed a 1:4 PM, 9/1/13 Copyrigh 213 Richard. Woodward 4. End poins and ransversaliy condiions AGEC 637-213 F z d Recall from Lecure 3 ha a ypical opimal conrol problem is o maimize (,,

More information

On-line Adaptive Optimal Timing Control of Switched Systems

On-line Adaptive Optimal Timing Control of Switched Systems On-line Adapive Opimal Timing Conrol of Swiched Sysems X.C. Ding, Y. Wardi and M. Egersed Absrac In his paper we consider he problem of opimizing over he swiching imes for a muli-modal dynamic sysem when

More information

ADDITIONAL PROBLEMS (a) Find the Fourier transform of the half-cosine pulse shown in Fig. 2.40(a). Additional Problems 91

ADDITIONAL PROBLEMS (a) Find the Fourier transform of the half-cosine pulse shown in Fig. 2.40(a). Additional Problems 91 ddiional Problems 9 n inverse relaionship exiss beween he ime-domain and freuency-domain descripions of a signal. Whenever an operaion is performed on he waveform of a signal in he ime domain, a corresponding

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

THE MATRIX-TREE THEOREM

THE MATRIX-TREE THEOREM THE MATRIX-TREE THEOREM 1 The Marix-Tree Theorem. The Marix-Tree Theorem is a formula for he number of spanning rees of a graph in erms of he deerminan of a cerain marix. We begin wih he necessary graph-heoreical

More information

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Article from. Predictive Analytics and Futurism. July 2016 Issue 13 Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

Math 334 Fall 2011 Homework 11 Solutions

Math 334 Fall 2011 Homework 11 Solutions Dec. 2, 2 Mah 334 Fall 2 Homework Soluions Basic Problem. Transform he following iniial value problem ino an iniial value problem for a sysem: u + p()u + q() u g(), u() u, u () v. () Soluion. Le v u. Then

More information

Model Reduction for Dynamical Systems Lecture 6

Model Reduction for Dynamical Systems Lecture 6 Oo-von-Guericke Universiä Magdeburg Faculy of Mahemaics Summer erm 07 Model Reducion for Dynamical Sysems ecure 6 v eer enner and ihong Feng Max lanck Insiue for Dynamics of Complex echnical Sysems Compuaional

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Introduction to Probability and Statistics Slides 4 Chapter 4

Introduction to Probability and Statistics Slides 4 Chapter 4 Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random

More information

Hidden Markov Models. Adapted from. Dr Catherine Sweeney-Reed s slides

Hidden Markov Models. Adapted from. Dr Catherine Sweeney-Reed s slides Hidden Markov Models Adaped from Dr Caherine Sweeney-Reed s slides Summary Inroducion Descripion Cenral in HMM modelling Exensions Demonsraion Specificaion of an HMM Descripion N - number of saes Q = {q

More information

Affine term structure models

Affine term structure models Affine erm srucure models A. Inro o Gaussian affine erm srucure models B. Esimaion by minimum chi square (Hamilon and Wu) C. Esimaion by OLS (Adrian, Moench, and Crump) D. Dynamic Nelson-Siegel model (Chrisensen,

More information

ψ(t) = V x (0)V x (t)

ψ(t) = V x (0)V x (t) .93 Home Work Se No. (Professor Sow-Hsin Chen Spring Term 5. Due March 7, 5. This problem concerns calculaions of analyical expressions for he self-inermediae scaering funcion (ISF of he es paricle in

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

The General Linear Test in the Ridge Regression

The General Linear Test in the Ridge Regression ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge

More information

Math 10B: Mock Mid II. April 13, 2016

Math 10B: Mock Mid II. April 13, 2016 Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.

More information

Maintenance Models. Prof. Robert C. Leachman IEOR 130, Methods of Manufacturing Improvement Spring, 2011

Maintenance Models. Prof. Robert C. Leachman IEOR 130, Methods of Manufacturing Improvement Spring, 2011 Mainenance Models Prof Rober C Leachman IEOR 3, Mehods of Manufacuring Improvemen Spring, Inroducion The mainenance of complex equipmen ofen accouns for a large porion of he coss associaed wih ha equipmen

More information

Testing the Random Walk Model. i.i.d. ( ) r

Testing the Random Walk Model. i.i.d. ( ) r he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp

More information

Lecture 4 Notes (Little s Theorem)

Lecture 4 Notes (Little s Theorem) Lecure 4 Noes (Lile s Theorem) This lecure concerns one of he mos imporan (and simples) heorems in Queuing Theory, Lile s Theorem. More informaion can be found in he course book, Bersekas & Gallagher,

More information