Optimal Large-MIMO Data Detection with Transmit Impairments

Size: px
Start display at page:

Download "Optimal Large-MIMO Data Detection with Transmit Impairments"

Transcription

1 Opima Large-MIMO Daa Deecion wih Transmi Impairmens Ramina Ghods, Chares Jeon, Arian Maeki, and Chrisoph Suder Absrac Rea-word ransceiver designs for muipe-inpu muipe-oupu (MIMO wireess communicaion sysems are affeced by a number of hardware impairmens ha aready appear a he ransmi side, such as ampifier non-ineariies, quanizaion arifacs, and phase noise Whie such ransmiside impairmens are rouiney ignored in he daa-deecion ieraure, hey ofen imi reiabe communicaion in pracica sysems In his paper, we presen a nove daa-deecion agorihm, referred o as arge-mimo approximae message passing wih ransmi impairmens (shor LAMA-I, which akes ino accoun a broad range of ransmi-side impairmens in wireess sysems wih a arge number of ransmi and receive anennas We provide condiions in he arge-sysem imi for which LAMA-I achieves he error-rae performance of he individuayopima (IO daa deecor We furhermore demonsrae ha LAMA-I achieves near-io performance a ow compuaiona compexiy in reaisic, finie dimensiona arge-mimo sysems I INTRODUCTION Pracica ransceiver impemenaions for wireess communicaion sysems suffer from a number of radio-frequency (RF hardware impairmens ha aready occur a he ransmi side, incuding (bu no imied o ampifier non-ineariies, quanizaion arifacs, and phase noise [1] [11] This paper deas wih opima daa deecion in he presence of such impairmens for arge (mui-user muipe-inpu muipeoupu (MIMO wireess sysems wih a arge number of anenna eemens a (possiby boh ends of he wireess ink [12], [13] In paricuar, we consider he probem of esimaing he M T -dimensiona ransmi daa vecor s O MT, where O is a finie conseaion se (eg, QAM or PSK, observed from he foowing (impaired MIMO inpu-oupu reaion [1], [2]: y = H(s + e + n (1 Here, he vecor y C MR corresponds o he received signa, he marix H C MR MT represens he MIMO channe, he vecor e C MT modes ransmi impairmens, and he vecor R Ghods, C Jeon, and C Suder are wih he Schoo of Eecrica and Compuer Engineering, Corne Universiy, Ihaca, NY; e-mai: rghods@cscorneedu, jeon@cscorneedu, suder@corneedu A Maeki is wih Deparmen of Saisics a Coumbia Universiy, New York Ciy, NY; e-mai: arian@sacoumbiaedu The work of R Ghods, C Jeon, and C Suder was suppored in par by Xiinx Inc, and by he US Naiona Science Foundaion under grans ECCS and CCF The work of A Maeki was suppored by he US Naiona Science Foundaion under gran CCF n C MR corresponds o receive noise; he number of receive and ransmi anennas is denoed by M R and M T, respecivey A Conribuions We buid upon our previous resus in [14] and deveop a nove, compuaionay efficien daa deecion agorihm for he mode (1, referred o as LAMA-I (shor for arge-mimo approximae message passing wih ransmi impairmens We provide condiions for which LAMA-I achieves he error-rae performance of he individuay opima (IO daa-deecor, which soves he foowing opimizaion probem: ŝ IO = arg min s O P( s s (2 In words, LAMA-I aims a minimizing he per-user symboerror probabiiy [15], [16] Assuming p(s = M T i=1 p(s i and iid circuary-symmeric compex Gaussian noise wih variance N 0 per compex enry of he noise vecor n, we define he effecive ransmi signa x C MT as x = s+e wih he ransmi-impairmen disribuion p(x s = M T =1 p(x s Besides user-wise independence, we do no impose any condiions on he saisics of he ransmi impairmens his aows us o mode a broad range of ransmi-side impairmens, incuding hardware non-ideaiies ha exhibi saisica dependence beween impairmens and he daa symbos, as we as deerminisic effecs (eg, non-ineariies Our opimaiy condiions are derived via he sae-evouion (SE framework [15], [16] of approximae message passing (AMP [17] [19] and for he asympoic seing, ie, he socaed arge-sysem imi Specificay, we fix he sysem raio β = M T /M R and e M T, and assume ha he enries of H are iid circuary-symmeric compex Gaussian wih variance 1/M R per compex enry To demonsrae he efficacy of LAMA-I in pracice, we provide error-rae simuaion resus in finie-dimensiona arge-mimo sysems Figure 1 iusraes he performance of LAMA-I in a and arge-mimo sysem (we use he noaion M R M T wih QPSK ransmission, and ransmi impairmens modeed as iid circuary-symmeric compex Gaussian noise [1] We observe significan symbo error-rae (SER improvemens compared o ha of reguar LAMA, which achieves given cerain condiions on he MIMO sysem are me he error-rae performance of he individuayopima (IO daa deecor in absence of ransmi impairmens (see [14], [20] for he deais We emphasize ha LAMA-I enais viruay no compexiy increase (compared o reguar

2 symbo error rae (SER LAMA, no EVM LAMA, EVM LAMA-I, EVM LAMA whiening, EVM IO, EVM average received SNR [db] (a 128 BS anennas and 8 users symbo error rae (SER LAMA, no EVM LAMA, EVM LAMA-I, EVM LAMA whiening, EVM IO, EVM average received SNR [db] (b 128 BS anennas and 128 users Fig 1 Symbo error-rae of LAMA-I in arge-mimo sysems wih QPSK and srong Gaussian ransmi noise (EVM = 10 db LAMA-I enabes significan performance improvemens compared o conveniona LAMA and requires ower compexiy han reguar LAMA wih noise whiening LAMA and achieves he same SER performance of whieningbased approaches, which require prohibiive compuaiona compexiy in arge MIMO sysems B Reevan Prior Ar Channe capaciy expressions for he ransmi-impaired MIMO sysem mode (1 have firs been derived in [1] A corresponding asympoic anaysis has been provided receny in [21], which uses he repica mehod [22] o obain capaciy expressions for arge MIMO sysems The resus in [1], [21] buid upon on he so-caed Gaussian ransmi-noise mode, which assumes ha he ransmi impairmens in e can be modeed as iid addiive Gaussian noise ha is independen of he ransmi signa s Whie he accuracy of his mode for a paricuar RF impemenaion in a MIMO sysem using orhogona frequency-division muipexing (OFDM has been confirmed via rea-word measuremens [1], i may no be accurae for oher RF ransceiver designs and/or moduaion schemes LAMA-I, as proposed in his paper, enabes us o sudy he fundamena performance of more genera ransmi impairmens (which may, for exampe, exhibi saisica dependence wih he ransmi signa and even incude deerminisic non-ineariies, which is in sark conras o he commony used ransmi-noise mode in [1] [11], [21] For he we-esabished Gaussian ransmi-noise mode, we wi show in Secion IV ha he sae-evouion equaions of LAMA-I coincide o he couped fixed poin equaions in [21], which reveas ha LAMA-I is a pracica agorihm ha deivers he same performance as prediced by repica-based capaciy expressions in he arge-sysem imi Daa deecion agorihms in he presence of ransmi impairmens were sudied in [1] The proposed mehods rey on he Gaussian ransmi-noise mode, which enabes one o whien he impaired sysem mode (1 by muipying he received vecor y wih a so-caed whiening marix W = N 0 Q 1 2, where Q = N T HH H + N 0 I M is he covariance marix of he effecive ransmi and receive noise n + He, and N T denoes he variance of he enries of he ransmi-noise vecor e By appying he whiening fier W o he received vecor in (1, we obain he foowing saisicayequivaen, whiened inpu-oupu reaion [1], [2]: ỹ = Hs + ñ, (3 where ỹ = Wy, H = WH, and ñ = W(n + He Opima (as we as subopima daa deecion can hen be performed by considering he whiened sysem mode in (3 Whie such a whiening approach enabes opima daa deecion in conveniona, sma-scae MIMO sysems (see [1] for he deais under he Gaussian ransmi-noise mode, compuaion of he whiening marix W quicky resus in prohibiive compuaiona compexiy in arge-mimo sysems consising of hundreds of receive anennas a siuaion ha arises in massive MIMO [12], [13], [23], an emerging echnoogy for 5G wireess sysems LAMA-I avoids compuaion of he whiening marix W aogeher, which resus in (ofen significany reduced compuaiona compexiy Furhermore, he generaiy of our sysem mode enabes LAMA-I o be resiien o a broader range of ransmi-side impairmens C Noaion Lowercase and uppercase bodface eers designae coumn vecors and marices, respecivey For a marix A, we define is conjugae ranspose o be A H The enry on he k-h row and -h coumn is A k,, and he k-h enry of a vecor a is a k The M M ideniy marix is denoed by I M and he M N a-zeros marix by 0 M N We denoe he averaging operaor by a = 1 N N k=1 a k Muivariae compex-vaued Gaussian probabiiy densiy funcions (PDFs are denoed by CN (m, K, where m represens he mean

3 vecor and K he covariance marix; E X [ ] and Var X [ ] denoe expecaion and variance wih respec o he PDF of he random variabe (RV X, respecivey We use P(X = x o denoe he probabiiy of he RV X being x D Paper Ouine The res of he paper is organized as foows Secion II deais he LAMA-I agorihm aong wih he sae-evouion framework Secion III provides condiions for which LAMA-I achieves he performance of he IO daa deecor Secion IV anayzes he specia case of Gaussian ransmi-noise We concude in Secion V II LAMA-I: LARGE MIMO APPROXIMATE MESSAGE PASSING WITH TRANSMIT IMPAIRMENTS Large MIMO is beieved o be one of he key echnoogies for 5G wireess sysems [24] The main idea is o equip he base saion (BS wih hundreds of anennas whie serving a ens of users simuaneousy and wihin he same frequency band One of he key chaenges in pracica arge MIMO sysems is he high compuaiona compexiy associaed wih daa deecion [25] We nex inroduce LAMA-I, a nove ow-compexiy daa deecion agorihm for arge-mimo sysems ha akes ino accoun ransmi-side impairmens We derive he associaed compex sae-evouion (cse framework, which wi be used in Secions III and IV o esabish condiions for which LAMA-I achieves he errorrae performance of he IO daa deecor for he impaired sysem mode (1 A Summary of he LAMA-I Agorihm In he remainder of he paper, we consider a compexvaued daa vecor s C MT, whose enries are chosen from a discree conseaion O, eg, phase shif keying (PSK or quadraure ampiude moduaion (QAM We furher assume iid priors p(s = M T =1 p(s wih p(s = p a δ(s a, (4 where p a corresponds o he (known prior probabiiy of he conseaion poin a O In he case of uniformy disribued conseaion poins, we have p a = O 1, where O is he cardinaiy of he se O We define he effecive ransmi signa x = s + e, which is disribued as p(x = M T =1 p(x wih p(x = p(x s p(s ds, (5 C where p(x s modes he ransmi-side impairmens We can now rewrie he inpu-oupu reaion (1 as y = Hx + n (6 The key idea behind LAMA-I is o perform daa deecion in wo seps We firs use message passing on he facor graph for he disribuion p(s, x y, H in order o obain he margina disribuion p(s y, H Once he message passing agorihm (a Impaired MIMO sysem wih LAMA-I as he daa deecor (b Equivaen decouped MIMO sysem Fig 2 In he arge-anenna imi, LAMA-I decoupes he impaired MIMO sysem ino M T parae and independen AWGN channes, which aows us o perform impairmen-aware MAP daa deecion, independeny per user converged, we assume ha i converged o he margina disribuion, which aows us o perform maximum a-poseriori (MAP deecion on p(s y, H o obain esimaes ŝ for he ransmi daa signas independeny for every user Since he facor graph for p(s, x y, H is dense, ie, for every enry in he receive vecor y we have a facor ha is conneced o every ransmi symbo x, an exac message passing agorihm is compuaionay expensive However, by expoiing he biparie srucure of he graph and he high dimensionaiy of he probem (ie, boh M T and M R are arge, he enire agorihm can be simpified 1 In paricuar, we simpify our message-passing agorihm using compex Bayesian AMP (cb- AMP as proposed in [14], [20] for he MIMO sysem mode (6 cb-amp cacuaes an esimae for he effecive ransmi signa ˆx, The MAP esimae can hen be cacuaed from ˆx independeny for every user The resuing wo-sep procedure of LAMA-I is iusraed in Fig 2 As iusraed in Fig 2(a, we firs use cb-amp o compue he Gaussian oupu z and he effecive noise variance σ 2 a ieraion Since he Gaussian oupu of cb-amp can be modeed as z = x + w wih w N (0, σ2, being independen from x, s and e, in he arge-sysem imi (see [16] for he deais, he MIMO sysem is effecivey decouped ino a se of M T parae and independen addiive whie Gaussian noise (AWGN channes Fig 2(b shows he equivaen decouped sysem Since he effecive ransmi 1 We refer o [26] for more deais on hese caims

4 signas are defined as x = s + e, = 1,, M T, we have z = s + e + w, (7 which aows us o compue he MAP esimae for each daa symbo independeny using ŝ = arg max p(s z (8 s O Here, he probabiiy p(s z is obained from Bayes rue p(s z p(z s p(s and from p(z s = p(x = z w s p(wdw (9 C The resuing LAMA-I agorihm is summarized as foows Agorihm 1 (LAMA-I Iniiaize ˆx 1 = E X[X], r 1 = y, and τ 1 = β Var X [X]/N 0 wih X p(x as defined in (5 1 Run cb-amp for max ieraions by compuing he foowing seps for = 1, 2,, max : z = ˆx + H H r ˆx +1 = F(z, N 0 (1 + τ τ +1 = β N 0 G(z, N 0 (1 + τ r +1 = y Hˆx +1 + τ τ r The scaar funcions F(z, σ2 and G(z, σ2 operae eemen-wise on vecors, and correspond o he poserior mean and variance, respecivey, defined as F(z, σ 2 = x f(x z, σ 2 dx (10 C G(z, σ 2 = x 2 f(x z, σ 2 dx F(z, σ 2 2 (11 C Here, he message poserior disribuion is f(x z, σ2 1 = Z p(z x, σ 2 p(x, where p(z x, σ 2 CN (x, σ 2 and Z is a normaizaion consan 2 Compue he MAP esimae using (8 for = max wih he poserior PDF p(s z max as defined in (9 and p(w max N (0, σ 2 max The effecive noise variance σ 2 max is esimaed using he posuaed oupu variance N 0 (1 + τ max from cb-amp (see [20, Def 3] B Sae Evouion for LAMA-I Viruay a exising heoreica resus are incapabe of providing performance guaranees for he success of messagepassing on dense graphs In our specific appicaion, however, he srucure of he facor graph of p(s, x y, H enabes us o sudy he associaed heoreica properies in he arge-sysem imi As shown in [20], he effecive noise variance σ 2 can be cacuaed anayicay for every ieraion = 1, 2,, max, using he compex sae evouion (cse recursion In Secion III, we wi use he cse framework o derive opimaiy condiions for which LAMA-I achieves he error-rae performance of he IO daa deecor in (2 The cse for cb-amp is deaied in he foowing heorem Theorem 1 ([20, Thm 3] Suppose ha p(x M T =1 p(x and he enries of H are iid circuary-symmeric compex Gaussian wih variance 1/M R Le n CN (0 MR 1, N 0 I MR and F be a pseudo-lipschiz funcion as defined in [27, Sec 11, Eq 15] Fix he sysem raio β = M T /M R and e M T Then, he effecive noise variance σ 2 +1 of cb-amp a ieraion is given by he foowing cse recursion: σ 2 +1 = N 0 + βψ(σ 2 (12 Here, he mean-squared error (MSE funcion Ψ is defined by Ψ(σ 2 = E X,Z [ F ( X + σ Z, σ 2 X 2 ] (13 wih X p(x, Z CN (0, 1, and F is defined in (10 The cse recursion is iniiaized by σ 2 1 = N 0 + β Var X [X] The cse in Theorem 1 racks he effecive noise variance σ 2 for every ieraion, which enabes us o compue he poserior disribuion (9 required in Sep 2 of Agorihm 1 Remark 1 The poserior mean funcion F and consequeny he MSE funcion Ψ(σ 2 in (13 depend on he effecive ransmi signa prior p(x in (5, which is a funcion of he daa-vecor prior p(s and he condiiona probabiiy p(x s ha modes he ransmi-side impairmens III OPTIMALITY OF LAMA-I We now anayze he opimaiy of LAMA-I for he impaired sysem mode (1 A Opimaiy Quesions The cse framework enabes us o characerize he performance of LAMA-I in he arge-sysem imi In his secion, we use his framework o sudy he opimaiy of LAMA-I In paricuar, we address he foowing wo opimaiy quesions: (i We derived LAMA-I using a message-passing agorihm However, here exiss a broader cass of agorihms o accompish he same ask More specificay, he version of LAMA-I ha uses sum-produc message passing empoys he poserior mean funcion F as defined in (10 One can poeniay change F (or even pick differen funcions a differen ieraions and come up wih esimaes ˆx,, and perform daa deecion by using MAP deecion on o hese new esimaes Such aernaive daa-deecion agorihms can si be anayzed hrough he sae evouion framework The firs opimaiy quesion we can ask is wheher we can improve he performance of LAMA-I by choosing funcions differen o hose we inroduced in (10? As we wi show in Secion III-B, he poserior mean funcions we used in (10 are indeed opima (ii We aso ask ourseves wheher he opima LAMA-I, ie, LAMA-I ha ses F o a poserior mean, achieves he same error-rae performance as he IO daa deecor (2? In wha foows, we wi answer boh of hese quesions in he arge-sysem imi

5 B Opimaiy of Poserior Mean for LAMA-I Consider he foowing generaizaion of LAMA-I, where he poserior mean funcion is repaced wih a genera pseudo- Lipschiz funcion F [16] ha depends on he ieraion sep, ie, where we use ˆx +1 = F (z, N 0 (1 + τ The firs opimaiy quesion we woud ike o address is wheher here exiss a choice for he funcions F 1, F 2,, such ha he resuing daa-deecion agorihm achieves ower probabiiy of error The foowing heorem esabishes he fac ha i is impossibe o improve upon he choice of LAMA-I, where we use he poserior mean Theorem 2 Le he assumpions made in Theorem 1 hod for F 1,, F max Suppose ha we run LAMA-I for max ieraions and hen, perform eemen-wise daa deecion Le ŝ be he esimae we obain for s We denoe he deecion error probabiiy as P F1,,F max (ŝ s o emphasize on he dependence of his probabiiy on he funcions empoyed a every ieraion The choice of F 1,, F max ha minimizes P F1,,F max (ŝ s is he poserior mean empoyed in (10 A deaied version of he proof for his heorem is given in [26] For he sake of breviy, we ony skech he main seps of he proof Since F 1,, F max are pseudo-lipschiz according o Theorem 1, we know ha z max can be modeed as z max = s + e + w max, where w max is Gaussian The effec of F 1,, F max is summarized by he variance of w max I is sraighforward o prove ha he smaer he variance of w max is, he smaer he error probabiiy P F1,,F max (ŝ s wi be Hence, we shoud use a sequence of funcions F 1,, F max ha minimize he variance of w max We can use inducion o esabish ha he poserior mean eads o he minimum variance In he as ieraion max, if he variance of w max 1 is fixed, hen i is sraighforward o prove ha we shoud use he poserior mean in he as ieraion o minimize he variance of w max By empoying inducion and by foowing he same ine of argumenaion, we can show ha F 1,, F max mus a be he poserior mean We now use he cse framework in Theorem 1 o esabish condiions for which LAMA-I is opima We consider he case where he number of ieraions max for which, as expained in [20, Sec IV], he cse recursion (12 converges o he foowing fixed-poin equaion: σ 2 = N 0 + βψ(σ 2 (14 This equaion can in genera have one or more fixed poins If i has more han one fixed poin, hen LAMA-I may converge o differen fixed poins, depending on is iniiaizaion [28] As he firs sep oward proving ha LAMA-I is opima, we derive condiions under which he fixed poin equaion (14 has a unique souion To esabish such condiions, we firs define he foowing quaniies (aso see [14, Defs 1-4] Definiion 1 For a given ransmi daa-vecor prior p(s and ransmi-impairmen disribuion p(x s, we define he exac recovery hreshod (ERT β max and he minimum recovery hreshod (MRT β min as { (Ψ(σ 2 1 } { (dψ(σ 2 1 } β max = min σ 2 >0 σ 2, β min = min σ 2 >0 dσ 2 The minimum criica noise N0 min (β is defined as { } N0 min (β = min σ 2 βψ(σ 2 : β dψ(σ2 σ 2 >0 dσ 2 = 1, and he maximum guaraneed noise N0 max (β is defined as { } N0 max (β = max σ 2 βψ(σ 2 : β dψ(σ2 σ 2 >0 dσ 2 = 1 Using Definiion 1, he foowing heorem esabishes severa regimes in which he fixed poin of LAMA-I is unique Lemma 3 (Opimaiy Condiions of LAMA-I Le he assumpions made in Theorem 1 hod and e max Fix p(s and p(x s If he variance of he receive noise N 0 and sysem raio β are in one of he foowing hree regimes: 1 β ( 0, β min] and N 0 R + 2 β ( β min, β max and N 0 [ 0, N0 min (β (N0 max (β, 3 β [β max, and N 0 (N0 max (β, hen LAMA-I soves he opima probem The proof foows from [14, Tabe II] Noe ha for LAMA-I, he quaniies in Definiion 1 do no ony depend on he daa-vecor prior p(s, bu aso on he ransmi-impairmen disribuion p(x s (cf Remark 1 C LAMA-I vs Individuay Opima (IO Daa Deecion We now show ha in he arge-sysem imi, LAMA-I achieves he error-rae performance of he IO daa deecor (2, if he fixed-poin equaion (14 has a unique fixed poin As wi be cear from our argumens, even in cases where LAMA-I does no have a unique fixed poin, one of is fixed poins corresponds o he souion of IO I is, however, difficu o find a suiabe agorihm iniiaizaion ha woud cause our mehod o converge o he opima fixed poin The core of our opimaiy anaysis is he resu on he performance of IO daa deecion based on he repica anaysis presened in [29] The repica anaysis for IO daa deecion makes he foowing assumpion abou ŝ IO Definiion 2 The IO souion is said o saisfy hard-sof assumpion, if and ony if here exis a funcion D : R O, whose se of disconinuiies has Lebesgue measure zero and ŝ IO = D(E(s y, H For some popuar conseaion ses, we can prove ha he hard-sof assumpion is in fac rue For exampe, for equiprobabe BPSK conseaion poins, we have E(s y, H = P(s = 1 y, H P(s = 1 y, H,

6 and hence, ŝ IO = sign(e(s y, H The nex heorem esabishes condiions for which LAMA-I achieves he performance of he IO daa deecor Theorem 4 Suppose ha he IO souion saisfies he hardsof assumpion Furhermore, assume ha he assumpions underying he repica symmery in [29] are correc Then, under a he condiions of Lemma 3 and in he argesysem imi, he error probabiiy of LAMA-I is he same as probabiiy of error of he IO daa deecor For he sake of breviy, we ony presen a proof skech; see [26] for he proof deais From he hard-sof assumpion we reaize ha in order o characerize he probabiiy of error of he IO daa deecor, we have o characerize he join disribuion of (s, E(s y, H Noe ha in [29] he imiing disribuion of (x, E(x y, H is cacuaed A simiar approach wi work for our probem oo However, we have o sighy modify he probem and make i coser o he one in [29] As he firs sep, we firs derive he imiing disribuion of (s, x, E(s y, H Noe ha he join disribuion of (s, x is known Furhermore, s x y form a Markov chain Hence, s x E(x y, H is a Markov chain, and condiioned on x, he wo quaniies s and E(x y, H are independen This impies ha in order o characerize he disribuion of (s, x, E(s y, H, we ony need o characerize he disribuion of (x, E(s y, H Furhermore, we have E(s y, H = E(s x dp(x y, H Define L(x = E(s x Our origina probem of characerizing he imiing disribuion of (s, E(s y, H is simpified o characerizing he imiing disribuion of (x, E(L(x y, H This aer probem can be soved by he repica mehod as expained in [22] The fina resu is he foowing: he join disribuion of (s, x, E(s y, H converges o (S, X, E(S X+ σz, where S p(s, X S = s p(x s, Z N(0, 1 and is independen of boh S and X, and finay σ saisfies he fixed poin equaion σ 2 = N 0 + βψ( σ 2 (15 Noe ha his is he same fixed poin equaion as he one we have for LAMA-I (14 Hence, whenever (15 has a unique fixed poin, he repica anaysis and LAMA-I wi necessariy ead o he same souion So far, we have shown ha he effecive noise eve is he same for LAMA-I and IO I is sraighforward o show ha since he effecive noise eves are he same, he error probabiiy of boh schemes is he same For he deais, refer o our journa paper [26] IV LAMA-I FOR THE GAUSSIAN TRANSMIT-NOISE MODEL Theorem 2, Lemma 3, and Theorem 4 as given above hod for genera ransmi-impairmen disribuions p(x s We now focus on he we-esabished Gaussian ransminoise mode [1], [3] In paricuar, we sar by providing he remaining LAMA-I agorihm deais and hen, derive more specific condiions for which LAMA-I is opima We furhermore provide simuaion resus for finie-dimensiona sysems A Agorihm Deais We assume e CN (0, N T I MT, where e is independen from s and n, and N T is he ransmi-noise power The foowing emma provides he remaining deais for Agorihm 1 wih his mode The proof is given in Appendix A Lemma 5 Assume he MIMO sysem in (1 wih e CN (0, N T I MT being independen of s and n For Sep 1 of Agorihm 1, he probabiiy disribuion p(x is given by p(x = p a 1 πn T exp ( 1NT x a 2 The poserior mean F and variance G funcion corresponds o F(z, σ 2 = N T N T + σ 2 z σ 2 + N T + σ 2 w a a, G(z, σ 2 = N Tσ 2 N T + σ 2 + N T z w + σ2 2 a a N T + σ 2 F(z, σ 2, respecivey, wih w a = p a exp p a exp ( z a 2 N T+σ ( 2 z a 2 N T+σ 2 (16 For Sep 2, he MAP esimaor (8 is given by ( z max a 2 ŝ = arg min N T + N 0 (1 + τ max og p a (17 For he Gaussian ransmi-noise mode, we see ha LAMA-I ony requires a few sube modificaions o he funcions F and G compared o reguar LAMA [20, Ag 1], which ignores ransmi-side impairmens Hence, making LAMA robus o he Gaussian ransmi-noise impairmens comes a viruay no expense in erms of compexiy, bu resus in ofen significan performance improvemens (cf Secion IV-C B Opimaiy Condiions The opimaiy condiions in Lemma 3, which depend on he sysem raio β, receive noise variance N 0, as we as he signa prior and he ransmi-impairmen mode, can be obained via he fixed-poin equaion in (14 I can be shown ha for he Gaussian ransmi noise mode, he fixed-poin equaion (14 is equivaen o he couped fixed poin equaions derived in [21, Eqs 48 and 49], which have been used o characerize he capaciy of he impaired sysem (1 Whie he resus in [21] have been obained via he repica mehod [22], LAMA-I provides a pracica agorihm ha achieves he same performance in he arge-sysem imi

7 The foowing emma provides a condiion for which LAMA-I is opima Our condiion is independen of he receive noise variance N 0 and he ransmi-noise power N T The proof is given in Appendix B Lemma 6 Le he assumpions in Theorem 1 hod and suppose ha he IO souion saisfies he hard-sof assumpion Define βm min = min NT β min (N T Furhermore, assume he Gaussian ransmi-noise mode If β βm min, hen LAMA-I is opima This emma impies ha here is a hreshod βm min on he sysem raio β ha enabes LAMA-I o achieve he same error-rae performance as he IO daa deecor in he argesysem imi Noe ha his condiion is independen of he receive and ransmi noise eves N 0 and N T, respecivey C Simuaion Resus We now demonsrae he efficacy of LAMA-I for he Gaussian ransmi-noise mode in more reaisic, finie-dimensiona arge-mimo sysems We define he average receive signao-noise-raio (SNR as SNR = E [ Hs 2] E [ n 2 ] = β E s N 0, where E s = E [ s 2] We aso define he so-caed errorvecor magniude (EVM as EVM = E [ e 2] E [ s 2 ] = N T E s Figures 1(a and 1(b iusrae he symbo error rae (SER simuaion resus for arge MIMO sysems wih QPSK moduaion, Gaussian ransmi-noise, and wo anenna configuraions, ie, and In boh figures, he soid bue ine corresponds o he performance of reguar LAMA [14], [20] in absence of ransmi noise (ie, EVM = db As shown by he dashed red ine, reguar LAMA experiences a significan performance oss in he presence of ransmi noise wih EVM = 10 db In conras, LAMA-I (indicaed wih he dash-doed magena ine yieds significan performance improvemens (he maximum number of LAMA-I ieraions for and was max = 10 and max = 15, respecivey The soid green ine shows he opima arge-sysem imi performance As i can be seen, LAMA-I cosey approaches he opimum SER performance for finie-dimensiona sysems Figures 1(a and 1(b furhermore compare LAMA-I o reguar LAMA operaing on he whiened sysem (3 shown by he doed back ine Whie boh approaches achieve nearopima performance, he whiening-based approach enais prohibiive compexiy, mainy caused by he inverse marix square roo In addiion, he whiening-based approach is designed specificay for he Gaussian ransmi-noise mode; in conrary, LAMA-I is appicabe o a broader range of rea-word ransmi-side impairmens V CONCLUSION We have inroduced LAMA-I, a nove, compuaionay efficien daa deecion agorihm suiabe for arge-mimo sysems ha are affeced by a broad range of ransmi-side impairmens We have deveoped condiions in he argesysem imi for which LAMA-I achieves he error rae performance of he individuay opima (IO daa deecor For he specia case of he Gaussian ransmi-noise mode and for pracica anenna configuraions, we have demonsraed ha LAMA-I enabes significan performance improvemens compared o impairmen-agnosic agorihms a viruay no overhead in erms of compuaiona compexiy As a consequence, LAMA-I is a pracica daa-deecion agorihm ha renders pracica arge-mimo sysems more resiien o user equipmen ha suffers from srong ransmi-side impairmens APPENDIX A DERIVATION OF F AND G FOR GAUSSIAN TRANSMIT NOISE We firs derive p(x as used in Sep 1 of Agorihm 1 From (4 and he Gaussian ransmi-noise mode e CN (0, N T I MT, which assumes independence from s, we can wrie effecive ransmi signa prior (5 as foows: ( 1 p(x = exp 1 s x 2 p a δ(s ads C πn T N T = 1 p a exp ( 1NT x a 2 πn T Wih his resu, we can wrie he message poserior disribuion f(x ˆx, σ 2 defined in Sep 1 of Agorihm 1 as: f(x z, σ 2 1 = Zπ 2 N T σ 2 p a exp ( z a 2 N T + σ 2 ( exp N T + σ 2 N T σ 2 x N Tz + σ2 a 2 N T + σ 2 Here he normaizaion consan Z is chosen so ha C f(x ˆx, σ 2 dx = 1, which can be compued as: Z = 1 p a ( π(n T + σ 2 exp z a 2 N T + σ 2 Therefore, he poserior mean F(z, σ2 in (10 is given by: F(z, σ 2 = x f(x z, σ 2 dx = N T z w + σ2 a a C N T + σ 2, wih he shorhand noaion (16 The message variance G(z, σ2 defined in (11 can be derived simiary For Sep 2 of Agorihm 1, he effecive noise w max is disribued as p(w max CN (0, N 0 (1 + τ max wih saisica independence from he ransmi-noise mode e CN (0, N T, which yieds p(w max + e CN (0, N 0 (1 + τ max + N T Wih his resu and reaion (7, we have p(z max s CN (s, N 0 (1 + τ max + N T, which ogeher wih (4, yieds he foowing poserior disribuion:

8 p(s z max p(s p(z max s = δ(s a π(n T + N 0 (1 + τ max ( z max s 2 exp (18 N T + N 0 (1 + τ max Using he poserior disribuion given in (18, we now compue he MAP esimaor (8: ( z max s 2 ŝ = arg max δ(s a p a exp s O N T + N 0 (1 + τ max ( z max a 2 = arg min N T + N 0 (1 + τ max og p a APPENDIX B PROOF OF LEMMA 6 If β min NT β min (N T, hen β βm min β min (N T for any N T As a resu, by Lemma 3, LAMA-I achieves he performance of he IO probem (2 for any N 0 and N T REFERENCES [1] C Suder, M Wenk, and A Burg, MIMO ransmission wih residua ransmi-rf impairmens, in In ITG Workshop on Smar Anennas (WSA, Feb 2010, pp [2], Sysem-eve impicaions of residua ransmi-rf impairmens in MIMO sysems, in Proc European Conf on Anennas and Propagaion (EUCAP, Apr 2011, pp [3] T C Schenk, RF imperfecions in high-rae wireess sysems: impac and digia compensaion Springer Neherands, 2008 [4] T C Schenk, P F Smuders, and E R Fedderus, Performance of MIMO OFDM sysems in fading channes wih addiive TX and RX impairmens, in Proc IEEE BENELUX/DSP Vaey Signa Process Symp, Apr 2005, pp [5] B Goransson, S Gran, E Larsson, and Z Feng, Effec of ransmier and receiver impairmens on he performance of MIMO in HSDPA, in Proc IEEE In Workshop Signa Process Advances Wireess Commun (SPAWC, Ju 2008, pp [6] H Suzuki, T V A Tran, I B Coings, G Danies, and M Hedey, Transmier noise effec on he performance of a MIMO-OFDM hardware impemenaion achieving improved coverage, IEEE J Se Areas Commun, vo 26, no 6, pp , Aug 2008 [7] H Suzuki, I B Coings, M Hedey, and G Danies, Pracica performance of MIMO-OFDM-LDPC wih ow compexiy doube ieraive receiver, in Proc IEEE In Symp Persona, Indoor, Mobie Radio Commun (PIMRC, Sep 2009, pp [8] J P Gonzáez-Coma, P M Casro, and L Casedo, Impac of ransmi impairmens on muiuser MIMO non-inear ransceivers, in In ITG Workshop on Smar Anennas (WSA, Feb 2011, pp 1 8 [9], Transmi impairmens infuence on he performance of MIMO receivers and precoders, in Proc European Wireess Conf Susainabe Wireess Techno (European Wireess, Apr 2011, pp 1 8 p a [10] E Bjornson, P Zeerberg, M Bengsson, and B Oersen, Capaciy imis and muipexing gains of MIMO channes wih ransceiver impairmens, IEEE Commun Le, vo 17, no 1, pp 91 94, Jan 2013 [11] X Zhang, M Mahaiou, E Bjornson, M Codrey, and M Debbah, On he MIMO capaciy wih residua ransceiver hardware impairmens, in Proc IEEE In Conf Commun (ICC, Jun 2014, pp [12] F Rusek, D Persson, B K Lau, E G Larsson, T L Marzea, O Edfors, and F Tufvesson, Scaing up MIMO: Opporuniies and chaenges wih very arge arrays, IEEE Signa Process Mag, vo 30, no 1, pp 40 60, Jan 2013 [13] T L Marzea, Noncooperaive ceuar wireess wih unimied numbers of base saion anennas, IEEE Trans Wireess Commun, vo 9, no 11, pp , Nov 2010 [14] C Jeon, R Ghods, A Maeki, and C Suder, Opimaiy of arge MIMO deecion via approximae message passing, in Proc IEEE In Symp Inf Theory (ISIT, Jun 2015, pp [15] D L Donoho, A Maeki, and A Monanari, Message-passing agorihms for compressed sensing, Proc Na Acad Sci USA, vo 106, no 45, pp , Nov 2009 [16] A Monanari, Graphica modes conceps in compressed sensing, Compressed Sensing (YC Edar and G Kuyniok, eds Cambridge Universiy Press, 2012 [17] A Maeki, Approximae message passing agorihms for compressed sensing, PhD disseraion, Sanford Universiy, Jan 2011 [18] D Donoho, A Maeki, and A Monanari, Message passing agorihms for compressed sensing: I Moivaion and consrucion, in Proc IEEE Inf Theory Workshop (ITW, Jan 2010, pp 1 5 [19], Message passing agorihms for compressed sensing: II Anaysis and vaidaion, in Proc IEEE Inf Theory Workshop (ITW, Jan 2010, pp 1 5 [20] C Jeon, R Ghods, A Maeki, and C Suder, Opima daa deecion in arge MIMO, in preparaion for a journa [21] M Vehkaperä, T Riihonen, M A Girnyk, E Björnson, M Debbah, L K Rasmussen, and R Wichman, Asympoic anaysis of SU-MIMO channes wih ransmier noise and mismached join decoding, IEEE Trans Commun, vo 32, no 6, pp , Mar 2015 [22] H Nishimori, Saisica physics of spin gasses and informaion processing: an inroducion Oxford Universiy Press, 2001, no 111 [23] E Larsson, O Edfors, F Tufvesson, and T Marzea, Massive MIMO for nex generaion wireess sysems, IEEE Commun Mag, vo 52, no 2, pp , Feb 2014 [24] J Andrews, S Buzzi, W Choi, S Hany, A Lozano, A Soong, and J Zhang, Wha wi 5G be? IEEE J Se Areas Commun, vo 32, no 6, pp , Jun 2014 [25] M Wu, B Yin, A Vosoughi, C Suder, J Cavaaro, and C Dick, Approximae marix inversion for high-hroughpu daa deecion in he arge-scae MIMO upink, in Proc IEEE In Symp Circuis and Sys (ISCAS, May 2013, pp [26] R Ghods, C Jeon, A Maeki, and C Suder, Daa dececion and esimaion wih inpu noise, in preparaion for a journa [27] M Bayai and A Monanari, The dynamics of message passing on dense graphs, wih appicaions o compressed sensing, IEEE Trans Inf Theory, vo 57, no 2, pp , Feb 2011 [28] L Zheng, A Maeki, X Wang, and T Long, Does p-minimizaion ouperform 1 -minimizaion? arxiv preprin: , Jan 2015 [29] D Guo and S Verdú, Randomy spread CDMA: Asympoics via saisica physics, IEEE Trans Inf Theory, vo 51, no 6, pp , Jun 2005

2 Weighted Residual Methods

2 Weighted Residual Methods 2 Weighed Residua Mehods Fundamena equaions Consider he probem governed by he differenia equaion: Γu = f in. (83) The above differenia equaion is soved by using he boundary condiions given as foows: u

More information

Analog Network Coding in General SNR Regime

Analog Network Coding in General SNR Regime Anaog Nework Coding in Genera SNR Regime Samar Agnihori, Sidharh Jaggi, and Minghua Chen Deparmen of Informaion Engineering, The Chinese Universiy of Hong Kong, Hong Kong Emai: {samar, jaggi, minghua}@ie.cuhk.edu.hk

More information

Research Article Developing a Series Solution Method of q-difference Equations

Research Article Developing a Series Solution Method of q-difference Equations Appied Mahemaics Voume 2013, Arice ID 743973, 4 pages hp://dx.doi.org/10.1155/2013/743973 Research Arice Deveoping a Series Souion Mehod of q-difference Equaions Hsuan-Ku Liu Deparmen of Mahemaics and

More information

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2 Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.

More information

STBC CDMA System Simulation in MIMO Channels with Correlative Model

STBC CDMA System Simulation in MIMO Channels with Correlative Model 9 Inernaiona Conference on Compuaiona Ineigence Modeing and Simuaion STBC CDMA Sysem Simuaion in MIMO Channes wih Correaive Mode Mehdi Rahmai Eecrica Engineering Deparmen Iran Universiy of Science and

More information

Linear MIMO Precoding in Jointly-Correlated Fading Multiple Access Channels with Finite Alphabet Signaling

Linear MIMO Precoding in Jointly-Correlated Fading Multiple Access Channels with Finite Alphabet Signaling Linear MIMO Precoding in Joiny-Correaed Fading Muipe Access Channes wih Finie Aphabe Signaing Yongpeng Wu, Chao-Kai Wen, Chengshan Xiao, Xiqi Gao, and Rober Schober arxiv:14015401v1 csit] 21 Jan 2014 Absrac

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

Reinforcing a Matroid to Have k Disjoint Bases

Reinforcing a Matroid to Have k Disjoint Bases Appied ahemaics 2 244-249 doi:4236/am233 Pubished Onine Sepember 2 (hp://wwwscirporg/journa/am) Reinforcing a aroid o Have Disjoin Bases Absrac Hong-Jian Lai 2 Ping Li 2 Yaning Liang 2 Jinquan Xu 3 Coege

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

Optimality of Large MIMO Detection via Approximate Message Passing

Optimality of Large MIMO Detection via Approximate Message Passing ptimality of Large MIM Detection via Approximate Message Passing Charles Jeon, Ramina Ghods, Arian Maleki, and Christoph Studer arxiv:5.695v [cs.it] ct 5 Abstract ptimal data detection in multiple-input

More information

CHAPTER 2 Signals And Spectra

CHAPTER 2 Signals And Spectra CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Introduction to Probability and Statistics Slides 4 Chapter 4

Introduction to Probability and Statistics Slides 4 Chapter 4 Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

EE3723 : Digital Communications

EE3723 : Digital Communications EE373 : Digial Communicaions Week 6-7: Deecion Error Probabiliy Signal Space Orhogonal Signal Space MAJU-Digial Comm.-Week-6-7 Deecion Mached filer reduces he received signal o a single variable zt, afer

More information

st semester. Kei Sakaguchi

st semester. Kei Sakaguchi 0 s semeser MIMO Communicaion Sysems #5: MIMO Channel Capaciy Kei Sakaguchi ee ac May 7, 0 Schedule ( s half Dae Tex Conens # Apr. A-, B- Inroducion # Apr. 9 B-5, B-6 Fundamenals

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Some new classes of generalized Lagrange-based Apostol type Hermite polynomials

Some new classes of generalized Lagrange-based Apostol type Hermite polynomials Preprins www.preprins.org NOT PEER-REVIEWED Posed: 19 Juy 2018 Some new casses of generaized Lagrange-based Aposo ype Hermie poynomias Waseem A. Khan 1 and Nisar K S 2 1 Deparmen of Mahemaics, Facuy of

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

(a) (b) (c) Pulse Duration (s) Natural Time ( χ) Pulse Duration (s) A different time domain (a.u.) E (10-6 V/m)

(a) (b) (c) Pulse Duration (s) Natural Time ( χ) Pulse Duration (s) A different time domain (a.u.) E (10-6 V/m) a) 70 60 50 40 30 20 0 0-0 -20 0 50 00 50 200 250 300 350 400 E 0-6 V/m) b) 20 Conveniona Time s) Puse Duraion s) 5 0 5 c) 0 20 /6 /3 /2 2/3 5/6 aura Time χ) Puse Duraion s) 5 0 5 0 /6 /3 /2 2/3 5/6 A

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

NULL DISTRIBUTION OF MULTIPLE CORRELATION COEFFICIENT UNDER MIXTURE NORMAL MODEL

NULL DISTRIBUTION OF MULTIPLE CORRELATION COEFFICIENT UNDER MIXTURE NORMAL MODEL IJMMS 3:4 49 55 PII. S67838 hp://ijmms.hindawi.com Hindawi Pubishing Corp. NULL DISTRIBUTION OF MULTIPLE CORRELATION COEFFICIENT UNDER MIXTURE NORMAL MODEL HYDAR ALI and DAYA K. NAGAR Received 4 Apri The

More information

Introduction to Simulation - Lecture 16. Methods for Computing Periodic Steady-State - Part II Jacob White

Introduction to Simulation - Lecture 16. Methods for Computing Periodic Steady-State - Part II Jacob White Inroducion o Simuaion - ecure 6 Mehods for Compuing Periodic Seady-Sae - Par II Jacob Whie hanks o Deepak Ramaswamy, Micha Rewienski, and Karen Veroy Ouine hree Mehods so far ime inegraion uni seady-sae

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Problem Formulation in Communication Systems

Problem Formulation in Communication Systems Problem Formulaion in Communicaion Sysems Sooyong Choi School of Elecrical and Elecronic Engineering Yonsei Universiy Inroducion Problem formulaion in communicaion sysems Simple daa ransmission sysem :

More information

Conditional Approximate Message Passing with Side Information

Conditional Approximate Message Passing with Side Information Condiional Approximae Message Passing wih Side Informaion Dror Baron Dp. Elecrical & Comp. Eng. NC Sae Universiy Anna Ma Ins. Mah. Sciences Claremon Grad. U. Deanna Needell Dp. Mahemaics UCLA Cynhia Rush

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

A SOLUTION TO THE WATERMARK DETECTION PROBLEM BASED ON BAYESIAN ESTIMATION AND EM ALGORITHM

A SOLUTION TO THE WATERMARK DETECTION PROBLEM BASED ON BAYESIAN ESTIMATION AND EM ALGORITHM 7h European Signa Processing Conference (EUSIPCO 2009) Gasgow, Scoand, Augus 24-28, 2009 A SOLUTION TO THE WATERMARK DETECTION PROBLEM BASED ON BAYESIAN ESTIMATION AND EM ALGORITHM Akio Miyazaki Facuy

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

Tight Results on Minimum Entropy Set Cover

Tight Results on Minimum Entropy Set Cover Tigh Resus on Minimum Enropy Se Cover Jean Cardina Samue Fiorini Gwenaë Jore Absrac In he minimum enropy se cover probem, one is given a coecion of k ses which coecivey cover an n-eemen ground se. A feasibe

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Sublinear Estimation of a Single Element in Sparse Linear Systems

Sublinear Estimation of a Single Element in Sparse Linear Systems Subinear Esimaion of a Singe Eemen in Sparse Linear Sysems Niin Shyamkumar, Siddharha Banerjee, Peer Lofgren Absrac We presen a fas bidireciona agorihm for esimaing a singe eemen of he produc of a marix

More information

Simultaneous Localisation and Mapping. IAR Lecture 10 Barbara Webb

Simultaneous Localisation and Mapping. IAR Lecture 10 Barbara Webb Simuaneous Locaisaion and Mapping IAR Lecure 0 Barbara Webb Wha is SLAM? Sar in an unknown ocaion and unknown environmen and incremenay buid a map of he environmen whie simuaneousy using his map o compue

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2 Financial Economerics Kalman Filer: some applicaions o Finance Universiy of Evry - Maser 2 Eric Bouyé January 27, 2009 Conens 1 Sae-space models 2 2 The Scalar Kalman Filer 2 21 Presenaion 2 22 Summary

More information

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

LECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS

LECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS LECTURE : GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS We will work wih a coninuous ime reversible Markov chain X on a finie conneced sae space, wih generaor Lf(x = y q x,yf(y. (Recall ha q

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

On the MIMO Capacity with Residual Transceiver Hardware Impairments

On the MIMO Capacity with Residual Transceiver Hardware Impairments On he MIMO Capaciy wih Residual Transceiver Hardware Impairmens Xinlin Zhang, Michail Mahaiou, Emil Björnson, Mikael Coldrey, and Mérouane Debbah Deparmen of Signals and Sysems, Chalmers Universiy of Technology,

More information

Orthogonal Rational Functions, Associated Rational Functions And Functions Of The Second Kind

Orthogonal Rational Functions, Associated Rational Functions And Functions Of The Second Kind Proceedings of he World Congress on Engineering 2008 Vol II Orhogonal Raional Funcions, Associaed Raional Funcions And Funcions Of The Second Kind Karl Deckers and Adhemar Bulheel Absrac Consider he sequence

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM Name: UNIVERSIY OF CALIFORNIA College of Engineering Deparmen of Elecrical Engineering and Compuer Sciences Professor David se EECS 121 FINAL EXAM 21 May 1997, 5:00-8:00 p.m. Please wrie answers on blank

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

Lecture 9: September 25

Lecture 9: September 25 0-725: Opimizaion Fall 202 Lecure 9: Sepember 25 Lecurer: Geoff Gordon/Ryan Tibshirani Scribes: Xuezhi Wang, Subhodeep Moira, Abhimanu Kumar Noe: LaTeX emplae couresy of UC Berkeley EECS dep. Disclaimer:

More information

How to Deal with Structural Breaks in Practical Cointegration Analysis

How to Deal with Structural Breaks in Practical Cointegration Analysis How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural

More information

Solving the Inverse Problems of Wave Equation by a Boundary Functional Method

Solving the Inverse Problems of Wave Equation by a Boundary Functional Method Journa of Shipping and Ocean Engineering 6 (7) 33-49 doi.765/59-5879/7.6. D DAVID PUBLISHING Soving he Inverse Probems of Wave Equaion by a Boundary Funciona Mehod Chein-Shan Liu and Yung-Wei Chen 3. Cener

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

arxiv: v1 [cs.gt] 27 Jan 2016

arxiv: v1 [cs.gt] 27 Jan 2016 Providing Probabiisic Robusness Guaranee for Crowdsensing arxiv:1601.07341v1 [cs.gt] 27 Jan 2016 Yuben Qu, Shaojie Tang, Chao Dong, Peng Li #, Song Guo #, Chang Tian Coege of Communicaions Engineering,

More information

Excel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand

Excel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338

More information

Research Article Asymptotic Method of Solution for a Problem of Construction of Optimal Gas-Lift Process Modes

Research Article Asymptotic Method of Solution for a Problem of Construction of Optimal Gas-Lift Process Modes Hindawi Pubishing Corporaion Mahemaica Probems in Engineering Voume 21, Arice ID 19153, 1 pages doi:1.1155/21/19153 Research Arice Asympoic Mehod of Souion for a Probem of Consrucion of Opima Gas-Lif Process

More information

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006 2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.

More information

A Two Stage Mixture Model for Predicting EAD

A Two Stage Mixture Model for Predicting EAD A wo Sage Mixure Mode for Predicing EAD Credi Scoring & Credi Conro, Edinburgh 2013 Mindy Leow & Jonahan Crook Credi Research Cenre, Universiy of Edinburgh, UK 1 Moivaion Reguaory Capia ase II requires

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Some Ramsey results for the n-cube

Some Ramsey results for the n-cube Some Ramsey resuls for he n-cube Ron Graham Universiy of California, San Diego Jozsef Solymosi Universiy of Briish Columbia, Vancouver, Canada Absrac In his noe we esablish a Ramsey-ype resul for cerain

More information

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion

More information

Delay Analysis of Maximum Weight Scheduling in Wireless Ad Hoc Networks

Delay Analysis of Maximum Weight Scheduling in Wireless Ad Hoc Networks Deay Anaysis o Maximum Weigh Scheduing in Wireess Ad Hoc Neworks The MIT Facuy has made his arice openy avaiabe. Pease share how his access beneis you. Your sory maers. Ciaion As Pubished Pubisher ong

More information

On the distribution of the residual cross-correlations between two uncorrelated infinite order vector autoregressive series

On the distribution of the residual cross-correlations between two uncorrelated infinite order vector autoregressive series On he disribuion of he residua cross-correaions beween wo uncorreaed infinie order vecor auoregressive series Chafik Bouhaddioui Roch Roy CRM-2924 June 2003 This work was suppored by grans o he second

More information

An Introduction to Malliavin calculus and its applications

An Introduction to Malliavin calculus and its applications An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

Cash Flow Valuation Mode Lin Discrete Time

Cash Flow Valuation Mode Lin Discrete Time IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics

More information

Y 0.4Y 0.45Y Y to a proper ARMA specification.

Y 0.4Y 0.45Y Y to a proper ARMA specification. HG Jan 04 ECON 50 Exercises II - 0 Feb 04 (wih answers Exercise. Read secion 8 in lecure noes 3 (LN3 on he common facor problem in ARMA-processes. Consider he following process Y 0.4Y 0.45Y 0.5 ( where

More information

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed 535 SOFT-DECSON THRESHOLD DECODNG OF CONVOLUTONAL CODES R.M.F. Goodman*, B.Sc., Ph.D. W.H. Ng*, M.S.E.E. Sunnnary Exising majoriy-decision hreshold decoders have so far been limied o his paper a new mehod

More information

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004 ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform

More information

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,

More information

Generalized Least Squares

Generalized Least Squares Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

Estimation of Poses with Particle Filters

Estimation of Poses with Particle Filters Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU

More information

Sensors, Signals and Noise

Sensors, Signals and Noise Sensors, Signals and Noise COURSE OUTLINE Inroducion Signals and Noise: 1) Descripion Filering Sensors and associaed elecronics rv 2017/02/08 1 Noise Descripion Noise Waveforms and Samples Saisics of Noise

More information

A Beam Propagation Method for Analysis of Er-doped Planar Devices

A Beam Propagation Method for Analysis of Er-doped Planar Devices Proceedings of he 5h WSEAS In. Conf. on Appied Eecromagneics, Wireess and Opica Communicaions, Corfu, Greece, Augus 3-5, 005 (pp37-4) A Beam Propagaion Mehod for Anaysis of Er-doped Panar Devices H. Shahrasbi,

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux Gues Lecures for Dr. MacFarlane s EE3350 Par Deux Michael Plane Mon., 08-30-2010 Wrie name in corner. Poin ou his is a review, so I will go faser. Remind hem o go lisen o online lecure abou geing an A

More information

Empirical Process Theory

Empirical Process Theory Empirical Process heory 4.384 ime Series Analysis, Fall 27 Reciaion by Paul Schrimpf Supplemenary o lecures given by Anna Mikusheva Ocober 7, 28 Reciaion 7 Empirical Process heory Le x be a real-valued

More information

Propagation of Singularities in One-Dimensional Thermoelasticity

Propagation of Singularities in One-Dimensional Thermoelasticity JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 647 998 ARTICLE NO AY98597 Propagaion of Singuariies in One-Dimensiona Thermoeasiciy Reinhard Racke Facuy of Mahemaics and Compuer Science, Uniersiy of

More information

Class Meeting # 10: Introduction to the Wave Equation

Class Meeting # 10: Introduction to the Wave Equation MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion

More information

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t M ah 5 2 7 Fall 2 0 0 9 L ecure 1 0 O c. 7, 2 0 0 9 Hamilon- J acobi Equaion: Explici Formulas In his lecure we ry o apply he mehod of characerisics o he Hamilon-Jacobi equaion: u + H D u, x = 0 in R n

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

Lecture 24. Calderon-Zygmund Decomposition Technique: Cube decomposition

Lecture 24. Calderon-Zygmund Decomposition Technique: Cube decomposition Lecure 24 May 3 h, 2004 Our moivaion for his as ecure in he course is o show a resu using our reguariy heory which is oherwise unprovabe using cassica echniques. This is he previous Theorem, and in paricuar

More information

Affine term structure models

Affine term structure models Affine erm srucure models A. Inro o Gaussian affine erm srucure models B. Esimaion by minimum chi square (Hamilon and Wu) C. Esimaion by OLS (Adrian, Moench, and Crump) D. Dynamic Nelson-Siegel model (Chrisensen,

More information