Regularized Blind Detection for MIMO Communications

Size: px
Start display at page:

Download "Regularized Blind Detection for MIMO Communications"

Transcription

1 Regularized Blind Deecion for MIMO Communicaions Yuejie Chi, Yiyue Wu and Rober Calderbank Deparmen of Elecrical Engineering Princeon Universiy Princeon, NJ 08544, USA ychi, yiyuewu, Absrac Muliple-Inpu Muliple-Oupu (MIMO) sysems improve he hroughpu and reliabiliy of wireless communicaions. Perfec Channel Sae Informaion (CSI) is needed a he receiver o perform coheren deecion and achieve he opimal gain of he sysem. In fas fading and low SNR regimes, i is hard or impossible o obain perfec CSI, which leads he receiver o operae wihou knowledge of he CSI and perform blind deecion. In realiy CSI may be available o he receiver bu his CSI may be insufficien o suppor coheren deecion. In his paper, we fill he gap beween coheren and blind deecion by considering a more realisic model where he receiver knows he saisics of he channel, ha is Channel Disribuion Informaion (CDI). We propose a new deecion algorihm, called Regularized Blind Deecion (RBD), where coheren and blind deecion can be viewed as special cases in our model. The algorihm esimaes CDI from any raining symbols ha are available and maximizes performance given he esimaed CDI. Simulaions demonsrae significan improvemen in performance over blind deecion. Our work can be viewed as a sysemaic exploraion of space beween coheren and blind deecion wih a srong Bayesian saisic flavor. I. INTRODUCTION Muliple-Inpu Muliple-Oupu (MIMO) sysems [], [2] enable higher rae ransmission on fading channels hrough higher specral efficiency while mainaining reliabiliy hrough spaial diversiy. The use of space-ime codes, inroduced by Tarokh e al. [3], [4], has furher improved he reliabiliy of communicaion over fading channel by correlaing signals across differen ransmi anennas. owever, from he perspecive of Shannon capaciy [5], [6], full realizaion of sysem poenial is heavily dependen on knowledge of Channel Sae Informaion (CSI) boh a he ransmier and he receiver. To perform coheren deecion, he channel is usually esimaed a he receiver hrough he ransmission of a sufficienly long raining/pilo sequence.this sysem overhead reduces he available daa rae. assibi e al. [7] explored he value of raining by analyzing channel capaciy when he channel saisics are known and raining is sufficien o obain an esimae of he CSI. In fas fading scenarios and low SNR regimes, i requires more resources and bandwidh o acquire perfec CSI, and i may be impracical o inroduce he necessary overhead. In his case, he ransmier will ransmi few raining/pilo sequences (o resolve phase ambiguiy), and he receiver will perform blind deecion wih around 3dB SNR degradaion in performance. One of he mos imporan approaches is join maximum likelihood daa deecion and channel esimaion, which has been exensively sudied in [8]-[4]. The sphere decoding algorihm [5] can be used o find he laice poin in he signal consellaion o minimize he arge norm; in paricular, i is shown in [6] ha for a wide range of SNR he complexiy of he sphere decoding algorihm is polynomial, making i feasible in many applicaions. In pracice, requiring a choice beween coheren and blind deecion is oo resricive. In sysems where coheren deecion is impracical, i.e. no enough resources can be allocaed o esimae exac CSI, i is usually possible, and much easier o obain parial knowledge of he channel informaion, for example, he Channel Disribuion Informaion (CDI). When he channel is assumed o be Gaussian, i can be described by is mean and covariance marix. We provide a graceful Bayesian approach o esimae CDI ha does no require he ransmission of a minimum number of raining symbols. Once perfec CDI is assumed known a he receiver, we propose a new deecion algorihm based on a Bayesian framework for join daa deecion and channel esimaion, called Regularized Blind Deecion (RBD), and we describe wo RBD varians. Convenional coheren and blind deecion are special cases of choosing he regularizaion parameer. Maximum likelihood deecion can be realized using a modified version of sphere decoding, so he complexiy is he same as blind deecion. In he simulaion, our algorihm performs very close o coheren deecion in he low SNR regime, and sill much beer han blind deecion in he high SNR regime. Our work can be viewed as a sysemaic exploraion of space beween coheren and blind deecion wih a srong Bayesian saisic flavor. I is worh menioning ha Bayesian deecion is also considered in [7] for inerference cancellaion in MIMO sysems using Alamoui signaling. The paper is organized as follows. In Secion II we describe he MIMO model used in his paper and explain boh coheren and blind deecion. In Secion III we assume perfec CDI a he receiver and presen wo varians of he RBD algorihm wihin a Bayesian framework. In Secion IV we analyze how o exrac CDI from raining daa wihin our Bayesian framework and inerpre he classical use of raining daa as selecion of regularizaion parameers. Secion V provides numerical resuls. Finally, Secion VI draws he conclusion. A noe on noaion: We use capial boldface o denoe

2 marices and vecors, and use F for he Frobenious norm. For a marix A, A denoes is Penrose-Moore pseudo-inverse, A denoes is conjugae ranspose, and Tr(A) denoes is race. I denoes he ideniy marix. II. SYSTEM MODEL We consider a general MIMO wireless communicaion sysem wih N ransmi anennas and N r receive anennas in a block fading channel model, where he channel is consan over T consecuive blocks, afer which i changes o an independen consan for anoher T consecuive blocks. The received signals Y C Nr T over T consecuive blocks a he receiver is given by Y = X + N, () where C Nr N is he channel marix, N is he addiive noise marix wih i.i.d. complex Gaussian random variable enries, and X = X, X 2,, X T C N T is he ransmied symbol marix wih X i, i =,,T as one coding block whose enries are aken from a signal consellaion Λ such as QPSK and QAM. A. Coheren Deecion Coheren deecion handles he case when is perfecly known a he receiver. The coheren maximum likelihood (ML) decoding rule are given as Y X 2 F (2) where F is he Frobenius norm and K is he number of symbols in one coding block. Since he noise is independen from one coding block o anoher, he decoding scheme in equaion (2) can be decomposed ino single coding blocks as ˆX i = argmin X i Λ K Y i X i 2 F (3) where Y i = X i +N i wih N i as he corresponding noise for coding block i. B. Blind Deecion Blind deecion handles he case when is unknown a he receiver. In convenional blind deecion, he decoding rule is ˆX = argmin, C Nr N = argmin Y X 2 F min Y X 2 C Nr N F. (4) In equaion (4), he inner minimizaion is a leas square problem given X, so he close form for he esimae Ĥ is given by [4] Ĥ = YX [X X ]. (5) In he case of orhogonal codes where X i X i (5) can be reduced o = KI, equaion Ĥ = KT YX. (6) Subsiuing equaion (6) ino equaion (4), we have Y 2 F KT YX 2 F = argmax TrYX X Y. (7) Remark: Blind deecion is acually no oally blind. In order o solve he ambiguiy, he firs coding block is normally assumed known. In anoher word, blind deecion sill requires he use of limied piloing signals. In boh cases, sphere decoding [5] is a general echnique which can efficienly reduce he average compuaional complexiy of maximum likelihood decoding. Some oher opimal decoding algorihms (cf [8] ec) achieve low complexiy by aking advanage of coding srucures. Noe ha inroducing correlaion a he ransmier hrough space-ime codes leads o correlaion a he receiver which is a form of CDI. III. REGULARIZED BLIND DETECTION In his secion, we formulae he decoding problem in a Bayesian probabilisic model, where we assume perfec CDI (namely, he disribuion and corresponding parameers of he channel) is known a he receiver. In pracice, he esimaion of CSI always involves uncerainy of he rue value, so ha i is reasonable o assume ha he rue channel follows cerain disribuion wih he esimaed CSI as he mean. From he Bayesian saisical viewpoin, he coheren deecion algorihm in equaion (2) is equivalen o maximizing he probabiliy of receiving Y given channel and daa X wih known, i.e. Pr(Y X, ); (8) similarly, he blind deecion algorihm in equaion (4) is equivalen o maximizing he same probabiliy given channel and daa X wihou assuming any prior on, which is equivalen o max C Nr N Pr(Y X, ), (9) where Pr(Y X, ) = Pr(X +N) N(X,σ 2 ni) is he pdf of he noise marix N. When is assumed o have a prior disribuion, namely a Gaussian prior on, N(Θ,Σ ), where Θ and Σ are assumed known, we propose wo variaions of algorihms for daa deecion: A. Join ML esimaion of channel and daa Join maximum likelihood esimaion of channel and daa X wih Gaussian prior on is given by: max C Nr N Pr(Y X, )Pr(). (0)

3 Wih Pr(Y, X) N(X,σnI), 2 and N(Θ,Σ ), Pr(Y X, )Pr() exp 2σn 2 Y X 2 F exp 2 ( Θ) Σ ( Θ). () Using he Cholesky decomposiion Σ = C C, he minimizaion problem in equaion (0) is equivalen o he following regularized esimaion: min Y X 2 C Nr N F + λ C( Θ) 2 F (2) where C( Θ) 2 F is he regularizaion erm and λ = σ2 n is he regularizaion facor. This is he reason he new algorihm is named by Regularized Blind Deecion. Rewriing he erms inside he bracke in equaion (2) as [ Y 0 ] [ X λc ] 2 F (3) where Y = Y ΘX and = Θ. Then he channel marix ha minimizes equaion (2) is: Ĥ = Θ + (Y ΘX)X (X X + λσ ). (4) Subsiuing his back ino equaion (2), we have he deecion rule for daa X : Y ĤX 2 F + λ C(Ĥ Θ) 2 F (5) = argmin Tr(Y ΘX)(I X (X X + λσ ) X) (Y ΘX). (6) B. ML esimaion of daa Maximum likelihood esimaion of daa X can be wrien as: Pr(Y X, )Pr()d (7) = argmax E Pr(Y X, ) (8) = argmax Pr(Y X). (9) When N(Θ,Σ ), his is compuable since E Pr(Y X, ) exp exp 2σn 2 Y X 2 F 2 ( Θ) Σ ( Θ) d X X + λσ /2 exp 2λ Tr(YX + λσ Θ)(X X + λσ (YX + λσ Θ) ) (20) Taking he logarihm of he above formula, he ML esimae is equivalen o X Λ 2 log X X + λσ + KT 2λ Tr (YX + λσ Θ)(X X + λσ ) (YX + λσ Θ). (2) C. Special Case: Orhogonal Codes As a special case, we consider he orhogonal codes X X = KTI and he channel covariance marix Σ = σh 2I. Le µ = λ/σh 2 = σ2 n/σh 2 ; he firs variaion of he algorihm in equaion (6) can be simplified as Tr YX X Y + µ ( YX Θ + ΘX Y ) = argmax Tr YX X Y + 2µR [ YX Θ ]. (22) Le W = Θ (YY ) Y, we have Tr (X + µw)(y Y)(X + µw). (23) Equaion (23) can be furher rewrien as Tr (X + µw)(ρi Y Y)(X + µw) (24) where ρ is a real consan greaer han all he eigenvalues of Y Y. Noe ha Y Y is posiive semidefinie, herefore we can perform Cholesky decomposiion of (ρi Y Y) such ha B B = ρi Y Y. (25) Therefore, equaion (24) can be reformulaed as a sandard sphere decoding problem wih a shif µw. B(X + µw) 2 F. (26) Similarly, he second variaion of he algorihm in equaion (2) becomes Tr YX X Y + µ ( YX Θ + ΘX Y ) = argmin B(X + µw) 2 F. (27) which coincides wih he firs variaion of RBD. Noice ha he variance of he channel plays a role in choosing he shif in sphere decoding. IV. EXTRACTING CDI FROM LIMITED TRAINING We now suppose some raining bis are ransmied o obain parial informaion abou he channel and we rewrie he received signals Y over T consecuive blocks a he receiver as Y = [Y τ Y d ] = [X τ X d ] + N (28) where X τ C N Tτ is he raining symbol marix, and X d C N T d is he daa symbol marix; respecively Y τ C N Tτ and Y d C N T d are he received symbol marix.

4 A. Tradiional Decoding Schemes wih Training. There are wo baseline approaches o using raining symbols ha do no make use of prior informaion abou channel saisics. The firs scheme is o obain he maximum likelihood deecion decoding rule using he formula below This is equivalen o min Y X 2 C Nr N F. (29) min Y d X d 2 C Nr N F + Y τ X τ 2 F (30) The second scheme is o firs use he raining symbols o ge an esimaed CSI, where hen use Ĥ o decode X d, i.e. Ĥ = argmin Y τ X τ 2 F C Nr N = Y τ Xτ (X τ Xτ ), (3) Y d ĤX d 2 F. (32) The leas square channel esimaion Ĥ from he raining daa lies in he span of Y τ, herefore i is necessary o ransmi enough raining symbols in order o ge a reasonable esimae, i.e. greaer han he number of ransmi anennas. B. Unified Approach I is possible o unify hese wo approaches by inroducing a penaly weigh λ o he second raining erm in equaion (30), given as min Y d X d 2 C Nr N F + λ Y τ X τ 2 F (33) hen he firs scheme is equivalen o choosing λ =, and he second scheme is equivalen o he limi soluion when λ goes o +. The general soluion o equaion (33) is essenially he same as he regularized blind deecion scheme discussed earlier under cerain parameerizaions. In fac, in he special case where he code is orhogonal and he channel variance marix Σ = σh 2 I is a scalar of ideniy marix, le Θ = Y τ X τ (X τ X τ ) = Y τ X τ /KT τ, i can be resaed as equaion (5). C. Esimaion of CDI hrough raining symbols. When aking advanage of he raining daa, he above decoding schemes essenially only obain a rough leas-square esimae of he CSI, and use i eiher wih full confidence (λ + ), or no confidence (λ = ) wihou disinguishing raining symbols from daa symbols. When here is limied raining available, he CSI can be very inaccurae. In fac we shall demonsrae ha i is more effecive o use low-rae raining daa over L blocks o esimae CDI and o hen use his esimae wihin our proposed RBD algorihms.., One way o esimae he mean Θ and variance Σ of he channel is via he following maximum likelihood esimaion, using available raining symbols from L blocks (Y τ,i, X τ,i ), i =,,L: Θ,Σ = argmax ˆΘ,ˆΣ = argmax ˆΘ,ˆΣ 2 2λ i= i= L E Pr(Y τ,i,x τ,i ) i= log X τ,i X τ,i + λˆσ + Tr (Y τ,i Xτ,i + λˆσ ˆΘ)(X τ,i Xτ,i + λˆσ ) (Y τ,i X τ,i + λˆσ ˆΘ) λ ˆΘ ˆΣ ˆΘ. (34) This can be furher simplified in he special case when X τ,i X τ,i = KT τi and Σ = σ 2 h I as (le ˆµ = σ2 n/ˆσ 2 h ): Θ,σh 2 = argmax L ˆΘ,ˆσ 2 log KT τ + ˆµ + h 2 2λ KT τ + ˆµ i= Y τ,i X τ,i + ˆµ ˆΘ 2 F ˆµL ˆΘ 2 F. (35) The choice of Θ does no depend on µ, and is given as Θ = KT τ L Y τ,i Xτ,i. (36) i= Plugging his back o equaion (35), and seing is derivaives wih respec o ˆµ o zero, we obain he maximum likelihood esimae of σ 2 h. V. NUMERICAL RESULTS In our simulaion, we consider a wireless communicaion sysem wih wo ransmi anennas and a single receive anenna which adops Alamoui signaling [4]. We consider he decoding of Alamoui signals during 3 consecuive coheren code blocks (namely, 6 consecuive ime slos). We assume ha he channel marix is complex Gaussian wih mean and covariance marix Σ = Θ = ( + i, + i) ( ). Fig. shows he comparison of differen deecion algorihms. For blind deecion, he phase ambiguiy is assumed o have been solved; for regularized blind deecion, CDI is assumed known a he receiver and for coheren deecion, CSI is assumed perfecly known a he receiver. The firs variaion of he proposed RBD algorihm is used. In he simulaion, our algorihm performs very close o coheren deecion in he low SNR regime, and sill much beer han blind deecion in he high SNR regime.

5 Symbol Error Rae Blind Deecion Regularized Blind Deecion Coheren Deecion SNR(dB) Fig.. Comparison of differen deecion algorihms wih decoding block lengh as 3 coding blocks. VI. CONCLUSIONS We have inroduced and analyzed he performance of Regularized Blind Deecion, a new algorihm ha provides a sysemaic way of inerpolaing beween coheren and blind deecion. Significan performance benefis are possible in environmens where i may be impracical o obain full CSI. The algorihm requires knowledge of CDI a he receiver and we have described how CDI may be esimaed from any available raining symbols. Coheren and blind deecion are special cases wihin our Bayesian framework and i is CDI ha parameerizes he space in beween. Simulaions demonsrae ha our algorihm performs very close o coheren deecion in he low SNR regime, and sill much beer han blind deecion in he high SNR regime. [8]. Vikalo, B. assibi, and P. Soica, Efficien join maximum likelihood channel esimaion and signal deecion, IEEE Transacions on Wireless Communicaions, vol. 5, pp , [9] L. Tong, G. Xu, and T. Kailah, Blind idenificaion and equalizaion based on second-order saisics: a ime domain approach, IEEE Transacions on Informaion Theory, vol. 40, pp , 994. [0] N. Seshadri, Join daa and channel esimaion using fas blind rellis search, US Paen , 993. []. Bolcskei, J. R. W. eah, and A. J. Paulraj, Blind channel esimaion in spaial muliplexing sysems using nonredundan anenna precoding, Proc. of he 33rd Annual IEEE Asilomar Conf. on Signals, Sysems, and Compuers, vol. 2, pp , 999. [2] W.-K. Ma, B.-N. Vo, T. Davidson, and P. Ching, Blind ML deecion of orhogonal space-ime block codes: igh performance, efficien implemenaions, IEEE Transacions on Signal Processing, vol. 54, pp , [3] W. Xu, M. Sojnic, and B. assibi, On exac maximum-likelihood deecion for non-coheren mimo wireless sysems: A branch-esimaebound opimizaion framework, Proceedings of he Inernaional Symposium on Informaion Theory, pp , [4] E. G. Larsson, P. Soica, and J. Li, On maximum-likelihood deecion and decoding for space-ime coding sysems, IEEE Transacions on Signal Processing, vol. 50, pp , [5] M. Pohs, On he compuaion of laice vecors of minimal lengh, successive minima and reduced basis wih applicaions, ACM SIGSAM, vol. 5, pp , 98. [6] B. assibi and. Vikalo, On he sphere decoding algorihm: Par I, he expeced complexiy, IEEE Transacions on Signal Processing, vol. 53, pp , [7] S. Sirianunpiboon, A. R. Calderbank, and S. D. oward, Spacepolarizaion-ime codes for diversiy gains across line of sigh and rich scaering environmens, Proc. IEEE ITW, May [8] S. Sirianunpiboon, Y. Wu, A. R. Calderbank, and S. D. oward, Fas opimal decoding of muliplexed orhogonal designs by condiional opimizaion, o appear, IEEE Transacions on Informaion Theory, 200. ACKNOWLEDGEMENTS The auhors would like o hank Vanee Aggarval and Waheed Bajwa for helpful discussions. REFERENCES [] D. Tse and P. Viswanah, Fundamenals of wireless communicaion. New York, NY: Cambridge Universiy Press, [2] G. J. Foschini, Layered space-ime archiecure for wireless communicaion in a fading environmen when using muli-elemen anennas, Bell Labs Technical Journal, vol., pp. 4 59, 996. [3] V. Tarokh, N. Seshadri, and A. R. Calderbank, Space-ime codes for high daa rae wireless communicaion:performance crierion and code consrucion, IEEE Transacions on Informaion Theory, vol. 44, pp , 998. [4] S. M. Alamoui, A simple ransmi diversiy echnique for wireless communicaions, IEEE Journal on Seleced Areas in Communicaions, vol. 6, pp , 998. [5] E. Telaar, Capaciy of muliple-anenna gaussian channels, European Transacions on Communicaions, vol. 0, pp , 999. [6] A. Goldsmih, S. A. Jafar, N. Jindal, and S. Vishwanah, Capaciy limis of MIMO channels, IEEE Journal on Seleced Areas In Communicaions, vol. 2, pp , [7] B. assibi and B. ochwald, ow much raining is needed in mulipleanenna wireless links? IEEE Transacions on Informaion Theory, vol. 49, pp , 2003.

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2 Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.

More information

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM Name: UNIVERSIY OF CALIFORNIA College of Engineering Deparmen of Elecrical Engineering and Compuer Sciences Professor David se EECS 121 FINAL EXAM 21 May 1997, 5:00-8:00 p.m. Please wrie answers on blank

More information

Suboptimal MIMO Detector based on Viterbi Algorithm

Suboptimal MIMO Detector based on Viterbi Algorithm Proceedings of he 7h WSEAS Inernaional Conference on ulimedia Sysems & Signal Processing, Hangzhou, China, April 5-7, 007 9 Subopimal IO Deecor based on Vierbi Algorihm Jin Lee and Sin-Chong Park Sysem

More information

st semester. Kei Sakaguchi

st semester. Kei Sakaguchi 0 s semeser MIMO Communicaion Sysems #5: MIMO Channel Capaciy Kei Sakaguchi ee ac May 7, 0 Schedule ( s half Dae Tex Conens # Apr. A-, B- Inroducion # Apr. 9 B-5, B-6 Fundamenals

More information

Joint Transmitter-Reciever Optimization for Multiple Input Multiple Output (MIMO) Systems

Joint Transmitter-Reciever Optimization for Multiple Input Multiple Output (MIMO) Systems Join Transmier-Reciever Opimizaion for Muliple Inpu Muliple Oupu (MIMO Sysems eun Chul WANG and wang Bo (Ed LEE School of Elecrical Engineering, Seoul Naional Universiy, OREA Absrac Muliple ransmi (Tx

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques Resource Allocaion in Visible Ligh Communicaion Neworks NOMA vs. OFDMA Transmission Techniques Eirini Eleni Tsiropoulou, Iakovos Gialagkolidis, Panagiois Vamvakas, and Symeon Papavassiliou Insiue of Communicaions

More information

Joint Optimization of Rate Allocation and BLAST Ordering to Minimize Outage Probability

Joint Optimization of Rate Allocation and BLAST Ordering to Minimize Outage Probability Join Opimizaion of Rae Allocaion and BLAST Ordering o Minimize Ouage Probabiliy Arumugam Kannan, Badri Varadarajan and John R. Barry School of Elecrical and Compuer Engineering Georgia Insiue of Technology,

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

Impact of Channel Estimation Errors on Space Time Trellis Codes

Impact of Channel Estimation Errors on Space Time Trellis Codes Impac of Channel Esimaion Errors on Space Time Trellis Codes by Rekha Menon Thesis submied o he faculy of Virginia Polyechnic Insiue and Sae Universiy in parial fulfillmen of he requiremens for he degree

More information

Problem Formulation in Communication Systems

Problem Formulation in Communication Systems Problem Formulaion in Communicaion Sysems Sooyong Choi School of Elecrical and Elecronic Engineering Yonsei Universiy Inroducion Problem formulaion in communicaion sysems Simple daa ransmission sysem :

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Mean-square Stability Control for Networked Systems with Stochastic Time Delay

Mean-square Stability Control for Networked Systems with Stochastic Time Delay JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Joint Channel Estimation/Detection in MIMO Systems Using Belief Propagation

Joint Channel Estimation/Detection in MIMO Systems Using Belief Propagation Join Channel Esimaion/Deecion in MIMO Sysems Using Belief ropagaion Ahmed Zaki and A. Chockalingam Deparmen of ECE, Indian Insiue of Science, Bangalore 560, INDIA Absrac We sudy he problem of join channel

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

4.1 Other Interpretations of Ridge Regression

4.1 Other Interpretations of Ridge Regression CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning

More information

EE3723 : Digital Communications

EE3723 : Digital Communications EE373 : Digial Communicaions Week 6-7: Deecion Error Probabiliy Signal Space Orhogonal Signal Space MAJU-Digial Comm.-Week-6-7 Deecion Mached filer reduces he received signal o a single variable zt, afer

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions

More information

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary

More information

Let us start with a two dimensional case. We consider a vector ( x,

Let us start with a two dimensional case. We consider a vector ( x, Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

Research Article SER Performance of Enhanced Spatial Multiplexing Codes with ZF/MRC Receiver in Time-Varying Rayleigh Fading Channels

Research Article SER Performance of Enhanced Spatial Multiplexing Codes with ZF/MRC Receiver in Time-Varying Rayleigh Fading Channels e Scienific World Journal, Aricle ID 537272, 2 pages hp://dx.doi.org/0.55/204/537272 Research Aricle SER Performance of Enhanced Spaial Muliplexing Codes wih ZF/MRC Receiver in Time-Varying Rayleigh Fading

More information

Mean Square Projection Error Gradient-based Variable Forgetting Factor FAPI

Mean Square Projection Error Gradient-based Variable Forgetting Factor FAPI 3rd Inernaional Conference on Advances in Elecrical and Elecronics Engineering (ICAEE'4) Feb. -, 4 Singapore Mean Square Projecion Error Gradien-based Variable Forgeing Facor FAPI Young-Kwang Seo, Jong-Woo

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

A Bayesian Approach to Spectral Analysis

A Bayesian Approach to Spectral Analysis Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Lecture 33: November 29

Lecture 33: November 29 36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure

More information

Probabilistic Models for Reliability Analysis of a System with Three Consecutive Stages of Deterioration

Probabilistic Models for Reliability Analysis of a System with Three Consecutive Stages of Deterioration Yusuf I., Gaawa R.I. Volume, December 206 Probabilisic Models for Reliabiliy Analysis of a Sysem wih Three Consecuive Sages of Deerioraion Ibrahim Yusuf Deparmen of Mahemaical Sciences, Bayero Universiy,

More information

ERROR LOCATING CODES AND EXTENDED HAMMING CODE. Pankaj Kumar Das. 1. Introduction and preliminaries

ERROR LOCATING CODES AND EXTENDED HAMMING CODE. Pankaj Kumar Das. 1. Introduction and preliminaries MATEMATIČKI VESNIK MATEMATIQKI VESNIK 70, 1 (2018), 89 94 March 2018 research paper originalni nauqni rad ERROR LOCATING CODES AND EXTENDED HAMMING CODE Pankaj Kumar Das Absrac. Error-locaing codes, firs

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

The Potential Effectiveness of the Detection of Pulsed Signals in the Non-Uniform Sampling

The Potential Effectiveness of the Detection of Pulsed Signals in the Non-Uniform Sampling The Poenial Effeciveness of he Deecion of Pulsed Signals in he Non-Uniform Sampling Arhur Smirnov, Sanislav Vorobiev and Ajih Abraham 3, 4 Deparmen of Compuer Science, Universiy of Illinois a Chicago,

More information

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,

More information

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game Sliding Mode Exremum Seeking Conrol for Linear Quadraic Dynamic Game Yaodong Pan and Ümi Özgüner ITS Research Group, AIST Tsukuba Eas Namiki --, Tsukuba-shi,Ibaraki-ken 5-856, Japan e-mail: pan.yaodong@ais.go.jp

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

On-line Adaptive Optimal Timing Control of Switched Systems

On-line Adaptive Optimal Timing Control of Switched Systems On-line Adapive Opimal Timing Conrol of Swiched Sysems X.C. Ding, Y. Wardi and M. Egersed Absrac In his paper we consider he problem of opimizing over he swiching imes for a muli-modal dynamic sysem when

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems.

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems. di ernardo, M. (995). A purely adapive conroller o synchronize and conrol chaoic sysems. hps://doi.org/.6/375-96(96)8-x Early version, also known as pre-prin Link o published version (if available):.6/375-96(96)8-x

More information

Evaluation of Mean Time to System Failure of a Repairable 3-out-of-4 System with Online Preventive Maintenance

Evaluation of Mean Time to System Failure of a Repairable 3-out-of-4 System with Online Preventive Maintenance American Journal of Applied Mahemaics and Saisics, 0, Vol., No., 9- Available online a hp://pubs.sciepub.com/ajams/// Science and Educaion Publishing DOI:0.69/ajams--- Evaluaion of Mean Time o Sysem Failure

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed 535 SOFT-DECSON THRESHOLD DECODNG OF CONVOLUTONAL CODES R.M.F. Goodman*, B.Sc., Ph.D. W.H. Ng*, M.S.E.E. Sunnnary Exising majoriy-decision hreshold decoders have so far been limied o his paper a new mehod

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Object tracking: Using HMMs to estimate the geographical location of fish

Object tracking: Using HMMs to estimate the geographical location of fish Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging

More information

Channel Estimation Techniques for Quantized Distributed Reception in MIMO Systems

Channel Estimation Techniques for Quantized Distributed Reception in MIMO Systems Channel Esimaion Techniques for Quanized Disribued Recepion in MIMO Sysems Junil Choi David J Love and D Richard Brown III School of Elecrical and Compuer Engineering Purdue Universiy Wes Lafayee IN Elecrical

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

DURING the past decade, the multiple-input multipleoutput

DURING the past decade, the multiple-input multipleoutput IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 6, NO. 6, PP. 3996 4008, JUNE 07 Dynamic Transmi Covariance Design in MIMO Fading Sysems Wih Unknown Channel Disribuions and Inaccurae Channel Sae Informaion

More information

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol Applied Mahemaical Sciences, Vol. 7, 013, no. 16, 663-673 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/10.1988/ams.013.39499 Pade and Laguerre Approximaions Applied o he Acive Queue Managemen Model of Inerne

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Impacts of both Tx and Rx IQ Imbalances on OFDM Systems - Analytical Approach

Impacts of both Tx and Rx IQ Imbalances on OFDM Systems - Analytical Approach mpacs of boh Tx and Rx Q mbalances on OFD Sysems - Analyical Approach Hassan Zareian, Vahid Tabaaba Vakili ran Universiy of Science and Technology UST, Tehran, ran Faculy of he slamic Republic of ran Broadcasing

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar CONROL OF SOCHASIC SYSEMS P.R. Kumar Deparmen of Elecrical and Compuer Engineering, and Coordinaed Science Laboraory, Universiy of Illinois, Urbana-Champaign, USA. Keywords: Markov chains, ransiion probabiliies,

More information

Robert Kollmann. 6 September 2017

Robert Kollmann. 6 September 2017 Appendix: Supplemenary maerial for Tracable Likelihood-Based Esimaion of Non- Linear DSGE Models Economics Leers (available online 6 Sepember 207) hp://dx.doi.org/0.06/j.econle.207.08.027 Rober Kollmann

More information

Testing for a Single Factor Model in the Multivariate State Space Framework

Testing for a Single Factor Model in the Multivariate State Space Framework esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics

More information

Wavelet Methods for Time Series Analysis. What is a Wavelet? Part I: Introduction to Wavelets and Wavelet Transforms. sines & cosines are big waves

Wavelet Methods for Time Series Analysis. What is a Wavelet? Part I: Introduction to Wavelets and Wavelet Transforms. sines & cosines are big waves Wavele Mehods for Time Series Analysis Par I: Inroducion o Waveles and Wavele Transforms waveles are analysis ools for ime series and images as a subjec, waveles are relaively new (983 o presen) a synhesis

More information

EE 435. Lecture 31. Absolute and Relative Accuracy DAC Design. The String DAC

EE 435. Lecture 31. Absolute and Relative Accuracy DAC Design. The String DAC EE 435 Lecure 3 Absolue and Relaive Accuracy DAC Design The Sring DAC . Review from las lecure. DFT Simulaion from Malab Quanizaion Noise DACs and ADCs generally quanize boh ampliude and ime If convering

More information

Low-complexity Algorithms for MIMO Multiplexing Systems

Low-complexity Algorithms for MIMO Multiplexing Systems Low-complexiy Algoihms fo MIMO Muliplexing Sysems Ouline Inoducion QRD-M M algoihm Algoihm I: : o educe he numbe of suviving pahs. Algoihm II: : o educe he numbe of candidaes fo each ansmied signal. :

More information

Approximation Algorithms for Unique Games via Orthogonal Separators

Approximation Algorithms for Unique Games via Orthogonal Separators Approximaion Algorihms for Unique Games via Orhogonal Separaors Lecure noes by Konsanin Makarychev. Lecure noes are based on he papers [CMM06a, CMM06b, LM4]. Unique Games In hese lecure noes, we define

More information

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS Xinping Guan ;1 Fenglei Li Cailian Chen Insiue of Elecrical Engineering, Yanshan Universiy, Qinhuangdao, 066004, China. Deparmen

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

non -negative cone Population dynamics motivates the study of linear models whose coefficient matrices are non-negative or positive.

non -negative cone Population dynamics motivates the study of linear models whose coefficient matrices are non-negative or positive. LECTURE 3 Linear/Nonnegaive Marix Models x ( = Px ( A= m m marix, x= m vecor Linear sysems of difference equaions arise in several difference conexs: Linear approximaions (linearizaion Perurbaion analysis

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

EKF SLAM vs. FastSLAM A Comparison

EKF SLAM vs. FastSLAM A Comparison vs. A Comparison Michael Calonder, Compuer Vision Lab Swiss Federal Insiue of Technology, Lausanne EPFL) michael.calonder@epfl.ch The wo algorihms are described wih a planar robo applicaion in mind. Generalizaion

More information

Isolated-word speech recognition using hidden Markov models

Isolated-word speech recognition using hidden Markov models Isolaed-word speech recogniion using hidden Markov models Håkon Sandsmark December 18, 21 1 Inroducion Speech recogniion is a challenging problem on which much work has been done he las decades. Some of

More information

Online Appendix to Solution Methods for Models with Rare Disasters

Online Appendix to Solution Methods for Models with Rare Disasters Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

Asymptotic Analysis on the Interaction between Spatial Diversity and Multiuser Diversity in Wireless Networks

Asymptotic Analysis on the Interaction between Spatial Diversity and Multiuser Diversity in Wireless Networks Asympoic Analysis on he Ineracion beween Spaial Diversiy and uliuser Diversiy in Wireless Newors Quan Zhou, Suden ember, IEEE, and Huaiyu Dai *, ember, IEEE Absrac Spaial diversiy and muliuser diversiy

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

The General Linear Test in the Ridge Regression

The General Linear Test in the Ridge Regression ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge

More information

On Waveform Conditions in MIMO Radars Using Matrix Completion

On Waveform Conditions in MIMO Radars Using Matrix Completion On Waveform Condiions in MIMO Radars Using Marix Compleion Shunqiao Sun and Ahina P Peropulu Deparmen of Elecrical and Compuer Engineering Rugers, The Sae Universiy of New Jersey, Piscaaway, NJ, 08854

More information

Combined ML and QR Detection Algorithm for MIMO-OFDM Systems with Perfect ChanneI State Information

Combined ML and QR Detection Algorithm for MIMO-OFDM Systems with Perfect ChanneI State Information Combined ML and QR Deecion Algorihm for MIMO-OFDM Sysems wih Perfec ChanneI Sae Informaion Weizhi You, Lilin Yi, and Weisheng Hu An effecive signal deecion algorihm wih low complexiy is presened for iple-inpu

More information

Lecture 2 October ε-approximation of 2-player zero-sum games

Lecture 2 October ε-approximation of 2-player zero-sum games Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion

More information

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data Chaper 2 Models, Censoring, and Likelihood for Failure-Time Daa William Q. Meeker and Luis A. Escobar Iowa Sae Universiy and Louisiana Sae Universiy Copyrigh 1998-2008 W. Q. Meeker and L. A. Escobar. Based

More information