1.0 Probability of Error for non-coherent BFSK
|
|
- Shanna Marilyn Young
- 6 years ago
- Views:
Transcription
1 Probability of Error, Digital Sigalig o a Fadig Chael Ad Equalizatio Schemes for ISI Wireless Commuicatios echologies Sprig 5 Lectures & R Departmet of Electrical Egieerig, Rutgers Uiversity, Piscataway, NJ Istructor: Dr. Naraya Madayam Summary by Rady Mitch Abstract his documet discusses the probability of error for o-coheret FSK ad DPSK. Digital sigalig o a frequecy selective chael will be reviewed as well as equalizatio schemes to elimiate ISI.. Probability of Error for o-coheret BFSK Recall from the last lecture that we have Biary FSK orthogoal modulatio. Whe a is selected the S (t) is trasmitted ad whe a is selected the S (t)is trasmitted. S (t) ad S (t) are orthogoal. he received sigal is g (t) if S (t) was trasmitted ad g (t) if S (t) is trasmitted. he received sigals g (t) ad g (t) are also orthogoal. he receiver structure is show i figure. X(t) Filter Matched to S(t) Evelope Detector t = l Compare l > l Filter Matched to S(t) Evelope Detector t = l l > l Figure. No-coheret Receiver for BFSK Let S (t) be trasmitted, the a error occurs if l > l. l = x + x I Q Where X I ad X Q are both Gaussia with zero mea ad psd = N /. l l exp, l fl ( l ) = N N, otherwise
2 l dl { } { λ } ( ) Pr obability of error P = Pr l > l = Pr l > l f l e l Pr{ l > λ l} = fl ( l ) dl = exp N l N where l = xi + x Q, x, I N E ad N xq N, ( xi E ) fx ( x ) exp I I = π N N x Q fx ( x ) exp Q Q = π N N ( error ) Pr obability of error P p x x f dx d x = I Q e I Q xi x Q ( xi E) xq + x I xq Pe = exp exp exp d xi dx Q N N N E xq + x I + x I E + x Q = x I E + x Q + E x Q Pe = exp exp ( x ) exp I E dx I dx π N N N N Rewritig ( ) ( ) Q E Pe = exp N. Probability of error for o-coheret M-ary FSK I geeral for M-ary FSK with o-coheret detectio: ( i ) M i Eb Pe = ( ) exp ( m ) i= in Where = log M A o-coheret receiver for M-ary FSK is show i Figure. As with the biary FSK receiver a compariso of the output of the evelope detectors selects the appropriate brach. Figure 3 illustrates the probability of bit error for various values of M. As M icreases the badwidth efficiecy decreases but the power efficiecy icreases. More costellatios require more chus of orthogoal spaces.
3 Filter Matched to S(t) Evelope Detector t = X(t) Filter Matched to S(t) Evelope Detector t = Compare Filter Matched to Sm(t) Evelope Detector t = Figure. No-coheret Receiver for M-ary FSK 3
4 Figure 3. No-coheret M-ary FSK BER 3. Differetial Phase Shift Keyig If iformatio is eyed oto the phase, PSK, it caot be detected by o-coheret methods. Use phase differece betwee two cosecutive waveforms to carry the iformatio. Assumptio: It wors provided the uow phase itroduced by the chael varies slowly (i.e. slow eough to be cosidered costat over bit itervals). Cosider iput sequece {m }. Geerate differetially ecoded sequece {d } from {m } as follows:. Sum d - ad m Modulo.. Set d to be the complemet of the result from above. 3. Use d to phase shift a carrier as follows: d = θ = d = θ = π Example: if { m } { d } { d} { θ} ππ Observe: Symbol is uchaged from previous symbol if icomig symbol is. d Symbol is toggled from previous symbol if icomig symbol is. d 4. 4 π - DQPSK Exploit the above observatio to derive the probability of error. Let the DPSK sigal i Eb t b be cos( π fct). If the ext bit (i the iterval b t b ) is, the the b phase is uchaged. If the ext bit is, the the phase is shifted by π. 4
5 S S () t () t It is possible to cosider E b cos( π ft c ), t b b = Eb cos( π ft c ), b t b b E b cos( π ft c ), t b b = Eb cos( π ft c π), b t + b b () modulatio over a bit iterval, t b. S t ad S ( t ) as similar to o-coheret orthogoal P e E = exp N Figure 4 compares the BER for DPSK ad FSK. Observe that DPSK BER is approximately 3 db better tha o-coheret FSK. Figure 4 BER Comparisos of DPSK ad FSK 5
6 5. Digital Sigalig o Frequecy Selective Fadig Chaels Modelig: Recall ay modulated sigal is give as vt () = A b( t, x ) ourselves to liear modulatio. ( ) ( ) { } btx, = xh t x complex symbol sequece a. We restrict amplitude samplig pulse he above sigal is trasmitted through a chael c(t) that results i the received sigal w(t). = ( ) wt () = xh t + zt () ht () = ha ( τ ) ct ( τ) dτ. zero-mea AWGN For causal chaels ht ( ) = ha ( τ) ct ( τ) dτ, t. We also assume h(t) = for t ad h(t) = for t L. L is some real positive iteger. x δ ( t ) h () t c( t) a u ( t) h * () t y ( ) ht () z ( t ) t= Figure 5. Matched Filter Receiver i AWGN Chael If we ow h(t), we ca implemet a matched filter as above. yt () = x f( t ) + vt () = Filter oise 6
7 * f () t = h h( + t) d ( ) τ τ τ. f() t is the overall pulse respose ad it accouts for trasiet filter, chael ad receive filters. y = y( t) = x f ( ) + v( ) = = x f + v = x f + x f + v = called itersymbol iterferece(isi) ISI is caused by the chael so if we ca elimiate it the we ca treat the chael as AWGN chael. herefore to achieve the same performace as o a AWGN chael, we require x f =. I order to do this we must mae f =. Alterately, = if i j f = δ f where δij =. if i= j Equally i the frequecy domai F f + = f, F( f) = F{ () } = f t It ca be show that f(t) ca be ay fuctio that has equally spaced zero crossigs. What is the optimum receiver? We must express wt () = lim wφ() t usig the Karhue-Loeve expasio. ( h = h t Φ t dt * ( ) ( ) z = ztφ tdt * () () w= w, w,... w ) is a multivariate Gaussia distributio because z(t) is Gaussia. 7
8 N pwxh (, ) = exp w xh = π N N = where H = h, h, h3,..., h ad h = (..., h 3, h, h, h) herefore the optimum receiver is the Maximum Lielihood receiver, for the case of AWGN it reduces to N arg max ux ( ) = w xh x = = he bottom lie is:. We eed owledge of { f } { c } i order to perfectly elimiate ISI. herefore we eed to estimate the chael i order to equalize it. to uderstad the chael respose ad owledge of. A additioal problem results as well by observig the followig: yt () = x f( t ) + vt () = where the oise fuctio is * vt () = h( ) zt ( ) d τ τ τ is still Gaussia but is ot white. herefore the oise samples at the output are correlated. I this case we ca obtai a discrete time white oise model as follows. x δ ( t ) h () t c( t) a h * ( t) Whiteig Filter v ht () z ( t ) t= Figure 6. Whiteig Filter with Matched Filter Receiver he output of the whiteig filter v L = gx + η = v is give by 8
9 where g is the overall filter for the chael ad the whiteig filter ad η is the white oise process. 3. Aother importat cosideratio is the desig of ISI equalizig filters is extremely sesitive to timig iformatio. We ca solve this sesitivity i two ways. a. Use pulse shapig. Raised cosie pulse shapig allows us to derive the legth of the pulse by samplig at eve poits. b. Use fractioal samplig. Sample the output y(t) at a rate higher tha /. Although we will still have correlated oise ad will eed a whiteig filter the overall pulse shape will be less sesitive to timig errors. 6. Equalizatio Schemes here are two types of equalizatio schemes.. Symbol by symbol equalizers that ca be liear or o-liear.. Sequece estimatio equalizers that are o-liear. 6. Symbol-by-Symbol Equalizers We cosider the discrete time white oise model show i figure 7. Where { a } is the iput sigal, L is the memory of the chael, η is the additive oise ad g = ( g, g..., g ) l is the chael vector that describes the overall chael impulse, respose. { } a... X g X g X g L L r = g a + η = Figure 7. Discrete ime White Noise Model η 9
10 Liear equalizers estimate the th trasmitted symbol aˆ M = cr j j Where { } M j is the equalizer filter of (M+) taps. M is a j= M c + M desig choice ad C is the chose umber of taps to estimate aˆ. 6. Zero Forcig Equalizer he Zero Forcig Equalizer combies the chael ad equalizer impulse respose to force to zero at all but oe of the taps i the DL filter. he tap coefficiets, c, are chose to zero-out the ISI. Give the chael vector, g, we ca select the tap coefficiets, c, to get the desired respose q = (,,,..., q,,...). he Zero Forcig Equalizer zeros out all but the desired result. he tap coefficiets are calculated usig the relatioship q = c g q aˆ. Zero forcig equalizers ca perfectly elimiate ISI as M but it also ehaces the oise. I practice, the receiver does ot ow the chael vector ad fiite legth traiig sequeces are used to choose the tap coefficiets. 6.3 Miimum Mea Square Equalizer (MMSE) he MMSE is aother symbol-by-symbol equalizer but is superior to the zero forcig equalizer i performace. he MSME utilizes the mea square error criterio to adjust the tap coefficiets. We defie a estimatio error: ε = a aˆ as Where a is the symbol set ad aˆ is the estimated symbol. he fuctio to be miimized is: J = mi E ε = mi E ( a a ˆ) c c M = mi E ( a cjr j) c j= M so as to mae the error sequece orthogoal to he error is miimized by choosig { c j } the sigal sequece r, for l M l E ε =, l M. he optimum c is, i.e. [ r ] l obtaied by solvig the followig set of equatios. M ce j r jr l = E[ ar l], l M j= M
11 Defie the followig fuctios. Γ r r E j l, j l, = M,..., M ad b= ( E[ a ] [ ]... r+ m E ar+ m E[ ar m] ) the copt =Γ b o implemet the MSME we eed to us adaptive algorithms because the chael respose is ot readily ow. ypically, we use the steepest descet algorithm. cj( + ) = cj( ) µ E ε ( ) c j, j = M... + M Where µ is a positive umber. Note: E ε ( ) ε ( ) = E ε( ) = E ε( ) r j = er( ) cj c R j j he term R er is the cross correlatio betwee the iput ad the error. he equalizer taps ca be obtaied by implemetig a stochastic gradiet algorithm. cj( + ) = cj( ) µε ( ) r j o evaluate ε ( ) i this algorithm we use a traiig sequece. 6.4 Decisio Feedbac Equalizer (DFE) A DFE is a oliear equalizer that cosists of a feed forward sectio ad a feedbac sectio. DFEs are very effective i frequecy selective chaels because they mitigate the effects of oise ehacemets that degrade the performace of liear equalizers. he DFE uses previous decisios to elimiate ISI caused by previously detected symbols o curret symbols. he output of the equalizer ca be expressed as: ˆ j j a = c r + ca% j= M feed forwad filter M + taps M j= j j feedbac filter M taps Where a%, a%,..., a% M are earlier detected symbols. Both the feed forward loop ad the feedbac loop eed adaptatio to adjust the coefficiets.
12 6.5 Maximum Lielihood Sequece Estimatio (MLSE) Recall the discrete-time white oise chael model. L r = g a + η m m m= Assume symbols are trasmitted over the chael. he after receivig the sequece { r }, the ML receiver decides i favor of the sequece { } = a = lielihood fuctio ( r r, r a, a a ) log,...,,..., that maximizes the Sice the oise samples are idepedet ad trasmitted symbols. r depeds oly o the L most recet ( r r, r a, a a ) ( r a, a a l) ( r r, r a, a a) log,...,,..., = log,., + log,..,,.., his has already bee calculated where a L= for L Sice the d term has bee calculated at the previous time (-), oly the first term eeds to be computed at time for each icomig sigal r. he Veterbi algorithm ca be used to implemet the MLSE equalizer. Adaptive MLSE is used i GSM. Refereces: [] N. Madayam, Wireless Commuicatio echologies, course otes. []. Rappaport, Wireless Commuicatios. Priciples ad Practice. d Editio, Pretice-Hall, Eglewood Cliffs, NJ: 996. [3] J. Proais, Digital Commuicatios, 3 rd Editio, McGraw-Hill, NY: 995. [4] G. Stuber, Priciples of Mobile Commuicatio, d Editio, Kluwer Academic Publishers, Norwell, MA:. [5] B. Slar, Digital Commuicatios. Fudametals ad Applicatios, Pretice-Hall, Eglewood Cliffs, NJ: 988. [6] D. Wu, Wireless Commuicatio echologies, Rutgers Uiversity, Piscataway, NJ:
Lecture 1: Channel Equalization 1 Advanced Digital Communications (EQ2410) 1. Overview. Ming Xiao CommTh/EES/KTH
: 1 Advaced Digital Commuicatios (EQ2410) 1 Tuesday, Ja. 20, 2015 8:15-10:00, D42 1 Textbook: U. Madhow, Fudametals of Digital Commuicatios, 2008 1 / 1 Overview 2 / 1 Chael Model Itersymbol iterferece
More informationThe starting phase of each symbol is determined by past bits. This memory can improve detection by giving additional hints about past symbol values.
8.2 Start With CPFSK 8.2-1 8.2.1 CPFSK Sigals Three pictures of the same CPFSK sigal: istataeous frequecy istataeous phase trajectory Trajectory is a circle with radius A = P. CPFSK moves at a steady speed
More informationDiversity Combining Techniques
Diversity Combiig Techiques Whe the required sigal is a combiatio of several waves (i.e, multipath), the total sigal amplitude may experiece deep fades (i.e, Rayleigh fadig), over time or space. The major
More informationFig. 2. Block Diagram of a DCS
Iformatio source Optioal Essetial From other sources Spread code ge. Format A/D Source ecode Ecrypt Auth. Chael ecode Pulse modu. Multiplex Badpass modu. Spread spectrum modu. X M m i Digital iput Digital
More informationThe Maximum-Likelihood Decoding Performance of Error-Correcting Codes
The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,
More informationECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220
ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part
More informationRandom Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation
Radom Sigals ad Noise Witer Semester 7 Problem Set Wieer Filter Cotiuatio Problem (Sprig, Exam A) Give is the sigal W t, which is a Gaussia white oise with expectatio zero ad power spectral desity fuctio
More informationFIR Filters. Lecture #7 Chapter 5. BME 310 Biomedical Computing - J.Schesser
FIR Filters Lecture #7 Chapter 5 8 What Is this Course All About? To Gai a Appreciatio of the Various Types of Sigals ad Systems To Aalyze The Various Types of Systems To Lear the Skills ad Tools eeded
More informationOFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI
MIMO-OFDM OFDM Precoder for Miimizig BER Upper Boud of MLD uder Imperfect CSI MCRG Joit Semiar Jue the th 008 Previously preseted at ICC 008 Beijig o May the st 008 Boosar Pitakdumrogkija Kazuhiko Fukawa
More informationEE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course
Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL
More informationELEC1200: A System View of Communications: from Signals to Packets Lecture 3
ELEC2: A System View of Commuicatios: from Sigals to Packets Lecture 3 Commuicatio chaels Discrete time Chael Modelig the chael Liear Time Ivariat Systems Step Respose Respose to sigle bit Respose to geeral
More informationComplex Algorithms for Lattice Adaptive IIR Notch Filter
4th Iteratioal Coferece o Sigal Processig Systems (ICSPS ) IPCSIT vol. 58 () () IACSIT Press, Sigapore DOI:.7763/IPCSIT..V58. Complex Algorithms for Lattice Adaptive IIR Notch Filter Hog Liag +, Nig Jia
More informationOrthogonal Gaussian Filters for Signal Processing
Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios
More informationLecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound
Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed
More informationChannel coding, linear block codes, Hamming and cyclic codes Lecture - 8
Digital Commuicatio Chael codig, liear block codes, Hammig ad cyclic codes Lecture - 8 Ir. Muhamad Asial, MSc., PhD Ceter for Iformatio ad Commuicatio Egieerig Research (CICER) Electrical Egieerig Departmet
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationELEG 4603/5173L Digital Signal Processing Ch. 1 Discrete-Time Signals and Systems
Departmet of Electrical Egieerig Uiversity of Arasas ELEG 4603/5173L Digital Sigal Processig Ch. 1 Discrete-Time Sigals ad Systems Dr. Jigxia Wu wuj@uar.edu OUTLINE 2 Classificatios of discrete-time sigals
More informationTime-Domain Representations of LTI Systems
2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationIntroduction to Signals and Systems, Part V: Lecture Summary
EEL33: Discrete-Time Sigals ad Systems Itroductio to Sigals ad Systems, Part V: Lecture Summary Itroductio to Sigals ad Systems, Part V: Lecture Summary So far we have oly looked at examples of o-recursive
More informationOutline. Linear regression. Regularization functions. Polynomial curve fitting. Stochastic gradient descent for regression. MLE for regression
REGRESSION 1 Outlie Liear regressio Regularizatio fuctios Polyomial curve fittig Stochastic gradiet descet for regressio MLE for regressio Step-wise forward regressio Regressio methods Statistical techiques
More informationSubstantiation of the Water Filling Theorem Using Lagrange Multipliers
J.A. Crawford U048 Water Fillig o Multiple Gaussia Chaels.doc Substatiatio of the Water Fillig heorem Usig Lagrage Multipliers Shao s capacity theorem states that i the case of parallel statistically idepedet
More informationInformation Theory and Coding
Sol. Iformatio Theory ad Codig. The capacity of a bad-limited additive white Gaussia (AWGN) chael is give by C = Wlog 2 ( + σ 2 W ) bits per secod(bps), where W is the chael badwidth, is the average power
More informationEE422G Homework #13 (12 points)
EE422G Homework #1 (12 poits) 1. (5 poits) I this problem, you are asked to explore a importat applicatio of FFT: efficiet computatio of covolutio. The impulse respose of a system is give by h(t) (.9),1,2,,1
More informationADVANCED SOFTWARE ENGINEERING
ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationDiscrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals.
Discrete-ime Sigals ad Systems Discrete-ime Sigals ad Systems Dr. Deepa Kudur Uiversity of oroto Referece: Sectios. -.5 of Joh G. Proakis ad Dimitris G. Maolakis, Digital Sigal Processig: Priciples, Algorithms,
More informationRun-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE
Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive
More informationMachine Learning Regression I Hamid R. Rabiee [Slides are based on Bishop Book] Spring
Machie Learig Regressio I Hamid R. Rabiee [Slides are based o Bishop Book] Sprig 015 http://ce.sharif.edu/courses/93-94//ce717-1 Liear Regressio Liear regressio: ivolves a respose variable ad a sigle predictor
More informationBER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals
results for a arrowbad multiuser receiver based o successive subtractio for M-PSK modulated sigals Gerard J.M. Jasse Telecomm. ad Traffic-Cotrol Systems Group Dept. of Iformatio Techology ad Systems Delft
More informationECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations
ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows
More informationELEG3503 Introduction to Digital Signal Processing
ELEG3503 Itroductio to Digital Sigal Processig 1 Itroductio 2 Basics of Sigals ad Systems 3 Fourier aalysis 4 Samplig 5 Liear time-ivariat (LTI) systems 6 z-trasform 7 System Aalysis 8 System Realizatio
More informationQuestion1 Multiple choices (circle the most appropriate one):
Philadelphia Uiversity Studet Name: Faculty of Egieerig Studet Number: Dept. of Computer Egieerig Fial Exam, First Semester: 2014/2015 Course Title: Digital Sigal Aalysis ad Processig Date: 01/02/2015
More informationADVANCED DIGITAL SIGNAL PROCESSING
ADVANCED DIGITAL SIGNAL PROCESSING PROF. S. C. CHAN (email : sccha@eee.hku.hk, Rm. CYC-702) DISCRETE-TIME SIGNALS AND SYSTEMS MULTI-DIMENSIONAL SIGNALS AND SYSTEMS RANDOM PROCESSES AND APPLICATIONS ADAPTIVE
More informationOPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE
Joural of ELECTRICAL EGIEERIG, VOL. 56, O. 7-8, 2005, 200 204 OPTIMAL PIECEWISE UIFORM VECTOR QUATIZATIO OF THE MEMORYLESS LAPLACIA SOURCE Zora H. Perić Veljo Lj. Staović Alesadra Z. Jovaović Srdja M.
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationOlli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5
Sigals ad Systems Sigals ad Systems Sigals are variables that carry iformatio Systemstake sigals as iputs ad produce sigals as outputs The course deals with the passage of sigals through systems T-6.4
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week Lecture: Cocept Check Exercises Starred problems are optioal. Statistical Learig Theory. Suppose A = Y = R ad X is some other set. Furthermore, assume P X Y is a discrete
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationDiscrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations
-6.3 Digital Sigal Processig ad Filterig..8 Discrete-ime Sigals ad Systems ime-domai Represetatios of Discrete-ime Sigals ad Systems ime-domai represetatio of a discrete-time sigal as a sequece of umbers
More informationSignal Processing in Mechatronics. Lecture 3, Convolution, Fourier Series and Fourier Transform
Sigal Processig i Mechatroics Summer semester, 1 Lecture 3, Covolutio, Fourier Series ad Fourier rasform Dr. Zhu K.P. AIS, UM 1 1. Covolutio Covolutio Descriptio of LI Systems he mai premise is that the
More informationFrequency Response of FIR Filters
EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we itroduce the idea of the frequecy respose of LTI systems, ad focus specifically o the frequecy respose of FIR filters.. Steady-state
More informationDifferential PSK (DPSK) and Its Performance
Differetial PSK (DPSK) ad Its Performace st ( ) = At ( )cos(2 πft+ θ( t) + θ) c A(t) = amplitude iformatio θ(t) = phase iformatio f c = the carrier frequecy θ = the phase shift itroduced by the chael I
More informationSignals & Systems Chapter3
Sigals & Systems Chapter3 1.2 Discrete-Time (D-T) Sigals Electroic systems do most of the processig of a sigal usig a computer. A computer ca t directly process a C-T sigal but istead eeds a stream of
More informationA new scalable decoder for linear space-time block codes with intersymbol interference
A ew scalale der for liear space-time lock s with itersymol iterferece Marc Kuh, Armi Wittee Uiversity of Saarlad, Istitute of Digital Commuicatios, D 6604 Saarruecke, Germay Email: marc.kuh@lnt.ui-saarlad.de,
More informationFilter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and
Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy
More information1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.
.3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(
More informationRegression and generalization
Regressio ad geeralizatio CE-717: Machie Learig Sharif Uiversity of Techology M. Soleymai Fall 2016 Curve fittig: probabilistic perspective Describig ucertaity over value of target variable as a probability
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More informationPipelined and Parallel Recursive and Adaptive Filters
VLSI Digital Sigal Processig Systems Pipelied ad Parallel Recursive ad Adaptive Filters La-Da Va 范倫達, Ph. D. Departmet of Computer Sciece Natioal Chiao ug Uiversity aiwa, R.O.C. Fall, 05 ldva@cs.ctu.edu.tw
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationCh3 Discrete Time Fourier Transform
Ch3 Discrete Time Fourier Trasform 3. Show that the DTFT of [] is give by ( k). e k 3. Determie the DTFT of the two sided sigal y [ ],. 3.3 Determie the DTFT of the causal sequece x[ ] A cos( 0 ) [ ],
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationChapter 2 Systems and Signals
Chapter 2 Systems ad Sigals 1 Itroductio Discrete-Time Sigals: Sequeces Discrete-Time Systems Properties of Liear Time-Ivariat Systems Liear Costat-Coefficiet Differece Equatios Frequecy-Domai Represetatio
More informationReliability and Queueing
Copyright 999 Uiversity of Califoria Reliability ad Queueig by David G. Messerschmitt Supplemetary sectio for Uderstadig Networked Applicatios: A First Course, Morga Kaufma, 999. Copyright otice: Permissio
More informationCastiel, Supernatural, Season 6, Episode 18
13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio
More informationJitter Transfer Functions For The Reference Clock Jitter In A Serial Link: Theory And Applications
Jitter Trasfer Fuctios For The Referece Clock Jitter I A Serial Lik: Theory Ad Applicatios Mike Li, Wavecrest Ady Martwick, Itel Gerry Talbot, AMD Ja Wilstrup, Teradye Purposes Uderstad various jitter
More informationΩ ). Then the following inequality takes place:
Lecture 8 Lemma 5. Let f : R R be a cotiuously differetiable covex fuctio. Choose a costat δ > ad cosider the subset Ωδ = { R f δ } R. Let Ωδ ad assume that f < δ, i.e., is ot o the boudary of f = δ, i.e.,
More informationComputational Tutorial of Steepest Descent Method and Its Implementation in Digital Image Processing
Computatioal utorial of Steepest Descet Method ad Its Implemetatio i Digital Image Processig Vorapoj Pataavijit Departmet of Electrical ad Electroic Egieerig, Faculty of Egieerig Assumptio Uiversity, Bagkok,
More informationCONTENTS. Course Goals. Course Materials Lecture Notes:
INTRODUCTION Ho Chi Mih City OF Uiversity ENVIRONMENTAL of Techology DESIGN Faculty Chapter of Civil 1: Orietatio. Egieerig Evaluatio Departmet of mathematical of Water Resources skill Egieerig & Maagemet
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationADAPTIVE FILTER ALGORITHMS FOR CHANNEL EQUALIZATION
ADAPTIVE FILTER ALGORITHMS FOR CHANNEL EQUALIZATION Omprakash Gurrapu S051960@utb.hb.se Supervisors: Adepu Nagedra Sr. desig Egieer AN SoftwareTechologies,Idia Examier : Jim Arlebrik Uiversity College
More informationMechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter
Time Respose & Frequecy Respose d -Order Dyamic System -Pole, Low-Pass, Active Filter R 4 R 7 C 5 e i R 1 C R 3 - + R 6 - + e out Assigmet: Perform a Complete Dyamic System Ivestigatio of the Two-Pole,
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationDept. of Biomed. Eng. BME801: Inverse Problems in Bioengineering Kyung Hee Univ.
Dept of Biomed Eg BME801: Iverse Problems i Bioegieerig Kyug ee Uiv Adaptive Filters - Statistical digital sigal processig: i may problems of iterest, the sigals exhibit some iheret variability plus additive
More informationA New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem
This is the Pre-Published Versio. A New Solutio Method for the Fiite-Horizo Discrete-Time EOQ Problem Chug-Lu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +852-2766-7410
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationFIR Filter Design: Part I
EEL3: Discrete-Time Sigals ad Systems FIR Filter Desig: Part I. Itroductio FIR Filter Desig: Part I I this set o otes, we cotiue our exploratio o the requecy respose o FIR ilters. First, we cosider some
More information2D DSP Basics: 2D Systems
- Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity
More informationA 2nTH ORDER LINEAR DIFFERENCE EQUATION
A 2TH ORDER LINEAR DIFFERENCE EQUATION Doug Aderso Departmet of Mathematics ad Computer Sciece, Cocordia College Moorhead, MN 56562, USA ABSTRACT: We give a formulatio of geeralized zeros ad (, )-discojugacy
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationPractical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement
Practical Spectral Aaysis (cotiue) (from Boaz Porat s book) Frequecy Measuremet Oe of the most importat applicatios of the DFT is the measuremet of frequecies of periodic sigals (eg., siusoidal sigals),
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationMATH 10550, EXAM 3 SOLUTIONS
MATH 155, EXAM 3 SOLUTIONS 1. I fidig a approximate solutio to the equatio x 3 +x 4 = usig Newto s method with iitial approximatio x 1 = 1, what is x? Solutio. Recall that x +1 = x f(x ) f (x ). Hece,
More informationCooperative Communication Fundamentals & Coding Techniques
3 th ICACT Tutorial Cooperative commuicatio fudametals & codig techiques Cooperative Commuicatio Fudametals & Codig Techiques 0..4 Electroics ad Telecommuicatio Research Istitute Kiug Jug 3 th ICACT Tutorial
More informationMathematical Description of Discrete-Time Signals. 9/10/16 M. J. Roberts - All Rights Reserved 1
Mathematical Descriptio of Discrete-Time Sigals 9/10/16 M. J. Roberts - All Rights Reserved 1 Samplig ad Discrete Time Samplig is the acquisitio of the values of a cotiuous-time sigal at discrete poits
More informationChapter 10 Advanced Topics in Random Processes
ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationECE 308 Discrete-Time Signals and Systems
ECE 38-5 ECE 38 Discrete-Time Sigals ad Systems Z. Aliyazicioglu Electrical ad Computer Egieerig Departmet Cal Poly Pomoa ECE 38-5 1 Additio, Multiplicatio, ad Scalig of Sequeces Amplitude Scalig: (A Costat
More informationDiscrete-Time Systems, LTI Systems, and Discrete-Time Convolution
EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [
More informationNYU Center for Data Science: DS-GA 1003 Machine Learning and Computational Statistics (Spring 2018)
NYU Ceter for Data Sciece: DS-GA 003 Machie Learig ad Computatioal Statistics (Sprig 208) Brett Berstei, David Roseberg, Be Jakubowski Jauary 20, 208 Istructios: Followig most lab ad lecture sectios, we
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationInformation Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame
Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationMa 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5
Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More informationFrequency Domain Filtering
Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform
More informationClassification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc)
Classificatio of problem & problem solvig strategies classificatio of time complexities (liear, arithmic etc) Problem subdivisio Divide ad Coquer strategy. Asymptotic otatios, lower boud ad upper boud:
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationA Joint Timing and Fractionally-Space Blind Equalization Algorithm Zheng Dong a, Kexian Gong b, Lindong Ge
Proceedigs of te 2d Iteratioal Coferece O Systems Egieerig ad Modelig (ICSEM-13) A Joit imig ad Fractioally-Space Blid Equalizatio Algoritm Zeg Dog a, Kexia Gog b, Lidog Ge Istitute of Zegzou Iformatio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationStatistical Noise Models and Diagnostics
L. Yaroslavsky: Advaced Image Processig Lab: A Tutorial, EUSIPCO2 LECTURE 2 Statistical oise Models ad Diagostics 2. Statistical models of radom iterfereces: (i) Additive sigal idepedet oise model: r =
More informationDIGITAL SIGNAL PROCESSING LECTURE 3
DIGITAL SIGNAL PROCESSING LECTURE 3 Fall 2 2K8-5 th Semester Tahir Muhammad tmuhammad_7@yahoo.com Cotet ad Figures are from Discrete-Time Sigal Processig, 2e by Oppeheim, Shafer, ad Buc, 999-2 Pretice
More informationFINALTERM EXAMINATION Fall 9 Calculus & Aalytical Geometry-I Questio No: ( Mars: ) - Please choose oe Let f ( x) is a fuctio such that as x approaches a real umber a, either from left or right-had-side,
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More information