Optimum Receivers for the AWGN channel

Size: px
Start display at page:

Download "Optimum Receivers for the AWGN channel"

Transcription

1 Opiu Receivers for he AWG chael Coes Opiu Receiver... Opiu Deodulaor... Correlaio Deodulaor... Mached filer Deodulaor... 5 Frequecy doai ierpreaio of ached filer... 8 he Opiu Deecor... Miiu Disace Deecio... he Maxiu Lielihood Sequece Deecor... 5 A syol y syol MAP deecor for sigals wih eory Perforace of he Opiu Receiver for Meory less Modulaio... 7 Proailiy of Error for Aipodal Biary Modulaio... 7 For Biary orhogoal sigals... 8 Copariso of Digial Modulaio Mehods... Perforace aalysis for wire-lie ad radio couicaio Syses... Regeeraive repeaers... Li Budge aalysis i radio co. Syses... AWG: Addiive Whie Gaussia oise Ojecive : Receiver desig Perforace evaluaio (eory, o eory) oe: hese oes are preliiary ad are posed y he reques of he sudes. Please, repor o e all he isaes ha you fid i he docue. (uqaiel@fup.edu.sa). his aerial is for he sole purpose of i class usage. Please oserve he copyrigh of he origial auhors for ay coe i hese oes. Dr. Ali Muqaiel Digial Couicaios I

2 Opiu Receiver s () + r() () r () s () + () { s( ),,,..., M} S( f ) W / Hz Ojecive: Upo oservaio of r(), wha is he opiu receiver desig i ers of proailiy of aig error. receiver deodulaor deecor Deodulaor : covers he received wavefor r() io a -diesioal vecor r [ r r r ] where is he diesio of he rasied sigal. Deecor: Is o decide which of he M possile sigals wavefors was rasied ased o r. ypes of deecors. he opiu deecor. Maxiu lielihood sequece deecor 3. Syol y syol MAP Opiu Deodulaor. Correlaors. Mached filers Correlaio Deodulaor Decoposes he received sigal-o-oise raio io -diesioal vecors. Liearly weighed orhogoal asis fucios {f ()}, where {f ()} spas he sigal space u o he oise space. We ca show ha he oise ers ha falls ouside he sigal space is irreleva o he deecio. Dr. Ali Muqaiel Digial Couicaios I

3 f () r ( ) d r () f () ( ) d r o he deecor f () ( ) d r() f () d [ s () + ()] f () d r s +,, where s s () f () d,,, () f () d,,, ' ' () () + () + () () + () ' f () () () r s f f r f r ' () is zero ea Gaussia oise process. I is he urepreseed par of oise ihere. ' () is Gaussia ecause i is he sapled oupu of a liear filer excied y a Gaussia ipu. E( ) E[ ()] f () d for all E( ) E[ ( τ) ( τ)] f ( ) f ( τ) ddτ δ δ δ( τ) f () ( ) f τ ddτ f () f ( τ) d δ, whe ad zero oherwise. 3 Dr. Ali Muqaiel Digial Couicaios I

4 { } are zero ea ucorrelaed rado variale wih coo covariace σ Er [ ] Es [ + ] s σr σ Gaussia ucorrelaed iplies saisically idepede. r [ r r r ] prs ( / ) prs ( / ),,..., M ( r s ) whe p( r/ s ) exp[ ],,,... π he joi codiioal pdf ( r s ) prs ( / ) exp[ ],,,..., M ( π ) / As a fial sep we ca show ha ( r, r,..., r ) are sufficie saisics. o addiioal releva iforaio ca e exraced fro ' (). ' E [ () r ] ucorrelaed proof p 35 Gaussia ad ucorrelaed iplies saisically idepede which iplies igore ' () Exaple M-ary PAM g() a E g () d a d a g PAM oe asis fucio 4 Dr. Ali Muqaiel Digial Couicaios I

5 f() / f() g () oherwise a he oupu of he correlaor r r() f () d r() d he correlaor ecoes a siple iegraor whe f() is recagular. r { [ s() ()} d [ s() d () d] + + r s + E [ ] σ E[ ( ) ( τ) ddτ] E[ ( ) ( τ)] ddτ δ( τ) ddτ pdf of he sapled oupu ( r s) prs ( / ) exp[ ] π Mached filer Deodulaor We use filers f ( ) h () oherwise y () r( τ) h ( τ) dτ r( τ) f ( + τ) dτ,,... If we saple a he ed he period 5 Dr. Ali Muqaiel Digial Couicaios I

6 y ( ) r( τ) f ( τ) dτ r,,... Mached filer: A filer whose ipulse respose h()s(-) or s() where s() is assued o e cofied o he ie ierval. s() y() A f ( ) r () f ( ) f ( ) Propery of Mached filer: If a sigal s() is corruped y AWG, he filer wih a ipulse respose ached o s() axiizes he oupu sigal o oise raio (SR). Proof : 6 Dr. Ali Muqaiel Digial Couicaios I

7 y ( ) r( τ) h ( τ) dτ s( τ) h ( τ) dτ + ( τ) h ( τ) dτ a y ( ) s( τ) h ( τ) dτ + ( τ) h ( τ) dτ SR y ( ) + y ( ) s s Ey y ( ) [ ( )] [ ( )] var [ ( )] [ ( ) ( )] ( ) ( ) where E y oise iace E y Eτ h τ h ddτ SR δ( τ) h ( τ) h ( dd ) τ h ( ) d [ s( τ) h( τ) dτ] [ h( τ) s( τ) dτ] h ( ) d h ( ) d Ca we axiize he ueraor while he deoiaor is held cosa. Cauchy-Schwarz iequaliy: [ g () g () d] g () d g () d Wih equaliy whe g () c g () g () h(), g () s(-) ore whe h() c s(-), c drop fro he ueraor ad deoiaor E SR s () d Propery: he oupu SR fro he ached filer depeds o he eergy of he wavefor s() u o o he deails (shape) of s(). 7 Dr. Ali Muqaiel Digial Couicaios I

8 Frequecy doai ierpreaio of ached filer Y( f) S( f) e jπ f jπ f jπ f jπ f Y ( ) Y ( f ) e df S( f ) e e df s a Y ( ) S( f ) df s () d E Pasaval ' s relaio s oise a he oupu of he ached filer Φ ( f) H( f) ( ) ( ) ( ) P Φ f df H f df S f df E Ps E E Ps Ys ( ) > SR P E Mached filer ad correlaor a equivale a u ached filer is iue o ie jiers. Exaple 5.. M4 i-orhogoal sigals f () f () h() f ( ) h () f ( ) y () s y () s A A oe he respose o s () is evaluaed a 8 Dr. Ali Muqaiel Digial Couicaios I

9 r [ r r ] [ E + ] ( E) E SR Addiioal Exaple (Mached Filers) Cosider he sigal s() A A a) Deerie he ipulse respose of a filered ached o his sigal ad sech i. h()s(-) A A ) Deerie he ached filer oupu as fucio of ie. c) his is doe y covoluio, we ay as aou he values a he pea (figure) A /4 E A 4 A A A pair of pulses ha are orhogoal o each oher over he ierval [,], are used for wo diesioal ached filer A A ipu Filered ach o s() Filered ach o s() Oupu Oupu A A 4 Wha is he oupu of he ached filer a? 9 Dr. Ali Muqaiel Digial Couicaios I

10 a) Whe s () is applied o he wo raches. ) Whe s () is applied o he wo raches. Firs rach is show i prole 4. Secod rach is zero [ geeralize o all orhogoal sigals]. Addiioal Proles o Mached filers. Aoher ehod for approxiaig realizaio of ached filer is he (RC) low pass filer [iegraor]. R ipu C oupu H( f), f + j f π RC f he ipu sigal is recagular of pulse apliude A ad duraio. Ojecive: Opiize he selecio of 3-dB cuoff frequecy f of he filer. So ha he pea oupu SR is axiized. Show ha f./ is he opiu. Copared o ached filer db loss. s() A[ exp( π f)] he pea value of he oupu power is Pou A[ exp( π f )] f is he 3-dB cuoff frequecy of he RC filer. ou π f df ( f ) + f he correspodig value for he SR A ( SR) ou [ exp( π f )] π f Differeiaig wih respec o (f ) ad seig he resul equal o zero. he axiu value of (SR) ou is a f./. Dr. Ali Muqaiel Digial Couicaios I

11 he Opiu Deecor r Deecor assue o eory Ojecive: Maxiize he proailiy of correc decisios. Poserior proailiies. P(sigal s was rasied r ) Ps ( r ) where,,..m Hece he ae axiu a poseriori proailiy (MAP) Pr ( s) Ps ( ) Usig Baye s rule: Ps ( r) Pr ( ) Ps ( ) a priori proailiy of he h sigal. M Pr ( ) Pr ( s) Ps ( ) Whe he M-sigals are equally proale Ps ( ) /M for all. he sae rule ha axiizes Ps ( r) is equivale o axiizig Pr ( s ) Lielihood fucio: is he codiioal PDF Pr ( s ) or ay oooic fucio of i. Maxiu lielihood (ML) crierio. MAP ML if { s } is equi-proale. For AWG, he lielihood fucio is give y 5.. ( r s ) Pr ( s) exp / ( π ) or l Pr ( s) l( π ) ( r s ) Maxiizig l Pr ( s ) is equivale o iiizig Dr ( s ) ( r s ) where Dr ( s ) is Euclidea disace ad,, M Dr. Ali Muqaiel Digial Couicaios I

12 Miiu Disace Deecio Aoher ierpreaio of ML crierio. + D( r, s ) r rs s r rs. + s where,,3 M D ' (, rs) rs. + s ' Le Crs (, ) D(, rs) o ge rid of he ius. ow, we axiize C raher ha iiize D. Crs (, ). rs. s s ca e eliiaed if eergy is fixed for all,, M, u cao if sigals have uequal eergy (PAM). C(, r s ) r() s () d E,,,,M A aleraive realizaio of he opiu AWG receiver. s () E ( ) d r () s () ( ) d E Selec he Larges s () ( ) d E Suary: Opiu ML Drs ) copue (, ) or D ' (, rs ) disace erics ad chooses he salles or Dr. Ali Muqaiel Digial Couicaios I

13 Crs ) copue (, ) correlaor erics ad choose he larges 3) ML MAP if eqiproale { s }, oherwise PM (, r s) P( r s) P( s) Exaple: Le us assue ha we are sedig oe of wo levels eiher or 6 as show i he figure. o illusrae he iporace of suracig he eergy of he syol. We will cosider wo cases. he firs oe will assue ha he received apliude is 4 ad he we will cosider he apliude o e 3. s () 6 s () Crs (, ). rs. s For he iddle case wih apliude 4 we ge a fair copariso afer reovig he ias 4 r() Crs (, ). rs. s Cr (, s ).(4).() Crs (, ).(4).(6) For he case ha he received sigal wih apliude of 3 we ge he wrog decisio uless we reove he ias Crs (, ).(3).() Crs (, ).(3).(6) r() Exaple: I iary PAM s -s E Prior proailiies P(s ) ρ, P(s ) - ρ Deerie he erics of he opiu MAP for AWG. 3 Dr. Ali Muqaiel Digial Couicaios I

14 ( ) r ± E + y zero ea ad σ oe: he variace of he sapled oise is /. I geeral he oise power, P B, Accordig o yquis B/(), Whe looig a he eergy we EP ( r E ) Pr ( s ) exp πσ σ ( r+ E ) Pr ( s) exp πσ σ ρ PM ( r, s ) ρ p( r s ) exp ( r E ) πσ σ ρ PM ( r, s ) ( ρ) p( r s ) exp PM ( r, s ) > PM ( r, s ) he choose s ( r+ E ) πσ σ If PM ( r, s ) PM ( r, s ) s > < s ( r+ E ) ( r E ) > exp < PM ( r, s ) ρ PM ( r, s ) ρ σ s s ( r+ E) ( r E) > ρ l σ < ρ Er E s > < s s s ρ ρ σ l l ρ 4 ρ E R s R τ s h ) If ρ ½, τ h ) If ρ ½, owledge of or If he M sigals are equi-proale. E is required for opial deecio. he axiu Lielihood (ML) iiize P(correc decisio) 4 Dr. Ali Muqaiel Digial Couicaios I

15 M P() c p( r s ) dr ML M M P() c p( s r ) p() r dr MAP M R R R is he regio for correc decisio. Explai he Uio oud Cocep of QPSK P(e)-P(c) he Maxiu Lielihood Sequece Deecor If o eory (syol-y-syol deecor) is opial (iiu proailiy of error) Meory > successive syols are ierdepede. he axiu lielihood (ML) sequece deecor: searches for he iiu Euclidea disace pah hrough he rellis ha characerizes he eory i he rasied sequece. Exaple RZI (PAM) (zero : lie efore, oe : flip) s -s E r ± E + ( r E ) Pr ( s ) exp πσ σ ( r + E ) Pr ( s) exp πσ σ K ( ) ( ) ( ) K ( r s ) Pr (, r,... r s ) Pr ( s ) exp πσ σ Maxiize he aove proailiy. By aig he logarih ad cosider oly hose releva er. ( ) K ( ) Dr (, s ) ( r s ) For iary we eed o search sequeces, where is he sequece legh. Vieri algorih: is a sequeial rellis search algorih for perforig ML sequece deecio Used for decodig covoluioal codes Assue iiial sae s he exaple of Biary RZI 5 Dr. Ali Muqaiel Digial Couicaios I

16 / E / E / E / E / E / E / E / E 3 A ad so o here are wo arrows eerig he sae, we choose he iiu disace survivor. D (,) ( r + E ) + ( r + E ) For sae we do siilar D (,) ( r + E ) + ( r E ) D (, ) ( r E ) + ( r E ) A 3 Suppose he survivors are (,) ad (,) D (,,) D (,) + ( r + E ) 3 D(,,) D(,) + ( r3+ E ) ad D (,,) D (,) + ( r E ) 3 D (,,) D (,) + ( r E ) 3 D (,) ( r E ) + ( r + E ) Usig Vieri i his exaple he uer of pah searched is reduced y a facor of wo a each sage. he eory legh is L (L i he previous exaple) You ae a decisio whe he survivor pah agree. Variale delay egaive?? Pracically a 5L ad he ae decisio a eve he efore -5L is alos ideical. Mae a decisio. 6 Dr. Ali Muqaiel Digial Couicaios I

17 Exaple (i he previous RZI) Le E ad he deodulaed sequece is (.9,-.8,.3,-.,.,.5,-.7) D (, ) (.9 + ) + (.8 + ) D (,) (. 9 + ) (.8 + ) (.) D (,)(.9+) +(-.8-) D (,)(.9-) +(-.8-) D D (,, ) D(,) (.3 ) (,,) D(, ) (.3 ) D D (,,) D (,) (.3 ) (,, ) D (, ) + (.3 + ) A syol y syol MAP deecor for sigals wih eory. Opiu (iiize syol error) If M is large > large copuaioal coplexiy. Used for covoluio codes ad uro codig. Beyod he scope. Perforace of he Opiu Receiver for Meory less Modulaio Proailiy of Error for Aipodal Biary Modulaio E E R s R τ s h PAM aipodal s () -s () r s + E + AWG 7 Dr. Ali Muqaiel Digial Couicaios I

18 Pr ( s) Pr ( s) π π e e ( r E ) / ( r+ E ) / ( r+ E ) / P ( e s ) P ( r s ) dr e dr π r E By replacig variales x /, dx dr > dr dx x, > r π E / E / r > x x / E x / E e dx Q π x / Q( x) e dx π x e dx Assuig s ad s are equiproale E P Pe ( / s) + Pe ( / s) Q d E > E d E 4 oe P e depeds o he raio d P Q For Biary orhogoal sigals s E E E s 8 Dr. Ali Muqaiel Digial Couicaios I

19 s [ E ] s [ E ] d E If s is rasied r [ E + ] Cr (, s ) rs. s Cr (, s).[ E + ].[ E] E () Cr (, s).[ E + ].[ E ] E () () Ca e furher siplified o E E ad () Ca e furher siplified o E + E E E + E Proailiy of error Cr (, s) > Cr (, s) Pe [ s] PCr [ (, s) > Cr (, s)] E + E E < E E E + ( ) E < > E Pe ( s) P [ > E ] ad are zero ea Gaussia rado variales x - is zero ea Gaussia rado variale wih variace σ / x x / E P( > E ) e dx e dx Q π E π / E Because of he syery s is he sae. γ SR/i Copare orhogoal wih aipodal (facor of icrease i eergy) log 3dB d E for orhogoal d 4E for aipodal 9 Dr. Ali Muqaiel Digial Couicaios I

20 Figure 5..4 ( ) P Q γ Proailiy of error P ( ) P Q γ ρ r ρ r SR per i, γ ( db ) Explai he cocep of Uio oud I addiio o he aove aipodal ad orhogoal exaples, we ca exed he aalsys o oher odulaio echiques. For exaple, May orhogoal sigals Bi-orhogoal Siplex M-ary PAM ( M ) d E g PM Q M ( M ) 6(log M) E av Q M ( M ) 6 Because deg P av M M-ary PSK QAM Copariso of Digial Modulaio Mehods P 6-9. Power specral Efficiecy! Readig Maerial Quiz Dr. Ali Muqaiel Digial Couicaios I

21 Perforace aalysis for wire-lie ad radio couicaio Syses Regeeraive repeaers s() r() α () Maheaical odel for chael wih aeuaio ad addiive oise is r () αs () + () E P Q PAM Biary. Repeaers assuig sigle error a a ie. E P Q a repeaer.. Why o exac equal sig? (error cacellaio) Aalog: Required E / reduced y E P Q A decisio receiver oe receiver is coeced + repeaer. Exaple repeaer -5-5 E Q > -7 E Q > SR.3dB -5 E Q > SR 9.6 db db Li Budge aalysis i radio co. Syses Microwave lie-of-sigh rasissio Li udge aalysis PG AR PR () 4π d he desig should specify P, size of aea (rasi ad receiver) Dr. Ali Muqaiel Digial Couicaios I

22 SR required o achieve a give perforace ad daa rae. PG G : aea rasi gai, G for isoropic aea. 4π d PG : Effecive radiaed power. ERP or EIRP copared wih isoropic aea A R : effecive area of he aea, c λ f, c 3X 8 /s Susiue () i () PG GR PR (4 πd / λ) A R GRλ 4π λ Free space pah loss facor L s 4π d Addiioal losses aospheric L a. P PG G LL R R s a () Calculaio of he aea gai is aea specific ad depeds o (diesios) diaeer D, Illuiaio efficiecy facor Effecive area A R Area A Bea widh θ B Dish, hor ec (P R ) db (P ) db + (G ) db + (G R ) db + (L s ) db + (L o ) db Exaple A geosychroous saellie ori (36, ) Power radiaed is W db aove W -- dbw rasi aea gai 7dB ERP 37 dbw 3- paraolic aea a 4 GHz dowli η.5 efficiecy facor π D G R η 39dB λ λ Ls 95.6dB 4π d (P R ) db dbw P R. X - W is his low or high? Dr. Ali Muqaiel Digial Couicaios I

23 Wha aer is he SR. oise is fla for up o - Hz B W/Hz K B : is Bolza s cosa.38x -3 oal oise W E P R PR Perforace is depede o R P R E R Req Exaple for he sae previous exaple. P R. X - W (-9.6 dbw) 4. X - W/Hz, P r W K B W -3.9 dbw/hz P R E db Hz SR is db R db db wih respec o i/sec 6.9 Mps 4 PCM (64 ps) he iroduced safey argi R db P R E M db req (P ) dbw + (G ) db + (G R ) db + (L a ) db + (L s ) db E M db req 3 Dr. Ali Muqaiel Digial Couicaios I

10.3 Autocorrelation Function of Ergodic RP 10.4 Power Spectral Density of Ergodic RP 10.5 Normal RP (Gaussian RP)

10.3 Autocorrelation Function of Ergodic RP 10.4 Power Spectral Density of Ergodic RP 10.5 Normal RP (Gaussian RP) ENGG450 Probabiliy ad Saisics for Egieers Iroducio 3 Probabiliy 4 Probabiliy disribuios 5 Probabiliy Desiies Orgaizaio ad descripio of daa 6 Samplig disribuios 7 Ifereces cocerig a mea 8 Comparig wo reames

More information

Introduction to Mobile Robotics Mapping with Known Poses

Introduction to Mobile Robotics Mapping with Known Poses Iroducio o Mobile Roboics Mappig wih Kow Poses Wolfra Burgard Cyrill Sachiss Mare Beewi Kai Arras Why Mappig? Learig aps is oe of he fudaeal probles i obile roboics Maps allow robos o efficiely carry ou

More information

Processamento Digital de Sinal

Processamento Digital de Sinal Deparaeo de Elecróica e Telecouicações da Uiversidade de Aveiro Processaeo Digial de ial Processos Esocásicos uar ado Processes aioar ad ergodic Correlaio auo ad cross Fucio Covariace Fucio Esiaes of he

More information

EGR 544 Communication Theory

EGR 544 Communication Theory EGR 544 Commuicaio heory 7. Represeaio of Digially Modulaed Sigals II Z. Aliyazicioglu Elecrical ad Compuer Egieerig Deparme Cal Poly Pomoa Represeaio of Digial Modulaio wih Memory Liear Digial Modulaio

More information

BE.430 Tutorial: Linear Operator Theory and Eigenfunction Expansion

BE.430 Tutorial: Linear Operator Theory and Eigenfunction Expansion BE.43 Tuorial: Liear Operaor Theory ad Eigefucio Expasio (adaped fro Douglas Lauffeburger) 9//4 Moivaig proble I class, we ecouered parial differeial equaios describig rasie syses wih cheical diffusio.

More information

BEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS

BEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS BEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS Opimal ear Forecasig Alhough we have o meioed hem explicily so far i he course, here are geeral saisical priciples for derivig he bes liear forecas, ad

More information

Paper Introduction. ~ Modelling the Uncertainty in Recovering Articulation from Acoustics ~ Korin Richmond, Simon King, and Paul Taylor.

Paper Introduction. ~ Modelling the Uncertainty in Recovering Articulation from Acoustics ~ Korin Richmond, Simon King, and Paul Taylor. Paper Iroducio ~ Modellig he Uceraiy i Recoverig Ariculaio fro Acousics ~ Kori Richod, Sio Kig, ad Paul Taylor Tooi Toda Noveber 6, 2003 Proble Addressed i This Paper Modellig he acousic-o-ariculaory appig

More information

Section 8 Convolution and Deconvolution

Section 8 Convolution and Deconvolution APPLICATIONS IN SIGNAL PROCESSING Secio 8 Covoluio ad Decovoluio This docume illusraes several echiques for carryig ou covoluio ad decovoluio i Mahcad. There are several operaors available for hese fucios:

More information

In this section we will study periodic signals in terms of their frequency f t is said to be periodic if (4.1)

In this section we will study periodic signals in terms of their frequency f t is said to be periodic if (4.1) Fourier Series Iroducio I his secio we will sudy periodic sigals i ers o heir requecy is said o be periodic i coe Reid ha a sigal ( ) ( ) ( ) () or every, where is a uber Fro his deiiio i ollows ha ( )

More information

Ideal Amplifier/Attenuator. Memoryless. where k is some real constant. Integrator. System with memory

Ideal Amplifier/Attenuator. Memoryless. where k is some real constant. Integrator. System with memory Liear Time-Ivaria Sysems (LTI Sysems) Oulie Basic Sysem Properies Memoryless ad sysems wih memory (saic or dyamic) Causal ad o-causal sysems (Causaliy) Liear ad o-liear sysems (Lieariy) Sable ad o-sable

More information

Energy Density / Energy Flux / Total Energy in 1D. Key Mathematics: density, flux, and the continuity equation.

Energy Density / Energy Flux / Total Energy in 1D. Key Mathematics: density, flux, and the continuity equation. ecure Phys 375 Eergy Desiy / Eergy Flu / oal Eergy i D Overview ad Moivaio: Fro your sudy of waves i iroducory physics you should be aware ha waves ca raspor eergy fro oe place o aoher cosider he geeraio

More information

Chemistry 1B, Fall 2016 Topics 21-22

Chemistry 1B, Fall 2016 Topics 21-22 Cheisry B, Fall 6 Topics - STRUCTURE ad DYNAMICS Cheisry B Fall 6 Cheisry B so far: STRUCTURE of aos ad olecules Topics - Cheical Kieics Cheisry B ow: DYNAMICS cheical kieics herodyaics (che C, 6B) ad

More information

Lecture 9: Polynomial Approximations

Lecture 9: Polynomial Approximations CS 70: Complexiy Theory /6/009 Lecure 9: Polyomial Approximaios Isrucor: Dieer va Melkebeek Scribe: Phil Rydzewski & Piramaayagam Arumuga Naiar Las ime, we proved ha o cosa deph circui ca evaluae he pariy

More information

th m m m m central moment : E[( X X) ] ( X X) ( x X) f ( x)

th m m m m central moment : E[( X X) ] ( X X) ( x X) f ( x) 1 Trasform Techiques h m m m m mome : E[ ] x f ( x) dx h m m m m ceral mome : E[( ) ] ( ) ( x) f ( x) dx A coveie wa of fidig he momes of a radom variable is he mome geeraig fucio (MGF). Oher rasform echiques

More information

Comparison between Fourier and Corrected Fourier Series Methods

Comparison between Fourier and Corrected Fourier Series Methods Malaysia Joural of Mahemaical Scieces 7(): 73-8 (13) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES Joural homepage: hp://eispem.upm.edu.my/oural Compariso bewee Fourier ad Correced Fourier Series Mehods 1

More information

Intro to multivariate AR(1) models estimating interaction strengths, aka the B matrix

Intro to multivariate AR(1) models estimating interaction strengths, aka the B matrix Iro o ulivariae AR(1) odels esiaig ieracio sreghs, aka he B ari Eli Holes FISH 507 Applied Tie Series Aalysis 23 Feruary 2017 Mea reverig processes I lecure, I ill alk aou esiaig ea-reversio i he coe of

More information

B. Maddah INDE 504 Simulation 09/02/17

B. Maddah INDE 504 Simulation 09/02/17 B. Maddah INDE 54 Simulaio 9/2/7 Queueig Primer Wha is a queueig sysem? A queueig sysem cosiss of servers (resources) ha provide service o cusomers (eiies). A Cusomer requesig service will sar service

More information

1 Notes on Little s Law (l = λw)

1 Notes on Little s Law (l = λw) Copyrigh c 26 by Karl Sigma Noes o Lile s Law (l λw) We cosider here a famous ad very useful law i queueig heory called Lile s Law, also kow as l λw, which assers ha he ime average umber of cusomers i

More information

ODEs II, Supplement to Lectures 6 & 7: The Jordan Normal Form: Solving Autonomous, Homogeneous Linear Systems. April 2, 2003

ODEs II, Supplement to Lectures 6 & 7: The Jordan Normal Form: Solving Autonomous, Homogeneous Linear Systems. April 2, 2003 ODEs II, Suppleme o Lecures 6 & 7: The Jorda Normal Form: Solvig Auoomous, Homogeeous Liear Sysems April 2, 23 I his oe, we describe he Jorda ormal form of a marix ad use i o solve a geeral homogeeous

More information

ECE-314 Fall 2012 Review Questions

ECE-314 Fall 2012 Review Questions ECE-34 Fall 0 Review Quesios. A liear ime-ivaria sysem has he ipu-oupu characerisics show i he firs row of he diagram below. Deermie he oupu for he ipu show o he secod row of he diagram. Jusify your aswer.

More information

ES 330 Electronics II Homework 03 (Fall 2017 Due Wednesday, September 20, 2017)

ES 330 Electronics II Homework 03 (Fall 2017 Due Wednesday, September 20, 2017) Pae1 Nae Soluios ES 330 Elecroics II Hoework 03 (Fall 017 ue Wedesday, Sepeber 0, 017 Proble 1 You are ive a NMOS aplifier wih drai load resisor R = 0 k. The volae (R appeari across resisor R = 1.5 vols

More information

Moment Generating Function

Moment Generating Function 1 Mome Geeraig Fucio m h mome m m m E[ ] x f ( x) dx m h ceral mome m m m E[( ) ] ( ) ( x ) f ( x) dx Mome Geeraig Fucio For a real, M () E[ e ] e k x k e p ( x ) discree x k e f ( x) dx coiuous Example

More information

Sampling Example. ( ) δ ( f 1) (1/2)cos(12πt), T 0 = 1

Sampling Example. ( ) δ ( f 1) (1/2)cos(12πt), T 0 = 1 Samplig Example Le x = cos( 4π)cos( π). The fudameal frequecy of cos 4π fudameal frequecy of cos π is Hz. The ( f ) = ( / ) δ ( f 7) + δ ( f + 7) / δ ( f ) + δ ( f + ). ( f ) = ( / 4) δ ( f 8) + δ ( f

More information

WILD Estimating Abundance for Closed Populations with Mark-Recapture Methods

WILD Estimating Abundance for Closed Populations with Mark-Recapture Methods WILD 50 - Esiaig Abudace for Closed Populaios wih Mark-Recapure Mehods Readig: Chaper 4 of WNC book (especially secios 4. & 4.) Esiaig N is uch ore difficul ha you igh iiially expec A variey of ehods ca

More information

Sampling. AD Conversion (Additional Material) Sampling: Band limited signal. Sampling. Sampling function (sampling comb) III(x) Shah.

Sampling. AD Conversion (Additional Material) Sampling: Band limited signal. Sampling. Sampling function (sampling comb) III(x) Shah. AD Coversio (Addiioal Maerial Samplig Samplig Properies of real ADCs wo Sep Flash ADC Pipelie ADC Iegraig ADCs: Sigle Slope, Dual Slope DA Coverer Samplig fucio (samplig comb III(x Shah III III ( x = δ

More information

STK4080/9080 Survival and event history analysis

STK4080/9080 Survival and event history analysis STK48/98 Survival ad eve hisory aalysis Marigales i discree ime Cosider a sochasic process The process M is a marigale if Lecure 3: Marigales ad oher sochasic processes i discree ime (recap) where (formally

More information

Electrical Engineering Department Network Lab.

Electrical Engineering Department Network Lab. Par:- Elecrical Egieerig Deparme Nework Lab. Deermiaio of differe parameers of -por eworks ad verificaio of heir ierrelaio ships. Objecive: - To deermie Y, ad ABD parameers of sigle ad cascaded wo Por

More information

Fresnel Dragging Explained

Fresnel Dragging Explained Fresel Draggig Explaied 07/05/008 Decla Traill Decla@espace.e.au The Fresel Draggig Coefficie required o explai he resul of he Fizeau experime ca be easily explaied by usig he priciples of Eergy Field

More information

K3 p K2 p Kp 0 p 2 p 3 p

K3 p K2 p Kp 0 p 2 p 3 p Mah 80-00 Mo Ar 0 Chaer 9 Fourier Series ad alicaios o differeial equaios (ad arial differeial equaios) 9.-9. Fourier series defiiio ad covergece. The idea of Fourier series is relaed o he liear algebra

More information

Big O Notation for Time Complexity of Algorithms

Big O Notation for Time Complexity of Algorithms BRONX COMMUNITY COLLEGE of he Ciy Uiversiy of New York DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE CSI 33 Secio E01 Hadou 1 Fall 2014 Sepember 3, 2014 Big O Noaio for Time Complexiy of Algorihms Time

More information

Clock Skew and Signal Representation

Clock Skew and Signal Representation Clock Skew ad Sigal Represeaio Ch. 7 IBM Power 4 Chip 0/7/004 08 frequecy domai Program Iroducio ad moivaio Sequeial circuis, clock imig, Basic ools for frequecy domai aalysis Fourier series sigal represeaio

More information

A Two-Level Quantum Analysis of ERP Data for Mock-Interrogation Trials. Michael Schillaci Jennifer Vendemia Robert Buzan Eric Green

A Two-Level Quantum Analysis of ERP Data for Mock-Interrogation Trials. Michael Schillaci Jennifer Vendemia Robert Buzan Eric Green A Two-Level Quaum Aalysis of ERP Daa for Mock-Ierrogaio Trials Michael Schillaci Jeifer Vedemia Rober Buza Eric Gree Oulie Experimeal Paradigm 4 Low Workload; Sigle Sessio; 39 8 High Workload; Muliple

More information

Extremal graph theory II: K t and K t,t

Extremal graph theory II: K t and K t,t Exremal graph heory II: K ad K, Lecure Graph Theory 06 EPFL Frak de Zeeuw I his lecure, we geeralize he wo mai heorems from he las lecure, from riagles K 3 o complee graphs K, ad from squares K, o complee

More information

The Eigen Function of Linear Systems

The Eigen Function of Linear Systems 1/25/211 The Eige Fucio of Liear Sysems.doc 1/7 The Eige Fucio of Liear Sysems Recall ha ha we ca express (expad) a ime-limied sigal wih a weighed summaio of basis fucios: v ( ) a ψ ( ) = where v ( ) =

More information

12 Getting Started With Fourier Analysis

12 Getting Started With Fourier Analysis Commuicaios Egieerig MSc - Prelimiary Readig Geig Sared Wih Fourier Aalysis Fourier aalysis is cocered wih he represeaio of sigals i erms of he sums of sie, cosie or complex oscillaio waveforms. We ll

More information

Development of Kalman Filter and Analogs Schemes to Improve Numerical Weather Predictions

Development of Kalman Filter and Analogs Schemes to Improve Numerical Weather Predictions Developme of Kalma Filer ad Aalogs Schemes o Improve Numerical Weaher Predicios Luca Delle Moache *, Aimé Fourier, Yubao Liu, Gregory Roux, ad Thomas Warer (NCAR) Thomas Nipe, ad Rolad Sull (UBC) Wid Eergy

More information

Improvement Over General And Wider Class of Estimators Using Ranked Set Sampling

Improvement Over General And Wider Class of Estimators Using Ranked Set Sampling ITERATIOAL JOURAL OF SIETIFI & TEOLOG RESEAR VOLUME ISSUE 7 AUGUST ISS 77-866 Iprovee Over Geeral Ad ider lass of Esiaors Usi Raked Se Sapli V L Madoara iu Meha Raka Absrac: I his paper Iprovee over eeral

More information

Optimum design of complementary transient experiments for estimating thermal properties

Optimum design of complementary transient experiments for estimating thermal properties Opiu desig of copleeary rasie experies for esiaig heral properies Jaes V. Beck*, Filippo de Moe, Doald E. Aos *Depare of Mechaical Egieerig, Michiga Sae Uiversiy, USA Depare of Idusrial ad Iforaio Egieerig

More information

5.74 Introductory Quantum Mechanics II

5.74 Introductory Quantum Mechanics II MIT OpeCourseWare hp://ocw.mi.edu 5.74 Iroducory Quaum Mechaics II Sprig 009 For iformaio aou ciig hese maerials or our Terms of Use, visi: hp://ocw.mi.edu/erms. drei Tokmakoff, MIT Deparme of Chemisry,

More information

CLOSED FORM EVALUATION OF RESTRICTED SUMS CONTAINING SQUARES OF FIBONOMIAL COEFFICIENTS

CLOSED FORM EVALUATION OF RESTRICTED SUMS CONTAINING SQUARES OF FIBONOMIAL COEFFICIENTS PB Sci Bull, Series A, Vol 78, Iss 4, 2016 ISSN 1223-7027 CLOSED FORM EVALATION OF RESTRICTED SMS CONTAINING SQARES OF FIBONOMIAL COEFFICIENTS Emrah Kılıc 1, Helmu Prodiger 2 We give a sysemaic approach

More information

1. Solve by the method of undetermined coefficients and by the method of variation of parameters. (4)

1. Solve by the method of undetermined coefficients and by the method of variation of parameters. (4) 7 Differeial equaios Review Solve by he mehod of udeermied coefficies ad by he mehod of variaio of parameers (4) y y = si Soluio; we firs solve he homogeeous equaio (4) y y = 4 The correspodig characerisic

More information

14.02 Principles of Macroeconomics Fall 2005

14.02 Principles of Macroeconomics Fall 2005 14.02 Priciples of Macroecoomics Fall 2005 Quiz 2 Tuesday, November 8, 2005 7:30 PM 9 PM Please, aswer he followig quesios. Wrie your aswers direcly o he quiz. You ca achieve a oal of 100 pois. There are

More information

Manipulations involving the signal amplitude (dependent variable).

Manipulations involving the signal amplitude (dependent variable). Oulie Maipulaio of discree ime sigals: Maipulaios ivolvig he idepede variable : Shifed i ime Operaios. Foldig, reflecio or ime reversal. Time Scalig. Maipulaios ivolvig he sigal ampliude (depede variable).

More information

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2 Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.

More information

Stochastic Processes Adopted From p Chapter 9 Probability, Random Variables and Stochastic Processes, 4th Edition A. Papoulis and S.

Stochastic Processes Adopted From p Chapter 9 Probability, Random Variables and Stochastic Processes, 4th Edition A. Papoulis and S. Sochasic Processes Adoped From p Chaper 9 Probabiliy, adom Variables ad Sochasic Processes, 4h Ediio A. Papoulis ad S. Pillai 9. Sochasic Processes Iroducio Le deoe he radom oucome of a experime. To every

More information

Lecture 8. Digital Communications Part III. Digital Demodulation

Lecture 8. Digital Communications Part III. Digital Demodulation Lecure 8. Digial Communicaions Par III. Digial Demodulaion Binary Deecion M-ary Deecion Lin Dai (Ciy Universiy of Hong Kong) EE38 Principles of Communicaions Lecure 8 Analog Signal Source SOURCE A-D Conversion

More information

ELEG5693 Wireless Communications Propagation and Noise Part II

ELEG5693 Wireless Communications Propagation and Noise Part II Deparme of Elecrical Egieerig Uiversiy of Arkasas ELEG5693 Wireless Commuicaios Propagaio ad Noise Par II Dr. Jigxia Wu wuj@uark.edu OUTLINE Wireless chael Pah loss Shadowig Small scale fadig Simulaio

More information

Exercise 3 Stochastic Models of Manufacturing Systems 4T400, 6 May

Exercise 3 Stochastic Models of Manufacturing Systems 4T400, 6 May Exercise 3 Sochasic Models of Maufacurig Sysems 4T4, 6 May. Each week a very popular loery i Adorra pris 4 ickes. Each ickes has wo 4-digi umbers o i, oe visible ad he oher covered. The umbers are radomly

More information

CS623: Introduction to Computing with Neural Nets (lecture-10) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay

CS623: Introduction to Computing with Neural Nets (lecture-10) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay CS6: Iroducio o Compuig ih Neural Nes lecure- Pushpak Bhaacharyya Compuer Sciece ad Egieerig Deparme IIT Bombay Tilig Algorihm repea A kid of divide ad coquer sraegy Give he classes i he daa, ru he percepro

More information

Chapter 3 Moments of a Distribution

Chapter 3 Moments of a Distribution Chaper 3 Moes of a Disribuio Epecaio We develop he epecaio operaor i ers of he Lebesgue iegral. Recall ha he Lebesgue easure λ(a) for soe se A gives he legh/area/volue of he se A. If A = (3; 7), he λ(a)

More information

New Class of Estimators of Population Mean. DECISION SCIENCES INSTITUTE New Class of Estimators of Population Mean Utilizing Median of Study Variable

New Class of Estimators of Population Mean. DECISION SCIENCES INSTITUTE New Class of Estimators of Population Mean Utilizing Median of Study Variable New lass of Esiaors of Poulaio Mea DEISION SIENES INSTITUTE New lass of Esiaors of Poulaio Mea Uilizig Media of Sudy Variable S.K. Yadav Dr. RML Avadh Uiversiy drskysas@gail.co Diesh K. Shara Uiversiy

More information

6.003: Signals and Systems

6.003: Signals and Systems 6.003: Sigals ad Sysems Lecure 8 March 2, 2010 6.003: Sigals ad Sysems Mid-erm Examiaio #1 Tomorrow, Wedesday, March 3, 7:30-9:30pm. No reciaios omorrow. Coverage: Represeaios of CT ad DT Sysems Lecures

More information

SUMMATION OF INFINITE SERIES REVISITED

SUMMATION OF INFINITE SERIES REVISITED SUMMATION OF INFINITE SERIES REVISITED I several aricles over he las decade o his web page we have show how o sum cerai iiie series icludig he geomeric series. We wa here o eed his discussio o he geeral

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

King Fahd University of Petroleum & Minerals Computer Engineering g Dept

King Fahd University of Petroleum & Minerals Computer Engineering g Dept Kig Fahd Uiversiy of Peroleum & Mierals Compuer Egieerig g Dep COE 4 Daa ad Compuer Commuicaios erm Dr. shraf S. Hasa Mahmoud Rm -4 Ex. 74 Email: ashraf@kfupm.edu.sa 9/8/ Dr. shraf S. Hasa Mahmoud Lecure

More information

Diversity Combining Techniques

Diversity Combining Techniques Diversity Combiig Techiques Whe the required sigal is a combiatio of several waves (i.e, multipath), the total sigal amplitude may experiece deep fades (i.e, Rayleigh fadig), over time or space. The major

More information

Super-Fast Delay Tradeoffs for Utility Optimal Fair Scheduling in Wireless Networks

Super-Fast Delay Tradeoffs for Utility Optimal Fair Scheduling in Wireless Networks IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 4, NO. 8, PP. 1489-1501, AUG. 006 1 Super-Fas Delay Tradeoffs for Uiliy Opial Fair Schedulig i Wireless Neworks Michael J. Neely Asrac We cosider

More information

Notes 03 largely plagiarized by %khc

Notes 03 largely plagiarized by %khc 1 1 Discree-Time Covoluio Noes 03 largely plagiarized by %khc Le s begi our discussio of covoluio i discree-ime, sice life is somewha easier i ha domai. We sar wih a sigal x[] ha will be he ipu io our

More information

Economics 8723 Macroeconomic Theory Problem Set 2 Professor Sanjay Chugh Spring 2017

Economics 8723 Macroeconomic Theory Problem Set 2 Professor Sanjay Chugh Spring 2017 Deparme of Ecoomics The Ohio Sae Uiversiy Ecoomics 8723 Macroecoomic Theory Problem Se 2 Professor Sajay Chugh Sprig 207 Labor Icome Taxes, Nash-Bargaied Wages, ad Proporioally-Bargaied Wages. I a ecoomy

More information

Calculus BC 2015 Scoring Guidelines

Calculus BC 2015 Scoring Guidelines AP Calculus BC 5 Scorig Guidelies 5 The College Board. College Board, Advaced Placeme Program, AP, AP Ceral, ad he acor logo are regisered rademarks of he College Board. AP Ceral is he official olie home

More information

Solutions Manual 4.1. nonlinear. 4.2 The Fourier Series is: and the fundamental frequency is ω 2π

Solutions Manual 4.1. nonlinear. 4.2 The Fourier Series is: and the fundamental frequency is ω 2π Soluios Maual. (a) (b) (c) (d) (e) (f) (g) liear oliear liear liear oliear oliear liear. The Fourier Series is: F () 5si( ) ad he fudameal frequecy is ω f ----- H z.3 Sice V rms V ad f 6Hz, he Fourier

More information

Viscous Damping Summary Sheet No Damping Case: Damped behaviour depends on the relative size of ω o and b/2m 3 Cases: 1.

Viscous Damping Summary Sheet No Damping Case: Damped behaviour depends on the relative size of ω o and b/2m 3 Cases: 1. Viscous Daping: && + & + ω Viscous Daping Suary Shee No Daping Case: & + ω solve A ( ω + α ) Daped ehaviour depends on he relaive size of ω o and / 3 Cases:. Criical Daping Wee 5 Lecure solve sae BC s

More information

Discrete-Time Signals and Systems. Introduction to Digital Signal Processing. Independent Variable. What is a Signal? What is a System?

Discrete-Time Signals and Systems. Introduction to Digital Signal Processing. Independent Variable. What is a Signal? What is a System? Discree-Time Sigals ad Sysems Iroducio o Digial Sigal Processig Professor Deepa Kudur Uiversiy of Toroo Referece: Secios. -.4 of Joh G. Proakis ad Dimiris G. Maolakis, Digial Sigal Processig: Priciples,

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

International Journal of Multidisciplinary Approach and Studies. Channel Capacity Analysis For L-Mrc Receiver Over Η-µ Fading Channel

International Journal of Multidisciplinary Approach and Studies. Channel Capacity Analysis For L-Mrc Receiver Over Η-µ Fading Channel Chael Capaciy Aalysis For L-Mrc eceiver Over Η-µ Fadig Chael Samom Jayaada Sigh* Pallab Dua** *NEIST, Deparme of ECE, Iaagar, Aruachal Pradesh-799, Idia **Tezpur Uiversiy, Deparme of ECE, Tezpur, Assam,

More information

6/10/2014. Definition. Time series Data. Time series Graph. Components of time series. Time series Seasonal. Time series Trend

6/10/2014. Definition. Time series Data. Time series Graph. Components of time series. Time series Seasonal. Time series Trend 6//4 Defiiio Time series Daa A ime series Measures he same pheomeo a equal iervals of ime Time series Graph Compoes of ime series 5 5 5-5 7 Q 7 Q 7 Q 3 7 Q 4 8 Q 8 Q 8 Q 3 8 Q 4 9 Q 9 Q 9 Q 3 9 Q 4 Q Q

More information

EE3723 : Digital Communications

EE3723 : Digital Communications EE373 : Digial Communicaions Week 6-7: Deecion Error Probabiliy Signal Space Orhogonal Signal Space MAJU-Digial Comm.-Week-6-7 Deecion Mached filer reduces he received signal o a single variable zt, afer

More information

MOSFET device models and conventions

MOSFET device models and conventions MOFET device odels ad coveios ybols: V hreshold volae; V T kt/q, W µ OX. W W W, L L L L µ elecro obiliy i he MOFET chael (ca be uch lower ha he obiliy i bulk silico). 1. RA URRET ro versio: V -V >>4V T

More information

MATH 507a ASSIGNMENT 4 SOLUTIONS FALL 2018 Prof. Alexander. g (x) dx = g(b) g(0) = g(b),

MATH 507a ASSIGNMENT 4 SOLUTIONS FALL 2018 Prof. Alexander. g (x) dx = g(b) g(0) = g(b), MATH 57a ASSIGNMENT 4 SOLUTIONS FALL 28 Prof. Alexader (2.3.8)(a) Le g(x) = x/( + x) for x. The g (x) = /( + x) 2 is decreasig, so for a, b, g(a + b) g(a) = a+b a g (x) dx b so g(a + b) g(a) + g(b). Sice

More information

An Analysis of State Evolution for Approximate Message Passing with Side Information

An Analysis of State Evolution for Approximate Message Passing with Side Information A Aalysis of Sae Evoluio for Approxiae Message Passig wih Side Iforaio Hagji Liu NC Sae Uiversiy Eail: hliu5@csu.edu Cyhia Rush Colubia Uiversiy Eail: cyhia.rush@colubia.edu Dror Baro NC Sae Uiversiy Eail:

More information

λiv Av = 0 or ( λi Av ) = 0. In order for a vector v to be an eigenvector, it must be in the kernel of λi

λiv Av = 0 or ( λi Av ) = 0. In order for a vector v to be an eigenvector, it must be in the kernel of λi Liear lgebra Lecure #9 Noes This week s lecure focuses o wha migh be called he srucural aalysis of liear rasformaios Wha are he irisic properies of a liear rasformaio? re here ay fixed direcios? The discussio

More information

Actuarial Society of India

Actuarial Society of India Acuarial Sociey of Idia EXAMINAIONS Jue 5 C4 (3) Models oal Marks - 5 Idicaive Soluio Q. (i) a) Le U deoe he process described by 3 ad V deoe he process described by 4. he 5 e 5 PU [ ] PV [ ] ( e ).538!

More information

Supplement for SADAGRAD: Strongly Adaptive Stochastic Gradient Methods"

Supplement for SADAGRAD: Strongly Adaptive Stochastic Gradient Methods Suppleme for SADAGRAD: Srogly Adapive Sochasic Gradie Mehods" Zaiyi Che * 1 Yi Xu * Ehog Che 1 iabao Yag 1. Proof of Proposiio 1 Proposiio 1. Le ɛ > 0 be fixed, H 0 γi, γ g, EF (w 1 ) F (w ) ɛ 0 ad ieraio

More information

Spectral Simulation of Turbulence. and Tracking of Small Particles

Spectral Simulation of Turbulence. and Tracking of Small Particles Specra Siuaio of Turbuece ad Trackig of Sa Parices Hoogeeous Turbuece Saisica ie average properies RMS veociy fucuaios dissipaio rae are idepede of posiio. Hoogeeous urbuece ca be odeed wih radoy sirred

More information

PARTIAL DIFFERENTIAL EQUATIONS SEPARATION OF VARIABLES

PARTIAL DIFFERENTIAL EQUATIONS SEPARATION OF VARIABLES Diola Bagayoko (0 PARTAL DFFERENTAL EQUATONS SEPARATON OF ARABLES. troductio As discussed i previous lectures, partial differetial equatios arise whe the depedet variale, i.e., the fuctio, varies with

More information

6.003 Homework #5 Solutions

6.003 Homework #5 Solutions 6. Homework #5 Soluios Problems. DT covoluio Le y represe he DT sigal ha resuls whe f is covolved wih g, i.e., y[] = (f g)[] which is someimes wrie as y[] = f[] g[]. Deermie closed-form expressios for

More information

Lecture 15 First Properties of the Brownian Motion

Lecture 15 First Properties of the Brownian Motion Lecure 15: Firs Properies 1 of 8 Course: Theory of Probabiliy II Term: Sprig 2015 Isrucor: Gorda Zikovic Lecure 15 Firs Properies of he Browia Moio This lecure deals wih some of he more immediae properies

More information

Introduction to Numerical Analysis. In this lesson you will be taken through a pair of techniques that will be used to solve the equations of.

Introduction to Numerical Analysis. In this lesson you will be taken through a pair of techniques that will be used to solve the equations of. Inroducion o Nuerical Analysis oion In his lesson you will be aen hrough a pair of echniques ha will be used o solve he equaions of and v dx d a F d for siuaions in which F is well nown, and he iniial

More information

LECTURE DEFINITION

LECTURE DEFINITION LECTURE 8 Radom Processes 8. DEFINITION A radom process (or sochasic process) is a ifiie idexed collecio of radom variables {X() : T}, defied over a commo probabiliy space. The idex parameer is ypically

More information

Bernstein Direct Method for Solving. Variational Problems

Bernstein Direct Method for Solving. Variational Problems Ieraioal Maheaical Foru, 5,, o. 48, 35-37 Bersei Direc Mehod for Solvig Variaioal Probles Sadeep Dixi*, Viee K. Sigh**, Ai K. Sigh*, O P. Sigh* *Depare of Applied Maheaics, Isiue of echology, Baaras Hidu

More information

Pure Math 30: Explained!

Pure Math 30: Explained! ure Mah : Explaied! www.puremah.com 6 Logarihms Lesso ar Basic Expoeial Applicaios Expoeial Growh & Decay: Siuaios followig his ype of chage ca be modeled usig he formula: (b) A = Fuure Amou A o = iial

More information

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM

UNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM Name: UNIVERSIY OF CALIFORNIA College of Engineering Deparmen of Elecrical Engineering and Compuer Sciences Professor David se EECS 121 FINAL EXAM 21 May 1997, 5:00-8:00 p.m. Please wrie answers on blank

More information

Samuel Sindayigaya 1, Nyongesa L. Kennedy 2, Adu A.M. Wasike 3

Samuel Sindayigaya 1, Nyongesa L. Kennedy 2, Adu A.M. Wasike 3 Ieraioal Joural of Saisics ad Aalysis. ISSN 48-9959 Volume 6, Number (6, pp. -8 Research Idia Publicaios hp://www.ripublicaio.com The Populaio Mea ad is Variace i he Presece of Geocide for a Simple Birh-Deah-

More information

APPLICATION OF THEORETICAL NUMERICAL TRANSFORMATIONS TO DIGITAL SIGNAL PROCESSING ALGORITHMS. Antonio Andonov, Ilka Stefanova

APPLICATION OF THEORETICAL NUMERICAL TRANSFORMATIONS TO DIGITAL SIGNAL PROCESSING ALGORITHMS. Antonio Andonov, Ilka Stefanova 78 Ieraioal Joural Iformaio Theories ad Applicaios, Vol. 25, Number 1, 2018 APPLICATION OF THEORETICAL NUMERICAL TRANSFORMATIONS TO DIGITAL SIGNAL PROCESSING ALGORITHMS Aoio Adoov, Ila Sefaova Absrac:

More information

Fourier transform. Continuous-time Fourier transform (CTFT) ω ω

Fourier transform. Continuous-time Fourier transform (CTFT) ω ω Fourier rasform Coiuous-ime Fourier rasform (CTFT P. Deoe ( he Fourier rasform of he sigal x(. Deermie he followig values, wihou compuig (. a (0 b ( d c ( si d ( d d e iverse Fourier rasform for Re { (

More information

F D D D D F. smoothed value of the data including Y t the most recent data.

F D D D D F. smoothed value of the data including Y t the most recent data. Module 2 Forecasig 1. Wha is forecasig? Forecasig is defied as esimaig he fuure value ha a parameer will ake. Mos scieific forecasig mehods forecas he fuure value usig pas daa. I Operaios Maageme forecasig

More information

Math 2414 Homework Set 7 Solutions 10 Points

Math 2414 Homework Set 7 Solutions 10 Points Mah Homework Se 7 Soluios 0 Pois #. ( ps) Firs verify ha we ca use he iegral es. The erms are clearly posiive (he epoeial is always posiive ad + is posiive if >, which i is i his case). For decreasig we

More information

Math 6710, Fall 2016 Final Exam Solutions

Math 6710, Fall 2016 Final Exam Solutions Mah 67, Fall 6 Fial Exam Soluios. Firs, a sude poied ou a suble hig: if P (X i p >, he X + + X (X + + X / ( evaluaes o / wih probabiliy p >. This is roublesome because a radom variable is supposed o be

More information

Inference of the Second Order Autoregressive. Model with Unit Roots

Inference of the Second Order Autoregressive. Model with Unit Roots Ieraioal Mahemaical Forum Vol. 6 0 o. 5 595-604 Iferece of he Secod Order Auoregressive Model wih Ui Roos Ahmed H. Youssef Professor of Applied Saisics ad Ecoomerics Isiue of Saisical Sudies ad Research

More information

Practice Problems - Week #4 Higher-Order DEs, Applications Solutions

Practice Problems - Week #4 Higher-Order DEs, Applications Solutions Pracice Probles - Wee #4 Higher-Orer DEs, Applicaions Soluions 1. Solve he iniial value proble where y y = 0, y0 = 0, y 0 = 1, an y 0 =. r r = rr 1 = rr 1r + 1, so he general soluion is C 1 + C e x + C

More information

EXAMPLE SHEET B (Partial Differential Equations) SPRING 2014

EXAMPLE SHEET B (Partial Differential Equations) SPRING 2014 Copuaioal Mechaics Eaples B - David Apsle EXAMPLE SHEET B Parial Differeial Equaios SPRING 0 B. Solve he parial differeial equaio 0 0 o, u u u u B. Classif he followig d -order PDEs as hperbolic, parabolic

More information

State-Space Model. In general, the dynamic equations of a lumped-parameter continuous system may be represented by

State-Space Model. In general, the dynamic equations of a lumped-parameter continuous system may be represented by Sae-Space Model I geeral, he dyaic equaio of a luped-paraeer coiuou ye ay be repreeed by x & f x, u, y g x, u, ae equaio oupu equaio where f ad g are oliear vecor-valued fucio Uig a liearized echique,

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

2 f(x) dx = 1, 0. 2f(x 1) dx d) 1 4t t6 t. t 2 dt i)

2 f(x) dx = 1, 0. 2f(x 1) dx d) 1 4t t6 t. t 2 dt i) Mah PracTes Be sure o review Lab (ad all labs) There are los of good quesios o i a) Sae he Mea Value Theorem ad draw a graph ha illusraes b) Name a impora heorem where he Mea Value Theorem was used i he

More information

1.225J J (ESD 205) Transportation Flow Systems

1.225J J (ESD 205) Transportation Flow Systems .5J J ESD 5 Trasporaio Flow Sysems Lecre 3 Modelig Road Traffic Flow o a Li Prof. Ismail Chabii ad Prof. Amedeo Odoi Lecre 3 Olie Time-Space Diagrams ad Traffic Flow Variables Irodcio o Li Performace Models

More information

Fourier Series & The Fourier Transform. Joseph Fourier, our hero. Lord Kelvin on Fourier s theorem. What do we want from the Fourier Transform?

Fourier Series & The Fourier Transform. Joseph Fourier, our hero. Lord Kelvin on Fourier s theorem. What do we want from the Fourier Transform? ourier Series & The ourier Transfor Wha is he ourier Transfor? Wha do we wan fro he ourier Transfor? We desire a easure of he frequencies presen in a wave. This will lead o a definiion of he er, he specru.

More information

A Note on Prediction with Misspecified Models

A Note on Prediction with Misspecified Models ITB J. Sci., Vol. 44 A, No. 3,, 7-9 7 A Noe o Predicio wih Misspecified Models Khresha Syuhada Saisics Research Divisio, Faculy of Mahemaics ad Naural Scieces, Isiu Tekologi Badug, Jala Gaesa Badug, Jawa

More information

Series Expansion with Wavelets. Advanced Signal Processing Reinisch Bernhard Teichtmeister Georg

Series Expansion with Wavelets. Advanced Signal Processing Reinisch Bernhard Teichtmeister Georg Series Expasio wih Waveles Advaced Sigal Processig - 7 Reiisch Berhard Teicheiser Georg Iroducio Series expasio Fourier Series: Eiher periodic or badliied sigals Tiedoai: No frequecy iforaio Fourierdoai:

More information

After the completion of this section the student

After the completion of this section the student Real Fucios REAL FUNCTIONS Afer he copleio of his secio he sude - should recall he defiiio of he asic algeraic ad rascedeal fucios - should e ale o deerie he ai properies of he fucios ad graph he fucios.

More information

Time Series, Part 1 Content Literature

Time Series, Part 1 Content Literature Time Series, Par Coe - Saioariy, auocorrelaio, parial auocorrelaio, removal of osaioary compoes, idepedece es for ime series - Liear Sochasic Processes: auoregressive (AR), movig average (MA), auoregressive

More information