Stochastic Signals and Systems
|
|
- Barnard Osborne
- 5 years ago
- Views:
Transcription
1 Sochasic Signals and Sysems Conens 1. Probabiliy Theory. Sochasic Processes 3. Parameer Esimaion 4. Signal Deecion 5. Specrum Analysis 6. Opimal Filering Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 1 6 Opimal Filering Inroducion 3 6. Mached Filering Mached Filering for Whie Noise Mached Filering as Correlaion Processing Wiener Filering Wiener-Hopf Equaion 6.3. Finie Wiener Filering Noncausal Wiener Filering Causal Wiener Filering Kalman Filering Sae Space Model Sae Esimaion Kalman Filer Approach 56 Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus
2 6 Opimal Filering 6.1 Inroducion A basic problem in he applicaion of sochasic processes is he esimaion of a signal in he presence of addiive noise. The signal may be random or deerminisic, and he noise may be colored or whie. The problem consiss of esablishing he presence of he signal or of esimaing is form. The soluion of his problem depends on he sae of prior knowledge concerning he signal and he noise, e.g. we may be able o specify signal and noise covariance funcions, power specra or probabiliy densiies. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 3 Furhermore, sysem consrains define he form of he soluion. For example we migh allow he sysem o be nonlinear/linear, ime-varian/invarian, realizable, ec. In he following, we shall be exclusively concerned wih linear ime-varian/invarian sysems bu will no necessarily require ha hey be realizable. 6. Mached Filering In chaper we considered sochasic processes and described he impac of linear sysems on hese processes. Now, we develop echniques for designing linear filers o minimize he effec of noise. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 4
3 X s U U h H() X s U U The signal X could be eiher a signal in noise or noise only. The signal s is assumed o be deerminisic. Addiionally, we suppose ha E(U ) = 0 and he specrum C UU () of he inpu noise U is known. Now, we wish o deermine he filer characerisics such ha he insananeous raio of he oupu signal power o he oupu noise power is maximized a sampling ime 0, i.e. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 5 S S max max s E h h 0 N N ou,max This problem ypically arises in sonar and radar applicaions, where we wish o esablish he presence and locaion of a signal s reurning from a disan arge. Remark: The mached filer does no preserve he waveform of he inpu signal. The objecive is o disor he waveform and filer he noise such ha a he sampling ime 0 he oupu signal level will be as large as possible compared o he oupu noise level. ou Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 6 U
4 Theorem: The mached filer ha maximizes S s E 0 N ou has a ransfer funcion given by * S( ) j 0 Hop( ) k e, CUU( ) where S( ) F s and C ( ) F c ( ) are he Fourier ransform of s and he specrum of U, respecively, k is an arbirary real consan and 0 is he sampling ime when (S/N) is evaluaed. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 7 U UU UU Exercise 6.-1: (Proof of he Theorem) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 8
5 Remarks: k is an arbirary consan since he signal and he noise a he inpu are boh muliplied by k. Thus k cancels in he relaion for (S/N) ou. The filer found may or may no be causal. If i is no causal, i has o be approximaed by a causal filer. The ransfer funcion of he opimum filer is proporional o he complex conjugae of he specrum of he inpu signal. Hence, we migh say ha he linear sysem is mached o he specified signal. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus Mached Filering for Whie Noise Theorem: Suppose he inpu noise is whie. Then he impulse response of he mached filer is given by hop, cs 0, where c is an arbirary real consan, 0 is he ime of he peak signal oupu, and s is he known inpu signal waveform. Consequenly, he impulse response of he mached filer is simply a ime reversed, complex conjugaed and by 0 ranslaed version of he known signal waveform. Therefore, he filer is said o be "mached o he signal". Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 10
6 Exercise 6.-: (Proof of he Theorem) X s Z Z h H() X s Z Z Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 11 The signal-o-noise raio a he oupu is given by S N ou where Es finie lengh T. 1 1 E S( ) d s, T 1 s 0 T 1 s Z Z 0 Z is he energy of he inpu signal of Remarks: The signal-o-noise raio a he oupu of he filer depends on he signal energy and power level of he noise and no on he paricular signal waveform used. To improve he signal-o-noise raio, we can increase he signal ampliude or he signal lengh. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 1
7 Example: We wan o find he mached filer for he known signal 1 if 1 s 0 elsewhere of finie exen T 1 + 1, as visualized below, 1 s 1 ha is imbedded in addiive whie noise. Hence, he impulse response of he mached filer is given by Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 13 h s s, op ( ) 0 0 In order o obain a causal mached filer, we have o require 0. Choosing 0, he impulse response of he mached filer is shown below. 1 s, The signal componen of he mached filer oupu, depiced in he following figure. s, is Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 14
8 s, T 0 T1 T The peak oupu level occurs a 0. The inpu signal waveform has been disored by he filer in order o peak up he oupu signal a 0. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 15 Exercise 6.-3: (Mached filer design for exponenially decaying signals) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 16
9 6.. Mached Filering as Correlaion Processing Consider a known signal waveform s of finie suppor { 1,, } embedded in whie noise Z, i.e. he signal exen is T The oupu of he mached filer a 0 is X 0 X h 0, op. Using he mached filer for whie noise wih 0, i.e. s if 0 0 T h, op 0 elsewhere he summaion is non-zero for 0 T T Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 17 and he convoluion can be reformulaed o , 0( 0 ) X Xh Xs Xs. op T1 T1 T Hence, mached filering can be inerpreed as a correlaion operaion which is illusraed in he following figure. X s Z 0 0 T1 X s Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 18
10 6.3 Wiener Filering The mached filer considered in he previous secion is an opimal filer in he sense ha i provides he highes SNR a he oupu for deecing he presence of a known signal. The Wiener filer considered now aims o provide an opimal esimaion of he realizaion of one sochasic process from observaions of anoher sochasic process. More specifically, we consider a sysem configuraion as shown in he figure below, where X, Y and denoe he sochasic process o be esimaed, he observed sochasic process and he error process, respecively. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 19 X no observable Y h H() observable The goal is o design a linear ime-invarian filer wih impulse response h such ha he expeced value of he squared-error process, i.e. he MSE, is minimized. The filer which minimizes he MSE is known as Wiener filer. For he following consideraions we suppose ha X and Y are real valued, zero-mean and joinly wide-sense saionary (WSS) sochasic processes. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 0
11 Since he processes X and Y are joinly WSS and he filer wih impulse response h is assumed o be sable, he error process is also WSS. Hence, he MSE, which is he second-order momen of, does no depend on he index. The MSE can be expressed in erms of he filer response h by qh ( ) E ( h) EX hy E( X ) h h E( ) E( ) 1 Y Y 1 h XY 1 c (0) h h c ( ) h c ( ). XX 1 1 XY 1 Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 1 The impulse response of he opimal (Wiener) filer h,op is defined by h, op argmin q( h ), h H where H denoes he se of all absoluely summable impulse responses Wiener-Hopf Equaion Now, we would like o solve he MSE problem The soluion of his problem is provided by exploiing he orhogonaliy principle saed in he following heorem. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus min qh ( ) mine X hy. hh hh
12 Theorem: (Orhogonaliy Principle) Suppose X and Y are joinly WSS. The impulse response h,op H minimizes he MSE if and only if For finding he soluion of he minimizaion problem a more convenien form of he orhogonaliy condiion is given by he following resul. Corollary: h,op H minimizes he MSE if and only if H E X h, opy hy 0 h. E X h, opy Y u 0 u. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 3 Exercise 6.3-1: (Proof of he Theorem) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 4
13 Using he corollary, we obain he equaion ha specifies he impulse response h,op of he opimum esimaor. Reformulaion of he orhogonaliy condiion E and finally, op u E X h Y Y 0 uu provides u, op u E XY h Y Y uu XY, op which is known as Wiener-Hopf equaion. c ( v) h c ( v ) v uv Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus Finie Wiener Filering We consider now he problem X no observable Y observable h H() where he sochasic process Y is observed only over a finie discree-ime inerval U { T 1,, T } wih T 1 T. I is desired o obain an esimae X for X by applying a linear filer wih impulse response h, i.e. T 1 X h Y hy T T Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 6 T 1.
14 The filer h is herefore of finie lengh as shown below. Y T 1 Y Y T h T1 h 0 h T X Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 7 As discussed in he previous secion, we wish o deermine he opimum soluion h,op, which minimizes he MSE of he esimae X. The relaion beween he discree-ime inerval U and he ime a which X should be esimaed gives rise o he following hree ypes of esimaion problems. Filering Suppose ha Y has been observed over he discreeime inerval U { T 1,, } wih T 1 > 0. Then X has o be esimaed from he mos recen observaions. The soluion o his problem provides a causal filer which can be implemened in real-ime. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 8
15 Smoohing If he observaions are aken over he discree-ime inerval U { T 1,, T } wih T 1,T > 0 hen X can be esimaed from pas and fuure observaions. This is applicable in pos-processing siuaions, when a realizaion of Y has been recorded and can be played back. Predicion Le Y be given over he discree-ime inerval U { T 1,, k } wih T 1 > k > 0. Then X has o be prediced from pas observaions. Since he filering procedure is defined by a linear operaion X represens a k-sep linear predicor for X. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 9 Now, he opimum soluion h,op has o saisfy he Wiener- Hopf equaion which can be expressed in marix form (also known as Yule-Walker equaion) as where and T 1 c v h c v vv { T,, T } XY, op 1 T h op Ch, op cxy ht, op cxy ( T ), cxy h T1, op cxy( T1) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 30
16 C c (0) c (1) c ( T T ) c c c T T c ( T1T) c ( T1T 1) c (0) 1 (1) (0) ( 1 1). Assuming ha C is posiive definie (covariance marices are a leas nonnegaive definie) he opimum impulse response is given by 1 h C c op XY. The opimum soluion h op can be efficienly compued by he Levinson-Durbin algorihm which explois he Toepliz srucure and he symmery of C. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus Noncausal Wiener Filering The following Wiener Filering approach is ermed noncausal because one wans o esimae X based on observaions Y for all U. Thus X h Y hy where he filering operaion is no necessarily causal, i.e. he impulse response may no saisfy h 0 for <0. Hence, he Wiener-Hopf equaion can be wrien as XY, op c ( v) h c ( v ) vv, where he righ side of he equaion represen a discree- Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 3,
17 convoluion of h,op and c (v) wih v...1,0,1,... Assuming ha he following Fourier ransforms exis j op( ), op, XY ( ) XY ( ) jv and v ( ) ( ) jv wih v H h e C c v e C c v e he Wiener-Hopf equaion becomes C ( ) H ( ) C ( ),, XY op where H op (), C XY () and C () denoe he ransfer funcion of he opimal filer, he power specral densiy of Y and he cross power specral densiy of X and Y. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 33 Hence, he Wiener-Hopf equaion can be easily solved for he ransfer funcion of he opimum filer, i.e. CXY ( ) Hop( ),, C ( ) from which he impulse response is obained by 1 CXY ( ) j h, op e d,. C ( ) The minimum mean square error (MMSE) can now be expressed by qh ( ) min qh ( ) minex hy, op hh hh Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 34
18 qh ( ) EX h Y EX h Y X Since cxy ( ) cyx ( ) and CYX ( ) CXY ( ) he infinie sum in he equaion above can be wrien as, op, op, op E( X ) h, ope( XY ) cxx (0) h, opcxy ( ). 1 h c ( ) h c ( ) H ( ) C ( ) d, op XY, op YX op YX 1 CXY ( ) 1 CXY ( ) CYX ( ) d d. C ( ) C ( ) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 35 Moreover, exploiing 1 cxx (0) CXX ( ) d he MMSE can be rewrien as 1 CXY ( ) qh (, op ) CXX ( ) d C ( ) where 1 XY ( ) XX ( ), 1 R C d CXY ( ) RXY ( ) C ( ) C ( ) denoes he so-called magniude squared coherence. XX Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 36
19 Applying he resuls saed in chaper.6.3, R XY () can be expressed by Cov dzx( ), dzy( ) RXY ( ) Var dz ( ) Var dz ( ) so ha R XY () can be inerpreed as he correlaion coefficien beween he random componens of X and Y a frequency. Thus, R XY ( ) 1,. Moreover, he equaliy sign holds for all [, ] if and only if X and Y are relaed by a linear ransformaion X hy X Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 37. Y Exercise 6.3-: (Signal esimaion in addiive noise, noncausal filering) X Desired Signal Y Observed Signal h H() X U Noise Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 38
20 6.3.4 Causal Wiener Filering Noncausal Wiener filering is improper for applicaions in which real-ime esimaion is required. Therefore, i is of pracical relevance o consider he causal Wiener filering problem in which we wish o esimae X based on observaions Y u for all u U { : }. Hence, wih he causal filer approach X h Y hy 0 he Wiener-Hopf equaion becomes Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 39 XY, op V 0 0 c ( v) h c ( v ) v. Since he Wiener-Hopf equaion is only defined for v 0 i can no be solved by Fourier ransform. Before we can derive he soluion we firs have o discuss he so-called specral facorizaion. Specral Facorizaion and Linear Represenaion Suppose Y has an absoluely coninuous and inegrable specral densiy C (). Then Y can be represened as noncausal filered whie noise wih, ( ) 0 and zz( ) Y g Z g E Z c and C () can be wrien as j C ( ) G( ) G( ) wih G( ) g e. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 40
21 Moreover, if C () saisfies he Paley-Wiener condiion an unique causal impulse response g wih g 0 > 0 and g exiss, such ha 0 j Gz ( ) gz wih Ge ( ) G( ) 0 log ( ) C has no zeros ouside he uni circle (minimum phase filer) and provides a facorizaion for C () in he form Furhermore, g implies ha no poles of 0 Gz ( ) are lying ouside he uni circle. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 41 C G G G G e ( ) ( ) ( ) j ( ) ( ). The Paley-Wiener condiion is a fairly weak condiion ha may hold in any siuaion of pracical ineres. However, if we impose he addiional consrains g and G( z) g z 0 z an explici expression can be obain for Gz ( ). The consrains imply ha all zeros and poles of Gz ( ) are lying wihin he uni circle. Thus, Gz ( ) can be inerpreed as he z-transform of a linear, causal, sable, minimum phase and inverible sable filer. Now, he specral densiy of X given by Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 4 C ( ) G( ) G( e ) j
22 can be analyically coninued 1 ( ) ( ) ( ) ( ) C z GzGz c z in an annulus ha conains z 1. Since C z C z 1 ( ) ( ) we can conclude ha if z are zeros and poles 0, i and z, j of C ( respecively hen z0, i, z0, i, z0, i and z, j, z, j, z z ), j are also zeros and poles of C (. z ) Hence, we obain he so-called canonical facorizaion C ( z) C ( z) C ( z), where ( ) C z and C ( z ) conain all zeros and poles of Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 43 C ( ha are lying wihin or ouside he uni circle respecively. Since he zeros and poles of C ( are rela- z ) z ) ed o he zeros and poles of C ( ) by mirroring a he z 1 uni circle we can wrie C ( z) C ( z ). Soluion of he Wiener-Hopf Equaion Due o he preceding assumpions and explanaions we are now able o solve he Wiener-Hopf equaion. For his purpose we define he sequence which has obviously o saisfy q v 0 for all v 0. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 44 v XY, op 0 q c ( v) h c ( v )
23 Afer applying he wo-sided z-transform we obain Qz ( ) C ( z) H ( zc ) ( z) XY op C z H C z C z XY ( ) op ( ) ( ), where he convoluion heorem for z-transforms and he canonical facorizaion has been exploied. Since q v is anicausal is z-transform Qz ( ) does no conain a consan componen and can only possess poles ouside he uni circle. Dividing he former equaion by C ( z ) we can wrie Qz ( ) CXY ( z) Hop( z) C ( z). C ( z) C ( z) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 45 Due o he aforemenioned properies of Qz ( ) and since C ( has only zeros ouside he uni circle we can infer z ) ha Qz ( ) C does no conain a consan componen ( z) and possesses only poles ouside he uni circle. Moreover, as he poles of H are lying wihin op( z) C ( z) he uni circle is inverse z-transform represens a causal sequence. Hence, afer defining he operaion Fz ( ) fz fz 0 we can sae ha Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 46
24 Q( z) C ( z) 0 and Hop( z) C ( z) Hop( z) C ( z). Finally, he laer provides ogeher wih Q( z) C ( z) CXY ( z) C ( z) Hop( z) C ( z) he desired soluion for he Wiener filer in he z-domain 1 CXY ( z) Hop ( z) C ( z) C ( z) which in he frequency domain can be expressed by j j 1 CXY ( e ) 1 CXY ( ) Hop( e ) Hop( ). j j C ( e ) C ( e ) C ( ) C ( ) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 47 Exercise 6.3-3: (Soluion of he Wiener-Hopf equaion for whie noise and is applicaion afer prewhiening) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 48
25 Exercise 6.3-4: (Signal esimaion in addiive whie noise, causal filering) X Desired Signal Y Observed Signal h H() X Z Whie Noise Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus Kalman Filering The Wiener approach considered in he previous secion solved he MMSE problem for filering, predicion and smoohing of scalar wide sense saionary processes, where he derivaion of he opimum filer could be primarily considered as an frequency domain approach. The Kalman approach addresses he filering, predicion and smoohing problem of no necessarily saionary and vecor valued processes. I provides soluions in he ime domain by virue of formulaing he problem in he sae space. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 50
26 6.4.1 Sae Space Model Discree-ime dynamic sysems can be represened by a sae equaion X f 1 ( X, U ), 0,1,, and a measuremen equaion Y h 1 ( X, V ), 0,1,,, where (f ) 0 and (h ) 0 are sequences of funcions, (X ) 0 is a sequence in p describing he saes of ineres, (U ) 0 is a sequence in q acing on (X ) 1 and where (Y ) 0 and (V ) 0 are sequences in r represening he measuremens and he measuremen noise, respecively. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 51 If he discree-ime sysem is linear he sae and measuremen equaions can be expressed by X 1 FX GU, 0,1,,, and Y HX V, 0,1,,, where F, G and H are pp, pq and rp marices, respecively, for each. Furhermore, if he sysem is ime-invarian he marices F, G and H become consan coefficien marices which are accordingly denoed by F, G and H. Hence, he sae and measuremen equaions simplify o X 1 FX GU and Y HX V, 0,1,,. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 5
27 Exercise 6.4-1: (Sae space represenaion of he one-dimensional moion of a paricle) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus Sae Esimaion Now, we suppose ha he sequence Y 0,...,Y has been observed and ha he sae X should be esimaed. This esimaion problem is known as a) filering problem if, b) smoohing problem if >, c) predicion problem if <. To esimae he sae X by means of realizaions of he measuremen sequence Y 0,...,Y in he minimum mean square error sense we have o find an esimaing funcion X ˆ ( y,, 0 y ) ha minimizes R ( ˆ ) E ˆ ( MSE X X X Y0,, Y ). Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 54
28 We know from chaper ha he opimum esimaing funcion is given by he condiional mean, i.e. X ˆ ( y,, y ) E X Y y,, Y y However, we are usually ineresed in generaing esimaes in real ime as increases. Since he daa increase linear wih, an efficien calculaion of he condiional mean will be impossible unless suiable resricions on he sysem model srucure are imposed, e.g. resricion o discree-ime linear sysems wih independen inpu and measuremen noise sequences of independen zero-mean Gaussian random vecors. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus Kalman Filer Approach Wihin he assumpions menioned above a compuaional efficien and simulaneous soluion of he filering and one sep predicion problem can be saed. Theorem: For he linear, finie-dimensional, discree-ime sysem X 1 FX GU and Y HX V, 0,1,,, where (U ) and (V ) are independen sequences of independen zero-mean Gaussian vecors which are independen of he Gaussian iniial condiion X 0 wih T T E( UU ) Σ ( ), E( VV ) Σ ( ), E( X ) μ, Cov( X ) Σ, UU VV Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 56
29 he esimaors X E( X Y,, Y) and X E( X Y,, Y) can be recursively deermined by he following equaions. X X 1 K Y HX 1 0,1,,, and X 1 FX 0,1,,, wih iniializaion X μ and Kalman gain marix where T 1 T K Σ 1 H H Σ 1 H Σ VV (), Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 57 is he covariance of he predicion error which can be compued joinly wih he filering error covariance by he recursion and Σ Cov( X Y,, Y ) Σ Σ 1 K H Σ, 1 0,1,,, T T Σ 1 F Σ F G Σ () G, 0,1,,, UU wih he iniializaion Σ Σ. E( X X )( X X ) Y,, Y T Σ Cov( X Y,, Y) E ( X X )( X X ) Y,, Y T Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 58
30 Exercise 6.4-: (Proof of he Theorem) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 59 The recursions consis of he following wo basic seps. Measuremen updae which updaes he sae esimae of X by incorporaing he new measuremen Y, filer error covariance marix. Time updae which provides he X X K Y HX and Σ Σ K H Σ one-sep predicion of he sae esimae, predicion error covariance marix X FX and Σ F Σ F G Σ ( ) G T T 1 1 UU Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 60
31 The measuremen updae equaion X X K Y HX 1 1 can be viewed as a combinaion of he prediced sae vecor and a correcion erm. Since Y E( Y Y,, Y ) H E( X Y,, Y ) E( V Y,, Y ) H X he difference in he correcion erm can be inerpreed as an error signal I Y Y Y HX which is known as innovaion. The erm innovaion comes from he fac ha I is he par of Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus , 1 1 Y Y I 1 ha canno be prediced and herefore conains he new informaion ha is gained by he curren observaion. Remarks: The innovaion sequence I is a sequence of independen no idenically disribued zero-mean Gaussian random vecors. Y consiss of a par, Y 1, compleely dependen and a par, I, compleely independen of he pas. Thus I provides a se of independen observaions ha forms suiably scaled he oupu of a prewhiening operaion. Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 6
32 Exercise 6.4-3: (Proof of he remarks) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 63 Kalman Filering Algorihm Iniialize he sae predicion X μ Iniialize he predicion error covariance marix Σ Σ Calculae he Innovaion I Y HX 1 Measuremen updae (Correcion) Calculae he Kalman gain marix T T () K Σ H H Σ H Σ VV Updae he sae vecor X X K I 1 Updae he error covariance marix Σ Σ K H Σ 1 1 Time updae (Predicion) Projecion of sae vecor ahead Projecion of error covariance marix ahead X FX 1 T T Σ 1 F Σ F G ΣUU() G Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 64
33 Exercise 6.4-4: (Scalar Kalman filer) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 65 Exercise 6.4-5: (Track-While-Scan Radar wih independen acceleraions from scan o scan) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 66
34 Exercise 6.4-6: (Track-While-Scan Radar wih dependen acceleraions from scan o scan) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 67 Exercise 6.4-7: (Sae space represenaion of AR(p)-, MA(q)-, and ARMA(p,q)-Processes) Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 68
35 References o Chaper 6 [1] B.D.O. Anderson and J.B. Moore, Opimal Filering, Dover, 005 [] A. Gelb, Applied Opimal Esimaion, MIT Press, 1974 [3] T. Kailah, A.H. Sayed and B. Hassibi, Linear Esimaion, Prenice Hall, 000 [4] S. Kay, Fundamenals of Saisical Signal Processing, Vol. 1: Esimaion Theory, Prenice Hall, 1993 [5] L. Ljung, Sysem Idenificaion: Theory for he User, Prenice Hall, 1998 [6] M.B. Priesley, Specral Analysis and Time Series, Academic Press, 1984 [7] H.V. Poor, An Inroducion o Signal Deecion and Esimaion, Springer, 1994 Chaper 6 / Sochasic Signals and Sysems / Prof. Dr.-Ing. Dieer Kraus 69
14 Autoregressive Moving Average Models
14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class
More informationRecursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems
8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More information12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =
1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationInstitute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler
MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More information23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes
Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals
More informationCHAPTER 2 Signals And Spectra
CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par
More informationBlock Diagram of a DCS in 411
Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass
More informationThe Potential Effectiveness of the Detection of Pulsed Signals in the Non-Uniform Sampling
The Poenial Effeciveness of he Deecion of Pulsed Signals in he Non-Uniform Sampling Arhur Smirnov, Sanislav Vorobiev and Ajih Abraham 3, 4 Deparmen of Compuer Science, Universiy of Illinois a Chicago,
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationElements of Stochastic Processes Lecture II Hamid R. Rabiee
Sochasic Processes Elemens of Sochasic Processes Lecure II Hamid R. Rabiee Overview Reading Assignmen Chaper 9 of exbook Furher Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A Firs Course
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More information5. Response of Linear Time-Invariant Systems to Random Inputs
Sysem: 5. Response of inear ime-invarian Sysems o Random Inpus 5.. Discree-ime linear ime-invarian (IV) sysems 5... Discree-ime IV sysem IV sysem xn ( ) yn ( ) [ xn ( )] Inpu Signal Sysem S Oupu Signal
More information2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006
2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationEE3723 : Digital Communications
EE373 : Digial Communicaions Week 6-7: Deecion Error Probabiliy Signal Space Orhogonal Signal Space MAJU-Digial Comm.-Week-6-7 Deecion Mached filer reduces he received signal o a single variable zt, afer
More informationADDITIONAL PROBLEMS (a) Find the Fourier transform of the half-cosine pulse shown in Fig. 2.40(a). Additional Problems 91
ddiional Problems 9 n inverse relaionship exiss beween he ime-domain and freuency-domain descripions of a signal. Whenever an operaion is performed on he waveform of a signal in he ime domain, a corresponding
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationChapter 6. Systems of First Order Linear Differential Equations
Chaper 6 Sysems of Firs Order Linear Differenial Equaions We will only discuss firs order sysems However higher order sysems may be made ino firs order sysems by a rick shown below We will have a sligh
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationSOLUTIONS TO ECE 3084
SOLUTIONS TO ECE 384 PROBLEM 2.. For each sysem below, specify wheher or no i is: (i) memoryless; (ii) causal; (iii) inverible; (iv) linear; (v) ime invarian; Explain your reasoning. If he propery is no
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationSection 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients
Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous
More informationContinuous Time. Time-Domain System Analysis. Impulse Response. Impulse Response. Impulse Response. Impulse Response. ( t) + b 0.
Time-Domain Sysem Analysis Coninuous Time. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 1. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 2 Le a sysem be described by a 2 y ( ) + a 1
More informationd 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3
and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationLecture Notes 2. The Hilbert Space Approach to Time Series
Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship
More informationOrdinary dierential equations
Chaper 5 Ordinary dierenial equaions Conens 5.1 Iniial value problem........................... 31 5. Forward Euler's mehod......................... 3 5.3 Runge-Kua mehods.......................... 36
More informationChapter One Fourier Series and Fourier Transform
Chaper One I. Fourier Series Represenaion of Periodic Signals -Trigonomeric Fourier Series: The rigonomeric Fourier series represenaion of a periodic signal x() x( + T0 ) wih fundamenal period T0 is given
More informationLaplace Transform and its Relation to Fourier Transform
Chaper 6 Laplace Transform and is Relaion o Fourier Transform (A Brief Summary) Gis of he Maer 2 Domains of Represenaion Represenaion of signals and sysems Time Domain Coninuous Discree Time Time () [n]
More informationIndependent component analysis for nonminimum phase systems using H filters
Independen componen analysis for nonminimum phase sysems using H filers Shuichi Fukunaga, Kenji Fujimoo Deparmen of Mechanical Science and Engineering, Graduae Shool of Engineering, Nagoya Universiy, Furo-cho,
More informationTesting for a Single Factor Model in the Multivariate State Space Framework
esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics
More informationFrom Particles to Rigid Bodies
Rigid Body Dynamics From Paricles o Rigid Bodies Paricles No roaions Linear velociy v only Rigid bodies Body roaions Linear velociy v Angular velociy ω Rigid Bodies Rigid bodies have boh a posiion and
More informationSome Basic Information about M-S-D Systems
Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,
More informationFor example, the comb filter generated from. ( ) has a transfer function. e ) has L notches at ω = (2k+1)π/L and L peaks at ω = 2π k/l,
Comb Filers The simple filers discussed so far are characeried eiher by a single passband and/or a single sopband There are applicaions where filers wih muliple passbands and sopbands are required The
More information2. Nonlinear Conservation Law Equations
. Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationStationary Time Series
3-Jul-3 Time Series Analysis Assoc. Prof. Dr. Sevap Kesel July 03 Saionary Time Series Sricly saionary process: If he oin dis. of is he same as he oin dis. of ( X,... X n) ( X h,... X nh) Weakly Saionary
More informationForecasting optimally
I) ile: Forecas Evaluaion II) Conens: Evaluaing forecass, properies of opimal forecass, esing properies of opimal forecass, saisical comparison of forecas accuracy III) Documenaion: - Diebold, Francis
More informationR.#W.#Erickson# Department#of#Electrical,#Computer,#and#Energy#Engineering# University#of#Colorado,#Boulder#
.#W.#Erickson# Deparmen#of#Elecrical,#Compuer,#and#Energy#Engineering# Universiy#of#Colorado,#Boulder# Chaper 2 Principles of Seady-Sae Converer Analysis 2.1. Inroducion 2.2. Inducor vol-second balance,
More informationA generalization of the Burg s algorithm to periodically correlated time series
A generalizaion of he Burg s algorihm o periodically correlaed ime series Georgi N. Boshnakov Insiue of Mahemaics, Bulgarian Academy of Sciences ABSTRACT In his paper periodically correlaed processes are
More informationA complex discrete (or digital) signal x(n) is defined in a
Chaper Complex Signals A number of signal processing applicaions make use of complex signals. Some examples include he characerizaion of he Fourier ransform, blood velociy esimaions, and modulaion of signals
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More informationThe Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form
Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure
More informationEKF SLAM vs. FastSLAM A Comparison
vs. A Comparison Michael Calonder, Compuer Vision Lab Swiss Federal Insiue of Technology, Lausanne EPFL) michael.calonder@epfl.ch The wo algorihms are described wih a planar robo applicaion in mind. Generalizaion
More informationTime series model fitting via Kalman smoothing and EM estimation in TimeModels.jl
Time series model fiing via Kalman smoohing and EM esimaion in TimeModels.jl Gord Sephen Las updaed: January 206 Conens Inroducion 2. Moivaion and Acknowledgemens....................... 2.2 Noaion......................................
More informationMATH 128A, SUMMER 2009, FINAL EXAM SOLUTION
MATH 28A, SUMME 2009, FINAL EXAM SOLUTION BENJAMIN JOHNSON () (8 poins) [Lagrange Inerpolaion] (a) (4 poins) Le f be a funcion defined a some real numbers x 0,..., x n. Give a defining equaion for he Lagrange
More informationApplication of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing
Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology
More informationExcel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand
Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338
More informationLECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS
LECTURE : GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS We will work wih a coninuous ime reversible Markov chain X on a finie conneced sae space, wih generaor Lf(x = y q x,yf(y. (Recall ha q
More informationSolutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2
Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.
More informationLicenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A
Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In
More informationLecture 9: September 25
0-725: Opimizaion Fall 202 Lecure 9: Sepember 25 Lecurer: Geoff Gordon/Ryan Tibshirani Scribes: Xuezhi Wang, Subhodeep Moira, Abhimanu Kumar Noe: LaTeX emplae couresy of UC Berkeley EECS dep. Disclaimer:
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More information15. Vector Valued Functions
1. Vecor Valued Funcions Up o his poin, we have presened vecors wih consan componens, for example, 1, and,,4. However, we can allow he componens of a vecor o be funcions of a common variable. For example,
More informationModeling Economic Time Series with Stochastic Linear Difference Equations
A. Thiemer, SLDG.mcd, 6..6 FH-Kiel Universiy of Applied Sciences Prof. Dr. Andreas Thiemer e-mail: andreas.hiemer@fh-kiel.de Modeling Economic Time Series wih Sochasic Linear Difference Equaions Summary:
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationFinancial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2
Financial Economerics Kalman Filer: some applicaions o Finance Universiy of Evry - Maser 2 Eric Bouyé January 27, 2009 Conens 1 Sae-space models 2 2 The Scalar Kalman Filer 2 21 Presenaion 2 22 Summary
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationY 0.4Y 0.45Y Y to a proper ARMA specification.
HG Jan 04 ECON 50 Exercises II - 0 Feb 04 (wih answers Exercise. Read secion 8 in lecure noes 3 (LN3 on he common facor problem in ARMA-processes. Consider he following process Y 0.4Y 0.45Y 0.5 ( where
More informationMath 334 Fall 2011 Homework 11 Solutions
Dec. 2, 2 Mah 334 Fall 2 Homework Soluions Basic Problem. Transform he following iniial value problem ino an iniial value problem for a sysem: u + p()u + q() u g(), u() u, u () v. () Soluion. Le v u. Then
More informationChapter 3 Boundary Value Problem
Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le
More information( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is
UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires
More information0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED
0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable
More information23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes
Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion
More informationSolutions from Chapter 9.1 and 9.2
Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is
More informationDYNAMIC ECONOMETRIC MODELS vol NICHOLAS COPERNICUS UNIVERSITY - TORUŃ Józef Stawicki and Joanna Górka Nicholas Copernicus University
DYNAMIC ECONOMETRIC MODELS vol.. - NICHOLAS COPERNICUS UNIVERSITY - TORUŃ 996 Józef Sawicki and Joanna Górka Nicholas Copernicus Universiy ARMA represenaion for a sum of auoregressive processes In he ime
More informationLAPLACE TRANSFORM AND TRANSFER FUNCTION
CHBE320 LECTURE V LAPLACE TRANSFORM AND TRANSFER FUNCTION Professor Dae Ryook Yang Spring 2018 Dep. of Chemical and Biological Engineering 5-1 Road Map of he Lecure V Laplace Transform and Transfer funcions
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationModel Reduction for Dynamical Systems Lecture 6
Oo-von-Guericke Universiä Magdeburg Faculy of Mahemaics Summer erm 07 Model Reducion for Dynamical Sysems ecure 6 v eer enner and ihong Feng Max lanck Insiue for Dynamics of Complex echnical Sysems Compuaional
More informationA Bayesian Approach to Spectral Analysis
Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2
More informationA Specification Test for Linear Dynamic Stochastic General Equilibrium Models
Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models
More informationChapter 2: Principles of steady-state converter analysis
Chaper 2 Principles of Seady-Sae Converer Analysis 2.1. Inroducion 2.2. Inducor vol-second balance, capacior charge balance, and he small ripple approximaion 2.3. Boos converer example 2.4. Cuk converer
More information4.1 Other Interpretations of Ridge Regression
CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning
More informationWATER LEVEL TRACKING WITH CONDENSATION ALGORITHM
WATER LEVEL TRACKING WITH CONDENSATION ALGORITHM Shinsuke KOBAYASHI, Shogo MURAMATSU, Hisakazu KIKUCHI, Masahiro IWAHASHI Dep. of Elecrical and Elecronic Eng., Niigaa Universiy, 8050 2-no-cho Igarashi,
More informationTesting the Random Walk Model. i.i.d. ( ) r
he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp
More informationm = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19
Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationTHE DISCRETE WAVELET TRANSFORM
. 4 THE DISCRETE WAVELET TRANSFORM 4 1 Chaper 4: THE DISCRETE WAVELET TRANSFORM 4 2 4.1 INTRODUCTION TO DISCRETE WAVELET THEORY The bes way o inroduce waveles is hrough heir comparison o Fourier ransforms,
More informationTechnical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models.
Technical Repor Doc ID: TR--203 06-March-203 (Las revision: 23-Februar-206) On formulaing quadraic funcions in opimizaion models. Auhor: Erling D. Andersen Convex quadraic consrains quie frequenl appear
More informationSub Module 2.6. Measurement of transient temperature
Mechanical Measuremens Prof. S.P.Venkaeshan Sub Module 2.6 Measuremen of ransien emperaure Many processes of engineering relevance involve variaions wih respec o ime. The sysem properies like emperaure,
More informationIntroduction to Probability and Statistics Slides 4 Chapter 4
Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationMathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013
Mahemaical Theory and Modeling ISSN -580 (Paper) ISSN 5-05 (Online) Vol, No., 0 www.iise.org The ffec of Inverse Transformaion on he Uni Mean and Consan Variance Assumpions of a Muliplicaive rror Model
More informationPhysics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution
Physics 7b: Saisical Mechanics Fokker-Planck Equaion The Langevin equaion approach o he evoluion of he velociy disribuion for he Brownian paricle migh leave you uncomforable. A more formal reamen of his
More information