Kalman Filtering with Markovian Packet Losses and Stability Criteria

Size: px
Start display at page:

Download "Kalman Filtering with Markovian Packet Losses and Stability Criteria"

Transcription

1 Proceedings of he 45h IEEE Conference on Decision & Conrol Mancheser Grand Hya Hoel San Diego, CA, USA, December 3-5, 26 Kalman Filering wih Markovian Packe Losses and Sabiliy Crieria Minyi Huang and Subhrakani Dey Absrac We consider Kalman filering in a nework wih packe losses, and use a wo sae Markov chain o describe he normal operaing condiion of packe delivery and ransmission failure. We analyze he behavior of he esimaion error covariance marix and inroduce he noion of peak covariance, which describes he upper envelope of he sequence of error covariance marices {P, } for he case of an unsable scalar model. We give sufficien condiions for he sabiliy of he peak covariance process in he general vecor case; for he scalar case we obain a sufficien and necessary condiion, and derive upper and lower bounds for he ail disribuion of he peak variance. For pracically verifying he sabiliy condiion, we furher inroduce a subopimal esimaor and develop a numerical procedure o generae igher esimae for he consans involved in he sabiliy crierion. I. INTRODUCTION The problem of sae esimaion is of grea imporance in various applicaions ranging from racking, deecion and conrol, and in linear sochasic dynamical sysems, Kalman filering [2], [] plays an essenial role. Recenly here has been an increased research aenion for filering in disribued sysems where sensor measuremens and final signal processing ake place in geographically separae locaions and he usage of wireless or wireline communicaion channels is essenial for daa communicaion. In conras o radiional filering problems, an imporan feaure in hese neworked sysems is ha he delivery of measuremens o he esimaor is no always reliable and losses of daa may occur. In his paper, we consider he opimal filering of a linear sysem wih random packe losses. We focus on he n dimensional linear ime-invarian sysem x + = Ax + w,, where he iniial sae is x a =. The sensor measuremens are obained saring from in he form y = Cx + v, where C R m n,andheny is ransmied by a channel. Here {w, } and {v, } are wo muually independen sequences of i.i.d. Gaussian noises wih covariance marices Q and R>, respecively. The wo noise sequences Work parially suppored by Ausralian Research Council (ARC). M. Huang is wih Deparmen of Informaion Engineering, Research School of Informaion Sciences and Engineering, The Ausralian Naional Universiy, Canberra 2, ACT, Ausralia. minyi.huang@rsise.anu.edu.au S. Dey is wih Deparmen of Elecrical and Elecronic Engineering, The Universiy of Melbourne, Vicoria 3, Ausralia. s.dey@ee.unimelb.edu.au are also independen of x, which is a Gaussian random vecor wih mean x = Ex and covariance marix P x.the underlying probabiliy space is denoed as (Ω, F, P) where F is he σ-algebra of all evens. We consider a communicaion channel such ha y is exacly rerieved or he packe conaining y is los due o corruped daa or subsanial delay. When he packe is successfully received, one obains he observaion y = y, and if here is a packe loss, by our convenion, he observaion obained by he receiver is y. Under his assumpion, he underlying communicaion link may be looked a as an erasure channel a he packe level. We use γ {, } o indicae he arrival (wih value ) or loss (wih value ) of packes. Here γ may be inerpreed as resuling from he physical operaing condiion of a nework and is assumed o be known a he filer. Specifically, he sae for γ may correspond o channel error or nework congesion which causes a sraigh packe loss or long delay resuling in packe dropping a he receiver. For faciliaing he presenaion, and shall be called he failure sae and normal sae, respecively. To capure he emporal correlaion of he channel variaion (e.g, in bursy error condiions), γ is modelled by a wo sae Markov chain wih he ransiion marix [ ] q q α =, () p p where p and q, respecively, are called he failure rae and recovery rae and p, q >. For insance, p denoes he probabiliy of he channel remaining a he normal sae afer one sep ransiion if i sars wih sae. This is usually called he Gilber-Ellio channel model [5], [2]. Obviously, a small value (close o ) for p and large value (close o ) for q mean he channel is more reliable. Based on he hisory F = σ(y i,γ i,i ), which is he σ-algebra generaed by he available informaion up o ime (i.e., all evens ha can be generaed by hese random variables), one can wrie a se of filering and predicion equaions corresponding o he opimal esimae ˆx = E[x F ] and ˆx + = E[x + F ],, respecively, by he same mehod as in [6] which deal wih i.i.d. packe losses. The deails for he recursion of ˆx and ˆx + will no be repeaed here. In his paper we focus on he esimaion /6/$2. 26 IEEE. 562

2 45h IEEE CDC, San Diego, USA, Dec. 3-5, 26 error of ˆx + wih an associaed covariance marix P + = E(x+ ˆx + )(x + ˆx + ). We also wrie P + = P +. To characerize he filering covariance condiioned on he pas hisory, one can easily derive he following random Riccai equaion P + = AP A + Q γ AP C (CP C + R) CP A,, (2) where M denoes he ranspose of a vecor or marix M. The iniial condiion in (2) is P = Var(x )=AP x A +Q. Noe ha γ appears as a random coefficien in he recursion. Under a Bernoulli i.i.d. packe loss modelling, he filering sabiliy can be efficienly sudied by a modified algebraic Riccai equaion (MARE), which is obained by replacing γ in equaion (2) by he arrival rae λ. Subsequenly, he analysis amouns o idenifying a criical value λ c (as a hreshold) such ha sabiliy holds if and only if he arrival rae is greaer han λ c (see Secion IV for addiional discussion) [6]. In conras, when he channel model is given by he Markov chain γ, such a conversion ino a deerminisic MARE is no longer feasible, and since he channel is described by several independen parameers, he usual hreshold argumen is no applicable. A. Background and Relaed Work Nowadays, filering and esimaion consiue an imporan aspec in sensor nework deploymen for monioring, deecion or racking [], [2], [2], as well as muli-vehicle coordinaion [9], since in realiy sensors can only obain noisy informaion abou a physical aciviy in is viciniy. And for many linear sochasic models, a useful ool is he sandard Kalman filering heory which has been widely used in various esimaion and conrol scenarios. Recenly here is an increased aenion for is applicaion in disribued neworks while new heoreical quesions and implemenaion issues emerge. In close relaion o esimaion in lossy sensor neworks, here also has been a long hisory of research on filering wih missing signals a cerain poins of ime, i.e., he oupu does no necessarily conain he signal in quesion and i may be only a noise componen. Such models were referred o as sysems wih uncerain observaions [5], [], [7], [8], where a ypical mehod for sabiliy analysis is o consruc a deerminisic recursion uilizing he saisics of he uncerainy sequence indicaing he availabiliy of signals. In he more recen research on nework models, he work [7] and [3] considered sae esimaion wih lossy measuremens resuling from ime-varying channel condiions. In paricular, he auhors in [7] developed a subopimal jump linear esimaor for complexiy reducion in compuing he correcor gain using finie loss hisory where he loss process is modelled by a wo sae Markov chain. The work [3] inroduced a more general muliple sae Markov chain o model he loss and non-loss channel saes, and he asympoic mean square esimaion error for subopimal linear esimaors is analyzed and opimized by a linear marix inequaliy (LMI) approach. The MARE based analysis in [6] for i.i.d. packe losses was exended o he wo sensor siuaion in [4]. In hese resuls, he occurrence of packe losses is known a he esimaor and his leads o a random Riccai equaion involving he loss indicaor sequence. Conrol problems wih packe losses have been examined in [8], [3], [6]. B. Conribuions and Organizaion In his paper we consider a Markovian packe loss model which capures he emporal correlaion naure of pracical channels, and we develop new analyic echniques for filering sabiliy analysis. In Secion II, we inroduce he noion of peak covariance. The general sufficien condiion in Secion III was iniially obained in our earlier work [9]. In Secion IV we examine he sabiliy propery for he scalar model, and presen a ail disribuion analysis for he peak variance. To find pracically more verifiable sufficien condiions han in [9], in Secion V we inroduce an appropriaely parameerized subopimal esimaor, and opimize he parameer in he subopimal esimaor o produce a igher selecion of he consans in he sabiliy crieria. Secion VI presens some simulaion and compuaional examples. II. EVOLUTION OF THE COVARIANCE In order o simplify he analysis, in he following we assume he iniial sae for γ is γ =. Noe ha his assumpion imposes no essenial resricion and he oher case wih γ =may be reaed in he same manner. Based on equaion (2), we wrie wo separae equaions P + = AP A + Q AP C (CP C + R) CP A, γ = (3) P + = AP A + Q, γ = (4) depending on he value of γ. The covariance process P,asa random process, may be regarded as being governed by a bimodal hybrid sysem where he evoluion of he coninuum componen is driven by a wo sae Markov chain. Such a bi-modal srucure is especially useful and will be exploied in he sabiliy analysis. To make he model nonrivial, hroughou his paper we make he following assumpions: (H) The failure and recovery rae p, q are boh in (, ). (H2) The sysem [A, C] is observable, i.e, he rank of he marix [C,A C,, (A n ) C ] is n. For he reader s convenience, we inroduce he basic definiion of sopping imes alhough i is easily found in exbooks (see, e.g., [4]). A sopping ime τ (associaed wih he Markov chain γ, ) is a measurable map from Ω o he se {, 2,, } such ha {τ k} depends on γ up o ime k. In our filering conex, he wo sequences of sopping imes inroduced during he analysis simply describe he random swich ime of he filer, or equivalenly, he jump ime of he Markov chain γ. Given he iniial condiion γ =, we inroduce he following sopping ime: τ = inf{ >, γ = }. We make he usual convenion ha he infimum of an empy se 5622

3 45h IEEE CDC, San Diego, USA, Dec. 3-5, 26 is +. Thus τ is he firs ime when a packe loss occurs. Furhermore, we define β = inf{, > τ,γ = }. I is clear β is he firs ime he channel recovers from he firs failure. The above procedure is repeaed o define wo sequences τ, τ 2, τ 3,, β, β 2, β 3,, which gives he value of γ a he swich imes: {, if = τi <, γ =, if = β i <. Obviously he following order relaionship holds: (5) <τ <β < <τ k <β k <τ k+ <, (6) whenever each of he enries is finie on he associaed sample poin ω Ω. Lemma : Under condiion (H), wih probabiliy one, he wo sequences {τ i,i } and {β i,i } have finie values for each of heir enries. Lemma forms he basis for he peak covariance noion o be inroduced laer. Define τi = τ i β i, i βi = β i τ i, i where we adop he convenion β =.Hereτi and βi denoe he sojourn imes (i.e., he lengh of a coninuous say) a he success sae and failure sae, respecively. Lemma 2: Under (H), we have (i) he random variables {τi,i } are i.i.d., and τ i is geomerically disribued wih P (τi =k) =( p) k p, k. (ii) he random variables {βi,i } are i.i.d., and β i is geomerically disribued wih P (βi = k) = ( q) k q, k. (iii) The wo sequences of random variables {τi,i } and {βi,i } are independen of each oher. Now we define β k = β k. (7) In fac, β k is he las ime of visi of γ, o he failure sae sinceτ k. The ime β k is useful for analyzing he filering performance in ha i provides a basis for esimaing o wha exen he covariance process may deeriorae resuling from successive packe losses. Immediaely from β k,anew packe will arrive a he observer, and he sae predicion for he nex sep will sar o improve. The period [τ i,β i ] and [β i,τ i+ ] shall be called he loss cycle and normal cycle, respecively. Labelling a subsequence of he covariance process P k by he sequence of imes β k, we denoe M k = P βk. (8) M k denoes he predicion error covariance P βk β k compued by (4) a = β k. For an unsable scalar model, saring from τ k +, P monoonically increases o reach a maximum M k = P βk a ime β k before urning downward; he sequence {M k,k } gives he upper envelope of he covariance sequence. For his reason, we shall call M k he peak covariance process. In he muli-dimensional (vecor) case, P does no necessarily change monoonically before or afer reaching M k according o he packe arrival or loss; o faciliae our presenaion, however, we shall sill refer o M k as he peak covariance process. Definiion 3: We say he sequence {M k,k } is sable if sup k E M k <. Accordingly, we say he (filering) sysem saisfies peak covariance sabiliy. III. SUFFICIENT CONDITION FOR PEAK COVARIANCE STABILITY Le S n denoe he se of all n n nonnegaive definie real marices. Based on Kalman filering, define he map F (P )=AP A + Q AP C (CPC + R) CPA, (9) where P S n.iiseasyoshowf(p) S n.toanalyze he map F, we inroduce he following definiion. Definiion 4: For he observable linear sysem [A, C], he observabiliy index is he smalles ineger I o such ha [C,A C,, (A Io ) C ] has rank n. Under he observabiliy assumpion (H2), he ineger I o specified in Definiion 4 obviously exiss. For a deerminisic sysem, I o specifies he minimum number of observaions which are required in order o reconsruc he iniial condiion of an observable sysem. Define S n = {P : P A PA +Q, for some P }, which is a convex subse of S n. Lemma 5: Leing F be defined by (9), here exiss a consan K>such ha (i) for any P S n, F k ( P ) KI for all k I ; (ii) for any P S n, F k+ ( P ) KI for all k I,whereI is he n n ideniy marix. The sraegy o prove he lemma is o run an auxiliary Kalman filer; see [9] for deails. Remark: The observabiliy condiion may be relaxed o deecabiliy, and one can idenify an associaed index I o such ha Lemma 5 holds. Then he subsequen analysis in his paper can be exended o he deecable model in a sraighforward manner. We inroduce a few consans. For i (I o ), le C () i and C () i saisfy he following inequaliy F i (P ) C () i P + C () i, P S n, () where denoes he induced norm for marices. By he fac F (P ) AP A + Q, i is clear he above pair (C () i,c () i ) always exiss. For he case I =,wemayakec () =. Theorem 6: [9] The peak covariance process is sable if he following wo condiions hold: (i) λ A 2 ([ q) <, (ii) pqc () + ] I o i= C() i ( p) i j= Aj 2 ( q) j <, where λ A is an eigenvalue of A wih he larges absolue value. 5623

4 45h IEEE CDC, San Diego, USA, Dec. 3-5, 26 We give a brief discussion on condiion (ii). Noice ha under condiion (i), he infinie series in condiion (ii) converges. Now le he pair A and q be fixed such ha (i) holds. Then i is easy o check ha for he given pair (A, q), ifp is sufficienly small, condiion (ii) is always saisfied. Corollary 7: If C is inverible, condiion (ii) in Theorem 6 vanishes and he peak covariance sabiliy holds under condiion (i). IV. STABILITY OF THE SCALAR MODEL For he scalar case, condiion (ii) in Theorem 6 vanishes since in his case C () =. The reason is ha for he scalar Riccai equaion, once here is an arrival of one packe a, P + becomes bounded by a fixed consan, regardless of he value of P. Furhermore we can show ha condiion (i) in Theorem 6 is also necessary. This leads o a sufficien and necessary condiion. Noe ha his condiion only depends on he recovery rae of he Markov chain {γ, }. For he scalar case, we se he coefficiens A and C in he dynamics o heir lower case form, i.e., A = a and C = c. The erm covariance is also replaced by variance. A. The Sufficien and Necessary Condiion for Sabiliy Theorem 8: Leing r, wehavesup k E P βk r < if and only if a 2r ( q) <. I is clearly seen from Theorem 8 ha, wih a given a >, for obaining higher order sabiliy resuls, we need o pu a more sringen condiion on he recovery rae q. By aking r = in Theorem 8, we conclude ha in he scalar model a sufficien and necessary condiion for peak covariance sabiliy is a 2 ( q) <. In he following we esablish he sabiliy on he sandard variance process P. To simplify he esimaes, we only analyze he symmeric case wih p = q, in which he disribuion of he random variable τ k 2k + is he convoluion of 2k i.i.d. geomeric disribuions, and his subsanially simplifies he calculaions. For he general case wih p q, he calculaion is much more involved. Theorem 9: For he scalar model wih p = q, ifa 2 ( q) <, hen he variance process has he usual sabiliy propery, i.e., sup EP <. B. The Relaion beween Differen Sabiliy Noions For illuminaing he relaionship beween our peak covariance sabiliy wih oher exising sabiliy resuls in he lieraure, we specialize o he scalar model wih i.i.d. packe losses. In his case, [ he ransiion] marix of he channel given q q by () reduces o, wih an associaed packe q q loss probabiliy p = q. I is shown in [6] (Theorem 2 and Sec. IV) ha for he scalar model wih i.i.d. packe losses, sup E P < (we erm his as he usual sabiliy of P ) if and only if he packe arrival rae λ>λ c = /a 2,or equivalenly, q> /a 2. () Recalling Theorem 8, () is also a necessary and sufficien condiion for he peak variance sabiliy for he special case of i.i.d. packe losses. Then we can immediaely claim he following relaionship. Corollary : For he scalar model wih i.i.d. packe losses, he peak variance sabiliy is equivalen o he usual sabiliy (i.e., sup E P < ). For he scalar model wih i.i.d. packe losses, i is of ineres o noe ha he peak variance sabiliy is seemingly sronger han he usual sabiliy as he former characerizes a cerain boundedness propery along he upper envelope of he variance rajecories, bu acually i is no, as saed in Corollary. For he vecor case when P is a marix, he relaion beween he wo sabiliy noions as discussed above is much more complicaed as he sabiliy condiion is no jus reduced o he inequaliy (). C. Tail Disribuion of he Peak Variance Now we examine he ail disribuion of he peak variance when i is sable, i.e., a 2 ( q) <. We resric o he case a > and Q>. ForM>, define he ail disribuion of P βk, k, asp ail (M) =P {P βk M}. I is easy o show ha Q P τk a 2 R/c 2 + Q = P. Below we resric o M P (a 2 Q). I can be verified ha {P βk M} {βk ln(m/q) ln a }. Denoe by x he 2 smalles ineger no less han x. Hence P {P βk M} ( q) ln(m/q) ln a 2 ( q) ln(m/q) ln a 2. Denoe κ = ln( q) ln a >, where a >. We have 2 P ail (M) Q κ M κ. In a similar manner, we have {P βk M} = {F β k (Pτk ) M} {βk ln(m/ P ) ln a 2 + ln(a2 ) ln a 2 2}. Hence P {P βk M} ( q) ln(m/ P ) ln a 2 + ln(a2 ) ln a 2 2,which gives P ail (M) ζ P κ M κ,whereζ =( q) ln(a 2 ) ln a 2 2. For M P (a 2 Q), i follows ha Q κ M κ P ail (M) ζ P κ M κ which gives he lower and upper bound esimaes. I is seen ha he decaying rae of he ail disribuion depends on he raio κ which in urn is relaed o he sabiliy margin associaed wih he condiion a 2 ( q) < and a >. V. STABILITY CHECK BY LINEAR SUBOPTIMAL ESTIMATORS Theorem 6 gives a crierion for checking he sabiliy of he peak covariance process. In paricular, condiion (ii) depends on some consans relaed o he operaor F defined by (). In general, i is difficul o explicily compue hese consans, and a rough selecion may lead o very conservaive condiions for he pair (p, q). In his secion, we combine he analyic echnique in Secion III wih a numerical procedure o give a pracically useful selecion of hese consans. The basic idea is as follows. Firs we 5624

5 45h IEEE CDC, San Diego, USA, Dec. 3-5, 26 consruc a subopimal esimaor and inroduce is predicion error covariance Pk s, where s indicaes i is yielded by he subopimal esimaor. Nex, i is easy o esablish a dominance relaionship beween P k and Pk s, i.e., P k Pk s, Subsequenly, if he sysem dynamics ogeher wih he channel saisics ensure sabiliy of Pβ s k, hen he sabiliy of P βk naurally follows. Below we resric o linear subopimal esimaors where he filering correcor gain L for he case of a packe arrival is a consan marix o be seleced. We consruc he following subopimal esimaor: ˆx s k k =ˆxs k k + {γ k =}L(y k C ˆx s k k ) ˆx s k k = Aˆxs k k. The predicion error covariance P+ s = P+ s,, is described by P s + ={A(I LC)P s (I LC) A + ALRL A } {γ=} + AP s A {γ=} + Q. For he case γ =,wege P s + = A(I LC)P s (I LC) A + ALRL A + Q. (2) Based on (2) we inroduce he operaor F L (P )=A(I LC)P (I LC) A + ALRL A + Q. For he Kalman filer and he subopimal esimaor, we have he following dominance relaionship. Theorem : Le he common iniial condiion P x be given for he Kalman filer and he subopimal esimaor. Wih probabiliy one, we have P s k P k, k. (3) Proof. By using Kalman filering wihou packe losses, we can esablish he relaion F (P ) F L (P ) for all P. We assume P = Var(x ); hen for any marix H, H ˆx 2 is he minimum covariance esimae of Hx 2. Thus, H(x 2 ˆx 2 )(x 2 ˆx 2 ) H H(x 2 ˆx s 2 )(x 2 ˆx s 2 ) H which means HF(P )H = HP 2 H HP2 s H = HF L (P )H, and herefore F (P ) F L (P ). Nex, he Kalman filering covariance sequence P k (P ) as a funcion of P is monoone, i.e., P k (P ) P k ( P ) if P P.I is easy o check ha Ψ(P ), sanding for F L (P ) or AP A +Q, also has he same monoone propery. Finally, by applying hese monoone properies along he sequence γ, we see ha (3) holds wih probabiliy one. Corollary 2: If {Pβ s k,k } is sable, hen he peak covariance of P k is also sable. For he operaor F L, in analogy o Secion III, we also define he consans as follows. For i (I o ), le C L,() i and C L,() i saisfy he following inequaliy FL(P i ) C L,() i P + C L,() i, P S n. (4) I is obvious he above pair (C L,() i,c L,() i ) always exiss. The following sabiliy resul can be proved by he same mehod as in proving Theorem 6. Corollary 3: The covariance process {Pβ s k,k } is sable if he following wo condiions hold: (i) λ A 2 ( q) <, (ii) pqc L,() [ + ] I o i= CL,() i ( p) i j= Aj 2 ( q) j <, where λ A is an eigenvalue of A wih he larges absolue value. For a pracical applicaion o he sabiliy Theorem 6 for he Kalman filer, we may choose a suiable L o reduce he magniude of C L,() i. Then by he fac F (P ) F L (P ), we may se C () i = C L,() i, i I. VI. NUMERICAL EXAMPLES A. Simulaions for he Peak Covariance We firs consider a scalar sysem wih parameers [A, C] = [a, c] =[.4, ], Q = R =and P =. For his model, in order o guaranee sabiliy, he minimum recovery rae is q c = /a 2 = Fig. shows a ypical sample pah wih he parameer q =.6 >q c, which ensures sabiliy of he peak variance process. The horizonal axis in he figure is he discree ime. Along ha sample pah, we have τ =3, β =6, τ 2 =23, β 2 =25, ec. In Fig. -op, he curve displays he change of he variance along ha sample pah, and Fig. -boom shows he associaed channel sae jumping beween and. A high peak value for he variance is observed near =6, and his is due o he muliple successive packe losses. Fig. 2 shows a sample pah wih q =.32 <q c. Since in his case he recovery rae is low, he variance process has more chances o reach a high level. We coninue o examine a vecor example specified by A = [ ], C =[, ]. (5) The covariance of w is Q = I R 2 2, and he variance of v is R =.Wehave F (P ) AA P. I is easily checked ha he observabiliy index I o =2andwemayake C () =2.83, (6) since AA has wo eigenvalues λ =.2879 and λ 2 = By condiion (i) in Theorem 6, he recovery rae mus saisfy q > λ A 2 = From now on we ake q =.65. By numerical calculaion, we have j= Aj 2 ( q) j Then if p <.4, condiion (ii) holds. Fig. 3 shows a sample pah for his model wih parameers p =.3 and q =.65; P () and P 2 () are wo enries in he 2 2 marix P, and he channel sae is displayed beween = and = 2. Forhe associaed channel wih (p, q) =(.3,.65), he saionary disribuion of he failure sae is P (γ =)=.448. Thus he long erm packe loss rae is abou 4.4%. Unlike he scalar case, we only have a sufficien condiion for filering sabiliy, and condiion (ii) in Theorem 6 specifying he region for (p, q) may be conservaive. However, his crierion is sill useful since i covers some pracical models wih packe loss rae as high as several percens. 5625

6 45h IEEE CDC, San Diego, USA, Dec. 3-5, P P () P 2 () γ γ Fig.. The variance P and channel sae γ, q =.6. Fig. 3. P (),P 2 () and channel sae γ, q =.65 for he vecor case Fig. 2. The variance P and channel sae γ, q =.32. B. Subopimal Esimaor Aided Sabiliy Check For he wo dimensional example given by (5), wih he aid of he subopimal esimaor, we may ake C () = (A ALC)(A ALC) by recalling F (P ) F L (P ) and he srucure of F L (P ). NowheaskisofindL such ha A L = (A ALC)(A ALC) is minimized. Here we use a numerical mehod o search for an ideal value for L = [l,l 2 ] T. We compue he value A L for (l,l 2 ) onagrid[.6, 2] [.7, 2] wih a sep size.5 on boh edges, which gives a oal of poins. On he grid, he minimum of.22 for A L is aained by (l,l 2 )=(.5,.5). Now we may ake C () =.22 wih a significan improvemen from he rough esimae in (6). On he oher hand, he seady-sae ( soluion o he Riccai ) equaion P = F (P ) is P = Accordingly, he seady-sae correcor gain for he sae predicion equaion in a sandard Kalman filer is L = PC (CPC+R) =(.385,.292) T. I can be checked ha (A AL C)(A AL C) =4.46 (>.22), which only gives a very poor bound for C (). This suggess a careful search of L is imporan. REFERENCES [] C.-Y. Chong and S. P. Kumar. Sensor neworks: evoluion, opporuniies, and challenges, Proc. IEEE, vol. 9, pp , Aug. 23. P γ [2] E. O. Ellio. Esimaion of error raes for codes on burs-noise channels. Bell Sys. Tech. J., vol. 42, pp , Sep [3] A. K. Flecher, S. Rangan, and V. K. Goyal. Esimaion from lossy sensor daa: jump linear modeling and Kalman filering. Proc. he 3rd ACM/IEEE Inernaional Symposium on Informaion Processing in Sensor Neworks, Berkeley, CA, pp , Apr. 24. [4] D. Freedman. Markov Chains, Springer-Verlag, New York, 983. [5] E. N. Gilber. Capaciy of burs-noise channels. Bell Sys. Tech. J., vol. 39, pp , Sep., 96. [6] V. Gupa, D. Spanos, B. Hassibi, and R. M. Murray. Opimal LQG conrol across packe-dropping links. Proc. American Conrol Conference, Porland, OR, pp , June 25. [7] M. T. Hadidi and S. C. Schwarz. Linear recursive sae esimaion under uncerain observaions. IEEE Trans. Auoma. Conrol, vol. 24, no. 6, pp , Dec [8] C. N. Hadjicosis and R. Touri. Feedback conrol uilizing packe dropping nework links. Proc. IEEE Conf. Decision and Conrol, Las Vegas, NV, pp. 25-2, Dec. 22. [9] M. Huang and S. Dey. Sabiliy of Kalman filering wih Markovian packe losses. Auomaica (acceped), 26. [] A. G. Jaffer and S. C. Gupa. Recursive Bayesian esimaion wih uncerain observaion. IEEE Trans. Inform. Theory, vol. 7, pp , Sep. 97. [] T. Kailah, A. H. Sayed, and B. Hassibi. Linear Esimaion, Prenice- Hall, Upper Saddle River, NJ, 2. [2] R. E. Kalman. A new approach o linear filering and predicion problems. Trans. ASME J. Basic Eng., Ser. D., vol. 82, pp , Mar. 96. [3] Q. Ling and M. Lemmon. Sof real-ime scheduling of neworked conrol sysems wih dropous governed by a Markov chain. Proc. American Conrol Conf., Denver, CO, pp , June, 23. [4] X. Liu and A. J. Goldsmih. Kalman filering wih parial observaion losses. Proc. IEEE Conf. Decision Conr., Bahamas, pp , Dec. 24. [5] N. E. Nahi. Opimal recursive esimaion wih uncerain observaion. IEEE Trans. Inform. Theory, vol. 5, pp , July 969. [6] B. Sinopoli, L. Schenao, M. Franceschei, K. Poolla, M. I. Jordan, and S. S. Sasry. Kalman filering wih inermien observaions, IEEE Trans. Auoma. Conrol, vol. 49, no. 9, pp , Sep. 24. [7] S. C. Smih and P. Seiler. Esimaion wih lossy measuremens: jump esimaors for jump sysems. IEEE Trans. Auoma. Conr., vol. 48, pp , Dec. 23. [8] J. K. Tugnai. Asympoic sabiliy of he MMSE linear filer for sysems wih uncerain observaions. IEEE Trans. Inform. Theory, vol. 27, no. 2, pp , Mar 98. [9] P. Varaiya. Smar cars on smar roads: Problems of conrol. IEEE Trans. Auoma. Conrol, vol. 38, pp , Feb [2] H. Zhang, J. M. F. Moura and B. Krogh. Esimaion in sensor neworks: A graph approach. Proc. 4h Inerna. Symp. Inform. Process. in Sensor Neworks (IPSN), Los Angeles, pp , April, 25 [2] F. Zhao, J. Shin and J. Reich. Informaion-driven dynamic sensor collaboraion, IEEE Sig. Process. Mag., vol. 9, pp. 6-72, Mar

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Mean-square Stability Control for Networked Systems with Stochastic Time Delay

Mean-square Stability Control for Networked Systems with Stochastic Time Delay JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS Xinping Guan ;1 Fenglei Li Cailian Chen Insiue of Elecrical Engineering, Yanshan Universiy, Qinhuangdao, 066004, China. Deparmen

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006 2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)

More information

Nonlinear observation over erasure channel

Nonlinear observation over erasure channel Nonlinear observaion over erasure channel Ami Diwadkar Umesh Vaidya Absrac In his paper, we sudy he problem of sae observaion of nonlinear sysems over an erasure channel. The noion of mean square exponenial

More information

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar CONROL OF SOCHASIC SYSEMS P.R. Kumar Deparmen of Elecrical and Compuer Engineering, and Coordinaed Science Laboraory, Universiy of Illinois, Urbana-Champaign, USA. Keywords: Markov chains, ransiion probabiliies,

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 2, May 2013, pp. 209 227 ISSN 0364-765X (prin) ISSN 1526-5471 (online) hp://dx.doi.org/10.1287/moor.1120.0562 2013 INFORMS On Boundedness of Q-Learning Ieraes

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

An Introduction to Malliavin calculus and its applications

An Introduction to Malliavin calculus and its applications An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214

More information

Object tracking: Using HMMs to estimate the geographical location of fish

Object tracking: Using HMMs to estimate the geographical location of fish Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differenial Equaions 5. Examples of linear differenial equaions and heir applicaions We consider some examples of sysems of linear differenial equaions wih consan coefficiens y = a y +... + a

More information

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data Chaper 2 Models, Censoring, and Likelihood for Failure-Time Daa William Q. Meeker and Luis A. Escobar Iowa Sae Universiy and Louisiana Sae Universiy Copyrigh 1998-2008 W. Q. Meeker and L. A. Escobar. Based

More information

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach 1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model

More information

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems.

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems. di ernardo, M. (995). A purely adapive conroller o synchronize and conrol chaoic sysems. hps://doi.org/.6/375-96(96)8-x Early version, also known as pre-prin Link o published version (if available):.6/375-96(96)8-x

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires

More information

Distributed Linear Supervisory Control

Distributed Linear Supervisory Control 3rd IEEE Conference on Decision and Conrol December -7, Los Angeles, California, USA Disribued Linear Supervisory Conrol Ali Khanafer, Tamer Başar, and Daniel Liberzon Absrac In his work, we propose a

More information

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Optimality Conditions for Unconstrained Problems

Optimality Conditions for Unconstrained Problems 62 CHAPTER 6 Opimaliy Condiions for Unconsrained Problems 1 Unconsrained Opimizaion 11 Exisence Consider he problem of minimizing he funcion f : R n R where f is coninuous on all of R n : P min f(x) x

More information

Testing the Random Walk Model. i.i.d. ( ) r

Testing the Random Walk Model. i.i.d. ( ) r he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp

More information

4.1 Other Interpretations of Ridge Regression

4.1 Other Interpretations of Ridge Regression CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

Optimal Server Assignment in Multi-Server

Optimal Server Assignment in Multi-Server Opimal Server Assignmen in Muli-Server 1 Queueing Sysems wih Random Conneciviies Hassan Halabian, Suden Member, IEEE, Ioannis Lambadaris, Member, IEEE, arxiv:1112.1178v2 [mah.oc] 21 Jun 2013 Yannis Viniois,

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Robust Control Over a Packet-based Network

Robust Control Over a Packet-based Network Robus Conrol Over a Packe-based Nework Ling Shi, Michael Epsein and Richard M. Murray Absrac In his paper, we consider a robus nework conrol problem. We consider linear unsable and uncerain discree ime

More information

Filtering Turbulent Signals Using Gaussian and non-gaussian Filters with Model Error

Filtering Turbulent Signals Using Gaussian and non-gaussian Filters with Model Error Filering Turbulen Signals Using Gaussian and non-gaussian Filers wih Model Error June 3, 3 Nan Chen Cener for Amosphere Ocean Science (CAOS) Couran Insiue of Sciences New York Universiy / I. Ouline Use

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Echocardiography Project and Finite Fourier Series

Echocardiography Project and Finite Fourier Series Echocardiography Projec and Finie Fourier Series 1 U M An echocardiagram is a plo of how a porion of he hear moves as he funcion of ime over he one or more hearbea cycles If he hearbea repeas iself every

More information

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS *

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS * haper 5 HERNOFF DISTANE AND AFFINITY FOR TRUNATED DISTRIBUTIONS * 5. Inroducion In he case of disribuions ha saisfy he regulariy condiions, he ramer- Rao inequaliy holds and he maximum likelihood esimaor

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

The Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite

The Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite American Journal of Operaions Research, 08, 8, 8-9 hp://wwwscirporg/journal/ajor ISSN Online: 60-8849 ISSN Prin: 60-8830 The Opimal Sopping Time for Selling an Asse When I Is Uncerain Wheher he Price Process

More information

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms Advances in Dynamical Sysems and Applicaions. ISSN 0973-531 Volume Number 1 007, pp. 107 11 Research India Publicaions hp://www.ripublicaion.com/adsa.hm Boundedness and Exponenial Asympoic Sabiliy in Dynamical

More information

4 Sequences of measurable functions

4 Sequences of measurable functions 4 Sequences of measurable funcions 1. Le (Ω, A, µ) be a measure space (complee, afer a possible applicaion of he compleion heorem). In his chaper we invesigae relaions beween various (nonequivalen) convergences

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

On a Discrete-In-Time Order Level Inventory Model for Items with Random Deterioration

On a Discrete-In-Time Order Level Inventory Model for Items with Random Deterioration Journal of Agriculure and Life Sciences Vol., No. ; June 4 On a Discree-In-Time Order Level Invenory Model for Iems wih Random Deerioraion Dr Biswaranjan Mandal Associae Professor of Mahemaics Acharya

More information

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

Solutions for Assignment 2

Solutions for Assignment 2 Faculy of rs and Science Universiy of Torono CSC 358 - Inroducion o Compuer Neworks, Winer 218 Soluions for ssignmen 2 Quesion 1 (2 Poins): Go-ack n RQ In his quesion, we review how Go-ack n RQ can be

More information

EE363 homework 1 solutions

EE363 homework 1 solutions EE363 Prof. S. Boyd EE363 homework 1 soluions 1. LQR for a riple accumulaor. We consider he sysem x +1 = Ax + Bu, y = Cx, wih 1 1 A = 1 1, B =, C = [ 1 ]. 1 1 This sysem has ransfer funcion H(z) = (z 1)

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Lecture 4 Notes (Little s Theorem)

Lecture 4 Notes (Little s Theorem) Lecure 4 Noes (Lile s Theorem) This lecure concerns one of he mos imporan (and simples) heorems in Queuing Theory, Lile s Theorem. More informaion can be found in he course book, Bersekas & Gallagher,

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

The General Linear Test in the Ridge Regression

The General Linear Test in the Ridge Regression ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge

More information

Signaling equilibria for dynamic LQG games with. asymmetric information

Signaling equilibria for dynamic LQG games with. asymmetric information Signaling equilibria for dynamic LQG games wih asymmeric informaion Deepanshu Vasal and Achilleas Anasasopoulos Absrac We consider a finie horizon dynamic game wih wo players who observe heir ypes privaely

More information

SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F. Trench. SIAM J. Matrix Anal. Appl. 11 (1990),

SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F. Trench. SIAM J. Matrix Anal. Appl. 11 (1990), SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F Trench SIAM J Marix Anal Appl 11 (1990), 601-611 Absrac Le T n = ( i j ) n i,j=1 (n 3) be a real symmeric

More information

Timed Circuits. Asynchronous Circuit Design. Timing Relationships. A Simple Example. Timed States. Timing Sequences. ({r 6 },t6 = 1.

Timed Circuits. Asynchronous Circuit Design. Timing Relationships. A Simple Example. Timed States. Timing Sequences. ({r 6 },t6 = 1. Timed Circuis Asynchronous Circui Design Chris J. Myers Lecure 7: Timed Circuis Chaper 7 Previous mehods only use limied knowledge of delays. Very robus sysems, bu exremely conservaive. Large funcional

More information

Math 334 Fall 2011 Homework 11 Solutions

Math 334 Fall 2011 Homework 11 Solutions Dec. 2, 2 Mah 334 Fall 2 Homework Soluions Basic Problem. Transform he following iniial value problem ino an iniial value problem for a sysem: u + p()u + q() u g(), u() u, u () v. () Soluion. Le v u. Then

More information

4. Advanced Stability Theory

4. Advanced Stability Theory Applied Nonlinear Conrol Nguyen an ien - 4 4 Advanced Sabiliy heory he objecive of his chaper is o presen sabiliy analysis for non-auonomous sysems 41 Conceps of Sabiliy for Non-Auonomous Sysems Equilibrium

More information

. Now define y j = log x j, and solve the iteration.

. Now define y j = log x j, and solve the iteration. Problem 1: (Disribued Resource Allocaion (ALOHA!)) (Adaped from M& U, Problem 5.11) In his problem, we sudy a simple disribued proocol for allocaing agens o shared resources, wherein agens conend for resources

More information

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game Sliding Mode Exremum Seeking Conrol for Linear Quadraic Dynamic Game Yaodong Pan and Ümi Özgüner ITS Research Group, AIST Tsukuba Eas Namiki --, Tsukuba-shi,Ibaraki-ken 5-856, Japan e-mail: pan.yaodong@ais.go.jp

More information

State Estimation in Energy Harvesting Systems

State Estimation in Energy Harvesting Systems 1 Sae Esimaion in Energy Harvesing Sysems Omur Ozel Venka Ananharam Deparmen of Elecrical Engineering and Compuer Sciences Universiy of California, Berkeley, CA 94720 ozel@berkeley.edu ananh@berkeley.edu

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

Estimation of Poses with Particle Filters

Estimation of Poses with Particle Filters Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU

More information

Air Traffic Forecast Empirical Research Based on the MCMC Method

Air Traffic Forecast Empirical Research Based on the MCMC Method Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,

More information

The electromagnetic interference in case of onboard navy ships computers - a new approach

The electromagnetic interference in case of onboard navy ships computers - a new approach The elecromagneic inerference in case of onboard navy ships compuers - a new approach Prof. dr. ing. Alexandru SOTIR Naval Academy Mircea cel Bărân, Fulgerului Sree, Consanţa, soiralexandru@yahoo.com Absrac.

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t M ah 5 2 7 Fall 2 0 0 9 L ecure 1 0 O c. 7, 2 0 0 9 Hamilon- J acobi Equaion: Explici Formulas In his lecure we ry o apply he mehod of characerisics o he Hamilon-Jacobi equaion: u + H D u, x = 0 in R n

More information

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion

More information

Recursive Estimation and Identification of Time-Varying Long- Term Fading Channels

Recursive Estimation and Identification of Time-Varying Long- Term Fading Channels Recursive Esimaion and Idenificaion of ime-varying Long- erm Fading Channels Mohammed M. Olama, Kiran K. Jaladhi, Seddi M. Djouadi, and Charalambos D. Charalambous 2 Universiy of ennessee Deparmen of Elecrical

More information

LECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS

LECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS LECTURE : GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS We will work wih a coninuous ime reversible Markov chain X on a finie conneced sae space, wih generaor Lf(x = y q x,yf(y. (Recall ha q

More information

Performance of Stochastically Intermittent Sensors in Detecting a Target Traveling between Two Areas

Performance of Stochastically Intermittent Sensors in Detecting a Target Traveling between Two Areas American Journal of Operaions Research, 06, 6, 99- Published Online March 06 in SciRes. hp://www.scirp.org/journal/ajor hp://dx.doi.org/0.436/ajor.06.60 Performance of Sochasically Inermien Sensors in

More information

Lecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples

Lecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,

More information

RC, RL and RLC circuits

RC, RL and RLC circuits Name Dae Time o Complee h m Parner Course/ Secion / Grade RC, RL and RLC circuis Inroducion In his experimen we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors.

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

LAPLACE TRANSFORM AND TRANSFER FUNCTION

LAPLACE TRANSFORM AND TRANSFER FUNCTION CHBE320 LECTURE V LAPLACE TRANSFORM AND TRANSFER FUNCTION Professor Dae Ryook Yang Spring 2018 Dep. of Chemical and Biological Engineering 5-1 Road Map of he Lecure V Laplace Transform and Transfer funcions

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

Excel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand

Excel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338

More information