A Distributed Multiple-Target Identity Management Algorithm in Sensor Networks

Size: px
Start display at page:

Download "A Distributed Multiple-Target Identity Management Algorithm in Sensor Networks"

Transcription

1 A Disribued Muliple-Targe Ideniy Managemen Algorihm in Sensor Neworks Inseok Hwang, Kaushik Roy, Hamsa Balakrishnan, and Claire Tomlin Dep. of Aeronauics and Asronauics, Sanford Universiy, CA Dep. of Elecrical Engineering, Sanford Universiy, CA ishwang, kroy1, hamsa, Absrac In his paper, we develop a disribued ideniy managemen algorihm for muliple arges in sensor neworks. Each sensor is assumed o have he capabiliy of managing ideniies of muliple arges wihin is surveillance region and of communicaing wih is neighboring sensors. We use he algorihm from our companion paper [1] o incorporae local informaion abou he ideniy of a arge when i is available o a local sensor and a he same ime reduces he uncerainy of he arge s ideniy as measured by enropy. Ideniy informaion fusion is crucial for disribued ideniy managemen o compue he global informaion of he sysem from informaion provided by local sensors. We formulae his problem as an opimizaion problem and presen hree differen cos funcions, namely, Shannon informaion, Chernoff informaion, and he sum of Kullback-Leibler disances, which represen differen performance crieria. Using Bayesian analysis, we derive a daa fusion algorihm ha needs a prior probabiliy of he given daa. Finally, we demonsrae he performance of he disribued ideniy managemen algorihm using scenarios from muliple-aircraf racking in a sensor (radar) nework wih differen fusion crieria. I. INTRODUCTION The las few decades have seen many advances in wireless communicaion echniques and in sensor echnology. These advances, combined wih growing ineres in boh miliary and civilian applicaions in using disribued sensors, have led o he concep of a sensor nework. These applicaions include balefield surveillance and enemy racking in miliary applicaions, and habia monioring, environmen observaion, and raffic surveillance in civilian applicaions ([2], [3] and references herein). A sensor nework is a nework of sensor nodes which have local sensing, processing, and communicaion capabiliies. Many applicaions of sensor neworks, such as arge racking and habia monioring using only local informaion (i.e., informaion obained by each sensor), have a unique problem ha does no arise in a cenralized nework: scalable disribued informaion fusion. This implies ha he global saes of he sysem mus be esimaed and mainained using only local informaion available o local sensors. In his paper, we presen a Disribued Muliple-Targe Ideniy Managemen (DMIM) algorihm which can esimae he ideniies of muliple maneuvering arges in sensor neworks. For DMIM in sensor neworks, informaion abou he ideniy of a arge may become available o a local sensor, and hus we need mehods which can incorporae his new informaion o reduce he uncerainy of he sysem. For he case in which he number of arges is consan, he Sinkhorn algorihm [4] is used in [5], [6], [7]. However, in disribued sensor neworks, he number of arges in he surveillance region of each sensor may change over ime and he Sinkhorn algorihm may no converge for his case. In [1], we have developed an algorihm which can solve his problem in polynomial ime and in his paper, we use his algorihm for local informaion incorporaion. A crucial par of he DMIM algorihm is disribued informaion fusion. In disribued sensor neworks, ideniy informaion of muliple arges is mainained by individual sensors and each sensor can manage only ideniies of he arges wihin is surveillance region. Thus, each sensor has only a knowledge abou is neighborhood, no he global picure of he whole sysem. To ge he global informaion from informaion mainained by individual local sensors, we need an informaion fusion algorihm. To fully exploi he capabiliy of sensor neworks, his algorihm should be scalable, i.e., adding/deleing sensors or arges ino a sensor nework can be handled efficienly, and disribued, i.e., he algorihm can be implemened in individual sensors. We formulae he informaion fusion problem as an opimizaion problem and propose hree differen cos funcions: Shannon informaion, Chernoff informaion, and he sum of Kullback-Leibler disances o represen differen performance crieria. Using Bayesian analysis, we also derive an informaion fusion algorihm ha needs a prior probabiliy of he given daa. Finally, we apply he DMIM algorihm o muliple-aircraf racking problems in sensor neworks and demonsrae he performance of he proposed informaion fusion algorihms under differen scenarios. This paper is organized as follows: In Secion II, he Disribued Muliple-Targe Ideniy Managemen (DMIM) algorihm including local informaion incorporaion and belief informaion fusion is presened. Secion III presens applicaions of he DMIM algorihm o muliple-aircraf racking in sensor neworks. Finally, our conclusions are presened in Secion IV. II. DISTRIBUTED MULTIPLE-TARGET IDENTITY MANAGEMENT (DMIM) In his secion, we consider he problem of managing ideniies of muliple arges in sensor neworks. Each sensor

2 is assumed o have is own surveillance region, and o communicae wih is neighboring sensors. A wo-sensor example is shown in Figure 1 in which he circles represen he surveillance regions of he sensors. We assume ha each sensor has he capabiliy o compue he posiion esimaes and manage he ideniy of arges wihin is surveillance region. For disribued ideniy managemen, we have o consider he possibiliy ha he number of arges wihin he surveillance region of a sensor could change over ime. For example, a arge migh leave or ener he surveillance region of a sensor. Anoher imporan problem ha has o be addressed is scalable and disribued informaion fusion o ge he global esimae of he sysem from informaion compued by individual local sensors. These problems are unique for disribued sensor nework applicaions. Therefore, we propose a scalable Disribued Muliple-Targe Ideniy Managemen (DMIM) algorihm ha can manage muliple-arge ideniies efficienly in a disribued sensor nework environmen. The srucure of DMIM is shown in Figure 2: le us sar wih he ideniy managemen algorihm. ac1 sensor 1 ac2 sensor 2 Fig. 1. A disribued muliple-arge ideniy managemen scenario for a wo-sensor nework. Informaion Fusion Ideniy Managemen ac3 ac4 even-driven, query-based communicaion communicaion communicaion belief vecor sensor 1 Daa Associaion belief vecor Ideniy Managemen sensor 2 Local Informaion Incorporaion Belief Marix Updae Ideniy managemen Informaion Fusion Fig. 2. The srucure of he Disribued Muliple-Targe Ideniy Managemen (DMIM) algorihm for a wo-sensor example. A. Daa Associaion Suppose here are T arges and T ideniies, for example, T aircraf wih ideniies {piper, cherokee, cessna, }, in he surveillance region of sensor i. Then, he problem of managing ideniies of muliple arges is o mach each arge o is ideniy over ime. For his, we use he idea of he Ideniy-Mass-Flow in [5]. The idea of he Ideniy- Mass-Flow is ha an ideniy is reaed as a uni mass assigned o a arge. These masses canno be desroyed or creaed, and flow from a arge ino anoher hrough he mixing marix, M(k) a ime k. The mixing marix is an T T marix whose elemen M ij (k) represens he probabiliy ha arge i a ime k 1 has become arge j a ime k. Thus, he mixing marix is a doubly sochasic marix; ha is, is column sums and row sums are equal o 1. The oupu of he Daa Associaion block is he mixing marix. B. Belief Marix Updae We use a belief vecor o represen he ideniy of a arge probabilisically. For muliple arges, we have a belief marix B(k) whose columns are belief vecors of he arges. Thus, enry B ij (k) represens he probabiliy ha arge j can be idenified as label (or name) i a ime k. The Belief Marix Updae block mainains ideniy informaion sored in a T T belief marix B(k) over ime. The evoluion of his belief marix is governed by he equaion [5]: B(k) = B(k 1)M(k) (1) We can show ha (1) keeps row and column sums of he belief marix consan when he numbers of arges and ideniies are he same. However, his is no he case for disribued ideniy managemen since he number of he arges wihin he surveillance region of individual sensors may change over ime. There are wo possible cases: a arge leaves or eners he surveillance region of a sensor. When a arge leaves, we delee he corresponding column in he belief marix managed by he sensor. When a arge eners he surveillance region of a sensor, here are wo possible cases: (i) he arge comes from he surveillance region of anoher sensor, which may be queried, or (ii) he arge comes from he ouside of he surveillance region of a sensor nework. For hese cases, we propose a scalable, even-driven, query-based belief marix updae algorihm: Algorihm 1: Even-driven, query-based Belief Marix Updae For sensor i and arge if arge leaves he surveillance region of sensor i. hen delee he corresponding column in he belief marix. if a arge eners he surveillance region of sensor i. hen send a query abou he ideniy of arge. if here is an answer yes and receive he belief vecor of arge, hen augmen he belief marix wih he belief vecor received. else augmen he belief marix wih a belief vecor wih a new ideniy assigned o he arge.

3 For disribued ideniy managemen, a belief marix managed by each sensor may no be a square marix bu migh more likely be a skinny marix which has more rows han columns. The belief marix may no be a doubly sochasic marix, bu i should be a sochasic marix wih column sums equal o one. Is row sums remain consan because an ideniy mass canno be desroyed or creaed. I also has he propery ha he sum of column sums is equal o he sum of row sums; ha is, even hough he number of arges in he surveillance region of each sensor changes, he ideniy mass is conserved in he surveillance region. Since he evoluion of he belief marix is governed by (1), hese characerisics of he belief marix are preserved over ime. C. Local Informaion Incorporaion In his secion, we consider he case in which local informaion abou he ideniy of a arge is available o a local sensor. The local informaion has he form of a belief vecor and when available, we use he local informaion o decrease he uncerainy of he belief marix measured by enropy. The enropy of a L T belief marix is defined as H(B(k)) L T i=1 j=1 B ij(k) log B ij (k). Then, he problem is how o incorporae his informaion o he belief marix. From he idea of he Ideniy-Mass- Flow and he characerisics of (1), we know ha he belief marix should have he following properies: is column sums are equal o one, is row sums remain consan, and he sum of row sums and he sum of column sums are equal. However, if we replace he column in he belief marix wih he local informaion, i is no guaraneed ha he new belief marix has he above properies. Thus, we have developed a polynomial-ime algorihm ha can check wheher he available local informaion can be incorporaed (i.e., he new belief marix is scalable or almos scalable) and if so, can make he new belief marix have he above properies. We refer he reader o our companion paper [1] for he deails. The local informaion incorporaed may no necessarily decrease he uncerainy (enropy) of he belief marix. Therefore, local informaion is incorporaed only when i reduces he uncerainy of he belief marix. The local informaion incorporaion algorihm can be described as follows: Algorihm 2: Local Informaion Incorporaion Given: local informaion (belief vecor) of a arge and a belief marix B(k). Make a marix B (k) by replacing he column corresponding o he arge in B(k) wih he local informaion. if B (k) is almos scalable hen B new (k) := S(B (k)) if H(B new (k)) H(B(k)) hen B(k) := B new (k) else B(k) := B(k) else B(k) := B(k) where is he operaor S represens he marix scaling process in [1]. D. Belief Informaion Fusion In his secion, we consider he problem of combining wo belief vecors of he same arge from wo differen sensors. Informaion fusion can be formulaed as an opimizaion problem such ha he fused informaion is he one ha minimizes a cos funcion which represens a performance crierion. For opimizaion, we propose hree differen cos funcions: Shannon informaion, Chernoff informaion, and he sum of Kullback-Leibler disances. Shannon informaion: The Shannon informaion is defined as n H(b ) = b (i) log b (i) (2) i=1 where b [0, 1] n wih i b (i) = 1. The Shannon informaion (also known as enropy) is a measure of he uncerainy of a sysem. Thus, he minimizaion of he Shannon informaion selecs a belief vecor ha is mos informaive in he sense of minimum enropy. Suppose b 1 and b 2 are belief vecors of arge compued by sensor 1 and sensor 2 respecively. Since he mos common daa fusion algorihms compue a linear combinaion of wo daa, we propose he following fusion sraegy: b = ωb 1 + (1 ω)b 2 (3) where ω [0, 1], b i [0, 1] n wih n j=1 b i(j) = 1 for i {1, 2}, and n j=1 b (j) = 1. Then, he problem of compuing he fused belief vecor becomes a problem o find a weigh, ω, which minimizes he cos funcion in (2). If we use he fusion sraegy in (3), he Shannon informaion of he new fused informaion is H(b ) = H(ωb 1 +(1 ω)b 2 ) ωh(b 1 )+(1 ω)h(b 2 ) (4) From (4), we can see ha he minimum is always achieved a eiher ω = 0 or ω = 1. This means ha a fused belief vecor ha has he minimum Shannon informaion is eiher of he wo given belief vecors, which is a hard choice. For some applicaions such as ideniy managemen in his paper, he hard choice may no be desirable since i ignores one possibiliy compleely and hus migh quickly lead o a wrong answer over ime if no immediaely. Thus, we propose a sof choice mehod which has ω (0, 1) for almos all cases. Moivaed by he fac ha Shannon informaion minimizaion chooses a belief vecor which has he minimum enropy, we propose o use he inverse of he Shannon informaion of a belief vecor as a weigh. Thus, we pu large confidence on a belief vecor which has small Shannon informaion. Then, a new belief vecor b = [b (i)] is b H(b 1 ) 1 b 1 (i) (i) = H(b 1 ) 1 + H(b 2 ) 1 + H(b 2 ) 1 b 2 (i) H(b 1 ) 1 (5) + H(b 2 ) 1

4 From (3) and (5), we ge ω = H(b 1 ) 1 H(b 1 ) 1 + H(b 2 ) 1 = H(b 2 ) H(b 1 ) + H(b 2 ) When H(b 1 ) = H(b 2 ) = 0, we se ω = 1 2. ω = 0 if H(b 2 ) = 0 (no uncerainy in b 2 ) and ω = 1 when H(b 1 ) = 0 (no uncerainy in b 1 ). In hese cases, he fused belief vecor compued by he proposed fusion algorihm is a belief vecor which has no uncerainy. This fusion algorihm is a sof choice mehod since he fused daa is a convex combinaion of he wo given daa wih a larger weigh on he daa which has smaller enropy han he oher. From (4) and (6), he Shannon informaion of he new belief H(b ) has he propery ha: H(b ) 2H(b 1)H(b 1 ) H(b 1 ) + H(b 2 ) or 2H(b ) 1 H(b 1 ) 1 +H(b 2 ) 1 (7) Inequaliy (7) ells us ha he achievable minimum uncerainy of he fused belief vecor wih he fusion sraegy in (3) wih (6) as a weigh is under-bounded by uncerainies of he given informaion. In oher words, he maximum achievable cerainy (inverse of he Shannon informaion) is upper-bounded by he arihmeic mean of he inverse of he Shannon informaion of he given belief vecors. If we use he fusion sraegy in (3), we can also derive he upper bound of he Shannon informaion of he new belief vecor: H(b ) ω 2 H(b 1) + (1 ω) 2 H(b 2) + ω(1 ω)(h(b 1) +H(b 2) + D(b 1 b 2) + D(b 2 b 1)) (8) where D(p q) p(i) i p(i) log( q(i) ) is he Kullback-Leibler disance [8]. If we use ω in (6), hen The new belief vecor in (11) saisfies ([8], [9]) (6) D(b b 1 ) = D(b b 2 ) (12) This fusion sraegy is differen from ha in (3) which is a convex combinaion of he wo daa. From (12), he minimizaion of he Chernoff informaion is equivalen o finding a funcion ha is in he middle of he wo original funcions, where he middle is defined in erms of he Kullback-Leibler disance. In oher words, Chernoff informaion minimizaion could be inerpreed as selecing a probabiliy vecor which is equally close in erms of he Kullback-Leibler disance o he original probabiliy vecors. This fusion algorihm does no pu more confidence on one han he oher. Thus, his cos funcion could be useful when we do no know he qualiy of informaion obained from individual sensors; by choosing he middle poin of he wo pieces of informaion, we could minimize he bias over ime. However, he fused belief vecor compued by he Chernoff informaion minimizaion algorihm may have larger enropy han ha compued by he algorihm in (3) wih (6). Sum of he Kullback-Leibler disances: Since he Kullback-Leibler disance is no symmeric, we consider wo possible opimizaion problems: minimize D(b b 1 ) + D(b b 2 ) n subjec o j=1 b (j) = 1 b (j) 0 minimize D(b 1 b ) + D(b 2 b ) n subjec o j=1 b (j) = 1 b (j) 0 (13) (14) where b (j) is he jh elemen of a vecor b. Le us firs consider he opimizaion problem in (13). The Lagrangian is given by H(b ) 2H(b1)H(b1) H(b1)H(b2)[D(b1 b2) + D(b2 b1)] n + H(b 1 ) + H(b 2 ) (H(b 1 ) + H(b 2 )) 2 L(b, λ) = D(b b 1 )+D(b b 2 )+λ( b (j) 1) (15) (9) j=1 Thus, we can analyically compue he upper and lower To ge an opimal soluion, we se he derivaives of L wih bounds of he Shannon informaion of he new belief vecor respec o b (i) and o λ o be equal o zero. Then, we ge using he fusion sraegy in (3) wih (6). Thus, he Shannon a new belief vecor: informaion cos funcion would be useful when we have good knowledge abou he performance and/or fideliy of b b1 (i)b 2 (i) (i) = n (16) each sensor, since we can ge a soluion which has lower j=1 b1 (j)b 2 (j) enropy by weighing informaion ha has smaller enropy From (16), we see ha he fused daa is a geomeric mean more han he oher. However, if we do no have such knowledge, we may ge a biased soluion by consisenly puing for Chernoff informaion minimizaion when ω = 1 2 of he given daa. The fused daa is he same as ha in (11) more confidence on one piece of informaion (possibly he. Thus, his daa fusion sraegy can be inerpreed as a special case wrong one) han he oher. of he Chernoff informaion minimizaion mehod. Chernoff informaion: The Chernoff informaion is defined as n Now, le us consider he opimizaion problem in (14). C(b 1, b 2 ) = min log( The Lagrangian is given by b 1 (i) ω b 2 (i) 1 ω ) (10) n 0 ω 1 i=1 L(b, λ) = D(b 1 b )+D(b 2 b )+λ( b (j) 1) (17) If ω minimizes (10), he new belief vecor b (= [b j=1 (i)] for i = {1, 2,, n}) is Similarly, we ge an opimal soluion: b b 1 (i) ω b 2 (i) 1 ω (i) = n j=1 b (11) 1(j) ω b 2 (j) b b 1 (i) + b 2 (i) (i) = 1 ω n j=1 [b 1(j) + b 2 (j)] = b 1(i) + b 2 (i) (18) 2 In his case, he fused daa is he arihmeic mean of he given daa. This fusion sraegy is he same as ha in (3)

5 when ω = 1 2. Thus, from (4) and (8), we ge he lower and upper bounds of Shannon informaion of he new belief vecor: H(b ) H(b1)+H(b2) 2 H(b ) H(b 1)+H(b 2 ) 2 + D(b 1 b 2 )+D(b 2 b 1 ) (19) 4 Therefore, he fusion algorihms obained by solving he opimizaion problems in (13) or (14) are o average he given daa eiher geomerically or arihmeically. This is similar o Chernoff informaion minimizaion and hus hese fusion sraegies would be useful when we wan o ge unbiased fused daa in siuaions where we do no have good a prior informaion abou a sysem. An example would be a case in which informaion from one sensor is wrong due o failure of he sensor or he malicious inen of he sensor ha is unknown a priori. These informaion fusion sraegies would be robus o his wrong informaion since hey do no pu more confidence on one (possibly incorrec informaion) han he oher, bu average hem o compue a fused belief vecor. Bayesian approach: In his secion, we derive a fused belief vecor using a Bayesian approach. Suppose he arge s ideniy θ {1, 2,, N} and wihou loss of generaliy, suppose here are wo sensors. Denoe evens X 1 and X 2 o be observaions a sensor 1 and sensor 2 respecively. We are assumed o be given informaion b 1 (θ) P (θ X 1 ) from sensor 1 and b 2 (θ) P (θ X 1 ) from sensor 2 where P ( ) is a condiional probabiliy. Then, he problem of informaion fusion is o find he a poseriori probabiliy P (θ X 1, X 2 ). We assume P (X 1, X 2 θ) = P (X 1 θ)p (X 2 θ) since given he ideniy of a arge, he evens ha i is observed by sensor 1 or sensor 2 are independen in disribued ideniy managemen. Using he Bayes rule, we ge Since P (θ X i ) = P (θ X 1, X 2 ) = P (X 1 θ)p (X 2 θ)p (θ) P (X 1, X 2 ) P (Xi θ)p (θ) P (X i ) for i {1, 2}, we obain P (θ X 1, X 2 ) = b 1(θ)b 2 (θ) P (X 1 )P (X 2 ) P (θ) P (X 1, X 2 ) Therefore, a fused belief vecor is b (ˆθ) = arg max P (θ X 1, X 2 ) = b 1(θ)b 2 (θ) 1 θ P (θ) c (20) (21) (22) where c is a normalizaion consan. This is an ineresing resul because he fused daa does depend only on he given daa (b 1 (θ), b 2 (θ)) and he a priori probabiliy P (θ). Thus, if we knew a priori informaion, we could compue he a poseriori probabiliy (i.e., he fused daa). However, since we may no know he a priori probabiliy for some applicaions such as disribued ideniy managemen in his paper, we canno compue he fused daa from (22). In order o compue he fused daa for his case, we have o assume P (θ) eiher from he characerisics of he sysems or from ha of applicaions. For example, due o he lack of informaion abou he sysem, we assume ha he a priori probabiliy is a geomeric mean of he given daa (P (θ) = b1 (θ)b 2 (θ)). Then, we can ge exacly he same resul as ha in (16) which minimizes he sum of Kullback-Leibler disances o he original daa in (13). Thus, he a poseriori probabiliy is he same as he a priori probabiliy; ha is, we canno exrac any informaion from he given daa. From Bayesian analysis, we can see ha he daa fusion sraegies such as Chernoff informaion minimizaion and he minimizaion of he sum of Kullback-Leibler disances in (13) compue he soluion in a similar form o he soluion produced by he Bayesian approach. III. SIMULATIONS Several simulaions are presened in his secion o highligh he performance and capabiliies of he DMIM algorihm. Specifically, he scenarios consis of saionary sensors (e.g., air raffic conrol radars) racking muliple aircraf hrough wo-dimensional space. Individual sensors are assumed o have he capabiliy o compue he posiion esimaes of aircraf. Measuremens are available o sensors when inside a sensing radius, se o 10 km, while wo sensors can communicae if inside he communicaion radius, se o 20 km. P 1 (A) Fig. 3. y posiion [km] x 10 4 L x posiion [km] x 10 4 Aircraf rajecories for wo-aircraf, wo-sensor scenario (a) K L disance (bis) R Fig. 4. A cooperaive wo-sensor scenario. (a) Belief of aircraf 1 having ideniy A. (b) Efficiency of belief esimaes as measured in bis. (Solid lines are local esimaes and dashed lines are global esimaes. Symbols x and + are used for sensor L and R respecively. Symbols,, and are used for he ideniy fusion algorihms using he sum of Kullback-Leibler disances beween he local esimaes and he global esimae (corresponding o an arihmeic mean), he sum of Kullback-Leibler disances beween he global esimae and he local esimaes (corresponding o a geomeric mean), and Shannon informaion, respecively.) The firs wo simulaions involve a sysem of wo sensors, denoed sensor L for lef and R for righ, observing wo (b)

6 aircraf, denoed 1 and 2. Aircraf 1 sars in sensor L s surveillance region, while aircraf 2 sars in R s surveillance region, as shown in Figure 3. This figure shows he rue posiions of he aircraf (solid lines and x s) and he global posiion esimaes made by he sensors (dashed lines and o s). Boh aircraf ravel souheas wih velociy 200 m/s. The rue ideniy of aircraf 1 and 2 are A and B respecively, bu simulaion is iniialized wih belief vecors [0.8 ] T for aircraf 1 and [ 0.8] T for aircraf 2 respecively. [0.8 ] T means ha aircraf 1 is hough o have ideniy A wih 80% probabiliy and B wih 20% probabiliy. Three imes correspond o imporan evens in he simulaion. A ime 7, aircraf 1 eners R s surveillance region, allowing global belief esimaes based on fusion echniques discussed in he previous secion and sensor R receives he ideniy informaion abou aircraf 1 from sensor L using Algorihm 1. A ime 11, local informaion is obained by sensor R. Aircraf 2 is now hough o have belief [ ] T. Since his local informaion makes a new belief marix scalable and decreases enropy (uncerainy) of he belief marix, we replace he belief vecor of aircraf 2 in he belief marix wih his local informaion. Since row sums of he belief marix should remain consan, he belief vecor for aircraf 1 in he new belief marix becomes [ ] T. This local informaion incorporaion is performed using Algorihm 2. Finally, a ime 18, aircraf 1 leaves sensor L s surveillance region. Because he wo aircraf mus share ideniy A and B, an esimae of he probabiliy of aircraf 1 having ideniy A deermines fully he belief marix for he sysem. Thus, only P 1 (A) (probabiliy ha aircraf 1 has ideniy A) is ploed in Figure 4-(a), which presens belief informaion according o differen esimaors. Solid lines indicae P 1 (A) for each observer, while he various dashed lines indicae P 1 (A) for hree global esimae mehods discussed in he previous secion. The hree mehods are using Shannon informaion, minimizing he sum of Kullback-Leibler disances beween he local esimaes and he global esimae (corresponding o an arihmeic mean of he local beliefs), and minimizing he sum of Kullback-Leibler disances beween he global esimae and he local esimaes (corresponding o a geomeric mean of he local beliefs). The Bayesian approach and he Chernoff approach have a similar form o he geomeric mean and are hus no ploed. Figure 4-(b) presens he efficiency of each mehod of esimaing he belief of aircraf 1. This figure only covers imes 7 o 17, since hese are he imes when he informaion fusion algorihms are used. We use he Kullback-Leibler disance beween he correc belief vecor and he esimaed belief vecor (i.e., D(b rue b es )) as a performance measure since his Kullback-Leibler disance measures he inefficiency of esimaors [8], [10], [11]. As shown in he figure, he inefficiency in sensor L s belief of aircraf 1 is consan, since i always has belief P 1 (A) = 0.8. Sensor R s inefficiency drops a ime 11 when local informaion is incorporaed. The various global esimaes lie beween he wo local belief esimaes. For his scenario, global belief esimaes are bes obained hrough Shannon informaion mixing in (3) wih (6) as expeced. P 1 (A) (a) K L disance (bis) Fig. 5. A malicious wo-sensor scenario. (a) Belief of aircraf 1 having ideniy A. (b) Efficiency of belief esimaes as measured in bis. (Solid lines are local esimaes and dashed lines are global esimaes. Symbols x and + are used for sensor L and R respecively. Symbols,, and are as in Figure 4.) The second scenario presens he same aircraf and rajecory, bu sensor R, hrough error or malice, reverses he local informaion received a ime 11. Tha is, i believes P 1 (A) = 0.1, raher han P 1 (A) = 0.9. The rajecory plo is exacly he same as in Figure 3, bu belief esimaes P 1 (A) are now hose shown in Figure 5-(a). The inefficiency of he belief esimae is shown in Figure 5-(b). As in he previous scenario, sensor L s belief of aircraf 1 and hus is inefficiency in ha belief remain consan. However, sensor R receives incorrec local informaion, hereby increasing is inefficiency o 3.32 bis, above he scale of Figure 5-(b). The global belief esimaes again fall somewhere in beween. However, because sensor R conribues incorrec informaion, he global belief esimae wih he leas inefficiency is now he arihmeic average of he local esimaes in (18), while he mehod based on he Shannon informaion resuls in he highes inefficiency. Tha is, he arihmeic average mehod is mos robus o incorrec informaion. To analyze he performance of he various Cooperaive efficiency (b) Malevolen efficiency Fig. 6. Cooperaive efficiency versus malicious efficiency for each global belief esimae, for he wo scenarios presened above. Symbols,, and are as in Figure 4.) belief fusion mehods, we presen Figure 6 ha plos he ordered pairs (D coop,d mal ) for each mehod of global belief fusion. The quaniies D coop and D mal refer respecively o he efficiency of he global esimaes for he cooperaive

7 and malicious scenarios and are aken from Figures 4-(b) and 5-(b). A poin closer o he origin in boh axes is more efficien overall han anoher poin. From Figure 6, one can argue ha using Shannon informaion is more efficien for scenarios in which all sensors are known o be cooperaive, while arihmeic combinaion is more efficien for scenarios in which here is a high probabiliy of malicious sensors. However, his conclusion depends on he configuraion of sensor neworks: he number of malicious sensors and heir locaions. y Prob(Targe 1=Aircraf A) A B = x Arih. mean Geom. mean Shannon info Fig. 7. A general sensor nework scenario. (Top) Aircraf rajecories for wo-aircraf, 41-sensor scenario. (Boom) Global belief esimaes of aircraf 1 having ideniy A. Figure 7 shows a complex scenario involving many sensors. I is assumed ha sensors ha can see he arges are all iniialized o he same belief vecors. Targe 1 is iniialized o [0.8 ] T and arge 2 o [ 0.8] T. Figure 7-(Top) shows he rack of each arge and he coverage areas of he 41 sensors. Sensors wih solid lines are malicious, meaning heir local esimaes are [β α] T when [α β] T is sensed. Sensors wih hick solid lines gaher local informaion; his informaion is always ha arge 1 is aircraf A wih probabiliy 0.9. Targe 2 exiss o creae confusion a he sar of he scenario; however, ideniy informaion is no presened for his arge. For arge 1, local esimaes are made a each ime sep by hose sensors ha can observe he arge. The global esimaes are made a each ime sep by combining he local ideniy esimaes. In Figure 7-(Boom), he global esimaes, using each of he hree mehods described in he previous secion, are ploed over ime. Iniially, all sensors have local belief [0.8 ] T, yielding he same global esimae. A imes 6, 26, and 31, sensors wih local informaion sar observing arge 1, leading o improved global esimaes; hese evens are noed by dashed lines in Figure 7-(Boom). A imes 16 and 24, malicious sensors begin observing arge 1, leading o degraded global esimaion, as noed by doed lines in he figure. This scenario exhibis he scalabiliy of he DMIM algorihm applied o a large se of sensors racking he ideniy of a maneuvering arge. IV. CONCLUSIONS We have developed a scalable Disribued Muliple-Targe Ideniy Managemen (DMIM) algorihm which can manage ideniies of muliple maneuvering arges in sensor neworks and efficienly incorporae local informaion abou he ideniy of a arge, when available, o reduce he uncerainy of he sysem. For ideniy fusion o obain global informaion using local sensor informaion, we have formulaed an opimizaion problem and have presened hree differen cos funcions: Shannon informaion, Chernoff informaion, and he sum of Kullback-Leibler disances, which represen differen performance crieria ha could be useful for differen applicaions. Using Bayesian analysis, we have also derived an informaion fusion algorihm ha needs a priori probabiliy of he given daa. Finally, we have applied he DMIM algorihm o he problem of managing ideniies of muliple aircraf in sensor neworks and demonsraed he performance of he proposed fusion algorihms. REFERENCES [1] H. Balakrishnan, I. Hwang, and C. Tomlin. Polynomial approximaion algorihms for belief marix mainenance in ideniy managemen. In Proceedings of he 43nd IEEE Conference on Decision and Conrol, Alanis, Paradise Island, Bahamas, December [2] I.F. Akyidliz, W. Su, Y. Sankarasubramaniam, and E. Cayirci. A survey on sensor neworks. IEEE Communicaions Magazine, 40(8): , Augus [3] Ning Xu. A survey of sensor nework applicaions. hp://enl.usc.edu/ ningxu/papers, [4] R. Sinkhorn. Diagonal equivalence o marices wih prescribed row and column sums. American Mahemaical Monhly, 74: , [5] J. Shin, L.J. Guibas, and F. Zhao. A disribued algorihm for managing muli-arge ideniies in wireless ad-hoc sensor neworks. In F. Zhao and L. Guibas, ediors, Informaion Processing in Sensor Neworks, Lecure Noes in Compuer Science 2654, pages , Palo Alo, CA, April [6] I. Hwang, H. Balakrishnan, K. Roy, J. Shin, L. Guibas, and C. Tomlin. Muliple-arge Tracking and Ideniy Managemen algorihm for Air Traffic Conrol. In Proceedings of he Second IEEE Inernaional Conference on Sensors, Torono, Canada, Ocober [7] I. Hwang, H. Balakrishnan, K. Roy, and C. Tomlin. Muliple-arge Tracking and Ideniy Managemen algorihm in cluer, wih applicaion o aircraf racking. In Proceedings of he AACC American Conrol Conference, Boson, MA, June [8] T.M. Cover and J.A. Thomas. Elemens of Informaion Theory. Wiley-Inerscience, New York, [9] J.N. Kapur and H.K. Kesavan. Enropy Opimizaion Principles wih Applicaion. Academic Press, Inc., [10] D. Fox. Adaping he sample size in paricle filers hrough KLDsampling. Inernaional Journal of Roboics Research, 22, Ocober [11] J. Kasuri, R. Acharya, and M. Ramanahan. An informaion heoreic approach for analyzing emporal paern of gene expression. Bioinformaics, 19(4): , 2003.

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Probabilistic Robotics

Probabilistic Robotics Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Introduction to Mobile Robotics

Introduction to Mobile Robotics Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

Math Week 14 April 16-20: sections first order systems of linear differential equations; 7.4 mass-spring systems.

Math Week 14 April 16-20: sections first order systems of linear differential equations; 7.4 mass-spring systems. Mah 2250-004 Week 4 April 6-20 secions 7.-7.3 firs order sysems of linear differenial equaions; 7.4 mass-spring sysems. Mon Apr 6 7.-7.2 Sysems of differenial equaions (7.), and he vecor Calculus we need

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006 2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)

More information

Predator - Prey Model Trajectories and the nonlinear conservation law

Predator - Prey Model Trajectories and the nonlinear conservation law Predaor - Prey Model Trajecories and he nonlinear conservaion law James K. Peerson Deparmen of Biological Sciences and Deparmen of Mahemaical Sciences Clemson Universiy Ocober 28, 213 Ouline Drawing Trajecories

More information

Math 315: Linear Algebra Solutions to Assignment 6

Math 315: Linear Algebra Solutions to Assignment 6 Mah 35: Linear Algebra s o Assignmen 6 # Which of he following ses of vecors are bases for R 2? {2,, 3, }, {4,, 7, 8}, {,,, 3}, {3, 9, 4, 2}. Explain your answer. To generae he whole R 2, wo linearly independen

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Tracking. Announcements

Tracking. Announcements Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol Applied Mahemaical Sciences, Vol. 7, 013, no. 16, 663-673 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/10.1988/ams.013.39499 Pade and Laguerre Approximaions Applied o he Acive Queue Managemen Model of Inerne

More information

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques Resource Allocaion in Visible Ligh Communicaion Neworks NOMA vs. OFDMA Transmission Techniques Eirini Eleni Tsiropoulou, Iakovos Gialagkolidis, Panagiois Vamvakas, and Symeon Papavassiliou Insiue of Communicaions

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Demodulation of Digitally Modulated Signals

Demodulation of Digitally Modulated Signals Addiional maerial for TSKS1 Digial Communicaion and TSKS2 Telecommunicaion Demodulaion of Digially Modulaed Signals Mikael Olofsson Insiuionen för sysemeknik Linköpings universie, 581 83 Linköping November

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Article from. Predictive Analytics and Futurism. July 2016 Issue 13 Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

2016 Possible Examination Questions. Robotics CSCE 574

2016 Possible Examination Questions. Robotics CSCE 574 206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19 Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible

More information

Online Convex Optimization Example And Follow-The-Leader

Online Convex Optimization Example And Follow-The-Leader CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

Mean-square Stability Control for Networked Systems with Stochastic Time Delay

Mean-square Stability Control for Networked Systems with Stochastic Time Delay JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455

More information

Lecture 2 October ε-approximation of 2-player zero-sum games

Lecture 2 October ε-approximation of 2-player zero-sum games Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS Xinping Guan ;1 Fenglei Li Cailian Chen Insiue of Elecrical Engineering, Yanshan Universiy, Qinhuangdao, 066004, China. Deparmen

More information

) were both constant and we brought them from under the integral.

) were both constant and we brought them from under the integral. YIELD-PER-RECRUIT (coninued The yield-per-recrui model applies o a cohor, bu we saw in he Age Disribuions lecure ha he properies of a cohor do no apply in general o a collecion of cohors, which is wha

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Particle Swarm Optimization

Particle Swarm Optimization Paricle Swarm Opimizaion Speaker: Jeng-Shyang Pan Deparmen of Elecronic Engineering, Kaohsiung Universiy of Applied Science, Taiwan Email: jspan@cc.kuas.edu.w 7/26/2004 ppso 1 Wha is he Paricle Swarm Opimizaion

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

CHAPTER 12 DIRECT CURRENT CIRCUITS

CHAPTER 12 DIRECT CURRENT CIRCUITS CHAPTER 12 DIRECT CURRENT CIUITS DIRECT CURRENT CIUITS 257 12.1 RESISTORS IN SERIES AND IN PARALLEL When wo resisors are conneced ogeher as shown in Figure 12.1 we said ha hey are conneced in series. As

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

Lecture 4 Kinetics of a particle Part 3: Impulse and Momentum

Lecture 4 Kinetics of a particle Part 3: Impulse and Momentum MEE Engineering Mechanics II Lecure 4 Lecure 4 Kineics of a paricle Par 3: Impulse and Momenum Linear impulse and momenum Saring from he equaion of moion for a paricle of mass m which is subjeced o an

More information

Sequential Importance Resampling (SIR) Particle Filter

Sequential Importance Resampling (SIR) Particle Filter Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle

More information

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid

More information

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 17

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 17 EES 16A Designing Informaion Devices and Sysems I Spring 019 Lecure Noes Noe 17 17.1 apaciive ouchscreen In he las noe, we saw ha a capacior consiss of wo pieces on conducive maerial separaed by a nonconducive

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

EKF SLAM vs. FastSLAM A Comparison

EKF SLAM vs. FastSLAM A Comparison vs. A Comparison Michael Calonder, Compuer Vision Lab Swiss Federal Insiue of Technology, Lausanne EPFL) michael.calonder@epfl.ch The wo algorihms are described wih a planar robo applicaion in mind. Generalizaion

More information

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,

More information

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing

More information

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004 ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform

More information

Physics 101 Fall 2006: Exam #1- PROBLEM #1

Physics 101 Fall 2006: Exam #1- PROBLEM #1 Physics 101 Fall 2006: Exam #1- PROBLEM #1 1. Problem 1. (+20 ps) (a) (+10 ps) i. +5 ps graph for x of he rain vs. ime. The graph needs o be parabolic and concave upward. ii. +3 ps graph for x of he person

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

The Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite

The Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite American Journal of Operaions Research, 08, 8, 8-9 hp://wwwscirporg/journal/ajor ISSN Online: 60-8849 ISSN Prin: 60-8830 The Opimal Sopping Time for Selling an Asse When I Is Uncerain Wheher he Price Process

More information

Announcements: Warm-up Exercise:

Announcements: Warm-up Exercise: Fri Apr 13 7.1 Sysems of differenial equaions - o model muli-componen sysems via comparmenal analysis hp//en.wikipedia.org/wiki/muli-comparmen_model Announcemens Warm-up Exercise Here's a relaively simple

More information

Matlab and Python programming: how to get started

Matlab and Python programming: how to get started Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,

More information

Analyze patterns and relationships. 3. Generate two numerical patterns using AC

Analyze patterns and relationships. 3. Generate two numerical patterns using AC envision ah 2.0 5h Grade ah Curriculum Quarer 1 Quarer 2 Quarer 3 Quarer 4 andards: =ajor =upporing =Addiional Firs 30 Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 andards: Operaions and Algebraic Thinking

More information

!!"#"$%&#'()!"#&'(*%)+,&',-)./0)1-*23)

!!#$%&#'()!#&'(*%)+,&',-)./0)1-*23) "#"$%&#'()"#&'(*%)+,&',-)./)1-*) #$%&'()*+,&',-.%,/)*+,-&1*#$)()5*6$+$%*,7&*-'-&1*(,-&*6&,7.$%$+*&%'(*8$&',-,%'-&1*(,-&*6&,79*(&,%: ;..,*&1$&$.$%&'()*1$$.,'&',-9*(&,%)?%*,('&5

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION MATH 28A, SUMME 2009, FINAL EXAM SOLUTION BENJAMIN JOHNSON () (8 poins) [Lagrange Inerpolaion] (a) (4 poins) Le f be a funcion defined a some real numbers x 0,..., x n. Give a defining equaion for he Lagrange

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

KINEMATICS IN ONE DIMENSION

KINEMATICS IN ONE DIMENSION KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

Overview. COMP14112: Artificial Intelligence Fundamentals. Lecture 0 Very Brief Overview. Structure of this course

Overview. COMP14112: Artificial Intelligence Fundamentals. Lecture 0 Very Brief Overview. Structure of this course OMP: Arificial Inelligence Fundamenals Lecure 0 Very Brief Overview Lecurer: Email: Xiao-Jun Zeng x.zeng@mancheser.ac.uk Overview This course will focus mainly on probabilisic mehods in AI We shall presen

More information

SPH3U: Projectiles. Recorder: Manager: Speaker:

SPH3U: Projectiles. Recorder: Manager: Speaker: SPH3U: Projeciles Now i s ime o use our new skills o analyze he moion of a golf ball ha was ossed hrough he air. Le s find ou wha is special abou he moion of a projecile. Recorder: Manager: Speaker: 0

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS *

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS * haper 5 HERNOFF DISTANE AND AFFINITY FOR TRUNATED DISTRIBUTIONS * 5. Inroducion In he case of disribuions ha saisfy he regulariy condiions, he ramer- Rao inequaliy holds and he maximum likelihood esimaor

More information

Phys 221 Fall Chapter 2. Motion in One Dimension. 2014, 2005 A. Dzyubenko Brooks/Cole

Phys 221 Fall Chapter 2. Motion in One Dimension. 2014, 2005 A. Dzyubenko Brooks/Cole Phys 221 Fall 2014 Chaper 2 Moion in One Dimension 2014, 2005 A. Dzyubenko 2004 Brooks/Cole 1 Kinemaics Kinemaics, a par of classical mechanics: Describes moion in erms of space and ime Ignores he agen

More information

Solutions from Chapter 9.1 and 9.2

Solutions from Chapter 9.1 and 9.2 Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is

More information

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004 Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

In this chapter the model of free motion under gravity is extended to objects projected at an angle. When you have completed it, you should

In this chapter the model of free motion under gravity is extended to objects projected at an angle. When you have completed it, you should Cambridge Universiy Press 978--36-60033-7 Cambridge Inernaional AS and A Level Mahemaics: Mechanics Coursebook Excerp More Informaion Chaper The moion of projeciles In his chaper he model of free moion

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1. Roboics I April 11, 017 Exercise 1 he kinemaics of a 3R spaial robo is specified by he Denavi-Harenberg parameers in ab 1 i α i d i a i θ i 1 π/ L 1 0 1 0 0 L 3 0 0 L 3 3 able 1: able of DH parameers of

More information

The Arcsine Distribution

The Arcsine Distribution The Arcsine Disribuion Chris H. Rycrof Ocober 6, 006 A common heme of he class has been ha he saisics of single walker are ofen very differen from hose of an ensemble of walkers. On he firs homework, we

More information

Probabilistic Models for Reliability Analysis of a System with Three Consecutive Stages of Deterioration

Probabilistic Models for Reliability Analysis of a System with Three Consecutive Stages of Deterioration Yusuf I., Gaawa R.I. Volume, December 206 Probabilisic Models for Reliabiliy Analysis of a Sysem wih Three Consecuive Sages of Deerioraion Ibrahim Yusuf Deparmen of Mahemaical Sciences, Bayero Universiy,

More information

Distributed Fictitious Play for Optimal Behavior of Multi-Agent Systems with Incomplete Information

Distributed Fictitious Play for Optimal Behavior of Multi-Agent Systems with Incomplete Information Disribued Ficiious Play for Opimal Behavior of Muli-Agen Sysems wih Incomplee Informaion Ceyhun Eksin and Alejandro Ribeiro arxiv:602.02066v [cs.g] 5 Feb 206 Absrac A muli-agen sysem operaes in an uncerain

More information

Let us start with a two dimensional case. We consider a vector ( x,

Let us start with a two dimensional case. We consider a vector ( x, Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our

More information

Traveling Waves. Chapter Introduction

Traveling Waves. Chapter Introduction Chaper 4 Traveling Waves 4.1 Inroducion To dae, we have considered oscillaions, i.e., periodic, ofen harmonic, variaions of a physical characerisic of a sysem. The sysem a one ime is indisinguishable from

More information

Optimal Path Planning for Flexible Redundant Robot Manipulators

Optimal Path Planning for Flexible Redundant Robot Manipulators 25 WSEAS In. Conf. on DYNAMICAL SYSEMS and CONROL, Venice, Ialy, November 2-4, 25 (pp363-368) Opimal Pah Planning for Flexible Redundan Robo Manipulaors H. HOMAEI, M. KESHMIRI Deparmen of Mechanical Engineering

More information