Limited circulation. For review only

Size: px
Start display at page:

Download "Limited circulation. For review only"

Transcription

1 Event-based Sensor Data Scheduling: Trade-off Between Communication Rate and Estimation Quality Process Sensor Estimator Networ Junfeng Wu, Qing-Shan Jia, Karl Henri Johansson, Ling Shi Abstract We consider sensor data scheduling for remote state estimation. Due to constrained communication energy and bandwidth, a sensor needs to decide whether it should send the measurement to a remote estimator for further processing. We propose an event-based sensor data scheduler for linear systems and derive the corresponding minimum squared error estimator. By selecting an appropriate eventtriggering threshold, we illustrate how to achieve a desired balance between the sensor-to-estimator communication rate and the estimation quality. Simulation examples are provided to demonstrate the theory. Key words: Kalman filter; sensor scheduling; event-based scheduling; estimation performance. I. INTRODUCTION Networed control systems have received much attention in the last decade and are found in a wide spectrum of applications, e.g., in civil structure maintenance, environmental monitoring, battlefield surveillance. In many of these applications, sensor nodes are batterypowered. Replacing old batteries that are running out of energy are costly operations and may not even be possible. At the same time, the communication networ may be shared by many nodes, and consequently the communication bandwidth might be scarce and uncertain. Thus it is practically important to minimize the sensorto-estimator communication rate. A too low rate may, however, lead to poor estimation quality. It is of significant interest to reduce the sensor-to-estimator communication rate while guarantee a certain level of desired estimation quality. Related research on remote estimation under communication constraint and sensor scheduling in various forms have appeared in recent years. The problem of sensor scheduling can be traced bac to the 970s. Athans first formulated a class of optimization problems dealing with selecting one measurement provided by one out of many sensors. Gupta et al. 2 proposed a stochastic sensor scheduling scheme among multiple sensors for one process and provided the optimal probability distribution over the sensors to be selected. In control of modern networed systems, actions are often desired to be taen only after certain events occur. These events may contain useful information about the system 3, and using an appropriate event-based scheduler, the performance of the estimator can be improved. Imer and Basar 4 considered optimal estimation with limited measurements where the stochastic process was a scalar linear system. They showed that the optimal observer policy has a solution in an event-triggered form. Cogill et al. 5 considered : Electronic and Computer Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong. jfwu, eesling}@ust.h. : Center for Intelligent and Networed Systems, Department of Automation, TNLIST, Tsinghua University, Beijing, China. jiaqs@tsinghua.edu.cn. : ACCESS Linnaeus Center, School of Electrical Engineering, Royal Institute of Technology, Stocholm, Sweden. allej@ee.th.se. The wor by J. Wu and L. Shi is partially supported by a HK RGC CRF grant HKUST/CRF/0 and a HK RGC GRF grant The wor by Q.-S. Jia is supported in part by the National Science Foundation of China under grants (Nos , , , and ), the Specialized Research Fund for the Doctoral Program of Higher Education (No ), the National International Collaboration Project (No. B06002) and the TNLIST Cross Disciplinary Research Funding. The wor by K. H. Johansson is supported by the Knut and Alice Wallenberg Foundation and the Swedish Research Council. Fig. : Event-based Scheduling for Remote State Estimation a sensor data scheduling problem and used a feedbac policy to choose the transmission times which provides a trade-off between the communication rate and the estimation error. Ambrosino et al. 6 considered the channel capacity constraint. In recent wor by Li et al. 7, an event-triggered approach was used to trigger the data transmission from a sensor to a remote observer in order to minimize the mean squared estimation error at the observer subject to a constraint on transmission frequency. Closely related wors are also given by Riberio et al. 8 and Msechu et al. 9 where quantized Kalman filter were considered. The main distinctions between our wor and 8, 9 include the different communication models (paced-based versus finite-bit channels) and different estimation procedures. While we design an event-based scheduler to optimize the tradeoff between the sensor-to-estimator communication rate and the remote estimation quality, the wor of 8, 9 focused on designing encoder-decoder pairs to improve the estimation quality over a bit-limited channel. This paper focuses on the design of sensor data scheduler and the corresponding networed state estimator illustrated by the architecture in Fig.. We propose an event-based sensor data scheduler and derive the corresponding minimum mean-squared error (MMSE) estimator. By adopting an approximation technique from nonlinear filtering, we derive a simple form of an accurate MMSE estimator, from which an illustrative relationship between the sensor-toestimator communication rate and the remote estimation quality can be obtained. The remainder of this paper is organized as follows. In Section II, we provide the mathematical problem formulation. In Section III, we derive the exact MMSE estimator and an approximate MMSE estimator for an event-based sensor data scheduler. Via simulation examples in Section IV, we demonstrate how a desired trade-off between the sensor communication rate and the estimation quality can be achieved. It is also shown that the approximate MMSE estimator produces accurate results. In Section V, some concluding remars are given. Notation: S n + is the set of n n positive semi-definite matrices. When X S n +, we simply write X 0; Similarly, X Y means X Y 0. f x (x) represents the probability density function (pdf) of the random variable (r.v.) x, and f x y (x y) denotes the pdf of a r.v. x conditional on the variable y. N (µ, Σ) denotes Gaussian distribution with mean µ and covariance matrix Σ. E denotes the mathematical expectation and Pr( ) denotes the probability of a random event. Tr } denotes the trace of a matrix and denotes the Hölder infinity-norm of a vector. A. System Model II. PROBLEM SETUP Consider the following linear system: x + = Ax + w, () y = Cx + v, (2) where x R n is the state vector, y R m is the sensor measurement, w R n and v R m are mutually uncorrelated white Gaussian noises with covariances Q 0 and R > 0, respectively. Preprint submitted to IEEE Transactions on Automatic Control. Received: August 20, 202 9:23:43 PST Copyright (c) 20 IEEE. Personal use is permitted. For any other purposes, permission must be obtained from the IEEE by ing pubs-permissions@ieee.org.

2 2 The initial state x 0 is zero-mean Gaussian with covariance matrix Ex 0 x 0 = Π 0 0, and is uncorrelated with w and v for all 0. (A, C) and (A, Q) are observable and controllable, respectively. After y (the measured value of y ) is taen, the sensor decides whether it will send y to a remote estimator for further processing. Let γ = or 0 be the decision variable whether y shall be sent or not. Define I γ 0 y 0,..., γ y } with I, and ˆx Ex I, e x ˆx, P Ee e I, (3) ˆx Ex I, e x ˆx, P Ee e I. (4) The estimates ˆx and ˆx are called the a priori and a posteriori MMSE estimate, respectively. Further define the measurement innovation z as z y Ey I. (5) Define the functions h, g λ, g λ and gλ : Sn + S n + as follows: g λ (X) X λxc CXC + R CX, h(x) AXA + Q, g λ (X) g λ h(x), where denotes the function composition. In the sequel, if λ =, g and g will be written as g and g for brevity. We can write the update equation for P in a compact form as g(p ), if γ P = =, h(p ), if γ = 0. Notice that h(p ) g(p ) as g(x) X for any X 0. This has an intuitive explanation: the measurement y (or alternatively, the innovation z ) always reduces the estimation error covariance. B. Event-based Sensor Scheduler We consider in this paper applications where feedbac is available from the estimator to the sensor, see Fig.. Consider the following two cases for the Kalman filter when z = 0: ) γ = : ˆx = Aˆx and P = g(p ), 2) γ = 0 : ˆx = Aˆx and P = h(p ). The estimate ˆx for the two cases are the same, but the error covariances are different. Therefore if the sensor finds that z is zero and does not send y to the estimator, and at the same time, the estimator is aware of this information, then even without receiving y, the estimator nows that ˆx = Aˆx has error covariance g(p ), which is smaller than h(p ). Since CP C + R > 0, there exists a unitary matrix U R m m such that U (CP C + R)U = Λ, where Λ = diag ( λ,..., ) λm R m m and λ,..., λm R are the eigenvalues of CP C + R. Define F R m m as F U Λ 2. (6) Examples of such applications can be found in remote estimation based on the IEEE /ZigBee protocol: sensor devices can be scheduled to communicate to the so-called Personal Area Networ coordinator which also serves as a remote estimator. The coordinator broadcasts information to all devices at the beginning of each periodic superframe and can then incorporate the required feedbac information. Evidently, F F = (CP C + R). The matrix F is computed by the remote estimator and is sent bac to the sensor along with C ˆx at each time, see Fig.. Define ɛ as ɛ F z. (7) This transformation is called the Mahalanobis transformation. The coordinates of z are decorrelated, so ɛ has mvariable standard Gaussian distribution, which contains a set of independent principal components of z. We consider the following event-based sensor data scheduler: 0, if ɛ γ = δ, (8), otherwise, where δ 0 is a fixed threshold. Under this scheduler, if γ = 0, the estimator can infer that ɛ δ. It is this additional information that helps reduce the estimation error at the remote estimator. With a slight abuse of notation, we redefine the information I received by the remote estimator till as I γ 0 y 0,..., γ y } γ 0,..., γ }. Define the average sensor communication rate as T γ lim sup Eγ. (9) T + T + Preprint submitted to IEEE Transactions on Automatic Control. Received: August 20, 202 9:23:43 PST Copyright (c) 20 IEEE. Personal use is permitted. For any other purposes, permission must be obtained from the IEEE by ing pubs-permissions@ieee.org. =0 Notice that both the average rate γ and the estimation error covariance matrix P depend on the threshold δ. For example, if δ = 0, then Pr( ɛ 0) = 0 and the sensor sends y at each (almost surely). Consequently, γ = and P = g(p ). On the other hand, if δ = +, then the sensor eeps y for all, thus maing γ = 0. As the event ɛ + provides no extra information on the innovation, the estimator is in this case equivalent to an openloop predictor. Therefore, P = h(p ). In the latter case, when A is unstable, P diverges as +. Apparently there is a trade-off between the communication rate and the estimation quality. We now state the main problems considered in this paper. ) Under the event-based sensor scheduler (8), what is the MMSE estimator? 2) How to choose the threshold δ in (8) to achieve a desirable trade-off between the communication rate and the estimation quality? We will provide answers to these two problems in the remainder of the paper. III. EVENT-BASED STATE ESTIMATION In this section, we derive the MMSE estimator under the eventbased sensor data scheduler (8), first the exact estimator and then an accurate approximation. A. The Exact MMSE Estimator The MMSE estimate is uniquely specified as the conditional mean given all available information 0. In this subsection, we provide an exact MMSE estimator corresponding to the event-based scheduler (8) using the following two-step updating procedure.. Time Update: The a priori estimate ˆx, which is the conditional mean of x given the information set I, is derived as ˆx = Ex I = R m xf x (x I )dx, (0) and the corresponding estimation error covariance P P = R m (x ˆx )(x ˆx ) f x (x I )dx. is given by

3 3 2. Measurement Update: The a posteriori estimate ˆx, which is the conditional mean of x given I, is derived as follows. Depending on whether γ = 0 or, we have the following two cases: ) γ = 0. The sensor does not send y to the remote estimator, but the estimator is aware of that ɛ δ. Consequently, ˆx is given by ˆx = Ex Î = R m xf x (x Î)dx, () where we denote Î = I γ = 0}. Define the set R m as ɛ R m : ɛ δ}, (2) then one can compute f x (x Î) using Bayes rule as f x (x I ) f x (x Î) = f ɛ (ɛ I, x )dɛ, (3) f ɛ (ɛ I )dɛ where f ɛ (ɛ I, x ) = N (F x F C ˆx, F RF ) and z = Cx + v C ˆx = Ce + v. (4) The a posteriori error covariance P is given by P = (x ˆx )(x ˆx ) f x (x Î)dx. R m 2) γ =. The sensor sends y to the remote estimator. Denote the measured value of the innovation z as z. Then I becomes I = I z = z}. The remote estimator updates ˆx as in (), but the conditional pdf f x (x I ) is now calculated using Bayes rule as f x (x I ) = f x (x I )f z (z I, x ), (5) f z (z I ) where, from (4), one easily sees that f z (z I, x ) = N (Cx C ˆx, R). The a posteriori estimation error covariance P is given by P = (x ˆx )(x ˆx ) f x (x I, z = z)dx. R m Remar 3.. Although the above two steps produce the MMSE estimate ˆx corresponding to the event-based scheduler (8), each updating step requires numerical integration. The amount of computation involved mae this estimator intractable in general, which motivates us to consider an approximate MMSE estimator. As we will demonstrate, by using a standard technique in nonlinear filtering, we can derive an approximate MMSE estimator in a simple recursive form. B. Approximate MMSE Estimator A commonly used approximation technique in nonlinear filtering is to assume that the conditional distribution of x given I is Gaussian, i.e., f x (x I ) = N (ˆx, P ). (6) This assumption reduces the estimation problem from the tracing of a general pdf, which is usually computationally intractable, to the tracing of its mean and covariance matrix. The approximation is widely used in the literature, e.g., 8, 9,. Unless specifically mentioned, our analysis in the rest of this paper is based on this assumption. The approximation leads to a very simple form of the estimator, as shown by the following result. Theorem 3.2. Consider the remote state estimation in Fig. with the event-based sensor scheduler (8). Under the assumption (6), the MMSE estimator is given recursively as follows: ) Time update: ˆx = Aˆx, P = h(p (7) ). 2) Measurement update: ˆx = ˆx + γ L z, P = γ g(p ) + ( γ ) g β(δ) (P ), Preprint submitted to IEEE Transactions on Automatic Control. Received: August 20, 202 9:23:43 PST Copyright (c) 20 IEEE. Personal use is permitted. For any other purposes, permission must be obtained from the IEEE by ing pubs-permissions@ieee.org. where β(δ) = 2 2π δe δ2 2 2Q(δ), (8) and Q( ) is the standard Q-function defined by + Q(δ) e x2 2 dx. (9) δ 2π Before we present the proof, we state a few preliminary results. From (4) and (6), z is zero-mean Gaussian conditioned on I. Furthermore, z is jointly Gaussian with x conditioned on I. From (4), Ez z I = CEe e and Ee z I = Ee e I C +R = CP C +R, (20) I C = P C. (2) Now let us tae a loo at ɛ defined in (7). From (20), Eɛ ɛ I = F Ez z I F = I m. Thus, given I, ɛ is a zero-mean Gaussian multivariate random variable with unit variance. Denote ɛ i as the ith element of ɛ. Then ɛ i and ɛj are mutually independent if i j. Notice that γ = 0 implies that the event ɛ δ happens. We then have the following result. Lemma 3.3. F Ez z ÎF = Eɛ ɛ Î = β(δ) I m. Proof: Straightforward calculation yields the first equality. Given I, due to the independence of ɛ i and ɛj for i j along with Lemma A. in the Appendix, we have and Thus, E(ɛ i ) 2 Î = E(ɛ i ) 2 I, ɛ δ = E(ɛ i ) 2 I, ɛ i δ = β(δ) Eɛ i ɛ j Î = Eɛ i ɛ j I, ɛ i δ, ɛ j δ = 0. Eɛ ɛ Î = β(δ) I m. The following lemma is used in deriving the main result. Lemma 3.4. The following equalities hold. Ee z Î = L Ez z Î, (22) E(e L z )z Î = 0, (23) E(e L z )(e L z ) I, z =z = g(p ), (24) E (e L z )(e L z ) Î = g(p ), (25)

4 4 where L = P C CP C + R. Proof: We first prove (22). From Lemma A.2, (20) and (2), Ex I, z = z = ˆx + P C CP C + R z. (26) Since given I, ɛ is Gaussian with zero mean and unit covariance, we can define p δ Pr( ɛ δ I ). Using the conditional pdf fɛ (ɛ I ) f ɛ (ɛ Î) = p δ, if ɛ δ; (27) 0, otherwise; we obtain Ee z Î = p δ = p δ = p δ Ee I, z = F Ex ˆx I, z = F ( Ex I, z = F = P C (CP C +R) F = L F Eɛ ɛ ÎF = L Ez z Î, ɛɛ F f ɛ (ɛ I )dɛ ɛɛ F f ɛ (ɛ I )dɛ ) ɛˆx ɛ F f ɛ (ɛ I )dɛ ɛɛ f ɛ (ɛ I )dɛ F p δ where the last equality is from Lemma 3.3. From (22) we have E(e L z )z Î = Ee z Î L Ez z Î = 0, which shows (23). To prove (24), using Lemma A.2, we have E(x Ex I, z =z)(x Ex I, z =z) I, z =z = P P C (CP C + R) CP = g(p ). (28) Notice that (26) leads to x Ex I, z = z = x ˆx L z = e L z, which together with (28) shows (24). Now from (24), one obtains E (e L z )(e L z ) Î = E (e L z )(e L z ) I, z = F fɛ (ɛ I ) ɛ dɛ p δ = g(p p ) f ɛ (ɛ I )dɛ δ = g(p ), where to get the second last equality, we note that from (27) we have f ɛ (ɛ I )dɛ = p δ. Proof to Theorem 3.2: The proof of the time update is simple: ˆx = AEx I = Aˆx, P = E(Ae + w )(Ae + w ) I = AP A + Q = h(p ). Next, we verify the measurement update for the following two cases. ) γ = : According to (26) and (28), ˆx = ˆx + L z, P = g(p ). 2) γ = 0: the sensor does not send y to the remote estimator which computes ˆx as ˆx = Ex Î = p δ = p δ Preprint submitted to IEEE Transactions on Automatic Control. Received: August 20, 202 9:23:43 PST Copyright (c) 20 IEEE. Personal use is permitted. For any other purposes, permission must be obtained from the IEEE by ing pubs-permissions@ieee.org. E x I, z = F ɛ f ɛ (ɛ I )dɛ ( ) ˆx + L F ɛ f ɛ (ɛ I )dɛ = ˆx + L F ɛf ɛ (ɛ I )dɛ p δ = ˆx, where the last equality is due to that ɛf ɛ (ɛ I )dɛ = 0 since being a pdf of Gaussian distribution, f ɛ (ɛ I ) is even and defined in (2) is symmetric and centered in the origin. Now from (23), (25), Lemmas 3.3 and A., the corresponding error covariance matrix P can be computed as P = E (x ˆx )(x ˆx ) Î = E (x ˆx )(x ˆx ) Î (e = E L } z )+L z (e L } z )+L z Î = E (e L z )(e L z ) +(e L z )z L +L z (e L z ) + L z z L Î = g(p ) + L Ez z ÎL = g(p ) + β(δ) L ( F F ) L = g(p ) + β(δ) L (CP C + R)L = g β(δ) (P ). From Theorem 3.2, we can write the update for P in a compact form as g(p ), if γ P = =, (29) g β(δ) (P ), if γ = 0. Remar 3.5. P is a function of γ t } t=0 and β(δ), both of which depend on δ. By properly tuning δ, we can achieve a desired trade-off between the sensor communication rate γ and the estimation quality in terms of P. For example, if we wish to have a small γ, then picing a large δ would serve the purpose. The optimal choice of δ depends on the available communication resources. Lemma 3.6. Let δ 0. Then ɛ i Pr( ɛ δ I ) = 2Q(δ) m. Proof: Note that ɛ = max ɛ,..., ɛm } δ iff δ, i m. Therefore, m Pr( ɛ δ I ) = Pr( ɛ i δ I ) i= = 2Q(δ) m. The following result is on the average sensor-to-estimator communication rate γ.

5 5 Process Sensor EP 2 TrEP } Networ Estimator Process 2 Sensor 2 Fig. 2: Scheduling of sensors communication for Process and Process 2 Proposition 3.7. Consider the remote state estimation in Fig. with the event-based sensor scheduler (8). Under the assumption (6), the average sensor-to-estimator communication rate γ in (9) is given by γ = 2Q(δ) m. (30) Proof: Note that γ is a random variable taing value in 0, } with Pr(γ = I ) = Pr( ɛ > δ I ). From Lemma 3.6, Pr( ɛ δ I ) = 2Q(δ) m whatever value I taes. Therefore, δ solely determines the distribution of γ and can be described by Pr(γ = 0) = 2Q(δ) m and Pr(γ = ) = 2Q(δ) m. Equation (30) is then proved from the definition of expectation of γ and the definition of γ. IV. SIMULATION EXAMPLE In this example, we consider the scheduling of two sensors measuring Process and Process 2 (see Fig. 2). Let Process be the stable process with A =, C = 0, Q = 5I 2, R = 2 and Process 2 be the unstable process with parameters A 2 =.2, C 2 =, Q 2 = 0, R 2 = 5. Assume at each time only one of the sensors is able to communicate its measurement to the remote estimator due to a shortage of communication bandwidth. Since Process is stable, a trivial sensor scheduler φ that guarantees a bounded estimation error covariance for both processes is that sensor 2 occupies the channel all the time, while sensor is idle and the remote estimator predicts the state of Process at each time. Let the estimation error covariances of Process and Process 2 under the scheduler φ be P (φ) and P 2 (φ), respectively, which are given by the following two recursions: P = h(p ) and P 2 = g(p 2 ). The steady-state values of TrP } and P 2 under φ are given by TrP } = and P 2 = By using the event-based scheduler proposed in this paper, we can reduce the estimation error for Process significantly while letting the estimation error for Process 2 grow only slightly. The idea is simple: let sensor 2 follow the event-based scheduler (8); whenever sensor 2 does not send data due to ɛ 2 δ, let sensor communicate with the remote estimator. The resulting errors are plotted in Fig. 3 as a function of the parameter δ being used by Process 2, which clearly demonstrates the advantage adopting the event-based scheduler. For example, when δ = 0.4, the values of TrEP }2 and EP 2 are and 3.99, respectively, corresponding to a 52.7% decrease of estimation error 2 Since P is a stochastic process due to the randomness of γ, we will consider TrEP } as a performance measure for the remote estimator under the event-based sensor scheduler (8), which is obtained in this example via Monte Carlo simulations δ Preprint submitted to IEEE Transactions on Automatic Control. Received: August 20, 202 9:23:43 PST Copyright (c) 20 IEEE. Personal use is permitted. For any other purposes, permission must be obtained from the IEEE by ing pubs-permissions@ieee.org. 0 Fig. 3: Estimation quality of Process and Process 2 versus δ theoretical sensor communication rate empirical sensor communication rate δ Fig. 4: Sensor communication rate γ versus scheduling parameter δ for Process and a 5.83% increase of estimation error for Process 2. In Fig. 4, we plot the empirical average sensor communication rate and the theoretical average sensor communication rate (30) for Process 2 under different values of δ. The two curves match almost indistinguishable and demonstrate that the approximated MMSE estimator is very close to the exact MMSE estimator. V. CONCLUSION We propose an event-based sensor data scheduler for state estimation over a networ. The MMSE estimator is derived together with an approximate estimator. It is shown that by tolerating a small amount of increase of the estimation error, a significant reduction of the sensor-to-estimator communication rate can be achieved. In many applications of networed control systems, multiple sensors may be involved. Constructing appropriate event-based schedules at each sensor and estimating the process state based on the received data and the additional information inferred by the events are more difficult than the one we have considered. This will be pursued in our future wor. REFERENCES M. Athans, On the determination of optimal costly measurement strategies for linear stochastic systems, Automatica, vol. 8, no V. Gupta, T. Chung, B. Hassibi, and R. M. Murray, On a stochastic sensor selection algorithm with applications in sensor scheduling and dynamic sensor coverage, Automatica, vol. 42, no. 2, pp , X. Cao, Stochastic Learning and Optimization: A Sensitivity-Based Approach. Springer-Verlag, O. C. Imer and T. Basar, Optimal estimation with limited measurements, in Proceedings of the 44th IEEE Conference on Decision and Control, European Control, December 2005, pp R. Cogill, S. Lall, and J. P. Hespanha, A constant factor approximation algorithm for event-based sampling, in Proceedings of the 2007 American Control Conference, New Yor City, USA, 2007, pp R. Ambrosino, B. Sinopoli, and K. Poolla, Optimal sensor scheduling for remote estimation over wireless sensor networs, in Modeling, Estimation and Control of Networed Complex Systems. New Yor, NY: Springer, 2009, pp

6 6 7 L. Li, M. Lemmon, and X. Wang, Event-triggered state estimation in vector linear processes, in Proceedings of the American Control Conference, 200, pp A. Ribeiro, G. B. Giannais, and S. I. Roumeliotis, SOI-KF: Distributed Kalman filtering with low-cost communications using the sign of innovations, IEEE Transactions on Signal Processing, vol. 54, no. 2, pp , E. J. Msechu, S. I. Roumeliotis, A. Ribeiro, and G. B. Giannais, Decentralized quantized Kalman filtering with scalable communication cost, IEEE Transactions on Signal Processing, vol. 56, no. 8, pp , B. Anderson and J. Moore, Optimal Filtering. Prentice Hall, 979. J. Kotecha and P. Djuric, Gaussian particle filtering, IEEE Transactions on Signal Processing, vol. 5, no. 0, pp , Appendix Lemma A.: Let x R be a Gaussian r.v. with zero mean and variance Ex 2 = σ 2. Denoting = δσ, then Ex 2 x = σ 2 ( β(δ)). Proof: The property f x (x x ) = fx(x) Ex 2 x = = yields fx(t)dt t 2 f e t2 2σ 2 dt x(t)dt 2π σ 2 δ y 2 e y2 2 dy 2Q(δ) δ 2π δ where y 2 δ 2π e y2 2 dy can be calculated as: δ y 2 e y2 2 dy = ye y2 δ 2 δ δ 2π 2π δ + δ = 2Q(δ) 2 2π δe δ2 2. 2π e y2 2 dy Then Ex 2 x = σ 2 ( β(δ)). Lemma A.2 0, Pages 24-25: Let x R n and y R m be jointly Gaussian with mean and variance x Σxx Σ m = and Σ = xy. ȳ Σ yx Σ yy Then x is conditionally Gaussian given y = y with f x y (x y) = N (µ, Σ xx Σ xy Σ yy Σ yx ) where µ = x + Σ xy Σ yy (y ȳ). Preprint submitted to IEEE Transactions on Automatic Control. Received: August 20, 202 9:23:43 PST Copyright (c) 20 IEEE. Personal use is permitted. For any other purposes, permission must be obtained from the IEEE by ing pubs-permissions@ieee.org.

Time and Event-based Sensor Scheduling for Networks with Limited Communication Resources

Time and Event-based Sensor Scheduling for Networks with Limited Communication Resources Proceedings of the 18th World Congress The International Federation of Automatic Control Time and Event-based Sensor Scheduling for Networks with Limited Communication Resources Ling Shi Karl Henrik Johansson

More information

A Stochastic Online Sensor Scheduler for Remote State Estimation with Time-out Condition

A Stochastic Online Sensor Scheduler for Remote State Estimation with Time-out Condition A Stochastic Online Sensor Scheduler for Remote State Estimation with Time-out Condition Junfeng Wu, Karl Henrik Johansson and Ling Shi E-mail: jfwu@ust.hk Stockholm, 9th, January 2014 1 / 19 Outline Outline

More information

arxiv: v1 [cs.it] 10 Feb 2015

arxiv: v1 [cs.it] 10 Feb 2015 arxiv:502.03068v [cs.it 0 Feb 205 Multi-Sensor Scheduling for State Estimation with Event-Based Stochastic Triggers Sean Weeraody Student Member IEEE Yilin Mo Member IEEE Bruno Sinopoli Member IEEE Duo

More information

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,

More information

Event-based State Estimation of Linear Dynamical Systems: Communication Rate Analysis

Event-based State Estimation of Linear Dynamical Systems: Communication Rate Analysis 2014 American Control Conference Estimation of Linear Dynamical Systems: Dawei Shi, Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada Department of Electronic

More information

Kalman Filtering with Uncertain Process and Measurement Noise Covariances with Application to State Estimation in Sensor Networks

Kalman Filtering with Uncertain Process and Measurement Noise Covariances with Application to State Estimation in Sensor Networks 1th IEEE International Conference on Control Applications Part of IEEE Multi-conference on Systems and Control Singapore, 1-3 October 7 WeA.5 Kalman Filtering with Uncertain Process and Measurement Noise

More information

arxiv: v1 [cs.sy] 30 Sep 2015

arxiv: v1 [cs.sy] 30 Sep 2015 Optimal Sensor Scheduling and Remote Estimation over an Additive Noise Channel Xiaobin Gao, Emrah Akyol, and Tamer Başar arxiv:1510.00064v1 cs.sy 30 Sep 015 Abstract We consider a sensor scheduling and

More information

Stability Conditions and Phase Transition for Kalman Filtering over Markovian Channels

Stability Conditions and Phase Transition for Kalman Filtering over Markovian Channels Stability Conditions and Phase Transition for Kalman Filtering over Marovian Channels Junfeng Wu, Guodong Shi 2, Brian D. O. Anderson 2, Karl Henri Johansson. ACCESS Linnaeus Center, School of Electrical

More information

arxiv: v1 [cs.sy] 15 Oct 2017

arxiv: v1 [cs.sy] 15 Oct 2017 Game-Theoretic Pricing and Selection with Fading Channels Yuqing Ni, Alex S. Leong, Daniel E. Quevedo, and Ling Shi arxiv:1710.05300v1 cs.sy 15 Oct 2017 Abstract We consider pricing and selection with

More information

LQG CONTROL WITH MISSING OBSERVATION AND CONTROL PACKETS. Bruno Sinopoli, Luca Schenato, Massimo Franceschetti, Kameshwar Poolla, Shankar Sastry

LQG CONTROL WITH MISSING OBSERVATION AND CONTROL PACKETS. Bruno Sinopoli, Luca Schenato, Massimo Franceschetti, Kameshwar Poolla, Shankar Sastry LQG CONTROL WITH MISSING OBSERVATION AND CONTROL PACKETS Bruno Sinopoli, Luca Schenato, Massimo Franceschetti, Kameshwar Poolla, Shankar Sastry Department of Electrical Engineering and Computer Sciences

More information

4 Derivations of the Discrete-Time Kalman Filter

4 Derivations of the Discrete-Time Kalman Filter Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof N Shimkin 4 Derivations of the Discrete-Time

More information

Event-based State Estimation in Cyber-Physical Systems

Event-based State Estimation in Cyber-Physical Systems Event-based State Estimation in Cyber-Physical Systems by Dawei Shi A thesis submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Control Systems Department of

More information

arxiv: v1 [cs.sy] 9 Apr 2017

arxiv: v1 [cs.sy] 9 Apr 2017 Quantized Innovations Bayesian Filtering Chun-Chia HuangRobert R.Bitmead a Department of Mechanical & Aerospace Engineering University of California San Diego 9 Gilman Drive La Jolla CA 99- USA. arxiv:7.6v

More information

Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels

Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels LEI BAO, MIKAEL SKOGLUND AND KARL HENRIK JOHANSSON IR-EE- 26: Stockholm 26 Signal Processing School of Electrical Engineering

More information

Lecture 3: Functions of Symmetric Matrices

Lecture 3: Functions of Symmetric Matrices Lecture 3: Functions of Symmetric Matrices Yilin Mo July 2, 2015 1 Recap 1 Bayes Estimator: (a Initialization: (b Correction: f(x 0 Y 1 = f(x 0 f(x k Y k = αf(y k x k f(x k Y k 1, where ( 1 α = f(y k x

More information

NON-LINEAR CONTROL OF OUTPUT PROBABILITY DENSITY FUNCTION FOR LINEAR ARMAX SYSTEMS

NON-LINEAR CONTROL OF OUTPUT PROBABILITY DENSITY FUNCTION FOR LINEAR ARMAX SYSTEMS Control 4, University of Bath, UK, September 4 ID-83 NON-LINEAR CONTROL OF OUTPUT PROBABILITY DENSITY FUNCTION FOR LINEAR ARMAX SYSTEMS H. Yue, H. Wang Control Systems Centre, University of Manchester

More information

Comparison of Periodic and Event-Based Sampling for Linear State Estimation

Comparison of Periodic and Event-Based Sampling for Linear State Estimation Preprints of the 9th World Congress The International Federation of Automatic Control Cape Town, South Africa. August 4-9, 4 Comparison of Periodic and Event-Based Sampling for Linear State Estimation

More information

STOCHASTIC STABILITY OF EXTENDED FILTERING FOR NONLINEAR SYSTEMS WITH MEASUREMENT PACKET LOSSES

STOCHASTIC STABILITY OF EXTENDED FILTERING FOR NONLINEAR SYSTEMS WITH MEASUREMENT PACKET LOSSES Proceedings of the IASTED International Conference Modelling, Identification and Control (AsiaMIC 013) April 10-1, 013 Phuet, Thailand STOCHASTIC STABILITY OF EXTENDED FILTERING FOR NONLINEAR SYSTEMS WITH

More information

Change Sensor Topology When Needed: How to Efficiently Use System Resources in Control and Estimation Over Wireless Networks

Change Sensor Topology When Needed: How to Efficiently Use System Resources in Control and Estimation Over Wireless Networks Proceedings of the 46th IEEE Conference on Decision and Control New Orleans, LA, USA, Dec. 2-4, 27 FrB.3 Change Sensor Topology When Needed: How to Efficiently Use System Resources in Control and Estimation

More information

Distributed Estimation and Detection for Smart Grid

Distributed Estimation and Detection for Smart Grid Distributed Estimation and Detection for Smart Grid Texas A&M University Joint Wor with: S. Kar (CMU), R. Tandon (Princeton), H. V. Poor (Princeton), and J. M. F. Moura (CMU) 1 Distributed Estimation/Detection

More information

Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate

Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate www.scichina.com info.scichina.com www.springerlin.com Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate WEI Chen & CHEN ZongJi School of Automation

More information

Networked Control Systems: Estimation and Control over Lossy Networks

Networked Control Systems: Estimation and Control over Lossy Networks Noname manuscript No. (will be inserted by the editor) Networked Control Systems: Estimation and Control over Lossy Networks João P. Hespanha Alexandre R. Mesquita the date of receipt and acceptance should

More information

A Study of Covariances within Basic and Extended Kalman Filters

A Study of Covariances within Basic and Extended Kalman Filters A Study of Covariances within Basic and Extended Kalman Filters David Wheeler Kyle Ingersoll December 2, 2013 Abstract This paper explores the role of covariance in the context of Kalman filters. The underlying

More information

Estimation for Nonlinear Dynamical Systems over Packet-Dropping Networks

Estimation for Nonlinear Dynamical Systems over Packet-Dropping Networks Estimation for Nonlinear Dynamical Systems over Packet-Dropping Networks Zhipu Jin Chih-Kai Ko and Richard M Murray Abstract Two approaches, the extended Kalman filter (EKF) and moving horizon estimation

More information

Time Varying Optimal Control with Packet Losses.

Time Varying Optimal Control with Packet Losses. Time Varying Optimal Control with Packet Losses. Bruno Sinopoli, Luca Schenato, Massimo Franceschetti, Kameshwar Poolla, Shankar S. Sastry Department of Electrical Engineering and Computer Sciences University

More information

Kalman filtering with intermittent heavy tailed observations

Kalman filtering with intermittent heavy tailed observations Kalman filtering with intermittent heavy tailed observations Sabina Zejnilović Abstract In large wireless sensor networks, data can experience loss and significant delay which from the aspect of control

More information

Asymptotically Optimal and Bandwith-efficient Decentralized Detection

Asymptotically Optimal and Bandwith-efficient Decentralized Detection Asymptotically Optimal and Bandwith-efficient Decentralized Detection Yasin Yılmaz and Xiaodong Wang Electrical Engineering Department, Columbia University New Yor, NY 10027 Email: yasin,wangx@ee.columbia.edu

More information

Lecture 4: Least Squares (LS) Estimation

Lecture 4: Least Squares (LS) Estimation ME 233, UC Berkeley, Spring 2014 Xu Chen Lecture 4: Least Squares (LS) Estimation Background and general solution Solution in the Gaussian case Properties Example Big picture general least squares estimation:

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

F denotes cumulative density. denotes probability density function; (.)

F denotes cumulative density. denotes probability density function; (.) BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models

More information

Optimal Sensor Hop Selection: Sensor Energy Minimization and Network Lifetime Maximization with Guaranteed System Performance

Optimal Sensor Hop Selection: Sensor Energy Minimization and Network Lifetime Maximization with Guaranteed System Performance To appear, 28 Conference on Decision and Control (CDC) http://www.cds.caltech.edu/~murray/preprints/28m_sjm8-cdc.html Optimal Sensor Hop Selection: Sensor Energy Minimization and Networ Lifetime Maximization

More information

Lecture 5 Channel Coding over Continuous Channels

Lecture 5 Channel Coding over Continuous Channels Lecture 5 Channel Coding over Continuous Channels I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw November 14, 2014 1 / 34 I-Hsiang Wang NIT Lecture 5 From

More information

STATE AND OUTPUT FEEDBACK CONTROL IN MODEL-BASED NETWORKED CONTROL SYSTEMS

STATE AND OUTPUT FEEDBACK CONTROL IN MODEL-BASED NETWORKED CONTROL SYSTEMS SAE AND OUPU FEEDBACK CONROL IN MODEL-BASED NEWORKED CONROL SYSEMS Luis A Montestruque, Panos J Antsalis Abstract In this paper the control of a continuous linear plant where the sensor is connected to

More information

Event-Triggered Decentralized Dynamic Output Feedback Control for LTI Systems

Event-Triggered Decentralized Dynamic Output Feedback Control for LTI Systems Event-Triggered Decentralized Dynamic Output Feedback Control for LTI Systems Pavankumar Tallapragada Nikhil Chopra Department of Mechanical Engineering, University of Maryland, College Park, 2742 MD,

More information

State Estimation Utilizing Multiple Description Coding over Lossy Networks

State Estimation Utilizing Multiple Description Coding over Lossy Networks Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 5 Seville, Spain, December 12-15, 5 MoB6.6 State Estimation Utilizing Multiple Description Coding over

More information

Minimum Necessary Data Rates for Accurate Track Fusion

Minimum Necessary Data Rates for Accurate Track Fusion Proceedings of the 44th IEEE Conference on Decision Control, the European Control Conference 005 Seville, Spain, December -5, 005 ThIA0.4 Minimum Necessary Data Rates for Accurate Trac Fusion Barbara F.

More information

On the Optimality of Threshold Policies in Event Triggered Estimation with Packet Drops

On the Optimality of Threshold Policies in Event Triggered Estimation with Packet Drops On the Optimality of Threshold Policies in Event Triggered Estimation with Packet Drops Alex S. Leong, Subhrakanti Dey, and Daniel E. Quevedo Abstract We consider a remote state estimation problem, where

More information

Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels

Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels Lei Bao, Mikael Skoglund and Karl Henrik Johansson Department of Signals, Sensors and Systems, Royal Institute of Technology,

More information

Communication constraints and latency in Networked Control Systems

Communication constraints and latency in Networked Control Systems Communication constraints and latency in Networked Control Systems João P. Hespanha Center for Control Engineering and Computation University of California Santa Barbara In collaboration with Antonio Ortega

More information

Networked Sensing, Estimation and Control Systems

Networked Sensing, Estimation and Control Systems Networked Sensing, Estimation and Control Systems Vijay Gupta University of Notre Dame Richard M. Murray California Institute of echnology Ling Shi Hong Kong University of Science and echnology Bruno Sinopoli

More information

Optimal LQG Control Across a Packet-Dropping Link

Optimal LQG Control Across a Packet-Dropping Link Optimal LQG Control Across a Pacet-Dropping Lin Vijay Gupta, Demetri Spanos, Baba Hassibi, Richard M Murray Division of Engineering and Applied Science California Institute of echnology {vijay,demetri}@cds.caltech.edu,{hassibi,murray}@caltech.edu

More information

Prediction, filtering and smoothing using LSCR: State estimation algorithms with guaranteed confidence sets

Prediction, filtering and smoothing using LSCR: State estimation algorithms with guaranteed confidence sets 2 5th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC) Orlando, FL, USA, December 2-5, 2 Prediction, filtering and smoothing using LSCR: State estimation algorithms with

More information

Decentralized Detection In Wireless Sensor Networks

Decentralized Detection In Wireless Sensor Networks Decentralized Detection In Wireless Sensor Networks Milad Kharratzadeh Department of Electrical & Computer Engineering McGill University Montreal, Canada April 2011 Statistical Detection and Estimation

More information

Kalman Filtering. Namrata Vaswani. March 29, Kalman Filter as a causal MMSE estimator

Kalman Filtering. Namrata Vaswani. March 29, Kalman Filter as a causal MMSE estimator Kalman Filtering Namrata Vaswani March 29, 2018 Notes are based on Vincent Poor s book. 1 Kalman Filter as a causal MMSE estimator Consider the following state space model (signal and observation model).

More information

Stabilization with Disturbance Attenuation over a Gaussian Channel

Stabilization with Disturbance Attenuation over a Gaussian Channel Proceedings of the 46th IEEE Conference on Decision and Control New Orleans, LA, USA, Dec. 1-14, 007 Stabilization with Disturbance Attenuation over a Gaussian Channel J. S. Freudenberg, R. H. Middleton,

More information

Introduction to Machine Learning

Introduction to Machine Learning What does this mean? Outline Contents Introduction to Machine Learning Introduction to Probabilistic Methods Varun Chandola December 26, 2017 1 Introduction to Probability 1 2 Random Variables 3 3 Bayes

More information

arxiv: v1 [cs.sy] 22 Jan 2015

arxiv: v1 [cs.sy] 22 Jan 2015 An Improved Stability Condition for Kalman Filtering with Bounded Markovian Packet Losses Junfeng Wu, Ling Shi, Lihua Xie, and Karl Henrik Johansson arxiv:1501.05469v1 [cs.sy] 22 Jan 2015 Abstract In this

More information

ECE 4400:693 - Information Theory

ECE 4400:693 - Information Theory ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 8: Differential Entropy Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Lecture 1 / 43 Outline 1 Review: Entropy of discrete RVs 2 Differential

More information

Shannon meets Wiener II: On MMSE estimation in successive decoding schemes

Shannon meets Wiener II: On MMSE estimation in successive decoding schemes Shannon meets Wiener II: On MMSE estimation in successive decoding schemes G. David Forney, Jr. MIT Cambridge, MA 0239 USA forneyd@comcast.net Abstract We continue to discuss why MMSE estimation arises

More information

Quadratic Extended Filtering in Nonlinear Systems with Uncertain Observations

Quadratic Extended Filtering in Nonlinear Systems with Uncertain Observations Applied Mathematical Sciences, Vol. 8, 2014, no. 4, 157-172 HIKARI Ltd, www.m-hiari.com http://dx.doi.org/10.12988/ams.2014.311636 Quadratic Extended Filtering in Nonlinear Systems with Uncertain Observations

More information

On Transmitter Design in Power Constrained LQG Control

On Transmitter Design in Power Constrained LQG Control On Transmitter Design in Power Constrained LQG Control Peter Breun and Wolfgang Utschic American Control Conference June 2008 c 2008 IEEE. Personal use of this material is permitted. However, permission

More information

Iterative Encoder-Controller Design for Feedback Control Over Noisy Channels

Iterative Encoder-Controller Design for Feedback Control Over Noisy Channels IEEE TRANSACTIONS ON AUTOMATIC CONTROL 1 Iterative Encoder-Controller Design for Feedback Control Over Noisy Channels Lei Bao, Member, IEEE, Mikael Skoglund, Senior Member, IEEE, and Karl Henrik Johansson,

More information

Final Examination Solutions (Total: 100 points)

Final Examination Solutions (Total: 100 points) Final Examination Solutions (Total: points) There are 4 problems, each problem with multiple parts, each worth 5 points. Make sure you answer all questions. Your answer should be as clear and readable

More information

RECURSIVE ESTIMATION AND KALMAN FILTERING

RECURSIVE ESTIMATION AND KALMAN FILTERING Chapter 3 RECURSIVE ESTIMATION AND KALMAN FILTERING 3. The Discrete Time Kalman Filter Consider the following estimation problem. Given the stochastic system with x k+ = Ax k + Gw k (3.) y k = Cx k + Hv

More information

A Crash Course on Kalman Filtering

A Crash Course on Kalman Filtering A Crash Course on Kalman Filtering Dan Simon Cleveland State University Fall 2014 1 / 64 Outline Linear Systems Probability State Means and Covariances Least Squares Estimation The Kalman Filter Unknown

More information

CYBER-Physical Systems (CPS) are systems that smoothly

CYBER-Physical Systems (CPS) are systems that smoothly 1 Optimal Linear Cyber-Attack on Remote State Estimation Ziyang Guo, Dawei Shi, Karl Henrik Johansson, Ling Shi Abstract Recent years have witnessed the surge of interest of security issues in cyber-physical

More information

Optimal Distributed Estimation Fusion with Compressed Data

Optimal Distributed Estimation Fusion with Compressed Data 12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 2009 Optimal Distributed Estimation Fusion with Compressed Data Zhansheng Duan X. Rong Li Department of Electrical Engineering

More information

ASIGNIFICANT research effort has been devoted to the. Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach

ASIGNIFICANT research effort has been devoted to the. Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 42, NO 6, JUNE 1997 771 Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach Xiangbo Feng, Kenneth A Loparo, Senior Member, IEEE,

More information

1 Kalman Filter Introduction

1 Kalman Filter Introduction 1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation

More information

A Novel Integral-Based Event Triggering Control for Linear Time-Invariant Systems

A Novel Integral-Based Event Triggering Control for Linear Time-Invariant Systems 53rd IEEE Conference on Decision and Control December 15-17, 2014. Los Angeles, California, USA A Novel Integral-Based Event Triggering Control for Linear Time-Invariant Systems Seyed Hossein Mousavi 1,

More information

Towards control over fading channels

Towards control over fading channels Towards control over fading channels Paolo Minero, Massimo Franceschetti Advanced Network Science University of California San Diego, CA, USA mail: {minero,massimo}@ucsd.edu Invited Paper) Subhrakanti

More information

Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise for Multisensor Stochastic Systems

Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise for Multisensor Stochastic Systems Mathematical Problems in Engineering Volume 2012, Article ID 257619, 16 pages doi:10.1155/2012/257619 Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise

More information

Kalman Filter Computer Vision (Kris Kitani) Carnegie Mellon University

Kalman Filter Computer Vision (Kris Kitani) Carnegie Mellon University Kalman Filter 16-385 Computer Vision (Kris Kitani) Carnegie Mellon University Examples up to now have been discrete (binary) random variables Kalman filtering can be seen as a special case of a temporal

More information

Event-triggered second-moment stabilization of linear systems under packet drops

Event-triggered second-moment stabilization of linear systems under packet drops Event-triggered second-moment stabilization of linear systems under pacet drops Pavanumar Tallapragada Massimo Franceschetti Jorge Cortés Abstract This paper deals with the stabilization of linear systems

More information

PARAMETER ESTIMATION AND ORDER SELECTION FOR LINEAR REGRESSION PROBLEMS. Yngve Selén and Erik G. Larsson

PARAMETER ESTIMATION AND ORDER SELECTION FOR LINEAR REGRESSION PROBLEMS. Yngve Selén and Erik G. Larsson PARAMETER ESTIMATION AND ORDER SELECTION FOR LINEAR REGRESSION PROBLEMS Yngve Selén and Eri G Larsson Dept of Information Technology Uppsala University, PO Box 337 SE-71 Uppsala, Sweden email: yngveselen@ituuse

More information

Estimation over Communication Networks: Performance Bounds and Achievability Results

Estimation over Communication Networks: Performance Bounds and Achievability Results Estimation over Communication Networks: Performance Bounds and Achievability Results A. F. Dana, V. Gupta, J. P. Hespanha, B. Hassibi and R. M. Murray Abstract This paper considers the problem of estimation

More information

in a Rao-Blackwellised Unscented Kalman Filter

in a Rao-Blackwellised Unscented Kalman Filter A Rao-Blacwellised Unscented Kalman Filter Mar Briers QinetiQ Ltd. Malvern Technology Centre Malvern, UK. m.briers@signal.qinetiq.com Simon R. Masell QinetiQ Ltd. Malvern Technology Centre Malvern, UK.

More information

Zeno-free, distributed event-triggered communication and control for multi-agent average consensus

Zeno-free, distributed event-triggered communication and control for multi-agent average consensus Zeno-free, distributed event-triggered communication and control for multi-agent average consensus Cameron Nowzari Jorge Cortés Abstract This paper studies a distributed event-triggered communication and

More information

Battery Level Estimation of Mobile Agents Under Communication Constraints

Battery Level Estimation of Mobile Agents Under Communication Constraints Battery Level Estimation of Mobile Agents Under Communication Constraints Jonghoek Kim, Fumin Zhang, and Magnus Egerstedt Electrical and Computer Engineering, Georgia Institute of Technology, USA jkim37@gatech.edu,fumin,

More information

Chapter 2: Random Variables

Chapter 2: Random Variables ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:

More information

Lecture 16: State Space Model and Kalman Filter Bus 41910, Time Series Analysis, Mr. R. Tsay

Lecture 16: State Space Model and Kalman Filter Bus 41910, Time Series Analysis, Mr. R. Tsay Lecture 6: State Space Model and Kalman Filter Bus 490, Time Series Analysis, Mr R Tsay A state space model consists of two equations: S t+ F S t + Ge t+, () Z t HS t + ɛ t (2) where S t is a state vector

More information

Causality Countermeasures for Anomaly Detection in Cyber-Physical Systems

Causality Countermeasures for Anomaly Detection in Cyber-Physical Systems This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI.9/TAC.27.274646,

More information

RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION

RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION 1 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, SEPT. 3 6, 1, SANTANDER, SPAIN RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T

More information

Simultaneous state and input estimation with partial information on the inputs

Simultaneous state and input estimation with partial information on the inputs Loughborough University Institutional Repository Simultaneous state and input estimation with partial information on the inputs This item was submitted to Loughborough University's Institutional Repository

More information

12.4 Known Channel (Water-Filling Solution)

12.4 Known Channel (Water-Filling Solution) ECEn 665: Antennas and Propagation for Wireless Communications 54 2.4 Known Channel (Water-Filling Solution) The channel scenarios we have looed at above represent special cases for which the capacity

More information

Distributed estimation in sensor networks

Distributed estimation in sensor networks in sensor networks A. Benavoli Dpt. di Sistemi e Informatica Università di Firenze, Italy. e-mail: benavoli@dsi.unifi.it Outline 1 An introduction to 2 3 An introduction to An introduction to In recent

More information

Capacity-achieving Feedback Scheme for Flat Fading Channels with Channel State Information

Capacity-achieving Feedback Scheme for Flat Fading Channels with Channel State Information Capacity-achieving Feedback Scheme for Flat Fading Channels with Channel State Information Jialing Liu liujl@iastate.edu Sekhar Tatikonda sekhar.tatikonda@yale.edu Nicola Elia nelia@iastate.edu Dept. of

More information

Discrete-Time H Gaussian Filter

Discrete-Time H Gaussian Filter Proceedings of the 17th World Congress The International Federation of Automatic Control Discrete-Time H Gaussian Filter Ali Tahmasebi and Xiang Chen Department of Electrical and Computer Engineering,

More information

Encoder Decoder Design for Feedback Control over the Binary Symmetric Channel

Encoder Decoder Design for Feedback Control over the Binary Symmetric Channel Encoder Decoder Design for Feedback Control over the Binary Symmetric Channel Lei Bao, Mikael Skoglund and Karl Henrik Johansson School of Electrical Engineering, Royal Institute of Technology, Stockholm,

More information

Conditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation

Conditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation 1 Conditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation Long Zuo, Ruixin Niu, and Pramod K. Varshney Abstract Posterior Cramér-Rao lower bounds (PCRLBs) 1] for sequential

More information

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier Miscellaneous Regarding reading materials Reading materials will be provided as needed If no assigned reading, it means I think the material from class is sufficient Should be enough for you to do your

More information

Factor Analysis and Kalman Filtering (11/2/04)

Factor Analysis and Kalman Filtering (11/2/04) CS281A/Stat241A: Statistical Learning Theory Factor Analysis and Kalman Filtering (11/2/04) Lecturer: Michael I. Jordan Scribes: Byung-Gon Chun and Sunghoon Kim 1 Factor Analysis Factor analysis is used

More information

Coding Sensor Outputs for Injection Attacks Detection

Coding Sensor Outputs for Injection Attacks Detection 53rd IEEE Conference on Decision and Control December 15-17, 2014 Los Angeles, California, USA Coding Sensor Outputs for Injection Attacks Detection Fei Miao Quanyan Zhu Miroslav Pajic George J Pappas

More information

5. Random Vectors. probabilities. characteristic function. cross correlation, cross covariance. Gaussian random vectors. functions of random vectors

5. Random Vectors. probabilities. characteristic function. cross correlation, cross covariance. Gaussian random vectors. functions of random vectors EE401 (Semester 1) 5. Random Vectors Jitkomut Songsiri probabilities characteristic function cross correlation, cross covariance Gaussian random vectors functions of random vectors 5-1 Random vectors we

More information

NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES

NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES 2013 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES Simo Särä Aalto University, 02150 Espoo, Finland Jouni Hartiainen

More information

19. Channel coding: energy-per-bit, continuous-time channels

19. Channel coding: energy-per-bit, continuous-time channels 9. Channel coding: energy-per-bit, continuous-time channels 9. Energy per bit Consider the additive Gaussian noise channel: Y i = X i + Z i, Z i N ( 0, ). (9.) In the last lecture, we analyzed the maximum

More information

Evaluating the Consistency of Estimation

Evaluating the Consistency of Estimation Tampere University of Technology Evaluating the Consistency of Estimation Citation Ivanov, P., Ali-Löytty, S., & Piche, R. (201). Evaluating the Consistency of Estimation. In Proceedings of 201 International

More information

Gaussian random variables inr n

Gaussian random variables inr n Gaussian vectors Lecture 5 Gaussian random variables inr n One-dimensional case One-dimensional Gaussian density with mean and standard deviation (called N, ): fx x exp. Proposition If X N,, then ax b

More information

State Estimation of Linear and Nonlinear Dynamic Systems

State Estimation of Linear and Nonlinear Dynamic Systems State Estimation of Linear and Nonlinear Dynamic Systems Part II: Observability and Stability James B. Rawlings and Fernando V. Lima Department of Chemical and Biological Engineering University of Wisconsin

More information

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1 Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is

More information

Target Localization and Circumnavigation Using Bearing Measurements in 2D

Target Localization and Circumnavigation Using Bearing Measurements in 2D Target Localization and Circumnavigation Using Bearing Measurements in D Mohammad Deghat, Iman Shames, Brian D. O. Anderson and Changbin Yu Abstract This paper considers the problem of localization and

More information

ENGR352 Problem Set 02

ENGR352 Problem Set 02 engr352/engr352p02 September 13, 2018) ENGR352 Problem Set 02 Transfer function of an estimator 1. Using Eq. (1.1.4-27) from the text, find the correct value of r ss (the result given in the text is incorrect).

More information

Lecture 6: Gaussian Channels. Copyright G. Caire (Sample Lectures) 157

Lecture 6: Gaussian Channels. Copyright G. Caire (Sample Lectures) 157 Lecture 6: Gaussian Channels Copyright G. Caire (Sample Lectures) 157 Differential entropy (1) Definition 18. The (joint) differential entropy of a continuous random vector X n p X n(x) over R is: Z h(x

More information

A Matrix Theoretic Derivation of the Kalman Filter

A Matrix Theoretic Derivation of the Kalman Filter A Matrix Theoretic Derivation of the Kalman Filter 4 September 2008 Abstract This paper presents a matrix-theoretic derivation of the Kalman filter that is accessible to students with a strong grounding

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

EECS 750. Hypothesis Testing with Communication Constraints

EECS 750. Hypothesis Testing with Communication Constraints EECS 750 Hypothesis Testing with Communication Constraints Name: Dinesh Krithivasan Abstract In this report, we study a modification of the classical statistical problem of bivariate hypothesis testing.

More information

Sensor Tasking and Control

Sensor Tasking and Control Sensor Tasking and Control Sensing Networking Leonidas Guibas Stanford University Computation CS428 Sensor systems are about sensing, after all... System State Continuous and Discrete Variables The quantities

More information

Achieving Shannon Capacity Region as Secrecy Rate Region in a Multiple Access Wiretap Channel

Achieving Shannon Capacity Region as Secrecy Rate Region in a Multiple Access Wiretap Channel Achieving Shannon Capacity Region as Secrecy Rate Region in a Multiple Access Wiretap Channel Shahid Mehraj Shah and Vinod Sharma Department of Electrical Communication Engineering, Indian Institute of

More information

On the Secrecy Capacity of the Z-Interference Channel

On the Secrecy Capacity of the Z-Interference Channel On the Secrecy Capacity of the Z-Interference Channel Ronit Bustin Tel Aviv University Email: ronitbustin@post.tau.ac.il Mojtaba Vaezi Princeton University Email: mvaezi@princeton.edu Rafael F. Schaefer

More information

Statistical Filtering and Control for AI and Robotics. Part II. Linear methods for regression & Kalman filtering

Statistical Filtering and Control for AI and Robotics. Part II. Linear methods for regression & Kalman filtering Statistical Filtering and Control for AI and Robotics Part II. Linear methods for regression & Kalman filtering Riccardo Muradore 1 / 66 Outline Linear Methods for Regression Gaussian filter Stochastic

More information