THERE has been a growing interest in using switching diffusion
|
|
- Kerry Jackson
- 5 years ago
- Views:
Transcription
1 1706 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 5, MAY 2007 Two-Time-Scale Approximation for Wonham Filters Qing Zhang, Senior Member, IEEE, G. George Yin, Fellow, IEEE, Johb B. Moore, Life Fellow, IEEE Abstract This paper is concerned with approximation of Wonham filters. A focal point is that the underlying hidden Markov chain has a large state space. To reduce computational complexity, a two-time-scale approach is developed. Under time scale separation, the state space of the underlying Markov chain is divided into a number of groups such that the chain jumps rapidly within each group switches occasionally from one group to another. Such structure gives rise to a limit Wonham filter that preserves the main features of the filtering process, but has a much smaller dimension therefore is easier to compute. Using the limit filter enables us to develop efficient approximations useful filters for hidden Markov chains. The main advantage of our approach is the reduction of dimensionality. Index Terms Hidden Markov chain, two-time-scale Markov process, Wonham filter. I. INTRODUCTION THERE has been a growing interest in using switching diffusion systems for emerging applications in wireless communication, signal processing, financial engineering. Unlike the pure diffusion models used in the traditional setup, both continuous dynamics discrete events coexist in the regimeswitching models. The hybrid formulation makes the models more versatile, but the analysis becomes more challenging. A class of hybrid diffusions uses a continuous-time Markov chain to capture the discrete event features resulting in a set of diffusions modulated by the Markov chain. To carry out control optimization tasks for regime-switching diffusions under partial observations, it is desirable to extract characteristics or features of the systems based on the limited information available, which brings us to the framework of hybrid filtering. Optimal filtering of hybrid systems typically yields infinite-dimensional stochastic differential equations. Efforts have been made to find finite-dimensional approximations. Some of these approximation schemes can be simplified if the conditional probability of the Markov chain given observation over time is available. In this paper, we consider the model in which a function of the Markov chain is observed in additive white Manuscript received April 12, 2005; revised January 23, This work was supported in part by the National ICT Australia, which is funded by the Australian Government Backing Australia s Ability Initiative in part through the Australian Research Council, in part by the ARC under discovery Grants A DP , in part by the National Science Foundation. Q. Zhang is with the Department of Mathematics, Boyd GSRC, The University of Georgia, Athens, GA USA ( qingz@math.uga.edu). G. Yin is with the Department of Mathematics, Wayne State University, Detroit, MI USA ( gyin@math.wayne.edu). J. B. Moore is with the Department of Systems Engineering, Australian National University, Canberra, ACT 0200, Australia ( john.moore@anu. edu.au). Communicated by A. Høst-Madsen, Associate Editor for Detection Estimation. Digital Object Identifier /TIT noise. We focus on the conditional probability of the chain given the observation. The corresponding filter, developed in [26], is known as the Wonham filter is given by the solution of a system of stochastic differential equations. A. Wonham Filter In the literature, after the Kalman filter was developed in the 1960s, the first rigorous development of nonlinear filters for diffusion-type processes came into being; see Kushner [18]. Nonlinear filter problems soon attracted growing continued attention. In contrast to the Kalman filter, which is finite dimensional, it is well known that nonlinear filters are generally infinite dimensional. There are only a hful of finite-dimensional nonlinear filters known to exist to date. The first of such finite-dimensional filters was the Wonham filter of [26]. Owing to its importance, it has received much attention. In the new era, because of the use of hidden Markov models, filters involving jump processes have drawn resurgent attention. For example, to characterize stock price movements, one may use to represent the stock trends. Suppose that we can observe, the percentage change of the stock price represented by plus white noise, is an appropriate function. For simplicity, suppose. For example, represents an up trend with adown trend with ); see [34] for more details related literature. In manufacturing applications, one may take as the discrete dem for a product that is corrupted by Gaussian noise. In a recent paper [25], Wang, Zhang, Yin considered Kalman-type filters for the partially observed system is the continuous state variable, is a finite-state Markov chain (a discrete-event state), is the observation process; they developed a quadratic variation test near-optimal filters by examining the associated system of Riccati equations. In the current paper, we concentrate on Wonham filters, in which only noisy corrupted observations of a Markov chain are available. Thus, there are no Riccati equations we can utilize. The methods developed in [25] do not apply. To proceed, we first summarize results about the Wonham filter. Let be a continuous-time Markov chain having finite state space generator. A function of the Markov chain together with additive Gaussian noise is observed. Let denote the observation given by is a positive constant is a stard Brownian motion independent of. (1) /$ IEEE
2 ZHANG et al.: TWO-TIME-SCALE APPROXIMATION FOR WONHAM FILTERS 1707 Let be the conditional probability of given the observations up to time, i.e., for. Let. Then the Wonham filter is given by initial probability vector (2) Here henceforth, we use as an identity matrix of appropriate dimension use as a generic constant with the convention. B. Brief Review of Literature Owing to its importance, filtering problems have received much attention, various developments have been made. For example, Caines Chen [4] derived an optimal filter when it involves a rom variable but with no switching; see also Hijab [12]. Haussmann Zhang [11] used two statistical hypothesis tests, the quadratic variation test the likelihood ratio test, to estimate the value of the rom variable to choose among competing filters on successive time intervals. These results are generalized in Zhang [31] to incorporate unobservable Markov chains. Concerning nonlinear filtering of a hybrid system in discrete time, Blom Bar-Shalom [3] proposed a numerical algorithm to compute the conditional expectation of the state given observations up to time. The algorithm seems to perform well numerically. However, there is no mathematical analysis for optimality or near optimality of these filters; see Li [20] for further discussions. For related work on filtering, see Dey Moore [6] Moore Baras [22] for risk sensitive filtering; Wang, Zhang, Yin [25] Yin Dey [27] for reduction of complexity of filtering problems involving large-scale Markov chains; Zhang [33], [32] for the most probable estimates in discrete-time continuous-time models, respectively; Liu Zhang [21] for numerical experiments involving piecewise approximation of nonlinear systems; Yin, Zhang, Liu [30] for numerical methods of Wonham filters. For a survey of results on filtering, we refer the reader to the books by Anderson Moore [1] on classical linear filtering. For hidden Markov models related filtering problems, see Elliott, Aggoun, Moore [8]. For general nonlinear filtering, see Kallianpur [16] Liptser Shiryayev [15]; see also the books by Bensoussan [2] Kushner [19] for related topics on partially observed systems. The primary concern of this paper is on constructing Wonham filters for Markov chains with a large state space. Note that related results may be found in Tweedie [24] for quasi-stationary distributions of Markov processes for a general state space, Huisinga, Meyn, Schutte [13] for a spectral theory approach to approximation of a complex Markov process with a simpler one, Jerrum [14] for further discussion. When the state space of the Markov chain is large, the number of the filter equations will be large comprising a switching diffusion system with large dimension. We focus on developing good approximations of such large-dimensional filters. The main idea is to use time-scale separation hierarchy within the Markov chain to reduce the computation complexity. In applications of manufacturing (see [23, Sec. 5.9]) in system reliability (see [28, Sec. 3.2]), the state space of the Markov chain can be partitioned to a number of groups so that the Markov chain jumps rapidly within a group of states less frequently (or occasionally) among different groups. Under such a setup, due to the fast variation of the Markov chain, it is difficult to pinpoint the exact location of the Markov chain. Nevertheless, it is much easier to identify if the chain belongs to certain groups. This leads to a two-time-scale formulation involving states having weak strong interactions. C. Contributions of this Paper Our contributions in this paper include the following: 1) presentation of a two-time-scale filter formulation; 2) construction of a limit filter; 3) proof of filter convergence to the desired limit Wonham filter as the rate of fluctuations of the Markov chain goes to infinity in each group of irreducible states; 4) construction of an approximation scheme based on the limit filter that is easier to compute; 5) proof that the original filter can be approximated in a twostage procedure under different topologies, establishment of the asymptotic optimality of the approximate filter. Before proceeding further, we point out: First, the time scale separation in this paper is formulated by using a small parameter. The asymptotic results to follow require that approaches zero. However, in applications, can be a fixed constant. For example, given the magnitude of other parameters being of order, can take the value or. Mainly, the small parameter brings out the different scales of the jump rates in different states of the Markov chain. Second, in the formulation, the Markov chain has a particular structure. Since any finite-state Markov chain has at least one recurrent state, conversion to such a canonical form is always possible; see for example, [28, Sec. 3.6] references therein. D. Outline The rest of the paper is organized as follows. In the next section, we present notation needed for two-time-scale Markov chains summarize relevant results to be used in this work. In Section III, we consider limit filters two-time-scale approximations verification of these results. In Section IV, we provide a numerical example to illustrate the main results of this paper. In Section V, extension of results to Markov chains with
3 1708 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 5, MAY 2007 transient states are considered. The paper is concluded with a few remarks. II. SINGULARLY PERTURBED MARKOV CHAINS Suppose that is a continuous-time Markov chain whose generator is. We say that the Markov chain or the generator is weakly irreducible if the system of equations we obtain a process with considerably smaller state space. To be more specific, the aggregated process is defined by when (6) Note that is not necessarily Markovian. However, using certain probabilistic arguments assuming to be weakly irreducible, we have shown the following in [28, Sec. 7.5]. (a) converges weakly to, which is a continuoustime Markov chain generated by has a unique solution satisfying for. The solution (row-vector-valued function) is termed a quasi-stationary distribution. Note that the definitions were used in our work [17] [28]. They are different from the usual definitions of irreducibility stationary distribution in that we do not require all the components ; they are also different than that of [24]. A. Time Scale Separation in Markov Chains In this work, we focus on Markov chains that have large state spaces with complex structures. Suppose that the states of the underlying Markov chain are divisible to a number of weakly irreducible classes such that the Markov chain fluctuates rapidly among different states within a weakly irreducible class, but jumps less frequently from one weakly irreducible class to another. To highlight the different rates of variation, introduce a small parameter assume the generator of the Markov chain to be of the form Throughout the paper, we assume both to be generators. As a result, the Markov chain becomes an -dependent singularly perturbed Markov chain. An averaging approach requires aggregating the states in each weakly irreducible class into a single state, replacing the original complex system by its limit, an average with respect to the quasi-stationary distributions. In this the following three sections, we concentrate on the case that the underlying Markov chain has weakly irreducible classes with no transient states, which specifies the form of as Here, for each is the weakly irreducible generator corresponding to the states in, for. The state space is decomposed as Note that governs the rapidly changing part describes the slowly varying components. Lumping the states in into a single state, an aggregated process, containing states, is obtained, in which these states interact through the matrix resulting in transitions from to. Thus, by aggregation, (3) (4) (5) is the quasi-stationary distribution of is an -dimensional column vector with all components being equal to is a block-diagonal matrix with appropriate dimensions. (b) For any bounded deterministic, then is the indicator function of a set. (c) Let. Then for some. Note that for the process, the state space is given by. For complete treatment of two-time-scale Markov chains in continuous time, see the book by Yin Zhang [28]. In addition, we would like to point out that the aggregation process depends on the decomposition of in (4). Substantial reduction of dimensionality can be achieved when. B. Two-Time-Scale Wonham Filters Let be the observation given by (7) (8) (9) (10) is a positive constant is a stard Brownian motion. We assume that are independent. Let denote the conditional probability of given the observation up to time, i.e., for. Let such that Let
4 ZHANG et al.: TWO-TIME-SCALE APPROXIMATION FOR WONHAM FILTERS 1709 We next derive the equation for. First, recall (8) the convergence of. Intuitively, we have (11) Then the corresponding Wonham filter can be rewritten as with given initial condition (12) III. LIMIT FILTER AND TWO-TIME-SCALE APPROXIMATION Therefore, we expect the weak limit of to have the form A. Limit Filter Intuitively, similar to the probability distributions of two-time-scale Markov chains, as, the conditional probability in Wonham filter for should converge to a limit filter. In this section, we first derive formally the limit filter then provide a verification theorem that shows that the limit filter is indeed the limit of the original filter as in an appropriate sense. Write (12) in its integral form note the boundedness of both. It follows that for some finite for all. Therefore, we have The proof of this can be found in Wang, Zhang, Yin [25]. Recall that. In (12), multiplying from the right by sending, we obtain (13) with initial condition This implies that Moreover, note that are conditional probability measures that are uniformly bounded between.if as for some, then necessarily This implies. In view of the block-diagonal structure of, the vector must have the following form: for (14) We will show in what follows that, for each can be approximated by in a two stage procedure as. B. Two-Time-Scale Approximation Note that the noise driving the limit filter is the weak limit of. In order to use the filter in real-time applications, one needs to feed the filter by the actual observation in (13). Let denote such a filter with given by (15) later. Recall the definition of is to be determined in (7). It follows that,
5 1710 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 5, MAY 2007 Then we have the following theorem. Theorem 3.1: The following assertions hold. (a) is an approximation to for small. More precisely for some constant. (b) converges weakly to in, denotes the space of -valued continuous functions defined on. Remark 3.2: This theorem reveals that the two-stage approximation of leads to the limit with. Stage 1 approximation provides a practical way for computing using that is governed by a system of stochastic differential equations (SDEs) of much smaller dimension. Stage 2 approximation leads to a theoretical weak limit for completeness of the two-time-scale analysis. Proof of Part (a): Let Write Recall that. It follows that Let Note that (16) or in differential form (17) Right-multiplying both sides by the matrix yields Integrating both sides from to leads to In view of this relation, (11) (16) yield that Moreover, owing to (12) (15), equation: satisfies the following Note that the term is a row vector the integr is a matrix. Recall that. It is easy to check that
6 ZHANG et al.: TWO-TIME-SCALE APPROXIMATION FOR WONHAM FILTERS 1711 with defined in (14). Recall the uniform boundedness of. We can show with initial, Moreover, in view of (15) (17), we have Using these (9), we have (18) Step 1. We show that converges to weakly. Recall that in distribution. By the Skorohod representation theorem (see Ethier Kurtz [7]), there exists a probability space processes such that for some constant. Using Cauchy Schwarz inequality noting,wehave (19) Moreover, recall that. It follows that almost surely (a.s.) in,. Let be a probability space upon which is a stard Brownian motion. Then, on the product space a.s. in Step 2. We show that for each,as. Let. Then. Moreover, in view of (15) (21) by reordering terms, we have (20) Let. It follows from (18) (20) that for some positive constants. Finally, the Gronwall s inequality (see [10, p. 36]) implies that. Write i.e., This proves Part (a). Proof of Part (b): The proof for Part (b) is divided into two steps. First, we introduce an intermediate process defined by It is easy to see that (21)
7 1712 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 5, MAY 2007 for some constant. This implies that In view of the Gronwall s inequality, it suffices to show. Let Then (8) implies, as. For a diffusion with bounded, let Then, using integration by parts, we have Finally, noting both have continuous sample paths a.s., the convergence, in fact, takes place on the space. Remark 3.3: The conditional probability vector does not converge in a neighborhood (of size )of due to an initial layer with thickness near the origin. Note that need not be the same as approaches for away from the initial layer. These observations are summarized in the next corollary. Corollary 3.4: The following assertions hold. (a). (b) For any. (c) For each in distribution. Proof: Parts (a) (b) are immediate from Theorem 3.1. To see Part (c), note that for all, wehave It follows that Take write IV. A NUMERICAL EXAMPLE In this section, we consider a simple example involving a four-state Markov chain. Let de- to obtain. Step 3. Finally, it is easy to show that the process fined in (15) satisfies the following conditions: The corresponding state space is for each for all (22) In this case (23) denotes the conditional expectation given. Using the tightness criterion [19, p. 47], it is easy to see that is tight. To complete the proof, it suffices to show the weak convergence of finite-dimensional distributions. To this end, note that following Steps 1 2, we have, for any (the space of functions whose second derivatives are bounded) The corresponding quasi-stationary distributions (in this case, also stationary distributions) are given by as solutions to. Note that the stationary distributions depend only on the block matrices in. Let denote the conditional probability vector its approximation by.define the norm In this example, we take for any constants. This implies converges to.
8 ZHANG et al.: TWO-TIME-SCALE APPROXIMATION FOR WONHAM FILTERS 1713 Fig. 1. Sample paths of (t); p (t); ~p (t) 0 p (t) with " =0:05. the discretization step size. A sample path of (with ) the corresponding conditional probabilities are given in the first five rows in Fig. 1. In Fig. 1, the states are labeled as. The differences between are plotted in the last four rows. As can be seen in Fig. 1, stays in group from to, jumps to group at, goes back to at, then to, finally ls in from to. The approximation filter tracks the corresponding conditional probabilities pretty well on these time intervals. TABLE I DEMONSTRATION OF ERROR BOUNDS In addition, we vary run 1000 samples for each. The results are recorded in Table I. As can be seen in Table I, the differences between the exact conditional probabilities their approximations are fairly small. The result validates the effectiveness of our approach in this simple example.
9 1714 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 5, MAY 2007 V. INCLUSION OF TRANSIENT STATES In the previous sections, we have concentrated on the case that the underlying Markov chain consists of weakly irreducible classes only. This section takes up the issue that the underlying Markov chain contains weakly irreducible classes as well as transient states. In this case, the state space is partitioned as (24) is the collection of the transient states, the generator is still of the form (3), but Write Define (28)... (25) To distinguish the transient states with that of the states in weakly irreducible classes, we use as an index for the transient states. We assume that is asymptotically stable, i.e., all of its eigenvalues belong to the left half of the complex plane. To proceed, define We proved in [29, Theorem 4.3] that converges weakly to, a continuous-time Markov chain generated by given in (28). We also obtained similar mean-squares estimates for the occupation measures as in the previous case. In fact for for Moreover, let. Then... (26) Define as follows: is an zero matrix, Let be a rom variable uniformly distributed on that is independent of. For each, define an integer-valued rom variable by We proceed to define the aggregated process, in which the aggregation is only taken over each weakly irreducible class. Define Using the partition if if for (27) with initial condition Similarly, define as above with replaced by. We can prove the following results similarly to the proof of Theorem 3.1. Theorem 5.1: Let. Then, we have (a), for some ; (b) converges to weakly on. VI. CONCLUDING REMARKS In this paper, we have developed approximate Wonham filters under the framework of two-time-scale Markov chains. The
10 ZHANG et al.: TWO-TIME-SCALE APPROXIMATION FOR WONHAM FILTERS 1715 advantage of this approach is the reduction of dimensionality. Our approach leads to a limit filter that is close to the original Wonham filter but of much smaller dimension. Such a filtering scheme is desirable in state estimation involving Markov chains with a large number of states such as in production planning of stochastic manufacturing systems. Recently, there has been resurgent interest in constructing robust filters inspired by the work of Clark [5]. In Elliott, Malcolm, Moore [9], unnormalized densities are considered. It will be interesting to see if the two-time-scale approach can be used to treat such problems. Nevertheless, care must be taken. Specifically, in such a setup, the counterpart of satisfies an ordinary differential equation; it is not bounded. More thoughts work are required for this. ACKNOWLEDGMENT The authors are very grateful to the referees the editors for many valuable comments suggestions, which led to improvements of the paper. REFERENCES [1] B. D. O. Anderson J. B. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice-Hall, [2] A. Bensoussan, Stochastic Control of Partially Observed Systems. Cambridge, U.K.: Cambridge Univ. Press, [3] H. A. P. Blom Y. Bar-Shalom, The interacting multiple model algorithm for systems with markovian switching coefficients, IEEE Trans. Automat. Control, vol. 33, no. 8, pp , Aug [4] P. E. Caines H. F. Chen, Optimal adaptive LQG control for systems with finite state process parameters, IEEE, Trans. Automat. Control, vol. AC-30, no. 2, pp , Feb [5] J. M. Clark, The design of robust approximation to the stochastic differential equation for nonlinear filtering, in Communications Systems Rom Process Theory, J. K. Skwirzynski, Ed. Alphen aan den Rijn, The Netherls: Sijthoff Nordhoof, 1978, pp [6] S. Dey J. B. Moore, Risk-sensitive filtering smoothing for hidden Markov models, Syst. Control Lett., vol. 25, no. 5, pp , [7] S. N. Ethier T. G. Kurtz, Markov Processes: Characterization Convergence. New York: Wiley, [8] R. J. Elliott, L. Aggoun, J. B. Moore, Hidden Markov Models: Estimation Control. New York, NY: Springer-Verlage, [9] R. J. Elliott, W. P. Malcolm, J. B. Moore, Robust control of a partially observed Markov chain, working paper. [10] J. Hale, Ordinary Differential Equations, 2nd ed. Malabar, FL: Krieger, [11] U. G. Haussmann Q. Zhang, Stochastic adaptive control with small observation noise, Stochastics Stochastics Rep., vol. 32, pp , [12] O. Hijab, The adaptive LQG problem-part I, IEEE, Trans. Automat. Control, vol. AC-28, no. 2, pp , Feb [13] W. Huisinga, S. P. Meyn, C. Schutte, Phase transitions metastability in markovian molecular systems, Ann. Appl. Probab., vol. 14, pp , [14] M. Jerrum, On the Approximation of One Markov Chain by Another, School of Informatics, Univ. Edinburgh. Edinburgh, U.K., Working paper, [15] R. S. Lipster A. N. Shiryayev, Statistics of Rom Processes. New York: Springer-Verlag, 1977, two volumes. [16] G. Kallianpur, Stochastic Filtering Theory. New York: Springer- Verlag, [17] R. Z. Khasminskii, G. Yin, Q. Zhang, Asymptotic expansions of singularly perturbed systems involving rapidly fluctuating Markov chains, SIAM J. Appl. Math., vol. 56, pp , [18] H. J. Kushner, On the differential equations satisfied by conditional probability densities of Markov processes with applications, SIAM J. Control, vol. 2, pp , [19] H. J. Kushner, Approximation Weak Convergence Methods for Rom Processes With Applications to Stochastic Systems Theory. Cambridge, MA: MIT Press, [20] X. R. Li,, C. T. Leondes, Ed., Hybrid Estimation Techniques, in Control Dynamic Systems. San Diego, CA: Academic, 1996, vol. 76. [21] R. H. Liu Q. Zhang, Nonlinear filtering: A hybrid approximation scheme, IEEE Trans. Aerosp. Electron. Syst., vol. 37, no. 2, pp , Apr [22] J. B. Moore J. S. Baras, Finite-dimensional optimal controllers for nonlinear plants, Syst. Control Lett., vol. 26, pp , [23] S. P. Sethi Q. Zhang, Hierarchical Decision Making in Stochastic Manufacturing Systems, ser. Systems & Control: Foundations & Applications. Boston, MA: Birkhäuser, [24] R. L. Tweedie, Quasi-stationary distributions for Markov chains on a general state space, J. Appl. Probab., vol. 11, pp , [25] J. W. Wang, Q. Zhang, G. Yin, Two-time-scale hybrid filters: Near optimality, SIAM J. Control Optim., vol. 45, pp , [26] W. M. Wonham, Some applications of stochastic differential equations to optimal nonlinear filtering, SIAM J. Control, vol. 2, pp , [27] G. Yin S. Dey, Weak convergence of hybrid filtering problems involving nearly completely decomposable hidden Markov chains, SIAM J. Control Optim., vol. 41, pp , [28] G. Yin Q. Zhang, Continuous-Time Markov Chains Applications: A Singular Perturbation Approach. New York: Springer-Verlag, [29] G. Yin, Q. Zhang, G. Badowski, Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states, Ann. Appl. Probab., vol. 10, pp , [30] G. Yin, Q. Zhang, Y. J. Liu, Discrete-time approximation of wonham filters, J. Control Theory Applic., vol. 2, pp. 1 10, [31] Q. Zhang, Nonlinear filtering control of a switching diffusion with small observation noise, SIAM J. Control Optim., vol. 36, pp , [32] Q. Zhang, Optimal filtering of discrete-time hybrid systems, J. Optim. Theory Applic., vol. 100, pp , [33] Q. Zhang, Hybrid filtering for linear systems with non-gaussian disturbances, IEEE Trans. Automat. Control, vol. 45, no. 1, pp , Jan [34] Q. Zhang G. Yin, Nearly optimal asset allocation in hybrid stock-investment models, J. Optim. Theory Applic., vol. 121, pp , 2004.
Two-Time-Scale Wonham Filters
Proceedings of the 46th IEEE Conference on Decision and Control New Orleans, LA, USA, Dec. -4, 7 Two-Time-Scale Wonham Filters Q. Zhang, G. Yin, and J.B. Moore Abstract This paper is concerned with a two-time-scale
More informationCONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Stochastic Stability - H.J. Kushner
STOCHASTIC STABILITY H.J. Kushner Applied Mathematics, Brown University, Providence, RI, USA. Keywords: stability, stochastic stability, random perturbations, Markov systems, robustness, perturbed systems,
More informationLeast Mean Square Algorithms With Markov Regime-Switching Limit
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 50, NO. 5, MAY 2005 577 Least Mean Square Algorithms With Markov Regime-Switching Limit G. George Yin, Fellow, IEEE, and Vikram Krishnamurthy, Fellow, IEEE
More informationLyapunov Stability of Linear Predictor Feedback for Distributed Input Delays
IEEE TRANSACTIONS ON AUTOMATIC CONTROL VOL. 56 NO. 3 MARCH 2011 655 Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays Nikolaos Bekiaris-Liberis Miroslav Krstic In this case system
More informationA Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing
IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 12, NO. 5, SEPTEMBER 2001 1215 A Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing Da-Zheng Feng, Zheng Bao, Xian-Da Zhang
More informationAn application of hidden Markov models to asset allocation problems
Finance Stochast. 1, 229 238 (1997) c Springer-Verlag 1997 An application of hidden Markov models to asset allocation problems Robert J. Elliott 1, John van der Hoek 2 1 Department of Mathematical Sciences,
More informationRisk-Sensitive Filtering and Smoothing via Reference Probability Methods
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 42, NO. 11, NOVEMBER 1997 1587 [5] M. A. Dahleh and J. B. Pearson, Minimization of a regulated response to a fixed input, IEEE Trans. Automat. Contr., vol.
More informationRiccati difference equations to non linear extended Kalman filter constraints
International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R
More informationFixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 54, NO. 4, APRIL 2006 1421 Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities Junlin Xiong and James Lam,
More information1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner), Second Revised Edition, Springer-Verlag, New York, 2001.
Paul Dupuis Professor of Applied Mathematics Division of Applied Mathematics Brown University Publications Books: 1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner),
More informationIN THIS PAPER, we consider a class of continuous-time recurrent
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 51, NO. 4, APRIL 2004 161 Global Output Convergence of a Class of Continuous-Time Recurrent Neural Networks With Time-Varying Thresholds
More information798 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 44, NO. 10, OCTOBER 1997
798 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 44, NO 10, OCTOBER 1997 Stochastic Analysis of the Modulator Differential Pulse Code Modulator Rajesh Sharma,
More informationAuxiliary signal design for failure detection in uncertain systems
Auxiliary signal design for failure detection in uncertain systems R. Nikoukhah, S. L. Campbell and F. Delebecque Abstract An auxiliary signal is an input signal that enhances the identifiability of a
More informationArticle (peer-reviewed)
Title Author(s) Influence of noise intensity on the spectrum of an oscillator Swain, Rabi Sankar; Gleeson, James P.; Kennedy, Michael Peter Publication date 2005-11 Original citation Type of publication
More informationMean-variance Portfolio Selection under Markov Regime: Discrete-time Models and Continuous-time Limits
Mean-variance Portfolio Selection under Marov Regime: Discrete-time Models and Continuous-time Limits G. Yin X. Y. Zhou Dept. of Mathematics Dept. Systems Eng. & Eng. Management Wayne State University
More informationRisk-Sensitive Control with HARA Utility
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 46, NO. 4, APRIL 2001 563 Risk-Sensitive Control with HARA Utility Andrew E. B. Lim Xun Yu Zhou, Senior Member, IEEE Abstract In this paper, a control methodology
More informationAlmost Sure Convergence of Two Time-Scale Stochastic Approximation Algorithms
Almost Sure Convergence of Two Time-Scale Stochastic Approximation Algorithms Vladislav B. Tadić Abstract The almost sure convergence of two time-scale stochastic approximation algorithms is analyzed under
More informationA Generalized Uncertainty Principle and Sparse Representation in Pairs of Bases
2558 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 48, NO 9, SEPTEMBER 2002 A Generalized Uncertainty Principle Sparse Representation in Pairs of Bases Michael Elad Alfred M Bruckstein Abstract An elementary
More informationH State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions
IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL 11, NO 2, APRIL 2003 271 H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions Doo Jin Choi and PooGyeon
More informationComments and Corrections
1386 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 59, NO 5, MAY 2014 Comments and Corrections Corrections to Stochastic Barbalat s Lemma and Its Applications Xin Yu and Zhaojing Wu Abstract The proof of
More informationA Complete Stability Analysis of Planar Discrete-Time Linear Systems Under Saturation
710 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL 48, NO 6, JUNE 2001 A Complete Stability Analysis of Planar Discrete-Time Linear Systems Under Saturation Tingshu
More informationThe Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems
668 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 49, NO 10, OCTOBER 2002 The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems Lei Zhang, Quan
More informationFilter Design for Linear Time Delay Systems
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 49, NO. 11, NOVEMBER 2001 2839 ANewH Filter Design for Linear Time Delay Systems E. Fridman Uri Shaked, Fellow, IEEE Abstract A new delay-dependent filtering
More informationIN neural-network training, the most well-known online
IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 1, JANUARY 1999 161 On the Kalman Filtering Method in Neural-Network Training and Pruning John Sum, Chi-sing Leung, Gilbert H. Young, and Wing-kay Kan
More informationDelay-dependent Stability Analysis for Markovian Jump Systems with Interval Time-varying-delays
International Journal of Automation and Computing 7(2), May 2010, 224-229 DOI: 10.1007/s11633-010-0224-2 Delay-dependent Stability Analysis for Markovian Jump Systems with Interval Time-varying-delays
More informationApplied Mathematics Letters. Stationary distribution, ergodicity and extinction of a stochastic generalized logistic system
Applied Mathematics Letters 5 (1) 198 1985 Contents lists available at SciVerse ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml Stationary distribution, ergodicity
More informationDATA receivers for digital transmission and storage systems
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 52, NO. 10, OCTOBER 2005 621 Effect of Loop Delay on Phase Margin of First-Order Second-Order Control Loops Jan W. M. Bergmans, Senior
More informationTHE information capacity is one of the most important
256 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 44, NO. 1, JANUARY 1998 Capacity of Two-Layer Feedforward Neural Networks with Binary Weights Chuanyi Ji, Member, IEEE, Demetri Psaltis, Senior Member,
More informationI R TECHNICAL RESEARCH REPORT. Risk-Sensitive Probability for Markov Chains. by Vahid R. Ramezani and Steven I. Marcus TR
TECHNICAL RESEARCH REPORT Risk-Sensitive Probability for Markov Chains by Vahid R. Ramezani and Steven I. Marcus TR 2002-46 I R INSTITUTE FOR SYSTEMS RESEARCH ISR develops, applies and teaches advanced
More informationOperations Research Letters. Instability of FIFO in a simple queueing system with arbitrarily low loads
Operations Research Letters 37 (2009) 312 316 Contents lists available at ScienceDirect Operations Research Letters journal homepage: www.elsevier.com/locate/orl Instability of FIFO in a simple queueing
More informationHOPFIELD neural networks (HNNs) are a class of nonlinear
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 52, NO. 4, APRIL 2005 213 Stochastic Noise Process Enhancement of Hopfield Neural Networks Vladimir Pavlović, Member, IEEE, Dan Schonfeld,
More informationNonstationary Invariant Distributions and the Hydrodynamics-Style Generalization of the Kolmogorov-Forward/Fokker Planck Equation
Accepted by Appl. Math. Lett. in 2004 1 Nonstationary Invariant Distributions and the Hydrodynamics-Style Generalization of the Kolmogorov-Forward/Fokker Planck Equation Laboratory of Physical Electronics
More informationPrediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate
www.scichina.com info.scichina.com www.springerlin.com Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate WEI Chen & CHEN ZongJi School of Automation
More informationASYMPTOTIC STABILITY IN THE DISTRIBUTION OF NONLINEAR STOCHASTIC SYSTEMS WITH SEMI-MARKOVIAN SWITCHING
ANZIAM J. 49(2007), 231 241 ASYMPTOTIC STABILITY IN THE DISTRIBUTION OF NONLINEAR STOCHASTIC SYSTEMS WITH SEMI-MARKOVIAN SWITCHING ZHENTING HOU 1, HAILING DONG 1 and PENG SHI 2 (Received March 17, 2007;
More informationPopulation Games and Evolutionary Dynamics
Population Games and Evolutionary Dynamics William H. Sandholm The MIT Press Cambridge, Massachusetts London, England in Brief Series Foreword Preface xvii xix 1 Introduction 1 1 Population Games 2 Population
More informationStationary distribution and pathwise estimation of n-species mutualism system with stochastic perturbation
Available online at www.tjnsa.com J. Nonlinear Sci. Appl. 9 6), 936 93 Research Article Stationary distribution and pathwise estimation of n-species mutualism system with stochastic perturbation Weiwei
More informationMANY papers and books are devoted to modeling fading
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 16, NO. 9, DECEMBER 1998 1809 Hidden Markov Modeling of Flat Fading Channels William Turin, Senior Member, IEEE, Robert van Nobelen Abstract Hidden
More informationNonlinear Filtering Revisited: a Spectral Approach, II
Nonlinear Filtering Revisited: a Spectral Approach, II Sergey V. Lototsky Center for Applied Mathematical Sciences University of Southern California Los Angeles, CA 90089-3 sergey@cams-00.usc.edu Remijigus
More informationTHE problem of phase noise and its influence on oscillators
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 54, NO. 5, MAY 2007 435 Phase Diffusion Coefficient for Oscillators Perturbed by Colored Noise Fergal O Doherty and James P. Gleeson Abstract
More informationR, 1 i 1,i 2,...,i m n.
SIAM J. MATRIX ANAL. APPL. Vol. 31 No. 3 pp. 1090 1099 c 2009 Society for Industrial and Applied Mathematics FINDING THE LARGEST EIGENVALUE OF A NONNEGATIVE TENSOR MICHAEL NG LIQUN QI AND GUANGLU ZHOU
More informationProduction Capacity Modeling of Alternative, Nonidentical, Flexible Machines
The International Journal of Flexible Manufacturing Systems, 14, 345 359, 2002 c 2002 Kluwer Academic Publishers Manufactured in The Netherlands Production Capacity Modeling of Alternative, Nonidentical,
More informationSliding Modes in Control and Optimization
Vadim I. Utkin Sliding Modes in Control and Optimization With 24 Figures Springer-Verlag Berlin Heidelberg New York London Paris Tokyo Hong Kong Barcelona Budapest Contents Parti. Mathematical Tools 1
More informationN.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a
WHEN IS A MAP POISSON N.G.Bean, D.A.Green and P.G.Taylor Department of Applied Mathematics University of Adelaide Adelaide 55 Abstract In a recent paper, Olivier and Walrand (994) claimed that the departure
More informationResearch Article Existence and Uniqueness Theorem for Stochastic Differential Equations with Self-Exciting Switching
Discrete Dynamics in Nature and Society Volume 211, Article ID 549651, 12 pages doi:1.1155/211/549651 Research Article Existence and Uniqueness Theorem for Stochastic Differential Equations with Self-Exciting
More informationThe likelihood for a state space model
Biometrika (1988), 75, 1, pp. 165-9 Printed in Great Britain The likelihood for a state space model BY PIET DE JONG Faculty of Commerce and Business Administration, University of British Columbia, Vancouver,
More informationMaximum Process Problems in Optimal Control Theory
J. Appl. Math. Stochastic Anal. Vol. 25, No., 25, (77-88) Research Report No. 423, 2, Dept. Theoret. Statist. Aarhus (2 pp) Maximum Process Problems in Optimal Control Theory GORAN PESKIR 3 Given a standard
More informationTHE aim of this paper is to prove a rate of convergence
894 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 44, NO. 5, MAY 1999 Convergence Rate of Moments in Stochastic Approximation with Simultaneous Perturbation Gradient Approximation Resetting László Gerencsér
More informationAPPROXIMATE SOLUTION OF A SYSTEM OF LINEAR EQUATIONS WITH RANDOM PERTURBATIONS
APPROXIMATE SOLUTION OF A SYSTEM OF LINEAR EQUATIONS WITH RANDOM PERTURBATIONS P. Date paresh.date@brunel.ac.uk Center for Analysis of Risk and Optimisation Modelling Applications, Department of Mathematical
More informationGaussian Filters for Nonlinear Filtering Problems
910 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 45, NO. 5, MAY 2000 Gaussian Filters for Nonlinear Filtering Problems Kazufumi Ito Kaiqi Xiong Abstract In this paper we develop analyze real-time accurate
More informationTime Series Prediction by Kalman Smoother with Cross-Validated Noise Density
Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Simo Särkkä E-mail: simo.sarkka@hut.fi Aki Vehtari E-mail: aki.vehtari@hut.fi Jouko Lampinen E-mail: jouko.lampinen@hut.fi Abstract
More informationWE CONSIDER linear systems subject to input saturation
440 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 48, NO 3, MARCH 2003 Composite Quadratic Lyapunov Functions for Constrained Control Systems Tingshu Hu, Senior Member, IEEE, Zongli Lin, Senior Member, IEEE
More informationOptimum Sampling Vectors for Wiener Filter Noise Reduction
58 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 1, JANUARY 2002 Optimum Sampling Vectors for Wiener Filter Noise Reduction Yukihiko Yamashita, Member, IEEE Absact Sampling is a very important and
More informationExpressions for the covariance matrix of covariance data
Expressions for the covariance matrix of covariance data Torsten Söderström Division of Systems and Control, Department of Information Technology, Uppsala University, P O Box 337, SE-7505 Uppsala, Sweden
More informationStochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions
International Journal of Control Vol. 00, No. 00, January 2007, 1 10 Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions I-JENG WANG and JAMES C.
More informationS. Lototsky and B.L. Rozovskii Center for Applied Mathematical Sciences University of Southern California, Los Angeles, CA
RECURSIVE MULTIPLE WIENER INTEGRAL EXPANSION FOR NONLINEAR FILTERING OF DIFFUSION PROCESSES Published in: J. A. Goldstein, N. E. Gretsky, and J. J. Uhl (editors), Stochastic Processes and Functional Analysis,
More informationThe Rationale for Second Level Adaptation
The Rationale for Second Level Adaptation Kumpati S. Narendra, Yu Wang and Wei Chen Center for Systems Science, Yale University arxiv:1510.04989v1 [cs.sy] 16 Oct 2015 Abstract Recently, a new approach
More informationStabilization and Controllability for the Transmission Wave Equation
1900 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 46, NO. 12, DECEMBER 2001 Stabilization Controllability for the Transmission Wave Equation Weijiu Liu Abstract In this paper, we address the problem of
More informationAQUANTIZER is a device that converts a real-valued
830 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 57, NO 4, APRIL 2012 Input to State Stabilizing Controller for Systems With Coarse Quantization Yoav Sharon, Member, IEEE, Daniel Liberzon, Senior Member,
More informationCountable state discrete time Markov Chains
Countable state discrete time Markov Chains Tuesday, March 18, 2014 2:12 PM Readings: Lawler Ch. 2 Karlin & Taylor Chs. 2 & 3 Resnick Ch. 1 Countably infinite state spaces are of practical utility in situations
More informationHIDDEN MARKOV CHANGE POINT ESTIMATION
Communications on Stochastic Analysis Vol. 9, No. 3 (2015 367-374 Serials Publications www.serialspublications.com HIDDEN MARKOV CHANGE POINT ESTIMATION ROBERT J. ELLIOTT* AND SEBASTIAN ELLIOTT Abstract.
More informationTIME-SCALE SEPARATION AND STATE AGGREGATION IN SINGULARLY PERTURBED SWITCHING DIFFUSIONS*
TIME-SCALE SEPARATION AND STATE AGGREGATION IN SINGULARLY PERTURBED SWITCHING DIFFUSIONS* G. Yin and M. Kniazeva Department of Mathematics Wayne State University Detroit, Ml 48202 gyin, maria
More informationAn Adaptive LQG Combined With the MRAS Based LFFC for Motion Control Systems
Journal of Automation Control Engineering Vol 3 No 2 April 2015 An Adaptive LQG Combined With the MRAS Based LFFC for Motion Control Systems Nguyen Duy Cuong Nguyen Van Lanh Gia Thi Dinh Electronics Faculty
More informationIEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 53, NO. 7, AUGUST /$ IEEE
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 53, NO 7, AUGUST 2008 1643 Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems Tao Li, Student Member, IEEE, and
More informationAn Efficient Approach to Multivariate Nakagami-m Distribution Using Green s Matrix Approximation
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL 2, NO 5, SEPTEMBER 2003 883 An Efficient Approach to Multivariate Nakagami-m Distribution Using Green s Matrix Approximation George K Karagiannidis, Member,
More informationA NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1
A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,
More informationOptimal Decentralized Control of Coupled Subsystems With Control Sharing
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 9, SEPTEMBER 2013 2377 Optimal Decentralized Control of Coupled Subsystems With Control Sharing Aditya Mahajan, Member, IEEE Abstract Subsystems that
More informationCONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström
PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,
More informationSemi-Markov Decision Problems and Performance Sensitivity Analysis
758 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 5, MAY 2003 Semi-Markov Decision Problems Performance Sensitivity Analysis Xi-Ren Cao, Fellow, IEEE Abstract Recent research indicates that Markov
More informationThe Skorokhod reflection problem for functions with discontinuities (contractive case)
The Skorokhod reflection problem for functions with discontinuities (contractive case) TAKIS KONSTANTOPOULOS Univ. of Texas at Austin Revised March 1999 Abstract Basic properties of the Skorokhod reflection
More informationOn Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes
On Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes Eugene A. Feinberg Department of Applied Mathematics and Statistics State University of New York at Stony Brook
More informationWE EXAMINE the problem of controlling a fixed linear
596 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 43, NO 5, MAY 1998 Controller Switching Based on Output Prediction Errors Judith Hocherman-Frommer, Member, IEEE, Sanjeev R Kulkarni, Senior Member, IEEE,
More informationH -Optimal Control and Related Minimax Design Problems
Tamer Başar Pierre Bernhard H -Optimal Control and Related Minimax Design Problems A Dynamic Game Approach Second Edition 1995 Birkhäuser Boston Basel Berlin Contents Preface v 1 A General Introduction
More informationHierarchically Consistent Control Systems
1144 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 45, NO. 6, JUNE 2000 Hierarchically Consistent Control Systems George J. Pappas, Member, IEEE, Gerardo Lafferriere, Shankar Sastry, Fellow, IEEE Abstract
More informationChapter 2 Event-Triggered Sampling
Chapter Event-Triggered Sampling In this chapter, some general ideas and basic results on event-triggered sampling are introduced. The process considered is described by a first-order stochastic differential
More informationA Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models
A Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models Jeff A. Bilmes (bilmes@cs.berkeley.edu) International Computer Science Institute
More informationIEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 5, MAY invertible, that is (1) In this way, on, and on, system (3) becomes
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 5, MAY 2013 1269 Sliding Mode and Active Disturbance Rejection Control to Stabilization of One-Dimensional Anti-Stable Wave Equations Subject to Disturbance
More informationDesign and Stability Analysis of Single-Input Fuzzy Logic Controller
IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART B: CYBERNETICS, VOL. 30, NO. 2, APRIL 2000 303 Design and Stability Analysis of Single-Input Fuzzy Logic Controller Byung-Jae Choi, Seong-Woo Kwak,
More informationIN THIS paper we investigate the diagnosability of stochastic
476 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 50, NO 4, APRIL 2005 Diagnosability of Stochastic Discrete-Event Systems David Thorsley and Demosthenis Teneketzis, Fellow, IEEE Abstract We investigate
More informationAdaptive Control of a Class of Nonlinear Systems with Nonlinearly Parameterized Fuzzy Approximators
IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL. 9, NO. 2, APRIL 2001 315 Adaptive Control of a Class of Nonlinear Systems with Nonlinearly Parameterized Fuzzy Approximators Hugang Han, Chun-Yi Su, Yury Stepanenko
More informationConditions for Suboptimal Filter Stability in SLAM
Conditions for Suboptimal Filter Stability in SLAM Teresa Vidal-Calleja, Juan Andrade-Cetto and Alberto Sanfeliu Institut de Robòtica i Informàtica Industrial, UPC-CSIC Llorens Artigas -, Barcelona, Spain
More informationTHIS paper deals with robust control in the setup associated
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 50, NO 10, OCTOBER 2005 1501 Control-Oriented Model Validation and Errors Quantification in the `1 Setup V F Sokolov Abstract A priori information required for
More informationLecture Note 2: Estimation and Information Theory
Univ. of Michigan - NAME 568/EECS 568/ROB 530 Winter 2018 Lecture Note 2: Estimation and Information Theory Lecturer: Maani Ghaffari Jadidi Date: April 6, 2018 2.1 Estimation A static estimation problem
More informationVolume 30, Issue 3. A note on Kalman filter approach to solution of rational expectations models
Volume 30, Issue 3 A note on Kalman filter approach to solution of rational expectations models Marco Maria Sorge BGSE, University of Bonn Abstract In this note, a class of nonlinear dynamic models under
More informationIEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 11, NOVEMBER On the Performance of Sparse Recovery
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 11, NOVEMBER 2011 7255 On the Performance of Sparse Recovery Via `p-minimization (0 p 1) Meng Wang, Student Member, IEEE, Weiyu Xu, and Ao Tang, Senior
More informationLinear-Quadratic Optimal Control: Full-State Feedback
Chapter 4 Linear-Quadratic Optimal Control: Full-State Feedback 1 Linear quadratic optimization is a basic method for designing controllers for linear (and often nonlinear) dynamical systems and is actually
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationWE study the capacity of peak-power limited, single-antenna,
1158 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 3, MARCH 2010 Gaussian Fading Is the Worst Fading Tobias Koch, Member, IEEE, and Amos Lapidoth, Fellow, IEEE Abstract The capacity of peak-power
More informationAdditive functionals of infinite-variance moving averages. Wei Biao Wu The University of Chicago TECHNICAL REPORT NO. 535
Additive functionals of infinite-variance moving averages Wei Biao Wu The University of Chicago TECHNICAL REPORT NO. 535 Departments of Statistics The University of Chicago Chicago, Illinois 60637 June
More informationEstimation Error Bounds for Frame Denoising
Estimation Error Bounds for Frame Denoising Alyson K. Fletcher and Kannan Ramchandran {alyson,kannanr}@eecs.berkeley.edu Berkeley Audio-Visual Signal Processing and Communication Systems group Department
More information6196 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 9, SEPTEMBER 2011
6196 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 9, SEPTEMBER 2011 On the Structure of Real-Time Encoding and Decoding Functions in a Multiterminal Communication System Ashutosh Nayyar, Student
More informationNonlinear Discrete-Time Observer Design with Linearizable Error Dynamics
622 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 4, APRIL 2003 Nonlinear Discrete-Time Observer Design with Linearizable Error Dynamics MingQing Xiao, Nikolaos Kazantzis, Costas Kravaris, Arthur
More informationA Statistical Analysis of Fukunaga Koontz Transform
1 A Statistical Analysis of Fukunaga Koontz Transform Xiaoming Huo Dr. Xiaoming Huo is an assistant professor at the School of Industrial and System Engineering of the Georgia Institute of Technology,
More informationDiscrete-Time H Gaussian Filter
Proceedings of the 17th World Congress The International Federation of Automatic Control Discrete-Time H Gaussian Filter Ali Tahmasebi and Xiang Chen Department of Electrical and Computer Engineering,
More informationAnother algorithm for nonnegative matrices
Linear Algebra and its Applications 365 (2003) 3 12 www.elsevier.com/locate/laa Another algorithm for nonnegative matrices Manfred J. Bauch University of Bayreuth, Institute of Mathematics, D-95440 Bayreuth,
More informationASIGNIFICANT research effort has been devoted to the. Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 42, NO 6, JUNE 1997 771 Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach Xiangbo Feng, Kenneth A Loparo, Senior Member, IEEE,
More informationThe Solvability Conditions for the Inverse Eigenvalue Problem of Hermitian and Generalized Skew-Hamiltonian Matrices and Its Approximation
The Solvability Conditions for the Inverse Eigenvalue Problem of Hermitian and Generalized Skew-Hamiltonian Matrices and Its Approximation Zheng-jian Bai Abstract In this paper, we first consider the inverse
More informationAdam Caromicoli. Alan S. Willsky 1. Stanley B. Gershwin 2. Abstract
December 1987 LIDS-P-1727 MULTIPLE TIME SCALE ANALYSIS OF MANUFACTURING SYSTEMS Adam Caromicoli Alan S. Willsky 1 Stanley B. Gershwin 2 Abstract In this paper we use results on the aggregation of singularly
More informationSequential Monte Carlo methods for filtering of unobservable components of multidimensional diffusion Markov processes
Sequential Monte Carlo methods for filtering of unobservable components of multidimensional diffusion Markov processes Ellida M. Khazen * 13395 Coppermine Rd. Apartment 410 Herndon VA 20171 USA Abstract
More informationAn Invariance Property of the Generalized Likelihood Ratio Test
352 IEEE SIGNAL PROCESSING LETTERS, VOL. 10, NO. 12, DECEMBER 2003 An Invariance Property of the Generalized Likelihood Ratio Test Steven M. Kay, Fellow, IEEE, and Joseph R. Gabriel, Member, IEEE Abstract
More informationNetworked Sensing, Estimation and Control Systems
Networked Sensing, Estimation and Control Systems Vijay Gupta University of Notre Dame Richard M. Murray California Institute of echnology Ling Shi Hong Kong University of Science and echnology Bruno Sinopoli
More information