SUB-OPTIMAL RISK-SENSITIVE FILTERING FOR THIRD DEGREE POLYNOMIAL STOCHASTIC SYSTEMS
|
|
- Louise Sparks
- 5 years ago
- Views:
Transcription
1 ICIC Express Letters ICIC International c 2008 ISSN X Volume 2, Number 4, December 2008 pp SUB-OPTIMAL RISK-SENSITIVE FILTERING FOR THIRD DEGREE POLYNOMIAL STOCHASTIC SYSTEMS Ma. Aracelia Alcorta-G., Michael Basin Juan J. Maldonado O., Sonia G. Anguiano R. Department of Physical and Mathematical Sciences Autonomous University of Nuevo Leon Cd. Universitaria, San Nicolas de los Garza, Nuevo Leon, 66450, Mexico { aalcorta; mbasin }@fcfm.uanl.mx { matematico one; srostro Received June 2008; accepted September 2008 Abstract. The risk-sensitive filtering problem with respect to the exponential meansquare criterion is considered for stochastic Gaussian systems with third degree polynomial drift terms and intensity parameters multiplying diffusion terms in the state and observations equations. The closed-form suboptimal filtering algorithm is obtained linearizing a nonlinear third degree polynomial system at the operating point and reducing the original problem to the optimal filter design for a first degree polynomial system. The reduced filtering problem is solved using quadratic value functions as solutions to the corresponding Hamilton-Jacobi-Bellman equation. The performance of the obtained risk-sensitive filter for stochastic third degree polynomial systems is verified in a numerical example against the mean-square optimal third degree polynomial filter and extended Kalman-Bucy filter, through comparing the exponential mean-square criteria values. The simulation results reveal strong advantages in favor of the designed risk-sensitive algorithm for large values of the intensity parameters. Keywords: Risk-sensitive filtering, Stochastic systems 1. Introduction. The optimal mean-square filtering theory was initiated by Kalman and Bucy for linear stochastic systems, and then continued for nonlinear systems in a variety of papers (see for example [1-7]). More than thirty years ago, Mortensen [8] introduced adeterministicfilter model which provides an alternative to stochastic filtering theory. In this model, errors in the state dynamics and the observations are modeled as deterministic disturbance functions, and a mean-square disturbance error criterion is to be minimized. Special conditions are given for the existence, continuity and boundlessness of a drift f(x) in the state equation and a linear function h(x) intheobservationone.a concept of the stochastic risk-sensitive estimator, introduced more recently by McEneaney [9], in regard to a dynamic system including nonlinear drift f(x), linear observations, and intensity parameters multiplying diffusion terms in both, state and observation, equations. Again, the exponential mean-square (EMS) criterion, introduced in [10] for deterministic systems and in [11] for stochastic ones, is used instead of the conventional mean-square criterion to provide a robust estimate, which is less sensitive to parameter variations in noise intensity. This paper presents a solution to the risk-sensitive filtering problem with respect to the exponential mean-square criterion for stochastic third degree polynomial systems including intensity parameters multiplying diffusion terms in both, state and observation, equations. The closed-form suboptimal filtering algorithm is obtained linearizing a nonlinear third degree polynomial system at the operating point and reducing the original problem to the optimal filter design for a first degree polynomial (affine) system. The reduced filtering problem is solved seeking quadratic value functions as solutions to the corresponding Hamilton-Jacobi-Bellman equation. Undefined parameters 371
2 372 M. A. ALCORTA, M. BASIN, J. J. MALDONADO AND S. G. ANGUIANO in the value functions are calculated through ordinary differential equations composed by collecting terms corresponding to each power of the state-dependent polynomial in the HJB equation. The closed-form risk-sensitive filter equations are explicitly obtained. The performance of the obtained risk-sensitive filter for stochastic third degree polynomial systems is verified in a numerical example against the mean-square optimal third degree polynomial filter and extended Kalman-Bucy filter, through comparing the exponential mean-square criteria values. The simulation results reveal strong advantages in favor of the designed risk-sensitive algorithm for large values of the intensity parameters multiplying diffusion terms in state and observation equations. Tables of the criteria values and simulation graphs are included. 2. Problem Statement and Preliminaries Optimal risk-sensitive filtering problem. Consider the following stochastic diffusion model, for the state process X t : dx t = f(x t )dt + dw t, (1) where f(x t ) represents the nominal dynamics. The observation process Y t satisfies the equation: dy t = h(x t )dt + d W t. Here, is a parameter and W and W are independent Brownian motions, which are also independent of the initial condition X 0.X 0 has probability density k exp( 1 φ(x 0 )) with a certain constant k. The exponential mean-square cost function to be minimized over possible estimates m t is given by: Z T J = loge{exp 1 (x t m t ) T (x t m t )dt/y t }, (2) 0 where E(ξ/Y t ) is the conditional expectation of a random variable ξ with respect to the observations process Y t. In the rest of the paper, the assumptions (A1)-(A4) from [12] hold. Let q(t,x) denote the unnormalized conditional density of X T, given observations Y t for 0 t T. It satisfies the Zakai stochastic PDE, in a sense made precise in [13], Sec. 7. Since the normalizing constant k above is unimportant for q, it is assumed that q(0,x) = exp( 1 φ(x)), (3) q(s, x) = p(s, x)exp[ 1 Y t h(x)], where p(s, x) is called pathwise unnormalized filter density. Then, p satisfies the following linear second-order parabolic PDE with coefficients depending on Y T where, for any g R n, let p s = (L s ) p + K p, (4) Lg = 2 tr(g xx)+f g x, K(t, x) = 1 2 (Y t h) x (Y t h) x L(Y t h) 1 2 h 2. (5) L denote the differential generator of the Markov diffusion X t in (1). By assumptions (A1) and (A3) in [12], K is bounded and continuous. Since Y 0 =0,p(0,x)=q(0,x). The initial condition for (4) is given by (3). We rewrite (4) as follows: p s = 1 2 tr(p xx)+a p x + B p, (6) where A = f(x)+(y t h(x)) x, B(t, x) = div[f(x) (Y t h(x)) x ]+K(t, x), (diva x ) j = Σ n i,j=1(a ij ) xi, j = 1,..., n. Taking log transform Z(T,x) = logp(t,x), the nonlinear parabolic PDE is obtained Z s = 2 tr(z xx)+a Z x Z x Z x + B, (7)
3 ICIC EXPRESS LETTERS, VOL.2, NO.4, with initial data Z x (0,x) = φ(x). The risk-sensitive optimal filter problem consists in finding the estimate C T of the state x t, verifying that Z(s, x) = 1(x C 2 s) T Q s (x C s )+ρ s Y t h(x t ), is a viscosity solution of (7). The notation for all the variables is x(t) =x t,x t R n,w t R m,y t R p,f,h R n, where f x,h x are assumed bounded. Here, h x is the matrix of partial derivatives of h. ThesamenotationholdsforZ x. 3. Risk-sensitive Suboptimal Filter. Taking f(x t )=A t +A 1t x t +A 2 (t)x T x+a 3 (t)xxx T, h(x t )=E t + E 1t x t, where A t R n,a 1t, M n n,a 2 (t) is a tensor of dimension n n n, A 3 (t) is a tensor of dimension n n n n, E t R p,e 1t M n p, the following system of stochastic equations is obtained: dx t = A t + A 1t X t + A 2 (t)x T X + A 3 (t)x T XX + d ˆB t, x 0 = x 0, (8) dy t = E t + E 1t X t + d B t. Regarding that f(x t ) is a third degree polynomial and linearizing the expansion of f(x t ) in Taylor series around the equilibrium point ξ, thesuboptimalfiltering algorithms are obtained and presented in the following theorem. Theorem 3.1. The suboptimal solution to the filtering problem for the system (8) with the exponential mean-square criterion (2) takes the form: Ċ s = f 0 (ξ)ξ + f 0 (ξ) T C s Q 1 E 1 (dy E 1t C s E t ), (9) Q s = f 0 (ξ) T Q s Q s f 0 (ξ)+q T s Q s E1tE T 1t, where ξ is the equilibrium point of f(x t ). Proof: The value function is proposed Z(s, X) = 1 2 (X t C s ) T Q s (X t C s )+ρ s Y t (E t + E 1t x t ), where Z x (0,x)= φ(x), C s,q s, ρ s are functions of s [0,T],C s R n,q s is a symmetric matrix of dimension n n and ρ s is a scalar function) as a viscosity solution of the nonlinear parabolic PDE (7). Z x,z xx are the partial derivatives of Z respect to x, and Z is the gradient of Z. The partial derivatives of Z are given by: Z s = 1 2 (X t C s ) T Q s (X t C s )+ ρ s 1 2ĊT s Q s (X t C s ) 1 2 (X t C s ) T Q s Ċ s dy t (E t +E 1t x t ) Z x = 1 2 Q s(x C s )+ 1 2 (X C s) T Q s Y t E 1t, 2 Z x x = Q s. Substituting (10) and the expressions for A, B in (7), the following expression is obtained: 1 2 (X t C s ) T Q s (X t C s )+ ρ s 1 2ĊT s Q s (X t C s ) 1 2 (X t C s ) T Q s Ċ s dy t (E t + E 1t x t )= 2 (q 11 + q q nn )+[ f 0 (ξ)ξ f 0 (ξ)x + Y T Ė 1 ][Q T (x C s ) Y T E 1 ]+ 1 2 [Q T (x C T ) Y T E 1 ][Q T (x C T ) Y T E 1 ] A Y T E 1 Y T E 1 (f 0 (ξ)ξ + f 0 (ξ)x)y T E (E + E 1x) 2 Collecting the second degree terms, equalizing them to zero, and doing it again for the terms of first degree, the risk-sensitive filtering equations (9) are obtained. In similar manner, collecting the zero degree terms, the equation for ρ s is obtained. Here, Q T is a symmetric negative definite matrix, and the initial condition Q 0 = q 0 is derived from initial conditions for Z. If φ(x t )=x T t Kx t, Q(0) = K. It is easy to verify that if Q = P 1, where P is the covariance matrix, those equations are equivalent to the Kalman-Bucy filtering equations, as was shown in [9].
4 374 M. A. ALCORTA, M. BASIN, J. J. MALDONADO AND S. G. ANGUIANO 4. Example. Consider the pendulum equations with friction [14] for the dynamical system with state and output equations: ẋ 1 = x 2, ẋ 2 = g l Senx 1 k m x 2 + ψ 1 (t),x i0 = x io, y t = x 1 + ψ 2 (t), (10) where x R 2,g = 9.8m/seg 2 is the gravity constant, l = 0.5m is the length of the road, m =0.25kg denotes the mass of the bob, θ is the angle subtended by the road and the vertical axes through the pivot point, k = denotes the friction coefficient. White Gaussian noises ψ 1, ψ 2 are the derivatives of the Brownian motion W i, which are independent of each other and the initial condition x i0 = x io,is a varying parameter. Note that x 1 is the measured variable, while x 2 is observable but not measured. Expanding in Taylor series around the origin, this system is reduced to the third degree polynomial form: ẋ 1 = x 2, ẋ 2 = g (x l 1 x3 1 3! ) k x m 2 + ψ 1 (t), x i0 = x i, y t = x 1 + ψ 2 (t). Further linealization yields the linear dynamical system: dx 1t = x 2, dx 2 = g l x 1 k m x 2dt + ψ 1 (t), x i0 = x i, y t = x 1 dt + ψ 2 (t), (11) Substituting the corresponding values from (10) into (9), the equations for the suboptimal risk-sensitive filtering algorithms are given by: Ċ 1 = g l C (q q (ẎT C 1 )+q 12 C 2 ), q 22 q 11 Ċ 2 = C 1 k m C 2 1 q 2 12 q 22 q 11 (q 21 (ẎT C 1 )+q 11 C 2 ), (12) where q 12,q 22,q 11 are the solutions of the following symmetric Riccati matrix equation : q 11 T =2 g l q 21 + q q12 2 1, q 12 T = g l q 22 q 11 + k m q 12 + q 11 q 12 + q 12 q 22, (13) q 22 T = 2k m q 22 2q 21 + q q The last equations (12) and (13) are simulated using Simulink in MatLab7. The initial conditions for the simulation are x 0 =0, q 11 (0) = 8,q 12 (0) = 1.75,q 22 (0) = 1.5, C 1 (0) = 1,C 2 (0) = 1, T =10. The graphs of the difference between the state x t, and the estimate C T,thatis,e i = x i C i, for i =1, 2, with =1000, are shown in Figure 1. Applying the extended Kalman-Bucy filter algorithms [15] to the state equations (11), the equations for the estimate vector m(t) and symmetric covariance matrix P (t) are obtained: dm 1 (t) =m 2 (t)dt + p 11 (dy (t) m 1(t)dt), dm 2 (t) = g l m 1(t)dt k m m 2(t)dt + p 12 (dy (t) m 1 (t)dt), ṗ 11 (t) = 2p 12 (t) p2 11(t)+p 2 12(t) +, ṗ 12 (t) = g l p 11(t) k m p 12(t)+p 22 (t) p 11 (t)p 12 (t)+p 22 (t)p 12 (t), ṗ 22 (t) = 2 g l p 12(t) 2 k m p 22(t) p2 12(t)+p This system of equations is simulated with the initial conditions: m 1,2 (0) = 1, p 11 (0) = ,p 12 (0) = ,p 22 (0) = The graph of the difference between state x i, and the estimate m i (t), that is, e i = x i m i, for =1000, can be observed in
5 ICIC EXPRESS LETTERS, VOL.2, NO.4, Table 1. Comparison of mean-square criterion (2) for R-s filter, third degree polynomial and K-B extended filter for certain values of. value JR S J polynomial Jext.K B Figure 3. The third degree polynomial filtering equations from [1] are given by ṁ 1 (t) =m 2 (t)+ p 11 (Ẏ m 1(t)), ṁ 2 (t) = g l m 1(t) k m m 2(t)+ g 6l (3p 11m 1 (t)+m 3 1(t)) + p 21 (Ẏ m 1(t)), ṗ 11 (t) =2p p2 11, ṗ 12 (t) = g l p 11(t) k (t)+p 22 + g m 12 2l p2 11(t)+ g 2l p 11(t)m 2 1 (t) 2 p 11p 12, ṗ 22 (t) = 2g l p 12(t) 2k (t)+ g m 22 l p 11(t)p 12 (t)+ g l p 12(t)m 2 1 (t). The graph of the difference between state x i, and the third degree polynomial estimate m i (t), that is, e i = x i m i, for =1000, canbeobservedinfigure2. Table1presentssome values of the exponential mean-square cost function corresponding to the risk-sensitive, extended Kalman-Bucy and third degree polynomial filters. It can be observed that the J r s values are less that the J ext.k B and J polynomial values for large values of the parameter. Figure 1. Graphs of the absolute values of the difference between the state x t and the risk-sensitive estimate C T,for = Conclusions. This paper presents the suboptimal solutions to the risk-sensitive optimal filtering problem for stochastic third degree polynomial systems with Gaussian white noises, an exponential-quadratic criterion to be minimized, and intensity parameters multiplying the white noises, using Taylor series for linearizing the third degree polynomial in the state equation. Numerical simulations are conducted to compare performance of the obtained risk-sensitive filter algorithms against third degree polynomial filtering algorithms and extended Kalman-Bucy filter, through comparing the exponential mean-square criteria values. The simulation results reveal strong advantages in favor of the designed
6 376 M. A. ALCORTA, M. BASIN, J. J. MALDONADO AND S. G. ANGUIANO Figure 2. Graphs of the absolute values of the difference between the x t and the third degree polynomial estimate m(t), for = Figure 3. Graphs of the absolute values of the difference between the x t and the Kalman-Bucy extended estimate m(t), for = risk-sensitive suboptimal algorithms in regard to the final criteria values, corresponding to large values of the intensity parameters multiplying diffusion terms in the state and observation equations. Acknowledgment. The first author thanks the UCMEXUS-CONACyT Foundation for financial support under Posdoctoral Research Fellowship Program and Grant The second author thanks the Mexican National Science and Technology Council (CONACyT) for financial support under Grants and REFERENCES [1] M. V. Basin and M. A. Alcorta-Garcia, Optimal filtering and control for third degree polynomial systems, Dynamics of Continuous Discrete and Impulsive Systems, vol.10, pp , [2] M. V. Basin and M. A. Alcorta-Garcia, Optimal filtering for bilinear systems and its application to terpolymerization process state, Proc. of the IFAC 13th Symposium System Identification, pp , [3] M. V. Basin, J. Perez and R. Martinez-Zuniga, Optimal filtering for nonlinear polynomial systems over linear observations with delay, International Journal of Innovative Computing, Information and Control, vol.2, pp , 2006.
7 ICIC EXPRESS LETTERS, VOL.2, NO.4, [4] F. L. Lewis, Applied Optimal Control and Estimation, Prentice Hall Englewood Cliffs, New Jersey, EUA, [5] V. S. Pugachev and I. N. Sinitsyn, Stochastic Systems Theory and Applications, World Scientific, Singapore, [6] S.-T. Yau, finite-dimensional filters with nonlinear drift. I: A class of filters including both Kalman- Bucy and Benes filters, J. Math. Systems Estimation and Control, pp , [7] H. Zhang, M. V. Basin and M. Skliar, Optimal state estimation for continuous, stochastic, state-space system with hybrid measurements, International Journal of Innovative Computing, Information and Control, vol.2, pp , [8] R. E. Mortensen, Maximum likelihood recursive nonlinear filtering, J. Optim. Theory Appl., pp , [9] W. M. McEneaney, Robust H filtering for nonlinear systems, Systems and Control Letters, pp , [10] M. D. Donsker and S. R. S. Varaqdhan, Asymptotic evaluation of certain Markov process expectations for large time, I, II, III, Comm. Pure Appl. Math., vol.28, pp.1-45, pp , 1975; vol.29, pp , [11] W. H. Fleming and W. M. McEneaney, Risk-sensitive control and differential games, Lecture Notes in Control and Info. Sci., vol.184, Springer-Verlag, New York, pp , [12] W. H. Fleming, et al., Robust limits of risk sensitive nonlinear filters, Math. Control Signals and Systems, vol.14, pp , [13] D. L. Lukes, Optimal regulation of nonlinear dynamic systems, SIAM J. Control Opt., vol.7, pp , [14] H. K. Khalil, Nonlinear Systems, Third Edition, Prentice Hall, New Jersey [15] A. H. Jazwinski, Stochastic Processes and Filtering Theory, Academic Press, Inc., New York, 1970.
Optimal Filtering for Linear States over Polynomial Observations
Optimal filtering for linear states over polynomial observations 261 14 2 Optimal Filtering for Linear States over Polynomial Observations Joel Perez 1, Jose P. Perez 1 and Rogelio Soto 2 1 Department
More informationSolution of Stochastic Optimal Control Problems and Financial Applications
Journal of Mathematical Extension Vol. 11, No. 4, (2017), 27-44 ISSN: 1735-8299 URL: http://www.ijmex.com Solution of Stochastic Optimal Control Problems and Financial Applications 2 Mat B. Kafash 1 Faculty
More informationAPPROXIMATIONS FOR NONLINEAR FILTERING
October, 1982 LIDS-P-1244 APPROXIMATIONS FOR NONLINEAR FILTERING Sanjoy K. Mitter Department of Electrical Engiieering and Computer Science and Laboratory for Information and Decision Systems Massachusetts
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationFinite-Dimensional H Filter Design for Linear Systems with Measurement Delay
Proceedings of the 17th World Congress The International Federation of Automatic Control Finite-Dimensional H Filter Design for Linear Systems with Measurement Delay Michael Basin Peng Shi Dario Calderon-Alvarez
More informationControlled Diffusions and Hamilton-Jacobi Bellman Equations
Controlled Diffusions and Hamilton-Jacobi Bellman Equations Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 2014 Emo Todorov (UW) AMATH/CSE 579, Winter
More informationSliding Mode Regulator as Solution to Optimal Control Problem for Nonlinear Polynomial Systems
29 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June -2, 29 WeA3.5 Sliding Mode Regulator as Solution to Optimal Control Problem for Nonlinear Polynomial Systems Michael Basin
More informationEN Applied Optimal Control Lecture 8: Dynamic Programming October 10, 2018
EN530.603 Applied Optimal Control Lecture 8: Dynamic Programming October 0, 08 Lecturer: Marin Kobilarov Dynamic Programming (DP) is conerned with the computation of an optimal policy, i.e. an optimal
More informationLessons in Estimation Theory for Signal Processing, Communications, and Control
Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL
More informationLecture 6: Bayesian Inference in SDE Models
Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs
More informationInverse Optimality Design for Biological Movement Systems
Inverse Optimality Design for Biological Movement Systems Weiwei Li Emanuel Todorov Dan Liu Nordson Asymtek Carlsbad CA 921 USA e-mail: wwli@ieee.org. University of Washington Seattle WA 98195 USA Google
More informationStochastic and Adaptive Optimal Control
Stochastic and Adaptive Optimal Control Robert Stengel Optimal Control and Estimation, MAE 546 Princeton University, 2018! Nonlinear systems with random inputs and perfect measurements! Stochastic neighboring-optimal
More informationHamilton-Jacobi-Bellman Equation Feb 25, 2008
Hamilton-Jacobi-Bellman Equation Feb 25, 2008 What is it? The Hamilton-Jacobi-Bellman (HJB) equation is the continuous-time analog to the discrete deterministic dynamic programming algorithm Discrete VS
More informationOPTIMAL REGULATOR FOR LINEAR SYSTEMS WITH TIME DELAY IN CONTROL INPUT
OPTIMAL REGULATOR FOR LINEAR SYSTEMS WITH TIME DELAY IN CONTROL INPUT MICHAEL BASIN JESUS RODRIGUEZ-GONZALEZ Department of Physical and Mathematical Sciences Autonomous University of Nuevo Leon Apdo postal
More informationOPTIMAL CONTROL. Sadegh Bolouki. Lecture slides for ECE 515. University of Illinois, Urbana-Champaign. Fall S. Bolouki (UIUC) 1 / 28
OPTIMAL CONTROL Sadegh Bolouki Lecture slides for ECE 515 University of Illinois, Urbana-Champaign Fall 2016 S. Bolouki (UIUC) 1 / 28 (Example from Optimal Control Theory, Kirk) Objective: To get from
More informationOPTIMAL REGULATOR FOR LINEAR SYSTEMS WITH TIME DELAY IN CONTROL INPUT
OPTIMAL REGULATOR FOR LINEAR SYSTEMS WITH TIME DELAY IN CONTROL INPUT M.V. Basin, J.G. Rodriguez-Gonzalez, R. Martinez-Zuniga Department of Physical and Mathematical Sciences Autonomous University of Nuevo
More informationGame Theory Extra Lecture 1 (BoB)
Game Theory 2014 Extra Lecture 1 (BoB) Differential games Tools from optimal control Dynamic programming Hamilton-Jacobi-Bellman-Isaacs equation Zerosum linear quadratic games and H control Baser/Olsder,
More informationHJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011
Department of Probability and Mathematical Statistics Faculty of Mathematics and Physics, Charles University in Prague petrasek@karlin.mff.cuni.cz Seminar in Stochastic Modelling in Economics and Finance
More informationNonlinear Observer Design for Dynamic Positioning
Author s Name, Company Title of the Paper DYNAMIC POSITIONING CONFERENCE November 15-16, 2005 Control Systems I J.G. Snijders, J.W. van der Woude Delft University of Technology (The Netherlands) J. Westhuis
More informationControlled Markov Processes and Viscosity Solutions
Controlled Markov Processes and Viscosity Solutions Wendell H. Fleming, H. Mete Soner Controlled Markov Processes and Viscosity Solutions Second Edition Wendell H. Fleming H.M. Soner Div. Applied Mathematics
More informationACM/CMS 107 Linear Analysis & Applications Fall 2016 Assignment 4: Linear ODEs and Control Theory Due: 5th December 2016
ACM/CMS 17 Linear Analysis & Applications Fall 216 Assignment 4: Linear ODEs and Control Theory Due: 5th December 216 Introduction Systems of ordinary differential equations (ODEs) can be used to describe
More informationA NEW NONLINEAR FILTER
COMMUNICATIONS IN INFORMATION AND SYSTEMS c 006 International Press Vol 6, No 3, pp 03-0, 006 004 A NEW NONLINEAR FILTER ROBERT J ELLIOTT AND SIMON HAYKIN Abstract A discrete time filter is constructed
More informationConvergence of Particle Filtering Method for Nonlinear Estimation of Vortex Dynamics
Convergence of Particle Filtering Method for Nonlinear Estimation of Vortex Dynamics Meng Xu Department of Mathematics University of Wyoming February 20, 2010 Outline 1 Nonlinear Filtering Stochastic Vortex
More informationAdvanced Mechatronics Engineering
Advanced Mechatronics Engineering German University in Cairo 21 December, 2013 Outline Necessary conditions for optimal input Example Linear regulator problem Example Necessary conditions for optimal input
More informationAlberto Bressan. Department of Mathematics, Penn State University
Non-cooperative Differential Games A Homotopy Approach Alberto Bressan Department of Mathematics, Penn State University 1 Differential Games d dt x(t) = G(x(t), u 1(t), u 2 (t)), x(0) = y, u i (t) U i
More informationAn Overview of Risk-Sensitive Stochastic Optimal Control
An Overview of Risk-Sensitive Stochastic Optimal Control Matt James Australian National University Workshop: Stochastic control, communications and numerics perspective UniSA, Adelaide, Sept. 2004. 1 Outline
More informationStochastic contraction BACS Workshop Chamonix, January 14, 2008
Stochastic contraction BACS Workshop Chamonix, January 14, 2008 Q.-C. Pham N. Tabareau J.-J. Slotine Q.-C. Pham, N. Tabareau, J.-J. Slotine () Stochastic contraction 1 / 19 Why stochastic contraction?
More informationNonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México
Nonlinear Observers Jaime A. Moreno JMorenoP@ii.unam.mx Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México XVI Congreso Latinoamericano de Control Automático October
More informationLinear Filtering of general Gaussian processes
Linear Filtering of general Gaussian processes Vít Kubelka Advisor: prof. RNDr. Bohdan Maslowski, DrSc. Robust 2018 Department of Probability and Statistics Faculty of Mathematics and Physics Charles University
More informationON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER
ON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER GERARDO HERNANDEZ-DEL-VALLE arxiv:1209.2411v1 [math.pr] 10 Sep 2012 Abstract. This work deals with first hitting time densities of Ito processes whose
More informationOptimal Control. Quadratic Functions. Single variable quadratic function: Multi-variable quadratic function:
Optimal Control Control design based on pole-placement has non unique solutions Best locations for eigenvalues are sometimes difficult to determine Linear Quadratic LQ) Optimal control minimizes a quadratic
More informationOn Stochastic Adaptive Control & its Applications. Bozenna Pasik-Duncan University of Kansas, USA
On Stochastic Adaptive Control & its Applications Bozenna Pasik-Duncan University of Kansas, USA ASEAS Workshop, AFOSR, 23-24 March, 2009 1. Motivation: Work in the 1970's 2. Adaptive Control of Continuous
More informationNonlinear Control Lecture 1: Introduction
Nonlinear Control Lecture 1: Introduction Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2011 Farzaneh Abdollahi Nonlinear Control Lecture 1 1/15 Motivation
More informationConverse Lyapunov theorem and Input-to-State Stability
Converse Lyapunov theorem and Input-to-State Stability April 6, 2014 1 Converse Lyapunov theorem In the previous lecture, we have discussed few examples of nonlinear control systems and stability concepts
More informationLecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations
Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations Simo Särkkä Aalto University Tampere University of Technology Lappeenranta University of Technology Finland November
More informationNonlinear Identification of Backlash in Robot Transmissions
Nonlinear Identification of Backlash in Robot Transmissions G. Hovland, S. Hanssen, S. Moberg, T. Brogårdh, S. Gunnarsson, M. Isaksson ABB Corporate Research, Control Systems Group, Switzerland ABB Automation
More informationControlled Markov Processes and Viscosity Solutions
Controlled Markov Processes and Viscosity Solutions Wendell H. Fleming, H. Mete Soner Controlled Markov Processes and Viscosity Solutions Second Edition Wendell H. Fleming H.M. Soner Div. Applied Mathematics
More informationx x2 2 + x3 3 x4 3. Use the divided-difference method to find a polynomial of least degree that fits the values shown: (b)
Numerical Methods - PROBLEMS. The Taylor series, about the origin, for log( + x) is x x2 2 + x3 3 x4 4 + Find an upper bound on the magnitude of the truncation error on the interval x.5 when log( + x)
More informationLecture 4: Ito s Stochastic Calculus and SDE. Seung Yeal Ha Dept of Mathematical Sciences Seoul National University
Lecture 4: Ito s Stochastic Calculus and SDE Seung Yeal Ha Dept of Mathematical Sciences Seoul National University 1 Preliminaries What is Calculus? Integral, Differentiation. Differentiation 2 Integral
More informationS. Lototsky and B.L. Rozovskii Center for Applied Mathematical Sciences University of Southern California, Los Angeles, CA
RECURSIVE MULTIPLE WIENER INTEGRAL EXPANSION FOR NONLINEAR FILTERING OF DIFFUSION PROCESSES Published in: J. A. Goldstein, N. E. Gretsky, and J. J. Uhl (editors), Stochastic Processes and Functional Analysis,
More informationA Remark on IVP and TVP Non-Smooth Viscosity Solutions to Hamilton-Jacobi Equations
2005 American Control Conference June 8-10, 2005. Portland, OR, USA WeB10.3 A Remark on IVP and TVP Non-Smooth Viscosity Solutions to Hamilton-Jacobi Equations Arik Melikyan, Andrei Akhmetzhanov and Naira
More informationComputational Issues in Nonlinear Dynamics and Control
Computational Issues in Nonlinear Dynamics and Control Arthur J. Krener ajkrener@ucdavis.edu Supported by AFOSR and NSF Typical Problems Numerical Computation of Invariant Manifolds Typical Problems Numerical
More informationA NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1
A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,
More informationOptimal Polynomial Control for Discrete-Time Systems
1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should
More informationCONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström
PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,
More informationThe Kalman filter is arguably one of the most notable algorithms
LECTURE E NOTES «Kalman Filtering with Newton s Method JEFFREY HUMPHERYS and JEREMY WEST The Kalman filter is arguably one of the most notable algorithms of the 0th century [1]. In this article, we derive
More informationEM-algorithm for Training of State-space Models with Application to Time Series Prediction
EM-algorithm for Training of State-space Models with Application to Time Series Prediction Elia Liitiäinen, Nima Reyhani and Amaury Lendasse Helsinki University of Technology - Neural Networks Research
More informationRisk-Sensitive Filtering and Smoothing via Reference Probability Methods
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 42, NO. 11, NOVEMBER 1997 1587 [5] M. A. Dahleh and J. B. Pearson, Minimization of a regulated response to a fixed input, IEEE Trans. Automat. Contr., vol.
More informationReview: control, feedback, etc. Today s topic: state-space models of systems; linearization
Plan of the Lecture Review: control, feedback, etc Today s topic: state-space models of systems; linearization Goal: a general framework that encompasses all examples of interest Once we have mastered
More informationLinear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters
Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 204 Emo Todorov (UW) AMATH/CSE 579, Winter
More informationTaylor expansions for the HJB equation associated with a bilinear control problem
Taylor expansions for the HJB equation associated with a bilinear control problem Tobias Breiten, Karl Kunisch and Laurent Pfeiffer University of Graz, Austria Rome, June 217 Motivation dragged Brownian
More informationLarge deviations and averaging for systems of slow fast stochastic reaction diffusion equations.
Large deviations and averaging for systems of slow fast stochastic reaction diffusion equations. Wenqing Hu. 1 (Joint work with Michael Salins 2, Konstantinos Spiliopoulos 3.) 1. Department of Mathematics
More informationDynamical systems with Gaussian and Levy noise: analytical and stochastic approaches
Dynamical systems with Gaussian and Levy noise: analytical and stochastic approaches Noise is often considered as some disturbing component of the system. In particular physical situations, noise becomes
More information2.20 Fall 2018 Math Review
2.20 Fall 2018 Math Review September 10, 2018 These notes are to help you through the math used in this class. This is just a refresher, so if you never learned one of these topics you should look more
More informationMATH 425, HOMEWORK 3 SOLUTIONS
MATH 425, HOMEWORK 3 SOLUTIONS Exercise. (The differentiation property of the heat equation In this exercise, we will use the fact that the derivative of a solution to the heat equation again solves the
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2018 Copyright 2018 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More information446 CHAP. 8 NUMERICAL OPTIMIZATION. Newton's Search for a Minimum of f(x,y) Newton s Method
446 CHAP. 8 NUMERICAL OPTIMIZATION Newton's Search for a Minimum of f(xy) Newton s Method The quadratic approximation method of Section 8.1 generated a sequence of seconddegree Lagrange polynomials. It
More informationWeighted balanced realization and model reduction for nonlinear systems
Weighted balanced realization and model reduction for nonlinear systems Daisuke Tsubakino and Kenji Fujimoto Abstract In this paper a weighted balanced realization and model reduction for nonlinear systems
More informationMulti-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form
Multi-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form Yipeng Yang * Under the supervision of Dr. Michael Taksar Department of Mathematics University of Missouri-Columbia Oct
More informationDynamical Systems & Scientic Computing: Homework Assignments
Fakultäten für Informatik & Mathematik Technische Universität München Dr. Tobias Neckel Summer Term Dr. Florian Rupp Exercise Sheet 3 Dynamical Systems & Scientic Computing: Homework Assignments 3. [ ]
More informationRobotics. Control Theory. Marc Toussaint U Stuttgart
Robotics Control Theory Topics in control theory, optimal control, HJB equation, infinite horizon case, Linear-Quadratic optimal control, Riccati equations (differential, algebraic, discrete-time), controllability,
More informationUncertainty in Kalman Bucy Filtering
Uncertainty in Kalman Bucy Filtering Samuel N. Cohen Mathematical Institute University of Oxford Research Supported by: The Oxford Man Institute for Quantitative Finance The Oxford Nie Financial Big Data
More informationIntroduction to Modern Control MT 2016
CDT Autonomous and Intelligent Machines & Systems Introduction to Modern Control MT 2016 Alessandro Abate Lecture 2 First-order ordinary differential equations (ODE) Solution of a linear ODE Hints to nonlinear
More informationLMI Methods in Optimal and Robust Control
LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 15: Nonlinear Systems and Lyapunov Functions Overview Our next goal is to extend LMI s and optimization to nonlinear
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More informationPath integrals for classical Markov processes
Path integrals for classical Markov processes Hugo Touchette National Institute for Theoretical Physics (NITheP) Stellenbosch, South Africa Chris Engelbrecht Summer School on Non-Linear Phenomena in Field
More informationRisk-Sensitive Control with HARA Utility
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 46, NO. 4, APRIL 2001 563 Risk-Sensitive Control with HARA Utility Andrew E. B. Lim Xun Yu Zhou, Senior Member, IEEE Abstract In this paper, a control methodology
More informationMCE693/793: Analysis and Control of Nonlinear Systems
MCE693/793: Analysis and Control of Nonlinear Systems Introduction to Nonlinear Controllability and Observability Hanz Richter Mechanical Engineering Department Cleveland State University Definition of
More informationStability of Stochastic Differential Equations
Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
More informationFokker-Planck Equation with Detailed Balance
Appendix E Fokker-Planck Equation with Detailed Balance A stochastic process is simply a function of two variables, one is the time, the other is a stochastic variable X, defined by specifying: a: the
More informationThe Entropy Penalized Minimum Energy Estimator
The Entropy Penalized Minimum Energy Estimator Sergio Pequito, A. Pedro Aguiar Adviser Diogo A. Gomes Co-Adviser Instituto Superior Tecnico Institute for System and Robotics Department of Electronic and
More informationThomas Knispel Leibniz Universität Hannover
Optimal long term investment under model ambiguity Optimal long term investment under model ambiguity homas Knispel Leibniz Universität Hannover knispel@stochastik.uni-hannover.de AnStAp0 Vienna, July
More informationHypoelliptic multiscale Langevin diffusions and Slow fast stochastic reaction diffusion equations.
Hypoelliptic multiscale Langevin diffusions and Slow fast stochastic reaction diffusion equations. Wenqing Hu. 1 (Joint works with Michael Salins 2 and Konstantinos Spiliopoulos 3.) 1. Department of Mathematics
More informationEECE Adaptive Control
EECE 574 - Adaptive Control Basics of System Identification Guy Dumont Department of Electrical and Computer Engineering University of British Columbia January 2010 Guy Dumont (UBC) EECE574 - Basics of
More informationSome recent results on controllability of coupled parabolic systems: Towards a Kalman condition
Some recent results on controllability of coupled parabolic systems: Towards a Kalman condition F. Ammar Khodja Clermont-Ferrand, June 2011 GOAL: 1 Show the important differences between scalar and non
More informationCS 195-5: Machine Learning Problem Set 1
CS 95-5: Machine Learning Problem Set Douglas Lanman dlanman@brown.edu 7 September Regression Problem Show that the prediction errors y f(x; ŵ) are necessarily uncorrelated with any linear function of
More informationAn Introduction to Noncooperative Games
An Introduction to Noncooperative Games Alberto Bressan Department of Mathematics, Penn State University Alberto Bressan (Penn State) Noncooperative Games 1 / 29 introduction to non-cooperative games:
More informationPerformance Evaluation of Generalized Polynomial Chaos
Performance Evaluation of Generalized Polynomial Chaos Dongbin Xiu, Didier Lucor, C.-H. Su, and George Em Karniadakis 1 Division of Applied Mathematics, Brown University, Providence, RI 02912, USA, gk@dam.brown.edu
More informationNested Uncertain Differential Equations and Its Application to Multi-factor Term Structure Model
Nested Uncertain Differential Equations and Its Application to Multi-factor Term Structure Model Xiaowei Chen International Business School, Nankai University, Tianjin 371, China School of Finance, Nankai
More informationOptimization-Based Control
Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This
More informationADAPTIVE FILTER THEORY
ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface
More informationVolume 30, Issue 3. A note on Kalman filter approach to solution of rational expectations models
Volume 30, Issue 3 A note on Kalman filter approach to solution of rational expectations models Marco Maria Sorge BGSE, University of Bonn Abstract In this note, a class of nonlinear dynamic models under
More informationENERGY DECAY ESTIMATES FOR LIENARD S EQUATION WITH QUADRATIC VISCOUS FEEDBACK
Electronic Journal of Differential Equations, Vol. 00(00, No. 70, pp. 1 1. ISSN: 107-6691. URL: http://ejde.math.swt.edu or http://ejde.math.unt.edu ftp ejde.math.swt.edu (login: ftp ENERGY DECAY ESTIMATES
More informationA Numerical Scheme for Generalized Fractional Optimal Control Problems
Available at http://pvamuedu/aam Appl Appl Math ISSN: 1932-9466 Vol 11, Issue 2 (December 216), pp 798 814 Applications and Applied Mathematics: An International Journal (AAM) A Numerical Scheme for Generalized
More informationPrediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother
Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications
More informationExplicit solutions of some Linear-Quadratic Mean Field Games
Explicit solutions of some Linear-Quadratic Mean Field Games Martino Bardi Department of Pure and Applied Mathematics University of Padua, Italy Men Field Games and Related Topics Rome, May 12-13, 2011
More informationState Regulator. Advanced Control. design of controllers using pole placement and LQ design rules
Advanced Control State Regulator Scope design of controllers using pole placement and LQ design rules Keywords pole placement, optimal control, LQ regulator, weighting matrixes Prerequisites Contact state
More informationApplied Math Qualifying Exam 11 October Instructions: Work 2 out of 3 problems in each of the 3 parts for a total of 6 problems.
Printed Name: Signature: Applied Math Qualifying Exam 11 October 2014 Instructions: Work 2 out of 3 problems in each of the 3 parts for a total of 6 problems. 2 Part 1 (1) Let Ω be an open subset of R
More informationLecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Approximations
Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Approximations Simo Särkkä Aalto University, Finland November 18, 2014 Simo Särkkä (Aalto) Lecture 4: Numerical Solution of SDEs November
More informationA note on linear differential equations with periodic coefficients.
A note on linear differential equations with periodic coefficients. Maite Grau (1) and Daniel Peralta-Salas (2) (1) Departament de Matemàtica. Universitat de Lleida. Avda. Jaume II, 69. 251 Lleida, Spain.
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 25 January 2006 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More informationLecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations
Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model
More informationLecture 7: Optimal Smoothing
Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother
More informationThe Important State Coordinates of a Nonlinear System
The Important State Coordinates of a Nonlinear System Arthur J. Krener 1 University of California, Davis, CA and Naval Postgraduate School, Monterey, CA ajkrener@ucdavis.edu Summary. We offer an alternative
More information1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner), Second Revised Edition, Springer-Verlag, New York, 2001.
Paul Dupuis Professor of Applied Mathematics Division of Applied Mathematics Brown University Publications Books: 1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner),
More informationLecture 1: Pragmatic Introduction to Stochastic Differential Equations
Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Simo Särkkä Aalto University, Finland (visiting at Oxford University, UK) November 13, 2013 Simo Särkkä (Aalto) Lecture 1: Pragmatic
More informationOutput Regulation of the Arneodo Chaotic System
Vol. 0, No. 05, 00, 60-608 Output Regulation of the Arneodo Chaotic System Sundarapandian Vaidyanathan R & D Centre, Vel Tech Dr. RR & Dr. SR Technical University Avadi-Alamathi Road, Avadi, Chennai-600
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 12: Gaussian Belief Propagation, State Space Models and Kalman Filters Guest Kalman Filter Lecture by
More informationKalman Filter and Parameter Identification. Florian Herzog
Kalman Filter and Parameter Identification Florian Herzog 2013 Continuous-time Kalman Filter In this chapter, we shall use stochastic processes with independent increments w 1 (.) and w 2 (.) at the input
More informationNonlinear Filtering Revisited: a Spectral Approach, II
Nonlinear Filtering Revisited: a Spectral Approach, II Sergey V. Lototsky Center for Applied Mathematical Sciences University of Southern California Los Angeles, CA 90089-3 sergey@cams-00.usc.edu Remijigus
More information