Linear-Quadratic-Gaussian Controllers!
|
|
- Anis Hart
- 5 years ago
- Views:
Transcription
1 Linear-Quadratic-Gaussian Controllers! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 2017!! LTI dynamic system!! Certainty Equivalence and the Separation Theorem!! Asymptotic stability of the constant-gain LQG regulator!! Coupling due to parameter uncertainty!! Robustness (loop transfer) recovery!! Stochastic Robustness Analysis and Design!! Neighboring-optimal Stochastic Control Copyright 2017 by Robert Stengel. All rights reserved. For educational use only The Problem: Minimize Cost, Subject to Dynamic Constraint, Uncertain Disturbances, and Measurement Error = Fx(t) + Gu(t) + Lw(t), x( 0) = x o z( t) = Hx( t) + n( t)!x t Dynamic System minv t o u = min u J ( t f ) Cost Function = 1 2 min u ( t f E * ( E! " x T (t )S(t )x(t ) I f f f D + E * ) )! ' " xt (t) u T (t) 0 +* +*! " Q 0 0 R! " x(t) u(t) dt I D,, ** --.*.* I D { } ( t) = ˆx ( t),p( t),u t 2
2 Initial Conditions and Dimensions E x( 0) { ˆx ( 0 ) ˆx ( 0 ) } = P( 0)!" w T ( ) = W' ( t ) T!" = ˆx o ; E!" x 0!" x 0 E w( t)!" = 0; E w t E n( t)!" = 0; E!" n( t)n T ( ) = N' t E!" w( t)n T ( ) = 0 dim!" x t = n 1 dim!" u t = m 1 dim!" w t = s 1 Dimensions dim!" z t = dim! " n t = r 1 Statistics 3 Linear-Quadratic-Gaussian Control 4
3 Separation Property and Certainty Equivalence Separation Property! Optimal Control Law and Optimal Estimation Law can be derived separately! Their derivations are strictly independent Certainty Equivalence Property! Separation property plus,...! The Stochastic Optimal Control Law and the Deterministic Optimal Control Law are the same! The Optimal Estimation Law can be derived separately Linear-quadratic-Gaussian (LQG) control is certainty-equivalent 5 The Equations (Continuous-Time Model) System State and Measurement Control Law = F(t)x(t) + G(t)u(t) + L(t)w(t) z( t) = Hx( t) + n( t)!x t u( t) =!C(t)ˆx(t) + C F (t)y C (t) State Estimate Estimator Gain and State Covariance Estimate = F(t)ˆx(t) + G(t)u(t) + K( t) z( t)! Hˆx ( t)! K( t)h ˆ!x t " = " F(t)! G(t)C t ˆx(t) + G( t)c F (t)y C (t) + K( t)z t = P(t)H T N!1 ( t) W( t)l T ( t)! P(t)H T N!1 t K t!p(t) = F(t)P(t) + P(t)F T (t) + L t Control Gain and Adjoint Covariance Estimate!S t C( t) = R!1 t =!Q(t)! F(t) T S( t)! S t G T ( t)s( t) F(t) + S( t)g(t)r!1 (t)g T (t)s t HP(t) 6
4 Estimator in the Feedback Loop Linear-Gaussian (LG) state estimator adds dynamics to the feedback signal =!C(t)ˆx(t) u t ˆ!x ( t) = Fˆx(t) + Gu(t) + K( t) z( t)! Hˆx ( t) " Thus, state estimator can be viewed as a control-law compensator Bandwidth of the compensation is dependent on the multivariable signal/noise ratio, [PH T ]N 1 K( t) = P(t)H T N!1!P(t) = FP(t) + P(t)F T + LWL T! P(t)H T N!1 HP(t) 7 Stable Scalar LTI Example of Estimator Compensation Dynamic system (stable) and measurement!x =!x + w; z = Hx + n Estimator differential equation Laplace transform of estimator Estimator transfer function Low-pass filter ˆ!x =! ˆx + K ( z! Hˆx ) = (!1! KH ) ˆx + Kz " s! (!1! KH ) ˆx ( s) = Kz( s) ˆx ( s) = ˆx s z s K z s " s!!1! KH = K s! (!1! KH ) " 8
5 Unstable Scalar LTI Example of Estimator Compensation Dynamic system (unstable) and measurement!x = x + w; z = Hx + n Estimator differential equation Laplace transform of estimator Estimator transfer function Low-pass filter ˆ!x = ˆx + K ( z! Hˆx ) = ( 1! KH ) ˆx + Kz " s! ( 1! KH ) ˆx ( s) = Kz( s) ˆx ( s) = ˆx s K " s! ( 1! KH ) z( s) = K s! ( 1! KH ) z s " 9 Steady-State Scalar Filter Gain P = Signal "Power" = State Estimate Variance N = Noise "Power" = Measurement Error Variance H = Projection from Measurement Space to Signal Space W = Disturbance Covariance Constant, scalar filter gain K = PH N 0 = 2P + W! P2 H 2 Algebraic Riccati equation (unstable case) P = N H ± 2! N " H 2 N ; P2! 2N H 2 P! WN H 2 = WN = N ' 1 ± 1+ WH 2 ) H 2 H 2 () N *, +, 10
6 Steady-State Filter Gain K = ') N! WH 2 ( H 2 " N *) N + ), H -) ') = ( 1 H *)! 2 WH " N + ), -) K! W!! >> N " W N 11 Dynamic Constraint on the Certainty-Equivalent Cost P(t) is independent of u(t); therefore min u J = min u J CE + J S J CE is Identical in form to the deterministic cost function Minimized subject to dynamic constraint based on the state estimate ˆ!x ( t) = Fˆx(t) + Gu(t) + K( t) z( t)! Hˆx ( t) " 12
7 Kalman-Bucy Filter Provides Estimate of the State Mean Value Filter residual is a Gaussian process = Fˆx(t) + Gu(t) + K( t) z( t)! Hˆx ( t) " Fˆx(t) + Gu(t) + K( t) ( t) ˆ!x t " Filter equation is analogous to deterministic dynamic constraint on deterministic cost function!x ( t) = Fx(t) + Gu(t) + Lw(t) 13 Control That Minimizes the Certainty-Equivalent Cost Optimizing control history is generated by a time-varying feedback control law =!C(t)ˆx(t) u t The control gain is the same as the deterministic gain = R!1 G T S( t) C t!s ( t) =!Q! F T S( t)! S t F + S( t)gr!1 G T S t given S t f 14
8 Optimal Cost for the Continuous- Time LQG Controller Certainty-equivalent cost J CE = 1 t 2 Tr! f S(0)E!" ˆx ( 0) ˆx T ( 0) + S( t)k( t)nk T ( t)dt ' " 0 ' Total cost J = J CE + J S = 1 t 2 Tr f ( S(0)E *!" ˆx ( 0) ˆx T ( 0) + S( t)k( t)nk T ( ' ( t)dt + )( 0,( + 1 t 2 Tr! f S(t )P(t ) + QP( t)dt - f f. " Discrete-Time LQG Controller Kalman filter produces state estimate ˆx k (!) = "ˆx k!1 ( + ) + C k!1ˆx k!1 ( + ) ˆx k ( + ) = ˆx k (!) + K k z k! Hˆx k (!) " Closed-loop system uses state estimate for feedback control x k +1 =!x k " C k ˆx k + 16
9 Response of Discrete-Time 1 st -Order System to Disturbance Kalman Filter Estimate from Noisy Measurement Propagation of Uncertainty Kalman Filter, Uncontrolled System 17 Comparison of 1 st -Order Discrete- Time LQ and LQG Control Response Linear-Quadratic Control with Noise-free Measurement Linear-Quadratic-Gaussian Control with Noisy Measurement 18
10 Asymptotic Stability of the LQG Regulator! 19 System Equations with LQG Control With perfect knowledge of the system!x ( t) = Fx(t) + Gu(t) + Lw(t) = Fˆx(t) + Gu(t) + K( t) z( t)! Hˆx ( t) ˆ!x t State estimate error!( t) = x( t) " ˆx ( t) " State estimate error dynamics!( t) = ( F " KH)! ( t) + Lw t " Kn( t) 20
11 Control-Loop and Estimator Eigenvalues are Uncoupled "!x t! t " ' ' = ( F ( GC) GC 0 F ( KH " ' ' x t! t ' ' + " L 0 L (K " ' w t n t ' ' Upper-block-triangular stability matrix LQG system is stable because (F GC) is stable (F KH) is stable Estimate error affects state response = F! GC!x t x t + GC" ( t) + Lw( t) Actual state does not affect error response Disturbance affects both equally 21 Parameter Uncertainty Introduces Coupling! 22
12 Coupling Due To Parameter Uncertainty Actual System: { F A,G A,H A } Assumed System: { F,G,H}!x ( t) = F A x(t) + G A u(t) + Lw(t) = Fˆx(t) + Gu(t) + K( t) z( t)! Hˆx ( t) ˆ!x t " = H A x(t) + n( t) u(t) =!C( t) ˆx ( t) z t "!x t! t " ' ' = ( F A ( G A C) G A C " ( F A ( F) ( ( G A ( G)C ( K( H A ( H) " F + ( G A ( G)C ( KH " ' ' x t! t ' ' +" Closed-loop control and estimator responses are coupled 23 Effects of Parameter Uncertainty on Closed-Loop Stability si 2n! F CL = " si n! ( F A! G A C)!G A C! ( G A! G)C! K( H A! H) { }! " F A! F si n! " F + ( G A! G)C! KH = CL ( s) = 0!! Uncertain parameters affect closed-loop eigenvalues!! Coupling can lead to instability for numerous reasons!! Improper control gain!! Control effect on estimator block!! Redistribution of damping 24
13 Doyle s Counter-Example of LQG Robustness (1978)! " Unstable Plant!x 1!x 2 =! 1 1 " 0 1! " z =! " 1 0 x 1 x 2! " +! 0 " 1 x 1 x 2 + n! u + 1 " 1 w Design Matrices! Q = Q 1 1 " 1 1! ; R = 1; W = W 1 1 " 1 1 ; N = 1 Control and Estimator Gains C = ( Q )! " 1 1! 1 K = ( W ) " 1 =! " c c! k = " k 25 Uncertainty in the Control Effect System Matrices! F A = F; G A = " 0 µ ; H A = H Characteristic Equation ( s!1)!1 0 0 µc µc!1 ( s!1+ c) 0 s!1!k 0 s!1+ k!k 0 c + k = 0 s 4 + a 3 s 3 + a 2 s 2 + a 1 s + a 0 =! CL ( s) = 0 26
14 Stability Effect of Parameter Variation Routh's Stability Criterion (necessary condition) All coefficients of!(s) must be positive for stability µ is nominally equal to 1 µ can force a 0 and a 1 to change sign Result is dependent on magnitude of ck a 1 = k + c! ( µ!1)ck a 0 = 1+ ( 1! µ )ck Arbitrarily small uncertainty, µ = 1 +!, could cause unstability Not surprising: uncertainty is in the control effect 27 The Counter-Example Raises a Flag Solution Choose Q and W to be small, increasing allowable range of "!! However,... The counter-example is irrelevant because it does not satisfy the requirements for LQ and LG stability!! The open-loop system is unstable, so it requires feedback control to restore stability!! To guarantee stability, Q and W must be positive definite, but! Q = Q 1 1 " 1 1! W = W 1 1 " 1 1 ; hence, Q = 0 ; hence, W = 0 28
15 Restoring Robustness! (Loop Transfer Recovery)! 29 Loop-Transfer Recovery (Doyle and Stein, 1979)!! Proposition: LQG and LQ robustness would be the same if the control vector had the same effect on the state and its estimate Cx( t) and Cˆx t produce same expected value of control, E!" u( t) E " u LQ t but not the same! u LQG ( t) u ( t)! u ( t) T { " LQ LQG } as ˆx ( t) contains measurement errors but x( t) does not!! Therefore, restoring the correct mean value from z(t) restores closed-loop robustness!! Solution: Increase the assumed process noise for estimator design as follows (see text for details) W = W o + k 2 GG T 30
16 Stochastic Robustness Analysis and Design! 31 Expression of Uncertainty in the System Model System uncertainty may be expressed as Elements of F Coefficients of!(s) Eigenvalues, " Frequency response/singular values/time response, A(j ), (j ), x(t) Variation may be! Deterministic, e.g., Upper/lower bounds ( worst-case )! Probabilistic, e.g., Gaussian distribution Bounded variation is equivalent to probabilistic variation with uniform distribution 32
17 Stochastic Root Locus: Uncertain Damping Ratio and Natural Frequency Gaussian Distribution of Eigenvalues Uniform Distribution of Eigenvalues 33 Probability of Instability Nonlinear mapping from probability density functions (pdf) of uncertain parameters to pdf of roots! Finite probability of instability with Gaussian (unbounded) distribution! Zero probability of instability for some uniform distributions! 34
18 Probabilistic Control Design Design constant-parameter controller (CPC) for satisfactory stability and performance in an uncertain environment Monte Carlo Evaluation of simulated system response with! competing CPC designs [Design parameters = d]! given statistical model of uncertainty in the plant [Uncertain plant parameters = v] Search for best CPC! Exhaustive search! Random search! Multivariate line search! Genetic algorithm! Simulated annealing 35 Design Outcome Follows Binomial Distribution Binomial distribution: Satisfactory/Unsatisfactory Confidence intervals of probability estimate are functions of! Actual probability! Number of trials Number of Evaluations 1e+09 1e+07 1e+05 1e+03 Number of Evaluations Confidence Interval Interval Width e+01 1e-06 1e-05 1e Probability or (1 - Probability Binomial Distribution Maximum Information Entropy when Pr =
19 Example: Probability of Stable Control of an Unstable Plant X-29 Aircraft F = Longitudinal dynamics for a Forward-Swept-Wing Airplane!2gf 11 /V "V 2 f 12 / 2 "Vf 13!g!45 /V 2 "Vf 22 / "V 2 f 32 / 2 "Vf ( ( ( ( ( '! G = " g 11 g g 31 g ! ; x = " V, Airspeed ', Angle of attack q, Pitch rate (, Pitch angle Ray, Stengel, Example: Probability of Stable Control of an Unstable Plant Nominal eigenvalues (one unstable)! 1" 4 = "0.1 ± j, " 5.15, 3.35 Air density and airspeed,! and V, have uniform distributions(±30) 10 coefficients have Gaussian distributions (! = 30) p = "! V f 11 f 12 f 13 f 22 f 32 f 33 g 11 g 12 g 31 g 32 T Environment Uncontrolled Dynamics Control Effect 38
20 LQ Regulators for the Example Three stabilizing feedback control laws Case a) LQR with low control weighting Q = diag( 1,1,1,0 ); R = ( 1,1);! 1"4nominal = 35, 5.1, 3.3,.02 C = "11 "3 "1.1 Case b) LQR with high control weighting Q = diag( 1,1,1,0 ); R = ( 1000,1000);! 1"4nominal = "5.2,"3.4,"1.1,".02 C = " "63 "16 "1.9 Case c) Case b with gains multiplied by 5 for bandwidth (loop-transfer) recovery! 1" 4nominal = "32, 5.2, 3.4, 0.01 C = ( ' ( ' " "313 "81 "1.1" 9.5 ( ' 39 Stochastic Root Loci!! Distribution of closed-loop roots with!! Gaussian uncertainty in 10 parameters!! Uniform uncertainty in velocity and air density!! 25,000 Monte Carlo evaluations!! Probability of instability!! a) Pr = 0.072!! b) Pr = 0.021!! c) Pr = Case a Case b Case c Stochastic Root Locus Ray, Stengel,
21 Probabilities of Instability for the Three Cases 41 Stochastic Root Loci for the Three Cases Case a: Low LQ Control Weights with Gaussian Aerodynamic Uncertainty! Case b: High LQ Control Weights Probabilities of instability with 30 uniform aerodynamic uncertainty!! Case a: 3.4 x 10-4!! Case b: 0!! Case c: 0! Case c: Bandwidth Recovery 42
22 American Control Conference Benchmark Control Problem, 1991 Parameters of 4 th -order mass-spring system! Uniform probability density functions for 0.5 < m 1, m 2 < < k < 2 Probability of Instability, P i! m i = 1 (unstable) or 0 (stable) Probability of Settling Time Exceedance, P ts! m ts = 1 (exceeded) or 0 (not exceeded) Probability of Control Limit Exceedance, P u! m u = 1 (exceeded) or 0 (not exceeded) Design Cost Function 10 controllers designed for the competition J = ap i 2 + bp ts 2 + cp u 2 43 Stochastic LQG Design for Benchmark Control Problem SISO Linear-Quadratic-Gaussian Regulators (Marrison)! Implicit model following with control-rate weighting and scalar output (5 th order)! Kalman filter with single measurement (4 th order)! Design parameters Control cost function weights Springs and masses in ideal model Estimator weights! Search Multivariate line search Genetic algorithm 44
23 Comparison of Design Costs for Benchmark Control Problem J = P i P ts P u 2 Cost Emphasizes Instability J = 0.01P i P ts 2 + P u 2 Cost Emphasizes Excess Control J = 0.01P i 2 + P ts P u 2 Cost Emphasizes Settling-Time Exceedance Competition Designs Four SRAD LQG Designs Marrison, Stengel, Stochastic LQG controller more robust in 39 of 40 benchmark controller comparisons Estimation of Minimum Design Cost Using Jackknife/Bootstrapping Evaluation Corresponding Weibull Distribution Pr(J < J0) Genetic Algorithm Results Design Cost Estimate x 103 Marrison, Stengel,
24 Neighboring-Optimal Control with Uncertain Disturbance, Measurement, and Initial Condition! 47 Immune Response Example!! Optimal open-loop drug therapy (control)!! Assumptions!! Initial condition known without error!! No disturbance!! Optimal closed-loop therapy!! Assumptions!! Small error in initial condition!! Small disturbance!! Perfect measurement of state!! Stochastic optimal closed-loop therapy!! Assumptions!! Small error in initial condition!! Small disturbance!! Imperfect measurement!! Certainty-equivalence applies to perturbation control 48
25 Immune Response Example with Optimal Feedback Control Open-Loop Optimal Control for Lethal Initial Condition Open- and Closed-Loop Optimal Control for 150 Lethal Initial Condition Ghigliazza, Kulkarni, Stengel, Immune Response with Full-State Stochastic Optimal Feedback Control (Random Disturbance and Measurement Error Not Simulated) Low-Bandwidth Estimator ( W < N ) High-Bandwidth Estimator ( W > N )!! Initial control too sluggish to prevent divergence Ghigliazza, Stengel, 2004!! Quick initial control prevents divergence 50
26 Stochastic-Optimal Control (u 1 ) with Two Measurements (x 1, x 3 ) W = I 4 N = I 2 / Immune Response to Random Disturbance with Two-Measurement Stochastic Neighboring-Optimal Control Disturbance due to! Re-infection! Sequestered pockets of pathogen Noisy measurements Closed-loop therapy is robust... but not robust enough:! Organ death occurs in one case Probability of satisfactory therapy can be maximized by stochastic redesign of controller 52
27 The End! Thank you! 53
Stochastic Optimal Control!
Stochastic Control! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2015 Learning Objectives Overview of the Linear-Quadratic-Gaussian (LQG) Regulator Introduction to Stochastic
More informationUncertain Systems. Robust vs. Adaptive Control. Generic Dynamic System ( Plant )
Uncertain Systems Stochastic Robustness of Control Systems Robert Stengel Princeton University May 2009 Robustness Monte Carlo Evaluation Confidence Interval vs. Number of Trials Robustness Benchmark Problem
More informationStochastic and Adaptive Optimal Control
Stochastic and Adaptive Optimal Control Robert Stengel Optimal Control and Estimation, MAE 546 Princeton University, 2018! Nonlinear systems with random inputs and perfect measurements! Stochastic neighboring-optimal
More informationReturn Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems
Spectral Properties of Linear- Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018! Stability margins of single-input/singleoutput (SISO) systems! Characterizations
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationNonlinear State Estimation! Extended Kalman Filters!
Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal
More informationTime-Invariant Linear Quadratic Regulators!
Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 17 Asymptotic approach from time-varying to constant gains Elimination of cross weighting
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2018 Copyright 2018 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More informationTime-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015
Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 15 Asymptotic approach from time-varying to constant gains Elimination of cross weighting
More informationFirst-Order Low-Pass Filter!
Filters, Cost Functions, and Controller Structures! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 217!! Dynamic systems as low-pass filters!! Frequency response of dynamic
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2017 Copyright 2017 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More informationDynamic Optimal Control!
Dynamic Optimal Control! Robert Stengel! Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Learning Objectives Examples of cost functions Necessary conditions for optimality Calculation
More informationHere represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.
19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that
More informationChapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control
Chapter 3 LQ, LQG and Control System H 2 Design Overview LQ optimization state feedback LQG optimization output feedback H 2 optimization non-stochastic version of LQG Application to feedback system design
More informationLQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin
LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system
More informationEvery real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics
Sensitivity Analysis of Disturbance Accommodating Control with Kalman Filter Estimation Jemin George and John L. Crassidis University at Buffalo, State University of New York, Amherst, NY, 14-44 The design
More informationFirst-Order Low-Pass Filter
Filters, Cost Functions, and Controller Structures Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Dynamic systems as low-pass filters! Frequency response of dynamic systems!
More informationEL2520 Control Theory and Practice
EL2520 Control Theory and Practice Lecture 8: Linear quadratic control Mikael Johansson School of Electrical Engineering KTH, Stockholm, Sweden Linear quadratic control Allows to compute the controller
More informationControl Systems! Copyright 2017 by Robert Stengel. All rights reserved. For educational use only.
Control Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Analog vs. digital systems Continuous- and Discretetime Dynamic Models Frequency Response Transfer Functions
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 25 January 2006 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More informationSteady State Kalman Filter
Steady State Kalman Filter Infinite Horizon LQ Control: ẋ = Ax + Bu R positive definite, Q = Q T 2Q 1 2. (A, B) stabilizable, (A, Q 1 2) detectable. Solve for the positive (semi-) definite P in the ARE:
More informationLinearized Equations of Motion!
Linearized Equations of Motion Robert Stengel, Aircraft Flight Dynamics MAE 331, 216 Learning Objectives Develop linear equations to describe small perturbational motions Apply to aircraft dynamic equations
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More information5. Observer-based Controller Design
EE635 - Control System Theory 5. Observer-based Controller Design Jitkomut Songsiri state feedback pole-placement design regulation and tracking state observer feedback observer design LQR and LQG 5-1
More informationTopic # Feedback Control Systems
Topic #17 16.31 Feedback Control Systems Deterministic LQR Optimal control and the Riccati equation Weight Selection Fall 2007 16.31 17 1 Linear Quadratic Regulator (LQR) Have seen the solutions to the
More informationSYSTEMTEORI - KALMAN FILTER VS LQ CONTROL
SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic
More informationIntroduction to Optimization!
Introduction to Optimization! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2017 Optimization problems and criteria Cost functions Static optimality conditions Examples
More information6 OUTPUT FEEDBACK DESIGN
6 OUTPUT FEEDBACK DESIGN When the whole sate vector is not available for feedback, i.e, we can measure only y = Cx. 6.1 Review of observer design Recall from the first class in linear systems that a simple
More informationState Observers and the Kalman filter
Modelling and Control of Dynamic Systems State Observers and the Kalman filter Prof. Oreste S. Bursi University of Trento Page 1 Feedback System State variable feedback system: Control feedback law:u =
More informationAutomatic Control II Computer exercise 3. LQG Design
Uppsala University Information Technology Systems and Control HN,FS,KN 2000-10 Last revised by HR August 16, 2017 Automatic Control II Computer exercise 3 LQG Design Preparations: Read Chapters 5 and 9
More informationNonlinear State Estimation! Particle, Sigma-Points Filters!
Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!
More informationLecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004
MER42 Advanced Control Lecture 9 Introduction to Kalman Filtering Linear Quadratic Gaussian Control (LQG) G. Hovland 24 Announcement No tutorials on hursday mornings 8-9am I will be present in all practical
More informationExam. 135 minutes, 15 minutes reading time
Exam August 6, 208 Control Systems II (5-0590-00) Dr. Jacopo Tani Exam Exam Duration: 35 minutes, 5 minutes reading time Number of Problems: 35 Number of Points: 47 Permitted aids: 0 pages (5 sheets) A4.
More informationLecture 10 Linear Quadratic Stochastic Control with Partial State Observation
EE363 Winter 2008-09 Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation partially observed linear-quadratic stochastic control problem estimation-control separation principle
More informationLinear State Feedback Controller Design
Assignment For EE5101 - Linear Systems Sem I AY2010/2011 Linear State Feedback Controller Design Phang Swee King A0033585A Email: king@nus.edu.sg NGS/ECE Dept. Faculty of Engineering National University
More informationAdaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018
Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Nonlinearity of adaptation! Parameter-adaptive filtering! Test for whiteness of the residual!
More informationLecture 7 LQG Design. Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for MIMO plant
L7: Lecture 7 LQG Design Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for IO plant LQG regulator L7:2 If the process and measurement noises
More informationNonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México
Nonlinear Observers Jaime A. Moreno JMorenoP@ii.unam.mx Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México XVI Congreso Latinoamericano de Control Automático October
More informationDepartment of Electronics and Instrumentation Engineering M. E- CONTROL AND INSTRUMENTATION ENGINEERING CL7101 CONTROL SYSTEM DESIGN Unit I- BASICS AND ROOT-LOCUS DESIGN PART-A (2 marks) 1. What are the
More informationOptimization-Based Control
Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This
More informationChapter 9 Observers, Model-based Controllers 9. Introduction In here we deal with the general case where only a subset of the states, or linear combin
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology c Chapter 9 Observers,
More informationLinear-Optimal State Estimation
Linear-Optimal State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218 Linear-optimal Gaussian estimator for discrete-time system (Kalman filter) 2 nd -order example
More informationOptimization-Based Control
Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7b, 23 February 2008 c California Institute of Technology All rights reserved. This
More informationState Regulator. Advanced Control. design of controllers using pole placement and LQ design rules
Advanced Control State Regulator Scope design of controllers using pole placement and LQ design rules Keywords pole placement, optimal control, LQ regulator, weighting matrixes Prerequisites Contact state
More informationOptimization-Based Control
Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v2.1a, January 3, 2010 c California Institute of Technology All rights reserved. This
More informationControl Systems. State Estimation.
State Estimation chibum@seoultech.ac.kr Outline Dominant pole design Symmetric root locus State estimation We are able to place the CLPs arbitrarily by feeding back all the states: u = Kx. But these may
More informationLQG/LTR CONTROLLER DESIGN FOR AN AIRCRAFT MODEL
PERIODICA POLYTECHNICA SER. TRANSP. ENG. VOL. 8, NO., PP. 3 4 () LQG/LTR CONTROLLER DESIGN FOR AN AIRCRAFT MODEL Balázs KULCSÁR Department of Control and Transport Automation Budapest University of Technology
More informationEL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1)
EL 625 Lecture 0 EL 625 Lecture 0 Pole Placement and Observer Design Pole Placement Consider the system ẋ Ax () The solution to this system is x(t) e At x(0) (2) If the eigenvalues of A all lie in the
More informationContents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31
Contents Preamble xiii Linear Systems I Basic Concepts 1 I System Representation 3 1 State-Space Linear Systems 5 1.1 State-Space Linear Systems 5 1.2 Block Diagrams 7 1.3 Exercises 11 2 Linearization
More informationAutonomous Mobile Robot Design
Autonomous Mobile Robot Design Topic: Guidance and Control Introduction and PID Loops Dr. Kostas Alexis (CSE) Autonomous Robot Challenges How do I control where to go? Autonomous Mobile Robot Design Topic:
More informationIterative Learning Control Analysis and Design I
Iterative Learning Control Analysis and Design I Electronics and Computer Science University of Southampton Southampton, SO17 1BJ, UK etar@ecs.soton.ac.uk http://www.ecs.soton.ac.uk/ Contents Basics Representations
More informationOverview of the Seminar Topic
Overview of the Seminar Topic Simo Särkkä Laboratory of Computational Engineering Helsinki University of Technology September 17, 2007 Contents 1 What is Control Theory? 2 History
More informationContents. PART I METHODS AND CONCEPTS 2. Transfer Function Approach Frequency Domain Representations... 42
Contents Preface.............................................. xiii 1. Introduction......................................... 1 1.1 Continuous and Discrete Control Systems................. 4 1.2 Open-Loop
More informationSequential State Estimation (Crassidas and Junkins, Chapter 5)
Sequential State Estimation (Crassidas and Junkins, Chapter 5) Please read: 5.1, 5.3-5.6 5.3 The Discrete-Time Kalman Filter The discrete-time Kalman filter is used when the dynamics and measurements are
More informationOptimal control and estimation
Automatic Control 2 Optimal control and estimation Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011
More informationSubject: Optimal Control Assignment-1 (Related to Lecture notes 1-10)
Subject: Optimal Control Assignment- (Related to Lecture notes -). Design a oil mug, shown in fig., to hold as much oil possible. The height and radius of the mug should not be more than 6cm. The mug must
More informationEE C128 / ME C134 Final Exam Fall 2014
EE C128 / ME C134 Final Exam Fall 2014 December 19, 2014 Your PRINTED FULL NAME Your STUDENT ID NUMBER Number of additional sheets 1. No computers, no tablets, no connected device (phone etc.) 2. Pocket
More informationPredictive Control of Gyroscopic-Force Actuators for Mechanical Vibration Damping
ARC Centre of Excellence for Complex Dynamic Systems and Control, pp 1 15 Predictive Control of Gyroscopic-Force Actuators for Mechanical Vibration Damping Tristan Perez 1, 2 Joris B Termaat 3 1 School
More informationOptimal Polynomial Control for Discrete-Time Systems
1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should
More information6.241 Dynamic Systems and Control
6.241 Dynamic Systems and Control Lecture 24: H2 Synthesis Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology May 4, 2011 E. Frazzoli (MIT) Lecture 24: H 2 Synthesis May
More informationControls Problems for Qualifying Exam - Spring 2014
Controls Problems for Qualifying Exam - Spring 2014 Problem 1 Consider the system block diagram given in Figure 1. Find the overall transfer function T(s) = C(s)/R(s). Note that this transfer function
More informationNumerical atmospheric turbulence models and LQG control for adaptive optics system
Numerical atmospheric turbulence models and LQG control for adaptive optics system Jean-Pierre FOLCHER, Marcel CARBILLET UMR6525 H. Fizeau, Université de Nice Sophia-Antipolis/CNRS/Observatoire de la Côte
More informationDISCRETE-TIME ADAPTIVE LQG/LTR CONTROL
DISCRETE-TIME ADAPTIVE LQG/LTR CONTROL DARIUSZ HORLA Poznan University of Technology Inst. of Control and Inf. Eng. ul. Piotrowo 3a, 6-965 Poznan POLAND ANDRZEJ KRÓLIKOWSKI Poznan University of Technology
More informationStochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents
Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents
More informationThe Kalman filter. Chapter 6
Chapter 6 The Kalman filter In the last chapter, we saw that in Data Assimilation, we ultimately desire knowledge of the full a posteriori p.d.f., that is the conditional p.d.f. of the state given the
More informationI. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching
I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 1 Adaptive Control Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 2 Outline
More informationDr Ian R. Manchester Dr Ian R. Manchester AMME 3500 : Review
Week Date Content Notes 1 6 Mar Introduction 2 13 Mar Frequency Domain Modelling 3 20 Mar Transient Performance and the s-plane 4 27 Mar Block Diagrams Assign 1 Due 5 3 Apr Feedback System Characteristics
More informationMulti-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures
Preprints of the 19th World Congress The International Federation of Automatic Control Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures Eric Peterson Harry G.
More informationAlternative Expressions for the Velocity Vector Velocity restricted to the vertical plane. Longitudinal Equations of Motion
Linearized Longitudinal Equations of Motion Robert Stengel, Aircraft Flig Dynamics MAE 33, 008 Separate solutions for nominal and perturbation flig paths Assume that nominal path is steady and in the vertical
More informationProbabilistic Control of Nonlinear Uncertain Systems
Probabilistic Control of Nonlinear Uncertain Systems Qian Wang 1 and Robert F. Stengel 2 1 Mechanical Engineering, Penn State University, University Park, PA 1682, quw6@psu.edu 2 Mechanical and Aerospace
More informationQuis custodiet ipsos custodes?
Quis custodiet ipsos custodes? James B. Rawlings, Megan Zagrobelny, Luo Ji Dept. of Chemical and Biological Engineering, Univ. of Wisconsin-Madison, WI, USA IFAC Conference on Nonlinear Model Predictive
More informationEfficient Minimax Control Design for Prescribed Parameter Uncertainty
JOURNAL OF GUIDANCE, CONTROL, AND DYNAMICS Vol. 27, No. 6, November December 2004 Efficient Minimax Control Design for Prescribed Parameter Uncertainty Dirk Tenne and Tarunraj Singh State University of
More informationRECURSIVE ESTIMATION AND KALMAN FILTERING
Chapter 3 RECURSIVE ESTIMATION AND KALMAN FILTERING 3. The Discrete Time Kalman Filter Consider the following estimation problem. Given the stochastic system with x k+ = Ax k + Gw k (3.) y k = Cx k + Hv
More informationRobust Control 5 Nominal Controller Design Continued
Robust Control 5 Nominal Controller Design Continued Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University 4/14/2003 Outline he LQR Problem A Generalization to LQR Min-Max
More informationCONTROL DESIGN FOR SET POINT TRACKING
Chapter 5 CONTROL DESIGN FOR SET POINT TRACKING In this chapter, we extend the pole placement, observer-based output feedback design to solve tracking problems. By tracking we mean that the output is commanded
More informationClosed-loop system 2/1/2016. Generally MIMO case. Two-degrees-of-freedom (2 DOF) control structure. (2 DOF structure) The closed loop equations become
Closed-loop system enerally MIMO case Two-degrees-of-freedom (2 DOF) control structure (2 DOF structure) 2 The closed loop equations become solving for z gives where is the closed loop transfer function
More informationDesign of Robust Controllers for Gas Turbine Engines
E THE AMERICAN SOCIETY OF MECHANICAL ENGINEERS y^ 345 E. 47 St., New York, N.Y. 117 s The Society shall not be responsible for statements or opinions advanced in papers or in discussion at meetings of
More informationLinear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013
Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013 Abstract As in optimal control theory, linear quadratic (LQ) differential games (DG) can be solved, even in high dimension,
More information= m(0) + 4e 2 ( 3e 2 ) 2e 2, 1 (2k + k 2 ) dt. m(0) = u + R 1 B T P x 2 R dt. u + R 1 B T P y 2 R dt +
ECE 553, Spring 8 Posted: May nd, 8 Problem Set #7 Solution Solutions: 1. The optimal controller is still the one given in the solution to the Problem 6 in Homework #5: u (x, t) = p(t)x k(t), t. The minimum
More informationLecture 7 : Generalized Plant and LFT form Dr.-Ing. Sudchai Boonto Assistant Professor
Dr.-Ing. Sudchai Boonto Assistant Professor Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Linear Quadratic Gaussian The state space
More informationLinear-Quadratic Control System Design
Linear-Quadratic Control Sytem Deign Robert Stengel Optimal Control and Etimation MAE 546 Princeton Univerity, 218! Control ytem configuration! Proportional-integral! Proportional-integral-filtering! Model
More informationTopic # Feedback Control
Topic #5 6.3 Feedback Control State-Space Systems Full-state Feedback Control How do we change the poles of the state-space system? Or,evenifwecanchangethepolelocations. Where do we put the poles? Linear
More informationMinimization with Equality Constraints
Path Constraints and Numerical Optimization Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2015 State and Control Equality Constraints Pseudoinverse State and Control Inequality
More informationOutline. Linear regulation and state estimation (LQR and LQE) Linear differential equations. Discrete time linear difference equations
Outline Linear regulation and state estimation (LQR and LQE) James B. Rawlings Department of Chemical and Biological Engineering 1 Linear Quadratic Regulator Constraints The Infinite Horizon LQ Problem
More informationTopic # Feedback Control Systems
Topic #19 16.31 Feedback Control Systems Stengel Chapter 6 Question: how well do the large gain and phase margins discussed for LQR map over to DOFB using LQR and LQE (called LQG)? Fall 2010 16.30/31 19
More informationMathematical Theory of Control Systems Design
Mathematical Theory of Control Systems Design by V. N. Afarias'ev, V. B. Kolmanovskii and V. R. Nosov Moscow University of Electronics and Mathematics, Moscow, Russia KLUWER ACADEMIC PUBLISHERS DORDRECHT
More informationMin-Max Output Integral Sliding Mode Control for Multiplant Linear Uncertain Systems
Proceedings of the 27 American Control Conference Marriott Marquis Hotel at Times Square New York City, USA, July -3, 27 FrC.4 Min-Max Output Integral Sliding Mode Control for Multiplant Linear Uncertain
More informationPrediction, filtering and smoothing using LSCR: State estimation algorithms with guaranteed confidence sets
2 5th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC) Orlando, FL, USA, December 2-5, 2 Prediction, filtering and smoothing using LSCR: State estimation algorithms with
More informationDesign Methods for Control Systems
Design Methods for Control Systems Maarten Steinbuch TU/e Gjerrit Meinsma UT Dutch Institute of Systems and Control Winter term 2002-2003 Schedule November 25 MSt December 2 MSt Homework # 1 December 9
More informationLINEAR QUADRATIC GAUSSIAN
ECE553: Multivariable Control Systems II. LINEAR QUADRATIC GAUSSIAN.: Deriving LQG via separation principle We will now start to look at the design of controllers for systems Px.t/ D A.t/x.t/ C B u.t/u.t/
More informationModeling and Control Overview
Modeling and Control Overview D R. T A R E K A. T U T U N J I A D V A N C E D C O N T R O L S Y S T E M S M E C H A T R O N I C S E N G I N E E R I N G D E P A R T M E N T P H I L A D E L P H I A U N I
More informationPerformance assessment of MIMO systems under partial information
Performance assessment of MIMO systems under partial information H Xia P Majecki A Ordys M Grimble Abstract Minimum variance (MV) can characterize the most fundamental performance limitation of a system,
More informationA Crash Course on Kalman Filtering
A Crash Course on Kalman Filtering Dan Simon Cleveland State University Fall 2014 1 / 64 Outline Linear Systems Probability State Means and Covariances Least Squares Estimation The Kalman Filter Unknown
More informationPole placement control: state space and polynomial approaches Lecture 2
: state space and polynomial approaches Lecture 2 : a state O. Sename 1 1 Gipsa-lab, CNRS-INPG, FRANCE Olivier.Sename@gipsa-lab.fr www.gipsa-lab.fr/ o.sename -based November 21, 2017 Outline : a state
More informationTopic # Feedback Control. State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback
Topic #17 16.31 Feedback Control State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback Back to reality Copyright 21 by Jonathan How. All Rights reserved 1 Fall
More informationFall 線性系統 Linear Systems. Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian. NTU-EE Sep07 Jan08
Fall 2007 線性系統 Linear Systems Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian NTU-EE Sep07 Jan08 Materials used in these lecture notes are adopted from Linear System Theory & Design, 3rd.
More information6.435, System Identification
SET 6 System Identification 6.435 Parametrized model structures One-step predictor Identifiability Munther A. Dahleh 1 Models of LTI Systems A complete model u = input y = output e = noise (with PDF).
More informationAn insight into noise covariance estimation for Kalman filter design
Preprints of the 19th World Congress The International Federation of Automatic Control An insight into noise covariance estimation for Kalman filter design Simone Formentin, Sergio Bittanti (IFAC Fellow)
More informationCOMPOSITE OPTIMAL CONTROL FOR INTERCONNECTED SINGULARLY PERTURBED SYSTEMS. A Dissertation by. Saud A. Alghamdi
COMPOSITE OPTIMAL CONTROL FOR INTERCONNECTED SINGULARLY PERTURBED SYSTEMS A Dissertation by Saud A. Alghamdi Master of Mathematical Science, Queensland University of Technology, 21 Bachelor of Mathematics,
More informationSpectral factorization and H 2 -model following
Spectral factorization and H 2 -model following Fabio Morbidi Department of Mechanical Engineering, Northwestern University, Evanston, IL, USA MTNS - July 5-9, 2010 F. Morbidi (Northwestern Univ.) MTNS
More information