Stochastic Optimal Control!
|
|
- Melissa Dawson
- 6 years ago
- Views:
Transcription
1 Stochastic Control! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2015 Learning Objectives Overview of the Linear-Quadratic-Gaussian (LQG) Regulator Introduction to Stochastic Robust Control Laws Copyright 2015 by Robert Stengel. All rights reserved. For educational use only. 1 Stochastic Optimal Control! 2
2 Deterministic vs. Stochastic Optimal Control Deterministic control! Known dynamic process precise input precise initial condition precise measurement! Optimal control minimizes J* = J(x*, u*) Stochastic control! Known dynamic process unknown input imprecise initial condition imprecise or incomplete measurement! Optimal control minimizes E{J[x*, u*]} 3 Linear-Quadratic-Gaussian (LQG) Control of a Dynamic Process! z(t) = Hx(t) + n(t) [ ] ˆ!x(t) = F(t)ˆx(t) + G(t)u(t) + K(t) z(t)! Hˆx(t) u(t) =!C(t) ˆx(t) + u command 4
3 Linear-Quadratic (LQ) Control Equations (Continuous-Time Model) Open-Loop System State Dynamics u t = Fx(t) + Gu( t)!x t Control Law =!Cx(t) + u command Closed-Loop System State Dynamics!x ( t) = ( F! GC)x(t) + GCu command Characteristic Equation si! ( F! GC) = 0 How many eigenvalues? n Stable or unstable? Stable, with correct design criteria, F, and G 5 Linear-Quadratic-Gaussian (LQG) Control Equations (Continuous-Time Model) Open-Loop System State Dynamics and Measurement ˆ!x t = Fx(t) + Gu(t) + Lw(t) z( t) = Hx( t) + n( t)!x t State Estimate = Fˆx(t) + Gu(t) + K z( t)! Hˆx ( t) " Control Law u( t) =!Cˆx(t) + u command 6
4 Linear-Quadratic-Gaussian (LQG) Control Equations (Continuous-Time Model) Closed-Loop System State and Estimate Dynamics (neglect command) = Fx(t) + G!Cˆx(t)!x t ˆ!x ( t) = Fˆx(t) + G!Cˆx(t) [ ]+ Lw(t) [ ]+ K " z( t)! Hˆx ( t) How many eigenvalues? 2n Stable or unstable? TBD 7 LQG Separation Property Optimal estimation algorithm does not depend on the optimal control algorithm = P(t)H T N!1 ( t) L T ( t)! P(t)H T N!1 t K t!p(t) = F(t)P(t) + P(t)F T (t) + L( t)w t HP(t) Optimal control algorithm does not depend on the optimal estimation algorithm C t = R!1 t!s ( t) =!Q(t)! F(t) T S( t)! S t G T ( t)s( t) F(t) + S( t)g(t)r!1 (t)g T (t)s t 8
5 LQG Certainty Equivalence Stochastic feedback control is computed from optimal estimate of the state u*(t) =!R!1 G T (t)s(t)ˆx(t) =!C(t) ˆx(t) Stochastic feedback control law is the same as the deterministic control law u*(t) =!R!1 G T (t)s(t)x(t) =!C(t) x(t) 9 Asymptotic Stability of the LQG Regulator! (with no parameter uncertainty)! 10
6 System Equations with LQG Control With perfect knowledge of the system!x ( t) = Fx(t) + G [!Cˆx(t) ]+ Lw(t) ˆ!x ( t) = Fˆx(t) + G!Cˆx(t) [ ]+ K " z( t)! Hˆx ( t) State estimate error!( t)! x( t) " ˆx ( t) State estimate error dynamics!( t) = ( F " KH)! ( t) + Lw t " Kn( t) 11 Control-Loop and Estimator Eigenvalues are Uncoupled "!x t! t ' ' = " ( F ( GC) GC 0 F ( KH " ' ' x t! t ' ' + " L 0 L (K " ' w t n t ' ' Upper-block-triangular stability matrix LQG system is stable because (F GC) is stable (F KH) is stable Estimate error affects state response = F! GC!x t x t + GC" ( t) + Lw( t) Actual state does not affect error response Disturbance affects both equally 12
7 Discrete-Time LQG Controller Kalman filter produces state estimate = "ˆx k!1 ( + )! C k!1ˆx k!1 ( + ) ˆx k! ˆx k ( + ) = ˆx k (!) + K k z k! Hˆx k (!) u k =!C k ˆx k ( + ) " Closed-loop system uses state estimate for feedback control (u command = 0) x k+1 (!) = "x k (!)! C k ˆx k ( + ) 13 Response of Discrete-Time 1 st -Order System to Disturbance, and Kalman Filter Estimate from Noisy Measurement Propagation of Uncertainty Kalman Filter, Uncontrolled System 14
8 Comparison of 1 st -Order Discrete-Time LQ and LQG Control Response Linear-Quadratic Control with Noise-free Measurement Linear-Quadratic-Gaussian Control with Noisy Measurement 15 MATLAB Demo: LQG Rolling Mill Control System Design Example Open- and Closed-Loop Response Maintain desired thickness of shaped beam Account for random! variations in thickness/ hardness of incoming beam! eccentricity in rolling cylinders! measurement errors 16
9 Robust Stochastic Control! 17 Stochastic, Robust, and Adaptive Control Stochastic controller minimize response to random initial conditions, disturbances, and measurement errors perfect knowledge of the plant Robust controller fixed gains and structure minimize likelihood of instability or unsatisfactory performance due to parameter uncertainty in the plant Adaptive controller variable gains and/or structure minimize likelihood of instability or unsatisfactory performance due to plant parameter uncertainty, disturbances, and measurement errors Practical controller may have elements of all three 18
10 Robust Control System Design Make closed-loop response insensitive to plant parameter variations Robust controller! Fixed gains and structure! Minimize likelihood of instability! Minimize likelihood of unsatisfactory performance 19 Probabilistic Robust Control Design Design a fixed-parameter controller for stochastic robustness Monte Carlo Evaluation of competing designs Genetic Algorithm or Simulated Annealing search for best design 20
11 Representations of Uncertainty Characteristic equation of the uncontrolled system si! F = det( si! F)! "(s) = s n + a n!1 s n! a 1 s + a 0 ( s! 2 )(...)( s! n ) = 0 = s! 1 Uncertainty can be expressed in! Elements of F! Coefficients of "(s)! Eigenvalues of F 21 Root Locations for an Uncertain 2 nd -Order System Variation may be represented by! Worst-case, e.g., Upper/lower bounds of uniform distribution! Probability, e.g., Gaussian distribution Uniform Distribution Gaussian Distribution s Plane s Plane 22
12 3-D Stochastic Root Loci for 2 nd -Order Example Root distributions are nonlinear functions of parameter distributions Unbounded parameter distributions always lead to non-zero probability of instability Bounded distributions may be guaranteed to be stable 23 Probability of Satisfying a Design Metric Pr(d,v)! 1 N N i=1 e" C( d), H ( v) Probability of satisfying a design metric! d: Control design parameter vector [e.g., SA, GA, ]! v: Uncertain plant parameter vector [e.g., RNG]! e: Binary indicator, e.g.,! 0: satisfactory 1: unsatisfactory! H(v): Plant! C(d): Controller (Compensator) 24
13 Design Control System to Minimize Probability of Instability Characteristic equation of the closed-loop system! closed"loop (s) = si " F( v) " G( v)c( d) ( s " ' 2 )(...)( s " ' n ) = s " ' 1 closed"loop = 0 Monte Carlo evaluation of probability of instability with uncertain plant parameters Minimize probability of instability using numerical search of control parameters { } min Pr Re! i, i = 1,n d " > 0 25 Control Design Example* u k w y m 1 m 2 Challenge: Design a feedback compensator for a 4 th -order spring-mass system ( the plant ) whose parameters are bounded but unknown! Minimize the likelihood of instability! Satisfy a settling time requirement! Don t use too much control * 1990 American Control Conference Robust Control Benchmark Problem 26
14 Design Cost Function Probability of Instability, Pr i! e i = 1 (unstable) or 0 (stable) Probability of Settling Time Exceedance, Pr ts! e ts = 1 (exceeded) or 0 (not exceeded) Probability of Control Limit Exceedance, Pr u! e u = 1 (exceeded) or 0 (not exceeded) Each metric has a binomial distribution pr( x) = n! k! ( n! k)! p x ( n!k )k " 1! p( x)! ' ( n k ) * + p( x n!k )k " 1! p( x) = probability of exactly k successes in n trials, in 0,1 ~ normal distribution for large n Design Cost Function! High probabilities weighted more than low probabilities! J = apr 2 i + bpr 2 ts + c Pr 2 u! a = 1! b = c = Monte Carlo Evaluation of Probability of Satisfying a Design Metric 1e+09 N Pr k (d,v)! 1 e k C( d), H ( v) N ", k = 1,3 i=1 J = apr i 2 (d,v) + bpr ts 2 (d,v) + cpr u 2 (d,v) Number of Evaluations 1e+07 1e+05 1e+03 Interval Width e+01 1e-06 1e-05 1e Probability or (1 - Probability Binomial Distribution Compute v using random number generators over N trials! Required number of trials depends on outcome probability and desired confidence interval Search for best d using a genetic algorithm to minimize J 28
15 Uncertain Plant* w k u y m 1 m 2 y = x 2 + n Plant dynamic equation! "!x 1!x 2!x 3!x 4! = " ' k m 1 k m k m 2 ' k m 2 0 0! " x 1 x 2 x 3 x 4! + " m 1 0! u + " m 2 w 4 th -Order Plant characteristic equation "!(s) = s 2 s 2 + k m + m 1 2 m 1 m 2 ' = s 2 s 2 2 " n * 1990 American Control Conference Robust Control Benchmark Problem 29 Parameter Uncertainties, Root Locus, and Control Law Parameters of massspring system! Uniform probability density functions for 0.5 < m 1, m 2 < < k < 2 Effects of parameters on root locations (right) x xx x "!(s) = s 2 s 2 + k m 1 + m 2 ' = s 2 s 2 2 m 1 m " n 2 Single-input/single-output feedback control law u( s) =!C ( s)y( s) 30
16 Mass-Spring-Mass Stabilization Requires Compensation Proportional feedback alone cannot stabilize the system Feedback of either sign drives at least one root into the right half plane u( s) =!cy( s) 31 Search-and-Sweep Design of Family of Robust Feedback Compensators Begin with lowest-order feedback compensator C 12 (s) = a 0 + a 1 s b 0 + b 1 s + b 2 s 2! C d Arrange parameters as binary design vector { } d = a 0,a 1,b 0,b 1,b 2 d* = { a 0 *,a 1 *,b 0 *,b 1 *,b 2 *} Search for design vector, d, that minimizes J m 1 = rand 1 m 2 = rand k =!1.5 *rand 1 Monte Carlo evaluation with uncertain parameters, v 32
17 Search-and-Sweep Design of Family of Robust Feedback Compensators 1) Define next higher-order compensator C 22 (s) = a 0 + a 1 s + a 2 s 2 b 0 + b 1 s + b 2 s 2 2) Optimize over all parameters, including optimal coefficients in starting population d = { a 0 *,a 1 *,a 2,b 0 *,b 1 *,b 2 *}! d ** = { a 0 **,a 1 **,a 2 **,b 0 **,b 1 **,b 2 **} 3) Sweep to satisfactory design or no further improvement C 23 (s) = a 0 + a 1 s + a 2 s 2 b 0 + b 1 s + b 2 s 2 + b 3 s 3 C 33 (s) = a 0 + a 1 s + a 2 s 2 + a 3 s 3 b 0 + b 1 s + b 2 s 2 + b 3 s 3 C 34 (s) = a 0 + a 1 s + a 2 s 2 + a 3 s 3 b 0 + b 1 s + b 2 s 2 + b 3 s 3 + b 4 s Design Cost and Probabilities for Optimal 2 nd - to 5 th -Order Compensators Number of Zeros = Number of Poles nd Order 3rd Order 4th Order 5th Order Cost Prob Instab Prob Ts Viol x 0.01 Prob Cont Viol x
18 Next Time:! Parameter Estimation and Adaptive Control! 35 Supplemental Material 36
19 Linear-Quadratic Gaussian Optimal Control Law Minimize expected value of cost, subject to uncertainty* min E(J)! E(J*) u Stochastic optimal feedback control law combines the linear-optimal control law with a linear-optimal state estimate u*(t) =!R!1 G T (t)s(t)ˆx(t) =!C(t) ˆx(t)! where ˆx(t) is an optimal estimate of the state perturbation * See reading for details 37 Example: Probability of Stable Control of an Unstable Plant X-29 Aircraft Longitudinal dynamics for a Forward-Swept-Wing Demonstrator F =!2gf 11 / V "V 2 f 12 / 2 "Vf 13!g!45 / V 2 "Vf 22 / "V 2 f 32 / 2 "Vf ( ( (; G = ( ( ' g 11 g g 31 g V ( ( ; x = ( ( q ( ( '( * ( ' Nominal eigenvalues (one unstable)! 1" 4 = "0.1 ± j, " 5.15, 3.35 Air density and airspeed,! and V, have uniform distributions(±30) 10 coefficients have Gaussian distributions (! = 30) p = "! V f 11 f 12 f 13 f 22 f 32 f 33 g 11 g 12 g 31 g 32 T Environment Uncontrolled Dynamics Control Effect 38
20 LQ Regulators for the Example Three stabilizing feedback control laws Case a) LQR with low control weighting Case b) LQR with high control weighting Q = diag( 1,1,1,0 ); R = ( 1,1);! 1" 4nominal = 35, 5.1, 3.3,.02 C = "11 "3 "1.1 Q = diag( 1,1,1,0 ); R = ( 1000,1000);! 1" 4nominal = "5.2,"3.4,"1.1,".02 C = " "63 "16 "1.9 ( ' ( ' Case c) Case b with gains multiplied by 5 for bandwidth (loop-transfer) recovery! 1" 4nominal = "32, 5.2, 3.4, 0.01 C = " "313 "81 "1.1" 9.5 ( ' 39 Stochastic Robustness! (Ray, Stengel, 1991) "! Distribution of closed-loop roots with "! Gaussian uncertainty in 10 parameters "! Uniform uncertainty in velocity and air density "! 25,000 Monte Carlo evaluations "! Probability of instability "! a) Pr = "! b) Pr = "! c) Pr = Stochastic Root Locus 40
21 Probabilities of Instability for the Three Cases 41 Case a: Low LQ Control Weights Stochastic Root Loci for the Three Cases with Gaussian Aerodynamic Uncertainty! Case b: High LQ Control Weights Probabilities of instability with 30 uniform aerodynamic uncertainty!! Case a: 3.4 x 10-4!! Case b: 0!! Case c: 0! Case c: Bandwidth Recovery 42
Linear-Quadratic-Gaussian Controllers!
Linear-Quadratic-Gaussian Controllers! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 2017!! LTI dynamic system!! Certainty Equivalence and the Separation Theorem!! Asymptotic
More informationUncertain Systems. Robust vs. Adaptive Control. Generic Dynamic System ( Plant )
Uncertain Systems Stochastic Robustness of Control Systems Robert Stengel Princeton University May 2009 Robustness Monte Carlo Evaluation Confidence Interval vs. Number of Trials Robustness Benchmark Problem
More informationReturn Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems
Spectral Properties of Linear- Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018! Stability margins of single-input/singleoutput (SISO) systems! Characterizations
More informationStochastic and Adaptive Optimal Control
Stochastic and Adaptive Optimal Control Robert Stengel Optimal Control and Estimation, MAE 546 Princeton University, 2018! Nonlinear systems with random inputs and perfect measurements! Stochastic neighboring-optimal
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2018 Copyright 2018 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More informationTime-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015
Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 15 Asymptotic approach from time-varying to constant gains Elimination of cross weighting
More informationFirst-Order Low-Pass Filter!
Filters, Cost Functions, and Controller Structures! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 217!! Dynamic systems as low-pass filters!! Frequency response of dynamic
More informationTime-Invariant Linear Quadratic Regulators!
Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 17 Asymptotic approach from time-varying to constant gains Elimination of cross weighting
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationChapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control
Chapter 3 LQ, LQG and Control System H 2 Design Overview LQ optimization state feedback LQG optimization output feedback H 2 optimization non-stochastic version of LQG Application to feedback system design
More informationHere represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.
19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that
More informationIntroduction to Optimization!
Introduction to Optimization! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2017 Optimization problems and criteria Cost functions Static optimality conditions Examples
More informationEvery real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics
Sensitivity Analysis of Disturbance Accommodating Control with Kalman Filter Estimation Jemin George and John L. Crassidis University at Buffalo, State University of New York, Amherst, NY, 14-44 The design
More informationControl Systems! Copyright 2017 by Robert Stengel. All rights reserved. For educational use only.
Control Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Analog vs. digital systems Continuous- and Discretetime Dynamic Models Frequency Response Transfer Functions
More informationTopic # Feedback Control. State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback
Topic #17 16.31 Feedback Control State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback Back to reality Copyright 21 by Jonathan How. All Rights reserved 1 Fall
More informationDynamic Optimal Control!
Dynamic Optimal Control! Robert Stengel! Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Learning Objectives Examples of cost functions Necessary conditions for optimality Calculation
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2017 Copyright 2017 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More informationNonlinear State Estimation! Extended Kalman Filters!
Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal
More informationLecture 7 LQG Design. Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for MIMO plant
L7: Lecture 7 LQG Design Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for IO plant LQG regulator L7:2 If the process and measurement noises
More informationStochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents
Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents
More informationEL2520 Control Theory and Practice
EL2520 Control Theory and Practice Lecture 8: Linear quadratic control Mikael Johansson School of Electrical Engineering KTH, Stockholm, Sweden Linear quadratic control Allows to compute the controller
More informationLQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin
LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system
More informationFirst-Order Low-Pass Filter
Filters, Cost Functions, and Controller Structures Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Dynamic systems as low-pass filters! Frequency response of dynamic systems!
More informationOverview of the Seminar Topic
Overview of the Seminar Topic Simo Särkkä Laboratory of Computational Engineering Helsinki University of Technology September 17, 2007 Contents 1 What is Control Theory? 2 History
More informationDesign Methods for Control Systems
Design Methods for Control Systems Maarten Steinbuch TU/e Gjerrit Meinsma UT Dutch Institute of Systems and Control Winter term 2002-2003 Schedule November 25 MSt December 2 MSt Homework # 1 December 9
More informationNonlinear State Estimation! Particle, Sigma-Points Filters!
Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!
More informationSequential State Estimation (Crassidas and Junkins, Chapter 5)
Sequential State Estimation (Crassidas and Junkins, Chapter 5) Please read: 5.1, 5.3-5.6 5.3 The Discrete-Time Kalman Filter The discrete-time Kalman filter is used when the dynamics and measurements are
More informationAdaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018
Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Nonlinearity of adaptation! Parameter-adaptive filtering! Test for whiteness of the residual!
More information5. Observer-based Controller Design
EE635 - Control System Theory 5. Observer-based Controller Design Jitkomut Songsiri state feedback pole-placement design regulation and tracking state observer feedback observer design LQR and LQG 5-1
More informationTime Response of Dynamic Systems! Multi-Dimensional Trajectories Position, velocity, and acceleration are vectors
Time Response of Dynamic Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 217 Multi-dimensional trajectories Numerical integration Linear and nonlinear systems Linearization
More informationProbabilistic Control of Nonlinear Uncertain Systems
Probabilistic Control of Nonlinear Uncertain Systems Qian Wang 1 and Robert F. Stengel 2 1 Mechanical Engineering, Penn State University, University Park, PA 1682, quw6@psu.edu 2 Mechanical and Aerospace
More information6 OUTPUT FEEDBACK DESIGN
6 OUTPUT FEEDBACK DESIGN When the whole sate vector is not available for feedback, i.e, we can measure only y = Cx. 6.1 Review of observer design Recall from the first class in linear systems that a simple
More informationAircraft Stability & Control
Aircraft Stability & Control Textbook Automatic control of Aircraft and missiles 2 nd Edition by John H Blakelock References Aircraft Dynamics and Automatic Control - McRuler & Ashkenas Aerodynamics, Aeronautics
More informationLinearized Equations of Motion!
Linearized Equations of Motion Robert Stengel, Aircraft Flight Dynamics MAE 331, 216 Learning Objectives Develop linear equations to describe small perturbational motions Apply to aircraft dynamic equations
More informationSteady State Kalman Filter
Steady State Kalman Filter Infinite Horizon LQ Control: ẋ = Ax + Bu R positive definite, Q = Q T 2Q 1 2. (A, B) stabilizable, (A, Q 1 2) detectable. Solve for the positive (semi-) definite P in the ARE:
More informationELEC4631 s Lecture 2: Dynamic Control Systems 7 March Overview of dynamic control systems
ELEC4631 s Lecture 2: Dynamic Control Systems 7 March 2011 Overview of dynamic control systems Goals of Controller design Autonomous dynamic systems Linear Multi-input multi-output (MIMO) systems Bat flight
More informationSYSTEMTEORI - KALMAN FILTER VS LQ CONTROL
SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic
More informationPole placement control: state space and polynomial approaches Lecture 2
: state space and polynomial approaches Lecture 2 : a state O. Sename 1 1 Gipsa-lab, CNRS-INPG, FRANCE Olivier.Sename@gipsa-lab.fr www.gipsa-lab.fr/ o.sename -based November 21, 2017 Outline : a state
More informationExam. 135 minutes, 15 minutes reading time
Exam August 6, 208 Control Systems II (5-0590-00) Dr. Jacopo Tani Exam Exam Duration: 35 minutes, 5 minutes reading time Number of Problems: 35 Number of Points: 47 Permitted aids: 0 pages (5 sheets) A4.
More information= m(0) + 4e 2 ( 3e 2 ) 2e 2, 1 (2k + k 2 ) dt. m(0) = u + R 1 B T P x 2 R dt. u + R 1 B T P y 2 R dt +
ECE 553, Spring 8 Posted: May nd, 8 Problem Set #7 Solution Solutions: 1. The optimal controller is still the one given in the solution to the Problem 6 in Homework #5: u (x, t) = p(t)x k(t), t. The minimum
More informationTopic # Feedback Control Systems
Topic #19 16.31 Feedback Control Systems Stengel Chapter 6 Question: how well do the large gain and phase margins discussed for LQR map over to DOFB using LQR and LQE (called LQG)? Fall 2010 16.30/31 19
More informationTopic # Feedback Control Systems
Topic #17 16.31 Feedback Control Systems Deterministic LQR Optimal control and the Riccati equation Weight Selection Fall 2007 16.31 17 1 Linear Quadratic Regulator (LQR) Have seen the solutions to the
More informationEL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1)
EL 625 Lecture 0 EL 625 Lecture 0 Pole Placement and Observer Design Pole Placement Consider the system ẋ Ax () The solution to this system is x(t) e At x(0) (2) If the eigenvalues of A all lie in the
More informationAutomatic Control II Computer exercise 3. LQG Design
Uppsala University Information Technology Systems and Control HN,FS,KN 2000-10 Last revised by HR August 16, 2017 Automatic Control II Computer exercise 3 LQG Design Preparations: Read Chapters 5 and 9
More informationCDS 101/110a: Lecture 8-1 Frequency Domain Design
CDS 11/11a: Lecture 8-1 Frequency Domain Design Richard M. Murray 17 November 28 Goals: Describe canonical control design problem and standard performance measures Show how to use loop shaping to achieve
More informationLINEAR QUADRATIC GAUSSIAN
ECE553: Multivariable Control Systems II. LINEAR QUADRATIC GAUSSIAN.: Deriving LQG via separation principle We will now start to look at the design of controllers for systems Px.t/ D A.t/x.t/ C B u.t/u.t/
More informationLecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004
MER42 Advanced Control Lecture 9 Introduction to Kalman Filtering Linear Quadratic Gaussian Control (LQG) G. Hovland 24 Announcement No tutorials on hursday mornings 8-9am I will be present in all practical
More informationNumerical Solutions of ODEs by Gaussian (Kalman) Filtering
Numerical Solutions of ODEs by Gaussian (Kalman) Filtering Hans Kersting joint work with Michael Schober, Philipp Hennig, Tim Sullivan and Han C. Lie SIAM CSE, Atlanta March 1, 2017 Emmy Noether Group
More informationAlternative Expressions for the Velocity Vector Velocity restricted to the vertical plane. Longitudinal Equations of Motion
Linearized Longitudinal Equations of Motion Robert Stengel, Aircraft Flig Dynamics MAE 33, 008 Separate solutions for nominal and perturbation flig paths Assume that nominal path is steady and in the vertical
More informationCHAPTER INTRODUCTION
CHAPTER 3 DYNAMIC RESPONSE OF 2 DOF QUARTER CAR PASSIVE SUSPENSION SYSTEM (QC-PSS) AND 2 DOF QUARTER CAR ELECTROHYDRAULIC ACTIVE SUSPENSION SYSTEM (QC-EH-ASS) 3.1 INTRODUCTION In this chapter, the dynamic
More informationLinear State Feedback Controller Design
Assignment For EE5101 - Linear Systems Sem I AY2010/2011 Linear State Feedback Controller Design Phang Swee King A0033585A Email: king@nus.edu.sg NGS/ECE Dept. Faculty of Engineering National University
More informationL 1 Adaptive Controller for a Missile Longitudinal Autopilot Design
AIAA Guidance, Navigation and Control Conference and Exhibit 8-2 August 28, Honolulu, Hawaii AIAA 28-6282 L Adaptive Controller for a Missile Longitudinal Autopilot Design Jiang Wang Virginia Tech, Blacksburg,
More informationD(s) G(s) A control system design definition
R E Compensation D(s) U Plant G(s) Y Figure 7. A control system design definition x x x 2 x 2 U 2 s s 7 2 Y Figure 7.2 A block diagram representing Eq. (7.) in control form z U 2 s z Y 4 z 2 s z 2 3 Figure
More informationOrganization. I MCMC discussion. I project talks. I Lecture.
Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems
More informationContents. PART I METHODS AND CONCEPTS 2. Transfer Function Approach Frequency Domain Representations... 42
Contents Preface.............................................. xiii 1. Introduction......................................... 1 1.1 Continuous and Discrete Control Systems................. 4 1.2 Open-Loop
More informationOptimal control and estimation
Automatic Control 2 Optimal control and estimation Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011
More informationChapter 9 Observers, Model-based Controllers 9. Introduction In here we deal with the general case where only a subset of the states, or linear combin
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology c Chapter 9 Observers,
More informationHomework Solution # 3
ECSE 644 Optimal Control Feb, 4 Due: Feb 17, 4 (Tuesday) Homework Solution # 3 1 (5%) Consider the discrete nonlinear control system in Homework # For the optimal control and trajectory that you have found
More informationIntroduction to System Identification and Adaptive Control
Introduction to System Identification and Adaptive Control A. Khaki Sedigh Control Systems Group Faculty of Electrical and Computer Engineering K. N. Toosi University of Technology May 2009 Introduction
More informationContents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31
Contents Preamble xiii Linear Systems I Basic Concepts 1 I System Representation 3 1 State-Space Linear Systems 5 1.1 State-Space Linear Systems 5 1.2 Block Diagrams 7 1.3 Exercises 11 2 Linearization
More informationFall 線性系統 Linear Systems. Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian. NTU-EE Sep07 Jan08
Fall 2007 線性系統 Linear Systems Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian NTU-EE Sep07 Jan08 Materials used in these lecture notes are adopted from Linear System Theory & Design, 3rd.
More informationLinear-Optimal State Estimation
Linear-Optimal State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218 Linear-optimal Gaussian estimator for discrete-time system (Kalman filter) 2 nd -order example
More informationDigital Control: Part 2. ENGI 7825: Control Systems II Andrew Vardy
Digital Control: Part 2 ENGI 7825: Control Systems II Andrew Vardy Mapping the s-plane onto the z-plane We re almost ready to design a controller for a DT system, however we will have to consider where
More informationModeling and Control Overview
Modeling and Control Overview D R. T A R E K A. T U T U N J I A D V A N C E D C O N T R O L S Y S T E M S M E C H A T R O N I C S E N G I N E E R I N G D E P A R T M E N T P H I L A D E L P H I A U N I
More informationA Comparative Study on Automatic Flight Control for small UAV
Proceedings of the 5 th International Conference of Control, Dynamic Systems, and Robotics (CDSR'18) Niagara Falls, Canada June 7 9, 18 Paper No. 13 DOI: 1.11159/cdsr18.13 A Comparative Study on Automatic
More informationTopic # Feedback Control Systems
Topic #16 16.31 Feedback Control Systems State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback Back to reality Fall 2007 16.31 16 1 Combined Estimators and Regulators
More informationControl Systems Lab - SC4070 Control techniques
Control Systems Lab - SC4070 Control techniques Dr. Manuel Mazo Jr. Delft Center for Systems and Control (TU Delft) m.mazo@tudelft.nl Tel.:015-2788131 TU Delft, February 16, 2015 (slides modified from
More informationAircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2018
Aircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2018 Course Overview Introduction to Flight Dynamics Math Preliminaries Copyright 2018 by Robert Stengel. All rights reserved. For
More informationLQG/LTR CONTROLLER DESIGN FOR AN AIRCRAFT MODEL
PERIODICA POLYTECHNICA SER. TRANSP. ENG. VOL. 8, NO., PP. 3 4 () LQG/LTR CONTROLLER DESIGN FOR AN AIRCRAFT MODEL Balázs KULCSÁR Department of Control and Transport Automation Budapest University of Technology
More informationRobust Control 5 Nominal Controller Design Continued
Robust Control 5 Nominal Controller Design Continued Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University 4/14/2003 Outline he LQR Problem A Generalization to LQR Min-Max
More informationTranslational and Rotational Dynamics!
Translational and Rotational Dynamics Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 217 Copyright 217 by Robert Stengel. All rights reserved. For educational use only.
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 25 January 2006 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More informationLecture 12. Upcoming labs: Final Exam on 12/21/2015 (Monday)10:30-12:30
289 Upcoming labs: Lecture 12 Lab 20: Internal model control (finish up) Lab 22: Force or Torque control experiments [Integrative] (2-3 sessions) Final Exam on 12/21/2015 (Monday)10:30-12:30 Today: Recap
More informationState Observers and the Kalman filter
Modelling and Control of Dynamic Systems State Observers and the Kalman filter Prof. Oreste S. Bursi University of Trento Page 1 Feedback System State variable feedback system: Control feedback law:u =
More informationVariable-gain output feedback control
7. Variable-gain output feedback control 7.1. Introduction PUC-Rio - Certificação Digital Nº 611865/CA In designing control laws, the usual first step is to describe the plant at a given operating point
More informationAutonomous Mobile Robot Design
Autonomous Mobile Robot Design Topic: Guidance and Control Introduction and PID Loops Dr. Kostas Alexis (CSE) Autonomous Robot Challenges How do I control where to go? Autonomous Mobile Robot Design Topic:
More informationSubject: Optimal Control Assignment-1 (Related to Lecture notes 1-10)
Subject: Optimal Control Assignment- (Related to Lecture notes -). Design a oil mug, shown in fig., to hold as much oil possible. The height and radius of the mug should not be more than 6cm. The mug must
More informationControl Design. Lecture 9: State Feedback and Observers. Two Classes of Control Problems. State Feedback: Problem Formulation
Lecture 9: State Feedback and s [IFAC PB Ch 9] State Feedback s Disturbance Estimation & Integral Action Control Design Many factors to consider, for example: Attenuation of load disturbances Reduction
More informationOutput Adaptive Model Reference Control of Linear Continuous State-Delay Plant
Output Adaptive Model Reference Control of Linear Continuous State-Delay Plant Boris M. Mirkin and Per-Olof Gutman Faculty of Agricultural Engineering Technion Israel Institute of Technology Haifa 3, Israel
More information4 Arithmetic of Feedback Loops
ME 132, Spring 2005, UC Berkeley, A. Packard 18 4 Arithmetic of Feedback Loops Many important guiding principles of feedback control systems can be derived from the arithmetic relations, along with their
More informationAircraft Flight Dynamics!
Aircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2016 Course Overview Introduction to Flight Dynamics Math Preliminaries Copyright 2016 by Robert Stengel. All rights reserved. For
More informationModeling and state estimation Examples State estimation Probabilities Bayes filter Particle filter. Modeling. CSC752 Autonomous Robotic Systems
Modeling CSC752 Autonomous Robotic Systems Ubbo Visser Department of Computer Science University of Miami February 21, 2017 Outline 1 Modeling and state estimation 2 Examples 3 State estimation 4 Probabilities
More informationControl System Design
ELEC4410 Control System Design Lecture 19: Feedback from Estimated States and Discrete-Time Control Design Julio H. Braslavsky julio@ee.newcastle.edu.au School of Electrical Engineering and Computer Science
More informationDr Ian R. Manchester
Week Content Notes 1 Introduction 2 Frequency Domain Modelling 3 Transient Performance and the s-plane 4 Block Diagrams 5 Feedback System Characteristics Assign 1 Due 6 Root Locus 7 Root Locus 2 Assign
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More informationOptimization-Based Control
Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This
More informationIntroduction. 1.1 Historical Overview. Chapter 1
Chapter 1 Introduction 1.1 Historical Overview Research in adaptive control was motivated by the design of autopilots for highly agile aircraft that need to operate at a wide range of speeds and altitudes,
More informationKalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q
Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I
More informationSeparation Principle & Full-Order Observer Design
Separation Principle & Full-Order Observer Design Suppose you want to design a feedback controller. Using full-state feedback you can place the poles of the closed-loop system at will. U Plant Kx If the
More informationIterative Learning Control Analysis and Design I
Iterative Learning Control Analysis and Design I Electronics and Computer Science University of Southampton Southampton, SO17 1BJ, UK etar@ecs.soton.ac.uk http://www.ecs.soton.ac.uk/ Contents Basics Representations
More informationNonlinear System Analysis
Nonlinear System Analysis Lyapunov Based Approach Lecture 4 Module 1 Dr. Laxmidhar Behera Department of Electrical Engineering, Indian Institute of Technology, Kanpur. January 4, 2003 Intelligent Control
More informationDISCRETE-TIME ADAPTIVE LQG/LTR CONTROL
DISCRETE-TIME ADAPTIVE LQG/LTR CONTROL DARIUSZ HORLA Poznan University of Technology Inst. of Control and Inf. Eng. ul. Piotrowo 3a, 6-965 Poznan POLAND ANDRZEJ KRÓLIKOWSKI Poznan University of Technology
More informationLecture: Gaussian Process Regression. STAT 6474 Instructor: Hongxiao Zhu
Lecture: Gaussian Process Regression STAT 6474 Instructor: Hongxiao Zhu Motivation Reference: Marc Deisenroth s tutorial on Robot Learning. 2 Fast Learning for Autonomous Robots with Gaussian Processes
More informationChap 8. State Feedback and State Estimators
Chap 8. State Feedback and State Estimators Outlines Introduction State feedback Regulation and tracking State estimator Feedback from estimated states State feedback-multivariable case State estimators-multivariable
More informationCS545 Contents XVI. l Adaptive Control. l Reading Assignment for Next Class
CS545 Contents XVI Adaptive Control Model Reference Adaptive Control Self-Tuning Regulators Linear Regression Recursive Least Squares Gradient Descent Feedback-Error Learning Reading Assignment for Next
More informationControl Systems. State Estimation.
State Estimation chibum@seoultech.ac.kr Outline Dominant pole design Symmetric root locus State estimation We are able to place the CLPs arbitrarily by feeding back all the states: u = Kx. But these may
More informationClosed-loop system 2/1/2016. Generally MIMO case. Two-degrees-of-freedom (2 DOF) control structure. (2 DOF structure) The closed loop equations become
Closed-loop system enerally MIMO case Two-degrees-of-freedom (2 DOF) control structure (2 DOF structure) 2 The closed loop equations become solving for z gives where is the closed loop transfer function
More informationINVERSE MODEL APPROACH TO DISTURBANCE REJECTION AND DECOUPLING CONTROLLER DESIGN. Leonid Lyubchyk
CINVESTAV Department of Automatic Control November 3, 20 INVERSE MODEL APPROACH TO DISTURBANCE REJECTION AND DECOUPLING CONTROLLER DESIGN Leonid Lyubchyk National Technical University of Ukraine Kharkov
More informationState Regulator. Advanced Control. design of controllers using pole placement and LQ design rules
Advanced Control State Regulator Scope design of controllers using pole placement and LQ design rules Keywords pole placement, optimal control, LQ regulator, weighting matrixes Prerequisites Contact state
More informationSTABILITY OF CLOSED-LOOP CONTOL SYSTEMS
CHBE320 LECTURE X STABILITY OF CLOSED-LOOP CONTOL SYSTEMS Professor Dae Ryook Yang Spring 2018 Dept. of Chemical and Biological Engineering 10-1 Road Map of the Lecture X Stability of closed-loop control
More information