Robust Control 5 Nominal Controller Design Continued

Size: px
Start display at page:

Download "Robust Control 5 Nominal Controller Design Continued"

Transcription

1 Robust Control 5 Nominal Controller Design Continued Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University 4/14/2003

2 Outline he LQR Problem A Generalization to LQR Min-Max Control Solving the Riccati Equation Classical LQG Stability Margins & LR

3 he Linear Quadratic Regulator Problem (state feedback) x = Ax + Bu, 1 J( x) = lim x ( ) Qx( ) u ( ) Ru( ) d 0 τ τ + τ τ τ heorem: If, is controllable (stabilizable) the optimal controller and X = ( AB) for any initial state is u t K = X R B X () = Kx() t, where: 0 is the unique positive semidefinite solution of the algebraic Riccati equation: + + = 0 A X XA XBR B X Q

4 Stability of LQR An autonomous linear system x = Ax is asymptotically stable if there exists P> 0, Q> 0 that satisfy the Lyapunov equation + = PA A P Q Furthermore, if det A 0, the system is asymptotically if and only if there exist, P> 0, Q 0 that satisfy the Lyapunov equation. ( ) Basis of proof: set V x = x Px, P > 0 and compute V V = x = x PAx + x A Px x If V = x Ax, Q > 0 we have stability by the Lyapunov stability heorem. If det A 0, use LaSalle's hm for sufficiency, Chetaev Instability hm for necessity.

5 Stability of LQR ~ 2 R B X XA + A X XBR B X = Q ( ) Now consider, x = Ax+ Buu, = Kx x = A+ BK xwhere K = ( ) ( ) ( ) ( R B X BK ) + XBK XB + X B R B X X X A+ BK + A+ BK X = Q XBR B ( ) ( ) X Lyapunov Equation

6 Generalization of LQR 1 J( x) = lim x ( ) Qx( ) 2 x ( ) Su( t) u ( ) Ru( ) d τ τ τ τ τ τ R> Q SR S 0, 0 Notice that (complete the square) ( ) ( ) ( ) x Qx + 2x Su + u Ru = u + R Sx R u + R Sx + x Q SR S x Define a new control ( ) = +, = + = + Bu 1 u u R S x x Ax Bu x A BR S x 1 J( x) = lim x ( τ) ( Q SR S ) x( τ) u ( τ) Ru( τ) dτ + 0 u = R ( B P+ S) x ( ) + ( ) + ( ) P A BR S A BR S P PBR B P Q SR S

7 RE & Associated Hamiltonian Matrix A BR B A X + XA XBR B X + Q = 0 H = if λ is an eigenvalue of H, so is λ ( ) ( ) A, B controllable, A, C observable where Q= C C there are no eigenvalues on the imaginary axis = such that H Q Λ 0 = 0 Λ A ( ) Λ is composed of real Jordan blocks, with Reλ Λ > 0 he positive definite solution is X =

8 Computational ools - 1 CARE Solve continuous-time algebraic Riccati equations. [X,L,G,RR] = CARE(A,B,Q,R,S,E) computes the unique symmetric stabilizing solution X of the continuous-time algebraic Riccati equation -1 A'XE + E'XA - (E'XB + S)R (B'XE + S') + Q = 0 or, equivalently, F'XE + E'XF - E'XBR B'XE + Q - SR S' = 0 with F:=A-BR S'. When omitted, R,S and E are set to the default values R=I, S=0, and E=I. Additional optional outputs include the gain matrix -1 G = R (B'XE + S'), the vector L of closed-loop eigenvalues (i.e., EIG(A-B*G,E)), and the Frobenius norm RR of the relative residual matrix.

9 Computational ools 2 LQR Linear-quadratic regulator design for continuous-time systems. [K,S,E] = LQR(A,B,Q,R,N) calculates the optimal gain matrix K such that the state-feedback law u = -Kx minimizes the cost function J = Integral {x'qx + u'ru + 2*x'Nu} dt. subject to the state dynamics x = Ax + Bu. he matrix N is set to zero when omitted. Also returned are the Riccati equation solution S and the closed-loop eigenvalues E: -1 SA + A'S - (SB+N)R (B'S+N') + Q = 0, E = EIG(A-B*K).

10 Min-Max Control x = Ax+ Bu+ Ew, y = Cx ( AC) 2 (, ) = ( ) ( ) + ρ ( ) ( ) γ ( ) ( ), ρ, γ > 0 0 Juw y tyt u tut w twt dt objective: min max Juw (, ) u () ( )( ) heorem: Suppose wt has bounded energy, AB,, AE, stabilizable,, detectable, then w 1 the optimal control i s u( t) = Kx( t), K = B S ρ 1 the worst case disturbance is wt ( ) = E Sxt ( ) 2 γ S is the unique, symmetric, nonnegative solution of the Riccati equation: 1 1 AS+ SA S BB EE S CC 2 = ρ γ

11 Min-Max Hamiltonian Matrix γ ρ 2 = = ρ γ AS SA S BB EE S CC H stabilizability/detectability γ such that there are no pure eigenvalues of H if γ > γ min γ produces LQR solution γ = γ min is the full state feedback H solution all γ γ < are valid min-max controllers min 1 1 A EE BB CC min A

12 Min-Max, Continued 1 1 Reλ( H) 0 Reλ A+ EE S BB S 0 2 < γ ρ 1 1 he closed loop system matrix is A BB S, since EE S 2 ρ γ is destabilizing, there is some stability margin

13 Linear Quadratic Gaussian (LQG) Problem Consider the linear system x = Ax+ Bu+ w y = Cx+ v where wv, are independent, zero-mean white noise processes having covariances { } { } { τ δ τ τ δ τ τ } E w() t w ( ) = W ( t ), E v() t v ( ) = V ( t ), E w() t v ( ) = 0 () Find u t that minimizes 1 J = E lim 0 xqx+ uru dt, Q= Q 0, R= R > 0

14 LQG Solution ( ) u = Kxˆ( t), K = R B P PA + A P PBR B P = Q, P 0 x ˆ = Axˆ+ Bu+ L y Cxˆ, L= SC V SA + AS SC V CS = W, S 0

15 LQG Robustness: State Feedback Loop break point x = 0 K ( ) 1 si A B x ( ) = ( ) = Φ, Φ= ( ) ( ) = ( ) 1 G s K si A B K B si A S s I K si A B ( ) ( ) For R diagonal, σ S jω 1 ω 1 π GM :, PM : (in each channel) 2 3

16 LQG Robustness: State Feedback 2 When K is determined via the Ricatti equation, it is known { ( ) } σ min S = min I K jωi A B v 1, ω > 0 v = 1 Similarly, R { ( ) } I C jωi A L v min 1, ω > 0 v = 1 V V R

17 LQG Robustness: Output Feedback y = 0 G ( s ) G ( s) c p y p ( ) = ( ) G s C si A B ( ) = ( + + ) Gc s K s A BK LC L No guaranteed margins!

18 Output Feedback-a closer look ŷ C v u xˆ = Axˆ+ Bu+ Lv K x = Ax + Bu ˆx y = Cx Φ ( s) [ si A] 1 Loop transfer functions: y v L Φ ˆx C ŷ (A) (B) (C) Φ Φ CΦL C BK BK L KΦB C L u Plant is invisible B Φ x K (D) 1 K Φ BK LC LCΦB observer is invisible Loop breaking at (A) & (D) do not produce the excellent margins of state feedback.

19 Loop ransfer Recovery Recall L= Let SA + AS SC V CS = W 2 W = W0 + BB phase plant SC V, with ( ) ( ) = ( ), ρ a scalar. It can be shown, for a minimum lim G s G s K si A B ρ c Correspondingly, p ( ) = ( ) ( ) lim G s K si A BG s ρ c ρ complete recovery! some of the estimator poles tend to the plant zeros For nonminimum phase plants, estimator poles tend to LHP plant zeros, recovery is not complete. p

OPTIMAL CONTROL SYSTEMS

OPTIMAL CONTROL SYSTEMS SYSTEMS MIN-MAX Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University OUTLINE MIN-MAX CONTROL Problem Definition HJB Equation Example GAME THEORY Differential Games Isaacs

More information

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system

More information

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control Chapter 3 LQ, LQG and Control System H 2 Design Overview LQ optimization state feedback LQG optimization output feedback H 2 optimization non-stochastic version of LQG Application to feedback system design

More information

6.241 Dynamic Systems and Control

6.241 Dynamic Systems and Control 6.241 Dynamic Systems and Control Lecture 24: H2 Synthesis Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology May 4, 2011 E. Frazzoli (MIT) Lecture 24: H 2 Synthesis May

More information

Linear Quadratic Regulator (LQR) Design II

Linear Quadratic Regulator (LQR) Design II Lecture 8 Linear Quadratic Regulator LQR) Design II Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Stability and Robustness properties

More information

1. LQR formulation 2. Selection of weighting matrices 3. Matlab implementation. Regulator Problem mm3,4. u=-kx

1. LQR formulation 2. Selection of weighting matrices 3. Matlab implementation. Regulator Problem mm3,4. u=-kx MM8.. LQR Reglator 1. LQR formlation 2. Selection of weighting matrices 3. Matlab implementation Reading Material: DC: p.364-382, 400-403, Matlab fnctions: lqr, lqry, dlqr, lqrd, care, dare 3/26/2008 Introdction

More information

State Space Design. MEM 355 Performance Enhancement of Dynamical Systems

State Space Design. MEM 355 Performance Enhancement of Dynamical Systems State Space Design MEM 355 Performance Enhancement of Dynamical Systems Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline State space techniques emerged around

More information

5. Observer-based Controller Design

5. Observer-based Controller Design EE635 - Control System Theory 5. Observer-based Controller Design Jitkomut Songsiri state feedback pole-placement design regulation and tracking state observer feedback observer design LQR and LQG 5-1

More information

MEM 355 Performance Enhancement of Dynamical Systems

MEM 355 Performance Enhancement of Dynamical Systems MEM 355 Performance Enhancement of Dynamical Systems State Space Design Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University 11/8/2016 Outline State space techniques emerged

More information

Course Outline. Higher Order Poles: Example. Higher Order Poles. Amme 3500 : System Dynamics & Control. State Space Design. 1 G(s) = s(s + 2)(s +10)

Course Outline. Higher Order Poles: Example. Higher Order Poles. Amme 3500 : System Dynamics & Control. State Space Design. 1 G(s) = s(s + 2)(s +10) Amme 35 : System Dynamics Control State Space Design Course Outline Week Date Content Assignment Notes 1 1 Mar Introduction 2 8 Mar Frequency Domain Modelling 3 15 Mar Transient Performance and the s-plane

More information

Exam. 135 minutes, 15 minutes reading time

Exam. 135 minutes, 15 minutes reading time Exam August 6, 208 Control Systems II (5-0590-00) Dr. Jacopo Tani Exam Exam Duration: 35 minutes, 5 minutes reading time Number of Problems: 35 Number of Points: 47 Permitted aids: 0 pages (5 sheets) A4.

More information

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004 MER42 Advanced Control Lecture 9 Introduction to Kalman Filtering Linear Quadratic Gaussian Control (LQG) G. Hovland 24 Announcement No tutorials on hursday mornings 8-9am I will be present in all practical

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

Linear Quadratic Regulator (LQR) Design I

Linear Quadratic Regulator (LQR) Design I Lecture 7 Linear Quadratic Regulator LQR) Design I Dr. Radhakant Padhi Asst. Proessor Dept. o Aerospace Engineering Indian Institute o Science - Bangalore LQR Design: Problem Objective o drive the state

More information

Suppose that we have a specific single stage dynamic system governed by the following equation:

Suppose that we have a specific single stage dynamic system governed by the following equation: Dynamic Optimisation Discrete Dynamic Systems A single stage example Suppose that we have a specific single stage dynamic system governed by the following equation: x 1 = ax 0 + bu 0, x 0 = x i (1) where

More information

Linear Quadratic Gausssian Control Design with Loop Transfer Recovery

Linear Quadratic Gausssian Control Design with Loop Transfer Recovery Linear Quadratic Gausssian Control Design with Loop Transfer Recovery Leonid Freidovich Department of Mathematics Michigan State University MI 48824, USA e-mail:leonid@math.msu.edu http://www.math.msu.edu/

More information

EE C128 / ME C134 Final Exam Fall 2014

EE C128 / ME C134 Final Exam Fall 2014 EE C128 / ME C134 Final Exam Fall 2014 December 19, 2014 Your PRINTED FULL NAME Your STUDENT ID NUMBER Number of additional sheets 1. No computers, no tablets, no connected device (phone etc.) 2. Pocket

More information

Control Systems. Design of State Feedback Control.

Control Systems. Design of State Feedback Control. Control Systems Design of State Feedback Control chibum@seoultech.ac.kr Outline Design of State feedback control Dominant pole design Symmetric root locus (linear quadratic regulation) 2 Selection of closed-loop

More information

Robust Control 9 Design Summary & Examples

Robust Control 9 Design Summary & Examples Robust Control 9 Design Summary & Examples Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University 5/6/003 Outline he H Problem Solution via γ-iteration Robust stability via

More information

State Regulator. Advanced Control. design of controllers using pole placement and LQ design rules

State Regulator. Advanced Control. design of controllers using pole placement and LQ design rules Advanced Control State Regulator Scope design of controllers using pole placement and LQ design rules Keywords pole placement, optimal control, LQ regulator, weighting matrixes Prerequisites Contact state

More information

Denis ARZELIER arzelier

Denis ARZELIER   arzelier COURSE ON LMI OPTIMIZATION WITH APPLICATIONS IN CONTROL PART II.2 LMIs IN SYSTEMS CONTROL STATE-SPACE METHODS PERFORMANCE ANALYSIS and SYNTHESIS Denis ARZELIER www.laas.fr/ arzelier arzelier@laas.fr 15

More information

2 The Linear Quadratic Regulator (LQR)

2 The Linear Quadratic Regulator (LQR) 2 The Linear Quadratic Regulator (LQR) Problem: Compute a state feedback controller u(t) = Kx(t) that stabilizes the closed loop system and minimizes J := 0 x(t) T Qx(t)+u(t) T Ru(t)dt where x and u are

More information

6. Linear Quadratic Regulator Control

6. Linear Quadratic Regulator Control EE635 - Control System Theory 6. Linear Quadratic Regulator Control Jitkomut Songsiri algebraic Riccati Equation (ARE) infinite-time LQR (continuous) Hamiltonian matrix gain margin of LQR 6-1 Algebraic

More information

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ ME 234, Lyapunov and Riccati Problems. This problem is to recall some facts and formulae you already know. (a) Let A and B be matrices of appropriate dimension. Show that (A, B) is controllable if and

More information

Linear Quadratic Regulator (LQR) I

Linear Quadratic Regulator (LQR) I Optimal Control, Guidance and Estimation Lecture Linear Quadratic Regulator (LQR) I Pro. Radhakant Padhi Dept. o Aerospace Engineering Indian Institute o Science - Bangalore Generic Optimal Control Problem

More information

Extensions and applications of LQ

Extensions and applications of LQ Extensions and applications of LQ 1 Discrete time systems 2 Assigning closed loop pole location 3 Frequency shaping LQ Regulator for Discrete Time Systems Consider the discrete time system: x(k + 1) =

More information

Quadratic Stability of Dynamical Systems. Raktim Bhattacharya Aerospace Engineering, Texas A&M University

Quadratic Stability of Dynamical Systems. Raktim Bhattacharya Aerospace Engineering, Texas A&M University .. Quadratic Stability of Dynamical Systems Raktim Bhattacharya Aerospace Engineering, Texas A&M University Quadratic Lyapunov Functions Quadratic Stability Dynamical system is quadratically stable if

More information

Semidefinite Programming Duality and Linear Time-invariant Systems

Semidefinite Programming Duality and Linear Time-invariant Systems Semidefinite Programming Duality and Linear Time-invariant Systems Venkataramanan (Ragu) Balakrishnan School of ECE, Purdue University 2 July 2004 Workshop on Linear Matrix Inequalities in Control LAAS-CNRS,

More information

Lecture 7 LQG Design. Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for MIMO plant

Lecture 7 LQG Design. Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for MIMO plant L7: Lecture 7 LQG Design Linear Quadratic Gaussian regulator Control-estimation duality SRL for optimal estimator Example of LQG design for IO plant LQG regulator L7:2 If the process and measurement noises

More information

Topic # Feedback Control. State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback

Topic # Feedback Control. State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback Topic #17 16.31 Feedback Control State-Space Systems Closed-loop control using estimators and regulators. Dynamics output feedback Back to reality Copyright 21 by Jonathan How. All Rights reserved 1 Fall

More information

6 OUTPUT FEEDBACK DESIGN

6 OUTPUT FEEDBACK DESIGN 6 OUTPUT FEEDBACK DESIGN When the whole sate vector is not available for feedback, i.e, we can measure only y = Cx. 6.1 Review of observer design Recall from the first class in linear systems that a simple

More information

w T 1 w T 2. w T n 0 if i j 1 if i = j

w T 1 w T 2. w T n 0 if i j 1 if i = j Lyapunov Operator Let A F n n be given, and define a linear operator L A : C n n C n n as L A (X) := A X + XA Suppose A is diagonalizable (what follows can be generalized even if this is not possible -

More information

OPTIMAL CONTROL. Sadegh Bolouki. Lecture slides for ECE 515. University of Illinois, Urbana-Champaign. Fall S. Bolouki (UIUC) 1 / 28

OPTIMAL CONTROL. Sadegh Bolouki. Lecture slides for ECE 515. University of Illinois, Urbana-Champaign. Fall S. Bolouki (UIUC) 1 / 28 OPTIMAL CONTROL Sadegh Bolouki Lecture slides for ECE 515 University of Illinois, Urbana-Champaign Fall 2016 S. Bolouki (UIUC) 1 / 28 (Example from Optimal Control Theory, Kirk) Objective: To get from

More information

Steady State Kalman Filter

Steady State Kalman Filter Steady State Kalman Filter Infinite Horizon LQ Control: ẋ = Ax + Bu R positive definite, Q = Q T 2Q 1 2. (A, B) stabilizable, (A, Q 1 2) detectable. Solve for the positive (semi-) definite P in the ARE:

More information

Variable Structure Control ~ Disturbance Rejection. Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University

Variable Structure Control ~ Disturbance Rejection. Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Variable Structure Control ~ Disturbance Rejection Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline Linear Tracking & Disturbance Rejection Variable Structure

More information

Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures

Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures Preprints of the 19th World Congress The International Federation of Automatic Control Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures Eric Peterson Harry G.

More information

Linear Quadratic Regulator (LQR) II

Linear Quadratic Regulator (LQR) II Optimal Control, Guidance and Estimation Lecture 11 Linear Quadratic Regulator (LQR) II Pro. Radhakant Padhi Dept. o Aerospace Engineering Indian Institute o Science - Bangalore Outline Summary o LQR design

More information

Topic # Feedback Control Systems

Topic # Feedback Control Systems Topic #17 16.31 Feedback Control Systems Deterministic LQR Optimal control and the Riccati equation Weight Selection Fall 2007 16.31 17 1 Linear Quadratic Regulator (LQR) Have seen the solutions to the

More information

Linear State Feedback Controller Design

Linear State Feedback Controller Design Assignment For EE5101 - Linear Systems Sem I AY2010/2011 Linear State Feedback Controller Design Phang Swee King A0033585A Email: king@nus.edu.sg NGS/ECE Dept. Faculty of Engineering National University

More information

State Feedback and State Estimators Linear System Theory and Design, Chapter 8.

State Feedback and State Estimators Linear System Theory and Design, Chapter 8. 1 Linear System Theory and Design, http://zitompul.wordpress.com 2 0 1 4 2 Homework 7: State Estimators (a) For the same system as discussed in previous slides, design another closed-loop state estimator,

More information

Lecture 2: Discrete-time Linear Quadratic Optimal Control

Lecture 2: Discrete-time Linear Quadratic Optimal Control ME 33, U Berkeley, Spring 04 Xu hen Lecture : Discrete-time Linear Quadratic Optimal ontrol Big picture Example onvergence of finite-time LQ solutions Big picture previously: dynamic programming and finite-horizon

More information

TRACKING AND DISTURBANCE REJECTION

TRACKING AND DISTURBANCE REJECTION TRACKING AND DISTURBANCE REJECTION Sadegh Bolouki Lecture slides for ECE 515 University of Illinois, Urbana-Champaign Fall 2016 S. Bolouki (UIUC) 1 / 13 General objective: The output to track a reference

More information

Advanced Control Theory

Advanced Control Theory State Feedback Control Design chibum@seoultech.ac.kr Outline State feedback control design Benefits of CCF 2 Conceptual steps in controller design We begin by considering the regulation problem the task

More information

Power Systems Control Prof. Wonhee Kim. Ch.3. Controller Design in Time Domain

Power Systems Control Prof. Wonhee Kim. Ch.3. Controller Design in Time Domain Power Systems Control Prof. Wonhee Kim Ch.3. Controller Design in Time Domain Stability in State Space Equation: State Feeback t A t B t t C t D t x x u y x u u t Kx t t A t BK t A BK x t x x x K shoul

More information

ECEEN 5448 Fall 2011 Homework #4 Solutions

ECEEN 5448 Fall 2011 Homework #4 Solutions ECEEN 5448 Fall 2 Homework #4 Solutions Professor David G. Meyer Novemeber 29, 2. The state-space realization is A = [ [ ; b = ; c = [ which describes, of course, a free mass (in normalized units) with

More information

Fall 線性系統 Linear Systems. Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian. NTU-EE Sep07 Jan08

Fall 線性系統 Linear Systems. Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian. NTU-EE Sep07 Jan08 Fall 2007 線性系統 Linear Systems Chapter 08 State Feedback & State Estimators (SISO) Feng-Li Lian NTU-EE Sep07 Jan08 Materials used in these lecture notes are adopted from Linear System Theory & Design, 3rd.

More information

Dynamical Systems & Lyapunov Stability

Dynamical Systems & Lyapunov Stability Dynamical Systems & Lyapunov Stability Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline Ordinary Differential Equations Existence & uniqueness Continuous dependence

More information

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic

More information

State Feedback and State Estimators Linear System Theory and Design, Chapter 8.

State Feedback and State Estimators Linear System Theory and Design, Chapter 8. 1 Linear System Theory and Design, http://zitompul.wordpress.com 2 0 1 4 State Estimator In previous section, we have discussed the state feedback, based on the assumption that all state variables are

More information

D(s) G(s) A control system design definition

D(s) G(s) A control system design definition R E Compensation D(s) U Plant G(s) Y Figure 7. A control system design definition x x x 2 x 2 U 2 s s 7 2 Y Figure 7.2 A block diagram representing Eq. (7.) in control form z U 2 s z Y 4 z 2 s z 2 3 Figure

More information

Infinite Horizon LQ. Given continuous-time state equation. Find the control function u(t) to minimize

Infinite Horizon LQ. Given continuous-time state equation. Find the control function u(t) to minimize Infinite Horizon LQ Given continuous-time state equation x = Ax + Bu Find the control function ut) to minimize J = 1 " # [ x T t)qxt) + u T t)rut)] dt 2 0 Q $ 0, R > 0 and symmetric Solution is obtained

More information

EL2520 Control Theory and Practice

EL2520 Control Theory and Practice EL2520 Control Theory and Practice Lecture 8: Linear quadratic control Mikael Johansson School of Electrical Engineering KTH, Stockholm, Sweden Linear quadratic control Allows to compute the controller

More information

Stability, Pole Placement, Observers and Stabilization

Stability, Pole Placement, Observers and Stabilization Stability, Pole Placement, Observers and Stabilization 1 1, The Netherlands DISC Course Mathematical Models of Systems Outline 1 Stability of autonomous systems 2 The pole placement problem 3 Stabilization

More information

POLE PLACEMENT. Sadegh Bolouki. Lecture slides for ECE 515. University of Illinois, Urbana-Champaign. Fall S. Bolouki (UIUC) 1 / 19

POLE PLACEMENT. Sadegh Bolouki. Lecture slides for ECE 515. University of Illinois, Urbana-Champaign. Fall S. Bolouki (UIUC) 1 / 19 POLE PLACEMENT Sadegh Bolouki Lecture slides for ECE 515 University of Illinois, Urbana-Champaign Fall 2016 S. Bolouki (UIUC) 1 / 19 Outline 1 State Feedback 2 Observer 3 Observer Feedback 4 Reduced Order

More information

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation EE363 Winter 2008-09 Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation partially observed linear-quadratic stochastic control problem estimation-control separation principle

More information

4F3 - Predictive Control

4F3 - Predictive Control 4F3 Predictive Control - Lecture 2 p 1/23 4F3 - Predictive Control Lecture 2 - Unconstrained Predictive Control Jan Maciejowski jmm@engcamacuk 4F3 Predictive Control - Lecture 2 p 2/23 References Predictive

More information

Robust Control 2 Controllability, Observability & Transfer Functions

Robust Control 2 Controllability, Observability & Transfer Functions Robust Control 2 Controllability, Observability & Transfer Functions Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University /26/24 Outline Reachable Controllability Distinguishable

More information

Lecture 4 Continuous time linear quadratic regulator

Lecture 4 Continuous time linear quadratic regulator EE363 Winter 2008-09 Lecture 4 Continuous time linear quadratic regulator continuous-time LQR problem dynamic programming solution Hamiltonian system and two point boundary value problem infinite horizon

More information

Australian Journal of Basic and Applied Sciences, 3(4): , 2009 ISSN Modern Control Design of Power System

Australian Journal of Basic and Applied Sciences, 3(4): , 2009 ISSN Modern Control Design of Power System Australian Journal of Basic and Applied Sciences, 3(4): 4267-4273, 29 ISSN 99-878 Modern Control Design of Power System Atef Saleh Othman Al-Mashakbeh Tafila Technical University, Electrical Engineering

More information

Return Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems

Return Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems Spectral Properties of Linear- Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018! Stability margins of single-input/singleoutput (SISO) systems! Characterizations

More information

Contents lecture 5. Automatic Control III. Summary of lecture 4 (II/II) Summary of lecture 4 (I/II) u y F r. Lecture 5 H 2 and H loop shaping

Contents lecture 5. Automatic Control III. Summary of lecture 4 (II/II) Summary of lecture 4 (I/II) u y F r. Lecture 5 H 2 and H loop shaping Contents lecture 5 Automatic Control III Lecture 5 H 2 and H loop shaping Thomas Schön Division of Systems and Control Department of Information Technology Uppsala University. Email: thomas.schon@it.uu.se,

More information

Lecture 2 and 3: Controllability of DT-LTI systems

Lecture 2 and 3: Controllability of DT-LTI systems 1 Lecture 2 and 3: Controllability of DT-LTI systems Spring 2013 - EE 194, Advanced Control (Prof Khan) January 23 (Wed) and 28 (Mon), 2013 I LTI SYSTEMS Recall that continuous-time LTI systems can be

More information

Riccati Equations and Inequalities in Robust Control

Riccati Equations and Inequalities in Robust Control Riccati Equations and Inequalities in Robust Control Lianhao Yin Gabriel Ingesson Martin Karlsson Optimal Control LP4 2014 June 10, 2014 Lianhao Yin Gabriel Ingesson Martin Karlsson (LTH) H control problem

More information

Lecture 8. Applications

Lecture 8. Applications Lecture 8. Applications Ivan Papusha CDS270 2: Mathematical Methods in Control and System Engineering May 8, 205 / 3 Logistics hw7 due this Wed, May 20 do an easy problem or CYOA hw8 (design problem) will

More information

9 Controller Discretization

9 Controller Discretization 9 Controller Discretization In most applications, a control system is implemented in a digital fashion on a computer. This implies that the measurements that are supplied to the control system must be

More information

Topic # /31 Feedback Control Systems

Topic # /31 Feedback Control Systems Topic #17 16.30/31 Feedback Control Systems Improving the transient performance of the LQ Servo Feedforward Control Architecture Design DOFB Servo Handling saturations in DOFB Fall 2010 16.30/31 17 1 LQ

More information

Lecture 5 Linear Quadratic Stochastic Control

Lecture 5 Linear Quadratic Stochastic Control EE363 Winter 2008-09 Lecture 5 Linear Quadratic Stochastic Control linear-quadratic stochastic control problem solution via dynamic programming 5 1 Linear stochastic system linear dynamical system, over

More information

Optimal control and estimation

Optimal control and estimation Automatic Control 2 Optimal control and estimation Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011

More information

CONTROL DESIGN FOR SET POINT TRACKING

CONTROL DESIGN FOR SET POINT TRACKING Chapter 5 CONTROL DESIGN FOR SET POINT TRACKING In this chapter, we extend the pole placement, observer-based output feedback design to solve tracking problems. By tracking we mean that the output is commanded

More information

Contents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31

Contents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31 Contents Preamble xiii Linear Systems I Basic Concepts 1 I System Representation 3 1 State-Space Linear Systems 5 1.1 State-Space Linear Systems 5 1.2 Block Diagrams 7 1.3 Exercises 11 2 Linearization

More information

The Newton-ADI Method for Large-Scale Algebraic Riccati Equations. Peter Benner.

The Newton-ADI Method for Large-Scale Algebraic Riccati Equations. Peter Benner. The Newton-ADI Method for Large-Scale Algebraic Riccati Equations Mathematik in Industrie und Technik Fakultät für Mathematik Peter Benner benner@mathematik.tu-chemnitz.de Sonderforschungsbereich 393 S

More information

The norms can also be characterized in terms of Riccati inequalities.

The norms can also be characterized in terms of Riccati inequalities. 9 Analysis of stability and H norms Consider the causal, linear, time-invariant system ẋ(t = Ax(t + Bu(t y(t = Cx(t Denote the transfer function G(s := C (si A 1 B. Theorem 85 The following statements

More information

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following

More information

SYSTEMTEORI - ÖVNING 5: FEEDBACK, POLE ASSIGNMENT AND OBSERVER

SYSTEMTEORI - ÖVNING 5: FEEDBACK, POLE ASSIGNMENT AND OBSERVER SYSTEMTEORI - ÖVNING 5: FEEDBACK, POLE ASSIGNMENT AND OBSERVER Exercise 54 Consider the system: ẍ aẋ bx u where u is the input and x the output signal (a): Determine a state space realization (b): Is the

More information

EE363 homework 7 solutions

EE363 homework 7 solutions EE363 Prof. S. Boyd EE363 homework 7 solutions 1. Gain margin for a linear quadratic regulator. Let K be the optimal state feedback gain for the LQR problem with system ẋ = Ax + Bu, state cost matrix Q,

More information

6.241 Dynamic Systems and Control

6.241 Dynamic Systems and Control 6.241 Dynamic Systems and Control Lecture 12: I/O Stability Readings: DDV, Chapters 15, 16 Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology March 14, 2011 E. Frazzoli

More information

Module 02 CPS Background: Linear Systems Preliminaries

Module 02 CPS Background: Linear Systems Preliminaries Module 02 CPS Background: Linear Systems Preliminaries Ahmad F. Taha EE 5243: Introduction to Cyber-Physical Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ taha/index.html August

More information

Optimization-Based Control

Optimization-Based Control Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This

More information

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis Topic # 16.30/31 Feedback Control Systems Analysis of Nonlinear Systems Lyapunov Stability Analysis Fall 010 16.30/31 Lyapunov Stability Analysis Very general method to prove (or disprove) stability of

More information

MODERN CONTROL DESIGN

MODERN CONTROL DESIGN CHAPTER 8 MODERN CONTROL DESIGN The classical design techniques of Chapters 6 and 7 are based on the root-locus and frequency response that utilize only the plant output for feedback with a dynamic controller

More information

Iterative methods to compute center and center-stable manifolds with application to the optimal output regulation problem

Iterative methods to compute center and center-stable manifolds with application to the optimal output regulation problem Iterative methods to compute center and center-stable manifolds with application to the optimal output regulation problem Noboru Sakamoto, Branislav Rehak N.S.: Nagoya University, Department of Aerospace

More information

Problem 1 Cost of an Infinite Horizon LQR

Problem 1 Cost of an Infinite Horizon LQR THE UNIVERSITY OF TEXAS AT SAN ANTONIO EE 5243 INTRODUCTION TO CYBER-PHYSICAL SYSTEMS H O M E W O R K # 5 Ahmad F. Taha October 12, 215 Homework Instructions: 1. Type your solutions in the LATEX homework

More information

CBE507 LECTURE IV Multivariable and Optimal Control. Professor Dae Ryook Yang

CBE507 LECTURE IV Multivariable and Optimal Control. Professor Dae Ryook Yang CBE507 LECURE IV Multivariable and Optimal Control Professor Dae Ryook Yang Fall 03 Dept. of Chemical and Biological Engineering Korea University Korea University IV - Decoupling Handling MIMO processes

More information

Autonomous Mobile Robot Design

Autonomous Mobile Robot Design Autonomous Mobile Robot Design Topic: Guidance and Control Introduction and PID Loops Dr. Kostas Alexis (CSE) Autonomous Robot Challenges How do I control where to go? Autonomous Mobile Robot Design Topic:

More information

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 204 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

Linear Quadratic Optimal Control Topics

Linear Quadratic Optimal Control Topics Linear Quadratic Optimal Control Topics Finite time LQR problem for time varying systems Open loop solution via Lagrange multiplier Closed loop solution Dynamic programming (DP) principle Cost-to-go function

More information

Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015

Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015 Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 15 Asymptotic approach from time-varying to constant gains Elimination of cross weighting

More information

8 A First Glimpse on Design with LMIs

8 A First Glimpse on Design with LMIs 8 A First Glimpse on Design with LMIs 8.1 Conceptual Design Problem Given a linear time invariant system design a linear time invariant controller or filter so as to guarantee some closed loop indices

More information

Robust Multivariable Control

Robust Multivariable Control Lecture 2 Anders Helmersson anders.helmersson@liu.se ISY/Reglerteknik Linköpings universitet Today s topics Today s topics Norms Today s topics Norms Representation of dynamic systems Today s topics Norms

More information

CDS Solutions to the Midterm Exam

CDS Solutions to the Midterm Exam CDS 22 - Solutions to the Midterm Exam Instructor: Danielle C. Tarraf November 6, 27 Problem (a) Recall that the H norm of a transfer function is time-delay invariant. Hence: ( ) Ĝ(s) = s + a = sup /2

More information

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 4

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 4 EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 4 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 12, 2012 Andre Tkacenko

More information

Homework Solution # 3

Homework Solution # 3 ECSE 644 Optimal Control Feb, 4 Due: Feb 17, 4 (Tuesday) Homework Solution # 3 1 (5%) Consider the discrete nonlinear control system in Homework # For the optimal control and trajectory that you have found

More information

EL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1)

EL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1) EL 625 Lecture 0 EL 625 Lecture 0 Pole Placement and Observer Design Pole Placement Consider the system ẋ Ax () The solution to this system is x(t) e At x(0) (2) If the eigenvalues of A all lie in the

More information

Optimal Control. Quadratic Functions. Single variable quadratic function: Multi-variable quadratic function:

Optimal Control. Quadratic Functions. Single variable quadratic function: Multi-variable quadratic function: Optimal Control Control design based on pole-placement has non unique solutions Best locations for eigenvalues are sometimes difficult to determine Linear Quadratic LQ) Optimal control minimizes a quadratic

More information

Topic # Feedback Control

Topic # Feedback Control Topic #5 6.3 Feedback Control State-Space Systems Full-state Feedback Control How do we change the poles of the state-space system? Or,evenifwecanchangethepolelocations. Where do we put the poles? Linear

More information

NAVAL POSTGRADUATE SCHOOL THESIS

NAVAL POSTGRADUATE SCHOOL THESIS NAVAL POSTGRADUATE SCHOOL MONTEREY, CALIFORNIA THESIS CONTROL OF A SYSTEM IN THE PRESENCE OF FLEXIBLE MODES by Eleftherios Manos June 27 Thesis Advisor: Second Reader: Roberto Cristi Xiaoping Yun Approved

More information

EECS C128/ ME C134 Final Wed. Dec. 14, am. Closed book. One page, 2 sides of formula sheets. No calculators.

EECS C128/ ME C134 Final Wed. Dec. 14, am. Closed book. One page, 2 sides of formula sheets. No calculators. Name: SID: EECS C128/ ME C134 Final Wed. Dec. 14, 211 81-11 am Closed book. One page, 2 sides of formula sheets. No calculators. There are 8 problems worth 1 points total. Problem Points Score 1 16 2 12

More information

CIMPA Summer School on Current Research on Finite Element Method Lecture 1. IIT Bombay. Introduction to feedback stabilization

CIMPA Summer School on Current Research on Finite Element Method Lecture 1. IIT Bombay. Introduction to feedback stabilization 1/51 CIMPA Summer School on Current Research on Finite Element Method Lecture 1 IIT Bombay July 6 July 17, 215 Introduction to feedback stabilization Jean-Pierre Raymond Institut de Mathématiques de Toulouse

More information

Lecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.

Lecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University. Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ

More information

Some New Results on Linear Quadratic Regulator Design for Lossless Systems

Some New Results on Linear Quadratic Regulator Design for Lossless Systems Some New Results on Linear Quadratic Regulator Design for Lossless Systems Luigi Fortuna, Giovanni Muscato Maria Gabriella Xibilia Dipartimento Elettrico Elettronico e Sistemistico Universitá degli Studi

More information