Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!

Size: px
Start display at page:

Download "Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!"

Transcription

1 Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2017 Copyright 2017 by Robert Stengel. All rights reserved. For educational use only Tuesday and Thursday, 3-4:20 pm Room 306, Friend Center Preliminaries Reference R. Stengel, Optimal Control and Estimation, Dover, 1994 Various journal papers and book chapters Resources Blackboard Course Home Page, Syllabus, and Links Engineering Library, including Databases and e-journals GRADING, tentative Class participation: 35 Mid-Term Paper: 15 Final Paper: 50 2

2 Syllabus - 1 Week Tuesday Thursday ==== ======= ======== 1 Overview and Preliminaries Minimization of Static Cost Functions 2 Principles for Optimal Control Principles for Optimal Control of Dynamic Systems Part 2 3 Path Constraints and Minimum-Time and -Fuel Numerical Optimization Optimization 4 Linear-Quadratic LQ) Control Dynamic System Stability 5 Linear-Quadratic Regulators Cost Functions and Controller Structures 6 LQ Control System Design Modal Properties of LQ Systems MID-TERM BREAK 3 Syllabus - 2 Week Tuesday Thursday ==== ======= ======== 7 Spectral Properties of LQ Systems Singular-Value Analysis Mid-Term Paper due 8 Probability and Statistics Least-Squares Estimation for Static Systems 9 Propagation of Uncertainty Kalman Filter in Dynamic Systems 10 Kalman-Bucy Filter Nonlinear State Estimation 11 Nonlinear State Estimation Adaptive State Estimation 12 Stochastic Optimal Control Linear-Quadratic-Gaussian Control READING PERIOD Final Paper due on Deans Date 4

3 Seminar Format Introduction Interactive Presentation and Discussion of Syllabus Topic Course Slides Assigned reading Additional visuals Will attempt to adhere to Syllabus Schedule After first few weeks, discussion led by students Discussion of recent journal papers Mid-Term Paper, Final Paper 5 Seminar Grading Rubric from CMU, 2000) 6

4 Seminar Grading Rubric from CMU, 2000) 7 Typical Optimization Problems Minimize the probable error in an estimate of the dynamic state of a system Maximize the probability of making a correct decision Minimize the time or energy required to achieve an objective Minimize the regulation error in a controlled system Estimation Control 8

5 Dynamic Systems Dynamic Process: Current state depends on prior state x = dynamic state u = input w = exogenous disturbance p = parameter t or k = time or event index Observation Process: Measurement may contain error or be incomplete y = output error-free) z = measurement n = measurement error All of these quantities are vectors 9 Mathematical Models of Dynamic Systems Dynamic Process: Current state depends on prior state x = dynamic state u = input w = exogenous disturbance p = parameter t = time index Observation Process: Measurement may contain error or be incomplete y = output error-free) z = measurement n = measurement error Continuous-time dynamic process: Vector Ordinary Differential Equation xt) = dxt) dt = f[xt),ut),wt),pt),t] t = time, s Output Transformation yt) = h[xt),ut)] Measurement with Error zt) = yt) + nt) 10

6 p = Example: Lateral Automobile Dynamics m I zz Y v Y steer N v N steer Constant forward axial) velocity, u No rigid-body rolling motion State Vector v Side velocity, m/s r x = Yaw angle rate, rad/s = y Lateral position, m Yaw angle, rad Parameter Vector u = steer = Steering angle, rad w = mass, kg Lateral moment of inertia, N-m Side force sensitivity to side velocity, N/m/s) Side force sensitivity to steering angle, N/rad = Yawing moment sensitivity to side velocity, N-m/m/s) Yawing moment sensitivity to steering angle, N-m/rad Control and Disturbance Vectors v wind f road = Crosswind, m/s Side force on front wheel, N Output and Measurement Vectors y y = = Lateral position, m Yaw angle, rad z = y measured measured = y + error + error 11 Lateral Automobile Dynamics Example Dynamic Process Observation Process x t) = ) ) ) ) v t r t y t t = Y x,u,w) m N x,u,w) I yy u sin + vcos r y = z = y z 1 z 2 = y 1 y 2 = y 1 + n 1 y 2 + n 2 = x 1 x 3 x 4

7 Discrete-Time Models of Dynamic Systems Dynamic Process: Current state depends on prior state x = dynamic state u = input w = exogenous disturbance p = parameter t = time index Discrete-time dynamic process: Vector Ordinary Difference Equation Observation Process: Measurement may contain error or be incomplete y = output error-free) z = measurement n = measurement error x k+1 = f k [x k,u k,w k,p k,k] t k+1 t k k = time index, - ) = time interval, s Output Transformation Measurement with Error y k = h k [x k,u k ] z k = y k + n k 13 Approximate Discrete-Time Lateral Automobile Dynamics Example x k+1 = Approximate Dynamic Process Rectangular Integration) v k+1 r k+1 y k+1 k+1 ) Y k x k,u k,w k m N k x k,u k,w k ) I yy u k sin k + v k cos k r k t k+1 ) t k ) = Observation Process y k = y k k = z k = = y 1k y 2k z 1k z 2k + n 1k + n 2k y 1k y 2k x 1k k x 3k x 4k 14

8 Dynamic System Model Types NTV NTI LTV LTI dxt) dt dxt) dt = f [ xt),ut),wt),pt),t ] dxt) dt = f [ xt),ut),wt) ] = Ft)xt) + Gt)ut) + Lt)wt) dxt) = Fxt) + Gut) + Lwt) dt 15 Controllability and Observability are Fundamental Characteristics of a Dynamic System Controllability: State can be brought from an arbitrary initial condition to zero in finite time by the use of control Observability: Initial state can be derived from measurements over a finite time interval Subsets of the system may be either, both, or neither Effects of Stability Stabilizability Detectability Blocks subject to feedback control? 16

9 Introduction to Optimization 17 Optimization Implies Choice Choice of best strategy Choice of best design parameters Choice of best control history Choice of best estimate Optimization is provided by selection of best control variables) 18

10 Tradeoff Between Two Cost Factors Minimum-Cost Cruising Speed Nominal Tradeoff Fuel Cost Doubled Fuel cost proportional to velocity-squared Cost of time inversely proportional to velocity Time Cost Doubled 19 Desirable Characteristics of a Cost Function, J Scalar Clearly defined preferably unique) maximum or minimum Local Global Preferably positive-definite i.e., always a positive number) 20

11 Criteria for Optimization Names for criteria Figure of merit Performance index Utility function Value function Cost function, J Optimal cost function = J* Optimal control = u* Minimum J = k Different criteria lead to different optimal solutions Maximum J = ke x2 Types of Optimality Criteria Absolute Regulatory Feasible 21 Minimum Cost Functions with Two Control Parameters Maximum 3-D plot of equal-cost contours iso-contours) 2-D plot of equal-cost contours iso-contours) 22

12 Real-World Topography Local vs. global maxima/minima 23 Cost Functions with Equality Constraints Must stay on the trail c u 1,u 2 ) = 0 u 2 = fcn u 1 ) then ) = J u 1, fcn u 1 ) J u 1,u 2 ) = J u 1 Equality constraint may allow control dimension to be reduced 24

13 Example: Minimize Concentrations of Bacteria, Infected Cells, and Drug Usage x 1 = Concentration of a pathogen, which displays antigen = Concentration of plasma cells, which are carriers and producers of antibodies x 3 = Concentration of antibodies, which recognize antigen and kill pathogen x 4 = Relative characteristic of a damaged organ [0 = healthy, 1 = dead] What is a reasonable cost function to minimize? 25 Optimal Estimate of the State, x, Given Uncertainty 26

14 Optimal State Estimation Goals Minimize effects of measurement error on knowledge of the state Reconstruct full state from reduced measurement set r n) Average redundant measurements r n) to estimate the full state Method Provide optimal balance between measurements and estimates based on the dynamic model alone 27 Typical Problems in Optimal Control and Estimation 28

15 Minimize an Absolute Criterion Achieve a specific objective Minimum time Minimum fuel Minimum financial cost to achieve a goal What is the control variable? 29 Optimal System Regulation Find feedback control gains that minimize tracking error in presence of random disturbances 30

16 Feasible Control Logic Find feedback control structure that guarantees stability i.e., that keeps x from diverging) 31 Cost Functions with Inequality Constraints Must stay to the left of the trail Must stay to the right of the trail 32

17 Static vs. Dynamic Optimization Static Optimal state, x*, and control, u*, are fixed, i.e., they do not change over time J* = Jx*, u*) Functional minimization or maximization) Parameter optimization Dynamic Optimal state and control vary over time J* = J[x*t), u*t)] Optimal trajectory Optimal feedback strategy Optimized cost function, J*, is a scalar, real number in both cases 33 Deterministic vs. Stochastic Optimization Deterministic System model, parameters, initial conditions, and disturbances are known without error Optimal control operates on the system with certainty J* = Jx*, u*) Stochastic Uncertainty in system model parameters initial conditions disturbances resulting cost function Optimal control minimizes the expected value of the cost: Optimal cost = E{J[x*, u*]} Cost function is a scalar, real number in both cases 34

18 Example: Pursuit-Evasion: Competitive Optimization Problem Pursuer s goal: minimize final miss distance Evader s goal: maximize final miss distance Minimax saddle-point) cost function Optimal control laws for pursuer and evader ut) = u P t) u E t) = C P t) C t) PE C EP t) C E t) ˆx P t) ˆx E t) Example of a differential game, Isaacs 1965), Bryson Ho 1969) 35 Example: Simultaneous Location and Mapping SLAM) Durrant- Whyte et al Build or update a local map within an unknown environment Stochastic map, defined by mean and covariance SLAM Algorithm = State estimation with extended Kalman filter Landmark and terrain tracking 36

19 SLAM Senior Thesis Research Quan Zhou, 15 Turtlebot Kinect 1 SLAM Navigation Results 37 Next Time: Minimization of Static Cost Functions Reading: Optimal Control and Estimation OCE): Chapter 1, Section

20 Supplemental Material 39 Math Review Scalars and Vectors Matrices, Transpose, and Trace Sums and Multiplication Vector Products Matrix Products Derivatives, Integrals, and Identity Matrix Matrix Inverse 40

21 Scalars and Vectors Scalar: usually lower case: a, b, c,, x, y, z Vector: usually bold or with underbar: x or x Ordered set Column of scalars Dimension = n x 1 x = x 1 x 3 3-D Vector ; y = a b c d 3 x 1 4 x 1 Transpose: interchange rows and columns x T = x 1 x 3 1 x 3 41 Matrices and Transpose Matrix: Usually bold capital or capital: F or F Dimension = m x n) Transpose: Interchange rows and columns A = a b c d e f g h k l m n 4 x 3 A T = a d g l b e h m c f k n 3 x 4 42

22 Trace of a Square Matrix Trace of A = n i=1 a ii A = a b c d e f g h i ; Tr A) = a + e + i 43 Sums and Multiplication by a Scalar Operands must be conformable Conformable vectors and matrices are added term by term x = a b ; z = c d ; x + z = a + c) b + d) A = a 1 a 2 a 3 a 4 ; B = b 1 b 2 b 3 b 4 ; A + B = a 1 + b 1 ) a 2 + b 2 ) a 3 + b 3 ) a 4 + b 4 ) Multiplication of vector by scalar is associative commutative distributive ax 1 ax = xa = a ax 3 ax T = ax 1 a ax 3 44

23 Vector Products Inner dot) product of vectors produces a scalar x T x = x x = x 1 x 3 1 m)m 1) = 11) x 1 x 3 = ) Outer product of vectors produces a matrix xx T = x x = x 1 x 3 m 1)1 m) = m m) x 1 x 3 = x 1 2 x 1 2 x 1 x 1 x 3 x 3 x 3 x 1 x 3 x Matrix Products Matrix-vector product transforms one vector into another y = Ax = a b c d e f g h k l m n n 1) = n m)m 1) x 1 x 3 = ax 1 + b + cx 3 dx 1 + e + fx 3 gx 1 + h + kx 3 lx 1 + m + nx 3 Matrix-matrix product produces a new matrix a 1 a 2 b 1 b 2 A = ; B = ; AB = a 3 a 4 b 3 b 4 a 1 b 1 + a 2 b 3 ) a 1 b 2 + a 2 b 4 ) a 3 b 1 + a 4 b 3 ) a 3 b 2 + a 4 b 4 ) n m) = n l)l m) 46

24 Inner product x T x = Examples = ) = 14 = length) 2 y = v x v y v z Rotation of expression for velocity vector through pitch angle = 2 cos 0 sin sin 0 cos Matrix product v x v y v z v x1 cos + v z1 sin = v y1 v x1 cos + v z1 sin a c b d = a + 2c 3a + 4c b + 2d 3b + 4d 47 Vector Transformation Example y = Ax = n 1) = n m)m 1) x 1 x 3 = 2x x 3 ) 3x x 3 ) 4x x 3 ) ) 9x 1 6 3x 3 = y 1 y 2 y 3 y 4 48

25 Derivatives and Integrals of Vectors Derivatives and integrals of vectors are vectors of derivatives and integrals dx dt = dx 1 dt d dt dx 3 dt x dt = x 1 dt dt x 3 dt 49 Matrix Identity and Inverse Identity matrix: no change when it multiplies a conformable vector or matrix I 3 = y = Iy A non-singular square matrix multiplied by its inverse forms an identity matrix AA 1 = A 1 A = I AA 1 = = cos 0 sin sin 0 cos cos 0 sin sin 0 cos = cos 0 sin sin 0 cos cos 0 sin sin 0 cos 1 50

26 A non-singular square matrix multiplied by its inverse forms an identity matrix Matrix Inverse AA 1 = A 1 A = I The inverse allows a reverse transformation of vectors of equal dimension y = Ax; x = A 1 y; dimx) = dimy) = n 1); dima) = n n) ) [ A] 1 = Adj A A = Adj A) det A n n) 1 1) Cofactors are signed minors of A = CT det A ; C = matrix of cofactors ij th minor of A is the determinant of A with the i th row and j th column removed 51 Matrix Inverse Example Transformation = Ax 1 x y z 2 = cos 0 sin sin 0 cos x y z 1 Inverse Transformation x 1 = A 1 x y z 1 = cos 0 sin sin 0 cos x y z 2 52

Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!

Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries! Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2018 Copyright 2018 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html

More information

Introduction to Optimization!

Introduction to Optimization! Introduction to Optimization! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2017 Optimization problems and criteria Cost functions Static optimality conditions Examples

More information

Aircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2018

Aircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2018 Aircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2018 Course Overview Introduction to Flight Dynamics Math Preliminaries Copyright 2018 by Robert Stengel. All rights reserved. For

More information

Aircraft Flight Dynamics!

Aircraft Flight Dynamics! Aircraft Flight Dynamics Robert Stengel MAE 331, Princeton University, 2016 Course Overview Introduction to Flight Dynamics Math Preliminaries Copyright 2016 by Robert Stengel. All rights reserved. For

More information

Minimization with Equality Constraints

Minimization with Equality Constraints Path Constraints and Numerical Optimization Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2015 State and Control Equality Constraints Pseudoinverse State and Control Inequality

More information

Time Response of Dynamic Systems! Multi-Dimensional Trajectories Position, velocity, and acceleration are vectors

Time Response of Dynamic Systems! Multi-Dimensional Trajectories Position, velocity, and acceleration are vectors Time Response of Dynamic Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 217 Multi-dimensional trajectories Numerical integration Linear and nonlinear systems Linearization

More information

Stochastic Optimal Control!

Stochastic Optimal Control! Stochastic Control! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2015 Learning Objectives Overview of the Linear-Quadratic-Gaussian (LQG) Regulator Introduction to Stochastic

More information

Minimization with Equality Constraints!

Minimization with Equality Constraints! Path Constraints and Numerical Optimization Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2017 State and Control Equality Constraints Pseudoinverse State and Control Inequality

More information

Nonlinear State Estimation! Extended Kalman Filters!

Nonlinear State Estimation! Extended Kalman Filters! Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal

More information

OPTIMAL CONTROL AND ESTIMATION

OPTIMAL CONTROL AND ESTIMATION OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION

More information

Dynamic Optimal Control!

Dynamic Optimal Control! Dynamic Optimal Control! Robert Stengel! Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Learning Objectives Examples of cost functions Necessary conditions for optimality Calculation

More information

Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015

Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015 Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 15 Asymptotic approach from time-varying to constant gains Elimination of cross weighting

More information

Minimization of Static! Cost Functions!

Minimization of Static! Cost Functions! Minimization of Static Cost Functions Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2017 J = Static cost function with constant control parameter vector, u Conditions for

More information

Stochastic and Adaptive Optimal Control

Stochastic and Adaptive Optimal Control Stochastic and Adaptive Optimal Control Robert Stengel Optimal Control and Estimation, MAE 546 Princeton University, 2018! Nonlinear systems with random inputs and perfect measurements! Stochastic neighboring-optimal

More information

Linear-Quadratic-Gaussian Controllers!

Linear-Quadratic-Gaussian Controllers! Linear-Quadratic-Gaussian Controllers! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 2017!! LTI dynamic system!! Certainty Equivalence and the Separation Theorem!! Asymptotic

More information

Time-Invariant Linear Quadratic Regulators!

Time-Invariant Linear Quadratic Regulators! Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 17 Asymptotic approach from time-varying to constant gains Elimination of cross weighting

More information

Linearized Equations of Motion!

Linearized Equations of Motion! Linearized Equations of Motion Robert Stengel, Aircraft Flight Dynamics MAE 331, 216 Learning Objectives Develop linear equations to describe small perturbational motions Apply to aircraft dynamic equations

More information

Control Systems! Copyright 2017 by Robert Stengel. All rights reserved. For educational use only.

Control Systems! Copyright 2017 by Robert Stengel. All rights reserved. For educational use only. Control Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Analog vs. digital systems Continuous- and Discretetime Dynamic Models Frequency Response Transfer Functions

More information

Translational and Rotational Dynamics!

Translational and Rotational Dynamics! Translational and Rotational Dynamics Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 217 Copyright 217 by Robert Stengel. All rights reserved. For educational use only.

More information

Linear-Optimal State Estimation

Linear-Optimal State Estimation Linear-Optimal State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218 Linear-optimal Gaussian estimator for discrete-time system (Kalman filter) 2 nd -order example

More information

Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013

Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013 Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013 Abstract As in optimal control theory, linear quadratic (LQ) differential games (DG) can be solved, even in high dimension,

More information

Return Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems

Return Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems Spectral Properties of Linear- Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018! Stability margins of single-input/singleoutput (SISO) systems! Characterizations

More information

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control Chapter 3 LQ, LQG and Control System H 2 Design Overview LQ optimization state feedback LQG optimization output feedback H 2 optimization non-stochastic version of LQG Application to feedback system design

More information

First-Order Low-Pass Filter!

First-Order Low-Pass Filter! Filters, Cost Functions, and Controller Structures! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 217!! Dynamic systems as low-pass filters!! Frequency response of dynamic

More information

(q 1)t. Control theory lends itself well such unification, as the structure and behavior of discrete control

(q 1)t. Control theory lends itself well such unification, as the structure and behavior of discrete control My general research area is the study of differential and difference equations. Currently I am working in an emerging field in dynamical systems. I would describe my work as a cross between the theoretical

More information

Aircraft Equations of Motion: Translation and Rotation Robert Stengel, Aircraft Flight Dynamics, MAE 331, 2018

Aircraft Equations of Motion: Translation and Rotation Robert Stengel, Aircraft Flight Dynamics, MAE 331, 2018 Aircraft Equations of Motion: Translation and Rotation Robert Stengel, Aircraft Flight Dynamics, MAE 331, 2018 Learning Objectives What use are the equations of motion? How is the angular orientation of

More information

OR MSc Maths Revision Course

OR MSc Maths Revision Course OR MSc Maths Revision Course Tom Byrne School of Mathematics University of Edinburgh t.m.byrne@sms.ed.ac.uk 15 September 2017 General Information Today JCMB Lecture Theatre A, 09:30-12:30 Mathematics revision

More information

Overview of the Seminar Topic

Overview of the Seminar Topic Overview of the Seminar Topic Simo Särkkä Laboratory of Computational Engineering Helsinki University of Technology September 17, 2007 Contents 1 What is Control Theory? 2 History

More information

Estimation, Detection, and Identification CMU 18752

Estimation, Detection, and Identification CMU 18752 Estimation, Detection, and Identification CMU 18752 Graduate Course on the CMU/Portugal ECE PhD Program Spring 2008/2009 Instructor: Prof. Paulo Jorge Oliveira pjcro @ isr.ist.utl.pt Phone: +351 21 8418053

More information

Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018

Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018 Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Nonlinearity of adaptation! Parameter-adaptive filtering! Test for whiteness of the residual!

More information

Basic Linear Algebra in MATLAB

Basic Linear Algebra in MATLAB Basic Linear Algebra in MATLAB 9.29 Optional Lecture 2 In the last optional lecture we learned the the basic type in MATLAB is a matrix of double precision floating point numbers. You learned a number

More information

Time Series Analysis

Time Series Analysis Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture State space models, 1st part: Model: Sec. 10.1 The

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

Linear Quadratic Zero-Sum Two-Person Differential Games

Linear Quadratic Zero-Sum Two-Person Differential Games Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard To cite this version: Pierre Bernhard. Linear Quadratic Zero-Sum Two-Person Differential Games. Encyclopaedia of Systems and Control,

More information

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications

More information

MATRICES The numbers or letters in any given matrix are called its entries or elements

MATRICES The numbers or letters in any given matrix are called its entries or elements MATRICES A matrix is defined as a rectangular array of numbers. Examples are: 1 2 4 a b 1 4 5 A : B : C 0 1 3 c b 1 6 2 2 5 8 The numbers or letters in any given matrix are called its entries or elements

More information

6.241 Dynamic Systems and Control

6.241 Dynamic Systems and Control 6.241 Dynamic Systems and Control Lecture 24: H2 Synthesis Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology May 4, 2011 E. Frazzoli (MIT) Lecture 24: H 2 Synthesis May

More information

Exam. 135 minutes, 15 minutes reading time

Exam. 135 minutes, 15 minutes reading time Exam August 6, 208 Control Systems II (5-0590-00) Dr. Jacopo Tani Exam Exam Duration: 35 minutes, 5 minutes reading time Number of Problems: 35 Number of Points: 47 Permitted aids: 0 pages (5 sheets) A4.

More information

Introduction to Matrices

Introduction to Matrices 214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the

More information

Basic Math Review for CS4830

Basic Math Review for CS4830 Basic Math Review for CS4830 Dr. Mihail August 18, 2016 (Dr. Mihail) Math Review for CS4830 August 18, 2016 1 / 35 Sets Definition of a set A set is a collection of distinct objects, considered as an object

More information

Singular Value Analysis of Linear- Quadratic Systems!

Singular Value Analysis of Linear- Quadratic Systems! Singular Value Analyi of Linear- Quadratic Sytem! Robert Stengel! Optimal Control and Etimation MAE 546! Princeton Univerity, 2017!! Multivariable Nyquit Stability Criterion!! Matrix Norm and Singular

More information

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system

More information

Nonlinear State Estimation! Particle, Sigma-Points Filters!

Nonlinear State Estimation! Particle, Sigma-Points Filters! Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat

Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat Linear Algebra Lecture 2 1.3.7 Matrix Matrix multiplication using Falk s

More information

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 19 Modeling Topics plan: Modeling (linear/non- linear least squares) Bayesian inference Bayesian approaches to spectral esbmabon;

More information

Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX

Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

Review of Linear Algebra

Review of Linear Algebra Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=

More information

Basic Math Review for CS1340

Basic Math Review for CS1340 Basic Math Review for CS1340 Dr. Mihail January 15, 2015 (Dr. Mihail) Math Review for CS1340 January 15, 2015 1 / 34 Sets Definition of a set A set is a collection of distinct objects, considered as an

More information

Nonlinear Observer Design for Dynamic Positioning

Nonlinear Observer Design for Dynamic Positioning Author s Name, Company Title of the Paper DYNAMIC POSITIONING CONFERENCE November 15-16, 2005 Control Systems I J.G. Snijders, J.W. van der Woude Delft University of Technology (The Netherlands) J. Westhuis

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

UCLA Chemical Engineering. Process & Control Systems Engineering Laboratory

UCLA Chemical Engineering. Process & Control Systems Engineering Laboratory Constrained Innite-time Optimal Control Donald J. Chmielewski Chemical Engineering Department University of California Los Angeles February 23, 2000 Stochastic Formulation - Min Max Formulation - UCLA

More information

4 Linear Algebra Review

4 Linear Algebra Review Linear Algebra Review For this topic we quickly review many key aspects of linear algebra that will be necessary for the remainder of the text 1 Vectors and Matrices For the context of data analysis, the

More information

Multiple Degree of Freedom Systems. The Millennium bridge required many degrees of freedom to model and design with.

Multiple Degree of Freedom Systems. The Millennium bridge required many degrees of freedom to model and design with. Multiple Degree of Freedom Systems The Millennium bridge required many degrees of freedom to model and design with. The first step in analyzing multiple degrees of freedom (DOF) is to look at DOF DOF:

More information

ELEC4631 s Lecture 2: Dynamic Control Systems 7 March Overview of dynamic control systems

ELEC4631 s Lecture 2: Dynamic Control Systems 7 March Overview of dynamic control systems ELEC4631 s Lecture 2: Dynamic Control Systems 7 March 2011 Overview of dynamic control systems Goals of Controller design Autonomous dynamic systems Linear Multi-input multi-output (MIMO) systems Bat flight

More information

Chapter 9: Systems of Equations and Inequalities

Chapter 9: Systems of Equations and Inequalities Chapter 9: Systems of Equations and Inequalities 9. Systems of Equations Solve the system of equations below. By this we mean, find pair(s) of numbers (x, y) (if possible) that satisfy both equations.

More information

1 Determinants. 1.1 Determinant

1 Determinants. 1.1 Determinant 1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

Kalman Filters with Uncompensated Biases

Kalman Filters with Uncompensated Biases Kalman Filters with Uncompensated Biases Renato Zanetti he Charles Stark Draper Laboratory, Houston, exas, 77058 Robert H. Bishop Marquette University, Milwaukee, WI 53201 I. INRODUCION An underlying assumption

More information

A Review of Matrix Analysis

A Review of Matrix Analysis Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value

More information

Columbus State Community College Mathematics Department Public Syllabus

Columbus State Community College Mathematics Department Public Syllabus Columbus State Community College Mathematics Department Public Syllabus Course and Number: MATH 2568 Elementary Linear Algebra Credits: 4 Class Hours Per Week: 4 Prerequisites: MATH 2153 with a C or higher

More information

11 a 12 a 21 a 11 a 22 a 12 a 21. (C.11) A = The determinant of a product of two matrices is given by AB = A B 1 1 = (C.13) and similarly.

11 a 12 a 21 a 11 a 22 a 12 a 21. (C.11) A = The determinant of a product of two matrices is given by AB = A B 1 1 = (C.13) and similarly. C PROPERTIES OF MATRICES 697 to whether the permutation i 1 i 2 i N is even or odd, respectively Note that I =1 Thus, for a 2 2 matrix, the determinant takes the form A = a 11 a 12 = a a 21 a 11 a 22 a

More information

Lecture 13: Simple Linear Regression in Matrix Format

Lecture 13: Simple Linear Regression in Matrix Format See updates and corrections at http://www.stat.cmu.edu/~cshalizi/mreg/ Lecture 13: Simple Linear Regression in Matrix Format 36-401, Section B, Fall 2015 13 October 2015 Contents 1 Least Squares in Matrix

More information

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004 MER42 Advanced Control Lecture 9 Introduction to Kalman Filtering Linear Quadratic Gaussian Control (LQG) G. Hovland 24 Announcement No tutorials on hursday mornings 8-9am I will be present in all practical

More information

Alternative Expressions for the Velocity Vector Velocity restricted to the vertical plane. Longitudinal Equations of Motion

Alternative Expressions for the Velocity Vector Velocity restricted to the vertical plane. Longitudinal Equations of Motion Linearized Longitudinal Equations of Motion Robert Stengel, Aircraft Flig Dynamics MAE 33, 008 Separate solutions for nominal and perturbation flig paths Assume that nominal path is steady and in the vertical

More information

Mathematical Theory of Control Systems Design

Mathematical Theory of Control Systems Design Mathematical Theory of Control Systems Design by V. N. Afarias'ev, V. B. Kolmanovskii and V. R. Nosov Moscow University of Electronics and Mathematics, Moscow, Russia KLUWER ACADEMIC PUBLISHERS DORDRECHT

More information

Review 1 Math 321: Linear Algebra Spring 2010

Review 1 Math 321: Linear Algebra Spring 2010 Department of Mathematics and Statistics University of New Mexico Review 1 Math 321: Linear Algebra Spring 2010 This is a review for Midterm 1 that will be on Thursday March 11th, 2010. The main topics

More information

Chapter 2 Optimal Control Problem

Chapter 2 Optimal Control Problem Chapter 2 Optimal Control Problem Optimal control of any process can be achieved either in open or closed loop. In the following two chapters we concentrate mainly on the first class. The first chapter

More information

EL2520 Control Theory and Practice

EL2520 Control Theory and Practice EL2520 Control Theory and Practice Lecture 8: Linear quadratic control Mikael Johansson School of Electrical Engineering KTH, Stockholm, Sweden Linear quadratic control Allows to compute the controller

More information

Course Syllabus for CIVL 2110 STATICS Spring

Course Syllabus for CIVL 2110 STATICS Spring Course Syllabus for CIVL 2110 STATICS Spring 2016-2017 Instructor: email: ilias@ust.hk Dr. Ilias DIMITRAKOPOULOS room: 3583 tel: 2358-5975: office hours Wed, Fri: 11:00-12:00 Lectures: Wed, Fri 16:30-18:00

More information

Flip Your Grade Book With Concept-Based Grading CMC 3 South Presentation, Pomona, California, 2016 March 05

Flip Your Grade Book With Concept-Based Grading CMC 3 South Presentation, Pomona, California, 2016 March 05 Flip Your Grade Book With Concept-Based Grading CMC South Presentation, Pomona, California, 016 March 05 Phil Alexander Smith, American River College (smithp@arc.losrios.edu) Additional Resources and Information

More information

MATH 2050 Assignment 8 Fall [10] 1. Find the determinant by reducing to triangular form for the following matrices.

MATH 2050 Assignment 8 Fall [10] 1. Find the determinant by reducing to triangular form for the following matrices. MATH 2050 Assignment 8 Fall 2016 [10] 1. Find the determinant by reducing to triangular form for the following matrices. 0 1 2 (a) A = 2 1 4. ANS: We perform the Gaussian Elimination on A by the following

More information

TTK4190 Guidance and Control Exam Suggested Solution Spring 2011

TTK4190 Guidance and Control Exam Suggested Solution Spring 2011 TTK4190 Guidance and Control Exam Suggested Solution Spring 011 Problem 1 A) The weight and buoyancy of the vehicle can be found as follows: W = mg = 15 9.81 = 16.3 N (1) B = 106 4 ( ) 0.6 3 3 π 9.81 =

More information

Multiple View Geometry in Computer Vision

Multiple View Geometry in Computer Vision Multiple View Geometry in Computer Vision Prasanna Sahoo Department of Mathematics University of Louisville 1 Basic Information Instructor: Professor Ron Sahoo Office: NS 218 Tel: (502) 852-2731 Fax: (502)

More information

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model

More information

LINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM

LINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM LINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM Unless otherwise stated, all vector spaces in this worksheet are finite dimensional and the scalar field F is R or C. Definition 1. A linear operator

More information

1 Continuous-time Systems

1 Continuous-time Systems Observability Completely controllable systems can be restructured by means of state feedback to have many desirable properties. But what if the state is not available for feedback? What if only the output

More information

CPE 310: Numerical Analysis for Engineers

CPE 310: Numerical Analysis for Engineers CPE 310: Numerical Analysis for Engineers Chapter 2: Solving Sets of Equations Ahmed Tamrawi Copyright notice: care has been taken to use only those web images deemed by the instructor to be in the public

More information

Nonlinear Model Predictive Control Tools (NMPC Tools)

Nonlinear Model Predictive Control Tools (NMPC Tools) Nonlinear Model Predictive Control Tools (NMPC Tools) Rishi Amrit, James B. Rawlings April 5, 2008 1 Formulation We consider a control system composed of three parts([2]). Estimator Target calculator Regulator

More information

(Refer Slide Time: 00:01:30 min)

(Refer Slide Time: 00:01:30 min) Control Engineering Prof. M. Gopal Department of Electrical Engineering Indian Institute of Technology, Delhi Lecture - 3 Introduction to Control Problem (Contd.) Well friends, I have been giving you various

More information

Mathematical Economics. Lecture Notes (in extracts)

Mathematical Economics. Lecture Notes (in extracts) Prof. Dr. Frank Werner Faculty of Mathematics Institute of Mathematical Optimization (IMO) http://math.uni-magdeburg.de/ werner/math-ec-new.html Mathematical Economics Lecture Notes (in extracts) Winter

More information

3-D Kinetics of Rigid Bodies

3-D Kinetics of Rigid Bodies 3-D Kinetics of Rigid Bodies Angular Momentum Generalized Newton s second law for the motion for a 3-D mass system Moment eqn for 3-D motion will be different than that obtained for plane motion Consider

More information

a11 a A = : a 21 a 22

a11 a A = : a 21 a 22 Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are

More information

Knowledge Discovery and Data Mining 1 (VO) ( )

Knowledge Discovery and Data Mining 1 (VO) ( ) Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory

More information

Phys 201. Matrices and Determinants

Phys 201. Matrices and Determinants Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1

More information

Math Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p

Math Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p Math Bootcamp 2012 1 Review of matrix algebra 1.1 Vectors and rules of operations An p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the

More information

Linear Algebra. Linear Equations and Matrices. Copyright 2005, W.R. Winfrey

Linear Algebra. Linear Equations and Matrices. Copyright 2005, W.R. Winfrey Copyright 2005, W.R. Winfrey Topics Preliminaries Systems of Linear Equations Matrices Algebraic Properties of Matrix Operations Special Types of Matrices and Partitioned Matrices Matrix Transformations

More information

Convolutional networks. Sebastian Seung

Convolutional networks. Sebastian Seung Convolutional networks Sebastian Seung Convolutional network Neural network with spatial organization every neuron has a location usually on a grid Translation invariance synaptic strength depends on locations

More information

minimize x subject to (x 2)(x 4) u,

minimize x subject to (x 2)(x 4) u, Math 6366/6367: Optimization and Variational Methods Sample Preliminary Exam Questions 1. Suppose that f : [, L] R is a C 2 -function with f () on (, L) and that you have explicit formulae for

More information

First-Order Low-Pass Filter

First-Order Low-Pass Filter Filters, Cost Functions, and Controller Structures Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Dynamic systems as low-pass filters! Frequency response of dynamic systems!

More information

Industrial Model Predictive Control

Industrial Model Predictive Control Industrial Model Predictive Control Emil Schultz Christensen Kongens Lyngby 2013 DTU Compute-M.Sc.-2013-49 Technical University of Denmark DTU Compute Matematiktovet, Building 303B, DK-2800 Kongens Lyngby,

More information

QUALIFYING EXAM IN SYSTEMS ENGINEERING

QUALIFYING EXAM IN SYSTEMS ENGINEERING QUALIFYING EXAM IN SYSTEMS ENGINEERING Written Exam: MAY 23, 2017, 9:00AM to 1:00PM, EMB 105 Oral Exam: May 25 or 26, 2017 Time/Location TBA (~1 hour per student) CLOSED BOOK, NO CHEAT SHEETS BASIC SCIENTIFIC

More information

Control of Mobile Robots

Control of Mobile Robots Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and

More information

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents

More information

Mobile Robot Localization

Mobile Robot Localization Mobile Robot Localization 1 The Problem of Robot Localization Given a map of the environment, how can a robot determine its pose (planar coordinates + orientation)? Two sources of uncertainty: - observations

More information

6.1 Matrices. Definition: A Matrix A is a rectangular array of the form. A 11 A 12 A 1n A 21. A 2n. A m1 A m2 A mn A 22.

6.1 Matrices. Definition: A Matrix A is a rectangular array of the form. A 11 A 12 A 1n A 21. A 2n. A m1 A m2 A mn A 22. 61 Matrices Definition: A Matrix A is a rectangular array of the form A 11 A 12 A 1n A 21 A 22 A 2n A m1 A m2 A mn The size of A is m n, where m is the number of rows and n is the number of columns The

More information

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y. as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations

More information

A Review of Linear Algebra

A Review of Linear Algebra A Review of Linear Algebra Gerald Recktenwald Portland State University Mechanical Engineering Department gerry@me.pdx.edu These slides are a supplement to the book Numerical Methods with Matlab: Implementations

More information