Disturbance modelling

Size: px
Start display at page:

Download "Disturbance modelling"

Transcription

1 Lecture 3 Disturbance modelling This section reviews the main aspects in disturbance modelling and the corresponding relations of descriptions in the time and frequency domain, respectively. We will also consider the two related questions illustrated in Fig.3.; (i) Givenaknowninputspectraandknowntransferfunction,whatisthespectral density of the output (ii) Givenaknownspectraldensityforasignal,findastablelinearsystemwith white noise input which gives the same spectral density on its output. The latter problem is called the spectral factorization problem and will be used to rewrite systems with coloured disturbances to an equivalent system with white noise input, which will be used as a standard form for different estimation and prediction problems later on in course. G(iω)known? {U, Φ uu }? "white noise" {Y, Φ yy } Figure 3. Illustration of two main questions of disturbance modelling in this chapter;(left) Whatistheoutputspectraldensity Φ yy giventhatweknowtheinputspectraldensity Φ uu and and the linear filter G(iω)?(right) Knowing the output spectral density, find a stable linear filter which gives the same output spectral density if fed by white noise. 3. Disturbances In the basic control diagram of Fig. 3. we consider load disturbances d and measurement noise n r d F e u Σ C Σ P z Σ n y c u d m d s g z + y n Figure 3. (Left) The basic control loop with load disturbances d and measurement noise n. (Right)Loaddisturbanceswhichcanbemeasured,d m,e.g.,changesinoutertemperature,can be(partially) compensated for by feedforward to the control signal.

2 Lecture 3. Disturbance modelling The load disturbance d drives the system from its desired state whereas the measurement noise n corrupts the feedback information about z. Load disturbancescanbedividedintomeasurableloaddisturbances,d m,whichpartiallycan be compensated by feedforward, and load disturbances which can t be measured. Evenifwecan tmeasured s infig.3.,statisticalinformationlikecovarianceor spectral density will help us to design controllers which reduces/supresses the effect of the disturbances with respect to e.g., average and variance of the control objective z. Example In paper production there are a lot of disturbances which affect the paper quality andthepaperthickness.oneobjectiveistokeepdownthevariationinthepaper thickness, see Fig Setpoint for controller with good tuning Distribution Test limit Setpoint for controller with bad tuning (Relative) paper thickness, test limit at. Figure 3.3 To be of acceptable quality, products must exceed a certain threshold. By minimizingthevarianceofthethicknessweseethattheaverageofthepaperthicknesscanbe reducedsignificantly(wecomeclosertothetestlimit)forthesameyield.thismaysavea lot in production costs regarding both energy and raw material. All paper production below the test limit is wasted. Good control allows for lower setpoint with the same yield. By having a lower variance of the production, the average paper thickness can thus also be lower, which saves significant costs inbothenergyandrawmaterial.keepingdownthevarianceoftheoutputwillbe an important control objective for us in this course. A first glimpse at linear stochastic control Inthepreviousexamplewesawthatoneobjectivecouldbetominimizethevarianceoftheoutputorofastate.Inamoregeneralsettingonecanchooseatrade-off withrespecttohowmuchcontrolactiononewillusebyintroducingacostforthis as well. Consider a system with state-disturbances w and measurement-disturbances v. The LQ-problem(Linear system, Quadratic cost function) is then described as follows: Minimize subjectto (x T Q x+x T Q u+u T Q u ) dt ẋ=ax+bu+w y=cx+du+v wherevandwiswhitenoisewithintensityr andr respectively.

3 3. Disturbances ξ Arealization x(, ω ) F( ξ,t ) x(, ω ) x(, ω 3 ) x(, ω 4 ) t t Figure3.4 Astochasticprocess:Forafixed ω wecallitarealization,forfixedtimet it willcorrespondtoarandomvariablewithadistributionf(ξ,t )=Prob{x(t ) ξ}. Aswewillseelateroninthiscourse,onecansolvethisastwoindependent sub-problems thanks to the separation principle by considering Controller design for full state information, u = Lx Optimal estimation of states(kalman filter), ˆx=Aˆx+Bu+K(y ŷ) combination= Outputfeedbackusingobserveru= Lˆx... Beforewedothiswewillhaveacloserlookonhowtodescribedisturbancesusing statistical properties. Stochastic processes A stochastic process(random process, random function) is a family of stochastic variables{x(t),t T}wheretrepresentstime.Thestocasticprocesscanbeviewed asafunctionoftwovariablesx(t,ω).forafixed ω= ω itgivesatimefunction x(,ω ),oftencalledarealization,whereasifwefixthetimet=t itgivesa randomvariablex(t, )withacertaindistribution,seefig.3.4. For a zero-mean stationary stochastic processes the distribution is independent oft.werefertothebasiccourseinstatisticsformoredetailsonthefollowingconcepts: Mean-value function Ex(t) Covariance function. A zero mean Gaussian process x is completely determined by its covariance function: Cross-covariance function R x (τ)=ex(t+ τ)x(t) T R xy (τ)=ex(t+ τ)y(t) T Spectral density(defined for(weakly) stationary processes). The spectral density is the Fourier transform of the covariance function Φ xy (ω)= R xy (t)e itω dt 3

4 Lecture 3. Disturbance modelling and R xy (t)= e itω Φ xy (ω)dω π In particular, we get the following expressions for the covariance matrix: Exx T =R x ()= π Φ xx (ω)dω Whenxisscalar,thisissimplythevarianceofx.(Notation:Wewilluse Φ y as shortfor Φ yy.) For relations between covariance function, spectral density and a typical realization,seefig.3.5,whereonemaynoticethattherealizationsseemtobe"more random" the flatter the spectra is(over a larger frequency range) while peaks in the spectral density corresponds to periodic covariance functions. Covariance Spectrum Output τ frequency ω time - Figure 3.5 Relations between covariance function, spectral density and a typical realization. Correction: The spectra should be divided by π White noise Aparticulardisturbanceisso-calledwhitenoiseewithintensityR.HereRisa constant matrix, which corresponds to a constant spectrum, totally flat and equal for all frequencies: Φ e (ω)=r One effect of this definition is that the continuous-time version of white noise has infinite energy, and causes some issues to be handled mathematically rigorously, butwewillnotgointothesedetailshere. 4

5 3. Disturbances Themostimportantpropertyofwhitenoisewhichwewillusebelow,isthat it can not be predicted; based on previous measurements there is no information about future values(infinite variance). From transform theory we also have that thefouriertransformofthediracpulse δ(t),isconstant,whichcorrespondstoan alternative interpretation: by applying a Dirac impulse as input to a linear system, the spectral density of the corresponding output(i.e., of the impulse response), will be like a finger-print of the system s frequency properties. ThetwoproblemsrelatedtoFig.3.canbeformulatedas. Determine the covariance function and spectral density of y when white noise u is filtered through the linear system ẋ=ax+u(k) y=cx. Conversely,findfilterparametersforastablelinearfilter,AandC,togive the output y a desired spectral density. u G(s) y Whatistheoutputspectraldensityforyiftheinputuhasspectraldensity Φ u (ω)? We use the transfer function representation Y(iω)=G(iω)U(iω) wherey=f{y},u=f{u}arethefouriertransforms.accordingtothedefinition,weget Φ y (ω)ˆ=φ yy (ω)=y(iω)y(iω) =G(iω)U(iω)U(iω) G(iω) wherewecanidentifythespectraldensityoftheoutputas Φ yy (ω)=g(iω)φ uu (ω)g(iω) u G(s) y In similar way we find the cross-spectral density Spectral factorization Φ yu (ω)=g(iω)φ uu (ω) Thenextquestionisthenhowwego"backwards"accordingtoFig.3.right,to find what linear filter which will do. Assumethatthedisturbancewhasspectrum Φ w (ω) (Spectral factorization) Assume that we can find a transfer function G(s) suchthatg(iω)rg(iω) = Φ w (ω)foraconstantr. InthatcasewecanconsiderwasanoutputfromthelinearsystemGwithwhite noiseasinput, Φ v (ω)=r(equalenergyforallfrequencies/flatspectrum). 5

6 Lecture 3. Disturbance modelling THEOREM 3. Spectral factorization [G&L 5.3] Assume that the real, scalar valued function Φ w (ω) isarationalfunctionof ω.thenthereexistsarationalfunction G(s)withallpolesstrictlyinthelefthalfplaneandallzerosinthelefthalfplane orontheimaginaryaxissuchthat Φ w (ω)= G(iω) =G(iω)G( iω) Ifvandwarescalarvaluedand Φ w (ω)isarationalfunctionof ω itiseasyto follow the proof in[glad& Ljung] and factorize to first or second order polynomials of ω inboththenumeratorandthedenominator.thesecanthenbesplitinstable and unstable poles, respectively, and comes from the fact that if the characteristic polynomialfor G(iω)is Π n k= (iω λ k)then G = G( iω)willhaveitspoles mirroredinthetheimaginaryaxis.thisisdoneintransferfunctionform,andin the next section we will see how this looks in state-space representation. Assume we have state-space model with disturbances where ẋ(t)=ax(t)+bu(t)+nw (t) z(t)=mx(t)+d z u(t) y(t)=cx(t)+d y u(t)+w (t) w iscalledstate-orsystemnoise w iscalledmeasurement-oroutputnoise The question is how to handle coloured noise? Ifw andw iscolourednoisewithknownorestimatedspectraldensitythen re-writew andw asoutputsignalsfromlinearsystemswithwhitenoiseinputs v andv. w (t)=g (p)v (t), w (t)=g (p)v (t) wherep= d dt (correspondingtothelaplacesinfrequencydomain). MakeastatespacerealizationofG andg andextendthesystemdescription with these states ẋ(t)=ax(t)+bu(t)+nv (t) z(t)=mx(t)+d z u(t) y(t)=cx(t)+d y u(t)+v (t) wheretheextendedstatexconsistsofthestatexandthestatesfromthestatespacerealizationsofg andg. A is the corresponding system matrix for the extended system etc. We illustrate this procedure with an example. Example Consider the system ẋ = 7x +u+w y=x +w wherew iscolourednoisewithspectraldensity Φ w = 9 ω +4 = (spectralfactorization)= 3 3 (iω+)( iω+) 6

7 3. Disturbances We can then introduce a state-space form of this transfer function, representing thecolourednoisew as ẋ = x +3v w =x wherev iswhitenoisewithintensity.thesystemcannowbewrittenas ẋ = 7x +u+x ẋ x +3v y=x +w andwecanproceedinthesamewaywiththecolourednoisew Covariance and spectral density for a state vector Consider the linear system ẋ=ax+bv, Φ v (ω)=r v We can calculate the transfer function from noise to state as G v x (s)=(si A) B andthespectraldensityforxwillthusbe Φ x (ω)=(iωi A) BR v B ( iωi A) T }{{} ((iωi A) B) ẋ=ax+bv, Φ v (ω)=r v Onewaytocalculatethecovariancematrixforstatexis Π x =R x = Φ x (ω)dω π Howeverthereisanalternativewayofcalculating Π x THEOREM 3. [GLAD&LJUNG 5.3] Ifalleigenvaluesof Aarestrictlyinthelefthalfplane(i.e.Re{λ k }<)then thereexistsauniquematrix Π x = Π T x >whichisthesolutiontothematrix equation AΠ x + Π x A T +BR v B T = WewillseethatasimilarformulacanbeusedtocalculatetheoptimalgainK in the Kalman filter with respect to measurement and state noise covariances. Anintuitiveinterpretationhowlargethegain K shouldbeisthatifwehave much state noise but little output noise(i.e, reliable measurements), then the optimization chooses a large gain which"trusts" the measurements. With very large measurement noise, it will choose a low gain which means that the observer will almost run in open-loop; trusting the model and gaining very little information from the measurements. 7

8 Lecture 3. Disturbance modelling Example 3 Consider the system [ ẋ=ax+bv = whereviswhitenoisewithvariancer v =. Whatisthecovarianceforx? ][ x x ] + FirstchecktheeigenvaluesofA:λ= ±i 7 LHP. OK! Solve the Lyapunov equation Find Π x : [ AΠ x + Π x A T +BRB T = [ ][ ] [ ][ ] [ ] Π Π Π Π + + [ ]= Π Π Π Π [ ] [ ] ( Π +Π + Π +Π Π = = Π +Π Π Π ] v Solvingfor Π, Π and Π gives [ ] [ ] Π Π / = Π x = = > Π Π /4 Inmatlab: lyap([- ; - ],[ ; ]*[ ]) 8

Feedback Control of Turbulent Wall Flows

Feedback Control of Turbulent Wall Flows Feedback Control of Turbulent Wall Flows Dipartimento di Ingegneria Aerospaziale Politecnico di Milano Outline Introduction Standard approach Wiener-Hopf approach Conclusions Drag reduction A model problem:

More information

Contents lecture 5. Automatic Control III. Summary of lecture 4 (II/II) Summary of lecture 4 (I/II) u y F r. Lecture 5 H 2 and H loop shaping

Contents lecture 5. Automatic Control III. Summary of lecture 4 (II/II) Summary of lecture 4 (I/II) u y F r. Lecture 5 H 2 and H loop shaping Contents lecture 5 Automatic Control III Lecture 5 H 2 and H loop shaping Thomas Schön Division of Systems and Control Department of Information Technology Uppsala University. Email: thomas.schon@it.uu.se,

More information

Subject: Optimal Control Assignment-1 (Related to Lecture notes 1-10)

Subject: Optimal Control Assignment-1 (Related to Lecture notes 1-10) Subject: Optimal Control Assignment- (Related to Lecture notes -). Design a oil mug, shown in fig., to hold as much oil possible. The height and radius of the mug should not be more than 6cm. The mug must

More information

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following

More information

EL2520 Control Theory and Practice

EL2520 Control Theory and Practice EL2520 Control Theory and Practice Lecture 8: Linear quadratic control Mikael Johansson School of Electrical Engineering KTH, Stockholm, Sweden Linear quadratic control Allows to compute the controller

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

SRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS

SRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided

More information

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents

More information

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 204 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

Exam in Automatic Control II Reglerteknik II 5hp (1RT495)

Exam in Automatic Control II Reglerteknik II 5hp (1RT495) Exam in Automatic Control II Reglerteknik II 5hp (1RT495) Date: August 4, 018 Venue: Bergsbrunnagatan 15 sal Responsible teacher: Hans Rosth. Aiding material: Calculator, mathematical handbooks, textbooks

More information

MAE143a: Signals & Systems (& Control) Final Exam (2011) solutions

MAE143a: Signals & Systems (& Control) Final Exam (2011) solutions MAE143a: Signals & Systems (& Control) Final Exam (2011) solutions Question 1. SIGNALS: Design of a noise-cancelling headphone system. 1a. Based on the low-pass filter given, design a high-pass filter,

More information

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 25 January 2006 Reading: This set of lectures provides a brief introduction to Kalman filtering, following

More information

Lecture 1: Pragmatic Introduction to Stochastic Differential Equations

Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Simo Särkkä Aalto University, Finland (visiting at Oxford University, UK) November 13, 2013 Simo Särkkä (Aalto) Lecture 1: Pragmatic

More information

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system

More information

Multivariable Control Exam

Multivariable Control Exam Department of AUTOMATIC CONTROL Multivariable Control Exam Exam 4 8 Grading All answers must include a clear motivation and a well-formulated answer. AnswersmaybegiveninEnglishorSwedish.Thetotalnumberofpointsis5.The

More information

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class

More information

Non-parametric identification

Non-parametric identification Non-parametric Non-parametric Transient Step-response using Spectral Transient Correlation Frequency function estimate Spectral System Identification, SSY230 Non-parametric 1 Non-parametric Transient Step-response

More information

Automatic Control II Computer exercise 3. LQG Design

Automatic Control II Computer exercise 3. LQG Design Uppsala University Information Technology Systems and Control HN,FS,KN 2000-10 Last revised by HR August 16, 2017 Automatic Control II Computer exercise 3 LQG Design Preparations: Read Chapters 5 and 9

More information

Lec 6: State Feedback, Controllability, Integral Action

Lec 6: State Feedback, Controllability, Integral Action Lec 6: State Feedback, Controllability, Integral Action November 22, 2017 Lund University, Department of Automatic Control Controllability and Observability Example of Kalman decomposition 1 s 1 x 10 x

More information

Intro. Computer Control Systems: F9

Intro. Computer Control Systems: F9 Intro. Computer Control Systems: F9 State-feedback control and observers Dave Zachariah Dept. Information Technology, Div. Systems and Control 1 / 21 dave.zachariah@it.uu.se F8: Quiz! 2 / 21 dave.zachariah@it.uu.se

More information

6.241 Dynamic Systems and Control

6.241 Dynamic Systems and Control 6.241 Dynamic Systems and Control Lecture 24: H2 Synthesis Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology May 4, 2011 E. Frazzoli (MIT) Lecture 24: H 2 Synthesis May

More information

Optimization-Based Control

Optimization-Based Control Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This

More information

2A1H Time-Frequency Analysis II

2A1H Time-Frequency Analysis II 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period

More information

FRTN 15 Predictive Control

FRTN 15 Predictive Control Department of AUTOMATIC CONTROL FRTN 5 Predictive Control Final Exam March 4, 27, 8am - 3pm General Instructions This is an open book exam. You may use any book you want, including the slides from the

More information

2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf

2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit   dwm/courses/2tf Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic

More information

X random; interested in impact of X on Y. Time series analogue of regression.

X random; interested in impact of X on Y. Time series analogue of regression. Multiple time series Given: two series Y and X. Relationship between series? Possible approaches: X deterministic: regress Y on X via generalized least squares: arima.mle in SPlus or arima in R. We have

More information

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval

More information

Process Modelling, Identification, and Control

Process Modelling, Identification, and Control Jan Mikles Miroslav Fikar 2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. Process Modelling, Identification, and

More information

State Observers and the Kalman filter

State Observers and the Kalman filter Modelling and Control of Dynamic Systems State Observers and the Kalman filter Prof. Oreste S. Bursi University of Trento Page 1 Feedback System State variable feedback system: Control feedback law:u =

More information

On Input Design for System Identification

On Input Design for System Identification On Input Design for System Identification Input Design Using Markov Chains CHIARA BRIGHENTI Masters Degree Project Stockholm, Sweden March 2009 XR-EE-RT 2009:002 Abstract When system identification methods

More information

D.S.G. POLLOCK: BRIEF NOTES

D.S.G. POLLOCK: BRIEF NOTES BIVARIATE SPECTRAL ANALYSIS Let x(t) and y(t) be two stationary stochastic processes with E{x(t)} = E{y(t)} =. These processes have the following spectral representations: (1) x(t) = y(t) = {cos(ωt)da

More information

Exam in FRT110 Systems Engineering and FRTN25 Process Control

Exam in FRT110 Systems Engineering and FRTN25 Process Control Department of AUTOMATIC CONTROL Exam in FRT Systems Engineering and FRTN5 Process Control June 5, 5, 4: 9: Points and grades All answers must include a clear motivation. Answers may be given in English

More information

Problems on Discrete & Continuous R.Vs

Problems on Discrete & Continuous R.Vs 013 SUBJECT NAME SUBJECT CODE MATERIAL NAME MATERIAL CODE : Probability & Random Process : MA 61 : University Questions : SKMA1004 Name of the Student: Branch: Unit I (Random Variables) Problems on Discrete

More information

EE482: Digital Signal Processing Applications

EE482: Digital Signal Processing Applications Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu EE482: Digital Signal Processing Applications Spring 2014 TTh 14:30-15:45 CBC C222 Lecture 11 Adaptive Filtering 14/03/04 http://www.ee.unlv.edu/~b1morris/ee482/

More information

Control Design. Lecture 9: State Feedback and Observers. Two Classes of Control Problems. State Feedback: Problem Formulation

Control Design. Lecture 9: State Feedback and Observers. Two Classes of Control Problems. State Feedback: Problem Formulation Lecture 9: State Feedback and s [IFAC PB Ch 9] State Feedback s Disturbance Estimation & Integral Action Control Design Many factors to consider, for example: Attenuation of load disturbances Reduction

More information

State Space Representation of Gaussian Processes

State Space Representation of Gaussian Processes State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)

More information

Stochastic Processes

Stochastic Processes Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic

More information

Atmospheric Flight Dynamics Example Exam 2 Solutions

Atmospheric Flight Dynamics Example Exam 2 Solutions Atmospheric Flight Dynamics Example Exam Solutions 1 Question Given the autocovariance function, C x x (τ) = 1 cos(πτ) (1.1) of stochastic variable x. Calculate the autospectrum S x x (ω). NOTE Assume

More information

2 Quick Review of Continuous Random Variables

2 Quick Review of Continuous Random Variables CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS b R. M. Murray Stochastic Systems 8 January 27 Reading: This set of lectures provides a brief introduction to stochastic systems. Friedland,

More information

14 - Gaussian Stochastic Processes

14 - Gaussian Stochastic Processes 14-1 Gaussian Stochastic Processes S. Lall, Stanford 211.2.24.1 14 - Gaussian Stochastic Processes Linear systems driven by IID noise Evolution of mean and covariance Example: mass-spring system Steady-state

More information

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control Chapter 3 LQ, LQG and Control System H 2 Design Overview LQ optimization state feedback LQG optimization output feedback H 2 optimization non-stochastic version of LQG Application to feedback system design

More information

Time Response of Systems

Time Response of Systems Chapter 0 Time Response of Systems 0. Some Standard Time Responses Let us try to get some impulse time responses just by inspection: Poles F (s) f(t) s-plane Time response p =0 s p =0,p 2 =0 s 2 t p =

More information

6.435, System Identification

6.435, System Identification System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

= m(0) + 4e 2 ( 3e 2 ) 2e 2, 1 (2k + k 2 ) dt. m(0) = u + R 1 B T P x 2 R dt. u + R 1 B T P y 2 R dt +

= m(0) + 4e 2 ( 3e 2 ) 2e 2, 1 (2k + k 2 ) dt. m(0) = u + R 1 B T P x 2 R dt. u + R 1 B T P y 2 R dt + ECE 553, Spring 8 Posted: May nd, 8 Problem Set #7 Solution Solutions: 1. The optimal controller is still the one given in the solution to the Problem 6 in Homework #5: u (x, t) = p(t)x k(t), t. The minimum

More information

System Identification & Parameter Estimation

System Identification & Parameter Estimation System Identification & Parameter Estimation Wb3: SIPE lecture Correlation functions in time & frequency domain Alfred C. Schouten, Dept. of Biomechanical Engineering (BMechE), Fac. 3mE // Delft University

More information

Lecture 5 Input output stability

Lecture 5 Input output stability Lecture 5 Input output stability or How to make a circle out of the point 1+0i, and different ways to stay away from it... k 2 yf(y) r G(s) y k 1 y y 1 k 1 1 k 2 f( ) G(iω) Course Outline Lecture 1-3 Lecture

More information

10/8/2015. Control Design. Pole-placement by state-space methods. Process to be controlled. State controller

10/8/2015. Control Design. Pole-placement by state-space methods. Process to be controlled. State controller Pole-placement by state-space methods Control Design To be considered in controller design * Compensate the effect of load disturbances * Reduce the effect of measurement noise * Setpoint following (target

More information

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier Miscellaneous Regarding reading materials Reading materials will be provided as needed If no assigned reading, it means I think the material from class is sufficient Should be enough for you to do your

More information

H 2 Optimal State Feedback Control Synthesis. Raktim Bhattacharya Aerospace Engineering, Texas A&M University

H 2 Optimal State Feedback Control Synthesis. Raktim Bhattacharya Aerospace Engineering, Texas A&M University H 2 Optimal State Feedback Control Synthesis Raktim Bhattacharya Aerospace Engineering, Texas A&M University Motivation Motivation w(t) u(t) G K y(t) z(t) w(t) are exogenous signals reference, process

More information

Chapter 9 Observers, Model-based Controllers 9. Introduction In here we deal with the general case where only a subset of the states, or linear combin

Chapter 9 Observers, Model-based Controllers 9. Introduction In here we deal with the general case where only a subset of the states, or linear combin Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology c Chapter 9 Observers,

More information

Reliability Theory of Dynamically Loaded Structures (cont.)

Reliability Theory of Dynamically Loaded Structures (cont.) Outline of Reliability Theory of Dynamically Loaded Structures (cont.) Probability Density Function of Local Maxima in a Stationary Gaussian Process. Distribution of Extreme Values. Monte Carlo Simulation

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan

More information

Chapter 6: Nonparametric Time- and Frequency-Domain Methods. Problems presented by Uwe

Chapter 6: Nonparametric Time- and Frequency-Domain Methods. Problems presented by Uwe System Identification written by L. Ljung, Prentice Hall PTR, 1999 Chapter 6: Nonparametric Time- and Frequency-Domain Methods Problems presented by Uwe System Identification Problems Chapter 6 p. 1/33

More information

Controlled Diffusions and Hamilton-Jacobi Bellman Equations

Controlled Diffusions and Hamilton-Jacobi Bellman Equations Controlled Diffusions and Hamilton-Jacobi Bellman Equations Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 2014 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

Systems Analysis and Control

Systems Analysis and Control Systems Analysis and Control Matthew M. Peet Arizona State University Lecture 21: Stability Margins and Closing the Loop Overview In this Lecture, you will learn: Closing the Loop Effect on Bode Plot Effect

More information

Control System Design

Control System Design ELEC ENG 4CL4: Control System Design Notes for Lecture #36 Dr. Ian C. Bruce Room: CRL-229 Phone ext.: 26984 Email: ibruce@mail.ece.mcmaster.ca Friday, April 4, 2003 3. Cascade Control Next we turn to an

More information

ECE-340, Spring 2015 Review Questions

ECE-340, Spring 2015 Review Questions ECE-340, Spring 2015 Review Questions 1. Suppose that there are two categories of eggs: large eggs and small eggs, occurring with probabilities 0.7 and 0.3, respectively. For a large egg, the probabilities

More information

MATH4406 (Control Theory) Unit 1: Introduction Prepared by Yoni Nazarathy, July 21, 2012

MATH4406 (Control Theory) Unit 1: Introduction Prepared by Yoni Nazarathy, July 21, 2012 MATH4406 (Control Theory) Unit 1: Introduction Prepared by Yoni Nazarathy, July 21, 2012 Unit Outline Introduction to the course: Course goals, assessment, etc... What is Control Theory A bit of jargon,

More information

Reduction of the rotor blade root bending moment and increase of the rotational-speed strength of a 5 MW IPC wind turbine based on a stochastic

Reduction of the rotor blade root bending moment and increase of the rotational-speed strength of a 5 MW IPC wind turbine based on a stochastic Chart 1 Reduction of the rotor blade root bending moment and increase of the rotational-speed strength of a 5 MW IPC wind turbine based on a stochastic disturbance observer By : Taha Fouda Supervised by:

More information

EECE Adaptive Control

EECE Adaptive Control EECE 574 - Adaptive Control Basics of System Identification Guy Dumont Department of Electrical and Computer Engineering University of British Columbia January 2010 Guy Dumont (UBC) EECE574 - Basics of

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the

More information

Optimization-Based Control

Optimization-Based Control Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v2.1a, January 3, 2010 c California Institute of Technology All rights reserved. This

More information

Fourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007

Fourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007 Stochastic processes review 3. Data Analysis Techniques in Oceanography OCP668 April, 27 Stochastic processes review Denition Fixed ζ = ζ : Function X (t) = X (t, ζ). Fixed t = t: Random Variable X (ζ)

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

Final exam: Automatic Control II (Reglerteknik II, 1TT495)

Final exam: Automatic Control II (Reglerteknik II, 1TT495) Uppsala University Department of Information Technology Systems and Control Professor Torsten Söderström Final exam: Automatic Control II (Reglerteknik II, TT495) Date: October 6, Responsible examiner:

More information

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004 MER42 Advanced Control Lecture 9 Introduction to Kalman Filtering Linear Quadratic Gaussian Control (LQG) G. Hovland 24 Announcement No tutorials on hursday mornings 8-9am I will be present in all practical

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7

More information

FRTN10 Exercise 3. Specifications and Disturbance Models

FRTN10 Exercise 3. Specifications and Disturbance Models FRTN0 Exercie 3. Specification and Diturbance Model 3. A feedback ytem i hown in Figure 3., in which a firt-order proce if controlled by an I controller. d v r u 2 z C() P() y n Figure 3. Sytem in Problem

More information

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance The Kalman Filter Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading s.l.dance@reading.ac.uk July

More information

10 Transfer Matrix Models

10 Transfer Matrix Models MIT EECS 6.241 (FALL 26) LECTURE NOTES BY A. MEGRETSKI 1 Transfer Matrix Models So far, transfer matrices were introduced for finite order state space LTI models, in which case they serve as an important

More information

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic

More information

TSKS01 Digital Communication Lecture 1

TSKS01 Digital Communication Lecture 1 TSKS01 Digital Communication Lecture 1 Introduction, Repetition, and Noise Modeling Emil Björnson Department of Electrical Engineering (ISY) Division of Communication Systems Emil Björnson Course Director

More information

Chapter Three Theoretical Description Of Stochastic Resonance 24

Chapter Three Theoretical Description Of Stochastic Resonance 24 Table of Contents List of Abbreviations and Symbols 5 Chapter One Introduction 8 1.1 The Phenomenon of the Stochastic Resonance 8 1.2 The Purpose of the Study 10 Chapter Two The Experimental Set-up 12

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

Lecture 5 Classical Control Overview III. Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore

Lecture 5 Classical Control Overview III. Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Lecture 5 Classical Control Overview III Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore A Fundamental Problem in Control Systems Poles of open

More information

EECE Adaptive Control

EECE Adaptive Control EECE 574 - Adaptive Control Overview Guy Dumont Department of Electrical and Computer Engineering University of British Columbia Lectures: Thursday 09h00-12h00 Location: PPC 101 Guy Dumont (UBC) EECE 574

More information

Systems Analysis and Control

Systems Analysis and Control Systems Analysis and Control Matthew M. Peet Arizona State University Lecture 23: Drawing The Nyquist Plot Overview In this Lecture, you will learn: Review of Nyquist Drawing the Nyquist Plot Using the

More information

Centre for Mathematical Sciences HT 2017 Mathematical Statistics. Study chapters 6.1, 6.2 and in the course book.

Centre for Mathematical Sciences HT 2017 Mathematical Statistics. Study chapters 6.1, 6.2 and in the course book. Lund University Stationary stochastic processes Centre for Mathematical Sciences HT 2017 Mathematical Statistics Computer exercise 2 in Stationary stochastic processes, HT 17. The purpose with this computer

More information

Performance of an Adaptive Algorithm for Sinusoidal Disturbance Rejection in High Noise

Performance of an Adaptive Algorithm for Sinusoidal Disturbance Rejection in High Noise Performance of an Adaptive Algorithm for Sinusoidal Disturbance Rejection in High Noise MarcBodson Department of Electrical Engineering University of Utah Salt Lake City, UT 842, U.S.A. (8) 58 859 bodson@ee.utah.edu

More information

Dynamics and control of mechanical systems

Dynamics and control of mechanical systems Dynamics and control of mechanical systems Date Day 1 (03/05) - 05/05 Day 2 (07/05) Day 3 (09/05) Day 4 (11/05) Day 5 (14/05) Day 6 (16/05) Content Review of the basics of mechanics. Kinematics of rigid

More information

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given

More information

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation EE363 Winter 2008-09 Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation partially observed linear-quadratic stochastic control problem estimation-control separation principle

More information

5 Kalman filters. 5.1 Scalar Kalman filter. Unit delay Signal model. System model

5 Kalman filters. 5.1 Scalar Kalman filter. Unit delay Signal model. System model 5 Kalman filters 5.1 Scalar Kalman filter 5.1.1 Signal model System model {Y (n)} is an unobservable sequence which is described by the following state or system equation: Y (n) = h(n)y (n 1) + Z(n), n

More information

On Identification of Cascade Systems 1

On Identification of Cascade Systems 1 On Identification of Cascade Systems 1 Bo Wahlberg Håkan Hjalmarsson Jonas Mårtensson Automatic Control and ACCESS, School of Electrical Engineering, KTH, SE-100 44 Stockholm, Sweden. (bo.wahlberg@ee.kth.se

More information

EAS 305 Random Processes Viewgraph 1 of 10. Random Processes

EAS 305 Random Processes Viewgraph 1 of 10. Random Processes EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome

More information

Control System Design

Control System Design ELEC ENG 4CL4: Control System Design Notes for Lecture #22 Dr. Ian C. Bruce Room: CRL-229 Phone ext.: 26984 Email: ibruce@mail.ece.mcmaster.ca Friday, March 5, 24 More General Effects of Open Loop Poles

More information

CDS Solutions to Final Exam

CDS Solutions to Final Exam CDS 22 - Solutions to Final Exam Instructor: Danielle C Tarraf Fall 27 Problem (a) We will compute the H 2 norm of G using state-space methods (see Section 26 in DFT) We begin by finding a minimal state-space

More information

13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES

13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES 13.42 READING 6: SPECTRUM OF A RANDOM PROCESS SPRING 24 c A. H. TECHET & M.S. TRIANTAFYLLOU 1. STATIONARY AND ERGODIC RANDOM PROCESSES Given the random process y(ζ, t) we assume that the expected value

More information

1 Loop Control. 1.1 Open-loop. ISS0065 Control Instrumentation

1 Loop Control. 1.1 Open-loop. ISS0065 Control Instrumentation Lecture 4 ISS0065 Control Instrumentation 1 Loop Control System has a continuous signal (analog) basic notions: open-loop control, close-loop control. 1.1 Open-loop Open-loop / avatud süsteem / открытая

More information

A review of stability and dynamical behaviors of differential equations:

A review of stability and dynamical behaviors of differential equations: A review of stability and dynamical behaviors of differential equations: scalar ODE: u t = f(u), system of ODEs: u t = f(u, v), v t = g(u, v), reaction-diffusion equation: u t = D u + f(u), x Ω, with boundary

More information

This examination consists of 10 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS

This examination consists of 10 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS THE UNIVERSITY OF BRITISH COLUMBIA Department of Electrical and Computer Engineering EECE 564 Detection and Estimation of Signals in Noise Final Examination 08 December 2009 This examination consists of

More information

IV. Covariance Analysis

IV. Covariance Analysis IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.

More information

ANNEX A: ANALYSIS METHODOLOGIES

ANNEX A: ANALYSIS METHODOLOGIES ANNEX A: ANALYSIS METHODOLOGIES A.1 Introduction Before discussing supplemental damping devices, this annex provides a brief review of the seismic analysis methods used in the optimization algorithms considered

More information

AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS

AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS First the X, then the AR, finally the MA Jan C. Willems, K.U. Leuven Workshop on Observation and Estimation Ben Gurion University, July 3, 2004 p./2 Joint

More information

Problem Sheet 1 Examples of Random Processes

Problem Sheet 1 Examples of Random Processes RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give

More information

I. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching

I. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 1 Adaptive Control Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 2 Outline

More information

Today s goals So far Today 2.004

Today s goals So far Today 2.004 Today s goals So far Feedback as a means for specifying the dynamic response of a system Root Locus: from the open-loop poles/zeros to the closed-loop poles Moving the closed-loop poles around Today Proportional

More information

Exercise sheet 3: Random walk and diffusion equation, the Wiener-Khinchin theorem, correlation function and power spectral density

Exercise sheet 3: Random walk and diffusion equation, the Wiener-Khinchin theorem, correlation function and power spectral density AMSI (217) Stochastic Equations and Processes in Physics and Biology Exercise sheet 3: Random walk and diffusion equation, the Wiener-Khinchin theorem, correlation function and power spectral density 1.

More information

A FEEDBACK STRUCTURE WITH HIGHER ORDER DERIVATIVES IN REGULATOR. Ryszard Gessing

A FEEDBACK STRUCTURE WITH HIGHER ORDER DERIVATIVES IN REGULATOR. Ryszard Gessing A FEEDBACK STRUCTURE WITH HIGHER ORDER DERIVATIVES IN REGULATOR Ryszard Gessing Politechnika Śl aska Instytut Automatyki, ul. Akademicka 16, 44-101 Gliwice, Poland, fax: +4832 372127, email: gessing@ia.gliwice.edu.pl

More information