Robust and Learning Control for Complex Systems
|
|
- Steven Page
- 6 years ago
- Views:
Transcription
1 Robus and Learning Conrol for Complex Sysems Peer M. Young Sepember 13, 2007 &
2 Talk Ouline Inroducion Robus Conroller Analysis and Design Theory Experimenal Applicaions Overview MIMO Robus HVAC Conrol Robus Learning Conrol Concluding Remarks
3 Single-Inpu, Single-Oupu (SISO) Loopshaping Conrol r + - e u y K P L = PK M = T = Y R = PK 1+ PK = L 1+ L S E R 1 1+ PK = = = 1 1+ L
4 Loopshaping Crierion L Genle Slope Near Crossover 0dB Low Frequency Gain Desired Bandwidh GM ω High Frequency Rolloff L PM -180 o ω
5 SISO Conrol Overview Nominal Sabiliy via Nyquis/Bode Injec Low Frequency Gain for Adequae Tracking and Disurbance Rejecion Adequae Bandwidh for Desired Speed Sabiliy Margins Gain Margin, Phase Margin High Frequency Rolloff All Achieved by Shaping Loop Gain
6 Muli-Inpu, Muli-Oupu (MIMO) Sysems u G y Coninuous Time: Discree-Time:
7 Quoe From Uncle Remus I ain wha you don know in life ha ges you ino rouble. I s wha you know for sure, bu wha ain so!
8 Robus Conroller Design Seup Δ Disurbances w P z Penaly Signals Conrol Signals u y Measuremens K - Generalized (Open-Loop) Plan: P - Robus Conroller: K - Perurbed Closed-Loop Map: T zw
9 μ Upper Bound as a Scaled H Problem Consan Marix: Dynamic Sysem: μ Synhesis:
10 D-K K Ieraion for μ-synhesis Δ P D P D -1 P K D K M Compue D: μ Problem Compue K: H Problem
11 Robus Conrol Theory Sysemaic Analysis and Design Theoreical and Compuaional Issues Complex MIMO Sysems Classical SISO Tools Inadequae Fundamenal Tradeoffs and Limiaions Robus o Uncerain Signals and Sysems Coninuous/Discree Time Various Uncerainy Types (Parameric/Dynamic) Opimal/High Performance
12 Applicaion Areas Power Disribuion Sysems (PSERC) Disk Drive Servo Conrol (Seagae/NSF) Human-Compuer Inerfaces (DARPA) Flexible Srucures (NSF) HVAC Conrol (Siemens/NSF)
13 Power Sysem Analysis High Qualiy Simulaion Models Modern Tools versus Tradiional Design and Analysis
14 Inerconneced Grid of Machines Key Parameers Fied as Polynomials Polynomials Wrien as Linear Fracional Transformaions See Earlier Work by Khammash, Vial, Zhu Large Scale Problems Compuaion Tools
15 Disk Drive Servo Conrol Seagae Technology as Indusrial Parner Single and Dual Sage Acuaion Sysems High Performance in Discree-Time Modern Robus Conrol Mehodologies Implemenaion Issues In Drive Tesing
16 Robus Conrol Servo Design
17 Measured Frequency Response
18 Measured Runou In Drive
19 Human-Compuer Inerface
20 Rapid Prooyping Environmen
21 Flexible Srucure Conrol
22 Conrol of HVAC Sysems Conrol Challenges for HVAC Sysems Complex Nonlinear Time-Varying Sysem Highly Uncerain Sysem Dynamics MIMO Ineracion of Conrolled Variables Currenly Conrolled by Muliple SISO PID Loops True MIMO Analysis and Design Improved Sysem Performance Coordinaed Acion for Independen Conrol MIMO Robus Sabiliy and Performance
23 Experimenal HVAC Plaform Simple HVAC Sysem Couner Flow Ho Waer o Air Hea-Exchanger Variable Air Volume Mixing Box Elecric Ho Waer Heaer Conrolled Variables: Discharge Air Temperaure Air Flow Rae
24 Experimenal HVAC Sysem exernal air T mixing box T filer heaing coil T air flow fan discharge air P E P E T T T T valve P E reurn air Inerface inpus T AE T AR T AI T WI F W T WS waer heaer T WO T AO F A variable frequency drive oupus C DE C DR C WH C VP C BS
25 PC/MATLAB Based Conrol Sysem
26 Model Verificaion Model of Experimenal Sysem Model and Experimenal Sysem Oupus
27 Conroller Design Basic Design Goals: MIMO Sabiliy and Robusness Independen Conrol of Key Sysem Variables Discharge Air Temperaure and Flow Rae Reference Convenional PI Conroller MIMO Robus Conrollers: Minimal (3x6) ~ T WS Exernally Conrolled Consrained (4x7) ~ T WS Inegraed Full (4x7) MIMO
28 PI Conroller Design Nonlinear Sysem Tune a High Gain Parameers Conrolled: Waer Supply Temperaure Air Flow Rae Inpu Air Temperaure Discharge Air Temperaure Heaing Coil capaciy vs.. waer flow rae
29 Reference PI Conroller
30 Conroller K Experimenal PI
31 Conroller K Implemenaion R3 4x7 Conroller Air flow (F a ) Inpu Air Temperaure (T ai ) Discharge Air Temperaure (T ao ao )
32 Conroller K Experimenal R3
33 Comparison of Conroller Performance
34 HVAC Conrol Summary Designed and Buil Experimenal HVAC Sysem Developed Model of HVAC sysem Designed MIMO Robus Conrollers Implemened MIMO Conrol Reduced T ao Sele Time by over 300% Decoupling of Conrolled Variables Simulaneous, Coordinaed Conrol Acion Conrollers are Insensiive o Model Uncerainy
35 Robus Learning Conrol Robus conrol heory Guaranees sabiliy Resuls in less aggressive conrollers Reinforcemen learning Opimizes he performance of a conroller No guaranee of sabiliy while learning
36 Reinforcemen Learning Agen in Parallel wih Robus Conroller reinforcemen = e
37 { } ), ( ), ( ), ( ), ( ), ( ), ( ), ( = = = + = + = T k k k k T k k k k a s Q a s R E a s R a s R E a s R a s R E a s Q π π π π π γ γ γ γ Reinforcemen Learning Theory Reinforcemen Learning Theory { } ), ( ), ( ), ( ), ( 1 1 a s Q a s Q a s R E a s Q π π π π γ + = Δ + + Subrac righ side from lef o ge algorihm for updaing Q Subrac righ side from lef o ge algorihm for updaing Q [ ] ), ( ), ( ), ( ), ( 1 1 a s Q a s Q a s R a s Q π π π γ α + = Δ + + Replace expecaion wih sample (Mone Carlo approach) Replace expecaion wih sample (Mone Carlo approach) Temporal Temporal-difference error difference error = = + + T k k k k a s R E a s Q 0 ), ( ), ( γ π π acion acion sae sae policy funcion policy funcion value value funcion funcion discoun facor discoun facor reinforcemen ( error ) reinforcemen ( error )
38 Reinforcemen Learning Implemenaion [ R( s, a ) + γq ( s, a ) Q ( s, a )] Δ Qπ ( s, a ) = α π π This converges on bes approximaion of value funcion for policy π. To also improve he policy: Q s, a ) = α R( s, a ) + γ min Q [ ] ( s, a ) Q ( s, a ) Δ π ( π + 1 π a A Q implicily defines he policy: π ( s ) = arg min Q( s, a) a A Value funcion (Q) learned by criic nework. (Q-learning, Wakins, 1989) Policy funcion (π)( ) learned by acor nework.
39 Neural Ne for Learning Agen W anh V Acor Nework (Criic Nework no shown) anh anh linear
40 Robus Conrol based on Inegral Quadraic Consrains An Inegral Quadraic Consrain (IQC) describes he relaionship p beween signals as vˆ( jw) wˆ( jw) * Π( jw) vˆ( jw) wˆ( jw) dw 0 v Uncerainies (D) Conroller/Plan (M) w Sabiliy of he closed loop sysem is guaraneed if M ( jw) I * Π( jw) M ( jw) I εi for all w and for ε > 0. Given specific IQCs for a paricular sysem, his inequaliy problem becomes a linear, marix inequaliy (LMI) problem.
41 IQCs Robusness Calculaion Two-layer neural ne as acor, in parallel wih conroller. Now wih anh and varying parameers covered by IQCs.
42 Robus Reinforcemen Learning Approach Reinforcemen learning algorihm guides adjusmen of acor s s weighs. IQC places bounding box in weigh space, beyond which sabiliy has no been verified. Sep 1 iniial guaraneedsable region Sep 4 nex guaraneed-sable region Sep 5 Now learning can coninue unil edge of new bounding box is encounered. UNSTABLE REGION! final weigh vecor Sep 0 iniial weigh vecor rajecory of weighs Sep 2 while learning mus find Sep 3 new sable region weigh rajecory wihou robus consrains weigh rajecory wih robus consrains weigh space (high-dimensional) weigh space (high-dimensional)
43 Disillaion Column Example of ask for which conrol variables inerac in complex way.
44 Decoupling Conroller Nominal Good response Perurbed Terrible response
45 Robus Conroller Nominal Less aggressive response Perurbed Much improved response
46 Robus Reinforcemen Learning Conroller Perurbed case, no learning (from previous slide) Perurbed case, wih learning Sum Squared Error Nominal Conroller Robus Conroller Robus RL Conroller Through learning, conroller has been fine-uned o acual dynamics of real plan wihou losing guaranee of sabiliy!
47 Reinforcemen Learning wihou IQCs Ulimaely achieves same good performance, bu during learning periods of insabiliy occur.
48 Concluding Remarks Complex MIMO Sysems (Coordinaed Conrol) Uncerain Signals and Sysems Opimal/High Performance (Efficiency/Mainenance) Robus Conrol Theory (Tradeoffs) Sysemaic Analysis and Design (Compuer Aided) Many Applicaion Areas Simulaion and Experimen Robus Learning Conrol Guaraneed Sabiliy Throughou he Online Learning/Adapaion Process
49 Fuure Research New Theoreical Tools for Robus/Learning Conroller Analysis and Design Improved Compuaion Tools (Malab) Furher Developmen of Exising Applicaion Areas New Applicaion Areas?
Robust Learning Control with Application to HVAC Systems
Robus Learning Conrol wih Applicaion o HVAC Sysems Naional Science Foundaion & Projec Invesigaors: Dr. Charles Anderson, CS Dr. Douglas Hile, ME Dr. Peer Young, ECE Mechanical Engineering Compuer Science
More informationEmbedded Systems and Software. A Simple Introduction to Embedded Control Systems (PID Control)
Embedded Sysems and Sofware A Simple Inroducion o Embedded Conrol Sysems (PID Conrol) Embedded Sysems and Sofware, ECE:3360. The Universiy of Iowa, 2016 Slide 1 Acknowledgemens The maerial in his lecure
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More informationAnti-Disturbance Control for Multiple Disturbances
Workshop a 3 ACC Ani-Disurbance Conrol for Muliple Disurbances Lei Guo (lguo@buaa.edu.cn) Naional Key Laboraory on Science and Technology on Aircraf Conrol, Beihang Universiy, Beijing, 9, P.R. China. Presened
More informationRL Lecture 7: Eligibility Traces. R. S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction 1
RL Lecure 7: Eligibiliy Traces R. S. Suon and A. G. Baro: Reinforcemen Learning: An Inroducion 1 N-sep TD Predicion Idea: Look farher ino he fuure when you do TD backup (1, 2, 3,, n seps) R. S. Suon and
More informationSliding Mode Controller for Unstable Systems
S. SIVARAMAKRISHNAN e al., Sliding Mode Conroller for Unsable Sysems, Chem. Biochem. Eng. Q. 22 (1) 41 47 (28) 41 Sliding Mode Conroller for Unsable Sysems S. Sivaramakrishnan, A. K. Tangirala, and M.
More informationChapter 5 Digital PID control algorithm. Hesheng Wang Department of Automation,SJTU 2016,03
Chaper 5 Digial PID conrol algorihm Hesheng Wang Deparmen of Auomaion,SJTU 216,3 Ouline Absrac Quasi-coninuous PID conrol algorihm Improvemen of sandard PID algorihm Choosing parameer of PID regulaor Brief
More informationCHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK
175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he
More informationApplication of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing
Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology
More informationd 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3
and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or
More informationAn introduction to the theory of SDDP algorithm
An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking
More informationHidden Markov Models. Adapted from. Dr Catherine Sweeney-Reed s slides
Hidden Markov Models Adaped from Dr Caherine Sweeney-Reed s slides Summary Inroducion Descripion Cenral in HMM modelling Exensions Demonsraion Specificaion of an HMM Descripion N - number of saes Q = {q
More informationThe Rosenblatt s LMS algorithm for Perceptron (1958) is built around a linear neuron (a neuron with a linear
In The name of God Lecure4: Percepron and AALIE r. Majid MjidGhoshunih Inroducion The Rosenbla s LMS algorihm for Percepron 958 is buil around a linear neuron a neuron ih a linear acivaion funcion. Hoever,
More informationCSE/NB 528 Lecture 14: From Supervised to Reinforcement Learning (Chapter 9) R. Rao, 528: Lecture 14
CSE/NB 58 Lecure 14: From Supervised o Reinforcemen Learning Chaper 9 1 Recall from las ime: Sigmoid Neworks Oupu v T g w u g wiui w Inpu nodes u = u 1 u u 3 T i Sigmoid oupu funcion: 1 g a 1 a e 1 ga
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationLecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples
EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,
More informationTUNING OF NONLINEAR MODEL PREDICTIVE CONTROL FOR QUADRUPLE TANK PROCESS
h Sepember 14. Vol. 67 No. 5-14 JATIT & LLS. All righs reserved. ISSN: 199-8645 www.jai.org E-ISSN: 1817-3195 TUNING OF NONLINEAR MODEL PREDICTIVE CONTROL FOR QUADRUPLE TANK PROCESS 1 P.SRINIVASARAO, DR.P.SUBBAIAH
More informationEstimation of Poses with Particle Filters
Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU
More informationStability Analysis of EWMA Run-to-Run Controller Subjects to Stochastic Metrology Delay
Preprins of he 8h IFAC World Congress Milano (Ialy) Augus 8 - Sepember, Sabiliy Analysis of EWMA Run-o-Run Conroller Subjecs o Sochasic Merology Delay Bing. Ai*, David Shan-Hill Wong**, Shi-Shang Jang**,
More informationOn Solving the Perturbed Multi- Revolution Lambert Problem: Applications in Enhanced SSA
On Solving he Perurbed Muli- Revoluion Lamber Problem: Applicaions in Enhanced SSA John L. Junkins and Robyn M. Woollands Texas A&M Universiy Presened o Sacie Williams (AFOSR/RT) AFOSR REMOTE SENSING PORTFOLIO
More informationSubway stations energy and air quality management
Subway saions energy and air qualiy managemen wih sochasic opimizaion Trisan Rigau 1,2,4, Advisors: P. Carpenier 3, J.-Ph. Chancelier 2, M. De Lara 2 EFFICACITY 1 CERMICS, ENPC 2 UMA, ENSTA 3 LISIS, IFSTTAR
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationAnnouncements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering
Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationEnsamble methods: Bagging and Boosting
Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par
More informationSpeaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis
Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions
More information2016 Possible Examination Questions. Robotics CSCE 574
206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he
More informationEnergy Storage and Renewables in New Jersey: Complementary Technologies for Reducing Our Carbon Footprint
Energy Sorage and Renewables in New Jersey: Complemenary Technologies for Reducing Our Carbon Fooprin ACEE E-filliaes workshop November 14, 2014 Warren B. Powell Daniel Seingar Harvey Cheng Greg Davies
More informationEnsamble methods: Boosting
Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room
More informationAir Traffic Forecast Empirical Research Based on the MCMC Method
Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,
More informationCSE-473. A Gentle Introduction to Particle Filters
CSE-473 A Genle Inroducion o Paricle Filers Bayes Filers for Robo Localizaion Dieer Fo 2 Bayes Filers: Framework Given: Sream of observaions z and acion daa u: d Sensor model Pz. = { u, z2, u 1, z 1 Dynamics
More informationA DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS
A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS Xinping Guan ;1 Fenglei Li Cailian Chen Insiue of Elecrical Engineering, Yanshan Universiy, Qinhuangdao, 066004, China. Deparmen
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationCSE/NB 528 Lecture 14: Reinforcement Learning (Chapter 9)
CSE/NB 528 Lecure 14: Reinforcemen Learning Chaper 9 Image from hp://clasdean.la.asu.edu/news/images/ubep2001/neuron3.jpg Lecure figures are from Dayan & Abbo s book hp://people.brandeis.edu/~abbo/book/index.hml
More informationScheduling of Crude Oil Movements at Refinery Front-end
Scheduling of Crude Oil Movemens a Refinery Fron-end Ramkumar Karuppiah and Ignacio Grossmann Carnegie Mellon Universiy ExxonMobil Case Sudy: Dr. Kevin Furman Enerprise-wide Opimizaion Projec March 15,
More informationApplications in Industry (Extended) Kalman Filter. Week Date Lecture Title
hp://elec34.com Applicaions in Indusry (Eended) Kalman Filer 26 School of Informaion echnology and Elecrical Engineering a he Universiy of Queensland Lecure Schedule: Week Dae Lecure ile 29-Feb Inroducion
More informationAn Analysis of Actor/Critic Algorithms using Eligibility Traces: Reinforcement Learning with Imperfect Value Functions
An Analysis of Acor/Criic Algorihms using Eligibiliy Traces: Reinforcemen Learning wih Imperfec Value Funcions Hajime Kimura 3 Tokyo Insiue of Technology gen@fe.dis.iech.ac.jp Shigenobu Kobayashi Tokyo
More informationUsing the Kalman filter Extended Kalman filter
Using he Kalman filer Eended Kalman filer Doz. G. Bleser Prof. Sricker Compuer Vision: Objec and People Tracking SA- Ouline Recap: Kalman filer algorihm Using Kalman filers Eended Kalman filer algorihm
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationSUPPLEMENTARY INFORMATION
SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion
More informationMulti-area Load Frequency Control using IP Controller Tuned by Particle Swarm Optimization
esearch Journal of Applied Sciences, Engineering and echnology (): 96-, ISSN: -767 axwell Scienific Organizaion, Submied: July, Acceped: Sepember 8, Published: ecember 6, uli-area Load Frequency Conrol
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationEKF SLAM vs. FastSLAM A Comparison
vs. A Comparison Michael Calonder, Compuer Vision Lab Swiss Federal Insiue of Technology, Lausanne EPFL) michael.calonder@epfl.ch The wo algorihms are described wih a planar robo applicaion in mind. Generalizaion
More informationKinematics and kinematic functions
Kinemaics and kinemaic funcions Kinemaics deals wih he sudy of four funcions (called kinemaic funcions or KFs) ha mahemaically ransform join variables ino caresian variables and vice versa Direc Posiion
More informationand Zero Sum Game Solutions
F.L. Lewis, K. Vamvoudakis, and D. Vrabie Moncrief-O Donnell Endowed Chair Head, Conrols & Sensors Group Auomaion & Roboics Research Insiue (ARRI) he Universiy of exas a Arlingon Suppored by : NSF PAUL
More informationMean-square Stability Control for Networked Systems with Stochastic Time Delay
JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More information2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006
2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)
More information3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon
3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of
More informationFor example, the comb filter generated from. ( ) has a transfer function. e ) has L notches at ω = (2k+1)π/L and L peaks at ω = 2π k/l,
Comb Filers The simple filers discussed so far are characeried eiher by a single passband and/or a single sopband There are applicaions where filers wih muliple passbands and sopbands are required The
More informationTom Heskes and Onno Zoeter. Presented by Mark Buller
Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden
More informationGlobal Optimization for Scheduling Refinery Crude Oil Operations
Global Opimizaion for Scheduling Refinery Crude Oil Operaions Ramkumar Karuppiah 1, Kevin C. Furman 2 and Ignacio E. Grossmann 1 (1) Deparmen of Chemical Engineering Carnegie Mellon Universiy (2) Corporae
More informationAdaptation and Synchronization over a Network: stabilization without a reference model
Adapaion and Synchronizaion over a Nework: sabilizaion wihou a reference model Travis E. Gibson (gibson@mi.edu) Harvard Medical School Deparmen of Pahology, Brigham and Women s Hospial 55 h Conference
More informationProblem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims
Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,
More information( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is
UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires
More informationLecture 10 - Model Identification
Lecure - odel Idenificaion Wha is ssem idenificaion? Direc impulse response idenificaion Linear regression Regularizaion Parameric model ID nonlinear LS Conrol Engineering - Wha is Ssem Idenificaion? Experimen
More informationParticle Swarm Optimization
Paricle Swarm Opimizaion Speaker: Jeng-Shyang Pan Deparmen of Elecronic Engineering, Kaohsiung Universiy of Applied Science, Taiwan Email: jspan@cc.kuas.edu.w 7/26/2004 ppso 1 Wha is he Paricle Swarm Opimizaion
More informationUnified Control Strategy Covering CCM and DCM for a Synchronous Buck Converter
Unified Conrol Sraegy Covering CCM and DCM for a Synchronous Buck Converer Dirk Hirschmann, Sebasian Richer, Chrisian Dick, Rik W. De Doncker Insiue for Power Elecronics and Elecrical Drives RWTH Aachen
More informationSub Module 2.6. Measurement of transient temperature
Mechanical Measuremens Prof. S.P.Venkaeshan Sub Module 2.6 Measuremen of ransien emperaure Many processes of engineering relevance involve variaions wih respec o ime. The sysem properies like emperaure,
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationRecursive Bayes Filtering Advanced AI
Recursive Bayes Filering Advanced AI Wolfram Burgard Tuorial Goal To familiarie you wih probabilisic paradigm in roboics! Basic echniques Advanages ifalls and limiaions! Successful Applicaions! Open research
More informationDesign of a control system
SE3 Prof. Davide Manca Poliecnico di Milano Dynamics and Conrol of Chemical Processes Soluion o Lab #3 Design of a conrol sysem Davide Manca Dynamics and Conrol of Chemical Processes Maser Degree in ChemEng
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More informationDynamic Effects of Feedback Control!
Dynamic Effecs of Feedback Conrol! Rober Sengel! Roboics and Inelligen Sysems MAE 345, Princeon Universiy, 2017 Inner, Middle, and Ouer Feedback Conrol Loops Sep Response of Linear, Time- Invarian (LTI)
More informationFinal Spring 2007
.615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o
More informationRecent Developments In Evolutionary Data Assimilation And Model Uncertainty Estimation For Hydrologic Forecasting Hamid Moradkhani
Feb 6-8, 208 Recen Developmens In Evoluionary Daa Assimilaion And Model Uncerainy Esimaion For Hydrologic Forecasing Hamid Moradkhani Cener for Complex Hydrosysems Research Deparmen of Civil, Consrucion
More informationSimulating models with heterogeneous agents
Simulaing models wih heerogeneous agens Wouer J. Den Haan London School of Economics c by Wouer J. Den Haan Individual agen Subjec o employmen shocks (ε i, {0, 1}) Incomplee markes only way o save is hrough
More informationZápadočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France
ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationRecursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems
8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More information1 Review of Zero-Sum Games
COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any
More informationLAPLACE TRANSFORM AND TRANSFER FUNCTION
CHBE320 LECTURE V LAPLACE TRANSFORM AND TRANSFER FUNCTION Professor Dae Ryook Yang Spring 2018 Dep. of Chemical and Biological Engineering 5-1 Road Map of he Lecure V Laplace Transform and Transfer funcions
More informationARTIFICIAL intelligence (AI) offers an attractive set of
DEEPCAS: A Deep Reinforcemen Learning Algorihm for Conrol-Aware Scheduling Burak Demirel, Arunselvan Ramaswamy, Daniel E. Quevedo and Holger Karl arxiv:803.02998v2 cs.sy 3 Jun 208 Absrac We consider neworked
More informationPlanning in POMDPs. Dominik Schoenberger Abstract
Planning in POMDPs Dominik Schoenberger d.schoenberger@sud.u-darmsad.de Absrac This documen briefly explains wha a Parially Observable Markov Decision Process is. Furhermore i inroduces he differen approaches
More informationDeep Learning: Theory, Techniques & Applications - Recurrent Neural Networks -
Deep Learning: Theory, Techniques & Applicaions - Recurren Neural Neworks - Prof. Maeo Maeucci maeo.maeucci@polimi.i Deparmen of Elecronics, Informaion and Bioengineering Arificial Inelligence and Roboics
More informationInventory Control of Perishable Items in a Two-Echelon Supply Chain
Journal of Indusrial Engineering, Universiy of ehran, Special Issue,, PP. 69-77 69 Invenory Conrol of Perishable Iems in a wo-echelon Supply Chain Fariborz Jolai *, Elmira Gheisariha and Farnaz Nojavan
More informationSpace-time Galerkin POD for optimal control of Burgers equation. April 27, 2017 Absolventen Seminar Numerische Mathematik, TU Berlin
Space-ime Galerkin POD for opimal conrol of Burgers equaion Manuel Baumann Peer Benner Jan Heiland April 27, 207 Absolvenen Seminar Numerische Mahemaik, TU Berlin Ouline. Inroducion 2. Opimal Space Time
More informationPade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol
Applied Mahemaical Sciences, Vol. 7, 013, no. 16, 663-673 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/10.1988/ams.013.39499 Pade and Laguerre Approximaions Applied o he Acive Queue Managemen Model of Inerne
More informationRC, RL and RLC circuits
Name Dae Time o Complee h m Parner Course/ Secion / Grade RC, RL and RLC circuis Inroducion In his experimen we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors.
More informationChapter 21. Reinforcement Learning. The Reinforcement Learning Agent
CSE 47 Chaper Reinforcemen Learning The Reinforcemen Learning Agen Agen Sae u Reward r Acion a Enironmen CSE AI Faculy Why reinforcemen learning Programming an agen o drie a car or fly a helicoper is ery
More informationData Fusion using Kalman Filter. Ioannis Rekleitis
Daa Fusion using Kalman Filer Ioannis Rekleiis Eample of a arameerized Baesian Filer: Kalman Filer Kalman filers (KF represen poserior belief b a Gaussian (normal disribuion A -d Gaussian disribuion is
More informationParticle Swarm Optimization Combining Diversification and Intensification for Nonlinear Integer Programming Problems
Paricle Swarm Opimizaion Combining Diversificaion and Inensificaion for Nonlinear Ineger Programming Problems Takeshi Masui, Masaoshi Sakawa, Kosuke Kao and Koichi Masumoo Hiroshima Universiy 1-4-1, Kagamiyama,
More informationFour Generations of Higher Order Sliding Mode Controllers. L. Fridman Universidad Nacional Autonoma de Mexico Aussois, June, 10th, 2015
Four Generaions of Higher Order Sliding Mode Conrollers L. Fridman Universidad Nacional Auonoma de Mexico Aussois, June, 1h, 215 Ouline 1 Generaion 1:Two Main Conceps of Sliding Mode Conrol 2 Generaion
More informationINVERSE RESPONSE COMPENSATION BY ESTIMATING PARAMETERS OF A PROCESS COMPRISING OF TWO FIRST ORDER SYSTEMS
Inernaional Journal of Informaion Technology and nowledge Managemen July-December 0, Volume 5, No., pp. 433-438 INVERSE RESPONSE COMPENSATION BY ESTIMATING PARAMETERS OF A PROCESS COMPRISING OF TWO FIRST
More informationTracking. Announcements
Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion
More informationOn Robust Stability of Uncertain Neutral Systems with Discrete and Distributed Delays
009 American Conrol Conference Hya Regency Riverfron S. Louis MO USA June 0-009 FrC09.5 On Robus Sabiliy of Uncerain Neural Sysems wih Discree and Disribued Delays Jian Sun Jie Chen G.P. Liu Senior Member
More informationSolutions to Assignment 1
MA 2326 Differenial Equaions Insrucor: Peronela Radu Friday, February 8, 203 Soluions o Assignmen. Find he general soluions of he following ODEs: (a) 2 x = an x Soluion: I is a separable equaion as we
More informationRevista INGENIERÍA UC ISSN: Universidad de Carabobo Venezuela
Revisa INGENIERÍA UC ISSN: 36-6832 revisaing@uc.edu.ve Universidad de Carabobo Venezuela Cornieles, Erneso; Saad, Maarouf; Areaga, Francisco; Obediene, Luis Sliding mode conrol for mulivariable processes
More informationMean Square Projection Error Gradient-based Variable Forgetting Factor FAPI
3rd Inernaional Conference on Advances in Elecrical and Elecronics Engineering (ICAEE'4) Feb. -, 4 Singapore Mean Square Projecion Error Gradien-based Variable Forgeing Facor FAPI Young-Kwang Seo, Jong-Woo
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationProbabilistic Robotics SLAM
Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map
More informationSliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game
Sliding Mode Exremum Seeking Conrol for Linear Quadraic Dynamic Game Yaodong Pan and Ümi Özgüner ITS Research Group, AIST Tsukuba Eas Namiki --, Tsukuba-shi,Ibaraki-ken 5-856, Japan e-mail: pan.yaodong@ais.go.jp
More information2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes
Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion
More informationFrom Particles to Rigid Bodies
Rigid Body Dynamics From Paricles o Rigid Bodies Paricles No roaions Linear velociy v only Rigid bodies Body roaions Linear velociy v Angular velociy ω Rigid Bodies Rigid bodies have boh a posiion and
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More informationApplying Genetic Algorithms for Inventory Lot-Sizing Problem with Supplier Selection under Storage Capacity Constraints
IJCSI Inernaional Journal of Compuer Science Issues, Vol 9, Issue 1, No 1, January 2012 wwwijcsiorg 18 Applying Geneic Algorihms for Invenory Lo-Sizing Problem wih Supplier Selecion under Sorage Capaciy
More information