Optimal Control Design
|
|
- Audra Walton
- 6 years ago
- Views:
Transcription
1 Optimal Control Design Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Acknowledgement: Indian Institute of Science Founded in 1909 more than 100 years old Founded by J. N. Tata (in consultation with Swami Vivekananda) land was donated by Mysore king. Deemed University in 1958 More than 40 departments Ranked No.1 in India for higher education Only institute in India among best 100 in global ranking For further information, please visit 20 September 2016 Prof. Radhakant Padhi, IISc-Bangalore 2 1
2 Collaboration & Research Funding Defense R&D Organisation (DRDO) Missile Complex (ASL, RCI, DRDL, ANURAG) ARDE CAIR Indian Space Research Organisation (ISRO) VSSC ISAC Air Force Research Lab (AFRL), USA Private Aerospace Companies Coral Digital Technologies Team Indus (Axiom Research Lab) 20 September 2016 Prof. Radhakant Padhi, IISc-Bangalore 3 Research Areas in ICGEL: Guidance and Control of Missiles MPSP and it variants are used to develop optimal guidance algorithm for better performance. Examples: Impact Angle Constrained Guidance of Tactical Missiles Integrated Guidance and Control for Missiles for Ballistic Missile Defence Integrated Control Guidance and Estimation Lab (ICGEL) & Aerospace Systems Lab (ASL) Contact: Prof. Radhakant Padhi E. mail: padhi@aero.iisc.ernet.in Nonlinear, Optimal & Adaptive Control Dynamic Inversion & Neuro-Adaptive Designs Single Network Adaptive Critic (SNAC) Guidance and control of UAVs Guidance and Control for automatic landing. Stereo Vision based reactive collision avoidance using ultra low-cost cameras Nonlinear differential geometric guidance for collision avoidance Nonlinear & Neuro- Adaptive Control of High-Perf. Aircrafts A new robust nonlinear approach is developed for better control of high performance (large L/D) aircrafts, which are unstable in nature. Dept. of Aerospace Engineering Indian Institute of Science, Bangalore Model Predictive Static Programming (MPSP) Online Modified (OM) Design for Enhanced Robustness State Estimation for Feedback Guidance & Control Formation Flying and Attitude Control of Satellites Robust Formation flying of satellites using online modified real-time optimal control Robust large attitude maneuvers of satellites in presence of significant modelling errors Feedback Control for Customized Automatic Drug Delivery Drug is delivered as per patient s condition (not in open loop) - Fast recovery & Reduced side effects Demonstrated for blood cancer, diabetes regulation & Milk-fever of cows Optimal Process Control Current Team (2016) 13 Ph.D. Students, 1 Master Student 2 Project Associates, 2 Project Assistants (many more in the past) 2
3 Acknowledgement: Graduated Students & Other Co-workers Mangal Kothari (Faculty in IIT-Kanpur) Arnab Maity (Faculty in IIT-Bombay) Sk. Faruque Ali (Faculty in IIT-Madras) Gurunath Gurala (Faculty in IISc-Bangalore) Harshal Oza (Faculty in Ahmedabad Univ., Ahmedabad) Prasiddha Nath Dwivedi (Scientist in DRDO, Hyderabad) Prem Kumar (Scientist in DRDO, Hyderabad) Girish Joshi (Former scientist in ISRO, doing his Ph.D. in USA) Kapil Sachan (currently a Ph.D. student) Avijit Banerjee (currently a Ph.D. student) Omkar Halbe (Working in EADS) Charu Chawla (Working in a Pvt. Company) and many more! 20 September 2016 Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 5 Outline Lecture 1 Generic Overview of Optimal Control Theory Lecture 2 Real-time Optimal Control using MPSP Lecture 3 Solution of Challenging Practical Problems using MPSP Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 6 3
4 Lecture 1 An Overview of Optimal Control Design Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Why Optimal Control? Summary of Benefits A variety of difficult real-life problems can be formulated in the framework of optimal control. State and control bounds can be incorporated in the control design process explicitly. Incorporation of optimal issues lead to a variety of advantages, like minimum cost, maximum efficiency, non-conservative design etc. Trajectory planning issues can be incorporated into the guidance and control design. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 8 4
5 Role of Optimal Control Question: What is R(s)? How to design it?? Unfortunately, books remain completely silent on this! Optimization (Optimal Control) Optimization (Optimal Control) Mission Objectives Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 9 A Tribute to Pioneers of Optimal Control 1700s Bernoulli, Newton Euler (Student of Bernoulli) Lagrange years later s Pontryagin Bellman Kalman Bernoulli Pontryagin Euler Bellman Lagrange Kalman Newton Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 10 5
6 An Interesting Observation Euler (1726) - Lagrange - Fourier - Dirichlet - Lipschitz - Klein [1A] Euler (1726) - Lagrange - Poisson - Dirichlet - Lipschitz - Klein [1B] Gauss (1799) - Gerling - Pluecker - Klein [2] >> Klein - Lindeman - Hilb - Baer - Liepman - Bryson - Speyer - Bala - Padhi [3] Gauss (1799) - Bessel - Scherk - Kummer - Prym - Rost - Baer - Liepman - Bryson - Speyer - Bala - Padhi [4] Prof. Radhakant Padhi, AE Dept., IISc- Bangalore 11 Optimal control formulation: Key components An optimal control formulation consists of: Performance index that needs to be optimized Appropriate boundary (initial & final) conditions Hard constraints Soft constraints Path constraints System dynamics constraint (nonlinear in general) State constraints Control constraints Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 12 6
7 Optimal Control Problem Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 13 Meaningful Performance Index Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 14 7
8 Meaningful Performance Index Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 15 Optimum of a Functional Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 16 8
9 Fundamental Theorem of Calculus of Variations Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 17 Fundamental Lemma Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 18 9
10 Optimal Control Problem Performance Index (to minimize / maximize): Path Constraint: Boundary Conditions: Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 19 Necessary Conditions of Optimality Augmented PI Hamiltonian First Variation Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 20 10
11 Necessary Conditions of Optimality First Variation Individual terms Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 21 Necessary Conditions of Optimality 0 Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 22 11
12 Necessary Conditions of Optimality First Variation Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 23 Necessary Conditions of Optimality First Variation Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 24 12
13 Necessary Conditions of Optimality: Summary State Equation Costate Equation Optimal Control Equation Boundary Condition Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 25 Necessary Conditions of Optimality: Some Comments State and Costate equations are dynamic equations. If one is stable, the other turns out to be unstable! Optimal control equation is a stationary equation Boundary conditions are split: it leads to Two-Point- Boundary-Value Problem (TPBVP) State equation develops forward whereas Costate equation develops backwards. It is known as Curse of Complexity in optimal control Traditionally, TPBVPs demand computationally-intensive iterative numerical procedures, which lead to open-loop control structure. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 26 13
14 General Boundary/Transversality Condition General condition: Special Cases: Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 27 Example 1: A Toy Problem Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore 14
15 Example Problem: Solution: Costate Eq. Optimal control Eq. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 29 Example Boundary Conditions Define Solution Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 30 15
16 Example Use the boundary condition at Use the boundary condition at Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 31 Example Four equations and four unknowns: Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 32 16
17 Example Solution for State and Costate Solution for Optimal Control Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 33 Example 2: Orbit Transfer Problem Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore 17
18 Example (Maximum Radius Orbit Transfer at a Given Time) Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 35 Example (Maximum Radius Orbit Transfer at a Given Time) Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 36 18
19 System Dynamics and B.C. System dynamics Boundary conditions Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 37 Performance index Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 38 19
20 Necessary Condition Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 39 Necessary Condition Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 40 20
21 A Classical Numerical Approach for Solving Optimal Control Problems: Gradient Method Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Gradient Method Assumptions: State equation satisfied Costate equation satisfied Boundary conditions satisfied Strategy: Satisfy the optimal control equation Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 42 21
22 Gradient Method Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 43 Gradient Method After satisfying the state & costate equations and boundary conditions, we have Select This leads to Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 44 22
23 Gradient Method We select This lead to Note: Eventually, Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 45 Gradient Method: Procedure Assume a control history (not a trivial task) Integrate the state equation forward Integrate the costate equation backward Update the control solution This can either be done at each step while integrating the costate equation backward or after the integration of the costate equation is complete Repeat the procedure until convergence Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 46 23
24 Gradient Method: Selection of Select so that it leads to a certain percentage reduction of Let the percentage be Then This leads to Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 47 Dynamic Programming and Hamilton Jacobi Jacobi Bellman (HJB) Theory Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore 24
25 Fundamental Philosophy Motivation / Objective To obtain a state feedback optimal control solution Fundamental Theorem Any part of an optimal trajectory is an optimal trajectory! Optimal path B C A Non-optimal path Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 49 Optimal Control Problem Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 50 25
26 Hamilton Jacobi Bellman (HJB) Equation Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 51 Hamilton Jacobi Bellman (HJB) Equation contd. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 52 26
27 Hamilton Jacobi Bellman (HJB) Equation contd. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 53 Hamilton Jacobi Bellman (HJB) Equation contd. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 54 27
28 Hamilton Jacobi Bellman (HJB) Equation contd. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 55 Hamilton Jacobi Bellman (HJB) Equation contd. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 56 28
29 Hamilton Jacobi Bellman (HJB) Equation contd. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 57 Summary of HJB Equation Define optimized cost function V as: Then V(t) must satisfy: HJB equation Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 58 29
30 Dynamic Programming: Some Relevant Results Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 59 Dynamic Programming: Some Relevant Results Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 60 30
31 Example: A Benchmark Toy Problem Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Example Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 62 31
32 Example Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 63 Example Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 64 32
33 Example-2 Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 65 Dynamic Programming: Some Important Facts Dynamic programming is a powerful technique in the sense that if the HJB equation is solved, it leads to a state feedback form of optimal control solution. HJB equation is both necessary and sufficient for the optimal cost function. At least one of the control solutions that results from the solution of the HJB equation is guaranteed to be stabilizing. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 66 33
34 Dynamic Programming: Some Important Facts The resulting PDE of the HJB equation is extremely difficult to solve in general. Dynamic Programming runs into a huge Computational and storage requirements for reasonably higher dimensional problems. This is a severe restriction of dynamic programming technique, which Bellman termed as curse of dimensionality. Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 67 Books on Optimal Control Design R. Padhi, Applied Optimal Control, Wiley, Manuscript Under Preparation (expected in 2018). D. S. Naidu, Optimal Control Systems, CRC Press, D. E. Kirk, Optimal Control Theory: An Introduction, Prentice Hall, A. E. Bryson and Y-C Ho, Applied Optimal Control, Taylor and Francis, A. P. Sage and C. C. White III, Optimum Systems Control (2nd Ed.), Prentice Hall, Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 68 34
35 Survey Papers on Classical Methods for Optimal Control Design H. J. Pesch (1994), A Practical Guide to the Solution of Real-Life Optimal Control Problems, Control and Cybernetics, Vol.23, No.1/2, 1994, pp R. E. Larson (1967), A Survey of Dynamic Programming Computational Procedures, IEEE Transactions on Automatic Control, December, pp M. Athans (1966), The Status of Optimal Control Theory and Applications for Deterministic Systems, IEEE Trans. on Automatic Control, Vol. AC-11, July 1966, pp Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 69 Thanks for the Attention.!! Prof. Radhakant Padhi, AE Dept., IISc-Bangalore 70 35
Classical Numerical Methods to Solve Optimal Control Problems
Lecture 26 Classical Numerical Methods to Solve Optimal Control Problems Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Necessary Conditions
More informationConstrained Optimal Control I
Optimal Control, Guidance and Estimation Lecture 34 Constrained Optimal Control I Pro. Radhakant Padhi Dept. o Aerospace Engineering Indian Institute o Science - Bangalore opics Motivation Brie Summary
More informationConstrained Optimal Control. Constrained Optimal Control II
Optimal Control, Guidance and Estimation Lecture 35 Constrained Optimal Control II Prof. Radhakant Padhi Dept. of Aerospace Engineering Indian Institute of Science - Bangalore opics: Constrained Optimal
More informationGain Scheduling and Dynamic Inversion
Lecture 31 Gain Scheduling and Dynamic Inversion Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Topics A Brief Overview of Gain Scheduling Philosophy
More informationLinear Quadratic Regulator (LQR) I
Optimal Control, Guidance and Estimation Lecture Linear Quadratic Regulator (LQR) I Pro. Radhakant Padhi Dept. o Aerospace Engineering Indian Institute o Science - Bangalore Generic Optimal Control Problem
More informationDynamic Inversion Design II
Lecture 32 Dynamic Inversion Design II Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Topics Summary of Dynamic Inversion Design Advantages Issues
More informationTwo-Point Boundary Value Problem and Optimal Feedback Control based on Differential Algebra
Two-Point Boundary Value Problem and Optimal Feedback Control based on Differential Algebra Politecnico di Milano Department of Aerospace Engineering Milan, Italy Taylor Methods and Computer Assisted Proofs
More informationLinear Quadratic Regulator (LQR) Design II
Lecture 8 Linear Quadratic Regulator LQR) Design II Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Stability and Robustness properties
More informationLinear Quadratic Regulator (LQR) Design I
Lecture 7 Linear Quadratic Regulator LQR) Design I Dr. Radhakant Padhi Asst. Proessor Dept. o Aerospace Engineering Indian Institute o Science - Bangalore LQR Design: Problem Objective o drive the state
More informationMinimum Time Ascent Phase Trajectory Optimization using Steepest Descent Method
IJCTA, 9(39), 2016, pp. 71-76 International Science Press Closed Loop Control of Soft Switched Forward Converter Using Intelligent Controller 71 Minimum Time Ascent Phase Trajectory Optimization using
More informationECE: Special Topics in Systems and Control. Optimal Control: Theory and Applications
ECE: Special Topics in Systems and Control Optimal Control: Theory and Applications Course #: 18879C/96840SV Semester: Fall 2012 Breadth Area: Artificial Intelligence, Robotics and Control Instructors:
More informationLecture 6 Classical Control Overview IV. Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore
Lecture 6 Classical Control Overview IV Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Lead Lag Compensator Design Dr. Radhakant Padhi Asst.
More informationNumerical Optimal Control Overview. Moritz Diehl
Numerical Optimal Control Overview Moritz Diehl Simplified Optimal Control Problem in ODE path constraints h(x, u) 0 initial value x0 states x(t) terminal constraint r(x(t )) 0 controls u(t) 0 t T minimize
More informationUsing Lyapunov Theory I
Lecture 33 Stability Analysis of Nonlinear Systems Using Lyapunov heory I Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Motivation Definitions
More informationDepartment of Mathematics Faculty of Natural Science, Jamia Millia Islamia, New Delhi-25
Department of Mathematics Faculty of Natural Science, Jamia Millia Islamia, New Delhi-25 Course Structure of U.G. under CBCS* (Only for those students who have not taken mathematics as a core or subsidiary
More informationOptimal Control Theory
Optimal Control Theory The theory Optimal control theory is a mature mathematical discipline which provides algorithms to solve various control problems The elaborate mathematical machinery behind optimal
More informationFeedback Optimal Control of Low-thrust Orbit Transfer in Central Gravity Field
Vol. 4, No. 4, 23 Feedback Optimal Control of Low-thrust Orbit Transfer in Central Gravity Field Ashraf H. Owis Department of Astronomy, Space and Meteorology, Faculty of Science, Cairo University Department
More informationOutput Regulation of the Arneodo Chaotic System
Vol. 0, No. 05, 00, 60-608 Output Regulation of the Arneodo Chaotic System Sundarapandian Vaidyanathan R & D Centre, Vel Tech Dr. RR & Dr. SR Technical University Avadi-Alamathi Road, Avadi, Chennai-600
More informationWelcome to IIT Guwahati
Welcome to IIT Guwahati PH101: PHYSICS-I Lecture 1 Padma Kumar Padmanabhan Uday Maiti Department of Physics IIT Guwahati Topics 1. Analytical (Classical) mechanics (Up to Mid-Sem Exam; Of 50% marks) 2.
More informationChapter 5. Pontryagin s Minimum Principle (Constrained OCP)
Chapter 5 Pontryagin s Minimum Principle (Constrained OCP) 1 Pontryagin s Minimum Principle Plant: (5-1) u () t U PI: (5-2) Boundary condition: The goal is to find Optimal Control. 2 Pontryagin s Minimum
More informationIntroduction to Reachability Somil Bansal Hybrid Systems Lab, UC Berkeley
Introduction to Reachability Somil Bansal Hybrid Systems Lab, UC Berkeley Outline Introduction to optimal control Reachability as an optimal control problem Various shades of reachability Goal of This
More informationUAV Navigation: Airborne Inertial SLAM
Introduction UAV Navigation: Airborne Inertial SLAM Jonghyuk Kim Faculty of Engineering and Information Technology Australian National University, Australia Salah Sukkarieh ARC Centre of Excellence in
More informationDecentralized Control of Nonlinear Multi-Agent Systems Using Single Network Adaptive Critics
Decentralized Control of Nonlinear Multi-Agent Systems Using Single Network Adaptive Critics Ali Heydari Mechanical & Aerospace Engineering Dept. Missouri University of Science and Technology Rolla, MO,
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationBook review for Stability and Control of Dynamical Systems with Applications: A tribute to Anthony M. Michel
To appear in International Journal of Hybrid Systems c 2004 Nonpareil Publishers Book review for Stability and Control of Dynamical Systems with Applications: A tribute to Anthony M. Michel João Hespanha
More informationOptimal Control. McGill COMP 765 Oct 3 rd, 2017
Optimal Control McGill COMP 765 Oct 3 rd, 2017 Classical Control Quiz Question 1: Can a PID controller be used to balance an inverted pendulum: A) That starts upright? B) That must be swung-up (perhaps
More informationLinear Quadratic Regulator (LQR) II
Optimal Control, Guidance and Estimation Lecture 11 Linear Quadratic Regulator (LQR) II Pro. Radhakant Padhi Dept. o Aerospace Engineering Indian Institute o Science - Bangalore Outline Summary o LQR design
More informationWhat is flight dynamics? AE540: Flight Dynamics and Control I. What is flight control? Is the study of aircraft motion and its characteristics.
KING FAHD UNIVERSITY Department of Aerospace Engineering AE540: Flight Dynamics and Control I Instructor Dr. Ayman Hamdy Kassem What is flight dynamics? Is the study of aircraft motion and its characteristics.
More informationOptimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations
Martino Bardi Italo Capuzzo-Dolcetta Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations Birkhauser Boston Basel Berlin Contents Preface Basic notations xi xv Chapter I. Outline
More informationNumerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini
Numerical approximation for optimal control problems via MPC and HJB Giulia Fabrini Konstanz Women In Mathematics 15 May, 2018 G. Fabrini (University of Konstanz) Numerical approximation for OCP 1 / 33
More informationENGINEERING MATHEMATICS I. CODE: 10 MAT 11 IA Marks: 25 Hrs/Week: 04 Exam Hrs: 03 PART-A
ENGINEERING MATHEMATICS I CODE: 10 MAT 11 IA Marks: 25 Hrs/Week: 04 Exam Hrs: 03 Total Hrs: 52 Exam Marks:100 PART-A Unit-I: DIFFERENTIAL CALCULUS - 1 Determination of n th derivative of standard functions-illustrative
More informationOptimal Control. Lecture 18. Hamilton-Jacobi-Bellman Equation, Cont. John T. Wen. March 29, Ref: Bryson & Ho Chapter 4.
Optimal Control Lecture 18 Hamilton-Jacobi-Bellman Equation, Cont. John T. Wen Ref: Bryson & Ho Chapter 4. March 29, 2004 Outline Hamilton-Jacobi-Bellman (HJB) Equation Iterative solution of HJB Equation
More informationOPTIMAL ESTIMATION of DYNAMIC SYSTEMS
CHAPMAN & HALL/CRC APPLIED MATHEMATICS -. AND NONLINEAR SCIENCE SERIES OPTIMAL ESTIMATION of DYNAMIC SYSTEMS John L Crassidis and John L. Junkins CHAPMAN & HALL/CRC A CRC Press Company Boca Raton London
More informationSession Title Chair & Co Chairs Paper Title of Best presentation
Date 02/02/2016 Session code TuAT1 TuAT2 TuAT3 TuAT4 TuBT1 TuBT2 Session Title Chair & Co Chairs Paper Title of Best presentation Guidance of Ratnoo, Ashwini, Autonomous Landing for UAVs Missiles and Using
More informationStability Analysis of Optimal Adaptive Control under Value Iteration using a Stabilizing Initial Policy
Stability Analysis of Optimal Adaptive Control under Value Iteration using a Stabilizing Initial Policy Ali Heydari, Member, IEEE Abstract Adaptive optimal control using value iteration initiated from
More informationNumerical Methods for Optimal Control Problems. Part I: Hamilton-Jacobi-Bellman Equations and Pontryagin Minimum Principle
Numerical Methods for Optimal Control Problems. Part I: Hamilton-Jacobi-Bellman Equations and Pontryagin Minimum Principle Ph.D. course in OPTIMAL CONTROL Emiliano Cristiani (IAC CNR) e.cristiani@iac.cnr.it
More informationINDIAN SPACE RESEARCH ORGANIZATION (ISRO), AHMEDABAD
Dr Jivraj Mehta Institute of Technology, Mogar Mechanical Engineering Department A REPORT ON INDUSTRIAL VISIT TO INDIAN SPACE RESEARCH ORGANIZATION (ISRO), AHMEDABAD ON 20 TH JANUARY 2017 Submitted by
More informationEE291E/ME 290Q Lecture Notes 8. Optimal Control and Dynamic Games
EE291E/ME 290Q Lecture Notes 8. Optimal Control and Dynamic Games S. S. Sastry REVISED March 29th There exist two main approaches to optimal control and dynamic games: 1. via the Calculus of Variations
More informationIntroduction MEAM 535. What is MEAM 535? Audience. Advanced topics in dynamics
What is MEAM 535? Advanced topics in dynamics Audience Review of Newtonian mechanics MEAM 535 Introduction Analytical mechanics: Lagrangian and Hamiltonian Special topics: Stability of dynamical systems,
More informationTWO- PHASE APPROACH TO DESIGN ROBUST CONTROLLER FOR UNCERTAIN INTERVAL SYSTEM USING GENETIC ALGORITHM
International Journal of Electrical and Electronics Engineering Research (IJEEER) ISSN:2250-155X Vol.2, Issue 2 June 2012 27-38 TJPRC Pvt. Ltd., TWO- PHASE APPROACH TO DESIGN ROBUST CONTROLLER FOR UNCERTAIN
More informationStatic and Dynamic Optimization (42111)
Static and Dynamic Optimization (421) Niels Kjølstad Poulsen Build. 0b, room 01 Section for Dynamical Systems Dept. of Applied Mathematics and Computer Science The Technical University of Denmark Email:
More informationSolution of Stochastic Optimal Control Problems and Financial Applications
Journal of Mathematical Extension Vol. 11, No. 4, (2017), 27-44 ISSN: 1735-8299 URL: http://www.ijmex.com Solution of Stochastic Optimal Control Problems and Financial Applications 2 Mat B. Kafash 1 Faculty
More informationEnergy-Insensitive Guidance of Solid Motor Propelled Long Range Flight Vehicles Using MPSP and Dynamic Inversion
Proceedings of the 17th World Congress he International Federation of Automatic Control Energy-Insensitive Guidance of Solid Motor Propelled Long Range Flight Vehicles Using MPSP and Dynamic Inversion
More informationInternational Symposium on Recent Advances in Nanomaterials & Workshop on
International Symposium on Recent Advances in Nanomaterials & Workshop on Modeling and Simulations of Nanomaterials using VASP Synthesis and Characterization of Nanomaterials 20 th & 21 st February, 2017
More informationRiccati difference equations to non linear extended Kalman filter constraints
International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R
More informationOptimal Control. Lecture 3. Optimal Control of Discrete Time Dynamical Systems. John T. Wen. January 22, 2004
Optimal Control Lecture 3 Optimal Control of Discrete Time Dynamical Systems John T. Wen January, 004 Outline optimization of a general multi-stage discrete time dynamical systems special case: discrete
More informationChapter 2 Optimal Control Problem
Chapter 2 Optimal Control Problem Optimal control of any process can be achieved either in open or closed loop. In the following two chapters we concentrate mainly on the first class. The first chapter
More informationOutput Regulation of the Tigan System
Output Regulation of the Tigan System Dr. V. Sundarapandian Professor (Systems & Control Eng.), Research and Development Centre Vel Tech Dr. RR & Dr. SR Technical University Avadi, Chennai-6 6, Tamil Nadu,
More informationOUTPUT REGULATION OF RÖSSLER PROTOTYPE-4 CHAOTIC SYSTEM BY STATE FEEDBACK CONTROL
International Journal in Foundations of Computer Science & Technology (IJFCST),Vol., No., March 01 OUTPUT REGULATION OF RÖSSLER PROTOTYPE-4 CHAOTIC SYSTEM BY STATE FEEDBACK CONTROL Sundarapandian Vaidyanathan
More informationAn Optimal Tracking Approach to Formation Control of Nonlinear Multi-Agent Systems
AIAA Guidance, Navigation, and Control Conference 13-16 August 212, Minneapolis, Minnesota AIAA 212-4694 An Optimal Tracking Approach to Formation Control of Nonlinear Multi-Agent Systems Ali Heydari 1
More informationRakhim Aitbayev, Ph.D.
Curriculum Vitae 1 Rakhim Aitbayev, Ph.D. Department of Mathematics New Mexico Institute of Mining and Technology Socorro, New Mexico 87801 phone: (575) 835-5463 e-mail: aitbayev@nmt.edu webpage: www.nmt.edu/
More informationPontryagin s maximum principle
Pontryagin s maximum principle Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 2012 Emo Todorov (UW) AMATH/CSE 579, Winter 2012 Lecture 5 1 / 9 Pontryagin
More informationNonlinear Optimization for Optimal Control Part 2. Pieter Abbeel UC Berkeley EECS. From linear to nonlinear Model-predictive control (MPC) POMDPs
Nonlinear Optimization for Optimal Control Part 2 Pieter Abbeel UC Berkeley EECS Outline From linear to nonlinear Model-predictive control (MPC) POMDPs Page 1! From Linear to Nonlinear We know how to solve
More informationA Simple Design Approach In Yaw Plane For Two Loop Lateral Autopilots
A Simple Design Approach In Yaw Plane For Two Loop Lateral Autopilots Jyoti Prasad Singha Thakur 1, Amit Mukhopadhyay Asst. Prof., AEIE, Bankura Unnayani Institute of Engineering, Bankura, West Bengal,
More informationOverview of the Seminar Topic
Overview of the Seminar Topic Simo Särkkä Laboratory of Computational Engineering Helsinki University of Technology September 17, 2007 Contents 1 What is Control Theory? 2 History
More informationCURRICULUM VITAE. Dept. of Mathematics, Sundergarh,Rourkela (Odisha) INDIA. Residential Address : C/O -BiswanathKar, At- Kodagambhir,
CURRICULUM VITAE RASMITA KAR Date of Birth : April 17, 1982 Nationality : Indian Gender : Female Marital status : Married Departmental Address : NIT Rourkela, Dept. of Mathematics, Sundergarh,Rourkela-769008
More informationPreface Acknowledgments
Contents Preface Acknowledgments xi xix Chapter 1: Brief review of static optimization methods 1 1.1. Introduction: Significance of Mathematical Models 1 1.2. Unconstrained Problems 4 1.3. Equality Constraints
More informationINSTITUTE OF AERONAUTICAL ENGINEERING (Autonomous) Dundigal, Hyderabad
Course Title Course Code INSTITUTE OF AERONAUTICAL ENGINEERING (Autonomous) Dundigal, Hyderabad - 500 043 CIVIL ENGINEERING COURSE DESCRIPTION MATHEMATICS-II A30006 Course Structure Lectures Tutorials
More informationOPTIMAL SPACECRAF1 ROTATIONAL MANEUVERS
STUDIES IN ASTRONAUTICS 3 OPTIMAL SPACECRAF1 ROTATIONAL MANEUVERS JOHNL.JUNKINS Texas A&M University, College Station, Texas, U.S.A. and JAMES D.TURNER Cambridge Research, Division of PRA, Inc., Cambridge,
More informationOptimal Control of Weakly Coupled Systems and Applications
Optimal Control of Weakly Coupled Systems and Applications HIGH ACCURACY TECHNIQUES Z. Gajić, M-T. Lim, D. Skatarić W-C. Su, and V. Kecman Taylor & Francis (CRC Press, Dekker) 2008 Preface This book is
More informationREVIEW. Hamilton s principle. based on FW-18. Variational statement of mechanics: (for conservative forces) action Equivalent to Newton s laws!
Hamilton s principle Variational statement of mechanics: (for conservative forces) action Equivalent to Newton s laws! based on FW-18 REVIEW the particle takes the path that minimizes the integrated difference
More informationPhotometric Stereo: Three recent contributions. Dipartimento di Matematica, La Sapienza
Photometric Stereo: Three recent contributions Dipartimento di Matematica, La Sapienza Jean-Denis DUROU IRIT, Toulouse Jean-Denis DUROU (IRIT, Toulouse) 17 December 2013 1 / 32 Outline 1 Shape-from-X techniques
More informationAnalytical Mechanics. of Space Systems. tfa AA. Hanspeter Schaub. College Station, Texas. University of Colorado Boulder, Colorado.
Analytical Mechanics of Space Systems Third Edition Hanspeter Schaub University of Colorado Boulder, Colorado John L. Junkins Texas A&M University College Station, Texas AIM EDUCATION SERIES Joseph A.
More informationPierre Bigot 2 and Luiz C. G. de Souza 3
INTERNATIONAL JOURNAL OF SYSTEMS APPLICATIONS, ENGINEERING & DEVELOPMENT Volume 8, 2014 Investigation of the State Dependent Riccati Equation (SDRE) adaptive control advantages for controlling non-linear
More informationOptimization Of Cruise Tourist Orbit For Multiple Targets On GEO
3rd International Conference on Management, Education echnology and Sports Science (MESS 016) Optimization Of Cruise ourist Orbit For Multiple argets On GEO Le-tian Zheng1, a, Fei Feng1 and Yan-li Xu1
More informationAn Overview on Behavioural Theory to Systems and Control. Md. Haider Ali Biswas PDEEC, FEUP
An Overview on Behavioural Theory to Systems and Control Md. Haider Ali Biswas PDEEC, FEUP E-mail: mhabiswas@yahoo.com Back to Basics Seminars.6 January, 2010 Presentation: At A glance Objectives A look
More informationWater Resources Systems: Modeling Techniques and Analysis
INDIAN INSTITUTE OF SCIENCE Water Resources Systems: Modeling Techniques and Analysis Lecture - 20 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc. 1 Summary of the previous lecture
More informationApplication of singular perturbation theory in modeling and control of flexible robot arm
Research Article International Journal of Advanced Technology and Engineering Exploration, Vol 3(24) ISSN (Print): 2394-5443 ISSN (Online): 2394-7454 http://dx.doi.org/10.19101/ijatee.2016.324002 Application
More informationAnalysis of optimal strategies for soft landing on the Moon from lunar parking orbits
Analysis of optimal strategies for soft landing on the Moon from lunar parking orbits R V Ramanan and Madan Lal Aerospace Flight Dynamics Group, Vikram Sarabhai Space Centre, Thiruvananthapuram 695 022,
More informationProfile... Dr. K. Venkata Rao Associate Professor Mechanical Engineering Department
Profile... Dr. K. Venkata Rao Associate Professor Mechanical Engineering Department Academic Record Degree Year Branch/Specialization Ph. D Visvesvaraya Technological April, 2016 Adaptive Structures M.E
More information(Autonomous/ Affiliated to Anna University, Chennai) COIMBATORE DEPARTMENT OF ELECTRICAL AND ELECTRONICS ENGINEERING
(Autonomous/ Affiliated to Anna University, Chennai) COIMBATORE-641 032 DEPARTMENT OF ELECTRICAL AND ELECTRONICS ENGINEERING Semester III Academic Year: 2015-2016 Regulations 2014 COURSE PLAN Vision To
More informationShock-Boundary Layer Interaction (SBLI) CFD research and applications. IIT Bombay, 15th May 2012
Workshop on Shock-Boundary Layer Interaction (SBLI) CFD research and applications IIT Bombay, 15th May 2012 Convenor: Prof. Krishnendu Sinha Preamble Interaction of shock waves with turbulent boundary
More informationMath 411 Preliminaries
Math 411 Preliminaries Provide a list of preliminary vocabulary and concepts Preliminary Basic Netwon s method, Taylor series expansion (for single and multiple variables), Eigenvalue, Eigenvector, Vector
More informationOUTPUT REGULATION OF THE SIMPLIFIED LORENZ CHAOTIC SYSTEM
OUTPUT REGULATION OF THE SIMPLIFIED LORENZ CHAOTIC SYSTEM Sundarapandian Vaidyanathan Research and Development Centre, Vel Tech Dr. RR & Dr. SR Technical University Avadi, Chennai-600 06, Tamil Nadu, INDIA
More informationNeural Dynamic Optimization for Control Systems Part II: Theory
490 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART B: CYBERNETICS, VOL. 31, NO. 4, AUGUST 2001 Neural Dynamic Optimization for Control Systems Part II: Theory Chang-Yun Seong, Member, IEEE, and
More informationWEIGHTING MATRICES DETERMINATION USING POLE PLACEMENT FOR TRACKING MANEUVERS
U.P.B. Sci. Bull., Series D, Vol. 75, Iss. 2, 2013 ISSN 1454-2358 WEIGHTING MATRICES DETERMINATION USING POLE PLACEMENT FOR TRACKING MANEUVERS Raluca M. STEFANESCU 1, Claudiu L. PRIOROC 2, Adrian M. STOICA
More informationLecture 4 Classical Control Overview II. Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore
Lecture 4 Classical Control Overview II Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Stability Analysis through Transfer Function Dr. Radhakant
More informationPolicy Gradient Reinforcement Learning for Robotics
Policy Gradient Reinforcement Learning for Robotics Michael C. Koval mkoval@cs.rutgers.edu Michael L. Littman mlittman@cs.rutgers.edu May 9, 211 1 Introduction Learning in an environment with a continuous
More informationStochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents
Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents
More informationLinear Feedback Control Using Quasi Velocities
Linear Feedback Control Using Quasi Velocities Andrew J Sinclair Auburn University, Auburn, Alabama 36849 John E Hurtado and John L Junkins Texas A&M University, College Station, Texas 77843 A novel approach
More informationThe Implicit Function Theorem with Applications in Dynamics and Control
48th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition 4-7 January 2010, Orlando, Florida AIAA 2010-174 The Implicit Function Theorem with Applications in Dynamics
More informationMaximum Process Problems in Optimal Control Theory
J. Appl. Math. Stochastic Anal. Vol. 25, No., 25, (77-88) Research Report No. 423, 2, Dept. Theoret. Statist. Aarhus (2 pp) Maximum Process Problems in Optimal Control Theory GORAN PESKIR 3 Given a standard
More informationHIGH-ORDER STATE FEEDBACK GAIN SENSITIVITY CALCULATIONS USING COMPUTATIONAL DIFFERENTIATION
(Preprint) AAS 12-637 HIGH-ORDER STATE FEEDBACK GAIN SENSITIVITY CALCULATIONS USING COMPUTATIONAL DIFFERENTIATION Ahmad Bani Younes, James Turner, Manoranjan Majji, and John Junkins INTRODUCTION A nonlinear
More informationGoddard s Problem Steven Finch
Goddard s Problem Steven Finch June 12, 2015 Arocketliftsoff vertically at time =0. Let ( ) be the mass of the rocket (payload and fuel) and ( ) be the altitude. We wish to choose the thrust ( ) and a
More informationBlack Boxes & White Noise
Black Boxes & White Noise The Evolution of Automatic Control K. J. Åström Lund Institute of Technology Lund, Sweden 1. Introduction 2. Early Ideas 3. A Discipline Emerges 4. The Second Wave 5. Conclusions
More informationPapers Published. Achievements from the Department of M.Tech(Aeronautical Engg.) Dr SK MAHARANA: Personal publications
Department of M.Tech( Engg.) Papers Published Dr SK MAHARANA: Personal publications SK Maharana, Praveen B Mali, Ganesh Prabhakar P, Sunil J, Vignesh Kumar, 2011, Cloud Computing Applied for Numerical
More informationLongitudinal Automatic landing System - Design for CHARLIE Aircraft by Root-Locus
International Journal of Scientific and Research Publications, Volume 3, Issue 7, July 2013 1 Longitudinal Automatic landing System - Design for CHARLIE Aircraft by Root-Locus Gaber El-Saady, El-Nobi A.Ibrahim,
More informationADAPTIVE FILTER THEORY
ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface
More informationGeneralization to inequality constrained problem. Maximize
Lecture 11. 26 September 2006 Review of Lecture #10: Second order optimality conditions necessary condition, sufficient condition. If the necessary condition is violated the point cannot be a local minimum
More informationStochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions
International Journal of Control Vol. 00, No. 00, January 2007, 1 10 Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions I-JENG WANG and JAMES C.
More informationSufficient Conditions for Finite-variable Constrained Minimization
Lecture 4 It is a small de tour but it is important to understand this before we move to calculus of variations. Sufficient Conditions for Finite-variable Constrained Minimization ME 256, Indian Institute
More informationCOE CST Fifth Annual Technical Meeting. Task 187: Space Situational Awareness. PI: Dan Scheeres Student: In-Kwan Park University of Colorado
COE CST Fifth Annual Technical Meeting Task 187: Space Situational Awareness PI: Dan Scheeres Student: In-Kwan Park University of Colorado Washington, DC 1 # Agenda Team Members Task Description Research
More informationECE 516: System Control Engineering
ECE 516: System Control Engineering This course focuses on the analysis and design of systems control. This course will introduce time-domain systems dynamic control fundamentals and their design issues
More informationReview. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn
Review Taylor Series and Error Analysis Roots of Equations Linear Algebraic Equations Optimization Numerical Differentiation and Integration Ordinary Differential Equations Partial Differential Equations
More informationComputational Modeling for Physical Sciences
Computational Modeling for Physical Sciences Since the invention of computers the use of computational modeling and simulations have revolutionized the way we study physical systems. Their applications
More informationMODEL-BASED REINFORCEMENT LEARNING FOR ONLINE APPROXIMATE OPTIMAL CONTROL
MODEL-BASED REINFORCEMENT LEARNING FOR ONLINE APPROXIMATE OPTIMAL CONTROL By RUSHIKESH LAMBODAR KAMALAPURKAR A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT
More informationLecture 3: Hamilton-Jacobi-Bellman Equations. Distributional Macroeconomics. Benjamin Moll. Part II of ECON Harvard University, Spring
Lecture 3: Hamilton-Jacobi-Bellman Equations Distributional Macroeconomics Part II of ECON 2149 Benjamin Moll Harvard University, Spring 2018 1 Outline 1. Hamilton-Jacobi-Bellman equations in deterministic
More informationEN Applied Optimal Control Lecture 8: Dynamic Programming October 10, 2018
EN530.603 Applied Optimal Control Lecture 8: Dynamic Programming October 0, 08 Lecturer: Marin Kobilarov Dynamic Programming (DP) is conerned with the computation of an optimal policy, i.e. an optimal
More informationH-infinity Model Reference Controller Design for Magnetic Levitation System
H.I. Ali Control and Systems Engineering Department, University of Technology Baghdad, Iraq 6043@uotechnology.edu.iq H-infinity Model Reference Controller Design for Magnetic Levitation System Abstract-
More information