Neural Network Control of Robot Manipulators and Nonlinear Systems

Size: px
Start display at page:

Download "Neural Network Control of Robot Manipulators and Nonlinear Systems"

Transcription

1 Neural Network Control of Robot Manipulators and Nonlinear Systems F.L. LEWIS Automation and Robotics Research Institute The University of Texas at Arlington S. JAG ANNATHAN Systems and Controls Research Caterpillar, Inc., Mossville A. YE ILDIREK Manager, New Product Development Depsa, Panama City '*8 - ^

2 Contents List of Tables of Design Equations List of Figures Series Introduction Preface xi xviii xix xxi 1 Background on Neural Networks NEURAL NETWORK TOPOLOGIES AND RECALL Neuron Mathematical Model Multilayer Perceptron Linear-in-the-Parameter (LIP) Neural Nets Dynamic Neural Networks PROPERTIES OF NEURAL NETWORKS Classification, Association, and Pattern Recognition Function Approximation NEURAL NETWORK WEIGHT SELECTION AND TRAINING Direct Computation of the Weights Training the One-Layer Neural Network Gradient Descent Training the Multilayer Neural Network Backpropagation Tuning Improvements on Gradient Descent Hebbian Tuning Continuous-Time Tuning REFERENCES PROBLEMS 63 2 Background on Dynamic Systems DYNAMICAL SYSTEMS Continuous-Time Systems Discrete-Time Systems SOME MATHEMATICAL BACKGROUND Vector and Matrix Norms Continuity and Function Norms PROPERTIES OF DYNAMICAL SYSTEMS 77 v

3 CONTENTS Stability Passivity Observability and Controllability FEEDBACK LINEARIZATION AND CONTROL SYSTEM DESIGN Input-Output Feedback Linearization Controllers Computer Simulation of Feedback Control Systems Feedback Linearization for Discrete-Time Systems NONLINEAR STABILITY ANALYSIS AND CONTROLS DESIGN Lyapunov Analysis for Autonomous Systems Controller Design Using Lyapunov Techniques Lyapunov Analysis for Non-Autonomous Systems Extensions of Lyapunov Techniques and Bounded Stability REFERENCES H5 2.7 PROBLEMS H6 Robot Dynamics and Control Commercial Robot Controllers KINEMATICS AND JACOBIANS Kinematics of Rigid Serial-Link Manipulators Robot Jacobians ROBOT DYNAMICS AND PROPERTIES Joint Space Dynamics and Properties State Variable Representations Cartesian Dynamics and Actuator Dynamics COMPUTED-TORQUE (CT) CONTROL AND COMPUTER SIM ULATION Computed-Torque (CT) Control Computer Simulation of Robot Controllers Approximate Computed-Torque Control and Classical Joint Control Digital Control FILTERED-ERROR APPROXIMATION-BASED CONTROL A General Controller Design Framework Based on Approximation Computed-Torque Control Variant Adaptive Control Robust Control Learning Control CONCLUSIONS REFERENCES PROBLEMS 169 Neural Network Robot Control ROBOT ARM DYNAMICS AND TRACKING ERROR DYNAMICS ONE-LAYER FUNCTIONAL-LINK NEURAL NETWORK CON TROLLER Approximation by One-Layer Functional-Link NN 180

4 CONTENTS Vll NN Controller and Error System Dynamics Unsupervised Backpropagation Weight Tuning Augmented Unsupervised Backpropagation Tuning Removing the PE Condition Functional-Link NN Controller Design and Simulation Examplel TWO-LAYER NEURAL NETWORK CONTROLLER NN Approximation and the Nonlinearity in the Parameters Problem Controller Structure and Error System Dynamics Weight Updates for Guaranteed Tracking Performance Two-Layer NN Controller Design and Simulation Example PARTITIONED NN AND SIGNAL PREPROCESSING Partitioned NN Preprocessing of Neural Net Inputs Selection of a Basis Set for the Functional-Link NN PASSIVITY PROPERTIES OF NN CONTROLLERS Passivity of the Tracking Error Dynamics Passivity Properties of NN Controllers CONCLUSIONS REFERENCES PROBLEMS Neural Network Robot Control: Applications and Extensions FORCE CONTROL USING NEURAL NETWORKS Force Constrained Motion and Error Dynamics Neural Network Hybrid Position/Force Controller Design Example for NN Hybrid Position/Force Controller ROBOT MANIPULATORS WITH LINK FLEXIBILITY, MOTOR DYNAMICS, AND JOINT FLEXIBILITY Flexible-Link Robot Arms Robots with Actuators and Compliant Drive Train Coupling Rigid-Link Electrically-Driven (RLED) Robot Arms SINGULAR PERTURBATION DESIGN Two-Time-Scale Controller Design NN Controller for Flexible-Link Robot Using Singular Perturbations BACKSTEPPING DESIGN Backstepping Design NN Controller for Rigid-Link Electrically-Driven Robot Using Backstepping CONCLUSIONS REFERENCES PROBLEMS 272

5 viii CONTENTS 6 Neural Network Control of Nonlinear Systems SYSTEM AND TRACKING ERROR DYNAMICS Tracking Controller and Error Dynamics Well-Defined Control Problem CASE OF KNOWN FUNCTION g(x) Proposed NN Controller NN Weight Tuning for Tracking Stability Illustrative Simulation Example CASE OF UNKNOWN FUNCTION g(x) Proposed NN Controller NN Weight Tuning for Tracking Stability Illustrative Simulation Examples CONCLUSIONS REFERENCES NN Control with Discrete-Time Tuning BACKGROUND AND ERROR DYNAMICS Neural Network Approximation Property Stability of Systems Tracking Error Dynamics for a Class of Nonlinear Systems ONE-LAYER NEURAL NETWORK CONTROLLER DESIGN Structure of the One-layer NN Controller and Error System Dynamics One-layer Neural Network Weight Updates Projection Algorithm Ideal Case: No Disturbances or NN Reconstruction Errors One-layer Neural Network Weight Tuning Modification for Relaxation of Persistency of Excitation Condition MULTILAYER NEURAL NETWORK CONTROLLER DESIGN Structure of the NN Controller and Error System Dynamics Multilayer Neural Network Weight Updates Projection Algorithm Multilayer Neural Network Weight Tuning Modification for Relaxation of Persistency of Excitation Condition PASSIVITY PROPERTIES OF THE NN Passivity Properties of the Tracking Error System Passivity Properties of One-layer Neural Networks and the Closed-Loop System Passivity Properties of Multilayer Neural Networks CONCLUSIONS REFERENCES PROBLEMS 356

6 IX Discrete-Time Feedback Linearization by Neural Networks SYSTEM DYNAMICS AND THE TRACKING PROBLEM Tracking Error Dynamics for a Class of Nonlinear Systems NN CONTROLLER DESIGN FOR FEEDBACK LINEARIZATION NN Approximation of Unknown Functions Error System Dynamics Well-Defined Control Problem Proposed Controller SINGLE-LAYER NN FOR FEEDBACK LINEARIZATION Weight Updates Requiring Persistence of Excitation Projection Algorithm Weight Updates not Requiring Persistence of Excitation MULTILAYER NEURAL NETWORKS FOR FEEDBACK LINEARIZA TION Weight Updates Requiring Persistence of Excitation Weight Updates not Requiring Persistence of Excitation PASSIVITY PROPERTIES OF THE NN Passivity Properties of the Tracking Error System Passivity Properties of One-layer Neural Network Controllers Passivity Properties of Multilayer Neural Network Controllers CONCLUSIONS REFERENCES PROBLEMS 411 State Estimation Using Discrete-Time Neural Networks IDENTIFICATION OF NONLINEAR DYNAMICAL SYSTEMS IDENTIFIER DYNAMICS FOR MIMO SYSTEMS MULTILAYER NEURAL NETWORK IDENTIFIER DESIGN Structure of the NN Controller and Error System Dynamics Three-Layer Neural Network Weight Updates PASSIVITY PROPERTIES OF THE NN SIMULATION RESULTS CONCLUSIONS REFERENCES PROBLEMS 430

NONLINEAR NETWORK STRUCTURES FOR FEEDBACK CONTROL

NONLINEAR NETWORK STRUCTURES FOR FEEDBACK CONTROL 205 Asian Journal of Control, Vol 1, No 4, pp 205-228, December 1999 NONLINEAR NETWORK STRUCTURES FOR FEEDBACK CONTROL FL Lewis ABSTRACT A framework is given for controller design using Nonlinear Network

More information

Adaptive Predictive Observer Design for Class of Uncertain Nonlinear Systems with Bounded Disturbance

Adaptive Predictive Observer Design for Class of Uncertain Nonlinear Systems with Bounded Disturbance International Journal of Control Science and Engineering 2018, 8(2): 31-35 DOI: 10.5923/j.control.20180802.01 Adaptive Predictive Observer Design for Class of Saeed Kashefi *, Majid Hajatipor Faculty of

More information

Adaptive Robust Tracking Control of Robot Manipulators in the Task-space under Uncertainties

Adaptive Robust Tracking Control of Robot Manipulators in the Task-space under Uncertainties Australian Journal of Basic and Applied Sciences, 3(1): 308-322, 2009 ISSN 1991-8178 Adaptive Robust Tracking Control of Robot Manipulators in the Task-space under Uncertainties M.R.Soltanpour, M.M.Fateh

More information

Neural Network-Based Adaptive Control of Robotic Manipulator: Application to a Three Links Cylindrical Robot

Neural Network-Based Adaptive Control of Robotic Manipulator: Application to a Three Links Cylindrical Robot Vol.3 No., 27 مجلد 3 العدد 27 Neural Network-Based Adaptive Control of Robotic Manipulator: Application to a Three Links Cylindrical Robot Abdul-Basset A. AL-Hussein Electrical Engineering Department Basrah

More information

Dissipative Systems Analysis and Control

Dissipative Systems Analysis and Control Bernard Brogliato, Rogelio Lozano, Bernhard Maschke and Olav Egeland Dissipative Systems Analysis and Control Theory and Applications 2nd Edition With 94 Figures 4y Sprin er 1 Introduction 1 1.1 Example

More information

Analytical Mechanics. of Space Systems. tfa AA. Hanspeter Schaub. College Station, Texas. University of Colorado Boulder, Colorado.

Analytical Mechanics. of Space Systems. tfa AA. Hanspeter Schaub. College Station, Texas. University of Colorado Boulder, Colorado. Analytical Mechanics of Space Systems Third Edition Hanspeter Schaub University of Colorado Boulder, Colorado John L. Junkins Texas A&M University College Station, Texas AIM EDUCATION SERIES Joseph A.

More information

Robust Control of Cooperative Underactuated Manipulators

Robust Control of Cooperative Underactuated Manipulators Robust Control of Cooperative Underactuated Manipulators Marcel Bergerman * Yangsheng Xu +,** Yun-Hui Liu ** * Automation Institute Informatics Technology Center Campinas SP Brazil + The Robotics Institute

More information

A Sliding Mode Control based on Nonlinear Disturbance Observer for the Mobile Manipulator

A Sliding Mode Control based on Nonlinear Disturbance Observer for the Mobile Manipulator International Core Journal of Engineering Vol.3 No.6 7 ISSN: 44-895 A Sliding Mode Control based on Nonlinear Disturbance Observer for the Mobile Manipulator Yanna Si Information Engineering College Henan

More information

GAIN SCHEDULING CONTROL WITH MULTI-LOOP PID FOR 2- DOF ARM ROBOT TRAJECTORY CONTROL

GAIN SCHEDULING CONTROL WITH MULTI-LOOP PID FOR 2- DOF ARM ROBOT TRAJECTORY CONTROL GAIN SCHEDULING CONTROL WITH MULTI-LOOP PID FOR 2- DOF ARM ROBOT TRAJECTORY CONTROL 1 KHALED M. HELAL, 2 MOSTAFA R.A. ATIA, 3 MOHAMED I. ABU EL-SEBAH 1, 2 Mechanical Engineering Department ARAB ACADEMY

More information

Real-time Motion Control of a Nonholonomic Mobile Robot with Unknown Dynamics

Real-time Motion Control of a Nonholonomic Mobile Robot with Unknown Dynamics Real-time Motion Control of a Nonholonomic Mobile Robot with Unknown Dynamics TIEMIN HU and SIMON X. YANG ARIS (Advanced Robotics & Intelligent Systems) Lab School of Engineering, University of Guelph

More information

Multilayer Neural Networks

Multilayer Neural Networks Multilayer Neural Networks Multilayer Neural Networks Discriminant function flexibility NON-Linear But with sets of linear parameters at each layer Provably general function approximators for sufficient

More information

CONTROL OF ROBOT CAMERA SYSTEM WITH ACTUATOR S DYNAMICS TO TRACK MOVING OBJECT

CONTROL OF ROBOT CAMERA SYSTEM WITH ACTUATOR S DYNAMICS TO TRACK MOVING OBJECT Journal of Computer Science and Cybernetics, V.31, N.3 (2015), 255 265 DOI: 10.15625/1813-9663/31/3/6127 CONTROL OF ROBOT CAMERA SYSTEM WITH ACTUATOR S DYNAMICS TO TRACK MOVING OBJECT NGUYEN TIEN KIEM

More information

Passivity-based Control of Euler-Lagrange Systems

Passivity-based Control of Euler-Lagrange Systems Romeo Ortega, Antonio Loria, Per Johan Nicklasson and Hebertt Sira-Ramfrez Passivity-based Control of Euler-Lagrange Systems Mechanical, Electrical and Electromechanical Applications Springer Contents

More information

Identification of Nonlinear Systems Using Neural Networks and Polynomial Models

Identification of Nonlinear Systems Using Neural Networks and Polynomial Models A.Janczak Identification of Nonlinear Systems Using Neural Networks and Polynomial Models A Block-Oriented Approach With 79 Figures and 22 Tables Springer Contents Symbols and notation XI 1 Introduction

More information

Introduction to Natural Computation. Lecture 9. Multilayer Perceptrons and Backpropagation. Peter Lewis

Introduction to Natural Computation. Lecture 9. Multilayer Perceptrons and Backpropagation. Peter Lewis Introduction to Natural Computation Lecture 9 Multilayer Perceptrons and Backpropagation Peter Lewis 1 / 25 Overview of the Lecture Why multilayer perceptrons? Some applications of multilayer perceptrons.

More information

I. MAIN NOTATION LIST

I. MAIN NOTATION LIST IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 19, NO. 5, MAY 2008 817 Robust Neural Network Tracking Controller Using Simultaneous Perturbation Stochastic Approximation Qing Song, Member, IEEE, James C. Spall,

More information

Adaptive Control Tutorial

Adaptive Control Tutorial Adaptive Control Tutorial Petros loannou University of Southern California Los Angeles, California Baris Fidan National ICT Australia & Australian National University Canberra, Australian Capital Territory,

More information

BACKPROPAGATION. Neural network training optimization problem. Deriving backpropagation

BACKPROPAGATION. Neural network training optimization problem. Deriving backpropagation BACKPROPAGATION Neural network training optimization problem min J(w) w The application of gradient descent to this problem is called backpropagation. Backpropagation is gradient descent applied to J(w)

More information

Lab 5: 16 th April Exercises on Neural Networks

Lab 5: 16 th April Exercises on Neural Networks Lab 5: 16 th April 01 Exercises on Neural Networks 1. What are the values of weights w 0, w 1, and w for the perceptron whose decision surface is illustrated in the figure? Assume the surface crosses the

More information

Gain Scheduling Control with Multi-loop PID for 2-DOF Arm Robot Trajectory Control

Gain Scheduling Control with Multi-loop PID for 2-DOF Arm Robot Trajectory Control Gain Scheduling Control with Multi-loop PID for 2-DOF Arm Robot Trajectory Control Khaled M. Helal, 2 Mostafa R.A. Atia, 3 Mohamed I. Abu El-Sebah, 2 Mechanical Engineering Department ARAB ACADEMY FOR

More information

Multilayer Neural Networks

Multilayer Neural Networks Multilayer Neural Networks Introduction Goal: Classify objects by learning nonlinearity There are many problems for which linear discriminants are insufficient for minimum error In previous methods, the

More information

100 inference steps doesn't seem like enough. Many neuron-like threshold switching units. Many weighted interconnections among units

100 inference steps doesn't seem like enough. Many neuron-like threshold switching units. Many weighted interconnections among units Connectionist Models Consider humans: Neuron switching time ~ :001 second Number of neurons ~ 10 10 Connections per neuron ~ 10 4 5 Scene recognition time ~ :1 second 100 inference steps doesn't seem like

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface

More information

ADAPTIVE NEURAL NETWORK CONTROL OF MECHATRONICS OBJECTS

ADAPTIVE NEURAL NETWORK CONTROL OF MECHATRONICS OBJECTS acta mechanica et automatica, vol.2 no.4 (28) ADAPIE NEURAL NEWORK CONROL OF MECHARONICS OBJECS Egor NEMSE *, Yuri ZHUKO * * Baltic State echnical University oenmeh, 985, St. Petersburg, Krasnoarmeyskaya,

More information

Exponential Controller for Robot Manipulators

Exponential Controller for Robot Manipulators Exponential Controller for Robot Manipulators Fernando Reyes Benemérita Universidad Autónoma de Puebla Grupo de Robótica de la Facultad de Ciencias de la Electrónica Apartado Postal 542, Puebla 7200, México

More information

Lyapunov Design for Controls

Lyapunov Design for Controls F.L. Lewis, NAI Moncrief-O Donnell Chair, UTA Research Institute (UTARI) The University of Texas at Arlington, USA and Foreign Professor, Chongqing University, China Supported by : China Qian Ren Program,

More information

On-line Learning of Robot Arm Impedance Using Neural Networks

On-line Learning of Robot Arm Impedance Using Neural Networks On-line Learning of Robot Arm Impedance Using Neural Networks Yoshiyuki Tanaka Graduate School of Engineering, Hiroshima University, Higashi-hiroshima, 739-857, JAPAN Email: ytanaka@bsys.hiroshima-u.ac.jp

More information

How to do backpropagation in a brain

How to do backpropagation in a brain How to do backpropagation in a brain Geoffrey Hinton Canadian Institute for Advanced Research & University of Toronto & Google Inc. Prelude I will start with three slides explaining a popular type of deep

More information

Robot Manipulator Control. Hesheng Wang Dept. of Automation

Robot Manipulator Control. Hesheng Wang Dept. of Automation Robot Manipulator Control Hesheng Wang Dept. of Automation Introduction Industrial robots work based on the teaching/playback scheme Operators teach the task procedure to a robot he robot plays back eecute

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks Threshold units Gradient descent Multilayer networks Backpropagation Hidden layer representations Example: Face Recognition Advanced topics 1 Connectionist Models Consider humans:

More information

A Physically-Based Fault Detection and Isolation Method and Its Uses in Robot Manipulators

A Physically-Based Fault Detection and Isolation Method and Its Uses in Robot Manipulators des FA 4.13 Steuerung und Regelung von Robotern A Physically-Based Fault Detection and Isolation Method and Its Uses in Robot Manipulators Alessandro De Luca Dipartimento di Informatica e Sistemistica

More information

OVER THE past 20 years, the control of mobile robots has

OVER THE past 20 years, the control of mobile robots has IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 18, NO. 5, SEPTEMBER 2010 1199 A Simple Adaptive Control Approach for Trajectory Tracking of Electrically Driven Nonholonomic Mobile Robots Bong Seok

More information

Neural Networks Lecturer: J. Matas Authors: J. Matas, B. Flach, O. Drbohlav

Neural Networks Lecturer: J. Matas Authors: J. Matas, B. Flach, O. Drbohlav Neural Networks 30.11.2015 Lecturer: J. Matas Authors: J. Matas, B. Flach, O. Drbohlav 1 Talk Outline Perceptron Combining neurons to a network Neural network, processing input to an output Learning Cost

More information

ADAPTIVE FORCE AND MOTION CONTROL OF ROBOT MANIPULATORS IN CONSTRAINED MOTION WITH DISTURBANCES

ADAPTIVE FORCE AND MOTION CONTROL OF ROBOT MANIPULATORS IN CONSTRAINED MOTION WITH DISTURBANCES ADAPTIVE FORCE AND MOTION CONTROL OF ROBOT MANIPULATORS IN CONSTRAINED MOTION WITH DISTURBANCES By YUNG-SHENG CHANG A THESIS PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT

More information

Nonlinear PD Controllers with Gravity Compensation for Robot Manipulators

Nonlinear PD Controllers with Gravity Compensation for Robot Manipulators BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 4, No Sofia 04 Print ISSN: 3-970; Online ISSN: 34-408 DOI: 0.478/cait-04-00 Nonlinear PD Controllers with Gravity Compensation

More information

Nonlinear Adaptive Robust Control. Theory and Applications to the Integrated Design of Intelligent and Precision Mechatronic Systems.

Nonlinear Adaptive Robust Control. Theory and Applications to the Integrated Design of Intelligent and Precision Mechatronic Systems. A Short Course on Nonlinear Adaptive Robust Control Theory and Applications to the Integrated Design of Intelligent and Precision Mechatronic Systems Bin Yao Intelligent and Precision Control Laboratory

More information

Applied Nonlinear Control

Applied Nonlinear Control Applied Nonlinear Control JEAN-JACQUES E. SLOTINE Massachusetts Institute of Technology WEIPING LI Massachusetts Institute of Technology Pearson Education Prentice Hall International Inc. Upper Saddle

More information

RBF Neural Network Adaptive Control for Space Robots without Speed Feedback Signal

RBF Neural Network Adaptive Control for Space Robots without Speed Feedback Signal Trans. Japan Soc. Aero. Space Sci. Vol. 56, No. 6, pp. 37 3, 3 RBF Neural Network Adaptive Control for Space Robots without Speed Feedback Signal By Wenhui ZHANG, Xiaoping YE and Xiaoming JI Institute

More information

COMPLIANT CONTROL FOR PHYSICAL HUMAN-ROBOT INTERACTION

COMPLIANT CONTROL FOR PHYSICAL HUMAN-ROBOT INTERACTION COMPLIANT CONTROL FOR PHYSICAL HUMAN-ROBOT INTERACTION Andrea Calanca Paolo Fiorini Invited Speakers Nevio Luigi Tagliamonte Fabrizio Sergi 18/07/2014 Andrea Calanca - Altair Lab 2 In this tutorial Review

More information

3.4 Linear Least-Squares Filter

3.4 Linear Least-Squares Filter X(n) = [x(1), x(2),..., x(n)] T 1 3.4 Linear Least-Squares Filter Two characteristics of linear least-squares filter: 1. The filter is built around a single linear neuron. 2. The cost function is the sum

More information

Plan. Perceptron Linear discriminant. Associative memories Hopfield networks Chaotic networks. Multilayer perceptron Backpropagation

Plan. Perceptron Linear discriminant. Associative memories Hopfield networks Chaotic networks. Multilayer perceptron Backpropagation Neural Networks Plan Perceptron Linear discriminant Associative memories Hopfield networks Chaotic networks Multilayer perceptron Backpropagation Perceptron Historically, the first neural net Inspired

More information

Video 8.1 Vijay Kumar. Property of University of Pennsylvania, Vijay Kumar

Video 8.1 Vijay Kumar. Property of University of Pennsylvania, Vijay Kumar Video 8.1 Vijay Kumar 1 Definitions State State equations Equilibrium 2 Stability Stable Unstable Neutrally (Critically) Stable 3 Stability Translate the origin to x e x(t) =0 is stable (Lyapunov stable)

More information

Trajectory Tracking Control of a Very Flexible Robot Using a Feedback Linearization Controller and a Nonlinear Observer

Trajectory Tracking Control of a Very Flexible Robot Using a Feedback Linearization Controller and a Nonlinear Observer Trajectory Tracking Control of a Very Flexible Robot Using a Feedback Linearization Controller and a Nonlinear Observer Fatemeh Ansarieshlaghi and Peter Eberhard Institute of Engineering and Computational

More information

Neural Networks, Computation Graphs. CMSC 470 Marine Carpuat

Neural Networks, Computation Graphs. CMSC 470 Marine Carpuat Neural Networks, Computation Graphs CMSC 470 Marine Carpuat Binary Classification with a Multi-layer Perceptron φ A = 1 φ site = 1 φ located = 1 φ Maizuru = 1 φ, = 2 φ in = 1 φ Kyoto = 1 φ priest = 0 φ

More information

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs)

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs) Multilayer Neural Networks (sometimes called Multilayer Perceptrons or MLPs) Linear separability Hyperplane In 2D: w x + w 2 x 2 + w 0 = 0 Feature x 2 = w w 2 x w 0 w 2 Feature 2 A perceptron can separate

More information

Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011!

Artificial Neural Networks and Nonparametric Methods CMPSCI 383 Nov 17, 2011! Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011! 1 Todayʼs lecture" How the brain works (!)! Artificial neural networks! Perceptrons! Multilayer feed-forward networks! Error

More information

Neural Networks. Nicholas Ruozzi University of Texas at Dallas

Neural Networks. Nicholas Ruozzi University of Texas at Dallas Neural Networks Nicholas Ruozzi University of Texas at Dallas Handwritten Digit Recognition Given a collection of handwritten digits and their corresponding labels, we d like to be able to correctly classify

More information

Artificial Neural Networks. Edward Gatt

Artificial Neural Networks. Edward Gatt Artificial Neural Networks Edward Gatt What are Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning Very

More information

A Sliding Mode Controller Using Neural Networks for Robot Manipulator

A Sliding Mode Controller Using Neural Networks for Robot Manipulator ESANN'4 proceedings - European Symposium on Artificial Neural Networks Bruges (Belgium), 8-3 April 4, d-side publi., ISBN -9337-4-8, pp. 93-98 A Sliding Mode Controller Using Neural Networks for Robot

More information

Complex Valued Nonlinear Adaptive Filters

Complex Valued Nonlinear Adaptive Filters Complex Valued Nonlinear Adaptive Filters Noncircularity, Widely Linear and Neural Models Danilo P. Mandic Imperial College London, UK Vanessa Su Lee Goh Shell EP, Europe WILEY A John Wiley and Sons, Ltd,

More information

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs)

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs) Multilayer Neural Networks (sometimes called Multilayer Perceptrons or MLPs) Linear separability Hyperplane In 2D: w 1 x 1 + w 2 x 2 + w 0 = 0 Feature 1 x 2 = w 1 w 2 x 1 w 0 w 2 Feature 2 A perceptron

More information

RESEARCH SUMMARY ASHKAN JASOUR. February 2016

RESEARCH SUMMARY ASHKAN JASOUR. February 2016 RESEARCH SUMMARY ASHKAN JASOUR February 2016 My background is in systems control engineering and I am interested in optimization, control and analysis of dynamical systems, robotics, machine learning,

More information

NONLINEAR AND ADAPTIVE (INTELLIGENT) SYSTEMS MODELING, DESIGN, & CONTROL A Building Block Approach

NONLINEAR AND ADAPTIVE (INTELLIGENT) SYSTEMS MODELING, DESIGN, & CONTROL A Building Block Approach NONLINEAR AND ADAPTIVE (INTELLIGENT) SYSTEMS MODELING, DESIGN, & CONTROL A Building Block Approach P.A. (Rama) Ramamoorthy Electrical & Computer Engineering and Comp. Science Dept., M.L. 30, University

More information

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009 AN INTRODUCTION TO NEURAL NETWORKS Scott Kuindersma November 12, 2009 SUPERVISED LEARNING We are given some training data: We must learn a function If y is discrete, we call it classification If it is

More information

Virtual Passive Controller for Robot Systems Using Joint Torque Sensors

Virtual Passive Controller for Robot Systems Using Joint Torque Sensors NASA Technical Memorandum 110316 Virtual Passive Controller for Robot Systems Using Joint Torque Sensors Hal A. Aldridge and Jer-Nan Juang Langley Research Center, Hampton, Virginia January 1997 National

More information

Two-Link Flexible Manipulator Control Using Sliding Mode Control Based Linear Matrix Inequality

Two-Link Flexible Manipulator Control Using Sliding Mode Control Based Linear Matrix Inequality IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Two-Link Flexible Manipulator Control Using Sliding Mode Control Based Linear Matrix Inequality To cite this article: Zulfatman

More information

Rhythmic Robot Arm Control Using Oscillators

Rhythmic Robot Arm Control Using Oscillators Rhythmic Robot Arm Control Using Oscillators Matthew M. Williamson MIT AI Lab, 545 Technology Square, Cambridge, MA 2139 http://www.ai.mit.edu/people/matt Abstract This paper presents an approach to robot

More information

Multilayer Perceptron = FeedForward Neural Network

Multilayer Perceptron = FeedForward Neural Network Multilayer Perceptron = FeedForward Neural Networ History Definition Classification = feedforward operation Learning = bacpropagation = local optimization in the space of weights Pattern Classification

More information

Reservoir Computing and Echo State Networks

Reservoir Computing and Echo State Networks An Introduction to: Reservoir Computing and Echo State Networks Claudio Gallicchio gallicch@di.unipi.it Outline Focus: Supervised learning in domain of sequences Recurrent Neural networks for supervised

More information

VC-dimension of a context-dependent perceptron

VC-dimension of a context-dependent perceptron 1 VC-dimension of a context-dependent perceptron Piotr Ciskowski Institute of Engineering Cybernetics, Wroc law University of Technology, Wybrzeże Wyspiańskiego 27, 50 370 Wroc law, Poland cis@vectra.ita.pwr.wroc.pl

More information

Machine Learning and Data Mining. Multi-layer Perceptrons & Neural Networks: Basics. Prof. Alexander Ihler

Machine Learning and Data Mining. Multi-layer Perceptrons & Neural Networks: Basics. Prof. Alexander Ihler + Machine Learning and Data Mining Multi-layer Perceptrons & Neural Networks: Basics Prof. Alexander Ihler Linear Classifiers (Perceptrons) Linear Classifiers a linear classifier is a mapping which partitions

More information

Control of constrained spatial three-link flexible manipulators

Control of constrained spatial three-link flexible manipulators Control of constrained spatial three-link flexible manipulators Sinan Kilicaslan, M. Kemal Ozgoren and S. Kemal Ider Gazi University/Mechanical Engineering Department, Ankara, Turkey Middle East Technical

More information

Neural Network Sliding-Mode-PID Controller Design for Electrically Driven Robot Manipulators

Neural Network Sliding-Mode-PID Controller Design for Electrically Driven Robot Manipulators Neural Network Sliding-Mode-PID Controller Design for Electrically Driven Robot Manipulators S. E. Shafiei 1, M. R. Soltanpour 2 1. Department of Electrical and Robotic Engineering, Shahrood University

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE 4: Linear Systems Summary # 3: Introduction to artificial neural networks DISTRIBUTED REPRESENTATION An ANN consists of simple processing units communicating with each other. The basic elements of

More information

Introduction to Artificial Neural Networks

Introduction to Artificial Neural Networks Facultés Universitaires Notre-Dame de la Paix 27 March 2007 Outline 1 Introduction 2 Fundamentals Biological neuron Artificial neuron Artificial Neural Network Outline 3 Single-layer ANN Perceptron Adaline

More information

Alexander Scheinker Miroslav Krstić. Model-Free Stabilization by Extremum Seeking

Alexander Scheinker Miroslav Krstić. Model-Free Stabilization by Extremum Seeking Alexander Scheinker Miroslav Krstić Model-Free Stabilization by Extremum Seeking 123 Preface Originating in 1922, in its 95-year history, extremum seeking has served as a tool for model-free real-time

More information

Neural networks. Chapter 19, Sections 1 5 1

Neural networks. Chapter 19, Sections 1 5 1 Neural networks Chapter 19, Sections 1 5 Chapter 19, Sections 1 5 1 Outline Brains Neural networks Perceptrons Multilayer perceptrons Applications of neural networks Chapter 19, Sections 1 5 2 Brains 10

More information

Artificial Neural Networks Examination, June 2004

Artificial Neural Networks Examination, June 2004 Artificial Neural Networks Examination, June 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum

More information

Adaptive Control of Variable-Speed Variable-Pitch Wind Turbines Using RBF Neural Network

Adaptive Control of Variable-Speed Variable-Pitch Wind Turbines Using RBF Neural Network Schulich School of Engineering Department of Mechanical and Manufacturing Engineering Adaptive Control of Variable-Speed Variable-Pitch Wind Turbines Using RBF Neural Network By: Hamidreza Jafarnejadsani,

More information

Nonlinear Identification of Backlash in Robot Transmissions

Nonlinear Identification of Backlash in Robot Transmissions Nonlinear Identification of Backlash in Robot Transmissions G. Hovland, S. Hanssen, S. Moberg, T. Brogårdh, S. Gunnarsson, M. Isaksson ABB Corporate Research, Control Systems Group, Switzerland ABB Automation

More information

Neural networks: Unsupervised learning

Neural networks: Unsupervised learning Neural networks: Unsupervised learning 1 Previously The supervised learning paradigm: given example inputs x and target outputs t learning the mapping between them the trained network is supposed to give

More information

Design and Control of Compliant Humanoids. Alin Albu-Schäffer. DLR German Aerospace Center Institute of Robotics and Mechatronics

Design and Control of Compliant Humanoids. Alin Albu-Schäffer. DLR German Aerospace Center Institute of Robotics and Mechatronics Design and Control of Compliant Humanoids Alin Albu-Schäffer DLR German Aerospace Center Institute of Robotics and Mechatronics Torque Controlled Light-weight Robots Torque sensing in each joint Mature

More information

Identification of two-mass system parameters using neural networks

Identification of two-mass system parameters using neural networks 3ème conférence Internationale des énergies renouvelables CIER-2015 Proceedings of Engineering and Technology - PET Identification of two-mass system parameters using neural networks GHOZZI Dorsaf 1,NOURI

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning

More information

Artifical Neural Networks

Artifical Neural Networks Neural Networks Artifical Neural Networks Neural Networks Biological Neural Networks.................................. Artificial Neural Networks................................... 3 ANN Structure...........................................

More information

Hover Control for Helicopter Using Neural Network-Based Model Reference Adaptive Controller

Hover Control for Helicopter Using Neural Network-Based Model Reference Adaptive Controller Vol.13 No.1, 217 مجلد 13 العدد 217 1 Hover Control for Helicopter Using Neural Network-Based Model Reference Adaptive Controller Abdul-Basset A. Al-Hussein Electrical Engineering Department Basrah University

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Jeff Clune Assistant Professor Evolving Artificial Intelligence Laboratory Announcements Be making progress on your projects! Three Types of Learning Unsupervised Supervised Reinforcement

More information

Position with Force Feedback Control of Manipulator Arm

Position with Force Feedback Control of Manipulator Arm Position with Force Feedback Control of Manipulator Arm 1 B. K. Chitra, 2 J. Nandha Gopal, 3 Dr. K. Rajeswari PG Student, Department of EIE Assistant Professor, Professor, Department of EEE Abstract This

More information

F.L. Lewis, NAI. Talk available online at Supported by : NSF AFOSR Europe ONR Marc Steinberg US TARDEC

F.L. Lewis, NAI. Talk available online at  Supported by : NSF AFOSR Europe ONR Marc Steinberg US TARDEC F.L. Lewis, NAI Moncrief-O Donnell Chair, UTA Research Institute (UTARI) The University of Texas at Arlington, USA and Qian Ren Consulting Professor, State Key Laboratory of Synthetical Automation for

More information

Lecture 4: Perceptrons and Multilayer Perceptrons

Lecture 4: Perceptrons and Multilayer Perceptrons Lecture 4: Perceptrons and Multilayer Perceptrons Cognitive Systems II - Machine Learning SS 2005 Part I: Basic Approaches of Concept Learning Perceptrons, Artificial Neuronal Networks Lecture 4: Perceptrons

More information

Case Study: The Pelican Prototype Robot

Case Study: The Pelican Prototype Robot 5 Case Study: The Pelican Prototype Robot The purpose of this chapter is twofold: first, to present in detail the model of the experimental robot arm of the Robotics lab. from the CICESE Research Center,

More information

General procedure for formulation of robot dynamics STEP 1 STEP 3. Module 9 : Robot Dynamics & controls

General procedure for formulation of robot dynamics STEP 1 STEP 3. Module 9 : Robot Dynamics & controls Module 9 : Robot Dynamics & controls Lecture 32 : General procedure for dynamics equation forming and introduction to control Objectives In this course you will learn the following Lagrangian Formulation

More information

Neural Networks biological neuron artificial neuron 1

Neural Networks biological neuron artificial neuron 1 Neural Networks biological neuron artificial neuron 1 A two-layer neural network Output layer (activation represents classification) Weighted connections Hidden layer ( internal representation ) Input

More information

WE PROPOSE a new approach to robust control of robot

WE PROPOSE a new approach to robust control of robot IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 14, NO. 1, FEBRUARY 1998 69 An Optimal Control Approach to Robust Control of Robot Manipulators Feng Lin and Robert D. Brandt Abstract We present a new

More information

Feedback Control of Dynamic Bipedal Robot Locomotion

Feedback Control of Dynamic Bipedal Robot Locomotion Feedback Control of Dynamic Bipedal Robot Locomotion Eric R. Westervelt Jessy W. Grizzle Christine Chevaiiereau Jun Ho Choi Benjamin Morris CRC Press Taylor & Francis Croup Boca Raton London New York CRC

More information

State and Parameter Estimation Based on Filtered Transformation for a Class of Second-Order Systems

State and Parameter Estimation Based on Filtered Transformation for a Class of Second-Order Systems State and Parameter Estimation Based on Filtered Transformation for a Class of Second-Order Systems Mehdi Tavan, Kamel Sabahi, and Saeid Hoseinzadeh Abstract This paper addresses the problem of state and

More information

COMP-4360 Machine Learning Neural Networks

COMP-4360 Machine Learning Neural Networks COMP-4360 Machine Learning Neural Networks Jacky Baltes Autonomous Agents Lab University of Manitoba Winnipeg, Canada R3T 2N2 Email: jacky@cs.umanitoba.ca WWW: http://www.cs.umanitoba.ca/~jacky http://aalab.cs.umanitoba.ca

More information

Control of Mobile Robots

Control of Mobile Robots Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning Neural Networks Varun Chandola x x 5 Input Outline Contents February 2, 207 Extending Perceptrons 2 Multi Layered Perceptrons 2 2. Generalizing to Multiple Labels.................

More information

Tutorial on Tangent Propagation

Tutorial on Tangent Propagation Tutorial on Tangent Propagation Yichuan Tang Centre for Theoretical Neuroscience February 5, 2009 1 Introduction Tangent Propagation is the name of a learning technique of an artificial neural network

More information

Security Analytics. Topic 6: Perceptron and Support Vector Machine

Security Analytics. Topic 6: Perceptron and Support Vector Machine Security Analytics Topic 6: Perceptron and Support Vector Machine Purdue University Prof. Ninghui Li Based on slides by Prof. Jenifer Neville and Chris Clifton Readings Principle of Data Mining Chapter

More information

A graph contains a set of nodes (vertices) connected by links (edges or arcs)

A graph contains a set of nodes (vertices) connected by links (edges or arcs) BOLTZMANN MACHINES Generative Models Graphical Models A graph contains a set of nodes (vertices) connected by links (edges or arcs) In a probabilistic graphical model, each node represents a random variable,

More information

EML5311 Lyapunov Stability & Robust Control Design

EML5311 Lyapunov Stability & Robust Control Design EML5311 Lyapunov Stability & Robust Control Design 1 Lyapunov Stability criterion In Robust control design of nonlinear uncertain systems, stability theory plays an important role in engineering systems.

More information

Christian Mohr

Christian Mohr Christian Mohr 20.12.2011 Recurrent Networks Networks in which units may have connections to units in the same or preceding layers Also connections to the unit itself possible Already covered: Hopfield

More information

Revision: Neural Network

Revision: Neural Network Revision: Neural Network Exercise 1 Tell whether each of the following statements is true or false by checking the appropriate box. Statement True False a) A perceptron is guaranteed to perfectly learn

More information

Machine Learning

Machine Learning Machine Learning 10-315 Maria Florina Balcan Machine Learning Department Carnegie Mellon University 03/29/2019 Today: Artificial neural networks Backpropagation Reading: Mitchell: Chapter 4 Bishop: Chapter

More information

Robust Classification using Boltzmann machines by Vasileios Vasilakakis

Robust Classification using Boltzmann machines by Vasileios Vasilakakis Robust Classification using Boltzmann machines by Vasileios Vasilakakis The scope of this report is to propose an architecture of Boltzmann machines that could be used in the context of classification,

More information

6.036 midterm review. Wednesday, March 18, 15

6.036 midterm review. Wednesday, March 18, 15 6.036 midterm review 1 Topics covered supervised learning labels available unsupervised learning no labels available semi-supervised learning some labels available - what algorithms have you learned that

More information

SGN (4 cr) Chapter 5

SGN (4 cr) Chapter 5 SGN-41006 (4 cr) Chapter 5 Linear Discriminant Analysis Jussi Tohka & Jari Niemi Department of Signal Processing Tampere University of Technology January 21, 2014 J. Tohka & J. Niemi (TUT-SGN) SGN-41006

More information

Enhancing a Model-Free Adaptive Controller through Evolutionary Computation

Enhancing a Model-Free Adaptive Controller through Evolutionary Computation Enhancing a Model-Free Adaptive Controller through Evolutionary Computation Anthony Clark, Philip McKinley, and Xiaobo Tan Michigan State University, East Lansing, USA Aquatic Robots Practical uses autonomous

More information