Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xx-xx PHASE OSCILLATOR NETWORK WITH PIECEWISE-LINEAR DYNAMICS

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xx-xx PHASE OSCILLATOR NETWORK WITH PIECEWISE-LINEAR DYNAMICS"

Transcription

1 Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xx-xx PHASE OSCILLATOR NETWORK WITH PIECEWISE-LINEAR DYNAMICS WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY Department of Mathematics and Computer Science, Rhode Island College, Providence, Rhode Island 02908, USA. Department of Mathematics and Computer Science, Rhode Island College, Providence, Rhode Island 02908, USA. Neuroscience Program, Brandeis University, Waltham, Massachusetts 02454, USA. ABSTRACT. We consider a Filippov system formed from N coupled phase oscillators similar to the Kuramoto model but using a periodic sawtooth in place of the sine wave. A Hebbian rule based interaction provides for a phase oscillator associative memory network where the memorized patterns are stored as phase-locked limit-cycle attractors. AMS (MOS) Subject Classification. 37N INTRODUCTION The Kuramoto model of coupled oscillators [5] was motivated by the phenomenon of collective synchronization in some networks with a large number of oscillators [11]. Here the frequencies of the oscillations can become locked to a common frequency despite the variations in the natural frequencies of the individual oscillators [8]. Generalizations of the model can be used to form phase oscillator associative memory networks, where the memorized patterns are stored as limit-cycles, although there are problems with the stability of the limit-cycle memories that must be overcome with the addition of higher-order terms [6]. The Kuramoto model describes the dynamics of a system of N phase oscillators θ i with natural frequencies ω i. The time evolution of the i-th oscillator is given by (1.1) θi = ω i + k ij sin(θ j θ i ), i = 1,..., N, where k jk are parameters representing the coupling strengths from the j-th to the i-th oscillators. The sine function was chosen because it would be the first-order term in the Fourier expansion of more general interactions. To visualize the phases, it is helpful to think of the oscillators as points on a unit circle moving with different angular velocities. In the case of synchronization, the points on the circle move around with constant phase differences. We approximate the sine wave interaction of the Kuramoto model by a periodic piecewiselinear (but discontinuous) sawtooth, which is interesting in its own right, and is more appropriate for some applications such as wireless sensor network synchronization [10]. We investigate the finite-n case with a symmetric (self-adjoint) N N connection matrix, as occurs in some phase-oscillator network models of neurocomputers utilizing phase-lock loops [3], and optical laser oscillator technologies [4], or any neural network that learns by a Received May 30, c Dynamic Publishers, Inc.

2 2 WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY Hebbian rule. We will find that associative memories can be encoded by stable phase-locked limit cycles. 2. MODEL DESCRIPTION We propose a simplified model where the nonlinear sine function is replaced by a periodic piecewise-linear sawtooth-like function. Our finite-n phase oscillators are modeled as (2.1) θi = ω i + k ij saw(θ j θ i ), i = 1,..., N, where x + π (2.2) saw(x) = x π π x π is defined using the floor and ceiling functions. Here ω i and k ij are the natural frequency and the coupling strength, respectively, for the oscillator θ i. Saw is a discontinuous function, and this is a Filippov dynamical system [2]. The function saw(x) = x is the first-order term in the Taylor expansion of sin(x) on ( π, π), extended -periodically so that saw(x) = x j when j π < x < j +π, j Z, and saw((2j ± 1)π) = 0, j Z. Our definition results in saw being an odd function and the average of its right-side and left-side limits at points of discontinuity. Hence, by Dirichlet s theorem, its Fourier sine series converges point-wise to saw for all x R [9], and we can also write (2.3) saw(x) = 2 (sin(x) 12 sin(2x) + 13 sin(3x) 14 ) sin(4x) As mentioned before, we will consider each phase component ω i S 1, and thus (2.1) as a dynamical system on the N-dimensional torus T N. The terms sin(θ j θ i ) and saw(θ j θ i ) are both positive whenever the oscillator θ j is slightly ahead of the oscillator θ i, so that the term saw(θ j θ i ) contributes to the acceleration of the oscillator θ i. Similarly, they are both negative when θ j is slightly behind θ i, so that θ i slows down. The terms are both zero when the phases differ by exactly half a period, as if diametrically opposed oscillators are equally undecided whether to speed up or slow down, as was the case with Buridan s donkey. See Figure 1(a). However, the saw function is increasing on ( π, π) and so becomes increasingly larger in absolute value as the phase difference approaches either ±π. This implies that as the absolute phase difference between the oscillators θ j θ i becomes larger, saw(θ j θ i ) (or π 1 saw(θ j θ i ) to compare similar amplitudes) contributes more to the catching up or slowing down than either sin(θ j θ i ) or a smaller absolute phase difference would, encouraging coherence in comparison with the original Kuramoto dynamics. One could perhaps imagine runners on a circular track connected by elastic bands. 3. SYNCHRONIZATION It turns out that in the symmetric case k ij = k ji, i, j, for N oscillators, the space of phase-deviations is actually a gradient system (in a generalized sense) which can endow the system (2.1) with neurocomputational properties.

3 PHASE OSCILLATOR NETWORK 3 Figure 1. (a) COMPARING THE PIECEWISE-LINEAR SAWTOOTH AND π SINE WAVES. (b) THE GENERALIZED ANTIDERIVATIVE I(X) OF SAW(X) The Generalized Antiderivative of Saw. The Fourier expansion of saw can be integrated term-by-term to obtain an antiderivative I(x) for saw: ( ) (3.1) I(x) = π2 6 2 cos 2x cos 3x cos x See Figure 1(b). The function I(x) is -periodic, piecewise-smooth, and continuous, with (3.2) I(x) = 1 ( x + π ) 2 x for x (, ). 2 When x [ π, π], I(x) = x 2 /2. Now I (x) = saw(x), x R, with the derivative being taken in a generalized sense at the points {(2m + 1)π, m Z}. It is interesting to note that if we define a centered-derivative of a function f at a point x to be the limit of the centered-difference quotients: lim h 0 f(x + h) f(x h), 2h then saw(x) is the centered-derivative of I(x) for all x, including the points at which I is not differentiable in the classical sense. This can be made the basis of a simple multistep second-order numerical scheme The Phase Deviation Equations. We let (3.3) ω = 1 N be the mean natural frequency, and let (3.4) ψ i = θ i ωt, i = 1,..., N ω i

4 4 WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY be the phase deviations. Let (3.5) ν i = ω i ω be the natural frequency deviations. Note that i ν i = 0. The phase deviation equations become (3.6) ψ i = ν i + k ij saw(ψ j ψ i ), i = 1,..., N. Note that if (3.7) ψ = 1 N is the mean of the phase deviations, then (3.8) in the symmetric case. d ψ dt = A Potential For the Phase Deviation Equations. When the k ij s are symmetric, a (negative) potential for the phase deviation equations can be given by (3.9) U( ψ) = ν i ψ i 1 k ij I(ψ i ψ j ), 2 ψ i where ψ is the vector of phase deviations (ψ 1,..., ψ N ). equations (3.6) is just the gradient system (3.10) d ψ dt = U( ψ). The system of phase deviation Hence, the phase deviations ψ converge to an equilibrium ψ 0 on T N. Thus, the phases θ i = ωt + ψ i converge to a limit-cycle attractor having frequency ω and phase relations ψ Hebbian Learning Rule and Neurocomputational Properties. This can form the basis of a neurocomputer with oscillatory associative memory. When N is large, there could be many such phase-locked limit-cycle attractors corresponding to many memorized patterns which are encoded into (or decoded from) the symmetric connection matrix K = k ij using the spectral theorem. Each phase-locked limit-cycle corresponds to an equilibrium of the phase deviation equations. And each equilibrium of the phase deviations corresponds to an extremum of U which corresponds to an eigenvector of K when all ν i = 0. For example, if ξ 1,..., ξ n are n orthogonal unit column N-vectors to be learned (n < N) with real weights µ 1,..., µ n, let n (3.11) K = µ j ξ j ξj t. Then, K is symmetric with eigenvectors ξ j and eigenvalues µ j on the orthogonal complement of the nullspace of K. Moreover, n (3.12) Kξ m = µ j ξ j ξj t ξ m = µ m ξ m. This results in the system asymptotically approaching the associated component at the bottom of a basin of attraction in which the initial input was located.

5 PHASE OSCILLATOR NETWORK 5 4. DISCUSSION Using the sawtooth function to model the symmetric interaction between N coupled phase oscillators, we obtain a piecewise-smooth, piecewise-linear system which can be analyzed explicitly. The phase deviations from the mean phase evolve according to a (generalized) gradient system. Stable phase-locking occurs at minimums of the potential energy function. One would expect that speed of convergence would be more rapid with sawtooth interactions compared to sine waves. Presented with a pattern close to one of the stored patterns, in the case that the ν i 0, the phase system with the symmetric connection matrix K and zero diagonal implementing a Hebbian learning rule will recall (or discriminant) by phase-locking with the closest stored pattern of phase deviations. Similarly, presented with a mixture of the stored patterns, the phase system will tend to phase-lock (or abstract) with the pattern with the largest positive weight present in the mixture, just as in principal component analysis. The use of oscillatory memories is especially interesting to neurocomputing since phaselocking has been hypothesized [1] to be important in such things as in binding gestalts, multiplexing in the thalamus, and reaching consensus by winner-take-all in the cortex. Phase oscillator networks have also been used in modeling central pattern generators for locomotion [7]. Many questions regarding capacity, retrieval, effects of forcing, inputing faster oscillation rates, possible multiplexing, and practical applications remain to be investigated. REFERENCES [1] M.A. Arbib (Ed.), Handbook of Brain Theory and Neural Networks (2ed.), MIT Press, Cambridge, [2] M. dibernardo, C.J. Budd, A.R. Champneys and P. Kowalczyk, Piecewise-smooth Dynamical Systems: Theory and Applications, Springer-Verlag, London, [3] F. Hoppensteadt and E. Izhikevich, Pattern recognition via synchronization in phase-locked loop neural networks, IEEE Transaction on Neural Network, 1: , [4] F.C. Hoppensteadt and E.M. Izhikevich, Synchronization of laser oscillators, associative memory, and optical neurocomputing, Physical Review E, 62: , [5] Y. Kuramoto, Chemical Oscillations, Waves, and Turbulence, Springer-Verlag, New York, [6] T. Nishikawa, F.C. Hoppensteadt and Y.C. Lai, Oscillatory associative memory networks with perfect retrieval, Physica D, 197: , [7] R.H. Rand, A.H. Cohen and P.J. Holmes, Systems of coupled oscillators as models of central pattern generators, in: A. Cohen (Ed.), Neural Control of Rhythmic Movements in Vertebrates, Wiley, New York, [8] S.H. Strogatz, From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators, Physica D, 143:1 20, [9] G.P. Tolstov, Fourier Series, Dover Publications, New York, [10] G. Werner-Allen, G. Tewari, A. Patel, M. Welch and R. Nagpal, Firefly-inspired sensor network synchronicity with realistic radio effects, Proceedings of the 3rd International Conference on Embedded Networked Sensor Systems, , [11] A.T. Winfree, The Geometry of Biological Time, Springer, New York, 1980.

Phase Synchronization

Phase Synchronization Phase Synchronization Lecture by: Zhibin Guo Notes by: Xiang Fan May 10, 2016 1 Introduction For any mode or fluctuation, we always have where S(x, t) is phase. If a mode amplitude satisfies ϕ k = ϕ k

More information

Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis

Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis Mimila Prost O. Collado J. Automatic Control Department, CINVESTAV IPN, A.P. 4 74 Mexico, D.F. ( e mail:

More information

Synchronization and Phase Oscillators

Synchronization and Phase Oscillators 1 Synchronization and Phase Oscillators Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 Synchronization

More information

Canonical Neural Models 1

Canonical Neural Models 1 Canonical Neural Models 1 Frank Hoppensteadt 1 and Eugene zhikevich 2 ntroduction Mathematical modeling is a powerful tool in studying fundamental principles of information processing in the brain. Unfortunately,

More information

Chimera states in networks of biological neurons and coupled damped pendulums

Chimera states in networks of biological neurons and coupled damped pendulums in neural models in networks of pendulum-like elements in networks of biological neurons and coupled damped pendulums J. Hizanidis 1, V. Kanas 2, A. Bezerianos 3, and T. Bountis 4 1 National Center for

More information

Phase Oscillators. and at r, Hence, the limit cycle at r = r is stable if and only if Λ (r ) < 0.

Phase Oscillators. and at r, Hence, the limit cycle at r = r is stable if and only if Λ (r ) < 0. 1 Phase Oscillators Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 2 Phase Oscillators Oscillations

More information

arxiv: v1 [nlin.ao] 3 May 2015

arxiv: v1 [nlin.ao] 3 May 2015 UNI-DIRECTIONAL SYNCHRONIZATION AND FREQUENCY DIFFERENCE LOCKING INDUCED BY A HETEROCLINIC RATCHET arxiv:155.418v1 [nlin.ao] 3 May 215 Abstract A system of four coupled oscillators that exhibits unusual

More information

Survey of Synchronization Part I: Kuramoto Oscillators

Survey of Synchronization Part I: Kuramoto Oscillators Survey of Synchronization Part I: Kuramoto Oscillators Tatsuya Ibuki FL11-5-2 20 th, May, 2011 Outline of My Research in This Semester Survey of Synchronization - Kuramoto oscillator : This Seminar - Synchronization

More information

PHASE-LOCKED SOLUTIONS IN A HUB CONNECTED OSCILLATOR RING NETWORK

PHASE-LOCKED SOLUTIONS IN A HUB CONNECTED OSCILLATOR RING NETWORK Copyright c 29 by ABCM PHASE-LOCKED SOLUTIONS IN A HUB CONNECTED OSCILLATOR RING NETWORK Jacqueline Bridge, Jacqueline.Bridge@sta.uwi.edu Department of Mechanical Engineering, The University of the West

More information

University of Colorado. The Kuramoto Model. A presentation in partial satisfaction of the requirements for the degree of MSc in Applied Mathematics

University of Colorado. The Kuramoto Model. A presentation in partial satisfaction of the requirements for the degree of MSc in Applied Mathematics University of Colorado The Kuramoto Model A presentation in partial satisfaction of the requirements for the degree of MSc in Applied Mathematics Jeff Marsh 2008 April 24 1 The Kuramoto Model Motivation:

More information

Dynamics of four coupled phase-only oscillators

Dynamics of four coupled phase-only oscillators Communications in Nonlinear Science and Numerical Simulation 13 (2008) 501 507 www.elsevier.com/locate/cnsns Short communication Dynamics of four coupled phase-only oscillators Richard Rand *, Jeffrey

More information

7 Recurrent Networks of Threshold (Binary) Neurons: Basis for Associative Memory

7 Recurrent Networks of Threshold (Binary) Neurons: Basis for Associative Memory Physics 178/278 - David Kleinfeld - Winter 2019 7 Recurrent etworks of Threshold (Binary) eurons: Basis for Associative Memory 7.1 The network The basic challenge in associative networks, also referred

More information

Computation with phase oscillators: an oscillatory perceptron model

Computation with phase oscillators: an oscillatory perceptron model Computation with phase oscillators: an oscillatory perceptron model Pablo Kaluza Abteilung Physikalische Chemie, Fritz-Haber-Institut der Max-Planck-Gesellschaft, Faradayweg 4-6, 495 Berlin, Germany. Abstract

More information

Synchronization Transitions in Complex Networks

Synchronization Transitions in Complex Networks Synchronization Transitions in Complex Networks Y. Moreno 1,2,3 1 Institute for Biocomputation and Physics of Complex Systems (BIFI) University of Zaragoza, Zaragoza 50018, Spain 2 Department of Theoretical

More information

arxiv:nlin/ v1 [nlin.cd] 4 Oct 2005

arxiv:nlin/ v1 [nlin.cd] 4 Oct 2005 Synchronization of Coupled Chaotic Dynamics on Networks R. E. Amritkar and Sarika Jalan Physical Research Laboratory, Navrangpura, Ahmedabad 380 009, India. arxiv:nlin/0510008v1 [nlin.cd] 4 Oct 2005 Abstract

More information

Plasticity and learning in a network of coupled phase oscillators

Plasticity and learning in a network of coupled phase oscillators PHYSICAL REVIEW E, VOLUME 65, 041906 Plasticity and learning in a network of coupled phase oscillators Philip Seliger, Stephen C. Young, and Lev S. Tsimring Institute for onlinear Science, University of

More information

7 Rate-Based Recurrent Networks of Threshold Neurons: Basis for Associative Memory

7 Rate-Based Recurrent Networks of Threshold Neurons: Basis for Associative Memory Physics 178/278 - David Kleinfeld - Fall 2005; Revised for Winter 2017 7 Rate-Based Recurrent etworks of Threshold eurons: Basis for Associative Memory 7.1 A recurrent network with threshold elements The

More information

A Multivariate Time-Frequency Based Phase Synchrony Measure for Quantifying Functional Connectivity in the Brain

A Multivariate Time-Frequency Based Phase Synchrony Measure for Quantifying Functional Connectivity in the Brain A Multivariate Time-Frequency Based Phase Synchrony Measure for Quantifying Functional Connectivity in the Brain Dr. Ali Yener Mutlu Department of Electrical and Electronics Engineering, Izmir Katip Celebi

More information

898 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 17, NO. 6, DECEMBER X/01$ IEEE

898 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 17, NO. 6, DECEMBER X/01$ IEEE 898 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 17, NO. 6, DECEMBER 2001 Short Papers The Chaotic Mobile Robot Yoshihiko Nakamura and Akinori Sekiguchi Abstract In this paper, we develop a method

More information

A. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network.

A. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network. III. Recurrent Neural Networks A. The Hopfield Network 2/9/15 1 2/9/15 2 Typical Artificial Neuron Typical Artificial Neuron connection weights linear combination activation function inputs output net

More information

Fourier mode dynamics for NLS Synchronization in fiber lasers arrays

Fourier mode dynamics for NLS Synchronization in fiber lasers arrays Fourier mode dynamics for NLS Synchronization in fiber lasers arrays Nonlinear Schrodinger workshop Heraklio, May 21 2013 Jean-guy Caputo Laboratoire de Mathématiques INSA de Rouen, France A. Aceves, N.

More information

IN THIS turorial paper we exploit the relationship between

IN THIS turorial paper we exploit the relationship between 508 IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 3, MAY 1999 Weakly Pulse-Coupled Oscillators, FM Interactions, Synchronization, Oscillatory Associative Memory Eugene M. Izhikevich Abstract We study

More information

Applicable Analysis and Discrete Mathematics available online at FRUSTRATED KURAMOTO MODEL GENERALISE EQUITABLE PARTITIONS

Applicable Analysis and Discrete Mathematics available online at   FRUSTRATED KURAMOTO MODEL GENERALISE EQUITABLE PARTITIONS Applicable Analysis and Discrete Mathematics available online at http://pefmath.etf.rs Appl. Anal. Discrete Math. x (xxxx), xxx xxx. doi:10.98/aadmxxxxxxxx α-kuramoto PARTITIONS FROM THE FRUSTRATED KURAMOTO

More information

Time-Frequency Analysis

Time-Frequency Analysis Time-Frequency Analysis Basics of Fourier Series Philippe B. aval KSU Fall 015 Philippe B. aval (KSU) Fourier Series Fall 015 1 / 0 Introduction We first review how to derive the Fourier series of a function.

More information

Research Article Mathematical Model and Cluster Synchronization for a Complex Dynamical Network with Two Types of Chaotic Oscillators

Research Article Mathematical Model and Cluster Synchronization for a Complex Dynamical Network with Two Types of Chaotic Oscillators Applied Mathematics Volume 212, Article ID 936, 12 pages doi:1.11/212/936 Research Article Mathematical Model and Cluster Synchronization for a Complex Dynamical Network with Two Types of Chaotic Oscillators

More information

Effects of Interactive Function Forms in a Self-Organized Critical Model Based on Neural Networks

Effects of Interactive Function Forms in a Self-Organized Critical Model Based on Neural Networks Commun. Theor. Phys. (Beijing, China) 40 (2003) pp. 607 613 c International Academic Publishers Vol. 40, No. 5, November 15, 2003 Effects of Interactive Function Forms in a Self-Organized Critical Model

More information

A conjecture on sustained oscillations for a closed-loop heat equation

A conjecture on sustained oscillations for a closed-loop heat equation A conjecture on sustained oscillations for a closed-loop heat equation C.I. Byrnes, D.S. Gilliam Abstract The conjecture in this paper represents an initial step aimed toward understanding and shaping

More information

Synchronization in delaycoupled bipartite networks

Synchronization in delaycoupled bipartite networks Synchronization in delaycoupled bipartite networks Ram Ramaswamy School of Physical Sciences Jawaharlal Nehru University, New Delhi February 20, 2015 Outline Ø Bipartite networks and delay-coupled phase

More information

A. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network.

A. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network. Part 3A: Hopfield Network III. Recurrent Neural Networks A. The Hopfield Network 1 2 Typical Artificial Neuron Typical Artificial Neuron connection weights linear combination activation function inputs

More information

Dynamical modelling of systems of coupled oscillators

Dynamical modelling of systems of coupled oscillators Dynamical modelling of systems of coupled oscillators Mathematical Neuroscience Network Training Workshop Edinburgh Peter Ashwin University of Exeter 22nd March 2009 Peter Ashwin (University of Exeter)

More information

Saturation of Information Exchange in Locally Connected Pulse-Coupled Oscillators

Saturation of Information Exchange in Locally Connected Pulse-Coupled Oscillators Saturation of Information Exchange in Locally Connected Pulse-Coupled Oscillators Will Wagstaff School of Computer Science, Georgia Institute of Technology, Atlanta, Georgia 30332, USA (Dated: 13 December

More information

Dynamical systems in neuroscience. Pacific Northwest Computational Neuroscience Connection October 1-2, 2010

Dynamical systems in neuroscience. Pacific Northwest Computational Neuroscience Connection October 1-2, 2010 Dynamical systems in neuroscience Pacific Northwest Computational Neuroscience Connection October 1-2, 2010 What do I mean by a dynamical system? Set of state variables Law that governs evolution of state

More information

α-kuramoto partitions: graph partitions from the frustrated Kuramoto model generalise equitable partitions

α-kuramoto partitions: graph partitions from the frustrated Kuramoto model generalise equitable partitions α-kuramoto partitions: graph partitions from the frustrated Kuramoto model generalise equitable partitions Stephen Kirkland 1 and Simone Severini 1 Hamilton Institute, National University of Ireland Maynooth,

More information

A General Framework for Neurobiological Modeling: An Application to the Vestibular System 1

A General Framework for Neurobiological Modeling: An Application to the Vestibular System 1 A General Framework for Neurobiological Modeling: An Application to the Vestibular System 1 Chris Eliasmith, a M. B. Westover, b and C. H. Anderson c a Department of Philosophy, University of Waterloo,

More information

Nonlinear Autonomous Systems of Differential

Nonlinear Autonomous Systems of Differential Chapter 4 Nonlinear Autonomous Systems of Differential Equations 4.0 The Phase Plane: Linear Systems 4.0.1 Introduction Consider a system of the form x = A(x), (4.0.1) where A is independent of t. Such

More information

Nonlinear systems, chaos and control in Engineering

Nonlinear systems, chaos and control in Engineering Nonlinear systems, chaos and control in Engineering Module 1 block 3 One-dimensional nonlinear systems Cristina Masoller Cristina.masoller@upc.edu http://www.fisica.edu.uy/~cris/ Schedule Flows on the

More information

Examples of the Fourier Theorem (Sect. 10.3). The Fourier Theorem: Continuous case.

Examples of the Fourier Theorem (Sect. 10.3). The Fourier Theorem: Continuous case. s of the Fourier Theorem (Sect. 1.3. The Fourier Theorem: Continuous case. : Using the Fourier Theorem. The Fourier Theorem: Piecewise continuous case. : Using the Fourier Theorem. The Fourier Theorem:

More information

Kasetsart University Workshop. Multigrid methods: An introduction

Kasetsart University Workshop. Multigrid methods: An introduction Kasetsart University Workshop Multigrid methods: An introduction Dr. Anand Pardhanani Mathematics Department Earlham College Richmond, Indiana USA pardhan@earlham.edu A copy of these slides is available

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning

More information

Hopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5

Hopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5 Hopfield Neural Network and Associative Memory Typical Myelinated Vertebrate Motoneuron (Wikipedia) PHY 411-506 Computational Physics 2 1 Wednesday, March 5 1906 Nobel Prize in Physiology or Medicine.

More information

Introduction - Motivation. Many phenomena (physical, chemical, biological, etc.) are model by differential equations. f f(x + h) f(x) (x) = lim

Introduction - Motivation. Many phenomena (physical, chemical, biological, etc.) are model by differential equations. f f(x + h) f(x) (x) = lim Introduction - Motivation Many phenomena (physical, chemical, biological, etc.) are model by differential equations. Recall the definition of the derivative of f(x) f f(x + h) f(x) (x) = lim. h 0 h Its

More information

Dynamical Systems and Chaos Part II: Biology Applications. Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325

Dynamical Systems and Chaos Part II: Biology Applications. Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325 Dynamical Systems and Chaos Part II: Biology Applications Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325 Foreword In order to model populations of physical/biological

More information

Symmetries 2 - Rotations in Space

Symmetries 2 - Rotations in Space Symmetries 2 - Rotations in Space This symmetry is about the isotropy of space, i.e. space is the same in all orientations. Thus, if we continuously rotated an entire system in space, we expect the system

More information

Robot Control Basics CS 685

Robot Control Basics CS 685 Robot Control Basics CS 685 Control basics Use some concepts from control theory to understand and learn how to control robots Control Theory general field studies control and understanding of behavior

More information

Boundary. DIFFERENTIAL EQUATIONS with Fourier Series and. Value Problems APPLIED PARTIAL. Fifth Edition. Richard Haberman PEARSON

Boundary. DIFFERENTIAL EQUATIONS with Fourier Series and. Value Problems APPLIED PARTIAL. Fifth Edition. Richard Haberman PEARSON APPLIED PARTIAL DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems Fifth Edition Richard Haberman Southern Methodist University PEARSON Boston Columbus Indianapolis New York San Francisco

More information

APPLIED PARTIM DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems

APPLIED PARTIM DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems APPLIED PARTIM DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems Fourth Edition Richard Haberman Department of Mathematics Southern Methodist University PEARSON Prentice Hall PEARSON

More information

CDS 101/110a: Lecture 2.1 Dynamic Behavior

CDS 101/110a: Lecture 2.1 Dynamic Behavior CDS 11/11a: Lecture.1 Dynamic Behavior Richard M. Murray 6 October 8 Goals: Learn to use phase portraits to visualize behavior of dynamical systems Understand different types of stability for an equilibrium

More information

PREMED COURSE, 14/08/2015 OSCILLATIONS

PREMED COURSE, 14/08/2015 OSCILLATIONS PREMED COURSE, 14/08/2015 OSCILLATIONS PERIODIC MOTIONS Mechanical Metronom Laser Optical Bunjee jumping Electrical Astronomical Pulsar Biological ECG AC 50 Hz Another biological exampe PERIODIC MOTIONS

More information

In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required.

In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required. In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required. In humans, association is known to be a prominent feature of memory.

More information

Slide10 Haykin Chapter 14: Neurodynamics (3rd Ed. Chapter 13)

Slide10 Haykin Chapter 14: Neurodynamics (3rd Ed. Chapter 13) Slie10 Haykin Chapter 14: Neuroynamics (3r E. Chapter 13) CPSC 636-600 Instructor: Yoonsuck Choe Spring 2012 Neural Networks with Temporal Behavior Inclusion of feeback gives temporal characteristics to

More information

Unsupervised Clustering of Human Pose Using Spectral Embedding

Unsupervised Clustering of Human Pose Using Spectral Embedding Unsupervised Clustering of Human Pose Using Spectral Embedding Muhammad Haseeb and Edwin R Hancock Department of Computer Science, The University of York, UK Abstract In this paper we use the spectra of

More information

Neural Nets and Symbolic Reasoning Hopfield Networks

Neural Nets and Symbolic Reasoning Hopfield Networks Neural Nets and Symbolic Reasoning Hopfield Networks Outline The idea of pattern completion The fast dynamics of Hopfield networks Learning with Hopfield networks Emerging properties of Hopfield networks

More information

Using Variable Threshold to Increase Capacity in a Feedback Neural Network

Using Variable Threshold to Increase Capacity in a Feedback Neural Network Using Variable Threshold to Increase Capacity in a Feedback Neural Network Praveen Kuruvada Abstract: The article presents new results on the use of variable thresholds to increase the capacity of a feedback

More information

Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting

Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting Eugene M. Izhikevich The MIT Press Cambridge, Massachusetts London, England Contents Preface xv 1 Introduction 1 1.1 Neurons

More information

CDS 101/110a: Lecture 2.1 Dynamic Behavior

CDS 101/110a: Lecture 2.1 Dynamic Behavior CDS 11/11a: Lecture 2.1 Dynamic Behavior Richard M. Murray 6 October 28 Goals: Learn to use phase portraits to visualize behavior of dynamical systems Understand different types of stability for an equilibrium

More information

Neuroscience applications: isochrons and isostables. Alexandre Mauroy (joint work with I. Mezic)

Neuroscience applications: isochrons and isostables. Alexandre Mauroy (joint work with I. Mezic) Neuroscience applications: isochrons and isostables Alexandre Mauroy (joint work with I. Mezic) Outline Isochrons and phase reduction of neurons Koopman operator and isochrons Isostables of excitable systems

More information

Problem Set Number 01, MIT (Winter-Spring 2018)

Problem Set Number 01, MIT (Winter-Spring 2018) Problem Set Number 01, 18.377 MIT (Winter-Spring 2018) Rodolfo R. Rosales (MIT, Math. Dept., room 2-337, Cambridge, MA 02139) February 28, 2018 Due Thursday, March 8, 2018. Turn it in (by 3PM) at the Math.

More information

Improved near-wall accuracy for solutions of the Helmholtz equation using the boundary element method

Improved near-wall accuracy for solutions of the Helmholtz equation using the boundary element method Center for Turbulence Research Annual Research Briefs 2006 313 Improved near-wall accuracy for solutions of the Helmholtz equation using the boundary element method By Y. Khalighi AND D. J. Bodony 1. Motivation

More information

Entrainment and Chaos in the Hodgkin-Huxley Oscillator

Entrainment and Chaos in the Hodgkin-Huxley Oscillator Entrainment and Chaos in the Hodgkin-Huxley Oscillator Kevin K. Lin http://www.cims.nyu.edu/ klin Courant Institute, New York University Mostly Biomath - 2005.4.5 p.1/42 Overview (1) Goal: Show that the

More information

Modelling Research Group

Modelling Research Group Modelling Research Group The Importance of Noise in Dynamical Systems E. Staunton, P.T. Piiroinen November 20, 2015 Eoghan Staunton Modelling Research Group 2015 1 / 12 Introduction Historically mathematicians

More information

Facilitator Guide. Unit 12

Facilitator Guide. Unit 12 Facilitator Guide Unit 12 Facilitator Guide ACTIVITIES NOTE: At many points in the activities for Mathematics Illuminated, workshop participants will be asked to explain, either verbally or in written

More information

Physics 250 Green s functions for ordinary differential equations

Physics 250 Green s functions for ordinary differential equations Physics 25 Green s functions for ordinary differential equations Peter Young November 25, 27 Homogeneous Equations We have already discussed second order linear homogeneous differential equations, which

More information

Lecture 19 Optical MEMS (1)

Lecture 19 Optical MEMS (1) EEL6935 Advanced MEMS (Spring 5) Instructor: Dr. Huikai Xie Lecture 19 Optical MEMS (1) Agenda: Optics Review EEL6935 Advanced MEMS 5 H. Xie 3/8/5 1 Optics Review Nature of Light Reflection and Refraction

More information

Quantitative Understanding in Biology Module III: Linear Difference Equations Lecture II: Complex Eigenvalues

Quantitative Understanding in Biology Module III: Linear Difference Equations Lecture II: Complex Eigenvalues Quantitative Understanding in Biology Module III: Linear Difference Equations Lecture II: Complex Eigenvalues Introduction In the previous section, we considered the generalized twovariable system of linear

More information

The Simple Harmonic Oscillator

The Simple Harmonic Oscillator The Simple Harmonic Oscillator Asaf Pe er 1 November 4, 215 This part of the course is based on Refs [1] [3] 1 Introduction We return now to the study of a 1-d stationary problem: that of the simple harmonic

More information

Neural Network Analysis of Russian Parliament Voting Patterns

Neural Network Analysis of Russian Parliament Voting Patterns eural etwork Analysis of Russian Parliament Voting Patterns Dusan Husek Acad. of Sci. of the Czech Republic, Institute of Computer Science, the Czech Republic Email: dusan@cs.cas.cz Alexander A. Frolov

More information

Important because SHM is a good model to describe vibrations of a guitar string, vibrations of atoms in molecules, etc.

Important because SHM is a good model to describe vibrations of a guitar string, vibrations of atoms in molecules, etc. Simple Harmonic Motion Oscillatory motion under a restoring force proportional to the amount of displacement from equilibrium A restoring force is a force that tries to move the system back to equilibrium

More information

IDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS OF A FIXED POINT IN A DISCRETE-TIME OSCILLATOR NETWORK

IDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS OF A FIXED POINT IN A DISCRETE-TIME OSCILLATOR NETWORK International Journal of Innovative Computing, Information and Control ICIC International c 203 ISSN 349-498 Volume 9, Number, January 203 pp. 355 363 IDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS

More information

Derivation of border-collision maps from limit cycle bifurcations

Derivation of border-collision maps from limit cycle bifurcations Derivation of border-collision maps from limit cycle bifurcations Alan Champneys Department of Engineering Mathematics, University of Bristol Mario di Bernardo, Chris Budd, Piotr Kowalczyk Gabor Licsko,...

More information

Stabilization of a 3D Rigid Pendulum

Stabilization of a 3D Rigid Pendulum 25 American Control Conference June 8-, 25. Portland, OR, USA ThC5.6 Stabilization of a 3D Rigid Pendulum Nalin A. Chaturvedi, Fabio Bacconi, Amit K. Sanyal, Dennis Bernstein, N. Harris McClamroch Department

More information

Consider the way we are able to retrieve a pattern from a partial key as in Figure 10 1.

Consider the way we are able to retrieve a pattern from a partial key as in Figure 10 1. CompNeuroSci Ch 10 September 8, 2004 10 Associative Memory Networks 101 Introductory concepts Consider the way we are able to retrieve a pattern from a partial key as in Figure 10 1 Figure 10 1: A key

More information

MIT Weakly Nonlinear Things: Oscillators.

MIT Weakly Nonlinear Things: Oscillators. 18.385 MIT Weakly Nonlinear Things: Oscillators. Department of Mathematics Massachusetts Institute of Technology Cambridge, Massachusetts MA 02139 Abstract When nonlinearities are small there are various

More information

Synchronization Phenomena of Impulsively-Coupled

Synchronization Phenomena of Impulsively-Coupled Synchronization Phenomena of Impulsively-Coupled van der Pol Oscillators Yoko Uwate and Yoshifumi Nishio and Ruedi Stoop UNI / ETH Zurich, Switzerland Tokushima Univeristy, Japan Introduction (1) Coupled

More information

Linear Regression and Its Applications

Linear Regression and Its Applications Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start

More information

DESYNCHRONIZATION TRANSITIONS IN RINGS OF COUPLED CHAOTIC OSCILLATORS

DESYNCHRONIZATION TRANSITIONS IN RINGS OF COUPLED CHAOTIC OSCILLATORS Letters International Journal of Bifurcation and Chaos, Vol. 8, No. 8 (1998) 1733 1738 c World Scientific Publishing Company DESYNCHRONIZATION TRANSITIONS IN RINGS OF COUPLED CHAOTIC OSCILLATORS I. P.

More information

The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception

The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception Takashi Kanamaru Department of Mechanical Science and ngineering, School of Advanced

More information

Math 4263 Homework Set 1

Math 4263 Homework Set 1 Homework Set 1 1. Solve the following PDE/BVP 2. Solve the following PDE/BVP 2u t + 3u x = 0 u (x, 0) = sin (x) u x + e x u y = 0 u (0, y) = y 2 3. (a) Find the curves γ : t (x (t), y (t)) such that that

More information

1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =

1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 = Chapter 5 Sequences and series 5. Sequences Definition 5. (Sequence). A sequence is a function which is defined on the set N of natural numbers. Since such a function is uniquely determined by its values

More information

Passivity-based Stabilization of Non-Compact Sets

Passivity-based Stabilization of Non-Compact Sets Passivity-based Stabilization of Non-Compact Sets Mohamed I. El-Hawwary and Manfredi Maggiore Abstract We investigate the stabilization of closed sets for passive nonlinear systems which are contained

More information

Adjoint Orbits, Principal Components, and Neural Nets

Adjoint Orbits, Principal Components, and Neural Nets Adjoint Orbits, Principal Components, and Neural Nets Some facts about Lie groups and examples Examples of adjoint orbits and a distance measure Descent equations on adjoint orbits Properties of the double

More information

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain

More information

arxiv: v4 [stat.me] 27 Nov 2017

arxiv: v4 [stat.me] 27 Nov 2017 CLASSIFICATION OF LOCAL FIELD POTENTIALS USING GAUSSIAN SEQUENCE MODEL Taposh Banerjee John Choi Bijan Pesaran Demba Ba and Vahid Tarokh School of Engineering and Applied Sciences, Harvard University Center

More information

Numerical Analysis: Interpolation Part 1

Numerical Analysis: Interpolation Part 1 Numerical Analysis: Interpolation Part 1 Computer Science, Ben-Gurion University (slides based mostly on Prof. Ben-Shahar s notes) 2018/2019, Fall Semester BGU CS Interpolation (ver. 1.00) AY 2018/2019,

More information

STAR CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE AND DYNAMIC MEMORIES

STAR CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE AND DYNAMIC MEMORIES International Journal of Bifurcation and Chaos, Vol. 4, No. 5 (2004) 725 772 c World Scientific Publishing Company STAR CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE AND DYNAMIC MEMORIES MAKOTO ITOH Department

More information

Neural Network Essentials 1

Neural Network Essentials 1 Neural Network Essentials Draft: Associative Memory Chapter Anthony S. Maida University of Louisiana at Lafayette, USA June 6, 205 Copyright c 2000 2003 by Anthony S. Maida Contents 0. Associative memory.............................

More information

Hopfield networks. Lluís A. Belanche Soft Computing Research Group

Hopfield networks. Lluís A. Belanche Soft Computing Research Group Lluís A. Belanche belanche@lsi.upc.edu Soft Computing Research Group Dept. de Llenguatges i Sistemes Informàtics (Software department) Universitat Politècnica de Catalunya 2010-2011 Introduction Content-addressable

More information

Review: control, feedback, etc. Today s topic: state-space models of systems; linearization

Review: control, feedback, etc. Today s topic: state-space models of systems; linearization Plan of the Lecture Review: control, feedback, etc Today s topic: state-space models of systems; linearization Goal: a general framework that encompasses all examples of interest Once we have mastered

More information

Associative Memories (I) Hopfield Networks

Associative Memories (I) Hopfield Networks Associative Memories (I) Davide Bacciu Dipartimento di Informatica Università di Pisa bacciu@di.unipi.it Applied Brain Science - Computational Neuroscience (CNS) A Pun Associative Memories Introduction

More information

LINEAR RESPONSE THEORY

LINEAR RESPONSE THEORY MIT Department of Chemistry 5.74, Spring 5: Introductory Quantum Mechanics II Instructor: Professor Andrei Tokmakoff p. 8 LINEAR RESPONSE THEORY We have statistically described the time-dependent behavior

More information

Quantum Physics III (8.06) Spring 2005 Assignment 8

Quantum Physics III (8.06) Spring 2005 Assignment 8 Quantum Physics III (8.06) Spring 2005 Assignment 8 April 5, 2005 Due WEDNESDAY April 20, 2005 Readings Griffiths Chapter 8 on the semiclassical approximation. Griffiths Chapter 10 on the adiabatic approximation.

More information

Learning and Memory in Neural Networks

Learning and Memory in Neural Networks Learning and Memory in Neural Networks Guy Billings, Neuroinformatics Doctoral Training Centre, The School of Informatics, The University of Edinburgh, UK. Neural networks consist of computational units

More information

Fourier Series. (Com S 477/577 Notes) Yan-Bin Jia. Nov 29, 2016

Fourier Series. (Com S 477/577 Notes) Yan-Bin Jia. Nov 29, 2016 Fourier Series (Com S 477/577 otes) Yan-Bin Jia ov 9, 016 1 Introduction Many functions in nature are periodic, that is, f(x+τ) = f(x), for some fixed τ, which is called the period of f. Though function

More information

CSE 291. Assignment Spectral clustering versus k-means. Out: Wed May 23 Due: Wed Jun 13

CSE 291. Assignment Spectral clustering versus k-means. Out: Wed May 23 Due: Wed Jun 13 CSE 291. Assignment 3 Out: Wed May 23 Due: Wed Jun 13 3.1 Spectral clustering versus k-means Download the rings data set for this problem from the course web site. The data is stored in MATLAB format as

More information

Lecture 6 Quantum Mechanical Systems and Measurements

Lecture 6 Quantum Mechanical Systems and Measurements Lecture 6 Quantum Mechanical Systems and Measurements Today s Program: 1. Simple Harmonic Oscillator (SHO). Principle of spectral decomposition. 3. Predicting the results of measurements, fourth postulate

More information

Nonlinear Dynamic Systems Homework 1

Nonlinear Dynamic Systems Homework 1 Nonlinear Dynamic Systems Homework 1 1. A particle of mass m is constrained to travel along the path shown in Figure 1, which is described by the following function yx = 5x + 1x 4, 1 where x is defined

More information

Mass on a Horizontal Spring

Mass on a Horizontal Spring Course- B.Sc. Applied Physical Science (Computer Science) Year- IInd, Sem- IVth Subject Physics Paper- XIVth, Electromagnetic Theory Lecture No. 22, Simple Harmonic Motion Introduction Hello friends in

More information

Stabilization of a Specified Equilibrium in the Inverted Equilibrium Manifold of the 3D Pendulum

Stabilization of a Specified Equilibrium in the Inverted Equilibrium Manifold of the 3D Pendulum Proceedings of the 27 American Control Conference Marriott Marquis Hotel at Times Square New York City, USA, July 11-13, 27 ThA11.6 Stabilization of a Specified Equilibrium in the Inverted Equilibrium

More information

Math 46, Applied Math (Spring 2009): Final

Math 46, Applied Math (Spring 2009): Final Math 46, Applied Math (Spring 2009): Final 3 hours, 80 points total, 9 questions worth varying numbers of points 1. [8 points] Find an approximate solution to the following initial-value problem which

More information