Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xxxx PHASE OSCILLATOR NETWORK WITH PIECEWISELINEAR DYNAMICS


 Alyson Bryan
 1 years ago
 Views:
Transcription
1 Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xxxx PHASE OSCILLATOR NETWORK WITH PIECEWISELINEAR DYNAMICS WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY Department of Mathematics and Computer Science, Rhode Island College, Providence, Rhode Island 02908, USA. Department of Mathematics and Computer Science, Rhode Island College, Providence, Rhode Island 02908, USA. Neuroscience Program, Brandeis University, Waltham, Massachusetts 02454, USA. ABSTRACT. We consider a Filippov system formed from N coupled phase oscillators similar to the Kuramoto model but using a periodic sawtooth in place of the sine wave. A Hebbian rule based interaction provides for a phase oscillator associative memory network where the memorized patterns are stored as phaselocked limitcycle attractors. AMS (MOS) Subject Classification. 37N INTRODUCTION The Kuramoto model of coupled oscillators [5] was motivated by the phenomenon of collective synchronization in some networks with a large number of oscillators [11]. Here the frequencies of the oscillations can become locked to a common frequency despite the variations in the natural frequencies of the individual oscillators [8]. Generalizations of the model can be used to form phase oscillator associative memory networks, where the memorized patterns are stored as limitcycles, although there are problems with the stability of the limitcycle memories that must be overcome with the addition of higherorder terms [6]. The Kuramoto model describes the dynamics of a system of N phase oscillators θ i with natural frequencies ω i. The time evolution of the ith oscillator is given by (1.1) θi = ω i + k ij sin(θ j θ i ), i = 1,..., N, where k jk are parameters representing the coupling strengths from the jth to the ith oscillators. The sine function was chosen because it would be the firstorder term in the Fourier expansion of more general interactions. To visualize the phases, it is helpful to think of the oscillators as points on a unit circle moving with different angular velocities. In the case of synchronization, the points on the circle move around with constant phase differences. We approximate the sine wave interaction of the Kuramoto model by a periodic piecewiselinear (but discontinuous) sawtooth, which is interesting in its own right, and is more appropriate for some applications such as wireless sensor network synchronization [10]. We investigate the finiten case with a symmetric (selfadjoint) N N connection matrix, as occurs in some phaseoscillator network models of neurocomputers utilizing phaselock loops [3], and optical laser oscillator technologies [4], or any neural network that learns by a Received May 30, c Dynamic Publishers, Inc.
2 2 WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY Hebbian rule. We will find that associative memories can be encoded by stable phaselocked limit cycles. 2. MODEL DESCRIPTION We propose a simplified model where the nonlinear sine function is replaced by a periodic piecewiselinear sawtoothlike function. Our finiten phase oscillators are modeled as (2.1) θi = ω i + k ij saw(θ j θ i ), i = 1,..., N, where x + π (2.2) saw(x) = x π π x π is defined using the floor and ceiling functions. Here ω i and k ij are the natural frequency and the coupling strength, respectively, for the oscillator θ i. Saw is a discontinuous function, and this is a Filippov dynamical system [2]. The function saw(x) = x is the firstorder term in the Taylor expansion of sin(x) on ( π, π), extended periodically so that saw(x) = x j when j π < x < j +π, j Z, and saw((2j ± 1)π) = 0, j Z. Our definition results in saw being an odd function and the average of its rightside and leftside limits at points of discontinuity. Hence, by Dirichlet s theorem, its Fourier sine series converges pointwise to saw for all x R [9], and we can also write (2.3) saw(x) = 2 (sin(x) 12 sin(2x) + 13 sin(3x) 14 ) sin(4x) As mentioned before, we will consider each phase component ω i S 1, and thus (2.1) as a dynamical system on the Ndimensional torus T N. The terms sin(θ j θ i ) and saw(θ j θ i ) are both positive whenever the oscillator θ j is slightly ahead of the oscillator θ i, so that the term saw(θ j θ i ) contributes to the acceleration of the oscillator θ i. Similarly, they are both negative when θ j is slightly behind θ i, so that θ i slows down. The terms are both zero when the phases differ by exactly half a period, as if diametrically opposed oscillators are equally undecided whether to speed up or slow down, as was the case with Buridan s donkey. See Figure 1(a). However, the saw function is increasing on ( π, π) and so becomes increasingly larger in absolute value as the phase difference approaches either ±π. This implies that as the absolute phase difference between the oscillators θ j θ i becomes larger, saw(θ j θ i ) (or π 1 saw(θ j θ i ) to compare similar amplitudes) contributes more to the catching up or slowing down than either sin(θ j θ i ) or a smaller absolute phase difference would, encouraging coherence in comparison with the original Kuramoto dynamics. One could perhaps imagine runners on a circular track connected by elastic bands. 3. SYNCHRONIZATION It turns out that in the symmetric case k ij = k ji, i, j, for N oscillators, the space of phasedeviations is actually a gradient system (in a generalized sense) which can endow the system (2.1) with neurocomputational properties.
3 PHASE OSCILLATOR NETWORK 3 Figure 1. (a) COMPARING THE PIECEWISELINEAR SAWTOOTH AND π SINE WAVES. (b) THE GENERALIZED ANTIDERIVATIVE I(X) OF SAW(X) The Generalized Antiderivative of Saw. The Fourier expansion of saw can be integrated termbyterm to obtain an antiderivative I(x) for saw: ( ) (3.1) I(x) = π2 6 2 cos 2x cos 3x cos x See Figure 1(b). The function I(x) is periodic, piecewisesmooth, and continuous, with (3.2) I(x) = 1 ( x + π ) 2 x for x (, ). 2 When x [ π, π], I(x) = x 2 /2. Now I (x) = saw(x), x R, with the derivative being taken in a generalized sense at the points {(2m + 1)π, m Z}. It is interesting to note that if we define a centeredderivative of a function f at a point x to be the limit of the centereddifference quotients: lim h 0 f(x + h) f(x h), 2h then saw(x) is the centeredderivative of I(x) for all x, including the points at which I is not differentiable in the classical sense. This can be made the basis of a simple multistep secondorder numerical scheme The Phase Deviation Equations. We let (3.3) ω = 1 N be the mean natural frequency, and let (3.4) ψ i = θ i ωt, i = 1,..., N ω i
4 4 WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY be the phase deviations. Let (3.5) ν i = ω i ω be the natural frequency deviations. Note that i ν i = 0. The phase deviation equations become (3.6) ψ i = ν i + k ij saw(ψ j ψ i ), i = 1,..., N. Note that if (3.7) ψ = 1 N is the mean of the phase deviations, then (3.8) in the symmetric case. d ψ dt = A Potential For the Phase Deviation Equations. When the k ij s are symmetric, a (negative) potential for the phase deviation equations can be given by (3.9) U( ψ) = ν i ψ i 1 k ij I(ψ i ψ j ), 2 ψ i where ψ is the vector of phase deviations (ψ 1,..., ψ N ). equations (3.6) is just the gradient system (3.10) d ψ dt = U( ψ). The system of phase deviation Hence, the phase deviations ψ converge to an equilibrium ψ 0 on T N. Thus, the phases θ i = ωt + ψ i converge to a limitcycle attractor having frequency ω and phase relations ψ Hebbian Learning Rule and Neurocomputational Properties. This can form the basis of a neurocomputer with oscillatory associative memory. When N is large, there could be many such phaselocked limitcycle attractors corresponding to many memorized patterns which are encoded into (or decoded from) the symmetric connection matrix K = k ij using the spectral theorem. Each phaselocked limitcycle corresponds to an equilibrium of the phase deviation equations. And each equilibrium of the phase deviations corresponds to an extremum of U which corresponds to an eigenvector of K when all ν i = 0. For example, if ξ 1,..., ξ n are n orthogonal unit column Nvectors to be learned (n < N) with real weights µ 1,..., µ n, let n (3.11) K = µ j ξ j ξj t. Then, K is symmetric with eigenvectors ξ j and eigenvalues µ j on the orthogonal complement of the nullspace of K. Moreover, n (3.12) Kξ m = µ j ξ j ξj t ξ m = µ m ξ m. This results in the system asymptotically approaching the associated component at the bottom of a basin of attraction in which the initial input was located.
5 PHASE OSCILLATOR NETWORK 5 4. DISCUSSION Using the sawtooth function to model the symmetric interaction between N coupled phase oscillators, we obtain a piecewisesmooth, piecewiselinear system which can be analyzed explicitly. The phase deviations from the mean phase evolve according to a (generalized) gradient system. Stable phaselocking occurs at minimums of the potential energy function. One would expect that speed of convergence would be more rapid with sawtooth interactions compared to sine waves. Presented with a pattern close to one of the stored patterns, in the case that the ν i 0, the phase system with the symmetric connection matrix K and zero diagonal implementing a Hebbian learning rule will recall (or discriminant) by phaselocking with the closest stored pattern of phase deviations. Similarly, presented with a mixture of the stored patterns, the phase system will tend to phaselock (or abstract) with the pattern with the largest positive weight present in the mixture, just as in principal component analysis. The use of oscillatory memories is especially interesting to neurocomputing since phaselocking has been hypothesized [1] to be important in such things as in binding gestalts, multiplexing in the thalamus, and reaching consensus by winnertakeall in the cortex. Phase oscillator networks have also been used in modeling central pattern generators for locomotion [7]. Many questions regarding capacity, retrieval, effects of forcing, inputing faster oscillation rates, possible multiplexing, and practical applications remain to be investigated. REFERENCES [1] M.A. Arbib (Ed.), Handbook of Brain Theory and Neural Networks (2ed.), MIT Press, Cambridge, [2] M. dibernardo, C.J. Budd, A.R. Champneys and P. Kowalczyk, Piecewisesmooth Dynamical Systems: Theory and Applications, SpringerVerlag, London, [3] F. Hoppensteadt and E. Izhikevich, Pattern recognition via synchronization in phaselocked loop neural networks, IEEE Transaction on Neural Network, 1: , [4] F.C. Hoppensteadt and E.M. Izhikevich, Synchronization of laser oscillators, associative memory, and optical neurocomputing, Physical Review E, 62: , [5] Y. Kuramoto, Chemical Oscillations, Waves, and Turbulence, SpringerVerlag, New York, [6] T. Nishikawa, F.C. Hoppensteadt and Y.C. Lai, Oscillatory associative memory networks with perfect retrieval, Physica D, 197: , [7] R.H. Rand, A.H. Cohen and P.J. Holmes, Systems of coupled oscillators as models of central pattern generators, in: A. Cohen (Ed.), Neural Control of Rhythmic Movements in Vertebrates, Wiley, New York, [8] S.H. Strogatz, From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators, Physica D, 143:1 20, [9] G.P. Tolstov, Fourier Series, Dover Publications, New York, [10] G. WernerAllen, G. Tewari, A. Patel, M. Welch and R. Nagpal, Fireflyinspired sensor network synchronicity with realistic radio effects, Proceedings of the 3rd International Conference on Embedded Networked Sensor Systems, , [11] A.T. Winfree, The Geometry of Biological Time, Springer, New York, 1980.
Phase Synchronization
Phase Synchronization Lecture by: Zhibin Guo Notes by: Xiang Fan May 10, 2016 1 Introduction For any mode or fluctuation, we always have where S(x, t) is phase. If a mode amplitude satisfies ϕ k = ϕ k
More informationPhase Model for the relaxed van der Pol oscillator and its application to synchronization analysis
Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis Mimila Prost O. Collado J. Automatic Control Department, CINVESTAV IPN, A.P. 4 74 Mexico, D.F. ( e mail:
More informationSynchronization and Phase Oscillators
1 Synchronization and Phase Oscillators Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 Synchronization
More informationCanonical Neural Models 1
Canonical Neural Models 1 Frank Hoppensteadt 1 and Eugene zhikevich 2 ntroduction Mathematical modeling is a powerful tool in studying fundamental principles of information processing in the brain. Unfortunately,
More informationChimera states in networks of biological neurons and coupled damped pendulums
in neural models in networks of pendulumlike elements in networks of biological neurons and coupled damped pendulums J. Hizanidis 1, V. Kanas 2, A. Bezerianos 3, and T. Bountis 4 1 National Center for
More informationPhase Oscillators. and at r, Hence, the limit cycle at r = r is stable if and only if Λ (r ) < 0.
1 Phase Oscillators Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 2 Phase Oscillators Oscillations
More informationarxiv: v1 [nlin.ao] 3 May 2015
UNIDIRECTIONAL SYNCHRONIZATION AND FREQUENCY DIFFERENCE LOCKING INDUCED BY A HETEROCLINIC RATCHET arxiv:155.418v1 [nlin.ao] 3 May 215 Abstract A system of four coupled oscillators that exhibits unusual
More informationSurvey of Synchronization Part I: Kuramoto Oscillators
Survey of Synchronization Part I: Kuramoto Oscillators Tatsuya Ibuki FL1152 20 th, May, 2011 Outline of My Research in This Semester Survey of Synchronization  Kuramoto oscillator : This Seminar  Synchronization
More informationPHASELOCKED SOLUTIONS IN A HUB CONNECTED OSCILLATOR RING NETWORK
Copyright c 29 by ABCM PHASELOCKED SOLUTIONS IN A HUB CONNECTED OSCILLATOR RING NETWORK Jacqueline Bridge, Jacqueline.Bridge@sta.uwi.edu Department of Mechanical Engineering, The University of the West
More informationUniversity of Colorado. The Kuramoto Model. A presentation in partial satisfaction of the requirements for the degree of MSc in Applied Mathematics
University of Colorado The Kuramoto Model A presentation in partial satisfaction of the requirements for the degree of MSc in Applied Mathematics Jeff Marsh 2008 April 24 1 The Kuramoto Model Motivation:
More informationDynamics of four coupled phaseonly oscillators
Communications in Nonlinear Science and Numerical Simulation 13 (2008) 501 507 www.elsevier.com/locate/cnsns Short communication Dynamics of four coupled phaseonly oscillators Richard Rand *, Jeffrey
More information7 Recurrent Networks of Threshold (Binary) Neurons: Basis for Associative Memory
Physics 178/278  David Kleinfeld  Winter 2019 7 Recurrent etworks of Threshold (Binary) eurons: Basis for Associative Memory 7.1 The network The basic challenge in associative networks, also referred
More informationComputation with phase oscillators: an oscillatory perceptron model
Computation with phase oscillators: an oscillatory perceptron model Pablo Kaluza Abteilung Physikalische Chemie, FritzHaberInstitut der MaxPlanckGesellschaft, Faradayweg 46, 495 Berlin, Germany. Abstract
More informationSynchronization Transitions in Complex Networks
Synchronization Transitions in Complex Networks Y. Moreno 1,2,3 1 Institute for Biocomputation and Physics of Complex Systems (BIFI) University of Zaragoza, Zaragoza 50018, Spain 2 Department of Theoretical
More informationarxiv:nlin/ v1 [nlin.cd] 4 Oct 2005
Synchronization of Coupled Chaotic Dynamics on Networks R. E. Amritkar and Sarika Jalan Physical Research Laboratory, Navrangpura, Ahmedabad 380 009, India. arxiv:nlin/0510008v1 [nlin.cd] 4 Oct 2005 Abstract
More informationPlasticity and learning in a network of coupled phase oscillators
PHYSICAL REVIEW E, VOLUME 65, 041906 Plasticity and learning in a network of coupled phase oscillators Philip Seliger, Stephen C. Young, and Lev S. Tsimring Institute for onlinear Science, University of
More information7 RateBased Recurrent Networks of Threshold Neurons: Basis for Associative Memory
Physics 178/278  David Kleinfeld  Fall 2005; Revised for Winter 2017 7 RateBased Recurrent etworks of Threshold eurons: Basis for Associative Memory 7.1 A recurrent network with threshold elements The
More informationA Multivariate TimeFrequency Based Phase Synchrony Measure for Quantifying Functional Connectivity in the Brain
A Multivariate TimeFrequency Based Phase Synchrony Measure for Quantifying Functional Connectivity in the Brain Dr. Ali Yener Mutlu Department of Electrical and Electronics Engineering, Izmir Katip Celebi
More information898 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 17, NO. 6, DECEMBER X/01$ IEEE
898 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 17, NO. 6, DECEMBER 2001 Short Papers The Chaotic Mobile Robot Yoshihiko Nakamura and Akinori Sekiguchi Abstract In this paper, we develop a method
More informationA. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network.
III. Recurrent Neural Networks A. The Hopfield Network 2/9/15 1 2/9/15 2 Typical Artificial Neuron Typical Artificial Neuron connection weights linear combination activation function inputs output net
More informationFourier mode dynamics for NLS Synchronization in fiber lasers arrays
Fourier mode dynamics for NLS Synchronization in fiber lasers arrays Nonlinear Schrodinger workshop Heraklio, May 21 2013 Jeanguy Caputo Laboratoire de Mathématiques INSA de Rouen, France A. Aceves, N.
More informationIN THIS turorial paper we exploit the relationship between
508 IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 3, MAY 1999 Weakly PulseCoupled Oscillators, FM Interactions, Synchronization, Oscillatory Associative Memory Eugene M. Izhikevich Abstract We study
More informationApplicable Analysis and Discrete Mathematics available online at FRUSTRATED KURAMOTO MODEL GENERALISE EQUITABLE PARTITIONS
Applicable Analysis and Discrete Mathematics available online at http://pefmath.etf.rs Appl. Anal. Discrete Math. x (xxxx), xxx xxx. doi:10.98/aadmxxxxxxxx αkuramoto PARTITIONS FROM THE FRUSTRATED KURAMOTO
More informationTimeFrequency Analysis
TimeFrequency Analysis Basics of Fourier Series Philippe B. aval KSU Fall 015 Philippe B. aval (KSU) Fourier Series Fall 015 1 / 0 Introduction We first review how to derive the Fourier series of a function.
More informationResearch Article Mathematical Model and Cluster Synchronization for a Complex Dynamical Network with Two Types of Chaotic Oscillators
Applied Mathematics Volume 212, Article ID 936, 12 pages doi:1.11/212/936 Research Article Mathematical Model and Cluster Synchronization for a Complex Dynamical Network with Two Types of Chaotic Oscillators
More informationEffects of Interactive Function Forms in a SelfOrganized Critical Model Based on Neural Networks
Commun. Theor. Phys. (Beijing, China) 40 (2003) pp. 607 613 c International Academic Publishers Vol. 40, No. 5, November 15, 2003 Effects of Interactive Function Forms in a SelfOrganized Critical Model
More informationA conjecture on sustained oscillations for a closedloop heat equation
A conjecture on sustained oscillations for a closedloop heat equation C.I. Byrnes, D.S. Gilliam Abstract The conjecture in this paper represents an initial step aimed toward understanding and shaping
More informationSynchronization in delaycoupled bipartite networks
Synchronization in delaycoupled bipartite networks Ram Ramaswamy School of Physical Sciences Jawaharlal Nehru University, New Delhi February 20, 2015 Outline Ø Bipartite networks and delaycoupled phase
More informationA. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network.
Part 3A: Hopfield Network III. Recurrent Neural Networks A. The Hopfield Network 1 2 Typical Artificial Neuron Typical Artificial Neuron connection weights linear combination activation function inputs
More informationDynamical modelling of systems of coupled oscillators
Dynamical modelling of systems of coupled oscillators Mathematical Neuroscience Network Training Workshop Edinburgh Peter Ashwin University of Exeter 22nd March 2009 Peter Ashwin (University of Exeter)
More informationSaturation of Information Exchange in Locally Connected PulseCoupled Oscillators
Saturation of Information Exchange in Locally Connected PulseCoupled Oscillators Will Wagstaff School of Computer Science, Georgia Institute of Technology, Atlanta, Georgia 30332, USA (Dated: 13 December
More informationDynamical systems in neuroscience. Pacific Northwest Computational Neuroscience Connection October 12, 2010
Dynamical systems in neuroscience Pacific Northwest Computational Neuroscience Connection October 12, 2010 What do I mean by a dynamical system? Set of state variables Law that governs evolution of state
More informationαkuramoto partitions: graph partitions from the frustrated Kuramoto model generalise equitable partitions
αkuramoto partitions: graph partitions from the frustrated Kuramoto model generalise equitable partitions Stephen Kirkland 1 and Simone Severini 1 Hamilton Institute, National University of Ireland Maynooth,
More informationA General Framework for Neurobiological Modeling: An Application to the Vestibular System 1
A General Framework for Neurobiological Modeling: An Application to the Vestibular System 1 Chris Eliasmith, a M. B. Westover, b and C. H. Anderson c a Department of Philosophy, University of Waterloo,
More informationNonlinear Autonomous Systems of Differential
Chapter 4 Nonlinear Autonomous Systems of Differential Equations 4.0 The Phase Plane: Linear Systems 4.0.1 Introduction Consider a system of the form x = A(x), (4.0.1) where A is independent of t. Such
More informationNonlinear systems, chaos and control in Engineering
Nonlinear systems, chaos and control in Engineering Module 1 block 3 Onedimensional nonlinear systems Cristina Masoller Cristina.masoller@upc.edu http://www.fisica.edu.uy/~cris/ Schedule Flows on the
More informationExamples of the Fourier Theorem (Sect. 10.3). The Fourier Theorem: Continuous case.
s of the Fourier Theorem (Sect. 1.3. The Fourier Theorem: Continuous case. : Using the Fourier Theorem. The Fourier Theorem: Piecewise continuous case. : Using the Fourier Theorem. The Fourier Theorem:
More informationKasetsart University Workshop. Multigrid methods: An introduction
Kasetsart University Workshop Multigrid methods: An introduction Dr. Anand Pardhanani Mathematics Department Earlham College Richmond, Indiana USA pardhan@earlham.edu A copy of these slides is available
More informationIntroduction to Neural Networks
Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning
More informationHopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5
Hopfield Neural Network and Associative Memory Typical Myelinated Vertebrate Motoneuron (Wikipedia) PHY 411506 Computational Physics 2 1 Wednesday, March 5 1906 Nobel Prize in Physiology or Medicine.
More informationIntroduction  Motivation. Many phenomena (physical, chemical, biological, etc.) are model by differential equations. f f(x + h) f(x) (x) = lim
Introduction  Motivation Many phenomena (physical, chemical, biological, etc.) are model by differential equations. Recall the definition of the derivative of f(x) f f(x + h) f(x) (x) = lim. h 0 h Its
More informationDynamical Systems and Chaos Part II: Biology Applications. Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325
Dynamical Systems and Chaos Part II: Biology Applications Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325 Foreword In order to model populations of physical/biological
More informationSymmetries 2  Rotations in Space
Symmetries 2  Rotations in Space This symmetry is about the isotropy of space, i.e. space is the same in all orientations. Thus, if we continuously rotated an entire system in space, we expect the system
More informationRobot Control Basics CS 685
Robot Control Basics CS 685 Control basics Use some concepts from control theory to understand and learn how to control robots Control Theory general field studies control and understanding of behavior
More informationBoundary. DIFFERENTIAL EQUATIONS with Fourier Series and. Value Problems APPLIED PARTIAL. Fifth Edition. Richard Haberman PEARSON
APPLIED PARTIAL DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems Fifth Edition Richard Haberman Southern Methodist University PEARSON Boston Columbus Indianapolis New York San Francisco
More informationAPPLIED PARTIM DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems
APPLIED PARTIM DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems Fourth Edition Richard Haberman Department of Mathematics Southern Methodist University PEARSON Prentice Hall PEARSON
More informationCDS 101/110a: Lecture 2.1 Dynamic Behavior
CDS 11/11a: Lecture.1 Dynamic Behavior Richard M. Murray 6 October 8 Goals: Learn to use phase portraits to visualize behavior of dynamical systems Understand different types of stability for an equilibrium
More informationPREMED COURSE, 14/08/2015 OSCILLATIONS
PREMED COURSE, 14/08/2015 OSCILLATIONS PERIODIC MOTIONS Mechanical Metronom Laser Optical Bunjee jumping Electrical Astronomical Pulsar Biological ECG AC 50 Hz Another biological exampe PERIODIC MOTIONS
More informationIn biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required.
In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required. In humans, association is known to be a prominent feature of memory.
More informationSlide10 Haykin Chapter 14: Neurodynamics (3rd Ed. Chapter 13)
Slie10 Haykin Chapter 14: Neuroynamics (3r E. Chapter 13) CPSC 636600 Instructor: Yoonsuck Choe Spring 2012 Neural Networks with Temporal Behavior Inclusion of feeback gives temporal characteristics to
More informationUnsupervised Clustering of Human Pose Using Spectral Embedding
Unsupervised Clustering of Human Pose Using Spectral Embedding Muhammad Haseeb and Edwin R Hancock Department of Computer Science, The University of York, UK Abstract In this paper we use the spectra of
More informationNeural Nets and Symbolic Reasoning Hopfield Networks
Neural Nets and Symbolic Reasoning Hopfield Networks Outline The idea of pattern completion The fast dynamics of Hopfield networks Learning with Hopfield networks Emerging properties of Hopfield networks
More informationUsing Variable Threshold to Increase Capacity in a Feedback Neural Network
Using Variable Threshold to Increase Capacity in a Feedback Neural Network Praveen Kuruvada Abstract: The article presents new results on the use of variable thresholds to increase the capacity of a feedback
More informationDynamical Systems in Neuroscience: The Geometry of Excitability and Bursting
Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting Eugene M. Izhikevich The MIT Press Cambridge, Massachusetts London, England Contents Preface xv 1 Introduction 1 1.1 Neurons
More informationCDS 101/110a: Lecture 2.1 Dynamic Behavior
CDS 11/11a: Lecture 2.1 Dynamic Behavior Richard M. Murray 6 October 28 Goals: Learn to use phase portraits to visualize behavior of dynamical systems Understand different types of stability for an equilibrium
More informationNeuroscience applications: isochrons and isostables. Alexandre Mauroy (joint work with I. Mezic)
Neuroscience applications: isochrons and isostables Alexandre Mauroy (joint work with I. Mezic) Outline Isochrons and phase reduction of neurons Koopman operator and isochrons Isostables of excitable systems
More informationProblem Set Number 01, MIT (WinterSpring 2018)
Problem Set Number 01, 18.377 MIT (WinterSpring 2018) Rodolfo R. Rosales (MIT, Math. Dept., room 2337, Cambridge, MA 02139) February 28, 2018 Due Thursday, March 8, 2018. Turn it in (by 3PM) at the Math.
More informationImproved nearwall accuracy for solutions of the Helmholtz equation using the boundary element method
Center for Turbulence Research Annual Research Briefs 2006 313 Improved nearwall accuracy for solutions of the Helmholtz equation using the boundary element method By Y. Khalighi AND D. J. Bodony 1. Motivation
More informationEntrainment and Chaos in the HodgkinHuxley Oscillator
Entrainment and Chaos in the HodgkinHuxley Oscillator Kevin K. Lin http://www.cims.nyu.edu/ klin Courant Institute, New York University Mostly Biomath  2005.4.5 p.1/42 Overview (1) Goal: Show that the
More informationModelling Research Group
Modelling Research Group The Importance of Noise in Dynamical Systems E. Staunton, P.T. Piiroinen November 20, 2015 Eoghan Staunton Modelling Research Group 2015 1 / 12 Introduction Historically mathematicians
More informationFacilitator Guide. Unit 12
Facilitator Guide Unit 12 Facilitator Guide ACTIVITIES NOTE: At many points in the activities for Mathematics Illuminated, workshop participants will be asked to explain, either verbally or in written
More informationPhysics 250 Green s functions for ordinary differential equations
Physics 25 Green s functions for ordinary differential equations Peter Young November 25, 27 Homogeneous Equations We have already discussed second order linear homogeneous differential equations, which
More informationLecture 19 Optical MEMS (1)
EEL6935 Advanced MEMS (Spring 5) Instructor: Dr. Huikai Xie Lecture 19 Optical MEMS (1) Agenda: Optics Review EEL6935 Advanced MEMS 5 H. Xie 3/8/5 1 Optics Review Nature of Light Reflection and Refraction
More informationQuantitative Understanding in Biology Module III: Linear Difference Equations Lecture II: Complex Eigenvalues
Quantitative Understanding in Biology Module III: Linear Difference Equations Lecture II: Complex Eigenvalues Introduction In the previous section, we considered the generalized twovariable system of linear
More informationThe Simple Harmonic Oscillator
The Simple Harmonic Oscillator Asaf Pe er 1 November 4, 215 This part of the course is based on Refs [1] [3] 1 Introduction We return now to the study of a 1d stationary problem: that of the simple harmonic
More informationNeural Network Analysis of Russian Parliament Voting Patterns
eural etwork Analysis of Russian Parliament Voting Patterns Dusan Husek Acad. of Sci. of the Czech Republic, Institute of Computer Science, the Czech Republic Email: dusan@cs.cas.cz Alexander A. Frolov
More informationImportant because SHM is a good model to describe vibrations of a guitar string, vibrations of atoms in molecules, etc.
Simple Harmonic Motion Oscillatory motion under a restoring force proportional to the amount of displacement from equilibrium A restoring force is a force that tries to move the system back to equilibrium
More informationIDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS OF A FIXED POINT IN A DISCRETETIME OSCILLATOR NETWORK
International Journal of Innovative Computing, Information and Control ICIC International c 203 ISSN 349498 Volume 9, Number, January 203 pp. 355 363 IDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS
More informationDerivation of bordercollision maps from limit cycle bifurcations
Derivation of bordercollision maps from limit cycle bifurcations Alan Champneys Department of Engineering Mathematics, University of Bristol Mario di Bernardo, Chris Budd, Piotr Kowalczyk Gabor Licsko,...
More informationStabilization of a 3D Rigid Pendulum
25 American Control Conference June 8, 25. Portland, OR, USA ThC5.6 Stabilization of a 3D Rigid Pendulum Nalin A. Chaturvedi, Fabio Bacconi, Amit K. Sanyal, Dennis Bernstein, N. Harris McClamroch Department
More informationConsider the way we are able to retrieve a pattern from a partial key as in Figure 10 1.
CompNeuroSci Ch 10 September 8, 2004 10 Associative Memory Networks 101 Introductory concepts Consider the way we are able to retrieve a pattern from a partial key as in Figure 10 1 Figure 10 1: A key
More informationMIT Weakly Nonlinear Things: Oscillators.
18.385 MIT Weakly Nonlinear Things: Oscillators. Department of Mathematics Massachusetts Institute of Technology Cambridge, Massachusetts MA 02139 Abstract When nonlinearities are small there are various
More informationSynchronization Phenomena of ImpulsivelyCoupled
Synchronization Phenomena of ImpulsivelyCoupled van der Pol Oscillators Yoko Uwate and Yoshifumi Nishio and Ruedi Stoop UNI / ETH Zurich, Switzerland Tokushima Univeristy, Japan Introduction (1) Coupled
More informationLinear Regression and Its Applications
Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start
More informationDESYNCHRONIZATION TRANSITIONS IN RINGS OF COUPLED CHAOTIC OSCILLATORS
Letters International Journal of Bifurcation and Chaos, Vol. 8, No. 8 (1998) 1733 1738 c World Scientific Publishing Company DESYNCHRONIZATION TRANSITIONS IN RINGS OF COUPLED CHAOTIC OSCILLATORS I. P.
More informationThe Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception
The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception Takashi Kanamaru Department of Mechanical Science and ngineering, School of Advanced
More informationMath 4263 Homework Set 1
Homework Set 1 1. Solve the following PDE/BVP 2. Solve the following PDE/BVP 2u t + 3u x = 0 u (x, 0) = sin (x) u x + e x u y = 0 u (0, y) = y 2 3. (a) Find the curves γ : t (x (t), y (t)) such that that
More information1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =
Chapter 5 Sequences and series 5. Sequences Definition 5. (Sequence). A sequence is a function which is defined on the set N of natural numbers. Since such a function is uniquely determined by its values
More informationPassivitybased Stabilization of NonCompact Sets
Passivitybased Stabilization of NonCompact Sets Mohamed I. ElHawwary and Manfredi Maggiore Abstract We investigate the stabilization of closed sets for passive nonlinear systems which are contained
More informationAdjoint Orbits, Principal Components, and Neural Nets
Adjoint Orbits, Principal Components, and Neural Nets Some facts about Lie groups and examples Examples of adjoint orbits and a distance measure Descent equations on adjoint orbits Properties of the double
More informationThe Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR
Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain
More informationarxiv: v4 [stat.me] 27 Nov 2017
CLASSIFICATION OF LOCAL FIELD POTENTIALS USING GAUSSIAN SEQUENCE MODEL Taposh Banerjee John Choi Bijan Pesaran Demba Ba and Vahid Tarokh School of Engineering and Applied Sciences, Harvard University Center
More informationNumerical Analysis: Interpolation Part 1
Numerical Analysis: Interpolation Part 1 Computer Science, BenGurion University (slides based mostly on Prof. BenShahar s notes) 2018/2019, Fall Semester BGU CS Interpolation (ver. 1.00) AY 2018/2019,
More informationSTAR CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE AND DYNAMIC MEMORIES
International Journal of Bifurcation and Chaos, Vol. 4, No. 5 (2004) 725 772 c World Scientific Publishing Company STAR CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE AND DYNAMIC MEMORIES MAKOTO ITOH Department
More informationNeural Network Essentials 1
Neural Network Essentials Draft: Associative Memory Chapter Anthony S. Maida University of Louisiana at Lafayette, USA June 6, 205 Copyright c 2000 2003 by Anthony S. Maida Contents 0. Associative memory.............................
More informationHopfield networks. Lluís A. Belanche Soft Computing Research Group
Lluís A. Belanche belanche@lsi.upc.edu Soft Computing Research Group Dept. de Llenguatges i Sistemes Informàtics (Software department) Universitat Politècnica de Catalunya 20102011 Introduction Contentaddressable
More informationReview: control, feedback, etc. Today s topic: statespace models of systems; linearization
Plan of the Lecture Review: control, feedback, etc Today s topic: statespace models of systems; linearization Goal: a general framework that encompasses all examples of interest Once we have mastered
More informationAssociative Memories (I) Hopfield Networks
Associative Memories (I) Davide Bacciu Dipartimento di Informatica Università di Pisa bacciu@di.unipi.it Applied Brain Science  Computational Neuroscience (CNS) A Pun Associative Memories Introduction
More informationLINEAR RESPONSE THEORY
MIT Department of Chemistry 5.74, Spring 5: Introductory Quantum Mechanics II Instructor: Professor Andrei Tokmakoff p. 8 LINEAR RESPONSE THEORY We have statistically described the timedependent behavior
More informationQuantum Physics III (8.06) Spring 2005 Assignment 8
Quantum Physics III (8.06) Spring 2005 Assignment 8 April 5, 2005 Due WEDNESDAY April 20, 2005 Readings Griffiths Chapter 8 on the semiclassical approximation. Griffiths Chapter 10 on the adiabatic approximation.
More informationLearning and Memory in Neural Networks
Learning and Memory in Neural Networks Guy Billings, Neuroinformatics Doctoral Training Centre, The School of Informatics, The University of Edinburgh, UK. Neural networks consist of computational units
More informationFourier Series. (Com S 477/577 Notes) YanBin Jia. Nov 29, 2016
Fourier Series (Com S 477/577 otes) YanBin Jia ov 9, 016 1 Introduction Many functions in nature are periodic, that is, f(x+τ) = f(x), for some fixed τ, which is called the period of f. Though function
More informationCSE 291. Assignment Spectral clustering versus kmeans. Out: Wed May 23 Due: Wed Jun 13
CSE 291. Assignment 3 Out: Wed May 23 Due: Wed Jun 13 3.1 Spectral clustering versus kmeans Download the rings data set for this problem from the course web site. The data is stored in MATLAB format as
More informationLecture 6 Quantum Mechanical Systems and Measurements
Lecture 6 Quantum Mechanical Systems and Measurements Today s Program: 1. Simple Harmonic Oscillator (SHO). Principle of spectral decomposition. 3. Predicting the results of measurements, fourth postulate
More informationNonlinear Dynamic Systems Homework 1
Nonlinear Dynamic Systems Homework 1 1. A particle of mass m is constrained to travel along the path shown in Figure 1, which is described by the following function yx = 5x + 1x 4, 1 where x is defined
More informationMass on a Horizontal Spring
Course B.Sc. Applied Physical Science (Computer Science) Year IInd, Sem IVth Subject Physics Paper XIVth, Electromagnetic Theory Lecture No. 22, Simple Harmonic Motion Introduction Hello friends in
More informationStabilization of a Specified Equilibrium in the Inverted Equilibrium Manifold of the 3D Pendulum
Proceedings of the 27 American Control Conference Marriott Marquis Hotel at Times Square New York City, USA, July 1113, 27 ThA11.6 Stabilization of a Specified Equilibrium in the Inverted Equilibrium
More informationMath 46, Applied Math (Spring 2009): Final
Math 46, Applied Math (Spring 2009): Final 3 hours, 80 points total, 9 questions worth varying numbers of points 1. [8 points] Find an approximate solution to the following initialvalue problem which
More information