Bridging the gap between vision and language:
|
|
|
- Domenic May
- 5 years ago
- Views:
Transcription
1 Bridging the gap between vision and language: A morphodynamical model of spatial cognitive categories René Doursat Brain Computation Laboratory Department of Computer Science University of Nevada, Reno Jean Petitot CREA Ecole Polytechnique, Paris
2 A Morphodynamical Model of Spatial Cognitive Categories 1. Spatial categorization 2. Cellular automaton model 3. Spiking neural model 4. Discussion August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 2
3 A Morphodynamical Model of Spatial Cognitive Categories 1. Spatial categorization Object vs. scene categorization Breaking up the categorical landscapes into protosemantic islands Cognitive linguistics collection of topological invariants What is the tolopogy of language? 2. Cellular automaton model 3. Spiking neural model 4. Discussion August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 3
4 CHAIR Object vs. scene categorization Prototypes of object shapes are relatively rigid TABLE EE August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 4
5 IN Object vs. scene categorization Prototypes of scene configurations are flexible ACROSS ABOVE August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 5
6 Object vs. scene categorization Prototypes of scene configurations are flexible IN How can the infinite diversity of scenes be categorized under just a few linguistic elements? Equivalently, how can a single linguistic element encompass such a wide topological variety? August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 6
7 Breaking up the categorical landscapes The structure of one complex category: in IN (1) (a) the cat in the house prototype (b) the bird in the garden (c) the flowers in the vase metonymy: flowers = stems (d) the bird in the tree (e) the chair in the corner (f) the water in the vase (g) the crack in the vase (h) the foot in the stirrup metonymy: vase = surface of vase (i)?the finger in the ring adapted from Herskovits (1986) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 7
8 Breaking up the categorical landscapes Prototype-based, radial category IN August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 8
9 Breaking up the categorical landscapes Protosemantic islands (with bridges) IN-2 metonymy metonymy IN-1 IN-3 August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 9
10 Breaking up the categorical landscapes Further extensions by metaphorical mapping (k) in a crowd metaphor from part of a discrete numerable set (k ) in a committee (j) in water metaphor from immersed in a continuous substance (j ) in doubt August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 10
11 Breaking up the categorical landscapes More protosemantic segmentation: cross-linguistic variations German auf German an English on English above German über Mixtec siki [at-the-back] Mixtec sini [at-the-head] adapted from Regier (1986) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 11
12 Breaking up the categorical landscapes Summary a semantic category is a cluster of protosemantic subcategories + metonymic effects + metaphorical mappings + categories do not overlap across languages we restrict our study to protosemantics: there is no unique classification criterion covering IN-1, IN-2, etc.... however, even focusing on a single protosemantic category, we are still facing a huge topological diversity August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 12
13 Cognitive linguistics Principles what is central to language is meaning, not syntax but meaning is not about logical truth conditions meaning is construals, conceptualization, mental representations, schematization, categorization there is a common level of representation where language, perception and action become compatible language is not an autonomous functional set of syntactic rules that create meaning as a by-product syntax, semantics and pragmatics are not independent Filmore. Talmy, Langacker, Lakoff,... August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 13
14 Cognitive linguistics Gestalt & mereology traditional logical atomism (set theory): things are already individuated symbols and relations are abstract links connecting these symbols the bird in the cage by contrast, in the Gestaltist or mereological conception, things and relations constitute analogic wholes: relations are not taken for granted but emerge together with the objects through segmentation and transformation August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 14
15 Cognitive linguistics Properties of construals cognitive linguistics identifies semantic construals to abstract iconic scenes ("theater stage") one can view construals from different angles and study their properties: figure () and ground () perspective / viewpoint profiling / salience frames / context etc. August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 15
16 bulk invariance Cognitive linguistics Collection of invariants (3) (a) The caterpillar crawled up along the filament. (b) The caterpillar crawled up along the flagpole. (c) The caterpillar crawled up along the redwood tree. along is insensitive to the girth of continuity invariance (4) (a) The ball is in the box. (b) The fruit is in the bowl. (c) The bird is in the cage. in is insensitive to discontinuities in shape invariance (5) (a) I zigzagged through the woods. (b) I circled through the woods. (c) I dashed through the woods. through is insensitive to the shape of s trajectory adapted from Talmy August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 16
17 What is the topology of language? language topology (LT) it is not the same as mathematical topology (MT) LT is sometimes less constrained than MT, as with the various examples of IN : closed container leaky container open container LT is sometimes more constrained than MT, as with the metric ratios of ACROSS : good example of ACROSS bad example of ACROSS August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 17
18 A Morphodynamical Model of Spatial Cognitive Categories 1. Spatial categorization 2. Cellular automaton model Key to invariance: drastic morphological transforms Perceptual-semantic classifier Objects (a) expand and (b) collide Singularities reveal the characteristic signature of the scene 3. Spiking neural model 4. Discussion August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 18
19 Key to invariance: Drastic morphological transforms influence zones influence zones scenes representing the same spatial class are not directly similar = ABOVE = ABOVE what can be compared, however, are virtual structures generated by morphological transforms August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 19
20 Skeleton by influence zones (SKIZ) SKIZ, a.k.a... medial axis transform cut locus stick figures shock graphs Voronoi diagrams, etc. August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 20
21 Perceptual-semantic classifier IN IN ABOVE ABOVE ACROSS August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 21
22 Principles of active semantics a) objects have a tendency to expand and occupy the whole space around them b) objects are obstacles to each other s expansion this creates virtual structures and singularities (e.g., SKIZ = skeleton by influence zones), which constitute the characteristic signature of the spatial relationship transformation routines considerably reduce the dimensionality of the input space, boiling down the input images to a few critical features singularities encode a lot of the image s geometrical information in a compact and localized manner August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 22
23 Dynamic evolution of singularities phase transition: the singularity disappears as the exits the interior of the (robust phenomenon) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 23
24 Perceptual-semantic classifier Architecture real images schematic scenes morphogenetic transform learning semantic descriptions IN GIVE ABOVE PUSH segmentation French English Japanese ACROSS TAKE later: introduce a learning module to combine protosemantic concepts into language-specific complex categories August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 24
25 A Morphodynamical Model of Spatial Cognitive Categories 1. Spatial categorization 2. Cellular automaton model 3. Spiking neural model Temporal coding Oscillators and excitable units Instead of group synchronization: traveling waves Model 1: cross-coupled waves + border detection Model 2: independent waves + complex cells 4. Discussion August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 25
26 Spiking neural model (preview) Replace discrete binary transforms with real-valued, continuous dynamical system August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 26
27 Temporal coding Synchronization vs. delayed correlations high activity rate high activity rate high activity rate low activity rate low activity rate low activity rate 1 and 2 more in sync than 1 and 3 4, 5 and 6 correlated through delays August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 27
28 Oscillators and excitable units Excitatory-inhibitory relaxation oscillator w EI w EE N excitatory neurons M inhibitory neurons relaxation oscillators exhibit discontinuous jumps different from sinusoidal or harmonic oscillations w IE Wang, DeLiang ( August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 28
29 Oscillators and excitable units Van der Pol relaxation oscillator limit cycle attractor Van der Pol relaxation oscillator Wang, DeLiang ( August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 29
30 Oscillators and excitable units Bonhoeffer-Van der Pol (BVP) stochastic oscillator = ( ) 3 u u + v + z + η + k ( u u ) u& i = c i i 3 i v& i ( a u bv ) i i c + η j j i + I i two activity regimes: (a) sparse stochastic and (b) quasi periodic (a) (b) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 30
31 Group synchronization Networks of coupled oscillators Wang, DeLiang ( August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 31
32 Group synchronization A model of segmentation by sync: LEGION Wang, D. L. & Terman, D. (1995) Locally excitatory globally inhibitory oscillator networks. IEEE Trans. Neural Net., 6: August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 32
33 Group synchronization A model of segmentation by sync: LEGION Wang, D. L. & Terman, D. (1997) Image segmentation based on oscillatory correlation. Neural Computation, 9: ,1997 August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 33
34 Group synchronization A model of segmentation by sync: LEGION Wang, D. L. & Terman, D. (1997) Image segmentation based on oscillatory correlation. Neural Computation, 9: ,1997 August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 34
35 Instead of group synchronization: traveling waves Instead of phase plateaus: phase gradients ϕ π ϕ π -π x -π x August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 35
36 Traveling waves Detail Grass-fire wave on 16x16 network of coupled Bonhoeffer-van der Pol units August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 36
37 Traveling waves Wave collision t = 5 t = 18 t = x 64 lattice of locally coupled Bonhoeffer-van der Pol oscillators... but how can we discriminate between activity coming from and? Doursat, R. & Petitot, J. (2005) Dynamical Systems and Cognitive Linguistics: Toward an Active Morphodynamical Semantics. To appear in Neural Networks. August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 37
38 Traveling waves Model 1: crossed-coupled waves + frame border detection t = 5 t = 22 t = 34 ABOVE (a) (b) use two cross-coupled, mutually inhibiting lattices of coupled oscillators August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 38
39 Frame border detection not enough (a) (b) (c) (d) how to distinguish among: (a-c) English above (b) Mixtec siki : is horizontally elongated (Regier, 1996) (c) French par-dessus : is horizontally elongated and covers (d) German auf : is in contact with problem: all yield the same type of frame border activity (upper half, lower half ) need for a refined SKIZ-based signature August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 39
40 Traveling waves Model 2: independent waves + complex readout cells August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 40
41 Traveling waves Model 2: independent waves + complex readout cells θ = 0 L (a) L D (b) D C 1 (c) C C 2 3 C 4 the activity in layers C provide a sparse signature of the scene specific of the SKIZ line August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 41
42 A Morphodynamical Model of Spatial Cognitive Categories 1. Spatial categorization 2. Cellular automaton model 3. Spiking neural model 4. Discussion Future work Originality Appendix: pattern formation in excitable media August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 42
43 Future work 1. wave dynamics and scene database systematic investigation of morphodynamical routines using a database of image/label pairs 2. real images and low-level visual processing start from real images via segmentation preprocessing 3. learning the semantics from the protosemantics combine protosemantic features (IN-1, IN-2, etc.) into fullfledged cultural-linguistics categories (IN, AUF, etc.) using learning methods 4. verb processes and complex scenes also investigate movies (bifurcation of singularities) and composition between schemas August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 43
44 Originality 1. bringing large-scale dynamical systems to cognitive linguistics CL is lacking computational foundations there were a few attempts, but mostly small hybrid ANNs 2. addressing semantics in cellular automata and neural networks using large-scale network of coupled neural units for high-level semantic feature extraction normally used for low-level image processing or visual cortical modeling (e.g., PCNNs, CNNs) 3. advocating pattern formation in neural modeling many physical, chemical, and biological media exhibit pattern formation; as a complex system, too, the brain produces forms = spatiotemporal patterns of activity yet, not a main field of research 4. suggesting wave dynamics in neural organization waves open a rich space of temporal coding for mesoscopic neural modeling, between micro neural activities and macro mental objects August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 44
45 Pattern formation Stationary patterns Mammal fur, seashells, and insect wings (Scott Camazine, August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 45
46 Pattern formation in excitable media Physical-chemical media Rayleigh-Benard convection cells in liquid heated uniformly from below (Manuel Velarde, Universidad Complutense, Madrid.) Circular and spiral traveling waves in Belousov-Zhabotinsky reaction (Arthur Winfree, University of Arizona.) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 46
47 Pattern formation in excitable media Multicellular structures Spiral waves in the heart in a model of a dog heart (James Keener, University of Utah.) Wave patterns in aggregating slime mold amoebas (Brian Goodwin, Schumacher College, UK.) Differential gene expression stripes in fruit fly embryo (Steve Paddock, Howard Hughes Medical Institute) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 47
48 Pattern formation in excitable media Retina of the chicken Dark front of spreading depression rotating on the retina of a chicken (40-second interval frames) (Gorelova and Bures, 1983) August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 48
49 A Morphodynamical Model of Spatial Cognitive Categories 1. Spatial categorization 2. Cellular automaton model 3. Spiking neural model 4. Discussion August 2005 Doursat, R. & Petitot, J. - A morphodynamical model of spatial cognitive categories 49
Cognitive morphodynamics:
Cognitive morphodynamics: Viewing semantic categorization as a pattern formation process in complex neural systems René Doursat Institut des Systèmes Complexes Paris Ile-de-France Ecole Polytechnique &
Neural Networks 1 Synchronization in Spiking Neural Networks
CS 790R Seminar Modeling & Simulation Neural Networks 1 Synchronization in Spiking Neural Networks René Doursat Department of Computer Science & Engineering University of Nevada, Reno Spring 2006 Synchronization
Synchronization in Spiking Neural Networks
CS 790R Seminar Modeling & Simulation Synchronization in Spiking Neural Networks ~ Lecture 8 ~ René Doursat Department of Computer Science & Engineering University of Nevada, Reno Spring 2005 Synchronization
Cognitive semantics and cognitive theories of representation: Session 6: Conceptual spaces
Cognitive semantics and cognitive theories of representation: Session 6: Conceptual spaces Martin Takáč Centre for cognitive science DAI FMFI Comenius University in Bratislava Príprava štúdia matematiky
Foreign Languages and Their Teaching
2002 2 155 Foreign Languages and Their Teaching 2002 2 Serial 155 : (1969 ) : :2001-06 - 21 ( 200433) : : ; ; ; Abstract :This paper deals with the guidance of cognitive linguistics in vocabulary teaching
Perceiving Geometric Patterns: From Spirals to Inside Outside Relations
1084 IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 12, NO. 5, SEPTEMBER 2001 Perceiving Geometric Patterns: From Spirals to Inside Outside Relations Ke Chen, Senior Member, IEEE, and DeLiang Wang, Senior
Elements of Neurogeometry
Lecture Notes in Morphogenesis Series Editor: Alessandro Sarti Jean Petitot Elements of Neurogeometry Functional Architectures of Vision http://www.springer.com/978-3-319-65589-5 Contents 1 Preface...
Influence of Criticality on 1/f α Spectral Characteristics of Cortical Neuron Populations
Influence of Criticality on 1/f α Spectral Characteristics of Cortical Neuron Populations Robert Kozma rkozma@memphis.edu Computational Neurodynamics Laboratory, Department of Computer Science 373 Dunn
Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)
Machine Learning Neural Networks (slides from Domingos, Pardo, others) Human Brain Neurons Input-Output Transformation Input Spikes Output Spike Spike (= a brief pulse) (Excitatory Post-Synaptic Potential)
Computational Models of Complex Systems
CS 790R Seminar Modeling & Simulation Computational Models of Complex Systems ~ Introductory Lecture 2 ~ René Doursat Department of Computer Science & Engineering University of Nevada, Reno Spring 2005
Pattern Recognition System with Top-Down Process of Mental Rotation
Pattern Recognition System with Top-Down Process of Mental Rotation Shunji Satoh 1, Hirotomo Aso 1, Shogo Miyake 2, and Jousuke Kuroiwa 3 1 Department of Electrical Communications, Tohoku University Aoba-yama05,
An Introductory Course in Computational Neuroscience
An Introductory Course in Computational Neuroscience Contents Series Foreword Acknowledgments Preface 1 Preliminary Material 1.1. Introduction 1.1.1 The Cell, the Circuit, and the Brain 1.1.2 Physics of
Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)
Machine Learning Neural Networks (slides from Domingos, Pardo, others) For this week, Reading Chapter 4: Neural Networks (Mitchell, 1997) See Canvas For subsequent weeks: Scaling Learning Algorithms toward
SINGLE-ELECTRON CIRCUITS PERFORMING DENDRITIC PATTERN FORMATION WITH NATURE-INSPIRED CELLULAR AUTOMATA
International Journal of Bifurcation and Chaos, Vol. 7, No. (7) 365 3655 c World Scientific Publishing Company SINGLE-ELECTRON CIRCUITS PERFORMING DENDRITIC PATTERN FORMATION WITH NATURE-INSPIRED CELLULAR
Toward a Better Understanding of Complexity
Toward a Better Understanding of Complexity Definitions of Complexity, Cellular Automata as Models of Complexity, Random Boolean Networks Christian Jacob jacob@cpsc.ucalgary.ca Department of Computer Science
Perceiving Spirals and Inside/Outside Relations by A Neural Oscillator Network
Perceiving Spirals and Inside/Outside Relations by A Neural Oscillator Network Ke Chen and DeLiang L. Wang Department of Computer and Information Science and Center for Cognitive Science The Ohio State
Complex Systems Made Simple
Complex Systems Made Simple 1. Introduction 2. A Complex Systems Sampler a. Cellular automata b. Pattern formation c. Swarm intelligence d. Complex networks e. Spatial communities f. Structured morphogenesis
Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)
Machine Learning Neural Networks (slides from Domingos, Pardo, others) For this week, Reading Chapter 4: Neural Networks (Mitchell, 1997) See Canvas For subsequent weeks: Scaling Learning Algorithms toward
CHAPTER 4 RELAXATION OSCILLATORS WITH TIME DELAY COUPLING
CHAPTER 4 RELAXATION OSCILLATORS WITH TIME DELAY COUPLING 4.1 Introduction Thus far we have studied synchronization in networks of locally coupled neurobiologically based oscillator models. One additional
Synchrony and Desynchrony in Integrate-and-Fire Oscillators
LETTER Communicated by David Terman Synchrony and Desynchrony in Integrate-and-Fire Oscillators Shannon R. Campbell Department of Physics, The Ohio State University, Columbus, Ohio 43210, U.S.A. DeLiang
DEVS Simulation of Spiking Neural Networks
DEVS Simulation of Spiking Neural Networks Rene Mayrhofer, Michael Affenzeller, Herbert Prähofer, Gerhard Höfer, Alexander Fried Institute of Systems Science Systems Theory and Information Technology Johannes
Motion Perception 1. PSY305 Lecture 12 JV Stone
Motion Perception 1 PSY305 Lecture 12 JV Stone 1 Structure Human visual system as a band-pass filter. Neuronal motion detection, the Reichardt detector. The aperture problem. 2 The visual system is a temporal
Harmonically Guided Evolution. Richard S. Merrick
Harmonically Guided Evolution Richard S. Merrick Richard@InterferenceTheory.com www.interferencetheory.com Key Points Discussed 1. Shows how Darwinian theory is incomplete. 2. Shows how carbon-water resonance
PULSE-COUPLED networks (PCNs) of integrate-and-fire
1018 IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 15, NO. 5, SEPTEMBER 2004 Grouping Synchronization in a Pulse-Coupled Network of Chaotic Spiking Oscillators Hidehiro Nakano, Student Member, IEEE, and Toshimichi
Part 8: Neural Networks
METU Informatics Institute Min720 Pattern Classification ith Bio-Medical Applications Part 8: Neural Netors - INTRODUCTION: BIOLOGICAL VS. ARTIFICIAL Biological Neural Netors A Neuron: - A nerve cell as
Systems Biology Across Scales: A Personal View XXVI. Waves in Biology: From cells & tissue to populations. Sitabhra Sinha IMSc Chennai
Systems Biology Across Scales: A Personal View XXVI. Waves in Biology: From cells & tissue to populations Sitabhra Sinha IMSc Chennai Spiral Waves in Biological Excitable Media Ca ++ waves in cytoplasm
Hestenes lectures, Part 5. Summer 1997 at ASU to 50 teachers in their 3 rd Modeling Workshop
Hestenes lectures, Part 5. Summer 1997 at ASU to 50 teachers in their 3 rd Modeling Workshop WHAT DO WE TEACH? The question What do we teach? has to do with What do we want to learn? A common instructional
Nature-inspired Analog Computing on Silicon
Nature-inspired Analog Computing on Silicon Tetsuya ASAI and Yoshihito AMEMIYA Division of Electronics and Information Engineering Hokkaido University Abstract We propose CMOS analog circuits that emulate
DIFFERENTIATION MORPHOGENESIS GROWTH HOW CAN AN IDENTICAL SET OF GENETIC INSTRUCTIONS PRODUCE DIFFERENT TYPES OF CELLS?
DIFFERENTIATION HOW CAN AN IDENTICAL SET OF GENETIC INSTRUCTIONS PRODUCE DIFFERENT TYPES OF CELLS? MORPHOGENESIS HOW CAN CELLS FORM ORDERED STRUCTURES? GROWTH HOW DO OUR CELLS KNOW WHEN TO STOP DIVIDING
Effect of Noise on the Performance of the Temporally-Sequenced Intelligent Block-Matching and Motion-Segmentation Algorithm
Effect of Noise on the Performance of the Temporally-Sequenced Intelligent Block-Matching and Motion-Segmentation Algorithm Xiaofu Zhang Complex Adaptive Systems Laboratory ECECS Department University
Learning Cycle Linear Hybrid Automata for Excitable Cells
Learning Cycle Linear Hybrid Automata for Excitable Cells Sayan Mitra Joint work with Radu Grosu, Pei Ye, Emilia Entcheva, I V Ramakrishnan, and Scott Smolka HSCC 2007 Pisa, Italy Excitable Cells Outline
Spatial language: Meaning, use, and lexical choice
Spatial language: Meaning, use, and lexical choice Kristen Johannes (kjohann@wested.org) Science Technology Engineering and Mathematics Program, WestEd 300 Lakeside Dr., Oakland, CA 94612 USA Barbara Landau
Motivation. Evolution has rediscovered several times multicellularity as a way to build complex living systems
Cellular Systems 1 Motivation Evolution has rediscovered several times multicellularity as a way to build complex living systems Multicellular systems are composed by many copies of a unique fundamental
Table of Contents. General Introduction... Part 1. Introduction... 3
Table of Contents General Introduction... xi PART 1. THE STRUCTURE OF THE GEOGRAPHIC SPACE... 1 Part 1. Introduction... 3 Chapter 1. Structure and System Concepts... 5 1.1. The notion of structure... 5
CHAPTER 3 SYNCHRONY IN RELAXATION OSCILLATORS
CHAPTER 3 SYNCHRONY IN RELAXATION OSCILLATORS 3.1 Introduction The phrase relaxation oscillations was coined by van der Pol in 1926 in his analysis of a triode circuit [van der Pol, 1926]. A relaxation
1. Synchronization Phenomena
1. Synchronization Phenomena In nature synchronization happens all the time. In mechanical systems, in biological systems, in epidemiology, basically everywhere. When we talk about synchronization we usually
Heaving Toward Speciation
Temporal Waves of Genetic Diversity in a Spatially Explicit Model of Evolution: Heaving Toward Speciation Guy A. Hoelzer 1, Rich Drewes 2 and René Doursat 2,3 1 Department of Biology, 2 Brain Computation
A Three-dimensional Physiologically Realistic Model of the Retina
A Three-dimensional Physiologically Realistic Model of the Retina Michael Tadross, Cameron Whitehouse, Melissa Hornstein, Vicky Eng and Evangelia Micheli-Tzanakou Department of Biomedical Engineering 617
Artificial Neural Network and Fuzzy Logic
Artificial Neural Network and Fuzzy Logic 1 Syllabus 2 Syllabus 3 Books 1. Artificial Neural Networks by B. Yagnanarayan, PHI - (Cover Topologies part of unit 1 and All part of Unit 2) 2. Neural Networks
Discrete and Indiscrete Models of Biological Networks
Discrete and Indiscrete Models of Biological Networks Winfried Just Ohio University November 17, 2010 Who are we? What are we doing here? Who are we? What are we doing here? A population of interacting
ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD
ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD WHAT IS A NEURAL NETWORK? The simplest definition of a neural network, more properly referred to as an 'artificial' neural network (ANN), is provided
Neuroevolution for sound event detection in real life audio: A pilot study
Neuroevolution for sound event detection in real life audio: A pilot study Christian Kroos & Mark D. Plumbley Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, UK Background
Stochastic Model for Adaptation Using Basin Hopping Dynamics
Stochastic Model for Adaptation Using Basin Hopping Dynamics Peter Davis NTT Communication Science Laboratories 2-4 Hikaridai, Keihanna Science City, Kyoto, Japan 619-0237 davis@cslab.kecl.ntt.co.jp Abstract
Localized activity patterns in excitatory neuronal networks
Localized activity patterns in excitatory neuronal networks Jonathan Rubin Amitabha Bose February 3, 2004 Abstract. The existence of localized activity patterns, or bumps, has been investigated in a variety
Simulation of mixing of heterogeneous HE components
Chapter Simulation of mixing of heterogeneous HE components The majority on high explosives (HEs) used are blend ones. Properties of components differ that produces interaction on the grain scale (mesoprocesses).
Part 1. Modeling the Relationships between Societies and Nature... 1
Contents Introduction........................................ xi Part 1. Modeling the Relationships between Societies and Nature............................................ 1 Chapter 1. The Theoretical
IDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS OF A FIXED POINT IN A DISCRETE-TIME OSCILLATOR NETWORK
International Journal of Innovative Computing, Information and Control ICIC International c 203 ISSN 349-498 Volume 9, Number, January 203 pp. 355 363 IDENTIFICATION OF TARGET IMAGE REGIONS BASED ON BIFURCATIONS
2 1. Introduction. Neuronal networks often exhibit a rich variety of oscillatory behavior. The dynamics of even a single cell may be quite complicated
GEOMETRIC ANALYSIS OF POPULATION RHYTHMS IN SYNAPTICALLY COUPLED NEURONAL NETWORKS J. Rubin and D. Terman Dept. of Mathematics; Ohio State University; Columbus, Ohio 43210 Abstract We develop geometric
11. Automata and languages, cellular automata, grammars, L-systems
11. Automata and languages, cellular automata, grammars, L-systems 11.1 Automata and languages Automaton (pl. automata): in computer science, a simple model of a machine or of other systems. ( a simplification
Introduction to Neural Networks
Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning
DESIGNING CNN GENES. Received January 23, 2003; Revised April 2, 2003
Tutorials and Reviews International Journal of Bifurcation and Chaos, Vol. 13, No. 10 (2003 2739 2824 c World Scientific Publishing Company DESIGNING CNN GENES MAKOTO ITOH Department of Information and
Asaf Bar Zvi Adi Hayat. Semantic Segmentation
Asaf Bar Zvi Adi Hayat Semantic Segmentation Today s Topics Fully Convolutional Networks (FCN) (CVPR 2015) Conditional Random Fields as Recurrent Neural Networks (ICCV 2015) Gaussian Conditional random
Adventures in Multicellularity
Adventures in Multicellularity The social amoeba (a.k.a. slime molds) Dictyostelium discoideum Dictyostelium discoideum the most studied of the social amoebae / cellular slime molds predatory soil amoeba
Contents Three Sources and Three Component Parts of the Concept of Dissipative Solitons Solitons in Viscous Flows
Three Sources and Three Component Parts of the Concept of Dissipative Solitons... 1 N. Akhmediev and A. Ankiewicz 1 Introduction...... 1 2 Cubic-Quintic Complex Ginzburg Landau Equation........ 7 3 TheMethodofMoments...
Phase Locking. 1 of of 10. The PRC's amplitude determines which frequencies a neuron locks to. The PRC's slope determines if locking is stable
Printed from the Mathematica Help Browser 1 1 of 10 Phase Locking A neuron phase-locks to a periodic input it spikes at a fixed delay [Izhikevich07]. The PRC's amplitude determines which frequencies a
Interacting Vehicles: Rules of the Game
Chapter 7 Interacting Vehicles: Rules of the Game In previous chapters, we introduced an intelligent control method for autonomous navigation and path planning. The decision system mainly uses local information,
StarLogo Simulation of Streaming Aggregation. Demonstration of StarLogo Simulation of Streaming. Differentiation & Pattern Formation.
StarLogo Simulation of Streaming Aggregation 1. chemical diffuses 2. if cell is refractory (yellow) 3. then chemical degrades 4. else (it s excitable, colored white) 1. if chemical > movement threshold
Synchronization and Desynchronization in a Network of Locally Coupled Wilson-Cowan Oscillators
OSU-CISRC-8/94-TR43 Synchronization and Desynchronization in a Network of Locally Coupled Wilson-Cowan Oscillators Shannon Campbell and DeLiang Wang Department of Physics Laboratory for Artificial Intelligence
Self-organized Criticality and Synchronization in a Pulse-coupled Integrate-and-Fire Neuron Model Based on Small World Networks
Commun. Theor. Phys. (Beijing, China) 43 (2005) pp. 466 470 c International Academic Publishers Vol. 43, No. 3, March 15, 2005 Self-organized Criticality and Synchronization in a Pulse-coupled Integrate-and-Fire
A Model for Real-Time Computation in Generic Neural Microcircuits
A Model for Real-Time Computation in Generic Neural Microcircuits Wolfgang Maass, Thomas Natschläger Institute for Theoretical Computer Science Technische Universitaet Graz A-81 Graz, Austria maass, tnatschl
Introduction Biologically Motivated Crude Model Backpropagation
Introduction Biologically Motivated Crude Model Backpropagation 1 McCulloch-Pitts Neurons In 1943 Warren S. McCulloch, a neuroscientist, and Walter Pitts, a logician, published A logical calculus of the
Problem Set Number 2, j/2.036j MIT (Fall 2014)
Problem Set Number 2, 18.385j/2.036j MIT (Fall 2014) Rodolfo R. Rosales (MIT, Math. Dept.,Cambridge, MA 02139) Due Mon., September 29, 2014. 1 Inverse function problem #01. Statement: Inverse function
Visual Selection and Attention Shifting Based on FitzHugh-Nagumo Equations
Visual Selection and Attention Shifting Based on FitzHugh-Nagumo Equations Haili Wang, Yuanhua Qiao, Lijuan Duan, Faming Fang, Jun Miao 3, and Bingpeng Ma 3 College of Applied Science, Beijing University
Self-correcting Symmetry Detection Network
Self-correcting Symmetry Detection Network Wonil hang 1,yunAhSong 2, Sang-oon Oh 3, and Soo-Young Lee 1,2 1 Department of Bio and Brain Engineering, 2 Department of Electrical Engineering, KAIST, Daejeon
Self-Organization and Collective Decision Making in Animal and Human Societies
Self-Organization and Collective Decision Making... Frank Schweitzer SYSS Dresden 31 March 26 1 / 23 Self-Organization and Collective Decision Making in Animal and Human Societies Frank Schweitzer fschweitzer@ethz.ch
Topological target patterns and population oscillations in a network with random gap junctional coupling
0 0 0 0 Neurocomputing }0 (00) } Topological target patterns and population oscillations in a network with random gap junctional coupling Timothy J. Lewis*, John Rinzel Center for Neural Science and Courant
Examples of Excitable Media. Excitable Media. Characteristics of Excitable Media. Behavior of Excitable Media. Part 2: Cellular Automata 9/7/04
Examples of Excitable Media Excitable Media Slime mold amoebas Cardiac tissue (& other muscle tissue) Cortical tissue Certain chemical systems (e.g., BZ reaction) Hodgepodge machine 9/7/04 1 9/7/04 2 Characteristics
(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann
(Feed-Forward) Neural Networks 2016-12-06 Dr. Hajira Jabeen, Prof. Jens Lehmann Outline In the previous lectures we have learned about tensors and factorization methods. RESCAL is a bilinear model for
The functional organization of the visual cortex in primates
The functional organization of the visual cortex in primates Dominated by LGN M-cell input Drosal stream for motion perception & spatial localization V5 LIP/7a V2 V4 IT Ventral stream for object recognition
Leo Kadanoff and 2d XY Models with Symmetry-Breaking Fields. renormalization group study of higher order gradients, cosines and vortices
Leo Kadanoff and d XY Models with Symmetry-Breaking Fields renormalization group study of higher order gradients, cosines and vortices Leo Kadanoff and Random Matrix Theory Non-Hermitian Localization in
Research and Reviews: Journal of Pure and Applied Physics. Further Remarks on the Oscillating Universe: an Explicative Approach
Further Remarks on the Oscillating Universe: an Explicative Approach Carmine Cataldo* Independent Researcher, PhD in Mechanical Engineering, Italy Review Article Received: 24/08/2016 Revised: 27/08/2016
Region Description for Recognition
Region Description for Recognition For object recognition, descriptions of regions in an image have to be compared with descriptions of regions of meaningful objects (models). The general problem of object
Neural Nets and Symbolic Reasoning Hopfield Networks
Neural Nets and Symbolic Reasoning Hopfield Networks Outline The idea of pattern completion The fast dynamics of Hopfield networks Learning with Hopfield networks Emerging properties of Hopfield networks
Complex Systems Made Simple
Erasmus Mundus Masters in Complex Systems Science Complex Systems Made Simple by Agent-Based Modeling and Simulation René Doursat http://iscpif.fr/~doursat Course Contents What this course is about (dense
To cognize is to categorize revisited: Category Theory is where Mathematics meets Biology
To cognize is to categorize revisited: Category Theory is where Mathematics meets Biology Autonomous Systems Laboratory Technical University of Madrid Index 1. Category Theory 2. The structure-function
Dynamical Constraints on Computing with Spike Timing in the Cortex
Appears in Advances in Neural Information Processing Systems, 15 (NIPS 00) Dynamical Constraints on Computing with Spike Timing in the Cortex Arunava Banerjee and Alexandre Pouget Department of Brain and
Interactive Chalkboard
1 Interactive Chalkboard 1 Table of Contents Unit 1: Energy and Motion Chapter 1: The Nature of Science 1.1: The Methods of Science 1.2: Standards of Measurement 1.3: Communicating with Graphs 1.1 The
The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception
The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception Takashi Kanamaru Department of Mechanical Science and ngineering, School of Advanced
DYNAMICS OF THREE COUPLED VAN DER POL OSCILLATORS WITH APPLICATION TO CIRCADIAN RHYTHMS
Proceedings of IDETC/CIE 2005 ASME 2005 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference September 24-28, 2005, Long Beach, California USA DETC2005-84017
Annales UMCS Informatica AI 1 (2003) UMCS. Liquid state machine built of Hodgkin-Huxley neurons pattern recognition and informational entropy
Annales UMC Informatica AI 1 (2003) 107-113 Annales UMC Informatica Lublin-Polonia ectio AI http://www.annales.umcs.lublin.pl/ Liquid state machine built of Hodgkin-Huxley neurons pattern recognition and
Northwestern Connecticut Community College Course Syllabus
Northwestern Connecticut Community College Course Syllabus Course Title: Introductory Physics Course #: PHY 110 Course Description: 4 credits (3 class hours and 3 laboratory hours per week) Physics 110
Nondeterministic Kinetics Based Feature Clustering for Fractal Pattern Coding
Nondeterministic Kinetics Based Feature Clustering for Fractal Pattern Coding Kohji Kamejima Faculty of Engineering, Osaka Institute of Technology 5-16-1 Omiya, Asahi, Osaka 535-8585 JAPAN Tel: +81 6 6954-4330;
Classification goals: Make 1 guess about the label (Top-1 error) Make 5 guesses about the label (Top-5 error) No Bounding Box
ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton Motivation Classification goals: Make 1 guess about the label (Top-1 error) Make 5 guesses
COMP304 Introduction to Neural Networks based on slides by:
COMP34 Introduction to Neural Networks based on slides by: Christian Borgelt http://www.borgelt.net/ Christian Borgelt Introduction to Neural Networks Motivation: Why (Artificial) Neural Networks? (Neuro-)Biology
Self-Excited Vibration
Wenjing Ding Self-Excited Vibration Theory, Paradigms, and Research Methods With 228 figures Ö Springer Contents Chapter 1 Introduction 1 1.1 Main Features of Self-Excited Vibration 1 1.1.1 Natural Vibration
Effects of Interactive Function Forms in a Self-Organized Critical Model Based on Neural Networks
Commun. Theor. Phys. (Beijing, China) 40 (2003) pp. 607 613 c International Academic Publishers Vol. 40, No. 5, November 15, 2003 Effects of Interactive Function Forms in a Self-Organized Critical Model
Stable and Efficient Representation Learning with Nonnegativity Constraints. Tsung-Han Lin and H.T. Kung
Stable and Efficient Representation Learning with Nonnegativity Constraints Tsung-Han Lin and H.T. Kung Unsupervised Representation Learning Layer 3 Representation Encoding Sparse encoder Layer 2 Representation
Biological Modeling of Neural Networks:
Week 14 Dynamics and Plasticity 14.1 Reservoir computing - Review:Random Networks - Computing with rich dynamics Biological Modeling of Neural Networks: 14.2 Random Networks - stationary state - chaos
The Duality of the Universe
The Duality of the Universe Gordon McCabe May 23, 2008 Abstract It is proposed that the physical universe is an instance of a mathematical structure which possesses a dual structure, and that this dual
Reification of Boolean Logic
526 U1180 neural networks 1 Chapter 1 Reification of Boolean Logic The modern era of neural networks began with the pioneer work of McCulloch and Pitts (1943). McCulloch was a psychiatrist and neuroanatomist;
How to build a brain. Cognitive Modelling. Terry & Chris Centre for Theoretical Neuroscience University of Waterloo
How to build a brain Cognitive Modelling Terry & Chris Centre for Theoretical Neuroscience University of Waterloo So far... We have learned how to implement high-dimensional vector representations linear
Analog CMOS Circuits Implementing Neural Segmentation Model Based on Symmetric STDP Learning
Analog CMOS Circuits Implementing Neural Segmentation Model Based on Symmetric STDP Learning Gessyca Maria Tovar, Eric Shun Fukuda,TetsuyaAsai, Tetsuya Hirose, and Yoshihito Amemiya Hokkaido University,
Key Words: geospatial ontologies, formal concept analysis, semantic integration, multi-scale, multi-context.
Marinos Kavouras & Margarita Kokla Department of Rural and Surveying Engineering National Technical University of Athens 9, H. Polytechniou Str., 157 80 Zografos Campus, Athens - Greece Tel: 30+1+772-2731/2637,
Causality and communities in neural networks
Causality and communities in neural networks Leonardo Angelini, Daniele Marinazzo, Mario Pellicoro, Sebastiano Stramaglia TIRES-Center for Signal Detection and Processing - Università di Bari, Bari, Italy
Northwestern CT Community College Course Syllabus. Course Title: CALCULUS-BASED PHYSICS I with Lab Course #: PHY 221
Northwestern CT Community College Course Syllabus Course Title: CALCULUS-BASED PHYSICS I with Lab Course #: PHY 221 Course Description: 4 credits (3 class hours and 3 laboratory hours per week) Physics
Chapter I : Basic Notions
Chapter I : Basic Notions - Image Processing - Lattices - Residues - Measurements J. Serra Ecole des Mines de Paris ( 2000 ) Course on Math. Morphology I. 1 Image Processing (I) => Image processing may
Localized Excitations in Networks of Spiking Neurons
Localized Excitations in Networks of Spiking Neurons Hecke Schrobsdorff Bernstein Center for Computational Neuroscience Göttingen Max Planck Institute for Dynamics and Self-Organization Seminar: Irreversible
MECHANICS: LINEAR MECHANICS QUESTIONS
MECHANICS: LINEAR MECHANICS QUESTIONS QUESTION ONE (2017;1) Two astronauts, Sylvia and Sam, are on a mission to another planet. During their journey they are doing a spacewalk outside their spaceship.
arxiv: v3 [q-bio.nc] 17 Oct 2018
![arxiv: v3 [q-bio.nc] 17 Oct 2018](/thumbs/96/126993392.jpg "arxiv: v3 [q-bio.nc] 17 Oct 2018")
Evaluating performance of neural codes in model neural communication networks Chris G. Antonopoulos 1, Ezequiel Bianco-Martinez 2 and Murilo S. Baptista 3 October 18, 2018 arxiv:1709.08591v3 [q-bio.nc]
Space, Time and Units Fundamental Vision
13 Space, Time and Units Fundamental Vision G.V.Sharlanov E-mail: gsharlanov@yahoo.com Abstract The change of the units between two time-spatial domains with different gravitational potentials is analyzed