Supervisor: Prof. Stefano Spaccapietra Dr. Fabio Porto Student: Yuanjian Wang Zufferey. EPFL - Computer Science - LBD 1

Size: px
Start display at page:

Download "Supervisor: Prof. Stefano Spaccapietra Dr. Fabio Porto Student: Yuanjian Wang Zufferey. EPFL - Computer Science - LBD 1"

Transcription

1 Supervisor: Prof. Stefano Spaccapietra Dr. Fabio Porto Student: Yuanjian Wang Zufferey EPFL - Computer Science - LBD 1

2 Introduction Related Work Proposed Solution Implementation Important Results Conclusion Future work EPFL - Computer Science - LBD 2

3 Background Problem Statement EPFL - Computer Science - LBD 3

4 Fast growing g knowledge collection on the Neuroscience Biologists: Biological neural information Experiment Data Mathematicians, ti i physicians, i and computer scientists: Computational neural model information Simulation data EPFL - Computer Science - LBD 4

5 Two kinds of data Meta data Basal Knowledge about the biological neuron Such as the physiology of a neuron computational model Such as the mathematic model High dimension data Experiment data from biological experiments Simulation data from simulations of computational model EPFL - Computer Science - LBD 5

6 User requirements: Basic knowledge storage, such as neural biological structure, computational composition Comparison between different computational model on the same biological neural structure Interpretation of the connection between biological and computational aspect on the same biological neural structure Bridge between biological experiment and simulation of computational model EPFL - Computer Science - LBD 6

7 Common knowledge database NeuronDB Save a computational model as a package written by some program languages, such as MatLab, NEURON, JAVA, C++ Few or no biological information Can t compare different computational model easily Can t find the connection between the biological experiment and computational simulation EPFL - Computer Science - LBD 7

8 Traditional database manager systems Predefined schema Can t compare high dimension data Semantic web applications Well defined conceptual schema to supply annotations Using Ontology reasoners or other intelligent tools Can t mine the high dimension data EPFL - Computer Science - LBD 8

9 Artificial intelligence Machine learning Supervised Learning Know in advance the classes Need training data: typical examples Unsupervised learning classes and typical examples are not available Solving cluster problem Reinforcement learning Real time system EPFL - Computer Science - LBD 9

10 Summary Learning Database Architecture Concept Model Unsupervised Machine Learning - Competitive Learning EPFL - Computer Science - LBD 10

11 Traditional data management system combined with machine learning Learning database well-formed storage Easy retrieval tool Find the possible hidden similarity between biological data and simulated data by one of the unsupervised machine learning algorithm - competitive learning algorithm EPFL - Computer Science - LBD 11

12 EPFL - Computer Science - LBD 12

13 Object-Oriented UML definition Easy to be understand by developers A standard XML format Easy to share information between different users Easy to compare the biological and computational information Easy to be used by the ontology reasoners or be mined by other intelligent agents Easy to communicate between different existing database EPFL - Computer Science - LBD 13

14 Biological neuron example A pyramidal neural cell: Neuron_Classification: multipolar neuron OrganInstance: hippocampus or cerebral cortex Compartments: a triangularly shaped soma a single apical dendrite multiple basal dendrites a single axon ElectricalProperty: K + channels on dendrites EPFL - Computer Science - LBD 14

15 Biological Neuron information EPFL - Computer Science - LBD 15

16 Computational p Model Example Simple Model of Spiking Neurons: Two equations: Three variables Four parameters EPFL - Computer Science - LBD 16

17 ReadInterface I WriteInterface u and v Hypothesis Hodgkin-Huxley-type yp dynamics and integrate-and fire BiologicalQuestion Spiking and bursting behavior of known types of cortical neurons Reference Izhikevich artificial neuron model from EM Izhikevich "Simple Model of Spiking Neurons IEEE Transactions On Neural Networks, Vol. 14, No. 6, November 2003 pp EPFL - Computer Science - LBD 17

18 Computational Model information EPFL - Computer Science - LBD 18

19 Connection between biological information and Computational Model by BiologicalExplanation: for example, equation definition: EPFL - Computer Science - LBD 19

20 Simulation Example Two computational models: M1:Computational_Model_Na M2:Computational_Model_K Neural cell with 3 compartments: Soma, Axon Dendrite Simulated Element: M1 and M2 applied on the membrane of each of the three compartments with different initial conditions, stop conditions and parameter settings EPFL - Computer Science - LBD 20

21 Simulation information EPFL - Computer Science - LBD 21

22 Predefined annotations for mining EPFL - Computer Science - LBD 22

23 Important Definitions Dimension: The number of points in one-dimension vector, such as X=, m is the dimension of vector X. Prototype: The center of cluster or a typical example of the data in a cluster Data Clustering: A technique for data analysis by partitioning a data set into subsets whose elements share common traits. Correlated Prototypes: The pair of prototypes that the cross-correlation between them is greater than predefine threshold. It means they may represent the same cluster. EPFL - Computer Science - LBD 23

24 K-means Competitive Learning Time consummation is great, slow to be converged Dead units and number of classes (clusters) unknown Results depends on the initial prototypes Need to recalculate all when new sample come Kohonen Competitive Learning Simple, need to decrease learning rate to be converged Dead units and number of classes unknown Results depends on the initial prototypes Fuzzy-C-Means Competitive Learning Partial membership in classes Results depends on the initial prototypes Need to recalculate l all when new sample come Principal component analysis (PCA) Works for the homologous same type of data Need to recalculate all when new sample come EPFL - Computer Science - LBD 24

25 Kohonen Competitive Learning Define more prototypes More dead units at beginning But not to miss real prototype Randomly initialize prototypes Cit Criteriai guarantee few correlated prototypes Reinitialize prototypes when samples scale grows to get better precision Decrease learning rate when samples size grows Learn fast at beginning, g slowly later EPFL - Computer Science - LBD 25

26 This project is implemented in Oracle by using the PL/SQL language Query tool: The semester project of EasyQueries of laboratory of Databases of EPFL in 2007 (author: Ariane Pasquier, supervised by Dr. Fabio Porto) EPFL - Computer Science - LBD 26

27 Possibility to reduce the dimension for the homologous data samples EPFL - Computer Science - LBD 27

28 To improve the quality of the clusters when the samples number has grown in some scales: Initialize the prototypes Execute the competitive i learning again EPFL - Computer Science - LBD 28

29 To improve the performance in Oracle: By using external tools such as Matlab to execute the learning algorithm Oracle serves as the storage and retrieval tools EPFL - Computer Science - LBD 29

30 What has been done in this project: A database stores the biological and computational neural information, also the experiment and simulation i information i A database learns from the high dimension data series or graph information to find the cluster information EPFL - Computer Science - LBD 30

31 An intelligent input tool: Editor Import tool PCA To reduce the dimension of homologous data samples External Competitive learning interface Phylogenetic tree From bottom to up From detail to general EPFL - Computer Science - LBD 31

32 Thanks Prof. Stefano Spaccapietra p to have accepted my proposition for this project. Thanks for the help of Dr. Fabio Porto during the whole work. Thanks the support of my family. Questions EPFL - Computer Science - LBD 32

33 Cluster analysis. (2008, June 17). In Wikipedia, The Free Encyclopedia. Retrieved 14:58, June 17, 2008, from / /i d h t l i ldid Neuron. (2008, May 18). In Wikipedia, the Free Encyclopedia. Retrieved 08:16, May 26, 2008, from Membrane potential. (2008, May 21). In Wikipedia, The Free Encyclopedia. Retrieved 08:14, May 26, 2008, from p p p p Pyramidal cell. (2008, May 8). In Wikipedia, The Free Encyclopedia. Retrieved 13:46, May 26, 2008, from Izhikevich artificial neuron model from EM Izhikevich "Simple Model of Spiking Neurons" IEEE Transactions On Neural Networks, Vol. 14, No. 6, November 2003 pp Kanungo, T. Mount, D.M. Netanyahu, N.S. Piatko, C.D. Silverman, R. Wu, A.Y.: An Efficient k-means Clustering Algorithm:Analysis and Implementation. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 24, NO. 7, JULY 2002 IBM Corporation, August, ng/dsqk2mst365.htm IBM Corporation, August, ng/dsqk2mst339.htm Ariane Pasquier: User Manul of EasyQueries. EPFL Semester Project April EPFL - Computer Science - LBD 33

34 Hines ML, Morse T, Migliore M, Carnevale NT, Shepherd GM. ModelDB: A Database to Support Computational Neuroscience. J Comput Neurosci Jul-Aug;17(1):7-11. Heng Tao Shen, Xiaofang Zhou, Aoying Zhou: An adaptive and dynamic imensionality reduction method for high-dimensional indexing. The VLDB Journal (2007) 16(2): Wikipedia contributors, 'Machine learning', Wikipedia, The Free Encyclopedia, 11 June 2008, 20:59 UTC, p p p g Neuroscience. (2008, June 10). In Wikipedia, The Free Encyclopedia. Retrieved 14:09, June 17, 2008, from Moving average. (2008, June 4). In Wikipedia, The Free Encyclopedia. Retrieved 07:27, June 18, 2008, from Moving_average&oldid= Principal components analysis. (2008, June 16). In Wikipedia, The Free Encyclopedia. Retrieved 07:45, June 18, 2008, from T. Kohonen Self-Organization and Associative Memory. Springer-Verlag Verlag, Berlin Heidelberg, 1989 H.Nielsen. Neurocomputing. Addison-Wesley, Redwood City EPFL - Computer Science - LBD 34

35 EPFL - Computer Science - LBD 35

36 K-means Fuzzy-C-means Kohonen (http: //spie.org/x24069.xml) PCA (3-dimensional gene expression samples are project onto a 2-dimensional component space) ( EPFL - Computer Science - LBD 36

37 The distance is usually defined as the Euclidian norm: The prototype j with a minimum distance is named winner: The prototype vector is moved a certain proportion of the distance between it and the sample: EPFL - Computer Science - LBD 37

38 Tree of life Hand written digits EPFL - Computer Science - LBD 38

An Introductory Course in Computational Neuroscience

An Introductory Course in Computational Neuroscience An Introductory Course in Computational Neuroscience Contents Series Foreword Acknowledgments Preface 1 Preliminary Material 1.1. Introduction 1.1.1 The Cell, the Circuit, and the Brain 1.1.2 Physics of

More information

Neural Modeling and Computational Neuroscience. Claudio Gallicchio

Neural Modeling and Computational Neuroscience. Claudio Gallicchio Neural Modeling and Computational Neuroscience Claudio Gallicchio 1 Neuroscience modeling 2 Introduction to basic aspects of brain computation Introduction to neurophysiology Neural modeling: Elements

More information

EE04 804(B) Soft Computing Ver. 1.2 Class 2. Neural Networks - I Feb 23, Sasidharan Sreedharan

EE04 804(B) Soft Computing Ver. 1.2 Class 2. Neural Networks - I Feb 23, Sasidharan Sreedharan EE04 804(B) Soft Computing Ver. 1.2 Class 2. Neural Networks - I Feb 23, 2012 Sasidharan Sreedharan www.sasidharan.webs.com 3/1/2012 1 Syllabus Artificial Intelligence Systems- Neural Networks, fuzzy logic,

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE 4: Linear Systems Summary # 3: Introduction to artificial neural networks DISTRIBUTED REPRESENTATION An ANN consists of simple processing units communicating with each other. The basic elements of

More information

Model of a Biological Neuron as a Temporal Neural Network

Model of a Biological Neuron as a Temporal Neural Network Model of a Biological Neuron as a Temporal Neural Network Sean D. Murphy and Edward W. Kairiss Interdepartmental Neuroscience Program, Department of Psychology, and The Center for Theoretical and Applied

More information

Annales UMCS Informatica AI 1 (2003) UMCS. Liquid state machine built of Hodgkin-Huxley neurons pattern recognition and informational entropy

Annales UMCS Informatica AI 1 (2003) UMCS. Liquid state machine built of Hodgkin-Huxley neurons pattern recognition and informational entropy Annales UMC Informatica AI 1 (2003) 107-113 Annales UMC Informatica Lublin-Polonia ectio AI http://www.annales.umcs.lublin.pl/ Liquid state machine built of Hodgkin-Huxley neurons pattern recognition and

More information

Using Variable Threshold to Increase Capacity in a Feedback Neural Network

Using Variable Threshold to Increase Capacity in a Feedback Neural Network Using Variable Threshold to Increase Capacity in a Feedback Neural Network Praveen Kuruvada Abstract: The article presents new results on the use of variable thresholds to increase the capacity of a feedback

More information

Artificial Neural Network and Fuzzy Logic

Artificial Neural Network and Fuzzy Logic Artificial Neural Network and Fuzzy Logic 1 Syllabus 2 Syllabus 3 Books 1. Artificial Neural Networks by B. Yagnanarayan, PHI - (Cover Topologies part of unit 1 and All part of Unit 2) 2. Neural Networks

More information

Fast and exact simulation methods applied on a broad range of neuron models

Fast and exact simulation methods applied on a broad range of neuron models Fast and exact simulation methods applied on a broad range of neuron models Michiel D Haene michiel.dhaene@ugent.be Benjamin Schrauwen benjamin.schrauwen@ugent.be Ghent University, Electronics and Information

More information

Neural Networks Introduction

Neural Networks Introduction Neural Networks Introduction H.A Talebi Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Winter 2011 H. A. Talebi, Farzaneh Abdollahi Neural Networks 1/22 Biological

More information

Signal, donnée, information dans les circuits de nos cerveaux

Signal, donnée, information dans les circuits de nos cerveaux NeuroSTIC Brest 5 octobre 2017 Signal, donnée, information dans les circuits de nos cerveaux Claude Berrou Signal, data, information: in the field of telecommunication, everything is clear It is much less

More information

Hopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5

Hopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5 Hopfield Neural Network and Associative Memory Typical Myelinated Vertebrate Motoneuron (Wikipedia) PHY 411-506 Computational Physics 2 1 Wednesday, March 5 1906 Nobel Prize in Physiology or Medicine.

More information

Biological Modeling of Neural Networks

Biological Modeling of Neural Networks Week 4 part 2: More Detail compartmental models Biological Modeling of Neural Networks Week 4 Reducing detail - Adding detail 4.2. Adding detail - apse -cable equat Wulfram Gerstner EPFL, Lausanne, Switzerland

More information

Introduction and Perceptron Learning

Introduction and Perceptron Learning Artificial Neural Networks Introduction and Perceptron Learning CPSC 565 Winter 2003 Christian Jacob Department of Computer Science University of Calgary Canada CPSC 565 - Winter 2003 - Emergent Computing

More information

Intelligent GIS: Automatic generation of qualitative spatial information

Intelligent GIS: Automatic generation of qualitative spatial information Intelligent GIS: Automatic generation of qualitative spatial information Jimmy A. Lee 1 and Jane Brennan 1 1 University of Technology, Sydney, FIT, P.O. Box 123, Broadway NSW 2007, Australia janeb@it.uts.edu.au

More information

Extending the Associative Rule Chaining Architecture for Multiple Arity Rules

Extending the Associative Rule Chaining Architecture for Multiple Arity Rules Extending the Associative Rule Chaining Architecture for Multiple Arity Rules Nathan Burles, James Austin, and Simon O Keefe Advanced Computer Architectures Group Department of Computer Science University

More information

COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS

COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS Proceedings of the First Southern Symposium on Computing The University of Southern Mississippi, December 4-5, 1998 COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS SEAN

More information

INTRODUCTION TO NEURAL NETWORKS

INTRODUCTION TO NEURAL NETWORKS INTRODUCTION TO NEURAL NETWORKS R. Beale & T.Jackson: Neural Computing, an Introduction. Adam Hilger Ed., Bristol, Philadelphia and New York, 990. THE STRUCTURE OF THE BRAIN The brain consists of about

More information

Brains and Computation

Brains and Computation 15-883: Computational Models of Neural Systems Lecture 1.1: Brains and Computation David S. Touretzky Computer Science Department Carnegie Mellon University 1 Models of the Nervous System Hydraulic network

More information

This is a repository copy of Improving the associative rule chaining architecture.

This is a repository copy of Improving the associative rule chaining architecture. This is a repository copy of Improving the associative rule chaining architecture. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/75674/ Version: Accepted Version Book Section:

More information

Computational Biology Course Descriptions 12-14

Computational Biology Course Descriptions 12-14 Computational Biology Course Descriptions 12-14 Course Number and Title INTRODUCTORY COURSES BIO 311C: Introductory Biology I BIO 311D: Introductory Biology II BIO 325: Genetics CH 301: Principles of Chemistry

More information

Artificial Neural Networks Examination, June 2005

Artificial Neural Networks Examination, June 2005 Artificial Neural Networks Examination, June 2005 Instructions There are SIXTY questions. (The pass mark is 30 out of 60). For each question, please select a maximum of ONE of the given answers (either

More information

An objective function for self-limiting neural plasticity rules.

An objective function for self-limiting neural plasticity rules. ESANN 5 proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges (Belgium), -4 April 5, i6doc.com publ., ISBN 978-875874-8. An objective function

More information

Artifical Neural Networks

Artifical Neural Networks Neural Networks Artifical Neural Networks Neural Networks Biological Neural Networks.................................. Artificial Neural Networks................................... 3 ANN Structure...........................................

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning

More information

Instituto Tecnológico y de Estudios Superiores de Occidente Departamento de Electrónica, Sistemas e Informática. Introductory Notes on Neural Networks

Instituto Tecnológico y de Estudios Superiores de Occidente Departamento de Electrónica, Sistemas e Informática. Introductory Notes on Neural Networks Introductory Notes on Neural Networs Dr. José Ernesto Rayas Sánche April Introductory Notes on Neural Networs Dr. José Ernesto Rayas Sánche BIOLOGICAL NEURAL NETWORKS The brain can be seen as a highly

More information

Identification and Control of Nonlinear Systems using Soft Computing Techniques

Identification and Control of Nonlinear Systems using Soft Computing Techniques International Journal of Modeling and Optimization, Vol. 1, No. 1, April 011 Identification and Control of Nonlinear Systems using Soft Computing Techniques Wahida Banu.R.S.D, ShakilaBanu.A and Manoj.D

More information

Introduction to Artificial Neural Networks

Introduction to Artificial Neural Networks Facultés Universitaires Notre-Dame de la Paix 27 March 2007 Outline 1 Introduction 2 Fundamentals Biological neuron Artificial neuron Artificial Neural Network Outline 3 Single-layer ANN Perceptron Adaline

More information

DISCRETE EVENT SIMULATION IN THE NEURON ENVIRONMENT

DISCRETE EVENT SIMULATION IN THE NEURON ENVIRONMENT Hines and Carnevale: Discrete event simulation in the NEURON environment Page 1 Preprint of a manuscript that will be published in Neurocomputing. DISCRETE EVENT SIMULATION IN THE NEURON ENVIRONMENT Abstract

More information

McGill University > Schulich School of Music > MUMT 611 > Presentation III. Neural Networks. artificial. jason a. hockman

McGill University > Schulich School of Music > MUMT 611 > Presentation III. Neural Networks. artificial. jason a. hockman jason a. hockman Overvie hat is a neural netork? basics and architecture learning applications in music History 1940s: William McCulloch defines neuron 1960s: Perceptron 1970s: limitations presented (Minsky)

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks CPSC 533 Winter 2 Christian Jacob Neural Networks in the Context of AI Systems Neural Networks as Mediators between Symbolic AI and Statistical Methods 2 5.-NeuralNets-2.nb Neural

More information

Neural Network to Control Output of Hidden Node According to Input Patterns

Neural Network to Control Output of Hidden Node According to Input Patterns American Journal of Intelligent Systems 24, 4(5): 96-23 DOI:.5923/j.ajis.2445.2 Neural Network to Control Output of Hidden Node According to Input Patterns Takafumi Sasakawa, Jun Sawamoto 2,*, Hidekazu

More information

Data Preprocessing. Cluster Similarity

Data Preprocessing. Cluster Similarity 1 Cluster Similarity Similarity is most often measured with the help of a distance function. The smaller the distance, the more similar the data objects (points). A function d: M M R is a distance on M

More information

Data Mining Part 5. Prediction

Data Mining Part 5. Prediction Data Mining Part 5. Prediction 5.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline How the Brain Works Artificial Neural Networks Simple Computing Elements Feed-Forward Networks Perceptrons (Single-layer,

More information

A FINITE STATE AUTOMATON MODEL FOR MULTI-NEURON SIMULATIONS

A FINITE STATE AUTOMATON MODEL FOR MULTI-NEURON SIMULATIONS A FINITE STATE AUTOMATON MODEL FOR MULTI-NEURON SIMULATIONS Maria Schilstra, Alistair Rust, Rod Adams and Hamid Bolouri Science and Technology Research Centre, University of Hertfordshire, UK Department

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks Philipp Koehn 4 April 205 Linear Models We used before weighted linear combination of feature values h j and weights λ j score(λ, d i ) = j λ j h j (d i ) Such models can

More information

Computational Neuroscience. Lubica Benuskova Lecture 1

Computational Neuroscience. Lubica Benuskova Lecture 1 Computational Neuroscience Lubica Benuskova Lecture 1 1 Outline Brief history of Computational Neuroscience, i.e. computational modelling of biological neurons Blue Brain project Basic concepts of computational

More information

PV021: Neural networks. Tomáš Brázdil

PV021: Neural networks. Tomáš Brázdil 1 PV021: Neural networks Tomáš Brázdil 2 Course organization Course materials: Main: The lecture Neural Networks and Deep Learning by Michael Nielsen http://neuralnetworksanddeeplearning.com/ (Extremely

More information

Neural Networks: Introduction

Neural Networks: Introduction Neural Networks: Introduction Machine Learning Fall 2017 Based on slides and material from Geoffrey Hinton, Richard Socher, Dan Roth, Yoav Goldberg, Shai Shalev-Shwartz and Shai Ben-David, and others 1

More information

Lecture 7 Artificial neural networks: Supervised learning

Lecture 7 Artificial neural networks: Supervised learning Lecture 7 Artificial neural networks: Supervised learning Introduction, or how the brain works The neuron as a simple computing element The perceptron Multilayer neural networks Accelerated learning in

More information

Optimization Methods for Machine Learning (OMML)

Optimization Methods for Machine Learning (OMML) Optimization Methods for Machine Learning (OMML) 2nd lecture (2 slots) Prof. L. Palagi 16/10/2014 1 What is (not) Data Mining? By Namwar Rizvi - Ad Hoc Query: ad Hoc queries just examines the current data

More information

Contents Why use NEURON ( 5-10 mins) Basics of NEURON (20-25 mins) Exercises (45 mins) Wrap Up (10 mins)

Contents Why use NEURON ( 5-10 mins) Basics of NEURON (20-25 mins) Exercises (45 mins) Wrap Up (10 mins) Contents Why use NEURON ( 5-10 mins) 3 Basics of NEURON (20-25 mins) 8 Exercises (45 mins) 27 Wrap Up (10 mins) 28 (Many thanks to David Sterratt (Uni of Edinburgh) for allowing the use of his tutorials

More information

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 BIOLOGICAL INSPIRATIONS Some numbers The human brain contains about 10 billion nerve cells (neurons) Each neuron is connected to the others through 10000

More information

Reinforcement Learning, Neural Networks and PI Control Applied to a Heating Coil

Reinforcement Learning, Neural Networks and PI Control Applied to a Heating Coil Reinforcement Learning, Neural Networks and PI Control Applied to a Heating Coil Charles W. Anderson 1, Douglas C. Hittle 2, Alon D. Katz 2, and R. Matt Kretchmar 1 1 Department of Computer Science Colorado

More information

Artificial neural networks

Artificial neural networks Artificial neural networks Chapter 8, Section 7 Artificial Intelligence, spring 203, Peter Ljunglöf; based on AIMA Slides c Stuart Russel and Peter Norvig, 2004 Chapter 8, Section 7 Outline Brains Neural

More information

Probabilistic Models in Theoretical Neuroscience

Probabilistic Models in Theoretical Neuroscience Probabilistic Models in Theoretical Neuroscience visible unit Boltzmann machine semi-restricted Boltzmann machine restricted Boltzmann machine hidden unit Neural models of probabilistic sampling: introduction

More information

CN2 1: Introduction. Paul Gribble. Sep 10,

CN2 1: Introduction. Paul Gribble. Sep 10, CN2 1: Introduction Paul Gribble http://gribblelab.org Sep 10, 2012 Administrivia Class meets Mondays, 2:00pm - 3:30pm and Thursdays, 11:30am - 1:00pm, in NSC 245A Contact me with any questions or to set

More information

An artificial neural networks (ANNs) model is a functional abstraction of the

An artificial neural networks (ANNs) model is a functional abstraction of the CHAPER 3 3. Introduction An artificial neural networs (ANNs) model is a functional abstraction of the biological neural structures of the central nervous system. hey are composed of many simple and highly

More information

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann (Feed-Forward) Neural Networks 2016-12-06 Dr. Hajira Jabeen, Prof. Jens Lehmann Outline In the previous lectures we have learned about tensors and factorization methods. RESCAL is a bilinear model for

More information

hsnim: Hyper Scalable Network Inference Machine for Scale-Free Protein-Protein Interaction Networks Inference

hsnim: Hyper Scalable Network Inference Machine for Scale-Free Protein-Protein Interaction Networks Inference CS 229 Project Report (TR# MSB2010) Submitted 12/10/2010 hsnim: Hyper Scalable Network Inference Machine for Scale-Free Protein-Protein Interaction Networks Inference Muhammad Shoaib Sehgal Computer Science

More information

Bursting and Chaotic Activities in the Nonlinear Dynamics of FitzHugh-Rinzel Neuron Model

Bursting and Chaotic Activities in the Nonlinear Dynamics of FitzHugh-Rinzel Neuron Model Bursting and Chaotic Activities in the Nonlinear Dynamics of FitzHugh-Rinzel Neuron Model Abhishek Yadav *#, Anurag Kumar Swami *, Ajay Srivastava * * Department of Electrical Engineering, College of Technology,

More information

Neuronal Dynamics: Computational Neuroscience of Single Neurons

Neuronal Dynamics: Computational Neuroscience of Single Neurons Week 4 part 5: Nonlinear Integrate-and-Fire Model 4.1 From Hodgkin-Huxley to 2D Neuronal Dynamics: Computational Neuroscience of Single Neurons Week 4 Recing detail: Two-dimensional neuron models Wulfram

More information

First-order deduction in neural networks

First-order deduction in neural networks First-order deduction in neural networks Ekaterina Komendantskaya 1 Department of Mathematics, University College Cork, Cork, Ireland e.komendantskaya@mars.ucc.ie Abstract. We show how the algorithm of

More information

Sean Escola. Center for Theoretical Neuroscience

Sean Escola. Center for Theoretical Neuroscience Employing hidden Markov models of neural spike-trains toward the improved estimation of linear receptive fields and the decoding of multiple firing regimes Sean Escola Center for Theoretical Neuroscience

More information

Artificial Neural Networks The Introduction

Artificial Neural Networks The Introduction Artificial Neural Networks The Introduction 01001110 01100101 01110101 01110010 01101111 01101110 01101111 01110110 01100001 00100000 01110011 01101011 01110101 01110000 01101001 01101110 01100001 00100000

More information

Cortical neural networks: light-microscopy-based anatomical reconstruction, numerical simulation and analysis

Cortical neural networks: light-microscopy-based anatomical reconstruction, numerical simulation and analysis Cortical neural networks: light-microscopy-based anatomical reconstruction, numerical simulation and analysis Hans-Christian Hege Berlin Workshop on Statistics and Neuroimaging 2011, Weierstrass Institute,

More information

CSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture

CSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture CSE/NB 528 Final Lecture: All Good Things Must 1 Course Summary Where have we been? Course Highlights Where do we go from here? Challenges and Open Problems Further Reading 2 What is the neural code? What

More information

Spiking Neural P Systems and Modularization of Complex Networks from Cortical Neural Network to Social Networks

Spiking Neural P Systems and Modularization of Complex Networks from Cortical Neural Network to Social Networks Spiking Neural P Systems and Modularization of Complex Networks from Cortical Neural Network to Social Networks Adam Obtu lowicz Institute of Mathematics, Polish Academy of Sciences Śniadeckich 8, P.O.B.

More information

In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required.

In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required. In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required. In humans, association is known to be a prominent feature of memory.

More information

Effects of Interactive Function Forms in a Self-Organized Critical Model Based on Neural Networks

Effects of Interactive Function Forms in a Self-Organized Critical Model Based on Neural Networks Commun. Theor. Phys. (Beijing, China) 40 (2003) pp. 607 613 c International Academic Publishers Vol. 40, No. 5, November 15, 2003 Effects of Interactive Function Forms in a Self-Organized Critical Model

More information

Neural Networks for Two-Group Classification Problems with Monotonicity Hints

Neural Networks for Two-Group Classification Problems with Monotonicity Hints Neural Networks for Two-Group Classification Problems with Monotonicity Hints P. Lory 1, D. Gietl Institut für Wirtschaftsinformatik, Universität Regensburg, D-93040 Regensburg, Germany Abstract: Neural

More information

Lecture 4: Feed Forward Neural Networks

Lecture 4: Feed Forward Neural Networks Lecture 4: Feed Forward Neural Networks Dr. Roman V Belavkin Middlesex University BIS4435 Biological neurons and the brain A Model of A Single Neuron Neurons as data-driven models Neural Networks Training

More information

Application of Associative Matrices to Recognize DNA Sequences in Bioinformatics

Application of Associative Matrices to Recognize DNA Sequences in Bioinformatics Application of Associative Matrices to Recognize DNA Sequences in Bioinformatics 1. Introduction. Jorge L. Ortiz Department of Electrical and Computer Engineering College of Engineering University of Puerto

More information

SPATIAL-TEMPORAL TECHNIQUES FOR PREDICTION AND COMPRESSION OF SOIL FERTILITY DATA

SPATIAL-TEMPORAL TECHNIQUES FOR PREDICTION AND COMPRESSION OF SOIL FERTILITY DATA SPATIAL-TEMPORAL TECHNIQUES FOR PREDICTION AND COMPRESSION OF SOIL FERTILITY DATA D. Pokrajac Center for Information Science and Technology Temple University Philadelphia, Pennsylvania A. Lazarevic Computer

More information

ECE 521. Lecture 11 (not on midterm material) 13 February K-means clustering, Dimensionality reduction

ECE 521. Lecture 11 (not on midterm material) 13 February K-means clustering, Dimensionality reduction ECE 521 Lecture 11 (not on midterm material) 13 February 2017 K-means clustering, Dimensionality reduction With thanks to Ruslan Salakhutdinov for an earlier version of the slides Overview K-means clustering

More information

Client-Server Architecture for a Neural Simulation Tool

Client-Server Architecture for a Neural Simulation Tool Client-Server Architecture for a Neural Simulation Tool Olga Kroupina and Raúl Rojas Institute of Computer Science Free University of Berlin Takustr. 9, D-14195 Berlin Germany ABSTRACT NeuroSim is a simulator

More information

Iterative face image feature extraction with Generalized Hebbian Algorithm and a Sanger-like BCM rule

Iterative face image feature extraction with Generalized Hebbian Algorithm and a Sanger-like BCM rule Iterative face image feature extraction with Generalized Hebbian Algorithm and a Sanger-like BCM rule Clayton Aldern (Clayton_Aldern@brown.edu) Tyler Benster (Tyler_Benster@brown.edu) Carl Olsson (Carl_Olsson@brown.edu)

More information

CISC 3250 Systems Neuroscience

CISC 3250 Systems Neuroscience CISC 3250 Systems Neuroscience Systems Neuroscience How the nervous system performs computations How groups of neurons work together to achieve intelligence Professor Daniel Leeds dleeds@fordham.edu JMH

More information

Star-Structured High-Order Heterogeneous Data Co-clustering based on Consistent Information Theory

Star-Structured High-Order Heterogeneous Data Co-clustering based on Consistent Information Theory Star-Structured High-Order Heterogeneous Data Co-clustering based on Consistent Information Theory Bin Gao Tie-an Liu Wei-ing Ma Microsoft Research Asia 4F Sigma Center No. 49 hichun Road Beijing 00080

More information

Topic Models and Applications to Short Documents

Topic Models and Applications to Short Documents Topic Models and Applications to Short Documents Dieu-Thu Le Email: dieuthu.le@unitn.it Trento University April 6, 2011 1 / 43 Outline Introduction Latent Dirichlet Allocation Gibbs Sampling Short Text

More information

Bayesian Networks Inference with Probabilistic Graphical Models

Bayesian Networks Inference with Probabilistic Graphical Models 4190.408 2016-Spring Bayesian Networks Inference with Probabilistic Graphical Models Byoung-Tak Zhang intelligence Lab Seoul National University 4190.408 Artificial (2016-Spring) 1 Machine Learning? Learning

More information

Artificial Neural Networks Examination, March 2004

Artificial Neural Networks Examination, March 2004 Artificial Neural Networks Examination, March 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum

More information

CS:4420 Artificial Intelligence

CS:4420 Artificial Intelligence CS:4420 Artificial Intelligence Spring 2018 Neural Networks Cesare Tinelli The University of Iowa Copyright 2004 18, Cesare Tinelli and Stuart Russell a a These notes were originally developed by Stuart

More information

NEURON - tutorial D of Gillies & Sterratt (part 1) http://www.anc.ed.ac.uk/school/neuron/ Lubica Benuskova Lecture 10 How to program ion channels with NMODL 1 Introduction: our current goal So far our

More information

Phase Response Curves, Delays and Synchronization in Matlab

Phase Response Curves, Delays and Synchronization in Matlab Phase Response Curves, Delays and Synchronization in Matlab W. Govaerts and B. Sautois Department of Applied Mathematics and Computer Science, Ghent University, Krijgslaan 281-S9, B-9000 Ghent, Belgium

More information

New Delhi & Affiliated to VTU, Belgavi ) Oorgaum, Kolar Dist ,Karnataka

New Delhi & Affiliated to VTU, Belgavi ) Oorgaum, Kolar Dist ,Karnataka Design and Implementation of Logic Gates and Adder Circuits on FPGA Using ANN Neelu Farha 1., Ann Louisa Paul J 2., Naadiya Kousar L S 3., Devika S 4., Prof. Ruckmani Divakaran 5 1,2,3,4,5 Department of

More information

Behavioural Simulation of Biological Neuron Systems using VHDL and VHDL-AMS

Behavioural Simulation of Biological Neuron Systems using VHDL and VHDL-AMS Behavioural Simulation of Biological Neuron Systems using VHDL and VHDL-AMS J.A. Bailey 1, P.R. Wilson 1, A.D. Brown 1 and J.E. Chad 2 School of Electronics and Computer Science 1 & School of Biological

More information

Processing of Time Series by Neural Circuits with Biologically Realistic Synaptic Dynamics

Processing of Time Series by Neural Circuits with Biologically Realistic Synaptic Dynamics Processing of Time Series by Neural Circuits with iologically Realistic Synaptic Dynamics Thomas Natschläger & Wolfgang Maass Institute for Theoretical Computer Science Technische Universität Graz, ustria

More information

Discrete and Indiscrete Models of Biological Networks

Discrete and Indiscrete Models of Biological Networks Discrete and Indiscrete Models of Biological Networks Winfried Just Ohio University November 17, 2010 Who are we? What are we doing here? Who are we? What are we doing here? A population of interacting

More information

How do biological neurons learn? Insights from computational modelling of

How do biological neurons learn? Insights from computational modelling of How do biological neurons learn? Insights from computational modelling of neurobiological experiments Lubica Benuskova Department of Computer Science University of Otago, New Zealand Brain is comprised

More information

Using a Hopfield Network: A Nuts and Bolts Approach

Using a Hopfield Network: A Nuts and Bolts Approach Using a Hopfield Network: A Nuts and Bolts Approach November 4, 2013 Gershon Wolfe, Ph.D. Hopfield Model as Applied to Classification Hopfield network Training the network Updating nodes Sequencing of

More information

In the Name of God. Lecture 9: ANN Architectures

In the Name of God. Lecture 9: ANN Architectures In the Name of God Lecture 9: ANN Architectures Biological Neuron Organization of Levels in Brains Central Nervous sys Interregional circuits Local circuits Neurons Dendrite tree map into cerebral cortex,

More information

Dynamic Classification of Power Systems via Kohonen Neural Network

Dynamic Classification of Power Systems via Kohonen Neural Network Dynamic Classification of Power Systems via Kohonen Neural Network S.F Mahdavizadeh Iran University of Science & Technology, Tehran, Iran M.A Sandidzadeh Iran University of Science & Technology, Tehran,

More information

Deconstructing Actual Neurons

Deconstructing Actual Neurons 1 Deconstructing Actual Neurons Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 Reference: The many ionic

More information

Iterative Laplacian Score for Feature Selection

Iterative Laplacian Score for Feature Selection Iterative Laplacian Score for Feature Selection Linling Zhu, Linsong Miao, and Daoqiang Zhang College of Computer Science and echnology, Nanjing University of Aeronautics and Astronautics, Nanjing 2006,

More information

Neural networks. Chapter 19, Sections 1 5 1

Neural networks. Chapter 19, Sections 1 5 1 Neural networks Chapter 19, Sections 1 5 Chapter 19, Sections 1 5 1 Outline Brains Neural networks Perceptrons Multilayer perceptrons Applications of neural networks Chapter 19, Sections 1 5 2 Brains 10

More information

All-or-None Principle and Weakness of Hodgkin-Huxley Mathematical Model

All-or-None Principle and Weakness of Hodgkin-Huxley Mathematical Model All-or-None Principle and Weakness of Hodgkin-Huxley Mathematical Model S. A. Sadegh Zadeh, C. Kambhampati International Science Index, Mathematical and Computational Sciences waset.org/publication/10008281

More information

A Modified Incremental Principal Component Analysis for On-Line Learning of Feature Space and Classifier

A Modified Incremental Principal Component Analysis for On-Line Learning of Feature Space and Classifier A Modified Incremental Principal Component Analysis for On-Line Learning of Feature Space and Classifier Seiichi Ozawa 1, Shaoning Pang 2, and Nikola Kasabov 2 1 Graduate School of Science and Technology,

More information

Linearization of F-I Curves by Adaptation

Linearization of F-I Curves by Adaptation LETTER Communicated by Laurence Abbott Linearization of F-I Curves by Adaptation Bard Ermentrout Department of Mathematics, University of Pittsburgh, Pittsburgh, PA 15260, U.S.A. We show that negative

More information

Application of Artificial Neural Network for Short Term Load Forecasting

Application of Artificial Neural Network for Short Term Load Forecasting aerd Scientific Journal of Impact Factor(SJIF): 3.134 e-issn(o): 2348-4470 p-issn(p): 2348-6406 International Journal of Advance Engineering and Research Development Volume 2,Issue 4, April -2015 Application

More information

BACHELOR OF TECHNOLOGY DEGREE PROGRAM IN COMPUTER SCIENCE AND ENGINEERING B.TECH (COMPUTER SCIENCE AND ENGINEERING) Program,

BACHELOR OF TECHNOLOGY DEGREE PROGRAM IN COMPUTER SCIENCE AND ENGINEERING B.TECH (COMPUTER SCIENCE AND ENGINEERING) Program, BACHELOR OF TECHNOLOGY DEGREE PROGRAM IN COMPUTER SCIENCE AND ENGINEERING B.TECH (COMPUTER SCIENCE AND ENGINEERING) Program, 2018-2022 3.1 PROGRAM CURRICULUM 3.1.1 Mandatory Courses and Credits The B.Tech

More information

System Identification for the Hodgkin-Huxley Model using Artificial Neural Networks

System Identification for the Hodgkin-Huxley Model using Artificial Neural Networks Proceedings of International Joint Conference on Neural Networks, Orlando, Florida, USA, August 12-17, 2007 System Identification for the Hodgkin-Huxley Model using Artificial Neural Networks Manish Saggar,

More information

Neural Networks. Chapter 18, Section 7. TB Artificial Intelligence. Slides from AIMA 1/ 21

Neural Networks. Chapter 18, Section 7. TB Artificial Intelligence. Slides from AIMA   1/ 21 Neural Networks Chapter 8, Section 7 TB Artificial Intelligence Slides from AIMA http://aima.cs.berkeley.edu / 2 Outline Brains Neural networks Perceptrons Multilayer perceptrons Applications of neural

More information

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller 2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks Todd W. Neller Machine Learning Learning is such an important part of what we consider "intelligence" that

More information

An Effective Approach to Fuzzy Ontologies Alignment

An Effective Approach to Fuzzy Ontologies Alignment , pp.73-82 http://dx.doi.org/10.14257/ijdta.2014.7.3.08 An Effective Approach to Fuzzy Ontologies Alignment Ling Qiu 1 and Yong Liu 2 1 School of Computer Science, Sichuan University of Science and Engineering

More information

80% of all excitatory synapses - at the dendritic spines.

80% of all excitatory synapses - at the dendritic spines. Dendritic Modelling Dendrites (from Greek dendron, tree ) are the branched projections of a neuron that act to conduct the electrical stimulation received from other cells to and from the cell body, or

More information

A Study on Energy Artificial Neuron Model and Its Applications in Self-growing and Self-organizing Neural Network

A Study on Energy Artificial Neuron Model and Its Applications in Self-growing and Self-organizing Neural Network A Study on Energy Artificial Neuron Model and Its Applications in Self-growing and Self-organizing Neural Network Hao Liu*, **. Xiaojuan Ban*, ***. Zhuoran Xu*, **. Masahito Kurihara** *Department of Computer

More information

ClassCast: A Tool for Class-Based Forecasting

ClassCast: A Tool for Class-Based Forecasting c Springer, 19th International GI/ITG Conference on Measurement, Modelling and Evaluation of Computing Systems (MMB). This is an author s version of the work with permission of Springer. Not for redistribution.

More information

Text Mining. Dr. Yanjun Li. Associate Professor. Department of Computer and Information Sciences Fordham University

Text Mining. Dr. Yanjun Li. Associate Professor. Department of Computer and Information Sciences Fordham University Text Mining Dr. Yanjun Li Associate Professor Department of Computer and Information Sciences Fordham University Outline Introduction: Data Mining Part One: Text Mining Part Two: Preprocessing Text Data

More information

Enhancing Generalization Capability of SVM Classifiers with Feature Weight Adjustment

Enhancing Generalization Capability of SVM Classifiers with Feature Weight Adjustment Enhancing Generalization Capability of SVM Classifiers ith Feature Weight Adjustment Xizhao Wang and Qiang He College of Mathematics and Computer Science, Hebei University, Baoding 07002, Hebei, China

More information