Application of SOM neural network in clustering
|
|
- Nathaniel Lang
- 6 years ago
- Views:
Transcription
1 J. Biomedical Science and Engineering, 2009, 2, doi: /jbise Published Online December 2009 ( Application of SOM neural network in clustering Soroor Behbahani 1, Ali Moti Nasrabadi 2 1 Biomedical Engineering Department, Science and Research Branch, Islamic Azad University, Tehran, Iran; 2 Biomedical Engineering Department, Faculty of Engineering, Shahed University, Tehran, Iran. soroor_behbahani@yahoo.com; a_m_nasrabadi@yahoo.com Received 11 June 2009; revised 29 June 2009; accepted 27 July ABSTRACT The Self-Organizing Map (SOM) is an unsupervised neural network algorithm that projects high-dimensional data onto a two-dimensional map. The projection preserves the topology of the data so that similar data items will be mapped to nearby locations on the map. One of the SOM neural network s applications is clustering of animals due their features. In this paper we produce an experiment to analyze the SOM in clustering different species of animals. Keywords: SOM Neural Network; Feature; Clustering; Animal 1. INTRODUCTION The Self-Organizing Map (SOM) is a fairly well-known neural network and indeed one of the most popular unsupervised learning algorithms. Since its invention by Finnish Professor Teuvo Kohonen in the early 1980s, more than 4000 research articles have been published on the algorithm, its visualization and applications. The maps comprehensively visualize natural groupings and relationships in the data and have been successfully applied in a broad spectrum of research areas ranging from speech recognition to financial analysis. The Self-organizing Map performs a non-linear projection of multidimensional data onto a two-dimensional display. The mapping is topology-preserving, meaning that the more alike two data samples are in the input space, the closer they will appear together on the final map. The SOM belongs to the class of Neural Network algorithms. This is a group of algorithms based on analogies to the neural structures of the brain. The SOM in particular was inspired by an interesting phenomenon: as physicians have discovered, some areas of brain tissue can be ordered according to an input signal. Basically, the SOM is a computer program simulating this biological ordering process. Applied to electronic datasets, the algorithm is capable of producing a map that shows similar input data items appearing close to each other. There are numerous applications involving the SOM algorithm but the most widespread use is the identification and visualization of natural groupings in the data. The process of finding similar items is generally referred to as clustering. Compared to the k-means clustering algorithm, the SOM exemplifies a robust and structured self-organizing neural networks are based on the principle of transforming a set of p-variate observations into a spatial representation of smaller dimensionality, which may allow a more effective visualization of correlations in the original data [4]. 2. SELF-ORGANIZING MAP The Self-Organizing Map belongs to the class of unsupervised and competitive learning algorithms. It is a sheet-like neural network, with nodes arranged as a regular, usually two-dimensional grid. As explained in the previous section on Neural Networks, we usually think of the node connections as being associated with a vector of weights. In the case of Self-Organizing Maps, it is easier to think of each node as being directly associated with a weight vector. The items in the input data set are assumed to be in a vector format. If n is the dimension of the input space, then every node on the map grid holds an n-dimensional vector of weights: mi = [mi1, mi2, mi3,., min] (1) The basic principle of the Self-Organizing Map is to adjust these weight vectors until the map represents a picture of the input data set. Since the number of map nodes is significantly smaller than the number of items in the dataset, it is needless to say that it is impossible to represent every input item from the data space on the map. Rather, the objective is to achieve a configuration in which the distribution of the data is reflected and the most important metric relationships are preserved. In particular, we are interested in obtaining a correlation between the similarity of items in the dataset and the distance of their most alike representatives on the map. In other words, items that are similar in the input space should map to nearby nodes on the grid [4]. Published Online December 2009 in SciRes.
2 638 S. Behbahani et al. / J. Biomedical Science and Engineering 2 (2009) Image s Characteristics To represent the 3D image of 12 lead ECG, three axes for time, temporal and spatial are needed witch temporal axis represented the time domain of the cardiac signal and the spatial axis represented the locations of the limb and thoracic leads. The data axis is represented two extracted features of cardiac signal contains amplitude and wavelet coefficients. 6 leads are used to represent the image obtained by thoracic leads and 6 leads of 12 are used to represent the image obtained by limb leads. In order to determine the information between consecutive leads in the spatial axis, an interpolation technique was used to witch could cause to homogeneousness of the image. 3. AN EXAMPLE OF SOM NEURAL NETWORK APPLICATION More researches are performing in the field of SOM neural network applications in last two decades. One of the most important and famous examples of this application is clustering of animals due their features. General features are using in this example based on the Kohonen animal data base (Table 1). But the fact is that, these features are not sufficient for different species of animals. In previous experiments, it had been assumed that there were only one species for each animal, whereas there may be exist more than 10 species for each special animal. So, for analyzing the ability of SOM neural network we perform a new experiment and assumed more than one species for them and increase the number of features to invent better separability. These features consist of geographical dispersion, nourishing and habitat, etc (Table 2). The SOM size in this research is 7*7 and the initial weights are selected randomly. Although there are 3 animals that are not settle in right location in SOM map, and selected wrong neurons, the results shows that extracted features could well separate the different species of animals. This result shows that the selected features for these 3 animals have not sufficient ability to separate them. This problem could be solved by adding extra features or choosing the features with more precise. One of the most important points in neural networks is the method of features extraction, but increasing the number of features could not always be the best solution for approving the results, because sometimes increasing the features lead to derangement in network. Another reason of bad result in neural networks relates to number of inputs. Increasing the number of inputs (animal species) leads to spreading the SOM size and could decrease the ability of it, because there would be more correlation between inputs, so the statistic of error will be increased. 4. RESULTS Choosing suitable features for separating animal s species lead to good results of SOM neural network.there were some similarity between some of the animal s feature in Kohonen data base. For example the features of Goose and Owl, as well as, horse and zebra are exactly the same. And this similarity leads to wrong results in clustering of these animals. Although there are some errors, in this new experiment, these errors occurred between different species of one animal not between different animals. So the more similarity between animal s species, the more errors will occur. Table 1. The animal data set. Animal Dove Hen Duck Goose Owl Hawk Eagle Fox Dog Wolf Cat Tiger Lion Horse Zebra Cow is Small Medium has Two kgs Four legs Hair Hooves Feathers likes to Hunt Run Fly Swim
3 S. Behbahani et al. / J. Biomedical Science and Engineering 2 (2009) Figure 1. SOM neural network resule. Table 2. Increasing number of features and animals species. Redfox Afghanfox EagleOw1 BrownfishOw1 LongearedOw1 ShortearedOw1 BarnOw1 Small Medium leg leg Hair Feathers Hunt Run Fly Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation
4 640 S. Behbahani et al. / J. Biomedical Science and Engineering 2 (2009) SakerFalcon LannerFalcon PeregrineFalcon OspreyEagle BootedEagle BonelliEagle SpottedEagle Small Medium leg leg Hair Mane Feathers Hunt Run Fly Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation LesserspottedEagle ImperialEagle GoldenEagle RedbreastedGoose GreylagGoose WithefrontedGoose SantherbertDog Small Medium leg leg Hair Feathers Hunt Run Fly Swim Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation
5 S. Behbahani et al. / J. Biomedical Science and Engineering 2 (2009) PointerDog WoodPigeon StockDove RockDove CollaredDave Wolf Kaiot Small Medium leg leg Hair Feathers Hunt Run Fly Swim Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation Tiger Lion Horse IranianZebra Zebra MarbledCat ChinchilaCat Small Medium Big leg leg Hair Hoove Mane Feathers Hunt Run Fly Swim Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation
6 642 S. Behbahani et al. / J. Biomedical Science and Engineering 2 (2009) AsiangolodenCat BlackearCat CaucasianblackGrouse MallardDuck GadwellDuck WigeonDuck PanitalDuck Small Medium Big leg leg Hair Feathers Hunt Run Fly Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation GarganeyDuck MarbledtealDuck BlackBear GrizliBear PandaBear OrangotanMonky ShampainMonky Small Medium Big leg leg Hair Feathers Hunt Run Fly Asia Africa Us Europe Mountainous Plain River Jungle Domestic Carnivorous Herbivorous Frugivorous Egg Milk Colour variation
7 S. Behbahani et al. / J. Biomedical Science and Engineering 2 (2009) CONCLUSIONS SOM is a highly useful multivariate visualization method that allows the multidimensional data to be displayed as a 2-dimensional map. This is the main advantage of SOM. The map units clustering makes it easy to observe similarities in the data. Through our experiment, we demonstrated that the possibility of quick observation of relationship between component (feature) and the class as well as the relationship among different component (feature) of the dataset from the visualization of a dataset. SOM is also capable of handling several types of classification problems while providing a useful, interactive, and intelligible summary of the data. However, SOM also has some disadvantages. For example, adjacent map units point to adjacent input data vector, so sometimes distortions are possible because high dimensional topography can not always be represented in 2D. To avoid such phenomenon, training rate and the neighborhood radius should not be reduced too quickly. Hence, SOM usually need many iterations of training. And SOM also does not provide an estimation of such map distortion. Alternatives to the SOM have been developed in order to overcome the theoretical problems and to enable probabilistic analysis. Current research showed a simple application of SOM neural network in clustering. This method can be used in many applications that need classification and one of them could be disease clustering. As seen in current research, we used fuzzy method to determine the features of each animal. Similar to this research, we can determine the features of diseases. This method could help the physician in their diagnosis. We can use the sign of diseases as the input of SOM neural network. As some classes of disease have similar symptoms the SOM neural network can show a limitation of neighbor diseases that have such symptoms, so the physician can focus on them to diagnose the patient s disease with more accuracy. Fuzzy features can increase the ability of SOM neural network if they choose carefully with more accuracy and of course it need some trail and error methods to find a rule to relate a membership function to each disease and its symptoms. REFERENCES [1] A. Forti, (2006) Growing hierarchical tree SOM: An unsupervised neural network with dynamic topology,, Gian Luca Foresti, Neural Networks, 19, [2] S. Haykin, (1999) Neural networks a comprehensive foundation (2nd ed.), Prentice Hall. [3] R. G. Adams, K. Butchart and N. Davey, (1999) Hierarchical classification with a competitive evolutionary neural tree, Neural Networks, 12, [4] J. Li, Information visualization of self organizing maps.
Formal Concept Analysis in a Nutshell
Outline 1 Concept lattices Data from a hospital Formal definitions More examples Outline 1 Concept lattices Data from a hospital Formal definitions More examples 2 Attribute logic Checking completeness
More informationIntroduction to Formal Concept Analysis
Introduction to Formal Concept Analysis 2nd International Conference of Formal Concept Analysis February 23 February 27, 2004 Sydney, Australia 1 Outline for the Tutorial: Presentation Short Break Practical
More informationARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92
ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 BIOLOGICAL INSPIRATIONS Some numbers The human brain contains about 10 billion nerve cells (neurons) Each neuron is connected to the others through 10000
More informationAnalysis of Interest Rate Curves Clustering Using Self-Organising Maps
Analysis of Interest Rate Curves Clustering Using Self-Organising Maps M. Kanevski (1), V. Timonin (1), A. Pozdnoukhov(1), M. Maignan (1,2) (1) Institute of Geomatics and Analysis of Risk (IGAR), University
More informationJae-Bong Lee 1 and Bernard A. Megrey 2. International Symposium on Climate Change Effects on Fish and Fisheries
International Symposium on Climate Change Effects on Fish and Fisheries On the utility of self-organizing maps (SOM) and k-means clustering to characterize and compare low frequency spatial and temporal
More informationContents. 1.Introduction
25/2/5 The 4th International Conference of the International Association for Computer Method and Advances in Geomechanics September 24, 24.Introduction Contents Method for hazard assessment to deep-seated
More informationApplication of hopfield network in improvement of fingerprint recognition process Mahmoud Alborzi 1, Abbas Toloie- Eshlaghy 1 and Dena Bazazian 2
5797 Available online at www.elixirjournal.org Computer Science and Engineering Elixir Comp. Sci. & Engg. 41 (211) 5797-582 Application hopfield network in improvement recognition process Mahmoud Alborzi
More informationNeural Networks Introduction
Neural Networks Introduction H.A Talebi Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Winter 2011 H. A. Talebi, Farzaneh Abdollahi Neural Networks 1/22 Biological
More informationarxiv: v1 [astro-ph] 12 Nov 2008
Self-Organizing Maps. An application to the OGLE data and the Gaia Science Alerts Łukasz Wyrzykowski, and Vasily Belokurov arxiv:0811.1808v1 [astro-ph] 12 Nov 2008 Institute of Astronomy, University of
More informationScuola di Calcolo Scientifico con MATLAB (SCSM) 2017 Palermo 31 Luglio - 4 Agosto 2017
Scuola di Calcolo Scientifico con MATLAB (SCSM) 2017 Palermo 31 Luglio - 4 Agosto 2017 www.u4learn.it Ing. Giuseppe La Tona Sommario Machine Learning definition Machine Learning Problems Artificial Neural
More informationNon-linear Measure Based Process Monitoring and Fault Diagnosis
Non-linear Measure Based Process Monitoring and Fault Diagnosis 12 th Annual AIChE Meeting, Reno, NV [275] Data Driven Approaches to Process Control 4:40 PM, Nov. 6, 2001 Sandeep Rajput Duane D. Bruns
More information6. Which of the following is not a basic need of all animals a. food b. friends c. water d. protection from predators
NAME SOL 4.5 Habitats, Niches and Adaptations POPULATION A group of the same species living in the same place at the same time. COMMUNITY-- All of the populations that live in the same area 6. Which of
More informationOrganisms & Environments Task Cards
Organisms & Environments Task Cards Organisms & Environments Task Cards Thank you so much for purchasing this product. I am truly appreciative of your business and I will happily respond to any of your
More informationData Mining Part 5. Prediction
Data Mining Part 5. Prediction 5.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline How the Brain Works Artificial Neural Networks Simple Computing Elements Feed-Forward Networks Perceptrons (Single-layer,
More informationÂngelo Cardoso 27 May, Symbolic and Sub-Symbolic Learning Course Instituto Superior Técnico
BIOLOGICALLY INSPIRED COMPUTER MODELS FOR VISUAL RECOGNITION Ângelo Cardoso 27 May, 2010 Symbolic and Sub-Symbolic Learning Course Instituto Superior Técnico Index Human Vision Retinal Ganglion Cells Simple
More informationDynamic Classification of Power Systems via Kohonen Neural Network
Dynamic Classification of Power Systems via Kohonen Neural Network S.F Mahdavizadeh Iran University of Science & Technology, Tehran, Iran M.A Sandidzadeh Iran University of Science & Technology, Tehran,
More informationArtificial Neural Networks. Edward Gatt
Artificial Neural Networks Edward Gatt What are Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning Very
More informationGLR-Entropy Model for ECG Arrhythmia Detection
, pp.363-370 http://dx.doi.org/0.4257/ijca.204.7.2.32 GLR-Entropy Model for ECG Arrhythmia Detection M. Ali Majidi and H. SadoghiYazdi,2 Department of Computer Engineering, Ferdowsi University of Mashhad,
More informationArtificial Neural Network and Fuzzy Logic
Artificial Neural Network and Fuzzy Logic 1 Syllabus 2 Syllabus 3 Books 1. Artificial Neural Networks by B. Yagnanarayan, PHI - (Cover Topologies part of unit 1 and All part of Unit 2) 2. Neural Networks
More informationProbabilistic Methods in Bioinformatics. Pabitra Mitra
Probabilistic Methods in Bioinformatics Pabitra Mitra pabitra@cse.iitkgp.ernet.in Probability in Bioinformatics Classification Categorize a new object into a known class Supervised learning/predictive
More informationRadial Basis Function Networks. Ravi Kaushik Project 1 CSC Neural Networks and Pattern Recognition
Radial Basis Function Networks Ravi Kaushik Project 1 CSC 84010 Neural Networks and Pattern Recognition History Radial Basis Function (RBF) emerged in late 1980 s as a variant of artificial neural network.
More informationTowards Synthesizing Artificial Neural Networks that Exhibit Cooperative Intelligent Behavior: Some Open Issues in Artificial Life Michael G.
Towards Synthesizing Artificial Neural Networks that Exhibit Cooperative Intelligent Behavior: Some Open Issues in Artificial Life Michael G. Dyer Computer Science Department, UCLA Overview Introduction
More informationSPATIAL DATA MINING. Ms. S. Malathi, Lecturer in Computer Applications, KGiSL - IIM
SPATIAL DATA MINING Ms. S. Malathi, Lecturer in Computer Applications, KGiSL - IIM INTRODUCTION The main difference between data mining in relational DBS and in spatial DBS is that attributes of the neighbors
More informationParticle swarm optimization (PSO): a potentially useful tool for chemometrics?
Particle swarm optimization (PSO): a potentially useful tool for chemometrics? Federico Marini 1, Beata Walczak 2 1 Sapienza University of Rome, Rome, Italy 2 Silesian University, Katowice, Poland Rome,
More informationGrade
www.abubakrshalaby.com 5 Grade Ecology is the scientific study of the relation of living organisms to each other and their surroundings. Ecology includes the study of plant and animal populations, plant
More informationThe pattern determination of sea surface temperature distribution and chlorophyll a in the Southern Caspian Sea using SOM Model
Iranian Journal of Fisheries Sciences 2()05-4 203 The pattern determination of sea surface temperature distribution and chlorophyll a in the Southern Caspian Sea using SOM Model Downloaded from jifro.ir
More informationLearning Vector Quantization
Learning Vector Quantization Neural Computation : Lecture 18 John A. Bullinaria, 2015 1. SOM Architecture and Algorithm 2. Vector Quantization 3. The Encoder-Decoder Model 4. Generalized Lloyd Algorithms
More informationLooking at information
Activity Sheet 1 Looking at information Load a copy of Junior ViewPoint and open the PlantAn1 file. Teacher s note: Introduce the program by showing the children that each sheet contains information about
More informationARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD
ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD WHAT IS A NEURAL NETWORK? The simplest definition of a neural network, more properly referred to as an 'artificial' neural network (ANN), is provided
More informationLoopSOM: A Robust SOM Variant Using Self-Organizing Temporal Feedback Connections
LoopSOM: A Robust SOM Variant Using Self-Organizing Temporal Feedback Connections Rafael C. Pinto, Paulo M. Engel Instituto de Informática Universidade Federal do Rio Grande do Sul (UFRGS) P.O. Box 15.064
More informationFARSI CHARACTER RECOGNITION USING NEW HYBRID FEATURE EXTRACTION METHODS
FARSI CHARACTER RECOGNITION USING NEW HYBRID FEATURE EXTRACTION METHODS Fataneh Alavipour 1 and Ali Broumandnia 2 1 Department of Electrical, Computer and Biomedical Engineering, Qazvin branch, Islamic
More informationUsing a Hopfield Network: A Nuts and Bolts Approach
Using a Hopfield Network: A Nuts and Bolts Approach November 4, 2013 Gershon Wolfe, Ph.D. Hopfield Model as Applied to Classification Hopfield network Training the network Updating nodes Sequencing of
More informationLearning Vector Quantization (LVQ)
Learning Vector Quantization (LVQ) Introduction to Neural Computation : Guest Lecture 2 John A. Bullinaria, 2007 1. The SOM Architecture and Algorithm 2. What is Vector Quantization? 3. The Encoder-Decoder
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Article from Predictive Analytics and Futurism July 2016 Issue 13 Regression and Classification: A Deeper Look By Jeff Heaton Classification and regression are the two most common forms of models fitted
More informationCOMP-4360 Machine Learning Neural Networks
COMP-4360 Machine Learning Neural Networks Jacky Baltes Autonomous Agents Lab University of Manitoba Winnipeg, Canada R3T 2N2 Email: jacky@cs.umanitoba.ca WWW: http://www.cs.umanitoba.ca/~jacky http://aalab.cs.umanitoba.ca
More informationScience Department. 1 st Primary. First & Second Term Booklet
Science Department 1 st Primary First & Second Term Booklet 1 Unit 1 Living and Non-living organisms Kindly watch these videos: http://youtube.com/watch?v=bn0vwkqorhk https://www.youtube.com/watch?v=p51fipo2_kq
More informationNeural Networks and Machine Learning research at the Laboratory of Computer and Information Science, Helsinki University of Technology
Neural Networks and Machine Learning research at the Laboratory of Computer and Information Science, Helsinki University of Technology Erkki Oja Department of Computer Science Aalto University, Finland
More informationThursday, February 28. Bell Work: On the picture.
Thursday, February 28 Bell Work: On the picture. 1 Classification Chapter 17 This is a pangolin. Though it may not look like any other animal that you are familiar with, it is a mammal the same group of
More informationAn artificial neural networks (ANNs) model is a functional abstraction of the
CHAPER 3 3. Introduction An artificial neural networs (ANNs) model is a functional abstraction of the biological neural structures of the central nervous system. hey are composed of many simple and highly
More informationHuman Blood Pressure and Body Temp Analysis Using Fuzzy Logic Control System
222 IJCSNS International Journal of Computer Science and Network Security, VOL.17 No.12, December 2017 Human Blood Pressure and Body Temp Analysis Using Fuzzy Logic Control System Syeda Binish Zahra 1,
More informationNeural Networks Lecture 4: Radial Bases Function Networks
Neural Networks Lecture 4: Radial Bases Function Networks H.A Talebi Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Winter 2011. A. Talebi, Farzaneh Abdollahi
More informationIntroduction to Neural Networks: Structure and Training
Introduction to Neural Networks: Structure and Training Professor Q.J. Zhang Department of Electronics Carleton University, Ottawa, Canada www.doe.carleton.ca/~qjz, qjz@doe.carleton.ca A Quick Illustration
More informationClassification Revision Pack (B2)
Grouping Organisms: All organisms (living things) are classified into a number of different groups. The first, most broad group is a kingdom. The last, most selective group is a species there are fewer
More informationNeural Networks. Single-layer neural network. CSE 446: Machine Learning Emily Fox University of Washington March 10, /9/17
3/9/7 Neural Networks Emily Fox University of Washington March 0, 207 Slides adapted from Ali Farhadi (via Carlos Guestrin and Luke Zettlemoyer) Single-layer neural network 3/9/7 Perceptron as a neural
More informationAnimals Are Living Things
Unit Key Words eat 11 Animals Are Living Things rock care for blue whale feed seagull grow move dolphin In this unit you will learn to: compare and contrast living things and nonliving things. recognize
More informationCSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning
CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS Learning Neural Networks Classifier Short Presentation INPUT: classification data, i.e. it contains an classification (class) attribute.
More informationA New Method to Build Gene Regulation Network Based on Fuzzy Hierarchical Clustering Methods
International Academic Institute for Science and Technology International Academic Journal of Science and Engineering Vol. 3, No. 6, 2016, pp. 169-176. ISSN 2454-3896 International Academic Journal of
More informationAn introduction to clustering techniques
- ABSTRACT Cluster analysis has been used in a wide variety of fields, such as marketing, social science, biology, pattern recognition etc. It is used to identify homogenous groups of cases to better understand
More informationSBI3U Evolution Unit Test
Knowledge & Understanding Application Thinking & Investigation Communication Total /24 /9 /8 /9 /50 Part A: Multiple Choice Questions (1 mark per question) (K/U) Please circle the letter that corresponds
More informationA SEASONAL FUZZY TIME SERIES FORECASTING METHOD BASED ON GUSTAFSON-KESSEL FUZZY CLUSTERING *
No.2, Vol.1, Winter 2012 2012 Published by JSES. A SEASONAL FUZZY TIME SERIES FORECASTING METHOD BASED ON GUSTAFSON-KESSEL * Faruk ALPASLAN a, Ozge CAGCAG b Abstract Fuzzy time series forecasting methods
More informationNeural Networks Based on Competition
Neural Networks Based on Competition In some examples of pattern classification we encountered a situation in which the net was trained to classify the input signal into one of the output categories, while
More informationLecture 4: Feed Forward Neural Networks
Lecture 4: Feed Forward Neural Networks Dr. Roman V Belavkin Middlesex University BIS4435 Biological neurons and the brain A Model of A Single Neuron Neurons as data-driven models Neural Networks Training
More informationChap 1. Overview of Statistical Learning (HTF, , 2.9) Yongdai Kim Seoul National University
Chap 1. Overview of Statistical Learning (HTF, 2.1-2.6, 2.9) Yongdai Kim Seoul National University 0. Learning vs Statistical learning Learning procedure Construct a claim by observing data or using logics
More informationHYPERGRAPH BASED SEMI-SUPERVISED LEARNING ALGORITHMS APPLIED TO SPEECH RECOGNITION PROBLEM: A NOVEL APPROACH
HYPERGRAPH BASED SEMI-SUPERVISED LEARNING ALGORITHMS APPLIED TO SPEECH RECOGNITION PROBLEM: A NOVEL APPROACH Hoang Trang 1, Tran Hoang Loc 1 1 Ho Chi Minh City University of Technology-VNU HCM, Ho Chi
More informationBeing Bayesian About Network Structure:
Being Bayesian About Network Structure: A Bayesian Approach to Structure Discovery in Bayesian Networks Nir Friedman and Daphne Koller Machine Learning, 2003 Presented by XianXing Zhang Duke University
More informationData Mining. Preamble: Control Application. Industrial Researcher s Approach. Practitioner s Approach. Example. Example. Goal: Maintain T ~Td
Data Mining Andrew Kusiak 2139 Seamans Center Iowa City, Iowa 52242-1527 Preamble: Control Application Goal: Maintain T ~Td Tel: 319-335 5934 Fax: 319-335 5669 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak
More informationRiver Flow Forecasting with ANN
River Flow Forecasting with ANN OMID BOZORG HADDAD, FARID SHARIFI, SAEED ALIMOHAMMADI Department of Civil Engineering Iran University of Science & Technology, Shahid Abbaspour University Narmak, Tehran,
More informationGlobal Scene Representations. Tilke Judd
Global Scene Representations Tilke Judd Papers Oliva and Torralba [2001] Fei Fei and Perona [2005] Labzebnik, Schmid and Ponce [2006] Commonalities Goal: Recognize natural scene categories Extract features
More informationInternational Journal of ChemTech Research CODEN (USA): IJCRGG ISSN: Vol.8, No.9, pp 12-19, 2015
International Journal of ChemTech Research CODEN (USA): IJCRGG ISSN: 0974-4290 Vol.8, No.9, pp 12-19, 2015 Assessing the performance and variability of some Sugar beet varieties using Self-organizing map
More informationApplying Visual Analytics Methods to Spatial Time Series Data: Forest Fires, Phone Calls,
Applying Visual Analytics Methods to Spatial Time Series Data: Forest Fires, Phone Calls, Dr. & Dr. Natalia Andrienko In collaboration with TU Darmstadt and Univ. Constance, DFG Priority Research Program
More informationIterative Laplacian Score for Feature Selection
Iterative Laplacian Score for Feature Selection Linling Zhu, Linsong Miao, and Daoqiang Zhang College of Computer Science and echnology, Nanjing University of Aeronautics and Astronautics, Nanjing 2006,
More informationResearch and Reviews: Journal of Botanical Sciences
Research and Reviews: Journal of Botanical Sciences e-issn: 2320-0189 Illness Detection on Cotton Leaves by Gabor Wavelet. Afshin shaabany*, and Fatemeh Jamshidi Department of Electrical Engineering, University
More informationINTERACTIONS IN AN ENVIRONMENT
reflect Earth is full of living things. Our planet has many kinds of organisms including bacteria, fungi (like mushrooms), plants, and animals. In some ways, living things are alike. Almost all living
More informationInvestigation 3: Comparing DNA Sequences to Understand Evolutionary Relationships with BLAST
Investigation 3: Comparing DNA Sequences to Understand Evolutionary Relationships with BLAST Introduction Bioinformatics is a powerful tool which can be used to determine evolutionary relationships and
More informationMap Activity. A map shows cities. A map shows rivers. A map shows mountains. Lesson 5. Ancient Earth Journey to the Center of the Earth
Lesson 5 Map Activity A map shows mountains. A map shows rivers. A map shows cities. Lesson 5 1 2 Find the map. Find the mountain. Iceland is an island. There is water all around an island. An island is
More informationSUPERVISED LEARNING: INTRODUCTION TO CLASSIFICATION
SUPERVISED LEARNING: INTRODUCTION TO CLASSIFICATION 1 Outline Basic terminology Features Training and validation Model selection Error and loss measures Statistical comparison Evaluation measures 2 Terminology
More informationMichael Harrigan Office hours: Fridays 2:00-4:00pm Holden Hall
Announcement New Teaching Assistant Michael Harrigan Office hours: Fridays 2:00-4:00pm Holden Hall 209 Email: michael.harrigan@ttu.edu Guofeng Cao, Texas Tech GIST4302/5302, Lecture 2: Review of Map Projection
More informationCOMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS
Proceedings of the First Southern Symposium on Computing The University of Southern Mississippi, December 4-5, 1998 COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS SEAN
More informationINTRODUCTION TO NEURAL NETWORKS
INTRODUCTION TO NEURAL NETWORKS R. Beale & T.Jackson: Neural Computing, an Introduction. Adam Hilger Ed., Bristol, Philadelphia and New York, 990. THE STRUCTURE OF THE BRAIN The brain consists of about
More informationMicroarray Data Analysis: Discovery
Microarray Data Analysis: Discovery Lecture 5 Classification Classification vs. Clustering Classification: Goal: Placing objects (e.g. genes) into meaningful classes Supervised Clustering: Goal: Discover
More informationSTA 414/2104: Lecture 8
STA 414/2104: Lecture 8 6-7 March 2017: Continuous Latent Variable Models, Neural networks With thanks to Russ Salakhutdinov, Jimmy Ba and others Outline Continuous latent variable models Background PCA
More informationInterpreting Deep Classifiers
Ruprecht-Karls-University Heidelberg Faculty of Mathematics and Computer Science Seminar: Explainable Machine Learning Interpreting Deep Classifiers by Visual Distillation of Dark Knowledge Author: Daniela
More informationINTSO EDUCATION SCIENCE TALENT SEARCH OLYMPIAD (STSO) Classes : III & IV Max. Marks : 50. Instructions : Ø Ø Ø
Instructions : INTSO EDUCATION SCIENCE TALENT SEARCH OLYMPIAD (STSO) Level-II : Primary Time : 60 Min Classes : III & IV Max. Marks : 50 Fill the OMR sheet completely and carefully. Please leave space
More informationArtificial Neural Networks. Introduction to Computational Neuroscience Tambet Matiisen
Artificial Neural Networks Introduction to Computational Neuroscience Tambet Matiisen 2.04.2018 Artificial neural network NB! Inspired by biology, not based on biology! Applications Automatic speech recognition
More informationBounded Approximation Algorithms
Bounded Approximation Algorithms Sometimes we can handle NP problems with polynomial time algorithms which are guaranteed to return a solution within some specific bound of the optimal solution within
More informationYear 4 Year 5 Year 6 Year 7
Middle childhood: Science/Life and Living Students understand their own biology and that of other living things and recognise the interdependence of life. When using animals, refer to Guidelines for the
More informationUsing Neural Networks for Identification and Control of Systems
Using Neural Networks for Identification and Control of Systems Jhonatam Cordeiro Department of Industrial and Systems Engineering North Carolina A&T State University, Greensboro, NC 27411 jcrodrig@aggies.ncat.edu
More informationArtificial Neural Networks Examination, June 2005
Artificial Neural Networks Examination, June 2005 Instructions There are SIXTY questions. (The pass mark is 30 out of 60). For each question, please select a maximum of ONE of the given answers (either
More informationArtificial Neural Network Method of Rock Mass Blastability Classification
Artificial Neural Network Method of Rock Mass Blastability Classification Jiang Han, Xu Weiya, Xie Shouyi Research Institute of Geotechnical Engineering, Hohai University, Nanjing, Jiangshu, P.R.China
More informationST-DBSCAN: An Algorithm for Clustering Spatial-Temporal Data
ST-DBSCAN: An Algorithm for Clustering Spatial-Temporal Data Title Di Qin Carolina Department First Steering of Statistics Committee and Operations Research October 9, 2010 Introduction Clustering: the
More informationUniversity of Genova - DITEN. Smart Patrolling. video and SIgnal Processing for Telecommunications ISIP40
University of Genova - DITEN Smart Patrolling 1 Smart Patrolling Detection of the intruder Tracking of the intruder A cognitive node will active an operator, describing on his mobile terminal the characteristic
More informationCMSC 422 Introduction to Machine Learning Lecture 4 Geometry and Nearest Neighbors. Furong Huang /
CMSC 422 Introduction to Machine Learning Lecture 4 Geometry and Nearest Neighbors Furong Huang / furongh@cs.umd.edu What we know so far Decision Trees What is a decision tree, and how to induce it from
More informationClassification of Ordinal Data Using Neural Networks
Classification of Ordinal Data Using Neural Networks Joaquim Pinto da Costa and Jaime S. Cardoso 2 Faculdade Ciências Universidade Porto, Porto, Portugal jpcosta@fc.up.pt 2 Faculdade Engenharia Universidade
More informationData Preprocessing. Cluster Similarity
1 Cluster Similarity Similarity is most often measured with the help of a distance function. The smaller the distance, the more similar the data objects (points). A function d: M M R is a distance on M
More informationNoise Robust Isolated Words Recognition Problem Solving Based on Simultaneous Perturbation Stochastic Approximation Algorithm
EngOpt 2008 - International Conference on Engineering Optimization Rio de Janeiro, Brazil, 0-05 June 2008. Noise Robust Isolated Words Recognition Problem Solving Based on Simultaneous Perturbation Stochastic
More informationArtificial Neural Networks. Q550: Models in Cognitive Science Lecture 5
Artificial Neural Networks Q550: Models in Cognitive Science Lecture 5 "Intelligence is 10 million rules." --Doug Lenat The human brain has about 100 billion neurons. With an estimated average of one thousand
More informationObject Recognition. Digital Image Processing. Object Recognition. Introduction. Patterns and pattern classes. Pattern vectors (cont.
3/5/03 Digital Image Processing Obect Recognition Obect Recognition One of the most interesting aspects of the world is that it can be considered to be made up of patterns. Christophoros Nikou cnikou@cs.uoi.gr
More informationSupervised (BPL) verses Hybrid (RBF) Learning. By: Shahed Shahir
Supervised (BPL) verses Hybrid (RBF) Learning By: Shahed Shahir 1 Outline I. Introduction II. Supervised Learning III. Hybrid Learning IV. BPL Verses RBF V. Supervised verses Hybrid learning VI. Conclusion
More informationMachine Learning of Environmental Spatial Data Mikhail Kanevski 1, Alexei Pozdnoukhov 2, Vasily Demyanov 3
1 3 4 5 6 7 8 9 10 11 1 13 14 15 16 17 18 19 0 1 3 4 5 6 7 8 9 30 31 3 33 International Environmental Modelling and Software Society (iemss) 01 International Congress on Environmental Modelling and Software
More informationMining Classification Knowledge
Mining Classification Knowledge Remarks on NonSymbolic Methods JERZY STEFANOWSKI Institute of Computing Sciences, Poznań University of Technology SE lecture revision 2013 Outline 1. Bayesian classification
More informationGIS Data Structure: Raster vs. Vector RS & GIS XXIII
Subject Paper No and Title Module No and Title Module Tag Geology Remote Sensing and GIS GIS Data Structure: Raster vs. Vector RS & GIS XXIII Principal Investigator Co-Principal Investigator Co-Principal
More informationNEURAL NETWORK APPLICATION FOR MONTHLY PRECIPITATION DATA RECONSTRUCTION
JOURNAL OF ENVIRONMENTAL HYDROLOGY The Electronic Journal of the International Association for Environmental Hydrology On the World Wide Web at http://www.hydroweb.com VOLUME 19 2011 NEURAL NETWORK APPLICATION
More information7 FORMATIVE ASSESSMENT - I &
7 FORMATIVE ASSESSMENT - I & Name :... Rank Time : 30 min. Class :... Section :... Roll No. :... Marks Subject : SCIENCE 1st Class Marks : 20 I. Answer any four of the following questions. 4 2 = 8 1. What
More informationUniversity of Florida CISE department Gator Engineering. Clustering Part 1
Clustering Part 1 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville What is Cluster Analysis? Finding groups of objects such that the objects
More informationCOMPARING DNA SEQUENCES TO UNDERSTAND EVOLUTIONARY RELATIONSHIPS WITH BLAST
Big Idea 1 Evolution INVESTIGATION 3 COMPARING DNA SEQUENCES TO UNDERSTAND EVOLUTIONARY RELATIONSHIPS WITH BLAST How can bioinformatics be used as a tool to determine evolutionary relationships and to
More informationNeural Networks. David Rosenberg. July 26, New York University. David Rosenberg (New York University) DS-GA 1003 July 26, / 35
Neural Networks David Rosenberg New York University July 26, 2017 David Rosenberg (New York University) DS-GA 1003 July 26, 2017 1 / 35 Neural Networks Overview Objectives What are neural networks? How
More informationORIE 4741: Learning with Big Messy Data. Train, Test, Validate
ORIE 4741: Learning with Big Messy Data Train, Test, Validate Professor Udell Operations Research and Information Engineering Cornell December 4, 2017 1 / 14 Exercise You run a hospital. A vendor wants
More informationThe Parameters Selection of PSO Algorithm influencing On performance of Fault Diagnosis
The Parameters Selection of Algorithm influencing On performance of Fault Diagnosis Yan HE,a, Wei Jin MA and Ji Ping ZHANG School of Mechanical Engineering and Power Engineer North University of China,
More informationUSING SINGULAR VALUE DECOMPOSITION (SVD) AS A SOLUTION FOR SEARCH RESULT CLUSTERING
POZNAN UNIVE RSIY OF E CHNOLOGY ACADE MIC JOURNALS No. 80 Electrical Engineering 2014 Hussam D. ABDULLA* Abdella S. ABDELRAHMAN* Vaclav SNASEL* USING SINGULAR VALUE DECOMPOSIION (SVD) AS A SOLUION FOR
More informationPower Supply Quality Analysis Using S-Transform and SVM Classifier
Journal of Power and Energy Engineering, 2014, 2, 438-447 Published Online April 2014 in SciRes. http://www.scirp.org/journal/jpee http://dx.doi.org/10.4236/jpee.2014.24059 Power Supply Quality Analysis
More information