Detection and Identification of Seismic P-Waves using Artificial Neural Networks

Size: px
Start display at page:

Download "Detection and Identification of Seismic P-Waves using Artificial Neural Networks"

Transcription

1 Proceedings of International Joint Conference on Neural Networks, Dallas, Texas, USA, August 4-9, 2013 Detection and Identification of Seismic P-Waves using Artificial Neural Networks Komalpreet Kaur, Manish Wadhwa and E. K. Park Abstract Detection and identification of seismic P-Wave is useful in event location and event detection. This involves an intensive amount of pattern recognition. For the recognition of seismic phases, no probabilistic distribution model performs as well as Artificial Neural Network(ANN). Back Propagation Neural Network (BPNN) was applied for the automatic detection and identification of local and regional seismic P-Waves. For a set of three-component seismic data, four attributes were used as input to the ANN: Degree of Polarization (DOP), Auto Regression Coefficient (ARC), Ratio between Short time average and Long time average (STA/LTA) and Ratio of Vertical power to Total power (RV2T). These four attributes were calculated in the frequency band of 1-8 Hz with a 2 second moving window. The results of preliminary training and testing with a set of various local and regional earthquake recordings show that the ANN achieved 95% correct rate of P-Wave detection and identification. 90% of the P-Waves were detected with a maximum deviation of 0.1 sec from correct manual pick up. I. INTRODUCTION The occurrence of an earthquake gives rise to seismic waves. Identification of seismic P-Waves helps to locate earthquake source [1], [2]. P-Waves are longitudinal waves, that is, they travel along the direction of wave propagation. These waves alternately compress and pull out the solid rock. These waves travel through massive rock and liquid material like magma and water. This is the fastest kind of seismic wave and can travel up to speed of 4 miles/sec. To minimize the colossal losses which take place as a result of major earthquakes, the design and configuration of a seismic alert system has become the urgent need of the hour. For this, the automatic identification and detection of first arrival is required, avoiding false alerts, and for logging correct arrival time of P-Wave. This is necessary for identification of an event. Quickly detecting and accurately identifying the first P-Wave is of great importance in event location, event identification, source mechanism analysis and spectral analysis. There are various methods available for identification of P-Wave. While all these algorithms work well for selected seismic data, the difficulties of how to define characteristic function and set threshold are still major drawbacks that reflect a compromise between rate of false picking and rate of missing real signals. Artificial Neural Komalpreet Kaur is with the Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA ( kkaur003@odu.edu). Manish Wadhwa is with the Department of Information Technology, South University, Virginia Beach, VA ( mwadhwa@southuniversity.edu). E. K. Park is with the Department of Graduate Studies and Office of Research and Sponsored Programs, California State University, Chico, CA ( ekpark@csuchico.edu) Networks (ANNs) are emerging as potential tool for the detection and identification of seismic signals owing to the fact that they can be adapted to fit more complex decision surface compared with the conventional techniques. Identification and detection of P-Wave from a seismogram is a problem of pattern recognition. ANN handles pattern information by performing several pattern recognition tasks. Several authors have used ANNs using different attributes of seismic waves for automatic detection of phases [3] [9]. ANN is used in pattern association, pattern classification, and pattern grouping etc. [5], [6]. Authors in [10], [11] employed an ANN to identify P- and S-Waves from seismic threecomponent data. They used degree of polarization (DOP) to distinguish P- and S-Waves. It was shown that ANN is capable of classifying the arrival type based on characteristic patterns of polarization state of a seismic wave. They showed that this method was adaptive and training sets can be altered to enhance particular features of different data sets. 84% of P-Waves and 63% of S-waves were precisely picked by this algorithm. It had a limitation due to inter-station complexity of DOP. The quality of polarization information deteriorates with increasing noise level. Instead of using DOP as the only attribute, this paper takes into consideration four different attributes as discussed in section II. The decision is thus based on weighted decision using four different attributes that reduces the error component caused by increased levels of noise. In this paper, we use Back Propagation Neural Network (BPNN) with three-component seismic data. Authors in [12] also applied BPNN for automatic seismic arrival pick up using single component recordings. Absolute value of the single-component seismic recordings was used as an input to ANN. Compared with other single-component methods this method is flexible and can pick up both P- and S- Waves simultaneously. But performance of single-component picking is lower as compared to three-component picking because of the dependency of the single-component data on ray direction. Three-component recordings are important for regional seismic monitoring because regional phases can exhibit large horizontal motions. The use of an array of three-component sensors reduces the variance of polarization attributes. In [13], the authors applied ANN to the automatic picking of local and regional S-phase. Three-component data was used and variety of attributes namely STA/LTA, ratio between horizontal and total power, short axis incidence angle and ARC were analyzed. The attributes were calculated in frequency band of 2 to 8 Hz with a 2.56 sec-moving window /13/$ IEEE 2949

2 Multi layer Perceptron (MLP) Neural Network model was employed for detection of seismic S-Wave. 74% of the S- phase was precisely picked with less than 0.1sec onset time. This paper accomplishes the following three objectives. The first objective is to optimize the neural network model with respect to its various parameters like momentum, learning rate, number of hidden layers, and number of nodes in the hidden layers etc. to achieve least error in the learning data as well as test data. The second objective is to find out the neural network s ability to accurately identify and detect the seismic P- Waves. The third objective is to compare the performance of the ANN model with the manual techniques. The rest of the paper is organized as follows. In section II, we discuss the attributes of seismic signal. The methodology to detect and identify seismic P-Waves using ANNs is then presented in section III. Section IV presents the simulation results in which the optimum ANN model for identification and detection of seismic P-Waves is presented. Section V finally concludes the paper. II. ATTRIBUTES OF SEISMIC SIGNAL The identification of different seismic waves is accomplished by recognizing different characteristics of the signal. For a set of local three-component seismic data, variety of features for signal detection and identification are analyzed. These attributes are as follows. A. Polarization Polarization is the main source of information derived from three-component seismic data [x, y, z]. The covariance matrix C is defined as follows [1] C = Cov(x, x) Cov(x, y) Cov(x, z) Cov(y, x) Cov(y, y) Cov(y, z) Cov(z, x) Cov(z, y) Cov(z, z) The diagonalization of the covariance matrix gives principal axis of the matrix. The direction of polarization is measured by considering the Eigen vector of the largest axis. This direction is parallel to propagation direction of P-wave and is perpendicular to the propagation direction of S-wave. It is difficult to use this direction as a decision parameter for arrival identification. Therefore the parameters that are independent of source location are required. The parameters used in this paper are as follows. 1) Degree of Polarization (DOP): P- and S-Waves can be identified by using a combination of the degree of polarization vector and vector modulus of its three-component motion. The DOP is calculated from the covariance matrix of three-component recording that is a useful measure of the polarization of seismic signal. DOP [2] is defined as given in Eq. 1. F (t) = (λ 1 λ 2 ) 2 + (λ 2 λ 3 ) 2 + (λ 3 λ 1 ) 2 2(λ 1 + λ 2 + λ 3 ) 2 (1) where λ 1, λ 2 and λ 3 are Eigen values of the covariance matrix at central time t of a moving window with N samples. These are independent of the co-ordinate system, so they are also independent of source location and depend only on the polarization state. According to this definition, if only one eigenvalue is nonzero, then F = 1, and the signal is linearly polarized; if all of the Eigen Values are equal then F = 0, and the signal can be considered as completely unpolarized or circularly polarized. Most P-Waves have high values of F (t) and S-Waves, low values. F (t) patterns of P-arrivals differ from those of S-Waves. To calculate the DOP, all three components must have same frequency, same bandwidth, same scale and same noise level. If one of the three-component has a different property, DOP is highly biased. Different arrival types not only have different polarization characteristics but also have different amplitude characteristics. Therefore, the modified function, F m (t), of DOP [14] must be used as given in Eq. 2. F m (t) = F (t) M(t) (2) where M(t) = (x 2 (t) + y 2 (t) + z 2 (t)) 1/2 and x(t), y(t) and z(t) represent displacements with time. 2) Ratio of Vertical Power to Total Power: Ratio of Vertical Power to Total Power (RV 2T ) is used to measure the power in the vertical component of the seismic signal. P- wave has its major component in Vertical Power. Thus with the arrival of P-wave, increase in RV 2T is observed. RV 2T [7] is defined as given by Eq. 3. RV 2T = N t=1 x2 (t) N t=1 (x2 (t) + y 2 (t) + z 2 (t) where x(t), y(t) and z(t) are amplitudes of three component recordings and N is the total points in the window. B. Auto Regression Coefficient (ARC) Representation For each seismic signal, each phase has its own characteristic and lasts at least for a few seconds. The difference in nature of the Auto Regression (AR) representation of signal and noise can be used to make a separation of phase contributed from background and hence permit onset time detections. For seismic signals second order AR model [7] is used and is expressed in Eq. 4. ARC(t) = w 1(t)w 2 (t) w 1 (t 1)w 2 (t 1) w 1 (t)w 2 (t) where w k (t) are AR coefficients of data at time t. AR technique is based on the assumption that the seismograms can be divided into locally stationary segments as an AR process, and the intervals before and after the onset are two different stationary processes. (3) (4) 2950

3 C. Energy Analysis Phase detection using energy analysis is based on the ratio of a Short-Time Average of the energy content to a Long- Time Average energy level (STA/LTA) [11]. It is defined as given by Eq. 5. β = ST A LT A where STA and LTA are defined by Eq. 6 and 7 respectively. ST A = LT A = 0 (5) t= N s (x 2 (t) + y 2 (t) + z 2 (t)) (6) 0 t= N l (x 2 (t) + y 2 (t) + z 2 (t)) (7) where N s and N l are the time windows for STA and LTA respectively. N s is much smaller as compared to N l and that is why the names short-term and long-term respectively. β is calculated recursively in a moving window at a time and its value will change if amplitude of signal changes. The Short-Time-Average to Long-Time-Average (STA/LTA) is the most broadly used algorithm. It continuously calculates the average values of the absolute amplitude of a seismic signal in two consecutive moving-time windows. The STA is sensitive to seismic events while LTA provides information about the temporal amplitude of seismic noise. When the ratio of both exceeds a pre-set value, an event is declared. The STA/LTA algorithm processes filter seismic signals in two moving time windows- a Short Time Average window (STA) and a Long-Time Average window (LTA). The STA measures the instant amplitude of the seismic signal and watches for earthquakes. The LTA takes care of the current average seismic noise amplitude. First, the absolute amplitude of each data sample of an incoming signal is calculated. Next, the average of absolute amplitudes in both windows is calculated. Then a ratio of both values that is, STA/LTA ratio is calculated. This ratio is continuously compared to a threshold value. If the ratio exceeds this threshold, event is declared [14]. III. METHODOLOGY The methodology to detect and identify seismic P-Waves using Artificial Neural Network can be divided into various steps as follows. 1) Data Collection 2) Selection of inputs 3) Preprocessing of the input data 4) Designing network architecture 5) Training and Testing of the network to optimize the neural network topology to minimize error in learning as well as test data. A. Data Collection The data used in this paper was taken from Central Scientific Instruments Organization (CSIO), Chandigarh, India. 160 events of the earthquake have been considered for the identification and detection purposes. The 160 events include the various different types of seismic waves that are produced because of the difference in the distance of the seismometer from the source or because of the difference in the depth of the originating earthquake. According to variations in depth three types exist as follows. 1) Shallow-focus Earthquakes (0 to 70m deep) 2) Intermediate Earthquakes (70 to 300m deep) 3) Deep-focus Earthquakes (300 to 700m deep) According to the distance from the seismometer they are categorized into three types as follows. 1) Local Shocks (0-200km) 2) Regional Shocks ( km) 3) Distant Shocks (more than 1500km) The epicentral data, i.e. data including the necessary parameters like Magnitude and Epicenter etc. was obtained from the United States Earthquake Information Center (see Fig. 1 shows sample of a three-component raw waveform for an event. Fig. 1. Sample of a three-component raw waveform for an event B. Selection of Inputs It is the most important aspect for detection and identification of waves. Choice of inputs influences the accuracy with which the phase will be identified and detected. In this paper four attributes were considered that greatly affect the P- Wave and hence make it easy to identify and detect these from raw data. These attributes are, Degree of Polarization (DOP), Auto Regression Coefficient (ARC), Short Time Average to Long Time Average Ratio (STA/LTA), and Ratio of Vertical power to total power (RV2T) as shown in Figs. 2(a), 2(b), 2(c), and 2(d) respectively and as discussed in Section II. There are peaks corresponding to P-Wave arrival in all the four attributes. The combinations of these four attributes give a clear response to P-Wave arrival. 2951

4 C. Preprocessing of Input Data The purpose of preprocessing the input data is to simplify the patterns to be recognized in order to avoid a huge amount of computation and to improve the network s generalization ability. For detection and identification of P-Wave, only data of 20 sec is required. Thus, a moving window of 2 sec was designed that extracts required amount of data and rejects the rest of the data. Data was low pass filtered to 8 Hz using a Butterworth Filter. (a) Degree of Polarization D. Designing Network Architecture BPNN was designed that uses four attributes of the seismic signal as an input as shown in Fig. 3. It consists of four preprocessors, four neural subnets, and one final decision neuron. When three-component seismograms are input to the system, four attributes are computed by the four preprocessors. Four neural subnets have identical three layer BPNN structure. Outputs of the four subnets are the inputs of the final decision unit. When the summation of inputs at time t is greater than a threshold, a P-wave is declared, and the time t is picked as the onset time of the P-phase. (b) Auto Regression Coefficient Fig. 3. Block Diagram of Back Propagation Neural Network (c) Ratio of Vertical Power to Total Power (d) Short Term Average to Long Term Average Fig. 2. Attributes of Seismic Signal E. Training and Testing Input data was divided into two parts: training data and test data. Training data consists of 30 P-wave arrival and 30 background noises. These 60 waveform segments were extracted from local and regional earthquake recordings. P- Wave waveform segments were extracted starting from 49 points before and 51 points after P-Wave arrivals. Background noise segments were extracted prior to P-Wave arrivals. The chosen topology was trained with the training data by using MATLAB. When it reached the minimum training error of 10 5, the trained network was applied to the test set and the testing error was noted. In order to minimize the testing error, the trained network was optimized by applying various topologies with different parameters. Table I gives the final optimum ANN model used for training and testing. IV. SIMULATION RESULTS This paper identifies the existence of P-Waves and also the time of occurrence of these. The results are thus presented for both the identification and occurrence as follows. 2952

5 A. Identification of P-Waves Four neural networks were trained with the training set i.e. 60 samples containing 30 P-Waves and 30 background noises. After that 100 local and regional three-component seismograms, each of which was 20 second long, were used to test the best neural network topology for P-wave identification. The signal was continuously checked for a P- wave with a moving window of 1 sec and updated every 0.01 sec. One 20 second long seismic recording has 1901 windows to be examined. For the 100 testing seismograms, there are windows to be tested. For all 100-test seismograms, a 95% correct identification was achieved. Fig. 4 shows the detected P-Waves using trained neural network for various types of local earthquakes. Fig. 5 shows the detected P- Waves using neural network for various types of regional earthquakes. ANN and manual picking is plotted versus the signal to noise ratio in Fig. 6. The time difference decreases with the increasing signal-to-noise ratio and becomes insignificant when the signal-to-noise ratio is larger than 15. Out of 100 seismograms, 90% of the P-Waves were detected with a maximum deviation of 0.1 sec from correct manual pick up without doing retiming. Fig. 6. picking The time difference between picking by the ANN and by manual Fig. 4. Detected and Identified P-wave for Local Earthquakes As discussed earlier in this paper, the three objectives of this paper were accomplished. The first objective was to optimize the neural network model with respect to its various parameters. Finding the best ANN model for a particular problem is always a very difficult task. There is no theoretical or empirical formula to model a network as an optimum one. This task must be performed by trial and observation technique as is done in this paper. After fair amount of training and testing various network parameters, an optimum ANN model for identification and detection of seismic P- wave is given in Table I. TABLE I OPTIMUM ANN MODEL FOR IDENTIFICATION AND DETECTION OF SEISMIC P-WAVES Parameter Value Number of Hidden layers 1 Number of Nodes in Hidden layers 20 Number of Input Nodes 100 Number of Output Nodes 1 Transfer Function for Input Layer Log-sigmoid Transfer Function for Hidden layer Tan-sigmoid Transfer Function for Output layer Log-sigmoid Training Function Scaled Conjugate Gradient Target Error for Training 10 5 Moving Window Length 2 seconds Filter Type IIR Butterworth Band Pass Frequency Band 1 8 Hz Fig. 5. Detected and Identified P-wave for Regional Earthquakes B. Detection of P-Waves After correct phase identification, the accuracy of onset estimation is important. The picking time difference between The second objective was to find out the neural network s ability to accurately identify and detect the seismic P-Waves. From the results, it is observed that neural network is able to identify and detect the P-Waves with good accuracy despite its highly random nature. The optimum network with above features gives accuracy greater than 94% in the 100 test seismograms, which is fairly satisfactory to identify and detect the P-wave. The third objective was to compare the performance of the ANN model with the manual techniques. It is observed 2953

6 that the ANN approach compares favorably with the manual approach. V. CONCLUSIONS In this paper, we presented the detection of seismic P- Waves using Back Propagation Neural Network for threecomponent seismic data. Four attributes of the seismic wave, viz. Degree of Polarization, Autoregression Coefficient, Ratio of Vertical to Total Power and Ratio of Short Term Average to Long Term Average Energy Level were equally weighted to decide the occurrence of seismic P-Wave. Because of the non-stationarity of the seismic signal, it is not possible to compute the threshold for different attributes for the occurrence of the P-Wave. Thus, Artificial Neural Network helps in the detection of these waves.the results obtained showed 95% accuracy in determining the P-Waves. The network has been tested on data obtained for local and regional earthquakes only, in our study, India is the point of reference for earthquake study. The future work would be to apply this technique over data obtained from distant earthquakes. Regarding performance measures, some refinements are expected to be fruitful, for example, more attributes can be used for the identification and detection of the seismic P-Waves, for example, spectral analysis of seismic wave. Considering more attributes would strengthen the credibility of the attributes. [12] Henchang Dai, Colin D.Macbeth, The application of Back Propagation Neural Network to Automate Picking Seismic Arrivals from Single Component Recordings, Journal of Geophysical Research, Vol 102, pp , [13] Jin Wang, Ta-ling Teng, Identification and Picking of S-phase using an Artificial Neural Networks, Bulletin of the Seismological Society of America, Vol 87, pp ,1997. [14] Amadej Trnkoczy, Understanding and Parameter Setting of STA/LTA Trigger Algorithm, CH1028 preverenges, Switzerland, ACKNOWLEDGMENTS The authors would like to thank Central Scientific Instruments Organization (CSIO), Chandigarh, India, for guidance and for the perusal of the data provided by them for this study. REFERENCES [1] William Lowrie, Fundamentals of Geophysics, Cambridge University Press, [2] G.J. Nair, Falguni Roy, Seismology - An Introduction, An International Journal of Nuclear Power, Vol 15, pp 1-4, [3] Zamani, Abu Sarwar, Response Prediction of Earthquake motion using Artificial Neural Networks, International Journal of Applied Research in Computer Science and Information Technology, Vol 1, no 2, [4] Diersen, Steve, En-Jui Lee, Diana Spears, Po Chen, Liqiang Wang, Classification of Seismic Windows using Artificial Neural Networks, Procedia Computer Science, Vol 4, pp , [5] James A. Anderson, An Introduction to Neural Networks, Prentice Hall of India Pvt. Ltd [6] S. Rajasekaran, G.A.Vijayalakshmi Pai, Neural Networks, Fuzzy logic, and Genetic algorithms: Synthesis and Applications, Prentice Hall of India Pvt. Ltd [7] Brian Russell, Hampsono-Russell, Neural Network Applications in Geophysics, CSEG National Convention, [8] Chao-ying Bai, B.L.N Kennett, Automatic Phase-Detection and Identification by Full Use of a Single Three-component Broadband Seismogram, Bulletin of Seismological Society of America, Vol 90, pp , [9] Haijiang Zhang, Clifford Thurber, Charlotte Rowe, Automatic P-Wave Arrival Detection and Picking with Multi Scale Wavelet Analysis for Single Component Recordings, Bulletin of the Seismological Society of America, Vol 93, pp , [10] Henchang Dai, Colin D.Macbeth, Identifying P and S Waves using Artificial Neural, EAGE 57th Conference and Technical Exhibition, Scotland, [11] Henchang Dai, Colin D.Macbeth, Arrival Type Identification in Local Earthquake Data using an Artificial Neural Network, Journal of Geophysical Exhibition, Vol 12, pp ,

Online Seismic Event Picking via Sequential Change-Point Detection

Online Seismic Event Picking via Sequential Change-Point Detection Online Seismic Event Picking via Sequential Change-Point Detection Shuang Li, Yang Cao, Christina Leamon, Yao Xie H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology

More information

Geophysical Research Letters. Supporting Information for

Geophysical Research Letters. Supporting Information for Geophysical Research Letters Supporting Information for A P-wave based, on-site method for earthquake early warning S. Colombelli(1), A. Caruso(1), A. Zollo(1), G. Festa(1) and H. Kanamori(2) (1) Department

More information

Revision: Neural Network

Revision: Neural Network Revision: Neural Network Exercise 1 Tell whether each of the following statements is true or false by checking the appropriate box. Statement True False a) A perceptron is guaranteed to perfectly learn

More information

revised October 30, 2001 Carlos Mendoza

revised October 30, 2001 Carlos Mendoza Earthquake Sources in the circum-caribbean Region Puerto Rico Tsunami Mitigation and Warning Program Federal Emergency Management Agency Preliminary Report: Task 3 revised October 30, 2001 Carlos Mendoza

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Jeff Clune Assistant Professor Evolving Artificial Intelligence Laboratory Announcements Be making progress on your projects! Three Types of Learning Unsupervised Supervised Reinforcement

More information

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009 AN INTRODUCTION TO NEURAL NETWORKS Scott Kuindersma November 12, 2009 SUPERVISED LEARNING We are given some training data: We must learn a function If y is discrete, we call it classification If it is

More information

Keywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm

Keywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm Volume 4, Issue 5, May 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Huffman Encoding

More information

Unit 8: Introduction to neural networks. Perceptrons

Unit 8: Introduction to neural networks. Perceptrons Unit 8: Introduction to neural networks. Perceptrons D. Balbontín Noval F. J. Martín Mateos J. L. Ruiz Reina A. Riscos Núñez Departamento de Ciencias de la Computación e Inteligencia Artificial Universidad

More information

Estimation of the Pre-Consolidation Pressure in Soils Using ANN method

Estimation of the Pre-Consolidation Pressure in Soils Using ANN method Current World Environment Vol. 11(Special Issue 1), 83-88 (2016) Estimation of the Pre-Consolidation Pressure in Soils Using ANN method M. R. Motahari Department of Civil Engineering, Faculty of Engineering,

More information

Neural Networks and the Back-propagation Algorithm

Neural Networks and the Back-propagation Algorithm Neural Networks and the Back-propagation Algorithm Francisco S. Melo In these notes, we provide a brief overview of the main concepts concerning neural networks and the back-propagation algorithm. We closely

More information

COMP-4360 Machine Learning Neural Networks

COMP-4360 Machine Learning Neural Networks COMP-4360 Machine Learning Neural Networks Jacky Baltes Autonomous Agents Lab University of Manitoba Winnipeg, Canada R3T 2N2 Email: jacky@cs.umanitoba.ca WWW: http://www.cs.umanitoba.ca/~jacky http://aalab.cs.umanitoba.ca

More information

Estimation of Inelastic Response Spectra Using Artificial Neural Networks

Estimation of Inelastic Response Spectra Using Artificial Neural Networks Estimation of Inelastic Response Spectra Using Artificial Neural Networks J. Bojórquez & S.E. Ruiz Universidad Nacional Autónoma de México, México E. Bojórquez Universidad Autónoma de Sinaloa, México SUMMARY:

More information

Final Examination CS 540-2: Introduction to Artificial Intelligence

Final Examination CS 540-2: Introduction to Artificial Intelligence Final Examination CS 540-2: Introduction to Artificial Intelligence May 7, 2017 LAST NAME: SOLUTIONS FIRST NAME: Problem Score Max Score 1 14 2 10 3 6 4 10 5 11 6 9 7 8 9 10 8 12 12 8 Total 100 1 of 11

More information

22c145-Fall 01: Neural Networks. Neural Networks. Readings: Chapter 19 of Russell & Norvig. Cesare Tinelli 1

22c145-Fall 01: Neural Networks. Neural Networks. Readings: Chapter 19 of Russell & Norvig. Cesare Tinelli 1 Neural Networks Readings: Chapter 19 of Russell & Norvig. Cesare Tinelli 1 Brains as Computational Devices Brains advantages with respect to digital computers: Massively parallel Fault-tolerant Reliable

More information

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD WHAT IS A NEURAL NETWORK? The simplest definition of a neural network, more properly referred to as an 'artificial' neural network (ANN), is provided

More information

DETERMINATION OF EARTHQUAKE PARAMETERS USING SINGLE STATION BROADBAND DATA IN SRI LANKA

DETERMINATION OF EARTHQUAKE PARAMETERS USING SINGLE STATION BROADBAND DATA IN SRI LANKA DETERMINATION OF EARTHQUAKE PARAMETERS USING SINGLE STATION BROADBAND DATA IN SRI LANKA S.W.M. SENEVIRATNE* MEE71 Supervisors: Yasuhiro YOSHIDA** Tatsuhiko HARA*** ABSTRACT We determined epicenters and

More information

P217 Automated P- and S-Wave Picking of Micro Earthquakes Re-Corded by a Vertical Array

P217 Automated P- and S-Wave Picking of Micro Earthquakes Re-Corded by a Vertical Array P217 Automated P- and S-Wave Picking of Micro arthquakes Re-Corded by a Vertical Array T. Fischer* (Geophysical Institute, Czech Academy of Science), A. Bouskova (Geophysical Institute, Czech Academy of

More information

Global geophysics and wave propagation

Global geophysics and wave propagation Global geophysics and wave propagation Reading: Fowler p76 83 Remote sensing Geophysical methods Seismology Gravity and bathymetry Magnetics Heat flow Seismology: Directly samples the physical properties

More information

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller 2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks Todd W. Neller Machine Learning Learning is such an important part of what we consider "intelligence" that

More information

Neural Networks biological neuron artificial neuron 1

Neural Networks biological neuron artificial neuron 1 Neural Networks biological neuron artificial neuron 1 A two-layer neural network Output layer (activation represents classification) Weighted connections Hidden layer ( internal representation ) Input

More information

STA 414/2104: Lecture 8

STA 414/2104: Lecture 8 STA 414/2104: Lecture 8 6-7 March 2017: Continuous Latent Variable Models, Neural networks With thanks to Russ Salakhutdinov, Jimmy Ba and others Outline Continuous latent variable models Background PCA

More information

Neural network modelling of reinforced concrete beam shear capacity

Neural network modelling of reinforced concrete beam shear capacity icccbe 2010 Nottingham University Press Proceedings of the International Conference on Computing in Civil and Building Engineering W Tizani (Editor) Neural network modelling of reinforced concrete beam

More information

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others) Machine Learning Neural Networks (slides from Domingos, Pardo, others) For this week, Reading Chapter 4: Neural Networks (Mitchell, 1997) See Canvas For subsequent weeks: Scaling Learning Algorithms toward

More information

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 BIOLOGICAL INSPIRATIONS Some numbers The human brain contains about 10 billion nerve cells (neurons) Each neuron is connected to the others through 10000

More information

A Wavelet Neural Network Forecasting Model Based On ARIMA

A Wavelet Neural Network Forecasting Model Based On ARIMA A Wavelet Neural Network Forecasting Model Based On ARIMA Wang Bin*, Hao Wen-ning, Chen Gang, He Deng-chao, Feng Bo PLA University of Science &Technology Nanjing 210007, China e-mail:lgdwangbin@163.com

More information

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others) Machine Learning Neural Networks (slides from Domingos, Pardo, others) Human Brain Neurons Input-Output Transformation Input Spikes Output Spike Spike (= a brief pulse) (Excitatory Post-Synaptic Potential)

More information

HMM and IOHMM Modeling of EEG Rhythms for Asynchronous BCI Systems

HMM and IOHMM Modeling of EEG Rhythms for Asynchronous BCI Systems HMM and IOHMM Modeling of EEG Rhythms for Asynchronous BCI Systems Silvia Chiappa and Samy Bengio {chiappa,bengio}@idiap.ch IDIAP, P.O. Box 592, CH-1920 Martigny, Switzerland Abstract. We compare the use

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE 4: Linear Systems Summary # 3: Introduction to artificial neural networks DISTRIBUTED REPRESENTATION An ANN consists of simple processing units communicating with each other. The basic elements of

More information

Theory. Summary. Introduction

Theory. Summary. Introduction Waveform similarity for quality control of event locations, time picking and moment tensor solutions Fernando Castellanos, University of Alberta. Edmonton, AB. Mirko van der Baan, University of Alberta.

More information

25th Seismic Research Review - Nuclear Explosion Monitoring: Building the Knowledge Base

25th Seismic Research Review - Nuclear Explosion Monitoring: Building the Knowledge Base KARATAU, MAKANCHI, AND LOCATION IN WESTERN CHINA Lee K. Steck, George E. Randall, Michael L. Begnaud, Charlotte A. Rowe, and Aaron A. Velasco Los Alamos National Laboratory Sponsored by National Nuclear

More information

ECE521 Lecture 7/8. Logistic Regression

ECE521 Lecture 7/8. Logistic Regression ECE521 Lecture 7/8 Logistic Regression Outline Logistic regression (Continue) A single neuron Learning neural networks Multi-class classification 2 Logistic regression The output of a logistic regression

More information

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino Artificial Neural Networks Data Base and Data Mining Group of Politecnico di Torino Elena Baralis Politecnico di Torino Artificial Neural Networks Inspired to the structure of the human brain Neurons as

More information

of other regional earthquakes (e.g. Zoback and Zoback, 1980). I also want to find out

of other regional earthquakes (e.g. Zoback and Zoback, 1980). I also want to find out 4. Focal Mechanism Solutions A way to investigate source properties of the 2001 sequence is to attempt finding well-constrained focal mechanism solutions to determine if they are consistent with those

More information

Speaker Representation and Verification Part II. by Vasileios Vasilakakis

Speaker Representation and Verification Part II. by Vasileios Vasilakakis Speaker Representation and Verification Part II by Vasileios Vasilakakis Outline -Approaches of Neural Networks in Speaker/Speech Recognition -Feed-Forward Neural Networks -Training with Back-propagation

More information

COGS Q250 Fall Homework 7: Learning in Neural Networks Due: 9:00am, Friday 2nd November.

COGS Q250 Fall Homework 7: Learning in Neural Networks Due: 9:00am, Friday 2nd November. COGS Q250 Fall 2012 Homework 7: Learning in Neural Networks Due: 9:00am, Friday 2nd November. For the first two questions of the homework you will need to understand the learning algorithm using the delta

More information

Data Repository: Seismic and Geodetic Evidence For Extensive, Long-Lived Fault Damage Zones

Data Repository: Seismic and Geodetic Evidence For Extensive, Long-Lived Fault Damage Zones DR2009082 Data Repository: Seismic and Geodetic Evidence For Extensive, Long-Lived Fault Damage Zones Fault Zone Trapped Wave Data and Methods Fault zone trapped waves observed for 2 shots and 5 local

More information

Lecture 3: Pattern Classification

Lecture 3: Pattern Classification EE E6820: Speech & Audio Processing & Recognition Lecture 3: Pattern Classification 1 2 3 4 5 The problem of classification Linear and nonlinear classifiers Probabilistic classification Gaussians, mixtures

More information

What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1

What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1 What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1 Multi-layer networks Steve Renals Machine Learning Practical MLP Lecture 3 7 October 2015 MLP Lecture 3 Multi-layer networks 2 What Do Single

More information

Analysis of the 29th May 2008 Ölfus earthquake and aftershock sequence using three-component t processing on ICEARRAY

Analysis of the 29th May 2008 Ölfus earthquake and aftershock sequence using three-component t processing on ICEARRAY Analysis of the 29th May 2008 Ölfus earthquake and aftershock sequence using three-component t processing on ICEARRAY Benedikt Halldórsson Steven J. Gibbons International Symposium on Strong-motion Earthquake

More information

A new automatic S-onset detection technique; application in microseismic data analysis

A new automatic S-onset detection technique; application in microseismic data analysis A new automatic S-onset detection technique; application in microseismic data analysis Athanasios Lois (1), Efthimios Sokos (1), Nikolaos Martakis (), Paraskevas Paraskevopoulos and G-Akis Tselentis (1)

More information

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann (Feed-Forward) Neural Networks 2016-12-06 Dr. Hajira Jabeen, Prof. Jens Lehmann Outline In the previous lectures we have learned about tensors and factorization methods. RESCAL is a bilinear model for

More information

JOINT ACCURATE TIME-FREQUENCY AND HIGH-RESOLUTION ARRAY ANALYSIS, A TOOL FOR SITE EFFECTS ESTIMATION?

JOINT ACCURATE TIME-FREQUENCY AND HIGH-RESOLUTION ARRAY ANALYSIS, A TOOL FOR SITE EFFECTS ESTIMATION? Third International Symposium on the Effects of Surface Geology on Seismic Motion Grenoble, France, 30 August - 1 September 2006 Paper Number: 152 JOINT ACCURATE TIME-FREQUENCY AND HIGH-RESOLUTION ARRAY

More information

Mark Gales October y (x) x 1. x 2 y (x) Inputs. Outputs. x d. y (x) Second Output layer layer. layer.

Mark Gales October y (x) x 1. x 2 y (x) Inputs. Outputs. x d. y (x) Second Output layer layer. layer. University of Cambridge Engineering Part IIB & EIST Part II Paper I0: Advanced Pattern Processing Handouts 4 & 5: Multi-Layer Perceptron: Introduction and Training x y (x) Inputs x 2 y (x) 2 Outputs x

More information

Observation of shear-wave splitting from microseismicity induced by hydraulic fracturing: A non-vti story

Observation of shear-wave splitting from microseismicity induced by hydraulic fracturing: A non-vti story Observation of shear-wave splitting from microseismicity induced by hydraulic fracturing: A non-vti story Petr Kolinsky 1, Leo Eisner 1, Vladimir Grechka 2, Dana Jurick 3, Peter Duncan 1 Summary Shear

More information

A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation

A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation F Onur Hocao glu, Ö Nezih Gerek, and Mehmet Kurban Anadolu University, Dept of Electrical and Electronics Eng, Eskisehir, Turkey

More information

Introduction to Biomedical Engineering

Introduction to Biomedical Engineering Introduction to Biomedical Engineering Biosignal processing Kung-Bin Sung 6/11/2007 1 Outline Chapter 10: Biosignal processing Characteristics of biosignals Frequency domain representation and analysis

More information

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others) Machine Learning Neural Networks (slides from Domingos, Pardo, others) For this week, Reading Chapter 4: Neural Networks (Mitchell, 1997) See Canvas For subsequent weeks: Scaling Learning Algorithms toward

More information

COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS

COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS Proceedings of the First Southern Symposium on Computing The University of Southern Mississippi, December 4-5, 1998 COMPARING PERFORMANCE OF NEURAL NETWORKS RECOGNIZING MACHINE GENERATED CHARACTERS SEAN

More information

Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011!

Artificial Neural Networks and Nonparametric Methods CMPSCI 383 Nov 17, 2011! Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011! 1 Todayʼs lecture" How the brain works (!)! Artificial neural networks! Perceptrons! Multilayer feed-forward networks! Error

More information

Neural Networks DWML, /25

Neural Networks DWML, /25 DWML, 2007 /25 Neural networks: Biological and artificial Consider humans: Neuron switching time 0.00 second Number of neurons 0 0 Connections per neuron 0 4-0 5 Scene recognition time 0. sec 00 inference

More information

An improved method for hydrofracture induced microseismic. event detection and phase picking

An improved method for hydrofracture induced microseismic. event detection and phase picking Page 1 of 24 Geophysics Manuscript, Accepted Pending: For Review Not Production An improved method for hydrofracture induced microseismic event detection and phase picking Fuxian Song 1, H. Sadi Kuleli

More information

Data Mining Part 5. Prediction

Data Mining Part 5. Prediction Data Mining Part 5. Prediction 5.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline How the Brain Works Artificial Neural Networks Simple Computing Elements Feed-Forward Networks Perceptrons (Single-layer,

More information

Operational modal analysis using forced excitation and input-output autoregressive coefficients

Operational modal analysis using forced excitation and input-output autoregressive coefficients Operational modal analysis using forced excitation and input-output autoregressive coefficients *Kyeong-Taek Park 1) and Marco Torbol 2) 1), 2) School of Urban and Environment Engineering, UNIST, Ulsan,

More information

STA 414/2104: Lecture 8

STA 414/2104: Lecture 8 STA 414/2104: Lecture 8 6-7 March 2017: Continuous Latent Variable Models, Neural networks Delivered by Mark Ebden With thanks to Russ Salakhutdinov, Jimmy Ba and others Outline Continuous latent variable

More information

EECS490: Digital Image Processing. Lecture #26

EECS490: Digital Image Processing. Lecture #26 Lecture #26 Moments; invariant moments Eigenvector, principal component analysis Boundary coding Image primitives Image representation: trees, graphs Object recognition and classes Minimum distance classifiers

More information

of the San Jacinto Fault Zone and detailed event catalog from spatially-dense array data

of the San Jacinto Fault Zone and detailed event catalog from spatially-dense array data Shallow structure s of the San Jacinto Fault Zone and detailed event catalog from spatially-dense array data Yehuda Ben-Zion, University of Southern California, with F. Vernon, Z. Ross, D. Zigone, Y. Ozakin,

More information

DR

DR DR2003071 0 0 270 0 30 0 90 0 60 0 120 0 150 0 90 0 180 0 180 0 A) RadialReceiverFunctions B ackazimuth (in degrees relative to north) -135-90 -45 0 45 90 135 180-5.0-2.5 Tangential R eceiver Functions

More information

Neural Networks. Nicholas Ruozzi University of Texas at Dallas

Neural Networks. Nicholas Ruozzi University of Texas at Dallas Neural Networks Nicholas Ruozzi University of Texas at Dallas Handwritten Digit Recognition Given a collection of handwritten digits and their corresponding labels, we d like to be able to correctly classify

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks Threshold units Gradient descent Multilayer networks Backpropagation Hidden layer representations Example: Face Recognition Advanced topics 1 Connectionist Models Consider humans:

More information

Artificial Neural Networks Examination, March 2004

Artificial Neural Networks Examination, March 2004 Artificial Neural Networks Examination, March 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum

More information

ECE521 Lectures 9 Fully Connected Neural Networks

ECE521 Lectures 9 Fully Connected Neural Networks ECE521 Lectures 9 Fully Connected Neural Networks Outline Multi-class classification Learning multi-layer neural networks 2 Measuring distance in probability space We learnt that the squared L2 distance

More information

DETECTING PROCESS STATE CHANGES BY NONLINEAR BLIND SOURCE SEPARATION. Alexandre Iline, Harri Valpola and Erkki Oja

DETECTING PROCESS STATE CHANGES BY NONLINEAR BLIND SOURCE SEPARATION. Alexandre Iline, Harri Valpola and Erkki Oja DETECTING PROCESS STATE CHANGES BY NONLINEAR BLIND SOURCE SEPARATION Alexandre Iline, Harri Valpola and Erkki Oja Laboratory of Computer and Information Science Helsinki University of Technology P.O.Box

More information

INTERPRETATION OF SEISMOGRAMS

INTERPRETATION OF SEISMOGRAMS INTERPRETATION OF SEISMOGRAMS INTRODUCTION 2 SEISMIC ONSETS 3 PROPERTIES 3 NOMENCLATURE 4 BODY WAVES 4 CRUSTAL PHASES 4 DEPTH PHASES 4 CORE PHASES 4 SURFACE WAVES 5 SURFACE WAVE RECURRENCE 6 TRAVEL TIME

More information

Research Article Algorithm Indicating Moment of P-Wave Arrival Based on Second-Moment Characteristic

Research Article Algorithm Indicating Moment of P-Wave Arrival Based on Second-Moment Characteristic Shock and Vibration Volume 216, Article ID 45171, 6 pages http://dx.doi.org/1.1155/216/45171 Research Article Algorithm Indicating Moment of P-Wave Arrival Based on Second-Moment Characteristic Jakub Sokolowski,

More information

Artificial Neural Networks Examination, June 2005

Artificial Neural Networks Examination, June 2005 Artificial Neural Networks Examination, June 2005 Instructions There are SIXTY questions. (The pass mark is 30 out of 60). For each question, please select a maximum of ONE of the given answers (either

More information

Lecture 3: Pattern Classification. Pattern classification

Lecture 3: Pattern Classification. Pattern classification EE E68: Speech & Audio Processing & Recognition Lecture 3: Pattern Classification 3 4 5 The problem of classification Linear and nonlinear classifiers Probabilistic classification Gaussians, mitures and

More information

Machine Learning. Neural Networks

Machine Learning. Neural Networks Machine Learning Neural Networks Bryan Pardo, Northwestern University, Machine Learning EECS 349 Fall 2007 Biological Analogy Bryan Pardo, Northwestern University, Machine Learning EECS 349 Fall 2007 THE

More information

Polarization analysis on three-component seismic data

Polarization analysis on three-component seismic data Bollettino di Geofisica Teorica ed Applicata Vol., n. -, pp. 9-; Sep.-Dec. Polarization analysis on three-component seismic data P. Capizzi, L. De Luca and M. Vitale Department of Chemistry and Physics

More information

Machine Learning for Large-Scale Data Analysis and Decision Making A. Neural Networks Week #6

Machine Learning for Large-Scale Data Analysis and Decision Making A. Neural Networks Week #6 Machine Learning for Large-Scale Data Analysis and Decision Making 80-629-17A Neural Networks Week #6 Today Neural Networks A. Modeling B. Fitting C. Deep neural networks Today s material is (adapted)

More information

Long-period Ground Motion Characteristics of the Osaka Sedimentary Basin during the 2011 Great Tohoku Earthquake

Long-period Ground Motion Characteristics of the Osaka Sedimentary Basin during the 2011 Great Tohoku Earthquake Long-period Ground Motion Characteristics of the Osaka Sedimentary Basin during the 2011 Great Tohoku Earthquake K. Sato, K. Asano & T. Iwata Disaster Prevention Research Institute, Kyoto University, Japan

More information

Lecture 4: Feed Forward Neural Networks

Lecture 4: Feed Forward Neural Networks Lecture 4: Feed Forward Neural Networks Dr. Roman V Belavkin Middlesex University BIS4435 Biological neurons and the brain A Model of A Single Neuron Neurons as data-driven models Neural Networks Training

More information

Wavelet based feature extraction for classification of Power Quality Disturbances

Wavelet based feature extraction for classification of Power Quality Disturbances European Association for the Development of Renewable Energies, Environment and Power Quality (EA4EPQ) International Conference on Renewable Energies and Power Quality (ICREPQ 11) Las Palmas de Gran Canaria

More information

Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption

Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption ANDRÉ NUNES DE SOUZA, JOSÉ ALFREDO C. ULSON, IVAN NUNES

More information

Earthquake location at teleseismic distances from 3-component records (Tutorial with exercise by hand)

Earthquake location at teleseismic distances from 3-component records (Tutorial with exercise by hand) Topic Author Version Earthquake location at teleseismic distances from 3-component records (Tutorial with exercise by hand) Peter Bormann (formerly GFZ German Research Centre for Geosciences, D-14473 Potsdam,

More information

29th Monitoring Research Review: Ground-Based Nuclear Explosion Monitoring Technologies MODELING P WAVE MULTIPATHING IN SOUTHEAST ASIA

29th Monitoring Research Review: Ground-Based Nuclear Explosion Monitoring Technologies MODELING P WAVE MULTIPATHING IN SOUTHEAST ASIA MODELING P WAVE MULTIPATHING IN SOUTHEAST ASIA Ali Fatehi and Keith D. Koper Saint Louis University Sponsored by the Air Force Research Laboratory ABSTRACT Contract No. FA8718-06-C-0003 We have used data

More information

100 inference steps doesn't seem like enough. Many neuron-like threshold switching units. Many weighted interconnections among units

100 inference steps doesn't seem like enough. Many neuron-like threshold switching units. Many weighted interconnections among units Connectionist Models Consider humans: Neuron switching time ~ :001 second Number of neurons ~ 10 10 Connections per neuron ~ 10 4 5 Scene recognition time ~ :1 second 100 inference steps doesn't seem like

More information

Temperature Prediction based on Artificial Neural Network and its Impact on Rice Production, Case Study: Bangladesh

Temperature Prediction based on Artificial Neural Network and its Impact on Rice Production, Case Study: Bangladesh erature Prediction based on Artificial Neural Network and its Impact on Rice Production, Case Study: Bangladesh Tushar Kanti Routh Lecturer, Department of Electronics & Telecommunication Engineering, South

More information

Effects of Surface Geology on Seismic Motion

Effects of Surface Geology on Seismic Motion 4 th IASPEI / IAEE International Symposium: Effects of Surface Geology on Seismic Motion August 23 26, 2011 University of California Santa Barbara VELOCITY STRUCTURE INVERSIONS FROM HORIZONTAL TO VERTICAL

More information

Introduction Biologically Motivated Crude Model Backpropagation

Introduction Biologically Motivated Crude Model Backpropagation Introduction Biologically Motivated Crude Model Backpropagation 1 McCulloch-Pitts Neurons In 1943 Warren S. McCulloch, a neuroscientist, and Walter Pitts, a logician, published A logical calculus of the

More information

Deep Neural Networks (1) Hidden layers; Back-propagation

Deep Neural Networks (1) Hidden layers; Back-propagation Deep Neural Networs (1) Hidden layers; Bac-propagation Steve Renals Machine Learning Practical MLP Lecture 3 4 October 2017 / 9 October 2017 MLP Lecture 3 Deep Neural Networs (1) 1 Recap: Softmax single

More information

Artificial Neural Network

Artificial Neural Network Artificial Neural Network Contents 2 What is ANN? Biological Neuron Structure of Neuron Types of Neuron Models of Neuron Analogy with human NN Perceptron OCR Multilayer Neural Network Back propagation

More information

Address for Correspondence

Address for Correspondence Research Article APPLICATION OF ARTIFICIAL NEURAL NETWORK FOR INTERFERENCE STUDIES OF LOW-RISE BUILDINGS 1 Narayan K*, 2 Gairola A Address for Correspondence 1 Associate Professor, Department of Civil

More information

COMPARISON OF FREQUENCY AND TIME-DOMAIN OBJECTIVE FUNCTIONS FOR BOREHOLE STATION'S INVERSE PROBLEMS

COMPARISON OF FREQUENCY AND TIME-DOMAIN OBJECTIVE FUNCTIONS FOR BOREHOLE STATION'S INVERSE PROBLEMS Paper No. COFDE COMPARISON OF FREQUENCY AND TIME-DOMAIN OBJECTIVE FUNCTIONS FOR BOREHOLE STATION'S INVERSE PROBLEMS Florent DE MARTIN 1 ABSTRACT This paper compares the use of frequency and time-domain

More information

A FUZZY NEURAL NETWORK MODEL FOR FORECASTING STOCK PRICE

A FUZZY NEURAL NETWORK MODEL FOR FORECASTING STOCK PRICE A FUZZY NEURAL NETWORK MODEL FOR FORECASTING STOCK PRICE Li Sheng Institute of intelligent information engineering Zheiang University Hangzhou, 3007, P. R. China ABSTRACT In this paper, a neural network-driven

More information

CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS

CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS 46 CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS 3.1 INTRODUCTION Cardiac beat classification is a key process in the detection of myocardial ischemic episodes

More information

Multilayer Perceptron Learning Utilizing Singular Regions and Search Pruning

Multilayer Perceptron Learning Utilizing Singular Regions and Search Pruning Multilayer Perceptron Learning Utilizing Singular Regions and Search Pruning Seiya Satoh and Ryohei Nakano Abstract In a search space of a multilayer perceptron having hidden units, MLP(), there exist

More information

Chapter 9: The Perceptron

Chapter 9: The Perceptron Chapter 9: The Perceptron 9.1 INTRODUCTION At this point in the book, we have completed all of the exercises that we are going to do with the James program. These exercises have shown that distributed

More information

Object Recognition Using a Neural Network and Invariant Zernike Features

Object Recognition Using a Neural Network and Invariant Zernike Features Object Recognition Using a Neural Network and Invariant Zernike Features Abstract : In this paper, a neural network (NN) based approach for translation, scale, and rotation invariant recognition of objects

More information

Application of cepstrum and neural network to bearing fault detection

Application of cepstrum and neural network to bearing fault detection Journal of Mechanical Science and Technology 23 (2009) 2730~2737 Journal of Mechanical Science and Technology www.springerlin.com/content/738-494x DOI 0.007/s2206-009-0802-9 Application of cepstrum and

More information

Neural Networks and Fuzzy Logic Rajendra Dept.of CSE ASCET

Neural Networks and Fuzzy Logic Rajendra Dept.of CSE ASCET Unit-. Definition Neural network is a massively parallel distributed processing system, made of highly inter-connected neural computing elements that have the ability to learn and thereby acquire knowledge

More information

Data S.A. 30s. Xe= Gravity anom. sigd=0.06 corlength=1000s sigp=1. dg microgal. dg microgal. Data S.A. 30s. Xe=

Data S.A. 30s. Xe= Gravity anom. sigd=0.06 corlength=1000s sigp=1. dg microgal. dg microgal. Data S.A. 30s. Xe= Gravity anom. sigd=.6 corlength=4s sigp=1. Gravity anom. sigd=.6 corlength=6s sigp=1. Xe=.594 Λ=4s Xe=.595 Λ=6s -2. -15. -1. -5.. Tim -2. -15. -1. -5.. Tim Gravity anom. sigd=.6 corlength=8s sigp=1. Gravity

More information

Deep Learning Architecture for Univariate Time Series Forecasting

Deep Learning Architecture for Univariate Time Series Forecasting CS229,Technical Report, 2014 Deep Learning Architecture for Univariate Time Series Forecasting Dmitry Vengertsev 1 Abstract This paper studies the problem of applying machine learning with deep architecture

More information

A Novel Activity Detection Method

A Novel Activity Detection Method A Novel Activity Detection Method Gismy George P.G. Student, Department of ECE, Ilahia College of,muvattupuzha, Kerala, India ABSTRACT: This paper presents an approach for activity state recognition of

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface

More information

DEVELOPMENT OF AUTOMATED MOMENT TENSOR SOFTWARE AT THE PROTOTYPE INTERNATIONAL DATA CENTER

DEVELOPMENT OF AUTOMATED MOMENT TENSOR SOFTWARE AT THE PROTOTYPE INTERNATIONAL DATA CENTER DEVELOPMENT OF AUTOMATED MOMENT TENSOR SOFTWARE AT THE PROTOTYPE INTERNATIONAL DATA CENTER Douglas Dreger, Barbara Romanowicz, and Jeffry Stevens* Seismological Laboratory 281 McCone Hall University of

More information

Neural Network Based Response Surface Methods a Comparative Study

Neural Network Based Response Surface Methods a Comparative Study . LS-DYNA Anwenderforum, Ulm Robustheit / Optimierung II Neural Network Based Response Surface Methods a Comparative Study Wolfram Beyer, Martin Liebscher, Michael Beer, Wolfgang Graf TU Dresden, Germany

More information

Apprentissage, réseaux de neurones et modèles graphiques (RCP209) Neural Networks and Deep Learning

Apprentissage, réseaux de neurones et modèles graphiques (RCP209) Neural Networks and Deep Learning Apprentissage, réseaux de neurones et modèles graphiques (RCP209) Neural Networks and Deep Learning Nicolas Thome Prenom.Nom@cnam.fr http://cedric.cnam.fr/vertigo/cours/ml2/ Département Informatique Conservatoire

More information

Main Menu. Summary. Introduction

Main Menu. Summary. Introduction Kyosuke Okamoto *, JSPS Research Fellow, Kyoto University; Ru-shan Wu, University of California, Santa Cruz; Hitoshi Mikada, Tada-nori Goto, Junichi Takekawa, Kyoto University Summary Coda-Q is a stochastic

More information

Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr. Harit K. Raval 3

Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr. Harit K. Raval 3 Investigations on Prediction of MRR and Surface Roughness on Electro Discharge Machine Using Regression Analysis and Artificial Neural Network Programming Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr.

More information

Learning and Memory in Neural Networks

Learning and Memory in Neural Networks Learning and Memory in Neural Networks Guy Billings, Neuroinformatics Doctoral Training Centre, The School of Informatics, The University of Edinburgh, UK. Neural networks consist of computational units

More information