Forecasting of Rain Fall in Mirzapur District, Uttar Pradesh, India Using Feed-Forward Artificial Neural Network

Similar documents
ESTIMATION OF HOURLY MEAN AMBIENT TEMPERATURES WITH ARTIFICIAL NEURAL NETWORKS 1. INTRODUCTION

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD

Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption

Neural Networks and the Back-propagation Algorithm

A Feature Based Neural Network Model for Weather Forecasting

Rainfall Prediction using Back-Propagation Feed Forward Network

Course 395: Machine Learning - Lectures

Introduction Neural Networks - Architecture Network Training Small Example - ZIP Codes Summary. Neural Networks - I. Henrik I Christensen

Optimal Artificial Neural Network Modeling of Sedimentation yield and Runoff in high flow season of Indus River at Besham Qila for Terbela Dam

Artificial Neural Network

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso

Prediction of Hourly Solar Radiation in Amman-Jordan by Using Artificial Neural Networks

Journal of of Computer Applications Research Research and Development and Development (JCARD), ISSN (Print), ISSN

4. Multilayer Perceptrons

COMP-4360 Machine Learning Neural Networks

Portugaliae Electrochimica Acta 26/4 (2008)

Estimation of Pan Evaporation Using Artificial Neural Networks A Case Study

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Prediction of Monthly Rainfall of Nainital Region using Artificial Neural Network (ANN) and Support Vector Machine (SVM)

International Journal of Emerging Technologies in Computational and Applied Sciences (IJETCAS)

Reading Group on Deep Learning Session 1

Vasil Khalidov & Miles Hansard. C.M. Bishop s PRML: Chapter 5; Neural Networks

Data Mining Part 5. Prediction

Forecasting River Flow in the USA: A Comparison between Auto-Regression and Neural Network Non-Parametric Models

Artificial Intelligence

On the convergence speed of artificial neural networks in the solving of linear systems

Wind Power Forecasting using Artificial Neural Networks

RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS

Weather based forecasting model for crops yield using neural network approach

Introduction to Natural Computation. Lecture 9. Multilayer Perceptrons and Backpropagation. Peter Lewis

Artificial Neural Networks The Introduction

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Temperature Prediction based on Artificial Neural Network and its Impact on Rice Production, Case Study: Bangladesh

International Journal of Advanced Research in Computer Science and Software Engineering

Comparison learning algorithms for artificial neural network model for flood forecasting, Chiang Mai, Thailand

Introduction to Artificial Neural Networks

Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011!

A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation

Feedforward Neural Nets and Backpropagation

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller

y(x n, w) t n 2. (1)

Optimum Neural Network Architecture for Precipitation Prediction of Myanmar

Introduction To Artificial Neural Networks

Feature Selection Optimization Solar Insolation Prediction Using Artificial Neural Network: Perspective Bangladesh

Lab 5: 16 th April Exercises on Neural Networks

Artificial Neural Network Method of Rock Mass Blastability Classification

Temporal Backpropagation for FIR Neural Networks

Keywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm

Neural Networks. Chapter 18, Section 7. TB Artificial Intelligence. Slides from AIMA 1/ 21

Revision: Neural Network

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Simple Neural Nets For Pattern Classification

Estimation of Reference Evapotranspiration by Artificial Neural Network

Artificial Neural Networks. Introduction to Computational Neuroscience Tambet Matiisen

Local Prediction of Precipitation Based on Neural Network

Data and prognosis for renewable energy

Serious limitations of (single-layer) perceptrons: Cannot learn non-linearly separable tasks. Cannot approximate (learn) non-linear functions

A Logarithmic Neural Network Architecture for Unbounded Non-Linear Function Approximation

Last update: October 26, Neural networks. CMSC 421: Section Dana Nau

Artificial neural networks in wave predictions at the west coast of. Portugal

Neural Networks (Part 1) Goals for the lecture

Artificial Neural Networks. Edward Gatt

Design Collocation Neural Network to Solve Singular Perturbed Problems with Initial Conditions

Thunderstorm Forecasting by using Artificial Neural Network

Journal of Urban and Environmental Engineering, v.3, n.1 (2009) 1 6 ISSN doi: /juee.2009.v3n

Neural networks. Chapter 20, Section 5 1

Back-Propagation Algorithm. Perceptron Gradient Descent Multilayered neural network Back-Propagation More on Back-Propagation Examples

Unit 8: Introduction to neural networks. Perceptrons

Artificial Neural Networks

Multilayer Perceptrons and Backpropagation

Artificial Neural Networks. MGS Lecture 2

Neural Networks and Deep Learning

Neural Networks biological neuron artificial neuron 1

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann

Artificial Neural Networks. Historical description

FORECASTING YIELD PER HECTARE OF RICE IN ANDHRA PRADESH

Chapter ML:VI (continued)

Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters

Computational statistics

Lecture 4: Perceptrons and Multilayer Perceptrons

Modelling and Prediction of 150KW PV Array System in Northern India using Artificial Neural Network

Neural Networks for Machine Learning. Lecture 2a An overview of the main types of neural network architecture

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009

SOIL MOISTURE MODELING USING ARTIFICIAL NEURAL NETWORKS

Lecture 5: Logistic Regression. Neural Networks

Introduction to Neural Networks

Fundamentals of Neural Networks

Pattern Recognition Prof. P. S. Sastry Department of Electronics and Communication Engineering Indian Institute of Science, Bangalore

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs)

Real Time wave forecasting using artificial neural network with varying input parameter

An artificial neural networks (ANNs) model is a functional abstraction of the

ARTIFICIAL INTELLIGENCE. Artificial Neural Networks

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs)

Machine Learning. Neural Networks

A. Pelliccioni (*), R. Cotroneo (*), F. Pungì (*) (*)ISPESL-DIPIA, Via Fontana Candida 1, 00040, Monteporzio Catone (RM), Italy.

Neural Networks Lecturer: J. Matas Authors: J. Matas, B. Flach, O. Drbohlav

Chapter ML:VI (continued)

Weekly Rainfall Analysis and Markov Chain Model Probability of Dry and Wet Weeks at Varanasi in Uttar Pradesh

Neural Networks Introduction

Artificial Neuron (Perceptron)

Transcription:

International Journal of Engineering Science Invention ISSN (Online): 2319 6734, ISSN (Print): 2319 6726 Volume 2 Issue 8ǁ August. 2013 ǁ PP.87-93 Forecasting of Rain Fall in Mirzapur District, Uttar Pradesh, India Using Feed-Forward Artificial Neural Network Rajan Kumar 1 and G.S. Yadav 2 1, 2 (Department of Geophysics, Banaras Hindu University, Varanasi, India) ABSTRACT: Rain fall is a major component of ecosystem and important role in hydrological cycle. It is recharged ground naturally. Rain fall percolate through pores of space of soil and enhance groundwater availability result in increasing level of groundwater. A feed-forward neural network model has been developed and trained with Levenberg Marquardt Back Propagation Algorithm for forecasting of rain fall in Mirzapur district, Uttar Pradesh, India. Monthly temperature (average, diurnal, maximum and minimum), evaporation (Potential and Reference crop), relative humidity, cloud cover and frequency (ground frost and wet day) have been chosen for inputs and rain fall for targets. The good results of the artificial neural network (ANN) model is depend upon the high correlation between actual and predicted value of rain fall. The regression coefficient (R 2 ) was calculated for efficiency and accuracy of developed model. For best fitting of developed model, the predicted trend followed the observed trend closely (regression coefficient (R 2 ) = 0.9858) and other statistics parameters of artificial neural network (ANN) of model were calculated such as mean, standard deviation (S.D.), and error mean, error standard deviation (error S.D.) and standard deviation ratio (S.D. ratio). KEYWORDS: Artificial neural network (ANN), Rain fall, Back propagation feed-forward, Forecasting, Mirzapur I. INTRODUCTION Rain fall process is essentially random in nature. It is important role in hydrological cycle. Due to rain fall natural recharge take place and it follows rising of groundwater level. Rainfall forecasting is one of the most difficult and important processes of the hydrologic cycle. This is largely related to the variability it displays over a wide range of scales both in time and space [1]. Flash flooding, being a product of intense rainfall, is a life-threatening phenomenon. Developing a rainfall forecasting and flood warning system for typical catchments is not considered a simple task. Both internal and external characteristics of rainfall field depend on many factors including: pressure, temperature, wind speed and its direction, meteorological characteristics of the catchments and so on. Although a physicallybased approach for rainfall forecasting has several advantages, given the short time scale, the small catchments area, and the massive costs associated with collecting the required meteorological data, it is not a feasible alternative in most cases because it involves many variables which are interconnected in a very complicated way [2]. Artificial neural network (ANN) has been widely used on pattern/speech recognition and image/signal processing in a variety of fields [3]. II. LOCATION & GEOGRAPHICAL OF THE STUDY AREA The study area extended over Mirzapur district and is the part of south-east Uttar Pradesh, shown in Fig.1. It is bounded in north by Sant Ravidas Nagar district, in south by Sonbhadra district & Rewa District of Madhya Pradesh, in east by Chandauli district, in West by Allahabad district and in north-west by Varanasi. It situated between latitudes 24 0 20 24 to 25 0 09 36 north and longitudes 82 0 30 00 to 83 0 06 36 east and total area approximately 4522 sq. kms. It has an average elevation of 80 metres (265 feet). 87 Page

Fig. 1: Map of the study area III. ARTIFICIAL NEURAL NETWORK (ANN) Artificial neural networks (ANNs) started about 47 years ago, when the theory of perceptron was presented by Rosenblatt (1962). During the mid-1960s, the interest in the artificial neural network (ANN) decreased, because of the limitations of the theory of perceptron [4]. Since new ANN paradigms have overcome some of these limitations, the artificial neural network (ANN) has emerged again as an active research area within computer science, engineering, physics and geophysics [5].In recent years, Artificial neural networks (ANNs) have become extremely popular for prediction and forecasting in a number of areas, including finance, power generation, medicine, water resources and environmental science [1].The Artificial neural network (ANN) is computational tool based on the biological nervous systems. Artificial neural network (ANN) is composed of three essentials: neurons, architecture and learning paradigm. Neurons are fundamental elements of a network and are interconnected in a definite rule to form architecture through network weights. The learning paradigm refers to the method that the network weights are adjusted [6]. IV. FEED-FORWARD NEURAL NETWORK (FNN) The Feed-forward neural networks have been applied successfully in many different problems since the advent of the error backpropagation learning algorithm. This network architecture and the corresponding learning algorithm can be viewed as a generalization of the popular least-mean-square (LMS) algorithm [7-8]. Fig. 2: Architecture of the Artificial Neural Network (ANN) model 88 Page

A multilayer perceptron network consists of an input layer, one or more hidden layers of computation nodes, and an output layer. Figure 2 shows a typical feed-forward network with one hidden layer consisting of three nodes, four input neurons and one output. The input signal propagates through the network in a forward direction, layer by layer. Their main advantage is that they are easy to handle, and can approximate any input/output map, as established by Hornik et al. (1989). The key disadvantages are that they train slowly, and require lots of training data (typically three times more training samples than network weights) [8]. V. TRAINING AND TESTING WITH LEVENBERG-MARQUARDT BACK PROPAGATION ALGORITHM (LMB) The Levenberg Marquardt method is a modification of the classic Newton algorithm for finding an optimum solution to a minimization problem. It uses an approximation to the Hessian matrix in the following Newton-like weight update where x the weights of neural network, J the Jacobian matrix of the performance criteria to be minimized, a scalar that controls the learning process and e the residual error vector. When the scalar is zero, Eq. (1) is just the Newton s method, using the approximate Hessian matrix. When is large, Eq. (1) becomes gradient descent with a small step size. Newton s method is faster and more accurate near an error minimum, so the aim is to shift towards Newton s method as quickly as possible [8]. Here, seven years (1995-2002) monthly rain fall data have been used for targets data and other metrological parameters such as monthly temperature (average, diurnal, maximum and minimum), evaporation (Potential and Reference crop), relative humidity, cloud cover and frequency (ground frost and wet day) have been used for inputs data. VI. Statistics of Artificial Neural Network ANN Model The regression coefficient (R 2 ) was measured for efficiency and accuracy of developed model and calculated by where is regression coefficient is the observed data is the calculated data is the number of observations. Regression analysis is utilized to measure the degree of correlation between the actual output and the network output. Regression coefficient (R 2 ) of 1 gives an indication of a perfect model while an (R 2 ) of 0 indicates a very bad model. A perfect prediction will have a regression coefficient of 1.0. A correlation of 1.0 does not necessarily indicate a perfect prediction (only a prediction which is perfectly linearly correlated with the actual outputs), although in practice the regression coefficient is a good indicator of performance. Other statistics parameters of Artificial Neural Network (ANN) of model were calculated such as mean, standard deviation (S.D.), and error mean, error standard deviation (error S.D.) and standard deviation ratio (S.D. ratio) shown in table 1 [9]. VII. RESULTS AND DISCUSSION Deciding the number of neurons in the hidden layers is a very important part of deciding overall neural network architecture. There are many rule-of-thumb methods for determining the correct number of neurons to use in the hidden layers, such as (1) The number of hidden neurons should be between the size of the input layer and the size of the output layer (2) The number of hidden neurons should be 2/3 the size of the input layer, plus the size of the output layer (3) The number of hidden neurons should be less than twice the size of the input layer[10]. 89 Page

90 Page

91 Page

Fig. 3a-h Trend of the model corresponds to the regression analysis of the model Here, ten input layer such as temperature (average, diurnal, maximum and minimum), evaporation (Potential and Reference crop), relative humidity, cloud cover and frequency (ground frost and wet day) and one output layer such as rain fall have been chosen. So, according to thumb rule the number of hidden neurons should be less than twenty. Regression coefficient ( ) have been calculated from Eq.2 and varies from 0.8563 to 0.9858. Fig. 3a: This figure presented a comparison of predicted rain fall using artificial neural network (ANN) and the observed rain fall with the standard deviation and shows very high correlation between the observed and predicted values of rain fall. The regression coefficient (R 2 ) between the predicted and observed output values of the artificial neural network (ANN) model is 0.9858. The high value of regression coefficient (R 2 ) showed that the predicted trend of rain fall (model trend) using the artificial neural network (ANN) model followed the observed trend of rain fall and in between very good agreement which indicates, artificial neural network (ANN ) model are helpful and applicable for prediction. Fig. 3b: The number of hidden layer is 9 and the value of regression coefficient ( ) is approximately 0.9006. It is closely to one. The model trend followed 75% to the observed trend shown in Fig. 3b and other statistics parameters has been calculated and shown in table 1. Fig. 3c: The value of regression coefficient ( observed trend shown in Fig. 3c. ) is approximately 0.9295. The model trend followed 67% to the 92 Page

Fig. 3d: The number of hidden layer is 8 and the value of regression coefficient ( ) is approximately 0.9644. It is closely to one. The model trend followed 90% to the observed trend shown in Fig. 3d and in between very good agreement. Fig. 3e: The model trend followed only 34% to the observed trend shown in Fig. 3e and the predicted trend of rain fall (model trend) using the artificial neural network (ANN) model was not followed properly to the observed trend of rain fall and no good agreement in between. Fig. 3f: The number of hidden layer is 9 and the value of regression coefficient ( ) is approximately 0.9665. It is closely to one but the model trend followed only 67% to the observed trend shown in Fig. 3f. Fig. 3g: The number of hidden layer is 9 and the value of regression coefficient ( ) is approximately 0.8563. The model trend followed 67% to the observed trend shown in Fig. 3g and other statistics parameters shown in table 1. Fig. 3 h: The model trend followed 75% to the observed trend shown in Fig. 3h. The number of hidden layer is 13 and the value of regression coefficient ( ) is approximately 0.9119. It is closely to one and the predicted trend of rain fall (model trend) using the artificial neural network (ANN) model followed the observed trend of rain fall and in between very good agreement which indicates, artificial neural network (ANN) model are helpful and applicable for prediction. Table 1: Network parameters, Regression coefficient (R 2 ) and other statistics parameters for the ANN model Year Hidden Neuron Layers Learning rate (η) Regression coefficient (R 2 ) Mean Standard Deviation Error Mean Error Standard Deviation Standard Deviation Ratio 1995 10 1.00E-09 0.9858 74.457 97.422 3.599 1.497 0.0153 1996 9 1.00E-08 0.9006 79.298 109.652 14.208 10.845 0.0989 1997 12 1.00E-08 0.9295 76.560 83.604 9.909 4.854 0.0580 1998 8 1.00E-08 0.9644 93.992 119.910 6.555 1.351 0.0112 1999 11 1.00E-08 0.9470 118.390 112.010 34.967 12.651 0.1129 2000 9 1.00E-08 0.9665 75.286 101.435 9.180 2.937 0.0289 2001 9 1.00E-09 0.8563 75.596 79.986 10.318 10.109 0.1263 2002 13 1.00E-08 0.9119 72.571 85.313 6.565 3.983 0.0466 VIII. ACKNOWLEDGEMENT The authors wish to thank the Head of Department of Geophysics, B.H.U, Varanasi, India for providing the Infrastrure to complete this work and also the providing the data used in the purpose. REFERENCES [1] R. Kumar and G.S. Yadav, Forecasting of Rain Fall in Varanasi District, Uttar Pradesh Using Artificial Neural Network, Journal of Environmental Science, Computer Science and Engineering &Technology.,2(3), 2013, 721-729. [2] M. Nasseri, K. Asghari and M.J. Abedini, Optimized scenario for rainfall forecasting using genetic algorithm coupled with artificial neural network, ScienceDirect., 35, 2008, 1415-1421. [3] B.Widrow and M.Lehr, 30 Years of Adaptive Neural Networks: In Neural Networks theoretical Foundations and Analysis edited by Clifford Lau., 1992, 27-53. [4] M.L. Minsky and S.A. Papert, Perceptron: MIT Press., (1969). [5] A. Neyamadpour, W.A.T. Abdullah and S. Wan Taib, Inversion of quasi-3d resistivity imaging data using artificial neural networks, Journal of Earth System Science., 119, (2010), 27-40. [6] X.U. Hai-Lang and W.U. Xiao-Ping, 2-D Resistivity inversion using the Neural Network method, Chinese Journal of Geophysics., 49, (2006), 507-514. [7] S. Haykin, Neural Networks, A Comprehensive Foundation, second ed., (Englewood Cliffs, NJ: Prentice-Hall, 1999). [8] N. Daliakopoulos, P. Coulibaly and I.K. Tsanis, Groundwater level forecasting using artificial neural network, Journal of Hydrology., 309, (2004), 229-240. [9] M. Seyam and Y. Mogheir, Application of Artificial Neural Networks Model as Analytical Tool for Groundwater Salinity, Journal of Environmental Protection., 2, (2011), 56-71. [10] J. Heaton, Introduction to Neural Networks with Java, (http://www.heatonresearch.com/articles/5/page2.html). 93 Page