STORM SURGE PREDICTION USING ARTIFICIAL NEURAL NETWORK MODEL AND CLUSTER ANALYSIS

Size: px
Start display at page:

Download "STORM SURGE PREDICTION USING ARTIFICIAL NEURAL NETWORK MODEL AND CLUSTER ANALYSIS"

Transcription

1 STORM SURGE PREDICTION USING ARTIFICIAL NEURAL NETWORK MODEL AND CLUSTER ANALYSIS DA-UN LEE 1 ; JANG-WON SEO 1 1 Global Environment System Research Lab, National Institute of Meteorological Research, Korea Meteorological Administration 45 Gisangcheong-gil, Dongjak-gu, Seoul, Republic of Korea ; ddaung@metri.re.kr; jwseo@metri.re.kr In the present study, the artificial intelligence model of neural network methodology on the prediction of storm surge was constructed and validated. In order to find the optimal model and evaluate its performance, several individual artificial neural networks were experimented with identified parameters which could be adjusted before the training phase, and the results were compared with observed sea levels and forecasted values calculated by conventional harmonic analysis (HA). Based on these previous studies, the Artificial Neural Network (ANN) model with cluster analysis method was developed to predict storm surge in the whole Korean coastal regions with especial focuses on the regional extension. The model used in this study is ANN model for each cluster (CL- NN) with the cluster analysis. In order to find the optimal clustering of the twenty one stations, agglomerative clustering with centroid-linkage method among hierarchical clustering was used. Finally the CL-NN can be constructed for predicting storm surge in the cluster regions. To validate model results, predicted sea level value from CL-NN model was compared with that of conventional harmonic analysis (HA) and of the ANN model in each region (NN). The forecast values from NN and CL-NN models show more accuracy with observed data than that of HA. Especially the statistics such as RMSE (Root Mean Square Error) and correlation coefficient shows little differences between CL-NN and NN model results. These results show that cluster analysis and CL-NN model can be applied in the regional storm surge prediction and developed forecast system. Keywords: storm surge prediction, neural network model, cluster analysis INTRODUCTION To reduce crucial coastal damage caused by strong meteorological forces, such as typhoons and strong cold fronts, more accurate storm surge prediction modeling, as well as

2 production of rapid and accurate information about typhoons, has been needed. Until now, some numerical models were usually used for predicting storm surges. However, there are limits to these models; for example, they are hard to reflect fully regional properties, especially in the Korean complex coastal regions, and demand too much time to accomplish anything. So these models are less accurate, especially in the high sea level intervals than around the average values (Sztobryn, 2003). For a more accurate local storm surge prediction, we use artificial neural network (ANN) model which is one of the statistical models. And we also use cluster analysis for regional extension to the whole Korean coastal regions. The artificial neural network model has been recently applied to many areas because of its high accuracy (Tissot et al., 2003). MODEL DESCRIPTION ARTIFICIAL NEURAL NETWORK MODEL Neural network model, originating from human brain biology, can be represented by a network diagram which is composed of three components: input layer, hidden layer and output layer (Figure 1). This model contains many interconnected units (neurons) which can extract linear and nonlinear relationships in the data. The neural network applies to regression and classification. For regression, this model has one output unit, and, for k-class classification, there are k output units in the output layer. x 1 ω 11 x 2 ω 12 H 1 M ω 1 E(y) M ω N1 H N ω 1p ω N 2 ω Np ω N x p (Input layer) (Hidden layer) (Output layer) FIGURE 1 - MLP STRUCTURE WITH ONE HIDDEN LAYER, N HIDDEN UNITS Input units correspond to input variables and each variable is usually normalized. Combination functions combine input units or hidden units, and, in the MLP (multi-layer perceptron) structure, linear combination function is mainly used. Hidden units are created by linear combinations of the input units, and the output unit is modeled as a function of linear combinations of the hidden units. The activation functions are usually chosen to be the sigmoid functions such as logistic, hyperbolic tangent functions and so on. The output

3 function allows a final transformation of linear combinations of hidden units. For regression, we typically choose the identity function. In this study, we use feed-forward neural network architecture, which receives an input layer, one broadcasting output layer, and one or more hidden layers in betweens. In a feed-forward neural network model, the units in one layer are connected only to the units in the next layer. CLUSTER ANALYSIS In the cluster analysis, distances that can show similarities are calculated for unsupervised data when variables that are highly correlated with each cluster characteristics are given. Cluster analysis groups data objects based on these distance information found in the data that describes the objects and their relationships. That is, the objects within a group are similar to one another and different from the objects in other groups (Tan et al., 2006). We consider a lot of standards of distance for measuring similarities between object X i and X j, and one of the most commonly used methods is Euclidean distance. Euclidean distance between object X and X is given in this form: i j 1/ 2 p 2 D ij = ( X i X j )( X i X j ) = ( X ki X kj ), k = 1 where p is the number of variables which are used in the cluster analysis. Especially, in agglomerative method among hierarchical clustering these methods are used for calculating similarity between objects or clusters. There are many linkage methods, including single, complete, average, and centroid methods, and centroid method is used in this study. The process of the centroid linkage method is as follows. First, if the number of objects which belong to cluster is n, then the centroid CL j CL j X j of the CL j is calculated in this form: X j = X n i CL j CL j i Second, if the number of objects which belong to cluster CL and CL is and j k n CL j ncl k, and the centroids is X j and X k, then distance D jk of the centroids between two clusters is calculated in this form: D jk = X j X k 2 Lastly, centroid X of the newly composed cluster, which is formed when two clusters are combined, is calculated by weighted average like this.

4 n X = CL j n X j CL j + n + n CLk CLk X k By repetition of these processes, we can calculate distance between each cluster, after which we can make cluster analysis. NEURAL NETWORK OPTIMUM MODELING FOR EACH STATION The optimum structure of this neural network model should be determined from the data. Therefore this stage involves some problems (Hastie et al., 2001). 1) Starting values: The starting values for weights are chosen to be random values near zero. So the model starts out nearly linear, and becomes nonlinear as the weights increase. 2) Over-fitting: Neural network has often too many weights so that it has tendency to over-fit the training data. Hence we should train the model only for a while, and stop well before it approaches the global minimum of the training data. 3) The number of Hidden units and layers: With too many hidden units, the extra weights can be shrunk toward zero if appropriate regularization is used. It is most common to put down a reasonably large number of units and train them with regularization and choose the number of hidden units. 4) Selection of input variables: The appropriate lags and input variables of the model have to be selected. To choose the optimal model for station Jeju and Yeosu in the Korean Peninsula, many experiments were carried out using different training data sets, input variables (variable and lag selection of observed storm surge height, wind stress, and sea level pressure), model structure and model parameter (learning rate and momentum parameter) (Lee et al., 2005). TABLE 1 SUMMARY OF THE EXPERIMENTS FOR OPTIMUM NEURAL NETWORK MODEL STRUCTURE Training Data set (year) Lags included in input data Model structure Experiment1 2000/2001/ MLP 2003 Experiment2 2000/2001/ RBF 2003 Experiment3 1990~ MLP 2003 Experiment Experiment5 stormy situations (1990~2003) except Maemi case Storm surge:-6hr~-1hr Atmospheric elements :-3hr~-1hr Storm surge: -6hr~-1hr Atmospheric elements :-3hr~-1hr MLP MLP Period for validation Typhoon Maemi case (2003) Typhoon Maemi case (2003) In Experiment1, one year continuous data (2000, 2001, and 2002) is used for model training respectively and MLP structure which contained input units, 2~5 hidden units and one output unit is used. Input variables are observed east-west wind stress, north-south wind stress and pressure. Target variable is storm surge height. Experiment2 uses RBF (radial basis function) structure and other conditions are same as Experiment1. Experiment3 comprises thirteen year continuous data series (1990~2002) and MLP structure which shows better and

5 more stable performance in Experiment1 and Experiment2. Experiment4 uses one year (2002) continuous data series as training data and uses past lagged measurements as well as present east-west wind stress, north-south wind stress and pressure as input variables. Experiment5 uses thirty Typhoon cases from 1990 to 2003 as training data and other conditions are same as Experiment4. Table 1 shows the outline of experiments and Table2~Table5 show results of the Experiment1~Experiment5. One year (2003) continuous data is used for validation in Experiment1~Experiment3 and data during the passage of Typhoon Maemi is used for validation in Experiment4~Experiment5 and Figure 2 shows the results from Experiment5. Results indicate that neural network model forecasts are accurate. The root mean square error between MLP and RBF seemed to have little difference, but MLP was more stable than RBF. The best result reached, when MLP training with three hidden units and previous input data, to a RMSE of approximate 20 cm, which is about 5 % of tidal range at Jeju and Yeosu. TABLE 2 RMSE OF THE MODELS FROM EXPERIMENT1 AND HARMONIC FORECAST AT JEJU AND YEOSU STATION IN THE KOREAN PENINSULA (CM) Year for MLP MLP MLP MLP StationHarmonic forecast training (hidden=2)(hidden=3)(hidden=4)(hidden=5) Jeju Yeosu TABLE 3 RMSE OF THE MODELS FROM EXPERIMENT2 AND HARMONIC FORECAST AT JEJU AND YEOSU STATION IN THE KOREAN PENINSULA (CM) Station Harmonic Year for RBF RBF RBF RBF forecast training (hidden=2)(hidden=3)(hidden=4)(hidden=5) Jeju Yeosu TABLE 4 RMSE OF THE MODELS FROM EXPERIMENT1, EXPERIMENT3 AND HARMONIC FORECAST (CM)

6 Station Harmonic forecast Experiment1 Experiment3 Jeju Yeosu TABLE 5 RESULTS OF EXPERIMENT4 AND EXPERIMENT5: COMPARISON BETWEEN OBSERVED SEA LEVELS AND FORECASTS AT YEOSU STATION DURING TYPHOON MAEMI (CM) Model Harmonic 1h-forecast 24h-forecast performance forecast Experiment4 Experiment5 Experiment4 Experiment5 RMSE(cm) Correlation Sea level(cm) Sea level(cm) (a) Gladys(1991) 50 (b) Faye(1995) Datetime (mm-dd hh) Datetime (mm-dd hh) Sea level(cm) (c) Yanny(1998) Datetime (mm-dd hh) Seal level(cm) (d) Rusa(2002) Datetime (mm-dd hh) FIGURE 2 RESULTS OF EXPERIMEMT 5: SEA LEVEL OBSERVED (SOLID LINE), AND PREDICTED FROM HA (DASHED) AND ANN (DOTTED) AT YEOSU DURING THE PASSAGE OF (a) TYPHOON GLADYS IN 1991, (b) FAYE IN 1995, (c) YANNY IN 1998, (d) RUSA IN 2002 In many experiments' results, we finally choose MLP structure, one hidden layer of three units, hyperbolic tangent hidden activation function and identity output activation function. Next, we consider two models. These models deal with predicted data from numerical model as input data, whereas observed pressure and wind stress are used as input variables so far. Model1 uses the typhoon event data which was obtained from Yeosu, Busan

7 and Wando station in the Korean Peninsula from 1990 to Input variables are pressure, east-west wind stress, north-south wind stress and target variable is storm surge height. Model1 does not include past information. Model2 was trained by Yeosu, Busan and Wando data in The lags of pressure and wind stress as well as past surge height were used as input variables in the model. Figure 3 represents the results of Model1 for Busan using the predicted data from MM5-KMA (Mesoscale Model version 5 from Korea Meteorological Administration) on 12 and 13 September Neural network model predictions greatly improve on predicted sea level from Harmonic analysis. Also, performance of Model2 for Yeosu data is presented in Table 6 for forecasting times of 3, 6, 12 and 24 hours. For 24-hour forecasts, root mean square error improves from 13-39cm to 12-15cm. FIGURE 3 OBSERVED SEA LEVEL (BLACK), PREDICTED SEA LEVEL FROM HARMONIC ANALYSIS (GREEN) AND ARTIFICIAL NEURAL NETWORK (RED) FOR BUSAN STATION IN THE KOREAN PENINSULA - MODEL1 TABLE 6 MODEL PERFORMANCE (RMSE) FOR TYPHOONS AT YEOSU STATION IN THE KOREAN PENINSULA MODEL2 Forecast RMSE (cm) time Olga (1999) Saomai (2000) Rusa (2002) 3h h h h Harmonic forecast REGIONAL REAL-TIME STORM SURGE PREDICTION SYSTEM FOR THREE STATIONS OF THE KOREAN PENINSULA Regional real-time storm surge prediction systems are constructed based on the previous neural network model experiments in Busan, Yeosu and Wando stations of the Korean Peninsula. Neural network model results for three stations are showed in Figure 4. Plots on the left side represent sea level observed (dotted), sea level predicted (predicted storm surge

8 from neural network model plus predicted tide from harmonic analysis) by neural network (red) and tide predicted by harmonic analysis (blue). Vertical line represents present time when surge prediction starts. Plots on the right side represent observed surge (prior to the vertical line) and predicted surge from neural network model (posterior to the vertical line). Input values are updated in hourly and newly updated values are applied to the model continuously. FIGURE 4 REAL-TIME STORM SURGE PREDICTION USING NEURAL NETWORK MODEL: OBSERVED (DOTTED), PREDICTED (RED LINE) SEA LEVEL AND PREDICTED TIDE (BLUE LINE) (LEFT) AND OBSERVED AND PREDICTED SURGE (RIGHT) AT BUSAN, YEOSU, AND WANDO IN THE KOREAN PENINSULA CLUSTER ANALYSIS FOR STATION For regional extension to the whole Korean coastal regions of the ANN model, we use the clustering method. Variables for cluster analysis are maximum storm surge heights for each typhoon that passed through Korean peninsula from 2000 to 2004 and station information (latitude and longitude). Seven variables are used and all of the variables are normalized. Since the most part of correlation coefficients between variables is not high, we calculate similarities between objects using Euclidean distance. The object of the cluster analysis is twenty one stations which is capable of using sea level height from NORI (National Oceanographic Research Institute) in Korea and AWS (Automatic Weather System) data from KMA (Korea Meteorological Administration). The number of stations for clustering will be larger while the amount of available data increases. In the case of Masan and Wido, which has missing values, an average of maximum storm surges from the nearest two stations

9 is substituted. Agglomerative clustering method among hierarchical clustering methods is used and it merges objects which have a lot of similarities as a start. The centroid linkage clustering criterion is used and it has not seriously affected the outliers. In the first step, each object constitutes each cluster and there is only one cluster in the final step. TABLE 7 STATION CLUSTERING FOR EACH STAGE Stage Cluster name Clusters joined Normalized Centroid Distance Difference in distance 1 CL20 POHA, ULSN CL19 KSOT, BORG CL18 WAND, JEJU CL17 CL18(WAND, JEJU), SOGW CL16 ANHG, CL19(KSOT, BORG) CL15 CL20(POHA, ULSN), BUSN CL14 MUKH, SOKC CL13 MASN, TONY CL12 KOMU, YOSU CL11 CL16(ANHG, KSOT, BORG), DAEH CL10 CL11(ANHG, KSOT, BORG, DAEH), WIDO CL09 13 CL08 PYOT, CL10(ANHG, KSOT, BORG, DAEH, WIDO) CL12(KOMU, YOSU), CL17(WAND, JEJU, SOGW) CL07 ULEU, CL14(MUKH, SOKC) CL06 CL07(ULEU, MUKH, SOKC), CL15((POHA, ULSN, BUSN) CL05 INCH, MOKP CL9(PYOT, ANHG, KSOT, BORG, DAEH, 17 CL04 18 CL03 19 CL02 WIDO), CL06(ULEU, MUKH, SOKC, POHA, ULSN, BUSN) CL04(PYOT, ANHG, KSOT, BORG, DAEH, WIDO, ULEU, MUKH, SOKC, POHA, ULSN, BUSN), CL08(KOMU, YOSU, WAND, JEJU, SOGW) CL03(PYOT, ANHG, KSOT, BORG, DAEH, WIDO, ULEU, MUKH, SOKC, POHA, ULSN,

10 20 CL01 BUSN, KOMU, YOSU, WAND, JEJU, SOGW), CL05(INCH, MOKP) CL2(PYOT, ANHG, KSOT, BORG, DAEH, WIDO, ULEU, MUKH, SOKC, POHA, ULSN, BUSN, KOMU, YOSU, WAND, JEJU, SOGW, INCH, MOKP), CL13(MASN, TONY) Table 7 displays station clustering for each stage. It expresses stations clustered at each stage for Incheon(INCH), Pyongtaek(PYOT), Anhung(ANHG), Boryeong(BORG), Kunsan(KSOT), Wido(WIDO), Mokpo(MOKP), Daeheuksando(DAEH), Wando(WAND), Jeju(JEJU), Seogwipo(SOGW), Geomundo(KOMU), Yeosu(YOSU), Tongyoung(TONY), Masan(MASN), Busan(BUSN), Ulsan(ULSN), Pohang(POHA), Uleungdo(ULEU), Mukho(MUKH), and Sokcho(SOKC). In the first stage, Pohang and Ulsan, where the distance between them is the shortest, form the cluster first, which causes the distance from the centroid to become longer in process of time. FIGURE 5 DENDROGRAM OF STATION CLUSTERING USING CENTROID LINKAGE METHOD Figure 5 shows a dendrogram, which shows hierarchical clustering shape for twenty one stations. Despite Storm surge height information for each typhoon, as well as latitude and longitude variables that represent position information for each station that use variables, we notice that closer stations are comprised in the same cluster as a whole. This means that storm surge heights of each typhoon case for stations closer to each other express a similar pattern.

11 St b FIGURE 6 DISTANCES BETWEEN CLUSTER CENTROIDS FOR EACH STAGE FIGURE 7 CLUSTERS FROM RESLUTS OF THE CLUSTER ANALYSIS Figure 6 shows that distance between two objects or centroids of two clusters in each stage. Because the standard for optimum number of cluster does not exist, we may consider the conclusion that clustering stops when distances between the merged clusters from Figure 6 begin to become noticeably larger (Wilks, 1995). That is, the distance between centroids has increased steadily until stage 7 or 12 but distance for the centroids between clusters of the stage 7 and stage 8 or of the stage 12 and stage 13 has drastic increase. Therefore we may stop the process after stage 7 or 12. In this study, we stop the process after stage 12 for the appropriate number of clusters. But this method aside, there are diverse methods for decision

12 of the number of clusters. We also display clusters from results of the cluster analysis in Figure 7. NEURAL NETWORK MODELING FOR EACH CLUSTER We enforce storm surge prediction modeling for each cluster based on cluster analysis results. Neural network modeling for Cluster1 (composed of Busan, Ulsan and Pohang) and Cluster2 (composed of Wando, Jeju and Seogwipo) especially took effect and the results were compared with the results of the model using Busan or Jeju data only and the predicted tide from harmonic analysis. We use data of the hour for the typhoon prapiroon (2000), Saomai (2000), Rusa (2002), Maemi (2003), and Megi (2004) of each three stations. Input variables are predicted air pressure and wind stress from MM5-KMA. Neural network model structure selected from prior experiments for model capacity is used. That is, it is MLP structure which has one hidden layer constituting of three hidden units. Model validation is performed by cross-validation for five typhoons. Typhoons, except the typhoon for validation, are used for model learning and the ratio for training data versus validation data is 80 versus 20. We compare RMSE (Root Mean Square Error) and correlation coefficient for each validation data. The result of the cluster neural network (CL-NN) is compared with predicted tide by harmonic analysis and the results of each station s neural network (NN) model. Table 8 shows RMSE and correlation coefficient (CORR) of each typhoon for Busan and Jeju. In Busan s case, results of CL-NN and NN shows higher RMSE and less correlation coefficient than predicted tide for Typhoon prapiroon which maximum storm surge height is about only 20 cm. Performance of the Neural networks for Typhoon Saomai (2000) and Rusa (2002) which storm surge height records more than 60 cm is better than other typhoon case. CL-NN specifically trained to use the cluster in which Busan, Ulsan, and Pohang records RMSE 8.82 cm, correlation coefficient 0.99 in Saomai s case, and RMSE 8.25 cm, correlation coefficient 0.97 in Rusa s case. These results shows that performance of the CL-NN is better than NN that is trained with only Busan data (RMSE 9.32 cm, correlation coefficient 0.98 for Saomai case, and RMSE 8.80 cm, correlation coefficient 0.96 for Rusa case). TABLE 8 COMPARISON OF HARMONIC ANALYSIS AND NEURAL NETWORK (NN, CL-NN) MODEL PERFORMANCE FOR BUSAN AND JEJU Tide NN CL-NN Busan RMSE Prapiroon CORR Saomai RMSE CORR Rusa RMSE CORR Maemi RMSE CORR Megi RMSE

13 Jeju Prapiroon Saomai Rusa Maemi Megi CORR RMSE CORR RMSE CORR RMSE CORR RMSE CORR RMSE CORR Storm surge heights in the Typhoon Maemi (2003) and Megi (2004) cases are so high and in these cases, NN shows better performance than CL-NN. In Jeju s case, result of CL- NN shows better performance than other models for Typhoon prapiroon, Maemi, and Megi. For Typhoon Saomai and Rusa s cases, result of NN using Jeju data only shows better performance. TABLE 9 MAXIMUM OBSERVED SEA LEVEL, TIDE AND PREDICTED SEA LEVEL AT BUSAN AND JEJU DURING TYPHOONS Max. sea level (cm) station Typhoon OBS. TIDE NN CL-NN Prapiroon Saomai Busan Rusa Maemi Megi Prapiroon Saomai Jeju Rusa Maemi Megi Table 9 shows maximum sea level heights for each typhoon, predicted tide heights when sea level is maximum, and storm surge heights predicted from neural network (NN and CL-NN) plus tide. In Busan case, CL-NN shows good performance because it shows 2, 11, and 14 cm residuals for each Saomai, Rusa, and Maemi and the majority of the CL-NN have over-estimated tendency. In Jeju case, NN model shows under-estimated tendency and these results are counter to Busan case. These results reflect multiple characteristics of many stations used in the cluster training. On the whole, CL-NN shows better performance than NN in the typhoon cases which have high surge heights and there is opposite appearance in the typhoon cases which have low surge

14 heights. We display observed sea level height, predicted sea level height from neural network (CL-NN and NN) and predicted tide for each typhoon in Figure 8. And Figure 9 shows observed and predicted storm surge heights at Busan station during typhoon saomai, rusa, maemi and megi. FIGURE 8 OBSERVED (SOLID), PREDICTED (NN:DOTTED/SQUARES, CL-NN: DASHED /CIRCLES) SEA LEVEL AND PREDICTED TIDE(DASH-DOTTED) AT BUSAN (UPPER) AND JEJU(LOWER) DURING TYPHOON SAOMAI, RUSA, MAEMI FIGURE 9 OBSERVED (SOLID) AND PREDICTED (NN:DOTTED/SQUARES, CL- NN:DASHED/CIRCLES) STORM SURGE AT BUSAN DURING TYPHOON SAOMAI, RUSA, MAEMI, AND MEGI

15 SUMMARY AND CONCLUSION In this study, for more accurate storm surge prediction, artificial neural network models were developed and applied to predict storm surges at more than three stations (Wando, Yeosu, and Busan) of the Korean coast. Artificial neural network models provide significant improvements over harmonic forecasts. And we express the results of the cluster analysis for regional extension to cover entire Korean coastal regions of the neural network for storm surge prediction and the results of the neural network modeling for each cluster. First of all, we consider station information and storm surge height for each typhoon for objective standard establishment of the station clustering and establish cluster analysis. Based on the skill which measures similarity between clusters, the nearest objects gather first, clustering will be stopped when distances between merged clusters begin to become noticeably larger. As a result, we cluster stations into several clusters. We put in operation cluster modeling for Cluster 1 (Busan, Ulsan, and Pohang) and Cluster 2 (Wando, Jeju, and Seogwipo) so that we calculate performance of the neural network model for each cluster. And we compare these results with the results of the models used Busan or Jeju data only and predicted tide. We know that CL-NN model has similar RMSE or correlation coefficient to NN model for the past typhoon cases and especially in the Saomai and Rusa cases, in which storm surge height is very high, CL-NN model has less RMSE or higher correlation coefficient rather than NN. This results reflect that we train the cluster model used more and more typhoon information for many stations. That is, as a result of the neural network modeling, CL-NN and NN model predict storm surge height well and especially, better performance comes out in the prediction of high storm surge height. Hence for the extension of the regional storm surge forecasting system, regional clustering and neural network modeling for each cluster will be supposed to be significant. Based on the result of this study, neural network model for each cluster could be applied to regional storm surge forecasting system and the extension into all coastal regions will be possible. In the future for the stable extension into all coastal regions more and more information of the typhoon cases will be required. Moreover, for better model accuracy, correction of the predicted air pressure and wind stress, which uses model input variables, will be required, especially in the passage of the typhoon, wind stress seems to be underestimated or overestimated. And construction of the dynamic modeling system will be also performed and then present meteorological state or condition, as well as past typhoon information, will be included in the real-time training optimized model. ACKNOWLEDGEMENTS This research was carried out as a part of Development of storm surge and wind wave monitoring system supported by METRI/KMA.

16 REFERENCES 1. M. Sztobryn, Forecasting of storm surge by means of artificial neural network, J. Sea Res., 49 (2003), P. E. Tissot, P. R. Michaud, and D. T. Cox, Optimization and performance of a neural network model forecasting water levels for the Corpus Christi, Texas, Estuary, Preprints, 3rd Conf. on Artificial Intelligence Applications to the Environmental Science, Long Beach, CA, Amer. Meteo. Soc. (2003). 3. P. N. Tan, M. Steinbach, and V. Kumar, Introduction to data mining, Pearson Education, Boston, MA, 2006, pp T. Hastie, R. Tibshirani, and J. Friedman, The elements of statistical learning, Springer, New York, 2001, pp D. U. Lee, H. Lee, J. W. Seo, S. H. You, and Y. H. Youn, Storm Surge Prediction using Artificial Neural Networks, J. of Korean Meteor. Soc., 41 (2005), D. S. Wilks, Statistical methods in the atmospheric sciences. Academic press, San Diego, 1995, pp

PREDICTION OF DESIGN WATER LEVEL DUE TO STORM SURGE AT THE SEOGWIPO COASTAL ZONE IN KOREA

PREDICTION OF DESIGN WATER LEVEL DUE TO STORM SURGE AT THE SEOGWIPO COASTAL ZONE IN KOREA Proceedings of the 7 th International Conference on Asian and Pacific Coasts (APAC 2013) Bali, Indonesia, September 24-26, 2013 PREDICTION OF DESIGN WATER LEVEL DUE TO STORM SURGE AT THE SEOGWIPO COASTAL

More information

Water Level Prediction with Artificial Neural Network Models

Water Level Prediction with Artificial Neural Network Models Water Level Prediction with Artificial Neural Network Models CARL STEIDLEY, ALEX SADOVSKI, PHILLIPE TISSOT, RAY BACHNAK, ZACK BOWLES Texas A&M University Corpus Christi 6300 Ocean Dr. Corpus Christi, TX

More information

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 BIOLOGICAL INSPIRATIONS Some numbers The human brain contains about 10 billion nerve cells (neurons) Each neuron is connected to the others through 10000

More information

SIMULATION OF ATMOSPHERIC STATES FOR THE CASE OF YEONG-GWANG STORM SURGE ON 31 MARCH 2007 : MODEL COMPARISON BETWEEN MM5, WRF AND COAMPS

SIMULATION OF ATMOSPHERIC STATES FOR THE CASE OF YEONG-GWANG STORM SURGE ON 31 MARCH 2007 : MODEL COMPARISON BETWEEN MM5, WRF AND COAMPS SIMULATION OF ATMOSPHERIC STATES FOR THE CASE OF YEONG-GWANG STORM SURGE ON 31 MARCH 2007 : MODEL COMPARISON BETWEEN MM5, WRF AND COAMPS JEONG-WOOK LEE 1 ; KYUNG-JA HA 1* ; KI-YOUNG HEO 1 ; KWANG-SOON

More information

BY REAL-TIME ClassZR. Jeong-Hee Kim 1, Dong-In Lee* 2, Min Jang 2, Kil-Jong Seo 2, Geun-Ok Lee 2 and Kyung-Eak Kim 3 1.

BY REAL-TIME ClassZR. Jeong-Hee Kim 1, Dong-In Lee* 2, Min Jang 2, Kil-Jong Seo 2, Geun-Ok Lee 2 and Kyung-Eak Kim 3 1. P2.6 IMPROVEMENT OF ACCURACY OF RADAR RAINFALL RATE BY REAL-TIME ClassZR Jeong-Hee Kim 1, Dong-In Lee* 2, Min Jang 2, Kil-Jong Seo 2, Geun-Ok Lee 2 and Kyung-Eak Kim 3 1 Korea Meteorological Administration,

More information

Artificial Neural Networks. Edward Gatt

Artificial Neural Networks. Edward Gatt Artificial Neural Networks Edward Gatt What are Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning Very

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Jeff Clune Assistant Professor Evolving Artificial Intelligence Laboratory Announcements Be making progress on your projects! Three Types of Learning Unsupervised Supervised Reinforcement

More information

Guide to Storm Surge Forecasting

Guide to Storm Surge Forecasting Guide to Storm Surge Forecasting WMO-No. 1076 Guide to Storm Surge Forecasting WMO-No. 1076 2011 edition WMO-No. 1076 World Meteorological Organization, 2011 The right of publication in print, electronic

More information

Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption

Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption Application of Artificial Neural Networks in Evaluation and Identification of Electrical Loss in Transformers According to the Energy Consumption ANDRÉ NUNES DE SOUZA, JOSÉ ALFREDO C. ULSON, IVAN NUNES

More information

Neural Networks Lecture 4: Radial Bases Function Networks

Neural Networks Lecture 4: Radial Bases Function Networks Neural Networks Lecture 4: Radial Bases Function Networks H.A Talebi Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Winter 2011. A. Talebi, Farzaneh Abdollahi

More information

Reading, UK 1 2 Abstract

Reading, UK 1 2 Abstract , pp.45-54 http://dx.doi.org/10.14257/ijseia.2013.7.5.05 A Case Study on the Application of Computational Intelligence to Identifying Relationships between Land use Characteristics and Damages caused by

More information

Hindcasting of Storm Surge by Typhoon 0314(Maemi) in Masan Bay, Korea

Hindcasting of Storm Surge by Typhoon 0314(Maemi) in Masan Bay, Korea Hindcasting of Storm Surge by Typhoon 0314(Maemi) in Masan Bay, Korea See-Whan Kang 1 ;Kicheon Jun 1 ; Kwang-Soon Park 1 ; Sung-Dae Han 2 1 Coastal Engineering Research Division, Korea Ocean Research and

More information

Optimal Artificial Neural Network Modeling of Sedimentation yield and Runoff in high flow season of Indus River at Besham Qila for Terbela Dam

Optimal Artificial Neural Network Modeling of Sedimentation yield and Runoff in high flow season of Indus River at Besham Qila for Terbela Dam Optimal Artificial Neural Network Modeling of Sedimentation yield and Runoff in high flow season of Indus River at Besham Qila for Terbela Dam Akif Rahim 1, Amina Akif 2 1 Ph.D Scholar in Center of integrated

More information

Changes of storm surge and typhoon intensities under the future global warming conditions Storm Surge Congress 2010

Changes of storm surge and typhoon intensities under the future global warming conditions Storm Surge Congress 2010 Changes of storm surge and typhoon intensities under the future global warming conditions Storm Surge Congress 2010 Il-Ju Moon & S. M. Oh Jeju (Cheju) National University, Korea Tropical Cyclone (TC) and

More information

Neural Networks and the Back-propagation Algorithm

Neural Networks and the Back-propagation Algorithm Neural Networks and the Back-propagation Algorithm Francisco S. Melo In these notes, we provide a brief overview of the main concepts concerning neural networks and the back-propagation algorithm. We closely

More information

Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I

Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I Phil Woodland: pcw@eng.cam.ac.uk Michaelmas 2012 Engineering Part IIB: Module 4F10 Introduction In

More information

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso xsu@utep.edu Fall, 2018 Outline Introduction A Brief History ANN Architecture Terminology

More information

Nonlinear Classification

Nonlinear Classification Nonlinear Classification INFO-4604, Applied Machine Learning University of Colorado Boulder October 5-10, 2017 Prof. Michael Paul Linear Classification Most classifiers we ve seen use linear functions

More information

Operational Forecasting of Marine Meteorology by Model and Observation in KMA. Jang-Won SEO

Operational Forecasting of Marine Meteorology by Model and Observation in KMA. Jang-Won SEO Operational Forecasting of Marine Meteorology by Model and Observation in KMA Jang-Won SEO Global Environment Research Lab. National Institute of Meteorological Research DBCP-XXIII Session of the Data

More information

Cluster Analysis (Sect. 9.6/Chap. 14 of Wilks) Notes by Hong Li

Cluster Analysis (Sect. 9.6/Chap. 14 of Wilks) Notes by Hong Li 77 Cluster Analysis (Sect. 9.6/Chap. 14 of Wilks) Notes by Hong Li 1) Introduction Cluster analysis deals with separating data into groups whose identities are not known in advance. In general, even the

More information

Introduction to Neural Networks: Structure and Training

Introduction to Neural Networks: Structure and Training Introduction to Neural Networks: Structure and Training Professor Q.J. Zhang Department of Electronics Carleton University, Ottawa, Canada www.doe.carleton.ca/~qjz, qjz@doe.carleton.ca A Quick Illustration

More information

4. Multilayer Perceptrons

4. Multilayer Perceptrons 4. Multilayer Perceptrons This is a supervised error-correction learning algorithm. 1 4.1 Introduction A multilayer feedforward network consists of an input layer, one or more hidden layers, and an output

More information

Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011!

Artificial Neural Networks and Nonparametric Methods CMPSCI 383 Nov 17, 2011! Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011! 1 Todayʼs lecture" How the brain works (!)! Artificial neural networks! Perceptrons! Multilayer feed-forward networks! Error

More information

DEVELOPMENT OF ROAD SURFACE TEMPERATURE PREDICTION MODEL

DEVELOPMENT OF ROAD SURFACE TEMPERATURE PREDICTION MODEL International Journal of Civil, Structural, Environmental and Infrastructure Engineering Research and Development (IJCSEIERD) ISSN(P): 2249-6866; ISSN(E): 2249-7978 Vol. 6, Issue 6, Dec 2016, 27-34 TJPRC

More information

Lecture 7 Artificial neural networks: Supervised learning

Lecture 7 Artificial neural networks: Supervised learning Lecture 7 Artificial neural networks: Supervised learning Introduction, or how the brain works The neuron as a simple computing element The perceptron Multilayer neural networks Accelerated learning in

More information

A. Pelliccioni (*), R. Cotroneo (*), F. Pungì (*) (*)ISPESL-DIPIA, Via Fontana Candida 1, 00040, Monteporzio Catone (RM), Italy.

A. Pelliccioni (*), R. Cotroneo (*), F. Pungì (*) (*)ISPESL-DIPIA, Via Fontana Candida 1, 00040, Monteporzio Catone (RM), Italy. Application of Neural Net Models to classify and to forecast the observed precipitation type at the ground using the Artificial Intelligence Competition data set. A. Pelliccioni (*), R. Cotroneo (*), F.

More information

School of Earth and Environmental Sciences, Seoul National University. Dong-Kyou Lee. Contribution: Dr. Yonhan Choi (UNIST/NCAR) IWTF/ACTS

School of Earth and Environmental Sciences, Seoul National University. Dong-Kyou Lee. Contribution: Dr. Yonhan Choi (UNIST/NCAR) IWTF/ACTS School of Earth and Environmental Sciences, Seoul National University Dong-Kyou Lee Contribution: Dr. Yonhan Choi (UNIST/NCAR) IWTF/ACTS CONTENTS Introduction Heavy Rainfall Cases Data Assimilation Summary

More information

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD WHAT IS A NEURAL NETWORK? The simplest definition of a neural network, more properly referred to as an 'artificial' neural network (ANN), is provided

More information

Prediction of Particulate Matter Concentrations Using Artificial Neural Network

Prediction of Particulate Matter Concentrations Using Artificial Neural Network Resources and Environment 2012, 2(2): 30-36 DOI: 10.5923/j.re.20120202.05 Prediction of Particulate Matter Concentrations Using Artificial Neural Network Surendra Roy National Institute of Rock Mechanics,

More information

Artificial Neural Networks 2

Artificial Neural Networks 2 CSC2515 Machine Learning Sam Roweis Artificial Neural s 2 We saw neural nets for classification. Same idea for regression. ANNs are just adaptive basis regression machines of the form: y k = j w kj σ(b

More information

J1.2 Short-term wind forecasting at the Hong Kong International Airport by applying chaotic oscillatory-based neural network to LIDAR data

J1.2 Short-term wind forecasting at the Hong Kong International Airport by applying chaotic oscillatory-based neural network to LIDAR data J1.2 Short-term wind forecasting at the Hong Kong International Airport by applying chaotic oscillatory-based neural network to LIDAR data K.M. Kwong Hong Kong Polytechnic University, Hong Kong, China

More information

Unit III. A Survey of Neural Network Model

Unit III. A Survey of Neural Network Model Unit III A Survey of Neural Network Model 1 Single Layer Perceptron Perceptron the first adaptive network architecture was invented by Frank Rosenblatt in 1957. It can be used for the classification of

More information

Long-Term Trend of Summer Rainfall at Selected Stations in the Republic of Korea

Long-Term Trend of Summer Rainfall at Selected Stations in the Republic of Korea Long-Term Trend of Summer Rainfall at Selected Stations in the Republic of Korea Il-Kon Kim Professor, Department of Region Information Rafique Ahmed Professor, Geography and Earth Science Silla University

More information

Artificial neural networks

Artificial neural networks Artificial neural networks Chapter 8, Section 7 Artificial Intelligence, spring 203, Peter Ljunglöf; based on AIMA Slides c Stuart Russel and Peter Norvig, 2004 Chapter 8, Section 7 Outline Brains Neural

More information

Neural Network prediction of the low-frequency coastal sea level response using conventional and NECP/NCAR Reanalysis data

Neural Network prediction of the low-frequency coastal sea level response using conventional and NECP/NCAR Reanalysis data Environmental Problems in Coastal Regions VI 341 Neural Network prediction of the low-frequency coastal sea level response using conventional and NECP/NCAR Reanalysis data M. M. F. Oliveira 1 N. F. F.

More information

Multilayer Perceptron

Multilayer Perceptron Outline Hong Chang Institute of Computing Technology, Chinese Academy of Sciences Machine Learning Methods (Fall 2012) Outline Outline I 1 Introduction 2 Single Perceptron 3 Boolean Function Learning 4

More information

A State Space Model for Wind Forecast Correction

A State Space Model for Wind Forecast Correction A State Space Model for Wind Forecast Correction Valrie Monbe, Pierre Ailliot 2, and Anne Cuzol 1 1 Lab-STICC, Université Européenne de Bretagne, France (e-mail: valerie.monbet@univ-ubs.fr, anne.cuzol@univ-ubs.fr)

More information

Artificial Neural Networks

Artificial Neural Networks Introduction ANN in Action Final Observations Application: Poverty Detection Artificial Neural Networks Alvaro J. Riascos Villegas University of los Andes and Quantil July 6 2018 Artificial Neural Networks

More information

Neural Networks DWML, /25

Neural Networks DWML, /25 DWML, 2007 /25 Neural networks: Biological and artificial Consider humans: Neuron switching time 0.00 second Number of neurons 0 0 Connections per neuron 0 4-0 5 Scene recognition time 0. sec 00 inference

More information

Introduction to Natural Computation. Lecture 9. Multilayer Perceptrons and Backpropagation. Peter Lewis

Introduction to Natural Computation. Lecture 9. Multilayer Perceptrons and Backpropagation. Peter Lewis Introduction to Natural Computation Lecture 9 Multilayer Perceptrons and Backpropagation Peter Lewis 1 / 25 Overview of the Lecture Why multilayer perceptrons? Some applications of multilayer perceptrons.

More information

Artificial Neural Network

Artificial Neural Network Artificial Neural Network Contents 2 What is ANN? Biological Neuron Structure of Neuron Types of Neuron Models of Neuron Analogy with human NN Perceptron OCR Multilayer Neural Network Back propagation

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE 4: Linear Systems Summary # 3: Introduction to artificial neural networks DISTRIBUTED REPRESENTATION An ANN consists of simple processing units communicating with each other. The basic elements of

More information

Impact of upper-ocean thermal structure on the intensity of Korean peninsular. landfall typhoons. Abstract

Impact of upper-ocean thermal structure on the intensity of Korean peninsular. landfall typhoons. Abstract Impact of upper-ocean thermal structure on the intensity of Korean peninsular landfall typhoons Il-Ju Moon 1 and Seok Jae Kwon 2 1 College of Ocean Science, Cheju National University 2 National Oceanographic

More information

SOIL MOISTURE MODELING USING ARTIFICIAL NEURAL NETWORKS

SOIL MOISTURE MODELING USING ARTIFICIAL NEURAL NETWORKS Int'l Conf. Artificial Intelligence ICAI'17 241 SOIL MOISTURE MODELING USING ARTIFICIAL NEURAL NETWORKS Dr. Jayachander R. Gangasani Instructor, Department of Computer Science, jay.gangasani@aamu.edu Dr.

More information

Mining Classification Knowledge

Mining Classification Knowledge Mining Classification Knowledge Remarks on NonSymbolic Methods JERZY STEFANOWSKI Institute of Computing Sciences, Poznań University of Technology SE lecture revision 2013 Outline 1. Bayesian classification

More information

An Adaptive Neural Network Scheme for Radar Rainfall Estimation from WSR-88D Observations

An Adaptive Neural Network Scheme for Radar Rainfall Estimation from WSR-88D Observations 2038 JOURNAL OF APPLIED METEOROLOGY An Adaptive Neural Network Scheme for Radar Rainfall Estimation from WSR-88D Observations HONGPING LIU, V.CHANDRASEKAR, AND GANG XU Colorado State University, Fort Collins,

More information

Data Mining Part 5. Prediction

Data Mining Part 5. Prediction Data Mining Part 5. Prediction 5.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline How the Brain Works Artificial Neural Networks Simple Computing Elements Feed-Forward Networks Perceptrons (Single-layer,

More information

Ocean in Motion 7: El Nino and Hurricanes!

Ocean in Motion 7: El Nino and Hurricanes! Ocean in Motion 7: El Nino and Hurricanes! A. Overview 1. Ocean in Motion -- El Nino and hurricanes We will look at the ocean-atmosphere interactions that cause El Nino and hurricanes. Using vocabulary

More information

Application of Neural Network for Long-Term Correction of Wind Data

Application of Neural Network for Long-Term Correction of Wind Data Application of Neural Network for Long-Term Correction of Wind Data [2008-12-WD-004] Application of Neural Network for Long-Term Correction of Wind Data Franz Vaas and Hyun-Goo Kim*, ** Abstract Wind farm

More information

Increasing the highest storm surge in Busan harbor

Increasing the highest storm surge in Busan harbor Journal of Coastal Research SI 75 760-764 Coconut Creek, Florida 2016 Increasing the highest storm surge in Busan harbor Sang Myeong Oh, Il-Ju Moon, and Suk Jae Kwon, Climate Research Department/APEC Climate

More information

Forecast of Nearshore Wave Parameters Using MIKE-21 Spectral Wave Model

Forecast of Nearshore Wave Parameters Using MIKE-21 Spectral Wave Model Forecast of Nearshore Wave Parameters Using MIKE-21 Spectral Wave Model Felix Jose 1 and Gregory W. Stone 2 1 Coastal Studies Institute, Louisiana State University, Baton Rouge, LA 70803 2 Coastal Studies

More information

Adjoint-based forecast sensitivities of Typhoon Rusa

Adjoint-based forecast sensitivities of Typhoon Rusa GEOPHYSICAL RESEARCH LETTERS, VOL. 33, L21813, doi:10.1029/2006gl027289, 2006 Adjoint-based forecast sensitivities of Typhoon Rusa Hyun Mee Kim 1 and Byoung-Joo Jung 1 Received 20 June 2006; revised 13

More information

Feed-forward Networks Network Training Error Backpropagation Applications. Neural Networks. Oliver Schulte - CMPT 726. Bishop PRML Ch.

Feed-forward Networks Network Training Error Backpropagation Applications. Neural Networks. Oliver Schulte - CMPT 726. Bishop PRML Ch. Neural Networks Oliver Schulte - CMPT 726 Bishop PRML Ch. 5 Neural Networks Neural networks arise from attempts to model human/animal brains Many models, many claims of biological plausibility We will

More information

This paper presents the

This paper presents the ISESCO JOURNAL of Science and Technology Volume 8 - Number 14 - November 2012 (2-8) A Novel Ensemble Neural Network based Short-term Wind Power Generation Forecasting in a Microgrid Aymen Chaouachi and

More information

Introduction of Korea Operational Oceanographic System (KOOS)

Introduction of Korea Operational Oceanographic System (KOOS) PICES-2010, Portland, USA October 21-31, 2010 Introduction of Korea Operational Oceanographic System (KOOS) Oct. 28, 2010 Kwang-Soon Park, Dong-Young Lee, Ki-Cheon Jun, Sang-Ik Kim, Jae-Il Kwon and Jung-Woon

More information

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann (Feed-Forward) Neural Networks 2016-12-06 Dr. Hajira Jabeen, Prof. Jens Lehmann Outline In the previous lectures we have learned about tensors and factorization methods. RESCAL is a bilinear model for

More information

Machine Learning and Data Mining. Multi-layer Perceptrons & Neural Networks: Basics. Prof. Alexander Ihler

Machine Learning and Data Mining. Multi-layer Perceptrons & Neural Networks: Basics. Prof. Alexander Ihler + Machine Learning and Data Mining Multi-layer Perceptrons & Neural Networks: Basics Prof. Alexander Ihler Linear Classifiers (Perceptrons) Linear Classifiers a linear classifier is a mapping which partitions

More information

A Support Vector Regression Model for Forecasting Rainfall

A Support Vector Regression Model for Forecasting Rainfall A Support Vector Regression for Forecasting Nasimul Hasan 1, Nayan Chandra Nath 1, Risul Islam Rasel 2 Department of Computer Science and Engineering, International Islamic University Chittagong, Bangladesh

More information

Neural Network to Control Output of Hidden Node According to Input Patterns

Neural Network to Control Output of Hidden Node According to Input Patterns American Journal of Intelligent Systems 24, 4(5): 96-23 DOI:.5923/j.ajis.2445.2 Neural Network to Control Output of Hidden Node According to Input Patterns Takafumi Sasakawa, Jun Sawamoto 2,*, Hidekazu

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks Oliver Schulte - CMPT 310 Neural Networks Neural networks arise from attempts to model human/animal brains Many models, many claims of biological plausibility We will focus on

More information

Retrieval of Cloud Top Pressure

Retrieval of Cloud Top Pressure Master Thesis in Statistics and Data Mining Retrieval of Cloud Top Pressure Claudia Adok Division of Statistics and Machine Learning Department of Computer and Information Science Linköping University

More information

Analysis of Radar Rainfall Estimation Accuracy using Hybrid Surface Rainfall (HSR) Technique

Analysis of Radar Rainfall Estimation Accuracy using Hybrid Surface Rainfall (HSR) Technique Analysis of Radar Rainfall Estimation Accuracy using Hybrid Surface Rainfall (HSR) Technique Hye-Sook Park 1, Min-Ho Lee 1, Mi-Kyung Suk 1, Jae-Won Lee 1 1 Korea Meteorological Administration, Weather

More information

Neural networks. Chapter 20. Chapter 20 1

Neural networks. Chapter 20. Chapter 20 1 Neural networks Chapter 20 Chapter 20 1 Outline Brains Neural networks Perceptrons Multilayer networks Applications of neural networks Chapter 20 2 Brains 10 11 neurons of > 20 types, 10 14 synapses, 1ms

More information

Neural networks (NN) 1

Neural networks (NN) 1 Neural networks (NN) 1 Hedibert F. Lopes Insper Institute of Education and Research São Paulo, Brazil 1 Slides based on Chapter 11 of Hastie, Tibshirani and Friedman s book The Elements of Statistical

More information

CS 4700: Foundations of Artificial Intelligence Ungraded Homework Solutions

CS 4700: Foundations of Artificial Intelligence Ungraded Homework Solutions CS 4700: Foundations of Artificial Intelligence Ungraded Homework Solutions 1. Neural Networks: a. There are 2 2n distinct Boolean functions over n inputs. Thus there are 16 distinct Boolean functions

More information

P1.10 Synchronization of Multiple Radar Observations in 3-D Radar Mosaic

P1.10 Synchronization of Multiple Radar Observations in 3-D Radar Mosaic Submitted for the 12 th Conf. on Aviation, Range, and Aerospace Meteor. 29 Jan. 2 Feb. 2006. Atlanta, GA. P1.10 Synchronization of Multiple Radar Observations in 3-D Radar Mosaic Hongping Yang 1, Jian

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning

More information

Neural networks. Chapter 19, Sections 1 5 1

Neural networks. Chapter 19, Sections 1 5 1 Neural networks Chapter 19, Sections 1 5 Chapter 19, Sections 1 5 1 Outline Brains Neural networks Perceptrons Multilayer perceptrons Applications of neural networks Chapter 19, Sections 1 5 2 Brains 10

More information

SIMULATION OF FREEZING AND FROZEN SOIL BEHAVIOURS USING A RADIAL BASIS FUNCTION NEURAL NETWORK

SIMULATION OF FREEZING AND FROZEN SOIL BEHAVIOURS USING A RADIAL BASIS FUNCTION NEURAL NETWORK SIMULATION OF FREEZING AND FROZEN SOIL BEHAVIOURS USING A RADIAL BASIS FUNCTION NEURAL NETWORK Z.X. Zhang 1, R.L. Kushwaha 2 Department of Agricultural and Bioresource Engineering University of Saskatchewan,

More information

Neural Networks. Bishop PRML Ch. 5. Alireza Ghane. Feed-forward Networks Network Training Error Backpropagation Applications

Neural Networks. Bishop PRML Ch. 5. Alireza Ghane. Feed-forward Networks Network Training Error Backpropagation Applications Neural Networks Bishop PRML Ch. 5 Alireza Ghane Neural Networks Alireza Ghane / Greg Mori 1 Neural Networks Neural networks arise from attempts to model human/animal brains Many models, many claims of

More information

FORECASTING: A REVIEW OF STATUS AND CHALLENGES. Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010

FORECASTING: A REVIEW OF STATUS AND CHALLENGES. Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010 SHORT-TERM TERM WIND POWER FORECASTING: A REVIEW OF STATUS AND CHALLENGES Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010 Integrating Renewable Energy» Variable

More information

Neural Networks with Applications to Vision and Language. Feedforward Networks. Marco Kuhlmann

Neural Networks with Applications to Vision and Language. Feedforward Networks. Marco Kuhlmann Neural Networks with Applications to Vision and Language Feedforward Networks Marco Kuhlmann Feedforward networks Linear separability x 2 x 2 0 1 0 1 0 0 x 1 1 0 x 1 linearly separable not linearly separable

More information

Feed-forward Network Functions

Feed-forward Network Functions Feed-forward Network Functions Sargur Srihari Topics 1. Extension of linear models 2. Feed-forward Network Functions 3. Weight-space symmetries 2 Recap of Linear Models Linear Models for Regression, Classification

More information

Multilayer Perceptrons (MLPs)

Multilayer Perceptrons (MLPs) CSE 5526: Introduction to Neural Networks Multilayer Perceptrons (MLPs) 1 Motivation Multilayer networks are more powerful than singlelayer nets Example: XOR problem x 2 1 AND x o x 1 x 2 +1-1 o x x 1-1

More information

Forecasting of Rain Fall in Mirzapur District, Uttar Pradesh, India Using Feed-Forward Artificial Neural Network

Forecasting of Rain Fall in Mirzapur District, Uttar Pradesh, India Using Feed-Forward Artificial Neural Network International Journal of Engineering Science Invention ISSN (Online): 2319 6734, ISSN (Print): 2319 6726 Volume 2 Issue 8ǁ August. 2013 ǁ PP.87-93 Forecasting of Rain Fall in Mirzapur District, Uttar Pradesh,

More information

Sections 18.6 and 18.7 Analysis of Artificial Neural Networks

Sections 18.6 and 18.7 Analysis of Artificial Neural Networks Sections 18.6 and 18.7 Analysis of Artificial Neural Networks CS4811 - Artificial Intelligence Nilufer Onder Department of Computer Science Michigan Technological University Outline Univariate regression

More information

Learning and Neural Networks

Learning and Neural Networks Artificial Intelligence Learning and Neural Networks Readings: Chapter 19 & 20.5 of Russell & Norvig Example: A Feed-forward Network w 13 I 1 H 3 w 35 w 14 O 5 I 2 w 23 w 24 H 4 w 45 a 5 = g 5 (W 3,5 a

More information

Data Mining. Preamble: Control Application. Industrial Researcher s Approach. Practitioner s Approach. Example. Example. Goal: Maintain T ~Td

Data Mining. Preamble: Control Application. Industrial Researcher s Approach. Practitioner s Approach. Example. Example. Goal: Maintain T ~Td Data Mining Andrew Kusiak 2139 Seamans Center Iowa City, Iowa 52242-1527 Preamble: Control Application Goal: Maintain T ~Td Tel: 319-335 5934 Fax: 319-335 5669 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak

More information

POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH

POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH Abstract POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH A.H.M.A.Rahim S.K.Chakravarthy Department of Electrical Engineering K.F. University of Petroleum and Minerals Dhahran. Dynamic

More information

EE-588 ADVANCED TOPICS IN NEURAL NETWORK

EE-588 ADVANCED TOPICS IN NEURAL NETWORK CUKUROVA UNIVERSITY DEPARTMENT OF ELECTRICAL&ELECTRONICS ENGINEERING EE-588 ADVANCED TOPICS IN NEURAL NETWORK THE PROJECT PROPOSAL AN APPLICATION OF NEURAL NETWORKS FOR WEATHER TEMPERATURE FORECASTING

More information

Short Term Solar Radiation Forecast from Meteorological Data using Artificial Neural Network for Yola, Nigeria

Short Term Solar Radiation Forecast from Meteorological Data using Artificial Neural Network for Yola, Nigeria American Journal of Engineering Research (AJER) 017 American Journal of Engineering Research (AJER) eiss: 300847 piss : 300936 Volume6, Issue8, pp8389 www.ajer.org Research Paper Open Access Short Term

More information

Development of models for maximum and time variation of storm surges at the Tanshui estuary

Development of models for maximum and time variation of storm surges at the Tanshui estuary Nat. Hazards Earth Syst. Sci., 4, 233 232, 24 www.nat-hazards-earth-syst-sci.net/4/233/24/ doi:.594/nhess-4-233-24 Author(s) 24. CC Attribution 3. License. Development of models for maximum and time variation

More information

Neural Networks. Nethra Sambamoorthi, Ph.D. Jan CRMportals Inc., Nethra Sambamoorthi, Ph.D. Phone:

Neural Networks. Nethra Sambamoorthi, Ph.D. Jan CRMportals Inc., Nethra Sambamoorthi, Ph.D. Phone: Neural Networks Nethra Sambamoorthi, Ph.D Jan 2003 CRMportals Inc., Nethra Sambamoorthi, Ph.D Phone: 732-972-8969 Nethra@crmportals.com What? Saying it Again in Different ways Artificial neural network

More information

Using artificial neural network for solar energy level predicting

Using artificial neural network for solar energy level predicting ISSN 1746-7659, England, UK Journal of Information and Computing Science Vol. 13, No. 3, 2018, pp.163-167 Using artificial neural network for solar energy level predicting A.G. Mustafaev Dagestan state

More information

Forecasting River Flow in the USA: A Comparison between Auto-Regression and Neural Network Non-Parametric Models

Forecasting River Flow in the USA: A Comparison between Auto-Regression and Neural Network Non-Parametric Models Journal of Computer Science 2 (10): 775-780, 2006 ISSN 1549-3644 2006 Science Publications Forecasting River Flow in the USA: A Comparison between Auto-Regression and Neural Network Non-Parametric Models

More information

The Relation between the Red Tide Occurrence and the Sea Water Temperature in South Sea of Korea

The Relation between the Red Tide Occurrence and the Sea Water Temperature in South Sea of Korea , pp.132-136 http://dx.doi.org/10.14257/astl.2017.145.26 The Relation between the Red Tide Occurrence and the Sea Water Temperature in South Sea of Korea Do-Hyun Hwang 1, Su-Ho Bak 1, Heung-Min Kim 1,

More information

Neural Networks. Chapter 18, Section 7. TB Artificial Intelligence. Slides from AIMA 1/ 21

Neural Networks. Chapter 18, Section 7. TB Artificial Intelligence. Slides from AIMA   1/ 21 Neural Networks Chapter 8, Section 7 TB Artificial Intelligence Slides from AIMA http://aima.cs.berkeley.edu / 2 Outline Brains Neural networks Perceptrons Multilayer perceptrons Applications of neural

More information

Prediction of Monthly Rainfall of Nainital Region using Artificial Neural Network (ANN) and Support Vector Machine (SVM)

Prediction of Monthly Rainfall of Nainital Region using Artificial Neural Network (ANN) and Support Vector Machine (SVM) Vol- Issue-3 25 Prediction of ly of Nainital Region using Artificial Neural Network (ANN) and Support Vector Machine (SVM) Deepa Bisht*, Mahesh C Joshi*, Ashish Mehta** *Department of Mathematics **Department

More information

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller

2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks. Todd W. Neller 2015 Todd Neller. A.I.M.A. text figures 1995 Prentice Hall. Used by permission. Neural Networks Todd W. Neller Machine Learning Learning is such an important part of what we consider "intelligence" that

More information

RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS

RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS CEST2011 Rhodes, Greece Ref no: XXX RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS D. BOTSIS1 1, P. LATINOPOULOS 2 and K. DIAMANTARAS 3 1&2 Department of Civil

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks Steve Renals Automatic Speech Recognition ASR Lecture 10 24 February 2014 ASR Lecture 10 Introduction to Neural Networks 1 Neural networks for speech recognition Introduction

More information

Flash-flood forecasting by means of neural networks and nearest neighbour approach a comparative study

Flash-flood forecasting by means of neural networks and nearest neighbour approach a comparative study Author(s 2006. This work is licensed under a Creative Commons License. Nonlinear Processes in Geophysics Flash-flood forecasting by means of neural networks and nearest neighbour approach a comparative

More information

Neural Networks. Haiming Zhou. Division of Statistics Northern Illinois University.

Neural Networks. Haiming Zhou. Division of Statistics Northern Illinois University. Neural Networks Haiming Zhou Division of Statistics Northern Illinois University zhouh@niu.edu Neural Networks The term neural network has evolved to encompass a large class of models and learning methods.

More information

Mining Classification Knowledge

Mining Classification Knowledge Mining Classification Knowledge Remarks on NonSymbolic Methods JERZY STEFANOWSKI Institute of Computing Sciences, Poznań University of Technology COST Doctoral School, Troina 2008 Outline 1. Bayesian classification

More information

Short Term Load Forecasting Based Artificial Neural Network

Short Term Load Forecasting Based Artificial Neural Network Short Term Load Forecasting Based Artificial Neural Network Dr. Adel M. Dakhil Department of Electrical Engineering Misan University Iraq- Misan Dr.adelmanaa@gmail.com Abstract Present study develops short

More information

y(x n, w) t n 2. (1)

y(x n, w) t n 2. (1) Network training: Training a neural network involves determining the weight parameter vector w that minimizes a cost function. Given a training set comprising a set of input vector {x n }, n = 1,...N,

More information

Introduction Neural Networks - Architecture Network Training Small Example - ZIP Codes Summary. Neural Networks - I. Henrik I Christensen

Introduction Neural Networks - Architecture Network Training Small Example - ZIP Codes Summary. Neural Networks - I. Henrik I Christensen Neural Networks - I Henrik I Christensen Robotics & Intelligent Machines @ GT Georgia Institute of Technology, Atlanta, GA 30332-0280 hic@cc.gatech.edu Henrik I Christensen (RIM@GT) Neural Networks 1 /

More information

EPL442: Computational

EPL442: Computational EPL442: Computational Learning Systems Lab 2 Vassilis Vassiliades Department of Computer Science University of Cyprus Outline Artificial Neuron Feedforward Neural Network Back-propagation Algorithm Notes

More information

1.2 DEVELOPMENT OF THE NWS PROBABILISTIC EXTRA-TROPICAL STORM SURGE MODEL AND POST PROCESSING METHODOLOGY

1.2 DEVELOPMENT OF THE NWS PROBABILISTIC EXTRA-TROPICAL STORM SURGE MODEL AND POST PROCESSING METHODOLOGY 1.2 DEVELOPMENT OF THE NWS PROBABILISTIC EXTRA-TROPICAL STORM SURGE MODEL AND POST PROCESSING METHODOLOGY Huiqing Liu 1 and Arthur Taylor 2* 1. Ace Info Solutions, Reston, VA 2. NOAA / NWS / Science and

More information

Deep Feedforward Networks

Deep Feedforward Networks Deep Feedforward Networks Liu Yang March 30, 2017 Liu Yang Short title March 30, 2017 1 / 24 Overview 1 Background A general introduction Example 2 Gradient based learning Cost functions Output Units 3

More information