CHAPTER 2: DATA MINING - A MODERN TOOL FOR ANALYSIS. Due to elements of uncertainty many problems in this world appear to be

Size: px
Start display at page:

Download "CHAPTER 2: DATA MINING - A MODERN TOOL FOR ANALYSIS. Due to elements of uncertainty many problems in this world appear to be"

Transcription

1 11 CHAPTER 2: DATA MINING - A MODERN TOOL FOR ANALYSIS Due to elements of uncertainty many problems in this world appear to be complex. The uncertainty may be either in parameters defining the problem or in the situations. Application theory is the tool to solve this uncertainty since time immemorial. However this may be suitable only in cases whose characteristics are based on random processes. But there is considerable number of problems whose uncertainty is characterized by nonrandom processes. Since the advent of computers data mining techniques is found to be very useful in reducing the uncertainty. In this context, pattern generation and classifier approach is very popular. In this chapter the importance and application of data mining as to the meteorological set are elaborated DATA MINING FUNCTIONALITIES Data mining is finding increased applications in society in recent years. Due to the advent of advanced information and communication technologies, huge amount of data are available nowadays and one has to extract maximum possible useful information and knowledge from the same. This is no doubt a challenging task. The fast growing tremendous amount of data, collected and stored in large and numerous data repositories has far exceeded the human ability for comprehension with powerful tools. As a result data collected in large data repositories became data tombs data archives that are seldom visited. Important decisions are not made based on the huge data banks but more on intuition and speculations. This is because the decision makers have no proper tools

2 12 to extract the valuable knowledge embedded in the data stored. In fact expert system technologies depend heavily upon domain experts to manually input knowledge into databases. This first of all is time consuming and secondly not very much reliable as the whole system is prone to erroneous biased interpretation of data. Data mining is used to find hidden information from the large databases (Agrawal et al 1993; Larose 2006). The newest answer is Data Mining, which is being used both to increase revenues and to reduce costs. The potential returns are enormous. Data mining is a process that uses a variety of data analysis tools to discover patterns and relationship in data that may be used to make valid predictions. Knowledge discovery in data is defined as the nontrivial process of identifying valid, novel, potentially useful, and ultimately understandable pattern in data. The overall process consists of turning low data into high-level knowledge. Classification, regression, clustering, image retrieval, summarization, functional dependencies, association rules, rules extraction etc are some of the significant functions of data mining. A meticulous data mining algorithm is usually an instantiation of the model- preference-search components. Data mining is found to be very useful in many fields like bio informatics, genetics, medicine, social sciences, education, power engineering, electronics etc (Larose 2006). In the study of human genetics, sequence mining helps to attain significant goal of understanding the mapping relationship between inter variation in human DNA sequence and variability in disease susceptibility (Tory et al 2000). In power engineering data mining method have been used for condition monitoring of high

3 13 voltage electrical equipment (McGrail et al 2002). Data clustering technique has been used to vibration monitoring and analysis of transformer on load tap changers (Allen et al 2000; Zhu and Davidson 2007). Another example of application is the use in expertise finding system in educational fields (Superby et al 2006). Besides management and social sciences, data mining has a variety of applications ASSOCIATION RULES Association rule mining (Agrawal et al 1995) discovers the relationship between items from the set of transactions. These relationships can be expressed by association rules such as [i 1 i 2, i 3 support, s = 2%, confidence, c = 60%]. This association rule means that 2% of the transactions under scrutiny show that items i 1, i 2 and i 3 appear jointly. A confidence of 60% means that 60% of the transactions carrying i 1 also carry i 2 and i 3. Associations may include any number of items on either side of the rule. Agrawal et al (1993) first introduced the problem of mining association rules and later it was enhanced by data mining scholars (Agrawal and Srikant 1994; Bayardo and Agrawal 1999; Sarawagi et al 2000). Let I = {i 1, i 2,, i m } denote a set of literals, namely, items. Moreover, let D represent a set of transactions, where each transaction T is a set of items such that T I. A unique identifier, namely TID, is associated with each transaction. A transaction T is said to contain X, a set of some items in I, if X T. An association rule implies the form X Y, where X I, Y I and X Y = φ. The rule X Y holds in the transaction set

4 14 D with confidence, c, where c% of transactions in D that contain X also contains Y. The rule has support, s, in the transaction set D if s% of transactions in D contain X Y. An efficient algorithm is required that restricts the search space and checks only a subset of all association rule, yet does not miss important rules. The apriori algorithm is very much useful to retrieve the frequent patterns and its relationships. However, the interestingness (validity) of the rule is only based on support and confidence. With the constant collection and storage of considerable quantities of business data, association rules are discovered from the domain databases and applied in many areas, such as marketing, logistics and manufacturing. In the areas of marketing, advertising and sales, corporations have found that they can benefit enormously if implicit and previously unknown buying and calling patterns of customers can be discovered from large volumes of business data. Generally, support and confidence are taken as two measurable factors to evaluate the 'interestingness' of association rules. Association rules are regarded as interesting if their support and confidence are greater than the user-specified minimum support and minimum confidence, respectively. In data mining, it is important but difficult to determine rule validity. In meteorology and climatology a lot of data on various weather elements like temperature, pressure, winds, humidity, cloud data etc are available. India meteorological

5 15 department is more than 125 years old and weather records are available. World meteorological organization, a wing of UNO is the coordinating agency for world weather watch and weather services. So weather data from various countries after scrutiny are sent to WMO and they keep a record of weather globally since last century. National Oceanic Atmospheric Administration of USA keeps a website making available of the world weather data. Thus we have a huge collection of data in meteorology that can have intra and inter correlations. Hence Data mining techniques was apt for our purpose and the same was selected to develop the pattern and methodology for spot forecasts. The methodology is selected for the forecast of selected points in Tamilnadu of peninsular India. A few attempts have been made to test the potential of data mining technique to apply for meteorological data (Cavozos 2000; Chen 2007; Cofino et al 2003; Dai 1996; Feng et al 2001; Jiang 2010; Kohail 2011; Lahoz and Miguel 2004; Nandagopal and Arunachalam 2010; Xiang Le et al 2008). But no systematic attempt towards forecast of any parameter seems to have been made using this tool. The exercise can also establish the capability of data mining to operational forecasting in the field of atmospheric science WEATHER PATTERN DERIVATION The discovery of associations and correlations among items in large climate data sets can be made using frequent item set mining. With enormously huge amounts of data continuously being collected and stored, many industries are becoming interested in

6 16 mining such patterns from their databases. In this proposed method, the discovery of interesting correlation relationships among huge amounts of surface daily data records which contains the weather information can help in the process of decision making, such as weather forecast relevant to agriculture operations, supply of analyzed data to end users for planning agricultural strategy and behavior analysis of rainfall during peak monsoons. When the association rule is applied to the concept mentioned above for analysis, the various atmospheric observations like minimum temperature, maximum temperature, daily mean temperature, sea level pressure, cloud density, humidity etc taken at a definite time in definite area, the association rules could be seen like Rule 1 : If the temperature is high, then there is no rain in the same area at the same time. Although rule Rule 1 reflects some relationships among the meteorological elements, its role in weather prediction is inadequate, as users are often more concerned about the weather along a time dimension like Rule 2: If the humidity is medium and temperature is low, then it keeps warm for the next 24 hour. The traditional association rules only capture associations among items within the same transactions. Therefore they are intra transactional rules. The notion of the

7 17 transaction could be usage pattern of communication preference, the occurrence of the rainfall, the atmospheric events like hot day and cool day occurrence with similar weather patterns, and so on. However, an inter-transactional association rule can represent also the association of items among different transactions along certain dimensions like 24 hours advance, 48 hours advance, 72 hours advance, 1 week advance, etc. For association rules mining from the filtered dataset, we use predictive Apriori algorithm for finding the hidden relationship between various atmospheric parameters. The basic property of Apriori is that all non-empty subsets of a frequent item set must be frequent. A frequent item set must be frequent in connection with the above Apriori algorithm searches with an increasing support threshold for the best 'N' rules concerning a support-based corrected confidence value. By using predictive Apriori algorithm the association rules are generated on weather data set with support and confidence threshold values BAYESIAN CLASSIFICATION FOR CLIMATE DATA A classification is made by combining the impact that the different attributes have on the prediction to be made. Bayesian classifiers are statistical classifiers. They can predict class membership probabilities, such as the probability that a given tuple belongs to a particular class. Bayesian classification is based on Bayes theorem. Bayesian classifiers have also exhibited high accuracy and speed when applied to large databases.

8 18 Given a data value Xi the probability that a related tuple, Ti, is in class Cj is described by P(Cj Xi). Training data can be used to determine P(Xi), P(Xi Cj), and P(Cj). From these values Bayes theorem allow us to estimate the posterior probability P(Cj Xi) and then P(Cj Ti). On classifying a target tuple, the conditional and prior probabilities generated from the training ser are used to make the prediction. This is done by combining the effects of the different attribute values from the tuple. Suppose that tuple Ti, has P independent attribute values {Xi1, Xi2, Xip}. We then estimate P(Ti Cj) by P(Ti Cj) = P(Xik Cj). Classification is a form of data analysis that can be used to extract models describing important data classes and to predict future data trends. It will be a great value in weather forecasting with a better understanding of the data at large (Ancel et al 2004). The proposed Bayesian classification for meteorological data set is implemented with the help of machine learning tool Weka that is available as open source. Many real time problems has been solved with the help of this open source tool (Weka 3). The learning process of the climate data classification has training data that are analyzed by a classification algorithm. Here the class label attribute is precipitation for rainfall prediction that is having two values; they are yes and no. For the rainfall estimation, the class label attribute is precipitation which has two values such as high and low. For the temperature prediction during winter monsoon, the class label is post_minimum which has two values such as low and normal. For the maximum temperature prediction during summer months, the class label is post_maximum which has two values such as high and normal. The learned model or classifier is represented in the

9 19 form of classification rules. The classification process of the climate data set contains the test data that are used to estimate the accuracy of the classification rules. If the accuracy is considered acceptable, the rules can be applied to the classification of new data tuples. The figure 2.1 shows the proposed model for the learning procedure of the climate data classification process. The figure 2.2 shows the proposed model for the classification procedure of the climate data set. The proposed backpropagation neural model for meteorological data classification learns by iteratively processing a weather data set of training tuples, comparing the network s prediction for each tuple with the actual known target value. The target value may be the known class label of the training tuple. For each training tuple, the weights are modified so as to minimize the mean squared error between the weather prediction and the actual target value that is stated in the figure 2.3.

10 Figure 2.1. Learning procedure of meteorological data classification process 20

11 21 Figure 2.2. Classification process of meteorological data Figure 2.3. BPN model for meteorological data classification process

12 22 The frequent weather patterns are extracted using predictive Apriori algorithm for rainfall prediction, rainfall estimation on Northeast and Southwest monsoon seasons for a location specific forecasting model. Summer maximum and winter minimum temperature patterns are also generated. By using the classifier model given weather data set can be classified. The significance of the present study would become clear if it is seen in broader perspective. While scholars have attempted to forecast tropical cyclone intensity change, evolution of association rules for droughts and floods, spatial association rule mining technique over the plateau, dissolved gas analysis etc. (Dhanya and Nagesh Kumar 2009; Esp and McGrail 2000; Guo et al 2004; Jian et al 2004; Yang et al 2011) using the data mining technique, the application of this technique towards spot specific forecast of weather events is yet to be attempted, particularly to Indian sub continent. The earlier works have concentrated the data mining concept towards forecast of patterns of synoptic scale like tropical cyclone and droughts etc, but the efficacy of data mining towards rainfall forecast is yet to be established. The present work does an attempt towards that direction for peninsular India.

ASSOCIATION RULE MINING AND CLASSIFIER APPROACH FOR QUANTITATIVE SPOT RAINFALL PREDICTION

ASSOCIATION RULE MINING AND CLASSIFIER APPROACH FOR QUANTITATIVE SPOT RAINFALL PREDICTION ASSOCIATION RULE MINING AND CLASSIFIER APPROACH FOR QUANTITATIVE SPOT RAINFALL PREDICTION T.R. SIVARAMAKRISHNAN 1, S. MEGANATHAN 2 1 School of EEE, SASTRA University, Thanjavur, 613 401 2 Department of

More information

PATTERN VISUALIZATION ON METEOROLOGICAL DATA FOR RAINFALL PREDICTION MODEL

PATTERN VISUALIZATION ON METEOROLOGICAL DATA FOR RAINFALL PREDICTION MODEL PATTERN VISUALIZATION ON METEOROLOGICAL DATA FOR RAINFALL PREDICTION MODEL 1 S. MEGANATHAN, 2 T.R. SIVARAMAKRISHNAN 1 Department of CSE, SASTRA University, Kumbakonam, 612 001 2 School of EEE, SASTRA University,

More information

To Predict Rain Fall in Desert Area of Rajasthan Using Data Mining Techniques

To Predict Rain Fall in Desert Area of Rajasthan Using Data Mining Techniques To Predict Rain Fall in Desert Area of Rajasthan Using Data Mining Techniques Peeyush Vyas Asst. Professor, CE/IT Department of Vadodara Institute of Engineering, Vadodara Abstract: Weather forecasting

More information

Data Mining. Chapter 1. What s it all about?

Data Mining. Chapter 1. What s it all about? Data Mining Chapter 1. What s it all about? 1 DM & ML Ubiquitous computing environment Excessive amount of data (data flooding) Gap between the generation of data and their understanding Looking for structural

More information

International Journal of Advance Engineering and Research Development. Review Paper On Weather Forecast Using cloud Computing Technique

International Journal of Advance Engineering and Research Development. Review Paper On Weather Forecast Using cloud Computing Technique Scientific Journal of Impact Factor (SJIF): 4.72 International Journal of Advance Engineering and Research Development Volume 4, Issue 12, December -2017 e-issn (O): 2348-4470 p-issn (P): 2348-6406 Review

More information

Short Term Load Forecasting Using Multi Layer Perceptron

Short Term Load Forecasting Using Multi Layer Perceptron International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Short Term Load Forecasting Using Multi Layer Perceptron S.Hema Chandra 1, B.Tejaswini 2, B.suneetha 3, N.chandi Priya 4, P.Prathima

More information

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 3, May-June 2015

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 3, May-June 2015 RESEARCH ARTICLE OPEN ACCESS Analysis of Meteorological Data in of Tamil Nadu Districts Based On K- Means Clustering Algorithm M. Mayilvaganan [1], P. Vanitha [2] Department of Computer Science [2], PSG

More information

Put the Weather to Work for Your Company

Put the Weather to Work for Your Company SAP Data Network Put the Weather to Work for Your Company Extend the Value of Your Business and Transactional Solutions by Incorporating Weather Data 1 / 7 Table of Contents 3 Enrich Business Data with

More information

1990 Intergovernmental Panel on Climate Change Impacts Assessment

1990 Intergovernmental Panel on Climate Change Impacts Assessment 1990 Intergovernmental Panel on Climate Change Impacts Assessment Although the variability of weather and associated shifts in the frequency and magnitude of climate events were not available from the

More information

TOOLS AND DATA NEEDS FOR FORECASTING AND EARLY WARNING

TOOLS AND DATA NEEDS FOR FORECASTING AND EARLY WARNING TOOLS AND DATA NEEDS FOR FORECASTING AND EARLY WARNING Professor Richard Samson Odingo Department of Geography and Environmental Studies University of Nairobi, Kenya THE NEED FOR ADEQUATE DATA AND APPROPRIATE

More information

Stochastic Hydrology. a) Data Mining for Evolution of Association Rules for Droughts and Floods in India using Climate Inputs

Stochastic Hydrology. a) Data Mining for Evolution of Association Rules for Droughts and Floods in India using Climate Inputs Stochastic Hydrology a) Data Mining for Evolution of Association Rules for Droughts and Floods in India using Climate Inputs An accurate prediction of extreme rainfall events can significantly aid in policy

More information

Seasonal Climate Watch June to October 2018

Seasonal Climate Watch June to October 2018 Seasonal Climate Watch June to October 2018 Date issued: May 28, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) has now moved into the neutral phase and is expected to rise towards an El Niño

More information

International Desks: African Training Desk and Projects

International Desks: African Training Desk and Projects The Climate Prediction Center International Desks: African Training Desk and Projects Wassila M. Thiaw Team Leader Climate Prediction Center National Centers for Environmental Predictions 1 African Desk

More information

Understanding Weather and Climate Risk. Matthew Perry Sharing an Uncertain World Conference The Geological Society, 13 July 2017

Understanding Weather and Climate Risk. Matthew Perry Sharing an Uncertain World Conference The Geological Society, 13 July 2017 Understanding Weather and Climate Risk Matthew Perry Sharing an Uncertain World Conference The Geological Society, 13 July 2017 What is risk in a weather and climate context? Hazard: something with the

More information

SHORT TERM LOAD FORECASTING

SHORT TERM LOAD FORECASTING Indian Institute of Technology Kanpur (IITK) and Indian Energy Exchange (IEX) are delighted to announce Training Program on "Power Procurement Strategy and Power Exchanges" 28-30 July, 2014 SHORT TERM

More information

1 Introduction. Station Type No. Synoptic/GTS 17 Principal 172 Ordinary 546 Precipitation

1 Introduction. Station Type No. Synoptic/GTS 17 Principal 172 Ordinary 546 Precipitation Use of Automatic Weather Stations in Ethiopia Dula Shanko National Meteorological Agency(NMA), Addis Ababa, Ethiopia Phone: +251116639662, Mob +251911208024 Fax +251116625292, Email: Du_shanko@yahoo.com

More information

Operational event attribution

Operational event attribution Operational event attribution Peter Stott, NCAR, 26 January, 2009 August 2003 Events July 2007 January 2009 January 2009 Is global warming slowing down? Arctic Sea Ice Climatesafety.org climatesafety.org

More information

Decision T ree Tree Algorithm Week 4 1

Decision T ree Tree Algorithm Week 4 1 Decision Tree Algorithm Week 4 1 Team Homework Assignment #5 Read pp. 105 117 of the text book. Do Examples 3.1, 3.2, 3.3 and Exercise 3.4 (a). Prepare for the results of the homework assignment. Due date

More information

Project Name: Implementation of Drought Early-Warning System over IRAN (DESIR)

Project Name: Implementation of Drought Early-Warning System over IRAN (DESIR) Project Name: Implementation of Drought Early-Warning System over IRAN (DESIR) IRIMO's Committee of GFCS, National Climate Center, Mashad November 2013 1 Contents Summary 3 List of abbreviations 5 Introduction

More information

Seasonal Climate Watch July to November 2018

Seasonal Climate Watch July to November 2018 Seasonal Climate Watch July to November 2018 Date issued: Jun 25, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is now in a neutral phase and is expected to rise towards an El Niño phase through

More information

Internet Engineering Jacek Mazurkiewicz, PhD

Internet Engineering Jacek Mazurkiewicz, PhD Internet Engineering Jacek Mazurkiewicz, PhD Softcomputing Part 11: SoftComputing Used for Big Data Problems Agenda Climate Changes Prediction System Based on Weather Big Data Visualisation Natural Language

More information

7 - DE Website Document Weather Meteorology

7 - DE Website Document Weather Meteorology Date: Subject: 7 - DE Website Document Weather Meteorology Name: Section: E.ES.07.71 - Compare and contrast the difference and relationship between climate and weather. E.ES.07.74 - Describe weather conditions

More information

Detecting Anomalous and Exceptional Behaviour on Credit Data by means of Association Rules. M. Delgado, M.D. Ruiz, M.J. Martin-Bautista, D.

Detecting Anomalous and Exceptional Behaviour on Credit Data by means of Association Rules. M. Delgado, M.D. Ruiz, M.J. Martin-Bautista, D. Detecting Anomalous and Exceptional Behaviour on Credit Data by means of Association Rules M. Delgado, M.D. Ruiz, M.J. Martin-Bautista, D. Sánchez 18th September 2013 Detecting Anom and Exc Behaviour on

More information

Chapter 6. Frequent Pattern Mining: Concepts and Apriori. Meng Jiang CSE 40647/60647 Data Science Fall 2017 Introduction to Data Mining

Chapter 6. Frequent Pattern Mining: Concepts and Apriori. Meng Jiang CSE 40647/60647 Data Science Fall 2017 Introduction to Data Mining Chapter 6. Frequent Pattern Mining: Concepts and Apriori Meng Jiang CSE 40647/60647 Data Science Fall 2017 Introduction to Data Mining Pattern Discovery: Definition What are patterns? Patterns: A set of

More information

Enhancing Weather Information with Probability Forecasts. An Information Statement of the American Meteorological Society

Enhancing Weather Information with Probability Forecasts. An Information Statement of the American Meteorological Society Enhancing Weather Information with Probability Forecasts An Information Statement of the American Meteorological Society (Adopted by AMS Council on 12 May 2008) Bull. Amer. Meteor. Soc., 89 Summary This

More information

WMO Priorities and Perspectives on IPWG

WMO Priorities and Perspectives on IPWG WMO Priorities and Perspectives on IPWG Stephan Bojinski WMO Space Programme IPWG-6, São José dos Campos, Brazil, 15-19 October 2012 1. Introduction to WMO Extended Abstract The World Meteorological Organization

More information

Lecture 2. Judging the Performance of Classifiers. Nitin R. Patel

Lecture 2. Judging the Performance of Classifiers. Nitin R. Patel Lecture 2 Judging the Performance of Classifiers Nitin R. Patel 1 In this note we will examine the question of how to udge the usefulness of a classifier and how to compare different classifiers. Not only

More information

NPTEL. NOC:Weather Forecast in Agriculture and Agroadvisory (WF) - Video course. Agriculture. COURSE OUTLINE

NPTEL. NOC:Weather Forecast in Agriculture and Agroadvisory (WF) - Video course. Agriculture.   COURSE OUTLINE NPTEL Syllabus NOC:Weather Forecast in Agriculture and Agroadvisory (WF) - Video course COURSE OUTLINE Week Topics 1 a. Basic aspect of atmosphere, climate, weather Definition on atmosphere role of atmosphere

More information

Seasonal Climate Watch February to June 2018

Seasonal Climate Watch February to June 2018 Seasonal Climate Watch February to June 2018 Date issued: Jan 26, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is expected to remain in a weak La Niña phase through to early autumn (Feb-Mar-Apr).

More information

A Support Vector Regression Model for Forecasting Rainfall

A Support Vector Regression Model for Forecasting Rainfall A Support Vector Regression for Forecasting Nasimul Hasan 1, Nayan Chandra Nath 1, Risul Islam Rasel 2 Department of Computer Science and Engineering, International Islamic University Chittagong, Bangladesh

More information

Chapter-1 Introduction

Chapter-1 Introduction Modeling of rainfall variability and drought assessment in Sabarmati basin, Gujarat, India Chapter-1 Introduction 1.1 General Many researchers had studied variability of rainfall at spatial as well as

More information

Seasonal Climate Watch September 2018 to January 2019

Seasonal Climate Watch September 2018 to January 2019 Seasonal Climate Watch September 2018 to January 2019 Date issued: Aug 31, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is still in a neutral phase and is still expected to rise towards an

More information

Data Mining Part 4. Prediction

Data Mining Part 4. Prediction Data Mining Part 4. Prediction 4.3. Fall 2009 Instructor: Dr. Masoud Yaghini Outline Introduction Bayes Theorem Naïve References Introduction Bayesian classifiers A statistical classifiers Introduction

More information

NetBox: A Probabilistic Method for Analyzing Market Basket Data

NetBox: A Probabilistic Method for Analyzing Market Basket Data NetBox: A Probabilistic Method for Analyzing Market Basket Data José Miguel Hernández-Lobato joint work with Zoubin Gharhamani Department of Engineering, Cambridge University October 22, 2012 J. M. Hernández-Lobato

More information

El Niño / Southern Oscillation

El Niño / Southern Oscillation El Niño / Southern Oscillation Student Packet 2 Use contents of this packet as you feel appropriate. You are free to copy and use any of the material in this lesson plan. Packet Contents Introduction on

More information

Classification Using Decision Trees

Classification Using Decision Trees Classification Using Decision Trees 1. Introduction Data mining term is mainly used for the specific set of six activities namely Classification, Estimation, Prediction, Affinity grouping or Association

More information

Predictive Analytics on Accident Data Using Rule Based and Discriminative Classifiers

Predictive Analytics on Accident Data Using Rule Based and Discriminative Classifiers Advances in Computational Sciences and Technology ISSN 0973-6107 Volume 10, Number 3 (2017) pp. 461-469 Research India Publications http://www.ripublication.com Predictive Analytics on Accident Data Using

More information

Atmospheric patterns for heavy rain events in the Balearic Islands

Atmospheric patterns for heavy rain events in the Balearic Islands Adv. Geosci., 12, 27 32, 2007 Author(s) 2007. This work is licensed under a Creative Commons License. Advances in Geosciences Atmospheric patterns for heavy rain events in the Balearic Islands A. Lana,

More information

UPDATE OF REGIONAL WEATHER AND SMOKE HAZE FOR MAY 2015

UPDATE OF REGIONAL WEATHER AND SMOKE HAZE FOR MAY 2015 UPDATE OF REGIONAL WEATHER AND SMOKE HAZE FOR MAY 2015 1. Review of Regional Weather Conditions in April 2015 1.1 Inter-Monsoon conditions prevailed over the ASEAN region in April 2015. The gradual northward

More information

Understanding the Global Distribution of Monsoon Depressions

Understanding the Global Distribution of Monsoon Depressions DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Understanding the Global Distribution of Monsoon Depressions William R. Boos PO Box 208109 New Haven, CT 06520 phone: (203)

More information

Data Analytics Beyond OLAP. Prof. Yanlei Diao

Data Analytics Beyond OLAP. Prof. Yanlei Diao Data Analytics Beyond OLAP Prof. Yanlei Diao OPERATIONAL DBs DB 1 DB 2 DB 3 EXTRACT TRANSFORM LOAD (ETL) METADATA STORE DATA WAREHOUSE SUPPORTS OLAP DATA MINING INTERACTIVE DATA EXPLORATION Overview of

More information

The Quadratic Entropy Approach to Implement the Id3 Decision Tree Algorithm

The Quadratic Entropy Approach to Implement the Id3 Decision Tree Algorithm Journal of Computer Science and Information Technology December 2018, Vol. 6, No. 2, pp. 23-29 ISSN: 2334-2366 (Print), 2334-2374 (Online) Copyright The Author(s). All Rights Reserved. Published by American

More information

Seasonal Climate Watch November 2017 to March 2018

Seasonal Climate Watch November 2017 to March 2018 Seasonal Climate Watch November 2017 to March 2018 Date issued: Oct 26, 2017 1. Overview The El Niño Southern Oscillation (ENSO) continues to develop towards a La Niña state, and is expected to be in at

More information

CHAPTER 4: PREDICTION AND ESTIMATION OF RAINFALL DURING NORTHEAST MONSOON

CHAPTER 4: PREDICTION AND ESTIMATION OF RAINFALL DURING NORTHEAST MONSOON 43 CHAPTER 4: PREDICTION AND ESTIMATION OF RAINFALL DURING NORTHEAST MONSOON After analyzing the weather patterns and forecast of seasonal rainfall for Cauvery delta region, a method to predict the dry

More information

Analysis of Data Mining Techniques for Weather Prediction

Analysis of Data Mining Techniques for Weather Prediction ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 Indian Journal of Science and Technology, Vol 9(38), DOI: 10.17485/ijst/2016/v9i38/101962, October 2016 Analysis of Data Mining Techniques for Weather

More information

Seasonality and Rainfall Prediction

Seasonality and Rainfall Prediction Seasonality and Rainfall Prediction Arpita Sharma 1 and Mahua Bose 2 1 Deen Dayal Upadhyay College, Delhi University, New Delhi, India. e-mail: 1 asharma@ddu.du.ac.in; 2 e cithi@yahoo.com Abstract. Time

More information

Seasonal Climate Watch April to August 2018

Seasonal Climate Watch April to August 2018 Seasonal Climate Watch April to August 2018 Date issued: Mar 23, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is expected to weaken from a moderate La Niña phase to a neutral phase through

More information

An Approach to Classification Based on Fuzzy Association Rules

An Approach to Classification Based on Fuzzy Association Rules An Approach to Classification Based on Fuzzy Association Rules Zuoliang Chen, Guoqing Chen School of Economics and Management, Tsinghua University, Beijing 100084, P. R. China Abstract Classification based

More information

Application and verification of the ECMWF products Report 2007

Application and verification of the ECMWF products Report 2007 Application and verification of the ECMWF products Report 2007 National Meteorological Administration Romania 1. Summary of major highlights The medium range forecast activity within the National Meteorological

More information

Possible Applications of Deep Neural Networks in Climate and Weather. David M. Hall Assistant Research Professor Dept. Computer Science, CU Boulder

Possible Applications of Deep Neural Networks in Climate and Weather. David M. Hall Assistant Research Professor Dept. Computer Science, CU Boulder Possible Applications of Deep Neural Networks in Climate and Weather David M. Hall Assistant Research Professor Dept. Computer Science, CU Boulder Quick overview of climate and weather models Weather models

More information

National level products generation including calibration aspects

National level products generation including calibration aspects National level products generation including calibration aspects Dr. Cedric J. VAN MEERBEECK, Climatologist (cmeerbeeck@cimh.edu.bb), Adrian R. Trotman, Chief of Applied Meteorology and Climatology (atrotman@cimh.edu.bb),

More information

Rainfall Prediction using Back-Propagation Feed Forward Network

Rainfall Prediction using Back-Propagation Feed Forward Network Rainfall Prediction using Back-Propagation Feed Forward Network Ankit Chaturvedi Department of CSE DITMR (Faridabad) MDU Rohtak (hry). ABSTRACT Back propagation is most widely used in neural network projects

More information

Improving global coastal inundation forecasting WMO Panel, UR2014, London, 2 July 2014

Improving global coastal inundation forecasting WMO Panel, UR2014, London, 2 July 2014 Improving global coastal inundation forecasting WMO Panel, UR2014, London, 2 July 2014 Cyclone Sidr, November 2007 Hurricane Katrina, 2005 Prof. Kevin Horsburgh Head of marine physics, UK National Oceanography

More information

The Kentucky Mesonet: Entering a New Phase

The Kentucky Mesonet: Entering a New Phase The Kentucky Mesonet: Entering a New Phase Stuart A. Foster State Climatologist Kentucky Climate Center Western Kentucky University KCJEA Winter Conference Lexington, Kentucky February 9, 2017 Kentucky

More information

CSE 5243 INTRO. TO DATA MINING

CSE 5243 INTRO. TO DATA MINING CSE 5243 INTRO. TO DATA MINING Mining Frequent Patterns and Associations: Basic Concepts (Chapter 6) Huan Sun, CSE@The Ohio State University Slides adapted from Prof. Jiawei Han @UIUC, Prof. Srinivasan

More information

Weather Analysis and Forecasting

Weather Analysis and Forecasting Weather Analysis and Forecasting An Information Statement of the American Meteorological Society (Adopted by AMS Council on 25 March 2015) Bull. Amer. Meteor. Soc., 88 This Information Statement describes

More information

Southwest Climate Change Projections Increasing Extreme Weather Events?

Southwest Climate Change Projections Increasing Extreme Weather Events? Southwest Climate Change Projections Increasing Extreme Weather Events? Jeremy Weiss Climate and Geospatial Extension Scientist School of Natural Resources and the Environment University of Arizona jlweiss@email.arizona.edu

More information

Understanding Weather And Climate

Understanding Weather And Climate Understanding Weather And Climate 1 / 6 2 / 6 3 / 6 Understanding Weather And Climate The Cambridge Guide to the Weather & Climate. The Cambridge Guide to the England Climate and Weather is a practical

More information

Issue Overview: El Nino and La Nina

Issue Overview: El Nino and La Nina Issue Overview: El Nino and La Nina By Bloomberg, adapted by Newsela staff on 09.28.16 Word Count 748 TOP: A Category 5 typhoon in the Pacific Ocean. BOTTOM: Graphics courtesy of the U.S. National Oceanic

More information

SOME STEP OF QUALITY CONTROL OF UPPER-AIR NETWORK DATA IN CHINA. Zhiqiang Zhao

SOME STEP OF QUALITY CONTROL OF UPPER-AIR NETWORK DATA IN CHINA. Zhiqiang Zhao SOME STEP OF QUALITY CONTROL OF UPPER-AIR NETWORK DATA IN CHINA Zhiqiang Zhao China Meteorological Administration (CMA) 46, Zhongguancun Nandajie, Beijing, 100081,China Tel: 8610-68407362, Fax: 8610-62179786,

More information

Predicting Floods in North Central Province of Sri Lanka using Machine Learning and Data Mining Methods

Predicting Floods in North Central Province of Sri Lanka using Machine Learning and Data Mining Methods Thilakarathne & Premachandra Predicting Floods in North Central Province of Sri Lanka using Machine Learning and Data Mining Methods H. Thilakarathne 1, K. Premachandra 2 1 Department of Physical Science,

More information

Global Climate Change and the Implications for Oklahoma. Gary McManus Associate State Climatologist Oklahoma Climatological Survey

Global Climate Change and the Implications for Oklahoma. Gary McManus Associate State Climatologist Oklahoma Climatological Survey Global Climate Change and the Implications for Oklahoma Gary McManus Associate State Climatologist Oklahoma Climatological Survey OCS LEGISLATIVE MANDATES Conduct and report on studies of climate and weather

More information

Reductionist View: A Priori Algorithm and Vector-Space Text Retrieval. Sargur Srihari University at Buffalo The State University of New York

Reductionist View: A Priori Algorithm and Vector-Space Text Retrieval. Sargur Srihari University at Buffalo The State University of New York Reductionist View: A Priori Algorithm and Vector-Space Text Retrieval Sargur Srihari University at Buffalo The State University of New York 1 A Priori Algorithm for Association Rule Learning Association

More information

FUTURE CARIBBEAN CLIMATES FROM STATISTICAL AND DYNAMICAL DOWNSCALING

FUTURE CARIBBEAN CLIMATES FROM STATISTICAL AND DYNAMICAL DOWNSCALING FUTURE CARIBBEAN CLIMATES FROM STATISTICAL AND DYNAMICAL DOWNSCALING Arnoldo Bezanilla Morlot Center For Atmospheric Physics Institute of Meteorology, Cuba The Caribbean Community Climate Change Centre

More information

Sub-seasonal predictions at ECMWF and links with international programmes

Sub-seasonal predictions at ECMWF and links with international programmes Sub-seasonal predictions at ECMWF and links with international programmes Frederic Vitart and Franco Molteni ECMWF, Reading, U.K. Using ECMWF forecasts, 4-6 June 2014 1 Outline Recent progress and plans

More information

Finding Multiple Outliers from Multidimensional Data using Multiple Regression

Finding Multiple Outliers from Multidimensional Data using Multiple Regression Finding Multiple Outliers from Multidimensional Data using Multiple Regression L. Sunitha 1*, Dr M. Bal Raju 2 1* CSE Research Scholar, J N T U Hyderabad, Telangana (India) 2 Professor and principal, K

More information

THE STUDY OF NUMBERS AND INTENSITY OF TROPICAL CYCLONE MOVING TOWARD THE UPPER PART OF THAILAND

THE STUDY OF NUMBERS AND INTENSITY OF TROPICAL CYCLONE MOVING TOWARD THE UPPER PART OF THAILAND THE STUDY OF NUMBERS AND INTENSITY OF TROPICAL CYCLONE MOVING TOWARD THE UPPER PART OF THAILAND Aphantree Yuttaphan 1, Sombat Chuenchooklin 2 and Somchai Baimoung 3 ABSTRACT The upper part of Thailand

More information

Application of Text Mining for Faster Weather Forecasting

Application of Text Mining for Faster Weather Forecasting International Journal of Computer Engineering and Information Technology VOL. 8, NO. 11, November 2016, 213 219 Available online at: www.ijceit.org E-ISSN 2412-8856 (Online) Application of Text Mining

More information

DROUGHT ASSESSMENT USING SATELLITE DERIVED METEOROLOGICAL PARAMETERS AND NDVI IN POTOHAR REGION

DROUGHT ASSESSMENT USING SATELLITE DERIVED METEOROLOGICAL PARAMETERS AND NDVI IN POTOHAR REGION DROUGHT ASSESSMENT USING SATELLITE DERIVED METEOROLOGICAL PARAMETERS AND NDVI IN POTOHAR REGION Researcher: Saad-ul-Haque Supervisor: Dr. Badar Ghauri Department of RS & GISc Institute of Space Technology

More information

A High Resolution Daily Gridded Rainfall Data Set ( ) for Mesoscale Meteorological Studies

A High Resolution Daily Gridded Rainfall Data Set ( ) for Mesoscale Meteorological Studies National Climate Centre Research Report No: 9/2008 A High Resolution Daily Gridded Rainfall Data Set (1971-2005) for Mesoscale Meteorological Studies M. Rajeevan and Jyoti Bhate National Climate Centre

More information

Hierarchical models for the rainfall forecast DATA MINING APPROACH

Hierarchical models for the rainfall forecast DATA MINING APPROACH Hierarchical models for the rainfall forecast DATA MINING APPROACH Thanh-Nghi Do dtnghi@cit.ctu.edu.vn June - 2014 Introduction Problem large scale GCM small scale models Aim Statistical downscaling local

More information

Data and prognosis for renewable energy

Data and prognosis for renewable energy The Hong Kong Polytechnic University Department of Electrical Engineering Project code: FYP_27 Data and prognosis for renewable energy by Choi Man Hin 14072258D Final Report Bachelor of Engineering (Honours)

More information

WMO Aeronautical Meteorology Scientific Conference 2017

WMO Aeronautical Meteorology Scientific Conference 2017 Session 1 Science underpinning meteorological observations, forecasts, advisories and warnings 1.6 Observation, nowcast and forecast of future needs 1.6.1 Advances in observing methods and use of observations

More information

AN INTERNATIONAL SOLAR IRRADIANCE DATA INGEST SYSTEM FOR FORECASTING SOLAR POWER AND AGRICULTURAL CROP YIELDS

AN INTERNATIONAL SOLAR IRRADIANCE DATA INGEST SYSTEM FOR FORECASTING SOLAR POWER AND AGRICULTURAL CROP YIELDS AN INTERNATIONAL SOLAR IRRADIANCE DATA INGEST SYSTEM FOR FORECASTING SOLAR POWER AND AGRICULTURAL CROP YIELDS James Hall JHTech PO Box 877 Divide, CO 80814 Email: jameshall@jhtech.com Jeffrey Hall JHTech

More information

Tokyo Climate Center Website (TCC website) and its products -For monitoring the world climate and ocean-

Tokyo Climate Center Website (TCC website) and its products -For monitoring the world climate and ocean- Tokyo, 14 November 2016, TCC Training Seminar Tokyo Climate Center Website (TCC website) and its products -For monitoring the world climate and ocean- Yasushi MOCHIZUKI Tokyo Climate Center Japan Meteorological

More information

Verification of the Seasonal Forecast for the 2005/06 Winter

Verification of the Seasonal Forecast for the 2005/06 Winter Verification of the Seasonal Forecast for the 2005/06 Winter Shingo Yamada Tokyo Climate Center Japan Meteorological Agency 2006/11/02 7 th Joint Meeting on EAWM Contents 1. Verification of the Seasonal

More information

Drought and Climate Extremes Indices for the North American Drought Monitor and North America Climate Extremes Monitoring System. Richard R. Heim Jr.

Drought and Climate Extremes Indices for the North American Drought Monitor and North America Climate Extremes Monitoring System. Richard R. Heim Jr. Drought and Climate Extremes Indices for the North American Drought Monitor and North America Climate Extremes Monitoring System Richard R. Heim Jr. NOAA/NESDIS/National Climatic Data Center Asheville,

More information

Operational Perspectives on Hydrologic Model Data Assimilation

Operational Perspectives on Hydrologic Model Data Assimilation Operational Perspectives on Hydrologic Model Data Assimilation Rob Hartman Hydrologist in Charge NOAA / National Weather Service California-Nevada River Forecast Center Sacramento, CA USA Outline Operational

More information

CSE 5243 INTRO. TO DATA MINING

CSE 5243 INTRO. TO DATA MINING CSE 5243 INTRO. TO DATA MINING Mining Frequent Patterns and Associations: Basic Concepts (Chapter 6) Huan Sun, CSE@The Ohio State University 10/17/2017 Slides adapted from Prof. Jiawei Han @UIUC, Prof.

More information

SEASONAL CLIMATE PREDICTION

SEASONAL CLIMATE PREDICTION SEASONAL CLIMATE PREDICTION David Walland Australian Bureau of Meteorology WMO RA-V Seminar on Climate Services Honiara, Solomon Islands, 1-4 November 2011 Overview Major climate Drivers in the region

More information

REQUIREMENTS FOR WEATHER RADAR DATA. Review of the current and likely future hydrological requirements for Weather Radar data

REQUIREMENTS FOR WEATHER RADAR DATA. Review of the current and likely future hydrological requirements for Weather Radar data WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPEN PROGRAMME AREA GROUP ON INTEGRATED OBSERVING SYSTEMS WORKSHOP ON RADAR DATA EXCHANGE EXETER, UK, 24-26 APRIL 2013 CBS/OPAG-IOS/WxR_EXCHANGE/2.3

More information

The Role of Weather in Risk Management For the Market Technician s Association October 15, 2013

The Role of Weather in Risk Management For the Market Technician s Association October 15, 2013 The Role of Weather in Risk Management For the Market Technician s Association October 15, 2013 RIA PERSAD President StatWeather rpersad@statweather.com Predictive Analytics Consumer Behavior Astronomy

More information

Mining Class-Dependent Rules Using the Concept of Generalization/Specialization Hierarchies

Mining Class-Dependent Rules Using the Concept of Generalization/Specialization Hierarchies Mining Class-Dependent Rules Using the Concept of Generalization/Specialization Hierarchies Juliano Brito da Justa Neves 1 Marina Teresa Pires Vieira {juliano,marina}@dc.ufscar.br Computer Science Department

More information

Unit title: Marine Meteorology: An Introduction (SCQF level 7)

Unit title: Marine Meteorology: An Introduction (SCQF level 7) Higher National Unit Specification General information Unit code: HT6M 34 Superclass: XQ Publication date: September 2017 Source: Scottish Qualifications Authority Version: 2 Unit purpose This unit introduces

More information

Weather Permitting/Meteorology. North Carolina Science Olympiad Coaches Clinic October 6, 2018 Michelle Hafey

Weather Permitting/Meteorology. North Carolina Science Olympiad Coaches Clinic October 6, 2018 Michelle Hafey Weather Permitting/Meteorology North Carolina Science Olympiad Coaches Clinic October 6, 2018 Michelle Hafey hafeym@uncw.edu Read the Rules Weather Permitting Division A Team Of Up To: 2 Bring writing

More information

NATS 101 Section 13: Lecture 25. Weather Forecasting Part II

NATS 101 Section 13: Lecture 25. Weather Forecasting Part II NATS 101 Section 13: Lecture 25 Weather Forecasting Part II NWP s First Baby Steps: Mid-Twentieth Century It wasn t until the development of computers in the 1940s and 1950s that NWP could be even attempted.

More information

Climate Change or Climate Variability?

Climate Change or Climate Variability? Climate Change or Climate Variability? Key Concepts: Greenhouse Gas Climate Climate change Climate variability Climate zones Precipitation Temperature Water cycle Weather WHAT YOU WILL LEARN 1. You will

More information

Global Flash Flood Guidance System Status and Outlook

Global Flash Flood Guidance System Status and Outlook Global Flash Flood Guidance System Status and Outlook HYDROLOGIC RESEARCH CENTER San Diego, CA 92130 http://www.hrcwater.org Initial Planning Meeting on the WMO HydroSOS, Entebbe, Uganda 26-28 September

More information

South Asian Climate Outlook Forum (SASCOF-6)

South Asian Climate Outlook Forum (SASCOF-6) Sixth Session of South Asian Climate Outlook Forum (SASCOF-6) Dhaka, Bangladesh, 19-22 April 2015 Consensus Statement Summary Below normal rainfall is most likely during the 2015 southwest monsoon season

More information

Infrastructure and Expertise available to the Advisory Section

Infrastructure and Expertise available to the Advisory Section Infrastructure and Expertise available to the Advisory Section By Lucky Nhlanhla Sigudla Advisory Section Outline INTRODUCTION STRUCTURE PRESENT INFRATUCTURE EXPERTISE SPECIFIC ISSUES USER ACTIVITIES CONCLUSION

More information

TRANSMISSION BUSINESS LOAD FORECAST AND METHODOLOGY

TRANSMISSION BUSINESS LOAD FORECAST AND METHODOLOGY Filed: September, 00 EB-00-00 Tab Schedule Page of 0 TRANSMISSION BUSINESS LOAD FORECAST AND METHODOLOGY.0 INTRODUCTION 0 This exhibit discusses Hydro One Networks transmission system load forecast and

More information

2015: A YEAR IN REVIEW F.S. ANSLOW

2015: A YEAR IN REVIEW F.S. ANSLOW 2015: A YEAR IN REVIEW F.S. ANSLOW 1 INTRODUCTION Recently, three of the major centres for global climate monitoring determined with high confidence that 2015 was the warmest year on record, globally.

More information

1 Ministry of Earth Sciences, Lodi Road, New Delhi India Meteorological Department, Lodi Road, New Delhi

1 Ministry of Earth Sciences, Lodi Road, New Delhi India Meteorological Department, Lodi Road, New Delhi Trends in Extreme Temperature Events over India during 1969-12 A. K. JASWAL, AJIT TYAGI 1 and S. C. BHAN 2 India Meteorological Department, Shivajinagar, Pune - 4105 1 Ministry of Earth Sciences, Lodi

More information

A Recommendation for Tropical Daily Rainfall Prediction Based on Meteorological Data Series in Indonesia

A Recommendation for Tropical Daily Rainfall Prediction Based on Meteorological Data Series in Indonesia A Recommendation for Tropical Daily Rainfall Prediction Based on Meteorological Data Series in Indonesia Indrabayu and D.A. Suriamiharja 2 Informatics Department-Hasanuddin University, Makassar, Indonesia

More information

Ebook Code: REAU4045. The Earth & Life Science Series. Weather. Science activities for 6 to 9 year olds

Ebook Code: REAU4045. The Earth & Life Science Series. Weather. Science activities for 6 to 9 year olds Ebook Code: REAU4045 The Earth & Life Science Series Weather Science activities for 6 to 9 year olds Written by Judy Gabrovec. Ready-Ed Publications - 2005. Published by Ready-Ed Publications (2005) P.O.

More information

Data Mining Classification: Basic Concepts, Decision Trees, and Model Evaluation

Data Mining Classification: Basic Concepts, Decision Trees, and Model Evaluation Data Mining Classification: Basic Concepts, Decision Trees, and Model Evaluation Lecture Notes for Chapter 4 Part I Introduction to Data Mining by Tan, Steinbach, Kumar Adapted by Qiang Yang (2010) Tan,Steinbach,

More information

Geovisualization for Association Rule Mining in CHOPS Well Data

Geovisualization for Association Rule Mining in CHOPS Well Data UNIVERSITY OF CALGARY Geovisualization for Association Rule Mining in CHOPS Well Data by Xiaodong Sun A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR

More information

Research Article Weather Forecasting Using Sliding Window Algorithm

Research Article Weather Forecasting Using Sliding Window Algorithm ISRN Signal Processing Volume 23, Article ID 5654, 5 pages http://dx.doi.org/.55/23/5654 Research Article Weather Forecasting Using Sliding Window Algorithm Piyush Kapoor and Sarabjeet Singh Bedi 2 KvantumInc.,Gurgaon22,India

More information

The WMO Integrated Global Observing System (WIGOS), current status and planned regional activities

The WMO Integrated Global Observing System (WIGOS), current status and planned regional activities The WMO Integrated Global Observing System (WIGOS), current status and planned regional activities Dr. Lars Peter Riishojgaard WMO Secretariat, Geneva Outline Introduction to WIGOS WMO The Rolling Review

More information

Application and verification of ECMWF products 2015

Application and verification of ECMWF products 2015 Application and verification of ECMWF products 2015 Hungarian Meteorological Service 1. Summary of major highlights The objective verification of ECMWF forecasts have been continued on all the time ranges

More information