Coefficient of Determination. Autoregressive Conditional Interval Model with Exogenous Explanatory Interval Variable. Adaptive Linear Neural Network

Size: px
Start display at page:

Download "Coefficient of Determination. Autoregressive Conditional Interval Model with Exogenous Explanatory Interval Variable. Adaptive Linear Neural Network"

Transcription

1 List of Symbols R 2 A AC ACF ACIX AE AI ALNN AMIN ANN APARCH AR ARIMA BFGS BiP Sig BLR BNN BP BPNN Coefficient of Determination Annual Analog Complexity Auto-Correlation Function Autoregressive Conditional Interval Model with Exogenous Explanatory Interval Variable Absolute Error Artificial Intelligent Adaptive Linear Neural Network AI framework of Amin-Naseri et al. Artificial Neural Network Asymmetric Power ARCH Annualised Return Autoregressive Integrated Moving Average Broyden Fletcher Goldfarb Shanno Quasi Newton Bipolar Sigmoid Bias Learning Rule Boltzmann Neural Network Back-Propagation Back-Propagation Neural Network xvi

2 BR Br BVaR CA Ca-Var CC CrI D DA Db DirS DNN DS DT Du ECM EGARCH EM EMD ENN Eqn. FBS Fig FIGARCH FIML Bayesian Regulation Brent Crude Oil Market Bayesian Vector Auto-Regression Correlation Analysis Conditionally Autoregressive VaR Cluster Classifier Crisis Index Daily Day Ahead Daubechies Direct Strategy Decomposition based Neural Networks Directional Statistics Delta Test Dubai Oil Market Error Correction Model Exponential GARCH Expectation Maximization Empirical Mode Decomposition Elman Neural Network Equation Forward Backward Selection Figure Fractionally Integrated GARCH Full Information Maximum Likelihood xvii

3 FLNN FM FNN FP GA GARCH GB GD GDX GPMGA GRNN GSM GT HaT HM HQIC HR HTS HWBT IBL IGARCH IGP JC KAB L-RIM Functional Link Neural Network Fuzzy Model Fuzzy Neural Network NYMEX Future Prices Genetic Algorithm Generalized Autoregressive Conditional Heteroskedasticity Geometric Brownian Process Gradient Descent Gradient Descent BEP Generalized Pattern Matching Genetic Algorithm General Regression Neural Network Grey System Model Gamma Test Harr a Trous Hidden Markov Model Hannan-Quinn Info Criterion Hit Rate Hyperbolic Tangent Sigmoid Hull White with Binomial Tree Instance Based Learning Integrated GARCH Inverse Gaussian Process Judgemental Criterion Genetic Programming framework of Kaboudan Linear Relative Inventory Model xviii

4 LD Lgs LM LS LSE M MA MAE MAPE MFA MLP MoGNN MRP MSE NL-RIM NMSE NN NORM NRW NSR OLS OU PACF PARCH PCP Log-Differenced Logistic Levenberg-Marquardt Algorithm Logarithmic Sigmoid Least Square Error Monthly Month Ahead Mean Absolute Error Mean Absolute Percentage Error Manual Feature Extraction Multi-layered Feed Forward Neural Network Mixture of Gaussian NN Mean Reverting Process Mean Squared Error Non-linear Relative Inventory Model Normalised Mean Squared Error Neural Networks Normalization Naïve Random Walk Noise-to-Signal Ratio Ordinary Least Square Ornstein-Uhlenbeck Model Partial Autocorrelation Function Power ARCH Percentage of Correct Predictions xix

5 PGRP PMI PR PRMS RBF RecS RM RMA RMS RMSE RNN RS RT RW S-SVM SA Sig SM SMAPE SMP SNR SoMLP SP SR SSE Persian Gulf Region Prices Partial Mutual Information Prediction Rate Pattern Modelling in Recognition System Approach Radial Basis Function Recursive Strategy Regression Model Relative Change of Moving Average Regime Markov Switching Stochastic Volatility Model Root Mean Squared Error Recurrent Neural Network Regime Switching Return Transformation Random Walk Standard SVM Step Ahead Sigmoid Stochastic Model Symmetric MAPE Smoothing Procedure Signal-to-Noise Ratio Self-organizing MLP Spot Prices Scaling Range Sum of Square Error xx

6 STEO SVM SVR TE TGARCH TM TPA TSig TSK VaR VECM W WA WANG WCI WDE WNN WSP WT WTI EIA s Short-Term Energy Outlook Econometric Model Support Vector Machine Support Vector Regression Trial and Error Method Threshold GARCH Text Mining Time Period Ahead Tangent Sigmoid Takagi-Sugano-Kang Value-at-Risk Model Vector Error Correction Model Weekly Week Ahead AI framework of Wang et al. Without Crisis Index Wavelet Decomposition Ensemble Wavelet Neural Network Without Smoothing Procedure Wavelet Transform West Texas Intermediate Crude Oil Market xxi

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso xsu@utep.edu Fall, 2018 Outline Introduction A Brief History ANN Architecture Terminology

More information

Pattern Recognition and Machine Learning

Pattern Recognition and Machine Learning Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability

More information

SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal

SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal Volume-03 Issue-07 July-2018 ISSN: 2455-3085 (Online) www.rrjournals.com [UGC Listed Journal] SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal *1 Kadek Jemmy Waciko & 2 Ismail B *1 Research Scholar,

More information

Volatility. Gerald P. Dwyer. February Clemson University

Volatility. Gerald P. Dwyer. February Clemson University Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use

More information

FORECASTING OF INFLATION IN BANGLADESH USING ANN MODEL

FORECASTING OF INFLATION IN BANGLADESH USING ANN MODEL FORECASTING OF INFLATION IN BANGLADESH USING ANN MODEL Rumana Hossain Department of Physical Science School of Engineering and Computer Science Independent University, Bangladesh Shaukat Ahmed Department

More information

Introduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017

Introduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017 Introduction to Regression Analysis Dr. Devlina Chatterjee 11 th August, 2017 What is regression analysis? Regression analysis is a statistical technique for studying linear relationships. One dependent

More information

PATTERN CLASSIFICATION

PATTERN CLASSIFICATION PATTERN CLASSIFICATION Second Edition Richard O. Duda Peter E. Hart David G. Stork A Wiley-lnterscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane Singapore Toronto CONTENTS

More information

Heteroskedasticity in Time Series

Heteroskedasticity in Time Series Heteroskedasticity in Time Series Figure: Time Series of Daily NYSE Returns. 206 / 285 Key Fact 1: Stock Returns are Approximately Serially Uncorrelated Figure: Correlogram of Daily Stock Market Returns.

More information

A new method for short-term load forecasting based on chaotic time series and neural network

A new method for short-term load forecasting based on chaotic time series and neural network A new method for short-term load forecasting based on chaotic time series and neural network Sajjad Kouhi*, Navid Taghizadegan Electrical Engineering Department, Azarbaijan Shahid Madani University, Tabriz,

More information

Frequency Forecasting using Time Series ARIMA model

Frequency Forecasting using Time Series ARIMA model Frequency Forecasting using Time Series ARIMA model Manish Kumar Tikariha DGM(O) NSPCL Bhilai Abstract In view of stringent regulatory stance and recent tariff guidelines, Deviation Settlement mechanism

More information

A Wavelet Neural Network Forecasting Model Based On ARIMA

A Wavelet Neural Network Forecasting Model Based On ARIMA A Wavelet Neural Network Forecasting Model Based On ARIMA Wang Bin*, Hao Wen-ning, Chen Gang, He Deng-chao, Feng Bo PLA University of Science &Technology Nanjing 210007, China e-mail:lgdwangbin@163.com

More information

Electricity price forecasting in Turkey with artificial neural network models

Electricity price forecasting in Turkey with artificial neural network models Electricity price forecasting in Turkey with artificial neural network models AUTHORS ARTICLE INFO DOI JOURNAL Fazıl Gökgöz Fahrettin Filiz Fazıl Gökgöz and Fahrettin Filiz (2016). Electricity price forecasting

More information

Evolutionary Functional Link Interval Type-2 Fuzzy Neural System for Exchange Rate Prediction

Evolutionary Functional Link Interval Type-2 Fuzzy Neural System for Exchange Rate Prediction Evolutionary Functional Link Interval Type-2 Fuzzy Neural System for Exchange Rate Prediction 3. Introduction Currency exchange rate is an important element in international finance. It is one of the chaotic,

More information

Stochastic Volatility Models with Auto-regressive Neural Networks

Stochastic Volatility Models with Auto-regressive Neural Networks AUSTRALIAN NATIONAL UNIVERSITY PROJECT REPORT Stochastic Volatility Models with Auto-regressive Neural Networks Author: Aditya KHAIRE Supervisor: Adj/Prof. Hanna SUOMINEN CoSupervisor: Dr. Young LEE A

More information

A Wavelet Based Prediction Method for Time Series

A Wavelet Based Prediction Method for Time Series Cristina Stolojescu Alexandru Isar Politehnica University Timisoara, Romania Ion Railean Technical University Cluj-Napoca, Romania Sorin Moga Philippe Lenca Institut TELECOM, TELECOM Bretagne, France Stochastic

More information

Data Mining (Mineria de Dades)

Data Mining (Mineria de Dades) Data Mining (Mineria de Dades) Lluís A. Belanche belanche@lsi.upc.edu Soft Computing Research Group Dept. de Llenguatges i Sistemes Informàtics (Software department) Universitat Politècnica de Catalunya

More information

Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function.

Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Bayesian learning: Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Let y be the true label and y be the predicted

More information

Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine

Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Song Li 1, Peng Wang 1 and Lalit Goel 1 1 School of Electrical and Electronic Engineering Nanyang Technological University

More information

ECE521 Lectures 9 Fully Connected Neural Networks

ECE521 Lectures 9 Fully Connected Neural Networks ECE521 Lectures 9 Fully Connected Neural Networks Outline Multi-class classification Learning multi-layer neural networks 2 Measuring distance in probability space We learnt that the squared L2 distance

More information

Longshore current velocities prediction: using a neural networks approach

Longshore current velocities prediction: using a neural networks approach Coastal Processes II 189 Longshore current velocities prediction: using a neural networks approach T. M. Alaboud & M. S. El-Bisy Civil Engineering Dept., College of Engineering and Islamic Architecture,

More information

Wind Energy Predictions of Small-Scale Turbine Output Using Exponential Smoothing and Feed- Forward Neural Network

Wind Energy Predictions of Small-Scale Turbine Output Using Exponential Smoothing and Feed- Forward Neural Network Wind Energy Predictions of Small-Scale Turbine Output Using Exponential Smoothing and Feed- Forward Neural Network Zaccheus O. Olaofe 1, 2 1 ZakkWealth Energy 2 Faculty of Engineering and Built Environment,

More information

Machine Learning and Data Mining. Multi-layer Perceptrons & Neural Networks: Basics. Prof. Alexander Ihler

Machine Learning and Data Mining. Multi-layer Perceptrons & Neural Networks: Basics. Prof. Alexander Ihler + Machine Learning and Data Mining Multi-layer Perceptrons & Neural Networks: Basics Prof. Alexander Ihler Linear Classifiers (Perceptrons) Linear Classifiers a linear classifier is a mapping which partitions

More information

CS6220: DATA MINING TECHNIQUES

CS6220: DATA MINING TECHNIQUES CS6220: DATA MINING TECHNIQUES Matrix Data: Prediction Instructor: Yizhou Sun yzsun@ccs.neu.edu September 14, 2014 Today s Schedule Course Project Introduction Linear Regression Model Decision Tree 2 Methods

More information

CS6220: DATA MINING TECHNIQUES

CS6220: DATA MINING TECHNIQUES CS6220: DATA MINING TECHNIQUES Matrix Data: Prediction Instructor: Yizhou Sun yzsun@ccs.neu.edu September 21, 2015 Announcements TA Monisha s office hour has changed to Thursdays 10-12pm, 462WVH (the same

More information

A Comparison of the Forecast Performance of. Double Seasonal ARIMA and Double Seasonal. ARFIMA Models of Electricity Load Demand

A Comparison of the Forecast Performance of. Double Seasonal ARIMA and Double Seasonal. ARFIMA Models of Electricity Load Demand Applied Mathematical Sciences, Vol. 6, 0, no. 35, 6705-67 A Comparison of the Forecast Performance of Double Seasonal ARIMA and Double Seasonal ARFIMA Models of Electricity Load Demand Siti Normah Hassan

More information

Machine Learning for Large-Scale Data Analysis and Decision Making A. Neural Networks Week #6

Machine Learning for Large-Scale Data Analysis and Decision Making A. Neural Networks Week #6 Machine Learning for Large-Scale Data Analysis and Decision Making 80-629-17A Neural Networks Week #6 Today Neural Networks A. Modeling B. Fitting C. Deep neural networks Today s material is (adapted)

More information

AN INTERACTIVE WAVELET ARTIFICIAL NEURAL NETWORK IN TIME SERIES PREDICTION

AN INTERACTIVE WAVELET ARTIFICIAL NEURAL NETWORK IN TIME SERIES PREDICTION AN INTERACTIVE WAVELET ARTIFICIAL NEURAL NETWORK IN TIME SERIES PREDICTION 1 JAIRO MARLON CORRÊA, 2 ANSELMO CHAVES NETO, 3 LUIZ ALBINO TEIXEIRA JÚNIOR, 4 SAMUEL BELLIDO RODRIGUES, 5 EDGAR MANUEL CARREÑO

More information

Deep Feedforward Networks

Deep Feedforward Networks Deep Feedforward Networks Liu Yang March 30, 2017 Liu Yang Short title March 30, 2017 1 / 24 Overview 1 Background A general introduction Example 2 Gradient based learning Cost functions Output Units 3

More information

Deep Feedforward Networks

Deep Feedforward Networks Deep Feedforward Networks Liu Yang March 30, 2017 Liu Yang Short title March 30, 2017 1 / 24 Overview 1 Background A general introduction Example 2 Gradient based learning Cost functions Output Units 3

More information

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis

More information

Forecasting ozone concentration levels using Box-Jenkins ARIMA modelling and artificial neural networks: a comparative study

Forecasting ozone concentration levels using Box-Jenkins ARIMA modelling and artificial neural networks: a comparative study MATEMATIKA, 2017, Volume 33, Number 2, 119 130 c Penerbit UTM Press. All rights reserved Forecasting ozone concentration levels using Box-Jenkins ARIMA modelling and artificial neural networks: a comparative

More information

Application of an Artificial Neural Network Based Tool for Prediction of Pavement Performance

Application of an Artificial Neural Network Based Tool for Prediction of Pavement Performance 0 0 0 0 Application of an Artificial Neural Network Based Tool for Prediction of Pavement Performance Adelino Ferreira, Rodrigo Cavalcante Pavement Mechanics Laboratory, Research Center for Territory,

More information

New Introduction to Multiple Time Series Analysis

New Introduction to Multiple Time Series Analysis Helmut Lütkepohl New Introduction to Multiple Time Series Analysis With 49 Figures and 36 Tables Springer Contents 1 Introduction 1 1.1 Objectives of Analyzing Multiple Time Series 1 1.2 Some Basics 2

More information

Wavelet Neural Networks for Nonlinear Time Series Analysis

Wavelet Neural Networks for Nonlinear Time Series Analysis Applied Mathematical Sciences, Vol. 4, 2010, no. 50, 2485-2495 Wavelet Neural Networks for Nonlinear Time Series Analysis K. K. Minu, M. C. Lineesh and C. Jessy John Department of Mathematics National

More information

Solar Nowcasting with Cluster-based Detrending

Solar Nowcasting with Cluster-based Detrending Solar Nowcasting with Cluster-based Detrending Antonio Sanfilippo, Luis Pomares, Daniel Perez-Astudillo, Nassma Mohandes, Dunia Bachour ICEM 2017 Oral Presentation 26-29June 2017, Bari, Italy Overview

More information

CS:4420 Artificial Intelligence

CS:4420 Artificial Intelligence CS:4420 Artificial Intelligence Spring 2018 Neural Networks Cesare Tinelli The University of Iowa Copyright 2004 18, Cesare Tinelli and Stuart Russell a a These notes were originally developed by Stuart

More information

Neural Networks and the Back-propagation Algorithm

Neural Networks and the Back-propagation Algorithm Neural Networks and the Back-propagation Algorithm Francisco S. Melo In these notes, we provide a brief overview of the main concepts concerning neural networks and the back-propagation algorithm. We closely

More information

Explanatory Information Analysis for Day-Ahead Price Forecasting in the Iberian Electricity Market

Explanatory Information Analysis for Day-Ahead Price Forecasting in the Iberian Electricity Market Energies 2015, 8, 10464-10486; doi:10.3390/en80910464 Article OPEN ACCESS energies ISSN 1996-1073 www.mdpi.com/journal/energies Explanatory Information Analysis for Day-Ahead Price Forecasting in the Iberian

More information

Machine Learning Lecture 7

Machine Learning Lecture 7 Course Outline Machine Learning Lecture 7 Fundamentals (2 weeks) Bayes Decision Theory Probability Density Estimation Statistical Learning Theory 23.05.2016 Discriminative Approaches (5 weeks) Linear Discriminant

More information

BDS ANFIS ANFIS ARMA

BDS ANFIS ANFIS ARMA * Saarman@yahoocom Ali_r367@yahoocom 0075 07 MGN G7 C5 C58 C53 JEL 3 7 TAR 6 ARCH Chaos Theory Deterministic 3 Exponential Smoothing Autoregressive Integrated Moving Average 5 Autoregressive Conditional

More information

ECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications

ECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications ECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications Yongmiao Hong Department of Economics & Department of Statistical Sciences Cornell University Spring 2019 Time and uncertainty

More information

HYBRID PREDICTION MODEL FOR SHORT TERM WIND SPEED FORECASTING

HYBRID PREDICTION MODEL FOR SHORT TERM WIND SPEED FORECASTING HYBRID PREDICTION MODEL FOR SHORT TERM WIND SPEED FORECASTING M. C. Lavanya and S. Lakshmi Department of Electronics and Communication, Sathyabama University, Chennai, India E-Mail: mclavanyabe@gmail.com

More information

Introduction to ARMA and GARCH processes

Introduction to ARMA and GARCH processes Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,

More information

Forecasting exchange rate volatility using conditional variance models selected by information criteria

Forecasting exchange rate volatility using conditional variance models selected by information criteria Forecasting exchange rate volatility using conditional variance models selected by information criteria Article Accepted Version Brooks, C. and Burke, S. (1998) Forecasting exchange rate volatility using

More information

Midterm Review CS 6375: Machine Learning. Vibhav Gogate The University of Texas at Dallas

Midterm Review CS 6375: Machine Learning. Vibhav Gogate The University of Texas at Dallas Midterm Review CS 6375: Machine Learning Vibhav Gogate The University of Texas at Dallas Machine Learning Supervised Learning Unsupervised Learning Reinforcement Learning Parametric Y Continuous Non-parametric

More information

Time Series and Forecasting

Time Series and Forecasting Time Series and Forecasting Introduction to Forecasting n What is forecasting? n Primary Function is to Predict the Future using (time series related or other) data we have in hand n Why are we interested?

More information

Development of New Models Using Machine Learning Methods Combined with Different Time Lags for Network Traffic Forecasting. Dissertation.

Development of New Models Using Machine Learning Methods Combined with Different Time Lags for Network Traffic Forecasting. Dissertation. Development of New Models Using Machine Learning Methods Combined with Different Time Lags for Network Traffic Forecasting Derman Akgöl Mehmet Fatih Akay (advisor) DISSERTATION.COM Irvine, California Boca

More information

A Hybrid Time-delay Prediction Method for Networked Control System

A Hybrid Time-delay Prediction Method for Networked Control System International Journal of Automation and Computing 11(1), February 2014, 19-24 DOI: 10.1007/s11633-014-0761-1 A Hybrid Time-delay Prediction Method for Networked Control System Zhong-Da Tian Xian-Wen Gao

More information

Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters

Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters Kyriaki Kitikidou, Elias Milios, Lazaros Iliadis, and Minas Kaymakis Democritus University of Thrace,

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

Neural Networks. Intro to AI Bert Huang Virginia Tech

Neural Networks. Intro to AI Bert Huang Virginia Tech Neural Networks Intro to AI Bert Huang Virginia Tech Outline Biological inspiration for artificial neural networks Linear vs. nonlinear functions Learning with neural networks: back propagation https://en.wikipedia.org/wiki/neuron#/media/file:chemical_synapse_schema_cropped.jpg

More information

Predicting Wheat Production in Iran Using an Artificial Neural Networks Approach

Predicting Wheat Production in Iran Using an Artificial Neural Networks Approach Predicting Wheat Production in Iran Using an Artificial Neural Networks Approach Reza Ghodsi, Ruzbeh Mirabdollah Yani, Rana Jalali, Mahsa Ruzbahman Industrial Engineering Department, University of Tehran,

More information

Linear Classification. CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington

Linear Classification. CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington Linear Classification CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 Example of Linear Classification Red points: patterns belonging

More information

NONLINEAR CLASSIFICATION AND REGRESSION. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition

NONLINEAR CLASSIFICATION AND REGRESSION. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition NONLINEAR CLASSIFICATION AND REGRESSION Nonlinear Classification and Regression: Outline 2 Multi-Layer Perceptrons The Back-Propagation Learning Algorithm Generalized Linear Models Radial Basis Function

More information

Numerical Learning Algorithms

Numerical Learning Algorithms Numerical Learning Algorithms Example SVM for Separable Examples.......................... Example SVM for Nonseparable Examples....................... 4 Example Gaussian Kernel SVM...............................

More information

TIME SERIES DATA ANALYSIS USING EVIEWS

TIME SERIES DATA ANALYSIS USING EVIEWS TIME SERIES DATA ANALYSIS USING EVIEWS I Gusti Ngurah Agung Graduate School Of Management Faculty Of Economics University Of Indonesia Ph.D. in Biostatistics and MSc. in Mathematical Statistics from University

More information

A Hybrid Wavelet Analysis and Adaptive. Neuro-Fuzzy Inference System. for Drought Forecasting

A Hybrid Wavelet Analysis and Adaptive. Neuro-Fuzzy Inference System. for Drought Forecasting Applied Mathematical Sciences, Vol. 8, 4, no. 39, 699-698 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.988/ams.4.4863 A Hybrid Wavelet Analysis and Adaptive Neuro-Fuzzy Inference System for Drought

More information

Dr SN Singh, Professor Department of Electrical Engineering. Indian Institute of Technology Kanpur

Dr SN Singh, Professor Department of Electrical Engineering. Indian Institute of Technology Kanpur Short Term Load dforecasting Dr SN Singh, Professor Department of Electrical Engineering Indian Institute of Technology Kanpur Email: snsingh@iitk.ac.in Basic Definition of Forecasting Forecasting is a

More information

Reading Group on Deep Learning Session 1

Reading Group on Deep Learning Session 1 Reading Group on Deep Learning Session 1 Stephane Lathuiliere & Pablo Mesejo 2 June 2016 1/31 Contents Introduction to Artificial Neural Networks to understand, and to be able to efficiently use, the popular

More information

A Hybrid Model of Wavelet and Neural Network for Short Term Load Forecasting

A Hybrid Model of Wavelet and Neural Network for Short Term Load Forecasting International Journal of Electronic and Electrical Engineering. ISSN 0974-2174, Volume 7, Number 4 (2014), pp. 387-394 International Research Publication House http://www.irphouse.com A Hybrid Model of

More information

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M. TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION

More information

Deep Neural Networks

Deep Neural Networks Deep Neural Networks DT2118 Speech and Speaker Recognition Giampiero Salvi KTH/CSC/TMH giampi@kth.se VT 2015 1 / 45 Outline State-to-Output Probability Model Artificial Neural Networks Perceptron Multi

More information

SCIENCE & TECHNOLOGY

SCIENCE & TECHNOLOGY Pertanika J. Sci. & Technol. 5 (3): 787-796 (017) SCIENCE & TECHNOLOGY Journal homepage: http://www.pertanika.upm.edu.my/ Combination of Forecasts with an Application to Unemployment Rate Muniroh, M. F.

More information

RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS

RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS CEST2011 Rhodes, Greece Ref no: XXX RAINFALL RUNOFF MODELING USING SUPPORT VECTOR REGRESSION AND ARTIFICIAL NEURAL NETWORKS D. BOTSIS1 1, P. LATINOPOULOS 2 and K. DIAMANTARAS 3 1&2 Department of Civil

More information

Variance stabilization and simple GARCH models. Erik Lindström

Variance stabilization and simple GARCH models. Erik Lindström Variance stabilization and simple GARCH models Erik Lindström Simulation, GBM Standard model in math. finance, the GBM ds t = µs t dt + σs t dw t (1) Solution: S t = S 0 exp ) ) ((µ σ2 t + σw t 2 (2) Problem:

More information

Course in Data Science

Course in Data Science Course in Data Science About the Course: In this course you will get an introduction to the main tools and ideas which are required for Data Scientist/Business Analyst/Data Analyst. The course gives an

More information

Artificial Neural Networks (ANN)

Artificial Neural Networks (ANN) Artificial Neural Networks (ANN) Edmondo Trentin April 17, 2013 ANN: Definition The definition of ANN is given in 3.1 points. Indeed, an ANN is a machine that is completely specified once we define its:

More information

I D I A P. A New Margin-Based Criterion for Efficient Gradient Descent R E S E A R C H R E P O R T. Ronan Collobert * Samy Bengio * IDIAP RR 03-16

I D I A P. A New Margin-Based Criterion for Efficient Gradient Descent R E S E A R C H R E P O R T. Ronan Collobert * Samy Bengio * IDIAP RR 03-16 R E S E A R C H R E P O R T I D I A P A New Margin-Based Criterion for Efficient Gradient Descent Ronan Collobert * Samy Bengio * IDIAP RR 03-16 March 14, 2003 D a l l e M o l l e I n s t i t u t e for

More information

Short Term Solar Radiation Forecast from Meteorological Data using Artificial Neural Network for Yola, Nigeria

Short Term Solar Radiation Forecast from Meteorological Data using Artificial Neural Network for Yola, Nigeria American Journal of Engineering Research (AJER) 017 American Journal of Engineering Research (AJER) eiss: 300847 piss : 300936 Volume6, Issue8, pp8389 www.ajer.org Research Paper Open Access Short Term

More information

Learning From Data Lecture 15 Reflecting on Our Path - Epilogue to Part I

Learning From Data Lecture 15 Reflecting on Our Path - Epilogue to Part I Learning From Data Lecture 15 Reflecting on Our Path - Epilogue to Part I What We Did The Machine Learning Zoo Moving Forward M Magdon-Ismail CSCI 4100/6100 recap: Three Learning Principles Scientist 2

More information

Sample Exam Questions for Econometrics

Sample Exam Questions for Econometrics Sample Exam Questions for Econometrics 1 a) What is meant by marginalisation and conditioning in the process of model reduction within the dynamic modelling tradition? (30%) b) Having derived a model for

More information

Kalman Filter and SVR Combinations in Forecasting US Unemployment

Kalman Filter and SVR Combinations in Forecasting US Unemployment Kalman Filter and SVR Combinations in Forecasting US Unemployment Georgios Sermpinis 1, Charalampos Stasinakis 1, and Andreas Karathanasopoulos 2 1 University of Glasgow Business School georgios.sermpinis@glasgow.ac.uk,

More information

Financial Econometrics Using Stata

Financial Econometrics Using Stata Financial Econometrics Using Stata SIMONA BOFFELLI University of Bergamo (Italy) and Centre for Econometric Analysis, Cass Business School, City University London (UK) GIOVANNI URGA Centre for Econometric

More information

An artificial neural network hybrid with wavelet transform for short-term wind speed forecasting: A preliminary case study

An artificial neural network hybrid with wavelet transform for short-term wind speed forecasting: A preliminary case study An artificial neural network hybrid with wavelet transform for short-term wind speed forecasting: A preliminary case study Moslem Yousefi *,1, Danial Hooshyar 2, Milad Yousefi 3 1 Center for Advanced Mechatronics

More information

Machine Learning. Boris

Machine Learning. Boris Machine Learning Boris Nadion boris@astrails.com @borisnadion @borisnadion boris@astrails.com astrails http://astrails.com awesome web and mobile apps since 2005 terms AI (artificial intelligence)

More information

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92 BIOLOGICAL INSPIRATIONS Some numbers The human brain contains about 10 billion nerve cells (neurons) Each neuron is connected to the others through 10000

More information

Nonparametric Bayesian Methods - Lecture I

Nonparametric Bayesian Methods - Lecture I Nonparametric Bayesian Methods - Lecture I Harry van Zanten Korteweg-de Vries Institute for Mathematics CRiSM Masterclass, April 4-6, 2016 Overview of the lectures I Intro to nonparametric Bayesian statistics

More information

Statistical Machine Learning from Data

Statistical Machine Learning from Data January 17, 2006 Samy Bengio Statistical Machine Learning from Data 1 Statistical Machine Learning from Data Multi-Layer Perceptrons Samy Bengio IDIAP Research Institute, Martigny, Switzerland, and Ecole

More information

ESTIMATION OF HOURLY MEAN AMBIENT TEMPERATURES WITH ARTIFICIAL NEURAL NETWORKS 1. INTRODUCTION

ESTIMATION OF HOURLY MEAN AMBIENT TEMPERATURES WITH ARTIFICIAL NEURAL NETWORKS 1. INTRODUCTION Mathematical and Computational Applications, Vol. 11, No. 3, pp. 215-224, 2006. Association for Scientific Research ESTIMATION OF HOURLY MEAN AMBIENT TEMPERATURES WITH ARTIFICIAL NEURAL NETWORKS Ömer Altan

More information

Deep Learning Architecture for Univariate Time Series Forecasting

Deep Learning Architecture for Univariate Time Series Forecasting CS229,Technical Report, 2014 Deep Learning Architecture for Univariate Time Series Forecasting Dmitry Vengertsev 1 Abstract This paper studies the problem of applying machine learning with deep architecture

More information

A hybrid model of stock price prediction based on the PCA-ARIMA-BP

A hybrid model of stock price prediction based on the PCA-ARIMA-BP ANZIAM J. 58 (E) pp.e162 E178, 2017 E162 A hybrid model of stock price prediction based on the PCA-ARIMA-BP Hua Luo 1 Shuang Wang 2 (Received 13 June 2016; revised 17 February 2017) Abstract A pca-arima-bp

More information

Lecture 9: Markov Switching Models

Lecture 9: Markov Switching Models Lecture 9: Markov Switching Models Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Defining a Markov Switching VAR model Structure and mechanics of Markov Switching: from

More information

Midterm Review CS 7301: Advanced Machine Learning. Vibhav Gogate The University of Texas at Dallas

Midterm Review CS 7301: Advanced Machine Learning. Vibhav Gogate The University of Texas at Dallas Midterm Review CS 7301: Advanced Machine Learning Vibhav Gogate The University of Texas at Dallas Supervised Learning Issues in supervised learning What makes learning hard Point Estimation: MLE vs Bayesian

More information

Prediction of Hourly Solar Radiation in Amman-Jordan by Using Artificial Neural Networks

Prediction of Hourly Solar Radiation in Amman-Jordan by Using Artificial Neural Networks Int. J. of Thermal & Environmental Engineering Volume 14, No. 2 (2017) 103-108 Prediction of Hourly Solar Radiation in Amman-Jordan by Using Artificial Neural Networks M. A. Hamdan a*, E. Abdelhafez b

More information

Chapter 4 Neural Networks in System Identification

Chapter 4 Neural Networks in System Identification Chapter 4 Neural Networks in System Identification Gábor HORVÁTH Department of Measurement and Information Systems Budapest University of Technology and Economics Magyar tudósok körútja 2, 52 Budapest,

More information

Short-Term Forecasting of Electric Loads Using Nonlinear Autoregressive Artificial Neural Networks with Exogenous Vector Inputs

Short-Term Forecasting of Electric Loads Using Nonlinear Autoregressive Artificial Neural Networks with Exogenous Vector Inputs Article Short-Term Forecasting of Electric Loads Using Nonlinear Autoregressive Artificial Neural Networks with Exogenous Vector Inputs Jaime Buitrago, and Shihab Asfour *, University of Miami, Department

More information

MGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong

MGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example

More information

Univariate ARIMA Models

Univariate ARIMA Models Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.

More information

Data Fitting and Uncertainty

Data Fitting and Uncertainty TiloStrutz Data Fitting and Uncertainty A practical introduction to weighted least squares and beyond With 124 figures, 23 tables and 71 test questions and examples VIEWEG+ TEUBNER IX Contents I Framework

More information

A survey on data mining techniques applied to energy time series forecasting

A survey on data mining techniques applied to energy time series forecasting See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/283513131 A survey on data mining techniques applied to energy time series forecasting ARTICLE

More information

WEATHER DEPENENT ELECTRICITY MARKET FORECASTING WITH NEURAL NETWORKS, WAVELET AND DATA MINING TECHNIQUES. Z.Y. Dong X. Li Z. Xu K. L.

WEATHER DEPENENT ELECTRICITY MARKET FORECASTING WITH NEURAL NETWORKS, WAVELET AND DATA MINING TECHNIQUES. Z.Y. Dong X. Li Z. Xu K. L. WEATHER DEPENENT ELECTRICITY MARKET FORECASTING WITH NEURAL NETWORKS, WAVELET AND DATA MINING TECHNIQUES Abstract Z.Y. Dong X. Li Z. Xu K. L. Teo School of Information Technology and Electrical Engineering

More information

Improving Performance of Conceptual Flood Forecasting Model Using Complementary Error Model

Improving Performance of Conceptual Flood Forecasting Model Using Complementary Error Model Improving Performance of Conceptual Flood Forecasting Model Using Complementary Error Model Dilip K. Gautam and Sumit Dugar Practical Action Consulting South Asia Kathmandu, Nepal International Conference

More information

COMPUTATIONAL MODELING OF ELECTRICITY CONSUMPTION USING ECONOMETRIC VARIABLES BASED ON NEURAL NETWORK TRAINING ALGORITHMS

COMPUTATIONAL MODELING OF ELECTRICITY CONSUMPTION USING ECONOMETRIC VARIABLES BASED ON NEURAL NETWORK TRAINING ALGORITHMS COMPUTATIONAL MODELING OF ELECTRICITY CONSUMPTION USING ECONOMETRIC VARIABLES BASED ON NEURAL NETWORK TRAINING ALGORITHMS T.M. Usha, S. Appavu alias Balamurugan Abstract: Recently, there has been a significant

More information

Deep learning / Ian Goodfellow, Yoshua Bengio and Aaron Courville. - Cambridge, MA ; London, Spis treści

Deep learning / Ian Goodfellow, Yoshua Bengio and Aaron Courville. - Cambridge, MA ; London, Spis treści Deep learning / Ian Goodfellow, Yoshua Bengio and Aaron Courville. - Cambridge, MA ; London, 2017 Spis treści Website Acknowledgments Notation xiii xv xix 1 Introduction 1 1.1 Who Should Read This Book?

More information

A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation

A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation A Novel 2-D Model Approach for the Prediction of Hourly Solar Radiation F Onur Hocao glu, Ö Nezih Gerek, and Mehmet Kurban Anadolu University, Dept of Electrical and Electronics Eng, Eskisehir, Turkey

More information

Multilayer Perceptron

Multilayer Perceptron Outline Hong Chang Institute of Computing Technology, Chinese Academy of Sciences Machine Learning Methods (Fall 2012) Outline Outline I 1 Introduction 2 Single Perceptron 3 Boolean Function Learning 4

More information

A new approach for Baltic Dry Index forecasting based on empirical mode decomposition and neural networks

A new approach for Baltic Dry Index forecasting based on empirical mode decomposition and neural networks Original Article A new approach for Baltic Dry Index forecasting based on empirical mode decomposition and neural networks Qingcheng Zeng a, Chenrui Qu a,adolfk.y.ng b and Xiaofeng Zhao a a School of Transportation

More information

Short-term wind forecasting using artificial neural networks (ANNs)

Short-term wind forecasting using artificial neural networks (ANNs) Energy and Sustainability II 197 Short-term wind forecasting using artificial neural networks (ANNs) M. G. De Giorgi, A. Ficarella & M. G. Russo Department of Engineering Innovation, Centro Ricerche Energia

More information

Speaker Representation and Verification Part II. by Vasileios Vasilakakis

Speaker Representation and Verification Part II. by Vasileios Vasilakakis Speaker Representation and Verification Part II by Vasileios Vasilakakis Outline -Approaches of Neural Networks in Speaker/Speech Recognition -Feed-Forward Neural Networks -Training with Back-propagation

More information

ECE662: Pattern Recognition and Decision Making Processes: HW TWO

ECE662: Pattern Recognition and Decision Making Processes: HW TWO ECE662: Pattern Recognition and Decision Making Processes: HW TWO Purdue University Department of Electrical and Computer Engineering West Lafayette, INDIANA, USA Abstract. In this report experiments are

More information