One step ahead prediction using Fuzzy Boolean Neural Networks 1
|
|
- Rolf Perkins
- 5 years ago
- Views:
Transcription
1 One ste ahead rediction using Fuzzy Boolean eural etworks 1 José A. B. Tomé IESC-ID, IST Rua Alves Redol, Lisboa jose.tome@inesc-id.t João Paulo Carvalho IESC-ID, IST Rua Alves Redol, Lisboa joao.carvalho@inesc-id.t Abstract Time series rediction is a roblem with a wide range of alications, including energy systems lanning, currency forecasting, stock exchange oerations or traffic rediction. Accordingly, a number of different rediction aroaches have been roosed such as linear models, Feedforward eural network models, Recurrent eural networks or Fuzzy eural Models. In this aer one resents a rediction model based on fuzzy rules that relate ast data values with the next unknown value to be estimated. A Fuzzy Boolean eural etwork has been used for that urose and the laser data set of the Santa Fe contest has been used for illustration urose. The results turned to be encouraging when comared with other ublished methods. Keywords: Time Series Prediction, Fuzzy eural ets. 1 Introduction Many ractical rediction roblems, such as stock exchange, traffic or water stream flow forecast, are satisfied with a one ste ahead rediction. That is, in this tye of roblems one aims to estimate a time series value v t given ast values v t-1, v t-2,, v t-k, their sloes or other simle functions of these values. Traditionally, most techniques to model this tye of time series assume linear relationshis among the variables, as AR models based on the Box and Jenkins method [1], [5]. on-linear models have also been used, mostly based on neural network architectures both feed forward [3] and recurrent [2], but also using fuzzy concets [4]. In this aer one introduces a new rediction model based on Fuzzy Boolean eural etworks (FB), which have been reviously been resented as ets caable of learning qualitative rules and of reasoning using those rules [10], [11]. The idea behind this aroach is that one-ste ahead rediction is nothing more that reasoning about the next value from assed values, assuming the variable behaviour can be described by a set of qualitative rules. In order to test such a conjecture one has chosen a well-known and studied roblem, which is the estimation of a time series obtained from laser data, the so called data set A from the Santa Fe contest on revision [14]. Section II resents the FB s architecture, with details about its learning and fuzzy reasoning caabilities. Section III addresses the alication details of FB s to time series rediction and a study on the effect of various net arameters on the net erformance for laser data examle. Section IV concludes and discusses some issues that deserve further attention, such as the ossibility to understand the et results, through the fuzzy rules results. 1 This work is artially suorted by the FCT - Portuguese Foundation for Science and Technology under roject POSI/SRI/47188/
2 2 Fuzzy Boolean ets Fuzzy Boolean ets [10] are insired on natural neural systems, in which neurons are of the tye on/off and where activity of concets/variables is given by the rate of activated (firing) neurons on the corresonding neural areas. In such nets every neuron of a consequent variable or concet has the caability to memorize an individual and very simle (binary) vision of each one of the ossible qualitative rules. In this model fuzziness is an inherent emerging roerty that can be derived from the network behaviour. A very interesting roerty of the model concerns its robustness, in the sense that it is immune to individual neuron or connection errors, which is not the case of other models, such as the classic artificial neural nets. The architecture of the model is anchored in cards/areas of neurons. Meshes of weightless connections between antecedent neuron oututs and consequent neuron inuts link antecedent to consequent areas. Individual connections are random and neurons are binary, both in which concerns inuts and oututs. euron s internal unitary memories are rovided, however, with a third state in addition to the classical 1 and 0, with the objective of identifying not taught situations. To each area a concet or variable is associated and the value of that concet or variable, when stimulated, is given by the activation ratio of that area (that is, the relation between activated -outut 1 - neurons and the total number of neurons). Basically, each consequent neuron samles the antecedent saces using for each antecedent a limited number (say m) of their neuron s oututs as its own inuts, being this number, m, much smaller then the number of neurons er area. This means that for rules with - antecedent/1-consequent each neuron has.m inuts. The oerations carried out by each neuron are just the combinatorial count of the number of activated inuts from every antecedent. They are erformed with the classic Boolean oerations (AD, OR), using as oerands the inuts coming from antecedents and the Boolean internal state variables that are established during a teaching hase. It has been roved [10] that, from these micro oerations (that is, on individual neurons using local and limited information), it emerges a global or macro qualitative reasoning caability on the concets, which can be exressed on the form of rules of tye: IF Antecedent1 is A1 AD Antecedent2 is A2 AD.THE Consequent is Ci, In the exression, Antecedent1, Antecedent2,.., Consequent are variables or concets and A1, A2;, Ci are linguistic terms (or fuzzy sets) of these variables (such as, small, high, etc.). The roof [10] is achieved through the interretation made to the relationshi between antecedent and consequent activation ratios. The consequent activation ratio is given by: L 1 L 1... ( k1= 0 k= 0 i = 1 m.i qi.(1 i) m qi.r(q1,...,q)) qi qi Ski (1) In this exression L is the number of subsets of counts (each one a set of consecutive integers {0,1,, m}), Ski are those sets, qi reresents every ossible number of activated inuts on antecedent i belonging to the set indexed by ki, i are the antecedent activation ratios of area i and r(q1,.,qn) are activation ratios of the internal binary memories (measured through every neuron), which have been established during the teaching hase. It is suosed that each neuron has one element of binary memory (with additional caability of memorizing if it has or not been taught) er set of counts on the antecedent inuts, (each set reresented by the set of q1 Sk 1 activated inuts on antecedent1,..., and qn Skn activated inuts on antecedent n). Taking the inner sum above to the outside and considering each count individually rather than on sets Ski, the following exression is obtained: m m Π.. i1= 0 i= 0 j= 1 m ( ) ij m ij j ) j.(1.r(i1,.., i) ij (2) This equation reresents at the macroscoic/network level an emergent behaviour, which can be viewed as a fuzzy qualitative reasoning that has been obtained from the microscoic neural oerations defined above. In order to establish this fuzzy reasoning, the algebraic roduct and the bounded sum are interreted resectively as the t-norm and t- conorm fuzzy oerations. To this urose the equations above should be interreted as follows [10]: 501
3 Inut variables, the activation ratios j, are fuzzified through binomial membershi functions of the form m ij m ij j.(1 j) ij. The evaluation of the exression for a given j reresents the membershi degree of j in that fuzzy set. The roduct of the terms, the Π, reresents the j= 1 fuzzy intersection of the antecedents (i=1,), by definition of the above t-norm. Considering the consequent fuzzy sets as singletons (amlitude "1") at the consequent UD values (i1,..,i), it follows that the equations reresent the defuzzification by the Centre of Area method [10]. During the learning hase the network is submitted to a collection of exeriments that will set or reset the individual neuron s binary memories and will establish the r(i1,...,i) robabilities in the above exression (1). For each exeriment, a different inut configuration (defined by the inut areas secific samles) is resented to each and every one of the consequent neurons. This configuration addresses one and only one the internal binary memories of each individual neuron. Udating of each binary memory value deends on its selection (or not) and on the logic value of the consequent neuron. This may be considered a Hebbian tye of learning [6] if re and ost-synatic activities are given by the activation ratios: j for antecedent area j and out for the consequent area. For each neuron, the m+1 different counts are the meaningful arameters to take into account for re synatic activity of one antecedent. Thus, in a given exeriment, the correlation between osterior synase activity ( out) and re synatic activity -the robability of activating a given decoder outut d(i 1,..i ), corresonding to i 1 activated inuts on antecedent area 1,, i activated inuts on area, - can be reresented by the robability of activating the different binary unitary memories. In ractical terms, for each teaching exeriment and for each consequent neuron, the state of binary memory ff( i1,..., i ) is decided by, and only by, the Boolean values of decoder outut d(i 1,..., i ) and of the outut neuron state considered. Considering then the r(k1,...,k),in exression (2), as the synatic strengths, one may have different learning tyes, deending on how they are udated. Here, one is considering the interesting case when non-selected binary memories maintain their state and selected binary memories take the value of consequent neuron, which corresonds to a kind of Grossberg based learning. It corresonds to the following udating equation (where indexes are not reresented and is used in lace of r, for simlicity) and where P a is the robability of activating, in the exeriment, the decoder outut associated with and out the robability of one consequent neuron to be activated: (t+1)-(t) = P a. ( out - (t)). (3) It can be roved [11] that the network converges to any taught rule. More secifically, it may be concluded that with a set of coherent exeriments -teaching the same rule- it will aroach the taught value P out roortionally to the distance between the resent value of and P out itself, that is, with aroaching zero decreasing stes. Moreover, it has been roved [12] that the et is caable of learning a set of different rules without cross-influence between different rules, and that the number of distinct rules that the system can effectively distinguish (in terms of different consequent terms) increases with the square root of the number m. This is an interesting result, since it should be verified in animal brains, that is, the number of synases coming from a given concet area is exected, according this simle model, to be at least of the order of the square of the different linguistic terms on the consequent. Finally, it has also been roved that this model is a Universal Aroximator [11], since it theoretically imlements a Parzen Window estimator [9]. This means that these networks are caable to imlement (aroximate) any ossible multi-inut single-outut function of the tye: [0,1] n [0,1]. These results give the theoretical background to establish the caability of these simle binary networks to erform reasoning and effective learning based on real exeriments. The model can also be viewed as a natural alication of the aradigm of comuting with words. Since the nets resent toologic similarities with natural systems and resent also some of their imortant roerties, it may be hyothesized that it may constitute a simle model for natural reasoning and learning. 502
4 Also, as the emergent reasoning may be interreted as fuzzy reasoning, it may also be hyothesized that natural reasoning is intrinsically fuzzy. 3 Laser Data Prediction The time series roblem here treated is the wellknown laser data of the Santa Fe contest [14]. This is data is aroximately a Lorenz model of a two level system [7] and is considered an examle of a stationary hysical system, which behaviour and equations are well established. During the learning hase values v t-1, v t-2,, v t-k of the variable on the data set are rovided as antecedents and v t is also rovided as the consequent. The FB is a black box forecast system that eventually acquires the governing qualitative rules of the time series. In the alication hase, when values v t -1, v t -2,, v t -k are given as inuts it is suosed that v t is redicted by the FB. In order to use the Boolean fuzzy net it is necessary to comly the continuous values of the antecedents with the binary inuts exected. Since the binary nature of antecedent inuts result from the fact that they come from an area of neurons where the resective variable value is the activation ratio, one has to define the interval limits for each variable and to find the ratio between the value of each continuous observation and the interval. Then a random assignation of 1 s and 0 s is made to every antecedent neuron in order to obtain the desired antecedent ratio. A Monte Carlo tye method can be used for this urose. That is, for each antecedent A k one gets: Oi j = Rand(Vi j /(Max-Min)) ; where Oi j is the outut from neuron i in exeriment j, Vi j is the actual continuous value of the variable k in the same exeriment and Rand(x) is a function that returns 1 with robability x or 0 otherwise. The theoretical conditions for convergence [12] state that the number of inuts er consequent neuron and er antecedent should be of the order of the square of consequent linguistic terms that must be differentiated. These conditions are achieved when the number of exeriments (observations in this case) goes to infinity. The theoretical results obtained also roved that the results of the Fuzzy Boolean ets are equivalent to those achieved with non arametric estimation by Parzen windows [9], which imlies that every data exeriment is suosed to belong to a distribution with a given robability density. This same conjecture is made for roving the relation between the number of inuts er consequent neuron and the granularity. Thus one assumes that there exists a hidden set of qualitative rules relating a set of consecutive data observations (or simle functions of these observations, such as moving averages) to the next unknown value and this set of rules comlies with the above assumtions. The behaviour of the Boolean Fuzzy et has been studied [13], in terms of the quadratic error obtained when the number of used neurons, of inuts er consequent neuron and er antecedent (ma) and of different rules on the consequent (granularity) are used as arameters. Also the effect of the number of different teaching exeriments has been observed. In that study, exerimental values for antecedent and consequent have been artificially generated from normal distributed variables, with known average and variances. It has been observed that the error diminishes with the number ma until a level of minimum is achieved, deending on the number of neurons. This otimum value for ma, in those exeriments, is of the order of 50 for 100 neurons and of 70 for 1000 neurons, when the value of three is used for consequent granularity. Further increasing of the ma from that oint on has the effect of increasing or decreasing the error on an oscillation form. This minimum error, however, deends on the number of consequent neurons and for a granularity of 3 on the consequent (say: Low, Medium and High ) and for a number of the order of 100 exeriments this minimum is , for 100 neurons and , both for 1000 and 5000 neurons, being the error a value between these two for 500 neurons. These values may be used as a clue for the work of this aer but, due to the different nature of the roblem, a more secific investigation has been erformed. In order to evaluate the net erformance four different indicators have been calculated as follows. In this context d is considered the redicted value of index and y the actual data set value to be redicted. Also, the values of the data set have been standardized for the interval [0,1]. 2 Mean squared error, MSE= 1/ 2 (d y) 503
5 ormalized Mean Squared error, 2 ( y d) MSE= 2 ( y y ) 20 rules! A similar result is obtained here with 3 antecedents and 9 rules. Table 1 describes the obtained values for two of the tests. Mean Percentage Error, MRPE= 1/ d y.100% Percentage of Correct (u/down) Direction 1 Prediction, PCD= f *100% With f =1 if sign(d - y -1 )=sign(y - y -1 ); f =0 otherwise. FB Outut Real Data Different teaching and testing sets have been used, namely art of the extra data set (about 9000 oints) as teaching set and the main data set (about 1000 oints) as the test set or 800 oints of the main data set as teaching set and the other 200 oints for test set, with similar results. A set of different values for the arameters have been tried, namely: R(number of consequent rules) has been changed from 3 to 9, A(the number of antecedents) on the range from 3 to 5, (number of consequent neurons) has been tried with values 500 and The number of inuts er antecedent and er consequent neuron, ma, was used according the theoretical conditions stated above, that is, at least of the order of the square of the number of rules. The actual values were from 24 for 3 rules to 161 for 9 rules. Figure 1 dislays 200 oints both of real and redicted data, of the 1000 used for test. These values comare otimistically with those already obtained by other authors. In articular one of the best reorted results, using Hidden Markov Exerts [15], accounts for MSE values (the other indicators are not available) from 0.01 (using 25 Exerts) to (using 10 Exerts). It should, however, be stressed that that work has used 10 antecedents (comaring with 3 and 9 of this work) and that the so-called Exerts have a similar role to Qualitative Rules. Thus, the value of (10 antecedents and 20 Exerts) for MSE should be comared to a FB result using 10 antecedents and Figure 1: Real and Predicted data Table 1: Prediction MSE, MSE, MRPE and PCD MSE MSE MRPE PCD R=3;A=5; =500;m A= % 88% R=9;A=3; =500;m A= % 90.5% This suggests that the interolation caability of these nets are very well adated to this tye of time series forecast and that the number of ast values/antecedents necessary to a good rediction, as long as enough rules are used, is not so high as indicated in other works,. 4 Conclusions It has been shown that FB s are a good otion for one ste ahead rediction for certain time series roblems, articularly in non trivial and stationary roblems, such as the chaotic ulsations of low dimensionality of the used laser data set. The obtained error rates, both for mean square error and mean relative ercentage error, are quite good when comared with other reorted results. Also the high ercentage of correct direction rediction (in terms 504
6 of the derivative sign of the series variable) encourages the study the FB behavior with other time series tye where this sign revision is of most imortance, such as stock exchange or currency roblems. Finally, although the main objective of this aer was the forecast of the value of a variable given its assed values, an interesting question is the interretation of the redictions. That is, the issue of exlaining the rediction results by qualitative rules can be very useful for understanding the underlying laws governing the time series behavior. Since the FB model learns rules this question is automatically answered by listing those rules. Moreover for the test hase it is ossible to list also the activation ratio of each rule, instead of exhibiting only the final defuzzified value. References [1] G.Box,G.Jenkins and G.C.Reinsel, Time Series Analysis, Forecasting and Control, Oakland, California: Holden Day, [2] P.Chang and J. Hu, Otimal nonlinear adative rediction and modelling of MPEG video in ATM networks using ielined recurrent neural networks, IEEE J.Select.Areas Commun., vol 15, Aug [3] S.Chong,S.Li and J.Ghosh, Predictive dynamic bandwidth allocation for efficient transort of real time VBR over ATM, IEEE J.Select. Areas Commun.,vol13, 12-33, Jan [4] A.Geva, on-stationary time series rediction using fuzzy clustering, Proceedings of the 18 th International Conference of the orth American Fuzzy Information Processing Society, , [5] S.Haykin, Adative Filter Theory. Uer Saddle River,J: Prentice Hall, [6] Hebb, D. The Organization of Behaviour: A eurosychological Theory. John Wiley &Sons. (1949). [7] U. Huebner,.B. Abraham and C.Weiss Dimensions and Entroies of chaotic intensity ulsations in a single-mode far infraredh3 laser, Phys. Rev. A40, 6354(1989) [8] Lin, Chin-Ten and Lee,C.S. A euro-fuzzy Synergism to Intelligent Systems.ew Jersey : Prentice Hall. (1996). [9] Parzen, E.(1962). "On Estimation of a robability density function and mode" Ann. Math. Stat., 33, [10] Tomé,J.A."eural Activation ratio based Fuzzy Reasoning."Proc. IEEE World Congress on Comutational Inteligence, Anchorage,May 1998, [11] Tomé,J.A."Counting Boolean etworks are Universal Aroximators" Proc. of 1998 Conference of AFIPS, Florida, August 1998, [12] Tomé,J.A. and Carvalho, J.P. "Rule Caacity in Fuzzy Boolean etworks. Proc. of AFIPS- FLIT 2002 International Conference, ew Orleans, IEEE2002, [13] Tomé, J.A. Error convergence on Fuzzy Boolean ets. Internal Reort, IESC [14] A. Weigeng and.a. Gershenfeld, Time Series Prediction: Forecasting the Future and Understandibg the Past. Reading,MA: Addison-Wesley, 1999 [15] X.Wang, P. Whigham,Da Deng,M. Purvis, Time-Line Hidden markov Exerts for Time Series Prediction, eural Information Processing Letters and Reviews, Vol. 3,2, May
Principal Components Analysis and Unsupervised Hebbian Learning
Princial Comonents Analysis and Unsuervised Hebbian Learning Robert Jacobs Deartment of Brain & Cognitive Sciences University of Rochester Rochester, NY 1467, USA August 8, 008 Reference: Much of the material
More informationUncertainty Modeling with Interval Type-2 Fuzzy Logic Systems in Mobile Robotics
Uncertainty Modeling with Interval Tye-2 Fuzzy Logic Systems in Mobile Robotics Ondrej Linda, Student Member, IEEE, Milos Manic, Senior Member, IEEE bstract Interval Tye-2 Fuzzy Logic Systems (IT2 FLSs)
More informationFeedback-error control
Chater 4 Feedback-error control 4.1 Introduction This chater exlains the feedback-error (FBE) control scheme originally described by Kawato [, 87, 8]. FBE is a widely used neural network based controller
More informationDistributed Rule-Based Inference in the Presence of Redundant Information
istribution Statement : roved for ublic release; distribution is unlimited. istributed Rule-ased Inference in the Presence of Redundant Information June 8, 004 William J. Farrell III Lockheed Martin dvanced
More informationPeriod-two cycles in a feedforward layered neural network model with symmetric sequence processing
PHYSICAL REVIEW E 75, 4197 27 Period-two cycles in a feedforward layered neural network model with symmetric sequence rocessing F. L. Metz and W. K. Theumann Instituto de Física, Universidade Federal do
More informationRadial Basis Function Networks: Algorithms
Radial Basis Function Networks: Algorithms Introduction to Neural Networks : Lecture 13 John A. Bullinaria, 2004 1. The RBF Maing 2. The RBF Network Architecture 3. Comutational Power of RBF Networks 4.
More informationMultilayer Perceptron Neural Network (MLPs) For Analyzing the Properties of Jordan Oil Shale
World Alied Sciences Journal 5 (5): 546-552, 2008 ISSN 1818-4952 IDOSI Publications, 2008 Multilayer Percetron Neural Network (MLPs) For Analyzing the Proerties of Jordan Oil Shale 1 Jamal M. Nazzal, 2
More informationAn Analysis of Reliable Classifiers through ROC Isometrics
An Analysis of Reliable Classifiers through ROC Isometrics Stijn Vanderlooy s.vanderlooy@cs.unimaas.nl Ida G. Srinkhuizen-Kuyer kuyer@cs.unimaas.nl Evgueni N. Smirnov smirnov@cs.unimaas.nl MICC-IKAT, Universiteit
More informationApproximating min-max k-clustering
Aroximating min-max k-clustering Asaf Levin July 24, 2007 Abstract We consider the roblems of set artitioning into k clusters with minimum total cost and minimum of the maximum cost of a cluster. The cost
More informationFuzzy Automata Induction using Construction Method
Journal of Mathematics and Statistics 2 (2): 395-4, 26 ISSN 1549-3644 26 Science Publications Fuzzy Automata Induction using Construction Method 1,2 Mo Zhi Wen and 2 Wan Min 1 Center of Intelligent Control
More informationUsing a Computational Intelligence Hybrid Approach to Recognize the Faults of Variance Shifts for a Manufacturing Process
Journal of Industrial and Intelligent Information Vol. 4, No. 2, March 26 Using a Comutational Intelligence Hybrid Aroach to Recognize the Faults of Variance hifts for a Manufacturing Process Yuehjen E.
More informationHotelling s Two- Sample T 2
Chater 600 Hotelling s Two- Samle T Introduction This module calculates ower for the Hotelling s two-grou, T-squared (T) test statistic. Hotelling s T is an extension of the univariate two-samle t-test
More informationBrownian Motion and Random Prime Factorization
Brownian Motion and Random Prime Factorization Kendrick Tang June 4, 202 Contents Introduction 2 2 Brownian Motion 2 2. Develoing Brownian Motion.................... 2 2.. Measure Saces and Borel Sigma-Algebras.........
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationOn Line Parameter Estimation of Electric Systems using the Bacterial Foraging Algorithm
On Line Parameter Estimation of Electric Systems using the Bacterial Foraging Algorithm Gabriel Noriega, José Restreo, Víctor Guzmán, Maribel Giménez and José Aller Universidad Simón Bolívar Valle de Sartenejas,
More informationProbability Estimates for Multi-class Classification by Pairwise Coupling
Probability Estimates for Multi-class Classification by Pairwise Couling Ting-Fan Wu Chih-Jen Lin Deartment of Comuter Science National Taiwan University Taiei 06, Taiwan Ruby C. Weng Deartment of Statistics
More informationInformation collection on a graph
Information collection on a grah Ilya O. Ryzhov Warren Powell February 10, 2010 Abstract We derive a knowledge gradient olicy for an otimal learning roblem on a grah, in which we use sequential measurements
More information4. Score normalization technical details We now discuss the technical details of the score normalization method.
SMT SCORING SYSTEM This document describes the scoring system for the Stanford Math Tournament We begin by giving an overview of the changes to scoring and a non-technical descrition of the scoring rules
More informationSolved Problems. (a) (b) (c) Figure P4.1 Simple Classification Problems First we draw a line between each set of dark and light data points.
Solved Problems Solved Problems P Solve the three simle classification roblems shown in Figure P by drawing a decision boundary Find weight and bias values that result in single-neuron ercetrons with the
More informationInformation collection on a graph
Information collection on a grah Ilya O. Ryzhov Warren Powell October 25, 2009 Abstract We derive a knowledge gradient olicy for an otimal learning roblem on a grah, in which we use sequential measurements
More informationAn Ant Colony Optimization Approach to the Probabilistic Traveling Salesman Problem
An Ant Colony Otimization Aroach to the Probabilistic Traveling Salesman Problem Leonora Bianchi 1, Luca Maria Gambardella 1, and Marco Dorigo 2 1 IDSIA, Strada Cantonale Galleria 2, CH-6928 Manno, Switzerland
More informationCombining Logistic Regression with Kriging for Mapping the Risk of Occurrence of Unexploded Ordnance (UXO)
Combining Logistic Regression with Kriging for Maing the Risk of Occurrence of Unexloded Ordnance (UXO) H. Saito (), P. Goovaerts (), S. A. McKenna (2) Environmental and Water Resources Engineering, Deartment
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More informationLIMITATIONS OF RECEPTRON. XOR Problem The failure of the perceptron to successfully simple problem such as XOR (Minsky and Papert).
LIMITATIONS OF RECEPTRON XOR Problem The failure of the ercetron to successfully simle roblem such as XOR (Minsky and Paert). x y z x y z 0 0 0 0 0 0 Fig. 4. The exclusive-or logic symbol and function
More informationUncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning
TNN-2009-P-1186.R2 1 Uncorrelated Multilinear Princial Comonent Analysis for Unsuervised Multilinear Subsace Learning Haiing Lu, K. N. Plataniotis and A. N. Venetsanooulos The Edward S. Rogers Sr. Deartment
More informationA Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-Test Split
A Bound on the Error of Cross Validation Using the Aroximation and Estimation Rates, with Consequences for the Training-Test Slit Michael Kearns AT&T Bell Laboratories Murray Hill, NJ 7974 mkearns@research.att.com
More informationUse of Transformations and the Repeated Statement in PROC GLM in SAS Ed Stanek
Use of Transformations and the Reeated Statement in PROC GLM in SAS Ed Stanek Introduction We describe how the Reeated Statement in PROC GLM in SAS transforms the data to rovide tests of hyotheses of interest.
More informationHow to Estimate Expected Shortfall When Probabilities Are Known with Interval or Fuzzy Uncertainty
How to Estimate Exected Shortfall When Probabilities Are Known with Interval or Fuzzy Uncertainty Christian Servin Information Technology Deartment El Paso Community College El Paso, TX 7995, USA cservin@gmail.com
More informationEvaluating Circuit Reliability Under Probabilistic Gate-Level Fault Models
Evaluating Circuit Reliability Under Probabilistic Gate-Level Fault Models Ketan N. Patel, Igor L. Markov and John P. Hayes University of Michigan, Ann Arbor 48109-2122 {knatel,imarkov,jhayes}@eecs.umich.edu
More informationImproved Capacity Bounds for the Binary Energy Harvesting Channel
Imroved Caacity Bounds for the Binary Energy Harvesting Channel Kaya Tutuncuoglu 1, Omur Ozel 2, Aylin Yener 1, and Sennur Ulukus 2 1 Deartment of Electrical Engineering, The Pennsylvania State University,
More informationThe Binomial Approach for Probability of Detection
Vol. No. (Mar 5) - The e-journal of Nondestructive Testing - ISSN 45-494 www.ndt.net/?id=7498 The Binomial Aroach for of Detection Carlos Correia Gruo Endalloy C.A. - Caracas - Venezuela www.endalloy.net
More informationGeneral Linear Model Introduction, Classes of Linear models and Estimation
Stat 740 General Linear Model Introduction, Classes of Linear models and Estimation An aim of scientific enquiry: To describe or to discover relationshis among events (variables) in the controlled (laboratory)
More informationSupplementary Materials for Robust Estimation of the False Discovery Rate
Sulementary Materials for Robust Estimation of the False Discovery Rate Stan Pounds and Cheng Cheng This sulemental contains roofs regarding theoretical roerties of the roosed method (Section S1), rovides
More informationEstimation of component redundancy in optimal age maintenance
EURO MAINTENANCE 2012, Belgrade 14-16 May 2012 Proceedings of the 21 st International Congress on Maintenance and Asset Management Estimation of comonent redundancy in otimal age maintenance Jorge ioa
More informationCharacterizing the Behavior of a Probabilistic CMOS Switch Through Analytical Models and Its Verification Through Simulations
Characterizing the Behavior of a Probabilistic CMOS Switch Through Analytical Models and Its Verification Through Simulations PINAR KORKMAZ, BILGE E. S. AKGUL and KRISHNA V. PALEM Georgia Institute of
More informationAI*IA 2003 Fusion of Multiple Pattern Classifiers PART III
AI*IA 23 Fusion of Multile Pattern Classifiers PART III AI*IA 23 Tutorial on Fusion of Multile Pattern Classifiers by F. Roli 49 Methods for fusing multile classifiers Methods for fusing multile classifiers
More informationGenetic Algorithm Based PID Optimization in Batch Process Control
International Conference on Comuter Alications and Industrial Electronics (ICCAIE ) Genetic Algorithm Based PID Otimization in Batch Process Control.K. Tan Y.K. Chin H.J. Tham K.T.K. Teo odelling, Simulation
More informationarxiv:cond-mat/ v2 25 Sep 2002
Energy fluctuations at the multicritical oint in two-dimensional sin glasses arxiv:cond-mat/0207694 v2 25 Se 2002 1. Introduction Hidetoshi Nishimori, Cyril Falvo and Yukiyasu Ozeki Deartment of Physics,
More informationUniversal Finite Memory Coding of Binary Sequences
Deartment of Electrical Engineering Systems Universal Finite Memory Coding of Binary Sequences Thesis submitted towards the degree of Master of Science in Electrical and Electronic Engineering in Tel-Aviv
More informationState Estimation with ARMarkov Models
Deartment of Mechanical and Aerosace Engineering Technical Reort No. 3046, October 1998. Princeton University, Princeton, NJ. State Estimation with ARMarkov Models Ryoung K. Lim 1 Columbia University,
More informationDETC2003/DAC AN EFFICIENT ALGORITHM FOR CONSTRUCTING OPTIMAL DESIGN OF COMPUTER EXPERIMENTS
Proceedings of DETC 03 ASME 003 Design Engineering Technical Conferences and Comuters and Information in Engineering Conference Chicago, Illinois USA, Setember -6, 003 DETC003/DAC-48760 AN EFFICIENT ALGORITHM
More informationModeling Pointing Tasks in Mouse-Based Human-Computer Interactions
Modeling Pointing Tasks in Mouse-Based Human-Comuter Interactions Stanislav Aranovskiy, Rosane Ushirobira, Denis Efimov, Géry Casiez To cite this version: Stanislav Aranovskiy, Rosane Ushirobira, Denis
More informationA generalization of Amdahl's law and relative conditions of parallelism
A generalization of Amdahl's law and relative conditions of arallelism Author: Gianluca Argentini, New Technologies and Models, Riello Grou, Legnago (VR), Italy. E-mail: gianluca.argentini@riellogrou.com
More informationOn the capacity of the general trapdoor channel with feedback
On the caacity of the general tradoor channel with feedback Jui Wu and Achilleas Anastasooulos Electrical Engineering and Comuter Science Deartment University of Michigan Ann Arbor, MI, 48109-1 email:
More informationCHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules
CHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules. Introduction: The is widely used in industry to monitor the number of fraction nonconforming units. A nonconforming unit is
More informationStatics and dynamics: some elementary concepts
1 Statics and dynamics: some elementary concets Dynamics is the study of the movement through time of variables such as heartbeat, temerature, secies oulation, voltage, roduction, emloyment, rices and
More informationarxiv: v1 [physics.data-an] 26 Oct 2012
Constraints on Yield Parameters in Extended Maximum Likelihood Fits Till Moritz Karbach a, Maximilian Schlu b a TU Dortmund, Germany, moritz.karbach@cern.ch b TU Dortmund, Germany, maximilian.schlu@cern.ch
More informationOn Fractional Predictive PID Controller Design Method Emmanuel Edet*. Reza Katebi.**
On Fractional Predictive PID Controller Design Method Emmanuel Edet*. Reza Katebi.** * echnology and Innovation Centre, Level 4, Deartment of Electronic and Electrical Engineering, University of Strathclyde,
More informationMATHEMATICAL MODELLING OF THE WIRELESS COMMUNICATION NETWORK
Comuter Modelling and ew Technologies, 5, Vol.9, o., 3-39 Transort and Telecommunication Institute, Lomonosov, LV-9, Riga, Latvia MATHEMATICAL MODELLIG OF THE WIRELESS COMMUICATIO ETWORK M. KOPEETSK Deartment
More informationAdaptive estimation with change detection for streaming data
Adative estimation with change detection for streaming data A thesis resented for the degree of Doctor of Philosohy of the University of London and the Diloma of Imerial College by Dean Adam Bodenham Deartment
More informationEvaluating Process Capability Indices for some Quality Characteristics of a Manufacturing Process
Journal of Statistical and Econometric Methods, vol., no.3, 013, 105-114 ISSN: 051-5057 (rint version), 051-5065(online) Scienress Ltd, 013 Evaluating Process aability Indices for some Quality haracteristics
More informationE-companion to A risk- and ambiguity-averse extension of the max-min newsvendor order formula
e-comanion to Han Du and Zuluaga: Etension of Scarf s ma-min order formula ec E-comanion to A risk- and ambiguity-averse etension of the ma-min newsvendor order formula Qiaoming Han School of Mathematics
More informationMATH 2710: NOTES FOR ANALYSIS
MATH 270: NOTES FOR ANALYSIS The main ideas we will learn from analysis center around the idea of a limit. Limits occurs in several settings. We will start with finite limits of sequences, then cover infinite
More informationA Simple Weight Decay Can Improve. Abstract. It has been observed in numerical simulations that a weight decay can improve
In Advances in Neural Information Processing Systems 4, J.E. Moody, S.J. Hanson and R.P. Limann, eds. Morgan Kaumann Publishers, San Mateo CA, 1995,. 950{957. A Simle Weight Decay Can Imrove Generalization
More informationGeneralized Coiflets: A New Family of Orthonormal Wavelets
Generalized Coiflets A New Family of Orthonormal Wavelets Dong Wei, Alan C Bovik, and Brian L Evans Laboratory for Image and Video Engineering Deartment of Electrical and Comuter Engineering The University
More informationGENERATING FUZZY RULES FOR PROTEIN CLASSIFICATION E. G. MANSOORI, M. J. ZOLGHADRI, S. D. KATEBI, H. MOHABATKAR, R. BOOSTANI AND M. H.
Iranian Journal of Fuzzy Systems Vol. 5, No. 2, (2008). 21-33 GENERATING FUZZY RULES FOR PROTEIN CLASSIFICATION E. G. MANSOORI, M. J. ZOLGHADRI, S. D. KATEBI, H. MOHABATKAR, R. BOOSTANI AND M. H. SADREDDINI
More informationRecursive Estimation of the Preisach Density function for a Smart Actuator
Recursive Estimation of the Preisach Density function for a Smart Actuator Ram V. Iyer Deartment of Mathematics and Statistics, Texas Tech University, Lubbock, TX 7949-142. ABSTRACT The Preisach oerator
More informationMetrics Performance Evaluation: Application to Face Recognition
Metrics Performance Evaluation: Alication to Face Recognition Naser Zaeri, Abeer AlSadeq, and Abdallah Cherri Electrical Engineering Det., Kuwait University, P.O. Box 5969, Safat 6, Kuwait {zaery, abeer,
More informationBOUNDS FOR THE COUPLING TIME IN QUEUEING NETWORKS PERFECT SIMULATION
BOUNDS FOR THE COUPLING TIME IN QUEUEING NETWORKS PERFECT SIMULATION JANTIEN G. DOPPER, BRUNO GAUJAL AND JEAN-MARC VINCENT Abstract. In this aer, the duration of erfect simulations for Markovian finite
More informationDynamic System Eigenvalue Extraction using a Linear Echo State Network for Small-Signal Stability Analysis a Novel Application
Dynamic System Eigenvalue Extraction using a Linear Echo State Network for Small-Signal Stability Analysis a Novel Alication Jiaqi Liang, Jing Dai, Ganesh K. Venayagamoorthy, and Ronald G. Harley Abstract
More informationA Unified 2D Representation of Fuzzy Reasoning, CBR, and Experience Based Reasoning
University of Wollongong Research Online Faculty of Commerce - aers (Archive) Faculty of Business 26 A Unified 2D Reresentation of Fuzzy Reasoning, CBR, and Exerience Based Reasoning Zhaohao Sun University
More informationSome Unitary Space Time Codes From Sphere Packing Theory With Optimal Diversity Product of Code Size
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 5, NO., DECEMBER 4 336 Some Unitary Sace Time Codes From Shere Packing Theory With Otimal Diversity Product of Code Size Haiquan Wang, Genyuan Wang, and Xiang-Gen
More informationYixi Shi. Jose Blanchet. IEOR Department Columbia University New York, NY 10027, USA. IEOR Department Columbia University New York, NY 10027, USA
Proceedings of the 2011 Winter Simulation Conference S. Jain, R. R. Creasey, J. Himmelsach, K. P. White, and M. Fu, eds. EFFICIENT RARE EVENT SIMULATION FOR HEAVY-TAILED SYSTEMS VIA CROSS ENTROPY Jose
More informationA MIXED CONTROL CHART ADAPTED TO THE TRUNCATED LIFE TEST BASED ON THE WEIBULL DISTRIBUTION
O P E R A T I O N S R E S E A R C H A N D D E C I S I O N S No. 27 DOI:.5277/ord73 Nasrullah KHAN Muhammad ASLAM 2 Kyung-Jun KIM 3 Chi-Hyuck JUN 4 A MIXED CONTROL CHART ADAPTED TO THE TRUNCATED LIFE TEST
More informationOn Wald-Type Optimal Stopping for Brownian Motion
J Al Probab Vol 34, No 1, 1997, (66-73) Prerint Ser No 1, 1994, Math Inst Aarhus On Wald-Tye Otimal Stoing for Brownian Motion S RAVRSN and PSKIR The solution is resented to all otimal stoing roblems of
More informationPreconditioning techniques for Newton s method for the incompressible Navier Stokes equations
Preconditioning techniques for Newton s method for the incomressible Navier Stokes equations H. C. ELMAN 1, D. LOGHIN 2 and A. J. WATHEN 3 1 Deartment of Comuter Science, University of Maryland, College
More informationIntroduction to Probability and Statistics
Introduction to Probability and Statistics Chater 8 Ammar M. Sarhan, asarhan@mathstat.dal.ca Deartment of Mathematics and Statistics, Dalhousie University Fall Semester 28 Chater 8 Tests of Hyotheses Based
More informationUsing the Divergence Information Criterion for the Determination of the Order of an Autoregressive Process
Using the Divergence Information Criterion for the Determination of the Order of an Autoregressive Process P. Mantalos a1, K. Mattheou b, A. Karagrigoriou b a.deartment of Statistics University of Lund
More informationPairwise active appearance model and its application to echocardiography tracking
Pairwise active aearance model and its alication to echocardiograhy tracking S. Kevin Zhou 1, J. Shao 2, B. Georgescu 1, and D. Comaniciu 1 1 Integrated Data Systems, Siemens Cororate Research, Inc., Princeton,
More informationVIBRATION ANALYSIS OF BEAMS WITH MULTIPLE CONSTRAINED LAYER DAMPING PATCHES
Journal of Sound and Vibration (998) 22(5), 78 85 VIBRATION ANALYSIS OF BEAMS WITH MULTIPLE CONSTRAINED LAYER DAMPING PATCHES Acoustics and Dynamics Laboratory, Deartment of Mechanical Engineering, The
More informationAnalysis of some entrance probabilities for killed birth-death processes
Analysis of some entrance robabilities for killed birth-death rocesses Master s Thesis O.J.G. van der Velde Suervisor: Dr. F.M. Sieksma July 5, 207 Mathematical Institute, Leiden University Contents Introduction
More informationSIMULATION OF DIFFUSION PROCESSES IN LABYRINTHIC DOMAINS BY USING CELLULAR AUTOMATA
SIMULATION OF DIFFUSION PROCESSES IN LABYRINTHIC DOMAINS BY USING CELLULAR AUTOMATA Udo Buschmann and Thorsten Rankel and Wolfgang Wiechert Deartment of Simulation University of Siegen Paul-Bonatz-Str.
More informationA Model for Randomly Correlated Deposition
A Model for Randomly Correlated Deosition B. Karadjov and A. Proykova Faculty of Physics, University of Sofia, 5 J. Bourchier Blvd. Sofia-116, Bulgaria ana@hys.uni-sofia.bg Abstract: A simle, discrete,
More informationand INVESTMENT DECISION-MAKING
CONSISTENT INTERPOLATIVE FUZZY LOGIC and INVESTMENT DECISION-MAKING Darko Kovačević, č Petar Sekulić and dal Aleksandar Rakićević National bank of Serbia Belgrade, Jun 23th, 20 The structure of the resentation
More informationCONSTRUCTIVE NEURAL NETWORKS IN FORECASTING WEEKLY RIVER FLOW
CONSTRUCTIVE NEURAL NETWORKS IN FORECASTING WEEKLY RIVER FLOW MÊUSER VALENÇA Universidade Salgado de Oliveira - UNIVERSO /Comanhia Hidroelétrica do São Francisco - Chesf Rua Gasar Peres, 47/4 CDU, Recife,
More informationHomogeneous and Inhomogeneous Model for Flow and Heat Transfer in Porous Materials as High Temperature Solar Air Receivers
Excert from the roceedings of the COMSOL Conference 1 aris Homogeneous and Inhomogeneous Model for Flow and Heat ransfer in orous Materials as High emerature Solar Air Receivers Olena Smirnova 1 *, homas
More informationON POLYNOMIAL SELECTION FOR THE GENERAL NUMBER FIELD SIEVE
MATHEMATICS OF COMPUTATIO Volume 75, umber 256, October 26, Pages 237 247 S 25-5718(6)187-9 Article electronically ublished on June 28, 26 O POLYOMIAL SELECTIO FOR THE GEERAL UMBER FIELD SIEVE THORSTE
More informationStatistical Models approach for Solar Radiation Prediction
Statistical Models aroach for Solar Radiation Prediction S. Ferrari, M. Lazzaroni, and V. Piuri Universita degli Studi di Milano Milan, Italy Email: {stefano.ferrari, massimo.lazzaroni, vincenzo.iuri}@unimi.it
More informationLinear diophantine equations for discrete tomography
Journal of X-Ray Science and Technology 10 001 59 66 59 IOS Press Linear diohantine euations for discrete tomograhy Yangbo Ye a,gewang b and Jiehua Zhu a a Deartment of Mathematics, The University of Iowa,
More informationPretest (Optional) Use as an additional pacing tool to guide instruction. August 21
Trimester 1 Pretest (Otional) Use as an additional acing tool to guide instruction. August 21 Beyond the Basic Facts In Trimester 1, Grade 8 focus on multilication. Daily Unit 1: Rational vs. Irrational
More informationA SIMPLE PLASTICITY MODEL FOR PREDICTING TRANSVERSE COMPOSITE RESPONSE AND FAILURE
THE 19 TH INTERNATIONAL CONFERENCE ON COMPOSITE MATERIALS A SIMPLE PLASTICITY MODEL FOR PREDICTING TRANSVERSE COMPOSITE RESPONSE AND FAILURE K.W. Gan*, M.R. Wisnom, S.R. Hallett, G. Allegri Advanced Comosites
More informationChurilova Maria Saint-Petersburg State Polytechnical University Department of Applied Mathematics
Churilova Maria Saint-Petersburg State Polytechnical University Deartment of Alied Mathematics Technology of EHIS (staming) alied to roduction of automotive arts The roblem described in this reort originated
More informationGeneralized analysis method of engine suspensions based on bond graph modeling and feedback control theory
Generalized analysis method of ine susensions based on bond grah modeling and feedback ntrol theory P.Y. RICHARD *, C. RAMU-ERMENT **, J. BUION *, X. MOREAU **, M. LE FOL *** *Equie Automatique des ystèmes
More informationConvex Optimization methods for Computing Channel Capacity
Convex Otimization methods for Comuting Channel Caacity Abhishek Sinha Laboratory for Information and Decision Systems (LIDS), MIT sinhaa@mit.edu May 15, 2014 We consider a classical comutational roblem
More informationChapter 1 Fundamentals
Chater Fundamentals. Overview of Thermodynamics Industrial Revolution brought in large scale automation of many tedious tasks which were earlier being erformed through manual or animal labour. Inventors
More informationApplied Mathematics and Computation
Alied Mathematics and Comutation 217 (2010) 1887 1895 Contents lists available at ScienceDirect Alied Mathematics and Comutation journal homeage: www.elsevier.com/locate/amc Derivative free two-oint methods
More informationAn Analysis of TCP over Random Access Satellite Links
An Analysis of over Random Access Satellite Links Chunmei Liu and Eytan Modiano Massachusetts Institute of Technology Cambridge, MA 0239 Email: mayliu, modiano@mit.edu Abstract This aer analyzes the erformance
More informationParallel Quantum-inspired Genetic Algorithm for Combinatorial Optimization Problem
Parallel Quantum-insired Genetic Algorithm for Combinatorial Otimization Problem Kuk-Hyun Han Kui-Hong Park Chi-Ho Lee Jong-Hwan Kim Det. of Electrical Engineering and Comuter Science, Korea Advanced Institute
More informationSystem Reliability Estimation and Confidence Regions from Subsystem and Full System Tests
009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 0-, 009 FrB4. System Reliability Estimation and Confidence Regions from Subsystem and Full System Tests James C. Sall Abstract
More informationThe Graph Accessibility Problem and the Universality of the Collision CRCW Conflict Resolution Rule
The Grah Accessibility Problem and the Universality of the Collision CRCW Conflict Resolution Rule STEFAN D. BRUDA Deartment of Comuter Science Bisho s University Lennoxville, Quebec J1M 1Z7 CANADA bruda@cs.ubishos.ca
More informationShadow Computing: An Energy-Aware Fault Tolerant Computing Model
Shadow Comuting: An Energy-Aware Fault Tolerant Comuting Model Bryan Mills, Taieb Znati, Rami Melhem Deartment of Comuter Science University of Pittsburgh (bmills, znati, melhem)@cs.itt.edu Index Terms
More informationThe Motion Path Study of Measuring Robot Based on Variable Universe Fuzzy Control
MATEC Web of Conferences 95, 8 (27) DOI:.5/ matecconf/27958 ICMME 26 The Motion Path Study of Measuring Robot Based on Variable Universe Fuzzy Control Ma Guoqing, Yu Zhenglin, Cao Guohua, Zhang Ruoyan
More informationAnalysis of Group Coding of Multiple Amino Acids in Artificial Neural Network Applied to the Prediction of Protein Secondary Structure
Analysis of Grou Coding of Multile Amino Acids in Artificial Neural Networ Alied to the Prediction of Protein Secondary Structure Zhu Hong-ie 1, Dai Bin 2, Zhang Ya-feng 1, Bao Jia-li 3,* 1 College of
More informationDeveloping A Deterioration Probabilistic Model for Rail Wear
International Journal of Traffic and Transortation Engineering 2012, 1(2): 13-18 DOI: 10.5923/j.ijtte.20120102.02 Develoing A Deterioration Probabilistic Model for Rail Wear Jabbar-Ali Zakeri *, Shahrbanoo
More informationTests for Two Proportions in a Stratified Design (Cochran/Mantel-Haenszel Test)
Chater 225 Tests for Two Proortions in a Stratified Design (Cochran/Mantel-Haenszel Test) Introduction In a stratified design, the subects are selected from two or more strata which are formed from imortant
More informationComputer arithmetic. Intensive Computation. Annalisa Massini 2017/2018
Comuter arithmetic Intensive Comutation Annalisa Massini 7/8 Intensive Comutation - 7/8 References Comuter Architecture - A Quantitative Aroach Hennessy Patterson Aendix J Intensive Comutation - 7/8 3
More informationJohn Weatherwax. Analysis of Parallel Depth First Search Algorithms
Sulementary Discussions and Solutions to Selected Problems in: Introduction to Parallel Comuting by Viin Kumar, Ananth Grama, Anshul Guta, & George Karyis John Weatherwax Chater 8 Analysis of Parallel
More informationTopic 7: Using identity types
Toic 7: Using identity tyes June 10, 2014 Now we would like to learn how to use identity tyes and how to do some actual mathematics with them. By now we have essentially introduced all inference rules
More informationq-ary Symmetric Channel for Large q
List-Message Passing Achieves Caacity on the q-ary Symmetric Channel for Large q Fan Zhang and Henry D Pfister Deartment of Electrical and Comuter Engineering, Texas A&M University {fanzhang,hfister}@tamuedu
More informationOrdered and disordered dynamics in random networks
EUROPHYSICS LETTERS 5 March 998 Eurohys. Lett., 4 (6),. 599-604 (998) Ordered and disordered dynamics in random networks L. Glass ( )andc. Hill 2,3 Deartment of Physiology, McGill University 3655 Drummond
More information