International Journal "Information Technologies & Knowledge" Vol.5, Number 1,
|
|
- Baldric Augustus Wheeler
- 6 years ago
- Views:
Transcription
1 Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 5 EVOLVING CASCADE NEURAL NETWORK BASED ON MULTIDIMESNIONAL EPANECHNIKOV S KERNELS AND ITS LEARNING ALGORITHM Yevgeniy Bodyanskiy, Pau Grimm, Nataiya Tesenko Abstract: At present time neura networks based on Group Metod of Data Handing (GMDH-NN), nodes of wic are two-input N-Adaines, is we-known. Eac of N-Adaines contains te set of adjustabe synaptic weigts tat are estimated using standard east squares metod and provides quadratic approximation of restoring noninear mapping. On te oter and, for needed approximation quaity ensuring tis NN can require considerabe number of idden ayers. Approximating properties of GMDH-NN can be improved by uniting te approaces based on Group Metod of Data Handing and Radia-Basis-Functions Networks tat ave ony one idden ayer, formed by, so-caed, R-neurons. Suc networks earning reduces, as a rue, to te tuning of synaptic weigts of output ayer tat are formed by adaptive inear associators. In contrast to neurons of mutiayer structures wit poynomia or sigmoida activation functions R-neurons ave be-saped activation functions. In tis paper as activation functions mutidimensiona Epanecnikov s kernes are used. Te advantage of activation function is tat its derivatives are inear according a te parameters tat aows to adjust sufficienty simpy not ony synaptic weigts but aso centers wit receptive fieds. Proposed network combines Group Metod of Data Handing, Radia-Basis-Functions Networks and cascade networks and isn t incined to te curse of dimensionaity, is abe to rea time mode information processing by adapting its parameters and structure to probem conditions. Te mutidimensiona Epanecnikov s kernes were used as activation functions, tat aowed to introduce numericay simpe earning agoritms, wic are caracterized by ig speed. Keywords: evoving neura network, cascade networks, radia-basis neura network, Group Metod of Data Handing, mutidimensiona Epanecnikov s kernes. ACM Cassification Keywords: F. Computation by abstract devices Sef-modifying macines (e.g., neura networks), I..6 Learning Connectionism and neura nets, G.. Approximation Noninear approximation. Introduction At present artificia neura networks ave gotten a wide spread for extensive cass of pattern recognition, identification, emuation, inteigent contro, time series prediction etc. probems due to universa approximating properties and abiities to earn. As far as wen a number of practica tasks soving te voume of earning sampe is imited, ten to te foreground earning rate factor comes. At te same time not a te neura networks are abe to overcome arising probems and, first of a, so-caed overfitting. As one of te most ig-performance networks tat are earned based on optimization procedures of second order wit ig convergence rate is Radia Basis Functions Neura Network (RBFN). Output signa of tis network ineary depends on adjusting synaptic weigts. At te same time tese networks are incined to so-caed curse of dimensionaity, wen te number of radia-basis neurons of idden ayer (R-neurons) exponentiay grows wie input signas state grows. It is possibe to overcome tis probem by dividing te initia task in one or anoter way to a number of subtasks of ow dimensionaity and grouping obtained soutions to get required resut. From computationa point of view te
2 6 Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 most convenient in tis case is Group Metod of Data Handing (GMDH) [Ivaknenko, 969; Ivaknenko, 975; Ivaknenko, Stepasko, 975; Ivaknenko, Madaa, 994] tat demonstrated its efficiency wen soving a great number of practica tasks. In [Pam, Liu, 995] muti-ayered GMDH-neura network was considered. It as two-inputs N-adaines as a nodes and output of eac node is quadratic function of input signas. At te same time te synaptic weigts of eac neuron are defined in patc mode using standard east squares metod. It can be needed some more quantity of idden ayers to provide necessary approximation quaity. Tat is wy on-ine earning becomes impossibe. Hybrid arcitecture of artificia neura network based on ideas of GMDH and consequent forming of cascade neura networks [Avedyan, Barkan, Levin, 999]. Nodes of tis network are compartmenta R-neurons wit activation functions ike mutidimensiona Epanecnikov s kernes [Epanecnikov, 969; Friedman, Hastie, Tibsirani, 003; Bodyanskiy, Capanov, Koodyazniy, Otto, 00], tat ave arge degree of freedom, and tus improved approximating properties in comparison wit conventiona Gaussians. Compartmenta R-neuron wit Mutidimensiona Epanecnikov Kernes and Its Learning Agoritm Let introduce te structure of compartmenta R-neuron presented on fig. and concurring wit simpified arcitecture of conventiona Radia Basis Functions Neura Network wit two inputs x i and x, i, j =,,..., n, were n dimensionaity of input space. j w 0 xi ( k) ϕ ( x, c, Σ ) w xj ( k) ϕ ( x, c, Σ ) w Σ yˆ ( k) ϕ ( x, c, Σ ) p p p w p Fig. Compartmenta R-neuron Compartmenta R-neuron contains p activation functions (conventionay in RBFN mutidimensiona Gaussians or oter be-saped functions are used) ϕ ( x, c, Σ ), p+ synaptic weigts tat are united to vector 0 p w = ( w, w,..., w ), p two-dimensiona vector of centers c = ( i, j c c ), p ( ) matrices of receptive
3 Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 7 fieds of activation functions Σ,two-dimensiona inputs vector x = ( x, x ), one output y ˆ ; =,,..., p ; k =,,..., N number of observation in processing sampe or index of current discrete time. Mutidimensiona Epanecnikov s kernes are used as activation functions ϕ ( x, c, Σ ) i j ϕ (,, Σ ) = x c x c, () ( Σ ) tat ave be-saped by positive definite matrix of receptive fied Σ. Te advantage of activation function () in comparison wit conventiona ones is in inearity of its derivatives wit respect to a te parameters tat aows to adjust not ony synaptic weigts but aso centers wit receptive fieds sufficienty easy. At te same time, transformation tat is reaized by compartmenta R-neura as a form p ˆ = 0 + ϕ (,, Σ ) y = 0 + w w x c w w x c ( Σ ). = = Usuay RBFN earning comes to synaptic weigts p w adjusting, but centers and caracteristics of receptive fieds are defined priory. At te same time for two-dimensiona case it is sufficienty easy to ocate te centers at te reguar attice nodes and define receptive fied as circes. Learning process itsef consists of synaptic weigts vector w estimating by earning sampe containing N observations x ( k) = ( xi( k), xj( k )), yk ( ), k =,,..., N, were yk ( ) - externa earning signa. By introducing to te consideration ( p + ) -vector of activation functions ϕ ( k) = (, ϕ ( x ( k), c, Σ ),..., ϕ ( x ( k), c, Σ )) and earning criterion p p p N N N N = ˆ ( ( ) ( )) = ( ) = ( ( ) ( ) ϕ ( )) k= k= k= E yk y k e k yk w k, () using standard east squares metod it is easy to obtain required soution in te form + were () symbo of inversion by Moore-Penrose. + N N w = ϕ ( k)( ϕ ( k)) ϕ ( kyk ) ( ), (3) k= k= If te data are fed to te processing consequenty in on-ine mode, ten instead of (3) can be used its recurrent variant in te form P ( k)( yk ( ) ( w ( k)) ϕ ( k)) w ( k) = w ( k ) + ϕ ( k), + ( ϕ ( k)) P ( k ) ϕ ( k) P ( k ) ϕ ( k)( ϕ ( k)) P ( k ) P ( k) = P ( k ), P ( 0) = γι, γ >> 0. + ( ϕ ( k)) P ( k ) ϕ ( k) Agoritms (3) and (4) are effective ony in te cases, wen required soution is stationary, tat is, optima vaues of synaptic weigts aren t variabe in time. Since in many practica tasks it is not so, for exampe, adaptive identification of non-stationary objects or non-stationary time series prediction, ten ig-performance adaptive earning agoritm aving tracking and fitering properties can be used [Bodyanskiy, Koodyazniy, Stepan, 00]: (4)
4 8 Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 w = + η ϕ ϕ = ( k) w ( k ) w( k)( y( k) ( w ( k )) ( k)) ( k) = ( ) + w k ηw( ke ) ( k) ϕ ( k), ηw ( k) = rw( k) = αrw( k ) + ϕ ( k), 0 α, were α smooting parameter tat defines compromise between fitering and tracking properties. For te purpose of compartmenta R-neuron approximating properties improving not ony synaptic weigts but aso centers wit receptive fieds can be adjusted. At te same owing to Epanecnikov s kernes using earning agoritms ave sufficienty simpe form. By using gradient procedure of criterion () minimization and its rate optimization tecnique [Otto, Bodyanskiy, Koodyazniy, 003] we obtain compartmenta R-neuron earning agoritm in te form w ( k) = w ( k ) + ηw( k) e( k) ϕ ( k), ηw ( k) = rw( k) = αrw( k ) + ϕ ( k), c( k) = c( k ) + ηc( k) e( k) w ( k) ( Σ( k ) ) ( x ( k) c( k )) = = c( k ) + ηc( ke ) ( kg ) ( k), ηc ( k) = rc( k) = αrc( k ) + g( k), ( Σ ( k )) = ( Σ( k ) ) ησ( k) e( k) w ( k)( x ( k) c( k))( x ( k) c( k)) = = ( Σ( k) ) ησ( ke ) ( kg ) ( k), ησ ( k) =Γ Σ( k) = αγσ( k ) + Tr( G( k) G( k)). Evoving Cascade Neura Network Uniting of GMDH and cascade neura networks ideas eads to arcitecture presented on fig.. x x CR-N [] CR-N [] 3 CR-N [] [ ] CR-N [3] [ 3] x n CR-N [] SB yˆ Cn [ Cn ] ˆ y CR-N [ Cn ] [ Cn ] ˆ y Fig. Evoving cascade neura network Te first idden ayer of te network is formed simiary to te first idden ayer of GMDH neura network [Pam, Liu, 995] and contains te number of neurons equa to quantity of combinations of n in, tat is C n. Seection
5 Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 9 bock SB executes sorting by accuracy, for exampe, in te sense of variations, of a output signas te most accurate signa is [ ]* ˆ C n y so tat, ten and te worst is y. Outputs of SB and ten are fed to te one neuron of te second ayer-cascade CR-N [] tat computes signa combined wit 3 [] ˆ [ ] wic in te tird cascade is. Te process of cascades increasing asts ti required accuracy obtaining, at te same time, maxima neurons number of tis network is restricted by te vaue C n. Tus, neura network is abe to process information tat are fed in rea time by readjusting bot its parameters and its arcitecture in time [Kasabov, 003] and by adapting to te conditions of te soving task. Concusion Arcitecture of evoving cascade radia-basis neura network was proposed in tis paper. It is formed based on te idea of combining GMDH and cascade networks. Aso tis network is not disposed to te curse of dimensionaity and is abe to process information in rea time by adapting its parameters and structure to te soving task conditions. Using of mutidimensiona Epanecnikov s kernes as activation functions aowed to introduce numericay simpe earning agoritms tat are caracterized by ig-performance. Acknowedgements Te paper is pubised wit financia support by te project ITHEA XXI of te Institute of Information Teories and Appications FOI ITHEA ( ) and te Association of Deveopers and Users of Inteigent Systems ADUIS Ukraine ( ). Bibiograpy [Ivaknenko, 969] Ivaknenko A.G. Sef-earning systems for recognition and automatic contro. Tecnika, Kiev, 969 (in Russian). [Ivaknenko, 975] Ivaknenko A.G. Long-term prediction and compex systems contro. Tecnika, Kiev, 975 (in Russian). [Ivaknenko, Stepasko, 975] Ivaknenko A.G., Stepasko V.S. Modeing noise-immunity. Naukova Dumka, Kiev, 975 (in Russian). [Ivaknenko, Madaa, 994] Ivaknenko A.G., Madaa H.R. Inductive Learning Agoritms for Compex Systems Modeing. CRC Press, London-Tokio,994. [Pam, Liu, 995] Pam D.J., Liu X. Neura Networks for Identification, Prediction and Contro. Springer-Verag, London, 995. [Avedyan, Barkan, Levin, 999] Avedyan E. D., Barkan G.V., Levin I.K. Cascade neura networks // Avtomatika i Teemekanika P (in Russian). [Epanecnikov, 969] Epanecnikov V.A. Non-parametric estimate of mutidimensiona probabiity density // Probabiity teory and its appication P (in Russian). [Friedman, Hastie, Tibsirani, 003] Friedman J., Hastie T., Tibsirani R. Te Eements of Statistica Learning. Data Mining, Inference and Prediction. Springer, Berin, 003. [Bodyanskiy, Capanov, Koodyazniy, Otto, 00] Bodyanskiy Ye., Capanov O., Koodyazniy V., Otto P. Adaptive quadratic radia basis function network for time series forecasting // Proc. East West Fuzzy Co. 00. Zittau/Goeritz: HS, 00. P.64-7.
6 30 Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 [Bodyanskiy, Koodyazniy, Stepan, 00] Bodyanskiy Ye., Koodyazniy V., Stepan A. An adaptive earning agoritm for a neuro-fuzzy network / Ed. by B.Reusc Computationa Inteigence. Teory and Appications. Berin-Heideberg- New York: Springer, 00. P [Otto, Bodyanskiy, Koodyazniy, 003] Otto P., Bodyanskiy Ye., Koodyazniy V. A new earning agoritm for forecasting neuro-fuzzy network// Integrated Computer-Aided Engineering P [Kasabov, 003] Kasabov N. Evoving Connectionist Systems: Metods and Appications in Bioinformatics. Springer Verag, London, 003. Autors' Information Yevgeniy Bodyanskiy Professor, Dr.-Ing. abi. Scientific ead of Contro Systems Researc Laboratory, KNURE, Senior member of IEEE, professor of Artificia Inteigence Department of KNURE. e-mai: bodya@kture.karkov.ua Major Fieds of Scientific Researc: ybrid systems of computationa inteigence. Pau Grimm Professor, Computer Grapics Department, Erfurt University of Appied Sciences. e-mai: grimm@f-erfurt.de Major Fieds of Scientific Researc: image processing using inteigent computer tecnoogies. Nataiya Tesenko P.D., Senior researcer of Contro Systems Researc Laboratory, KNURE. e-mai: ntntp@ukr.net Major Fieds of Scientific Researc: sef-earning evoving neuro-fuzzy modes and systems in te inteigent data anaysis tasks
Appendix A: MATLAB commands for neural networks
Appendix A: MATLAB commands for neura networks 132 Appendix A: MATLAB commands for neura networks p=importdata('pn.xs'); t=importdata('tn.xs'); [pn,meanp,stdp,tn,meant,stdt]=prestd(p,t); for m=1:10 net=newff(minmax(pn),[m,1],{'tansig','purein'},'trainm');
More informationTheory and implementation behind: Universal surface creation - smallest unitcell
Teory and impementation beind: Universa surface creation - smaest unitce Bjare Brin Buus, Jaob Howat & Tomas Bigaard September 15, 218 1 Construction of surface sabs Te aim for tis part of te project is
More informationAn advanced variant of an interpolatory graphical display algorithm
App. Num. Ana. Comp. Mat., No., 04 2 (2004) / DOI 0.002/anac.20030009 An advanced variant o an interpoatory grapica dispay agoritm G. Aa, E. Francomano 2,3, A.Tortorici 2, 3, E.Toscano 4, and F. Vioa Dipartimento
More informationStatistical Learning Theory: A Primer
Internationa Journa of Computer Vision 38(), 9 3, 2000 c 2000 uwer Academic Pubishers. Manufactured in The Netherands. Statistica Learning Theory: A Primer THEODOROS EVGENIOU, MASSIMILIANO PONTIL AND TOMASO
More informationSVM: Terminology 1(6) SVM: Terminology 2(6)
Andrew Kusiak Inteigent Systems Laboratory 39 Seamans Center he University of Iowa Iowa City, IA 54-57 SVM he maxima margin cassifier is simiar to the perceptron: It aso assumes that the data points are
More informationA Solution to the 4-bit Parity Problem with a Single Quaternary Neuron
Neura Information Processing - Letters and Reviews Vo. 5, No. 2, November 2004 LETTER A Soution to the 4-bit Parity Probem with a Singe Quaternary Neuron Tohru Nitta Nationa Institute of Advanced Industria
More informationReliability: Theory & Applications No.3, September 2006
REDUNDANCY AND RENEWAL OF SERVERS IN OPENED QUEUING NETWORKS G. Sh. Tsitsiashvii M.A. Osipova Vadivosto, Russia 1 An opened queuing networ with a redundancy and a renewa of servers is considered. To cacuate
More informationKeywords: Surrogate modelling, data fusion, incomplete factorial DoE, tensor approximation
Buiding Data Fusion Surrogate Modes for Spacecraft Aerodynamic Probems wit Incompete Factoria Design of Experiments Miai Beyaev 1,, 3, a, Evgeny Burnaev 1,, 3, b, Erme apusev 1,, c, Stepane Aestra 4, d,
More informationStatistical Learning Theory: a Primer
??,??, 1 6 (??) c?? Kuwer Academic Pubishers, Boston. Manufactured in The Netherands. Statistica Learning Theory: a Primer THEODOROS EVGENIOU AND MASSIMILIANO PONTIL Center for Bioogica and Computationa
More informationSupplemental Notes to. Physical Geodesy GS6776. Christopher Jekeli. Geodetic Science School of Earth Sciences Ohio State University
Suppementa Notes to ysica Geodesy GS6776 Cristoper Jekei Geodetic Science Scoo of Eart Sciences Oio State University 016 I. Terrain eduction (or Correction): Te terrain correction is a correction appied
More informationA Novel Learning Method for Elman Neural Network Using Local Search
Neura Information Processing Letters and Reviews Vo. 11, No. 8, August 2007 LETTER A Nove Learning Method for Eman Neura Networ Using Loca Search Facuty of Engineering, Toyama University, Gofuu 3190 Toyama
More informationMultilayer Kerceptron
Mutiayer Kerceptron Zotán Szabó, András Lőrincz Department of Information Systems, Facuty of Informatics Eötvös Loránd University Pázmány Péter sétány 1/C H-1117, Budapest, Hungary e-mai: szzoi@csetehu,
More informationDISTRIBUTION OF TEMPERATURE IN A SPATIALLY ONE- DIMENSIONAL OBJECT AS A RESULT OF THE ACTIVE POINT SOURCE
DISTRIBUTION OF TEMPERATURE IN A SPATIALLY ONE- DIMENSIONAL OBJECT AS A RESULT OF THE ACTIVE POINT SOURCE Yury Iyushin and Anton Mokeev Saint-Petersburg Mining University, Vasiievsky Isand, 1 st ine, Saint-Petersburg,
More informationSample Problems for Third Midterm March 18, 2013
Mat 30. Treibergs Sampe Probems for Tird Midterm Name: Marc 8, 03 Questions 4 appeared in my Fa 000 and Fa 00 Mat 30 exams (.)Let f : R n R n be differentiabe at a R n. (a.) Let g : R n R be defined by
More informationA Ridgelet Kernel Regression Model using Genetic Algorithm
A Ridgeet Kerne Regression Mode using Genetic Agorithm Shuyuan Yang, Min Wang, Licheng Jiao * Institute of Inteigence Information Processing, Department of Eectrica Engineering Xidian University Xi an,
More informationDetermining The Degree of Generalization Using An Incremental Learning Algorithm
Determining The Degree of Generaization Using An Incrementa Learning Agorithm Pabo Zegers Facutad de Ingeniería, Universidad de os Andes San Caros de Apoquindo 22, Las Condes, Santiago, Chie pzegers@uandes.c
More informationThe Bending of Rectangular Deep Beams with Fixed at Both Ends under Uniform Load
Engineering,,, 8-9 doi:.6/eng..7 Pubised Onine December (ttp://.scirp.org/journa/eng) Te Bending of Rectanguar Deep Beams it Fied at Bot Ends under Uniform Load Abstract Ying-Jie Cen, Bao-Lian Fu, Gang
More informationA Brief Introduction to Markov Chains and Hidden Markov Models
A Brief Introduction to Markov Chains and Hidden Markov Modes Aen B MacKenzie Notes for December 1, 3, &8, 2015 Discrete-Time Markov Chains You may reca that when we first introduced random processes,
More informationSteepest Descent Adaptation of Min-Max Fuzzy If-Then Rules 1
Steepest Descent Adaptation of Min-Max Fuzzy If-Then Rues 1 R.J. Marks II, S. Oh, P. Arabshahi Λ, T.P. Caude, J.J. Choi, B.G. Song Λ Λ Dept. of Eectrica Engineering Boeing Computer Services University
More informationA Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c)
A Simpe Efficient Agorithm of 3-D Singe-Source Locaization with Uniform Cross Array Bing Xue a * Guangyou Fang b Yicai Ji c Key Laboratory of Eectromagnetic Radiation Sensing Technoogy, Institute of Eectronics,
More informationConverting Z-number to Fuzzy Number using. Fuzzy Expected Value
ISSN 1746-7659, Engand, UK Journa of Information and Computing Science Vo. 1, No. 4, 017, pp.91-303 Converting Z-number to Fuzzy Number using Fuzzy Expected Vaue Mahdieh Akhbari * Department of Industria
More informationReliable Computation of Local Quantities of Interest in Composite Laminated Plates
Reiabe Computation of Loca Quantities of Interest in Composite Laminated Pates P. M. Moite * and C. S. Upadyay Indian Institute of Tecnoogy, Kanpur, Uttar Prades 0806, India In te present study a famiy
More informationChemistry 3502 Physical Chemistry II (Quantum Mechanics) 3 Credits Fall Semester 2003 Christopher J. Cramer. Lecture 12, October 1, 2003
Cemistry 350 Pysica Cemistry II (Quantum Mecanics) 3 Credits Fa Semester 003 Cristoper J. Cramer Lecture 1, October 1, 003 Soved Homework We are asked to demonstrate te ortogonaity of te functions Φ(φ)
More informationMoreau-Yosida Regularization for Grouped Tree Structure Learning
Moreau-Yosida Reguarization for Grouped Tree Structure Learning Jun Liu Computer Science and Engineering Arizona State University J.Liu@asu.edu Jieping Ye Computer Science and Engineering Arizona State
More informationArtificial Neural Network Model Based Estimation of Finite Population Total
International Journal of Science and Researc (IJSR), India Online ISSN: 2319-7064 Artificial Neural Network Model Based Estimation of Finite Population Total Robert Kasisi 1, Romanus O. Odiambo 2, Antony
More information232 Calculus and Structures
3 Calculus and Structures CHAPTER 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS FOR EVALUATING BEAMS Calculus and Structures 33 Copyrigt Capter 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS 17.1 THE
More informationJoint Flow Control, Routing and Medium Access Control in Random Access Multi-Hop Wireless Networks with Time Varying Link Capacities
22 ECTI TRANSACTIONS ON ELECTRICAL ENG., ELECTRONICS, AND COMMUNICATIONS VOL.8, NO.1 February 2010 Joint Fow Contro, Routing and Medium Access Contro in Random Access Muti-Hop Wireess Networks wit Time
More informationAdaptive Noise Cancellation Using Deep Cerebellar Model Articulation Controller
daptive Noise Canceation Using Deep Cerebear Mode rticuation Controer Yu Tsao, Member, IEEE, Hao-Chun Chu, Shih-Wei an, Shih-Hau Fang, Senior Member, IEEE, Junghsi ee*, and Chih-Min in, Feow, IEEE bstract
More informationInductive Bias: How to generalize on novel data. CS Inductive Bias 1
Inductive Bias: How to generaize on nove data CS 478 - Inductive Bias 1 Overfitting Noise vs. Exceptions CS 478 - Inductive Bias 2 Non-Linear Tasks Linear Regression wi not generaize we to the task beow
More informationNonlinear Gaussian Filtering via Radial Basis Function Approximation
51st IEEE Conference on Decision and Contro December 10-13 01 Maui Hawaii USA Noninear Gaussian Fitering via Radia Basis Function Approximation Huazhen Fang Jia Wang and Raymond A de Caafon Abstract This
More informationDIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM
DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM MIKAEL NILSSON, MATTIAS DAHL AND INGVAR CLAESSON Bekinge Institute of Technoogy Department of Teecommunications and Signa Processing
More informationOptimality of Inference in Hierarchical Coding for Distributed Object-Based Representations
Optimaity of Inference in Hierarchica Coding for Distributed Object-Based Representations Simon Brodeur, Jean Rouat NECOTIS, Département génie éectrique et génie informatique, Université de Sherbrooke,
More informationA. Distribution of the test statistic
A. Distribution of the test statistic In the sequentia test, we first compute the test statistic from a mini-batch of size m. If a decision cannot be made with this statistic, we keep increasing the mini-batch
More informationMARKOV CHAINS AND MARKOV DECISION THEORY. Contents
MARKOV CHAINS AND MARKOV DECISION THEORY ARINDRIMA DATTA Abstract. In this paper, we begin with a forma introduction to probabiity and expain the concept of random variabes and stochastic processes. After
More informationVolume 13, MAIN ARTICLES
Voume 13, 2009 1 MAIN ARTICLES THE BASIC BVPs OF THE THEORY OF ELASTIC BINARY MIXTURES FOR A HALF-PLANE WITH CURVILINEAR CUTS Bitsadze L. I. Vekua Institute of Appied Mathematics of Iv. Javakhishvii Tbiisi
More informationAn Algorithm for Pruning Redundant Modules in Min-Max Modular Network
An Agorithm for Pruning Redundant Modues in Min-Max Moduar Network Hui-Cheng Lian and Bao-Liang Lu Department of Computer Science and Engineering, Shanghai Jiao Tong University 1954 Hua Shan Rd., Shanghai
More informationExplicit overall risk minimization transductive bound
1 Expicit overa risk minimization transductive bound Sergio Decherchi, Paoo Gastado, Sandro Ridea, Rodofo Zunino Dept. of Biophysica and Eectronic Engineering (DIBE), Genoa University Via Opera Pia 11a,
More informationRajesh C. Shah 1,*, Dilip B. Patel 2
Appied Matematics (5): 76-83 DOI:.593/j.am.5.5 Matematica Modeing of newy Designed Ferrofuid Based Sider Bearing Incuding Effects of Porosity Anisotropic Permeabiity Sip Veocity at bot te Ends Squeeze
More informationLearning Structural Changes of Gaussian Graphical Models in Controlled Experiments
Learning Structura Changes of Gaussian Graphica Modes in Controed Experiments Bai Zhang and Yue Wang Bradey Department of Eectrica and Computer Engineering Virginia Poytechnic Institute and State University
More informationSVM-based Supervised and Unsupervised Classification Schemes
SVM-based Supervised and Unsupervised Cassification Schemes LUMINITA STATE University of Pitesti Facuty of Mathematics and Computer Science 1 Targu din Vae St., Pitesti 110040 ROMANIA state@cicknet.ro
More informationAdaptive Fuzzy Sliding Control for a Three-Link Passive Robotic Manipulator
Adaptive Fuzzy Siding Contro for a hree-link Passive Robotic anipuator Abstract An adaptive fuzzy siding contro (AFSC scheme is proposed to contro a passive robotic manipuator. he motivation for the design
More information18-660: Numerical Methods for Engineering Design and Optimization
8-660: Numerica Methods for Engineering esign and Optimization in i epartment of ECE Carnegie Meon University Pittsburgh, PA 523 Side Overview Conjugate Gradient Method (Part 4) Pre-conditioning Noninear
More informationConvolutional Networks 2: Training, deep convolutional networks
Convoutiona Networks 2: Training, deep convoutiona networks Hakan Bien Machine Learning Practica MLP Lecture 8 30 October / 6 November 2018 MLP Lecture 8 / 30 October / 6 November 2018 Convoutiona Networks
More informationKernel Trick Embedded Gaussian Mixture Model
Kerne Trick Embedded Gaussian Mixture Mode Jingdong Wang, Jianguo Lee, and Changshui Zhang State Key Laboratory of Inteigent Technoogy and Systems Department of Automation, Tsinghua University Beijing,
More informationD. Prémel, J.M. Decitre and G. Pichenot. CEA, LIST, F Gif-sur-Yvette, France
SIMULATION OF EDDY CURRENT INSPECTION INCLUDING MAGNETIC FIELD SENSOR SUCH AS A GIANT MAGNETO-RESISTANCE OVER PLANAR STRATIFIED MEDIA COMPONENTS WITH EMBEDDED FLAWS D. Préme, J.M. Decitre and G. Pichenot
More informationFirst-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries
c 26 Noninear Phenomena in Compex Systems First-Order Corrections to Gutzwier s Trace Formua for Systems with Discrete Symmetries Hoger Cartarius, Jörg Main, and Günter Wunner Institut für Theoretische
More informationThe EM Algorithm applied to determining new limit points of Mahler measures
Contro and Cybernetics vo. 39 (2010) No. 4 The EM Agorithm appied to determining new imit points of Maher measures by Souad E Otmani, Georges Rhin and Jean-Marc Sac-Épée Université Pau Veraine-Metz, LMAM,
More informationNumerical solution of one dimensional contaminant transport equation with variable coefficient (temporal) by using Haar wavelet
Goba Journa of Pure and Appied Mathematics. ISSN 973-1768 Voume 1, Number (16), pp. 183-19 Research India Pubications http://www.ripubication.com Numerica soution of one dimensiona contaminant transport
More information4 Separation of Variables
4 Separation of Variabes In this chapter we describe a cassica technique for constructing forma soutions to inear boundary vaue probems. The soution of three cassica (paraboic, hyperboic and eiptic) PDE
More informationNumerical Differentiation
Numerical Differentiation Finite Difference Formulas for te first derivative (Using Taylor Expansion tecnique) (section 8.3.) Suppose tat f() = g() is a function of te variable, and tat as 0 te function
More informationTraining Algorithm for Extra Reduced Size Lattice Ladder Multilayer Perceptrons
Training Agorithm for Extra Reduced Size Lattice Ladder Mutiayer Perceptrons Daius Navakauskas Division of Automatic Contro Department of Eectrica Engineering Linköpings universitet, SE-581 83 Linköping,
More informationTarget Location Estimation in Wireless Sensor Networks Using Binary Data
Target Location stimation in Wireess Sensor Networks Using Binary Data Ruixin Niu and Pramod K. Varshney Department of ectrica ngineering and Computer Science Link Ha Syracuse University Syracuse, NY 344
More informationA = h w (1) Error Analysis Physics 141
Introduction In all brances of pysical science and engineering one deals constantly wit numbers wic results more or less directly from experimental observations. Experimental observations always ave inaccuracies.
More informationIntuitionistic Fuzzy Optimization Technique for Nash Equilibrium Solution of Multi-objective Bi-Matrix Games
Journa of Uncertain Systems Vo.5, No.4, pp.27-285, 20 Onine at: www.jus.org.u Intuitionistic Fuzzy Optimization Technique for Nash Equiibrium Soution of Muti-objective Bi-Matri Games Prasun Kumar Naya,,
More informationTitle: Crack Diagnostics via Fourier Transform: Real and Imaginary Components vs. Power Spectral Density
Tite: rack Diagnostics via ourier Transform: ea and maginary omponents vs. Power pectra Density Authors: Leonid M. Geman Victor Giurgiutiu van V. Petrunin 3 rd nternationa Workshop on tructura Heath Monitoring
More informationBayesian Learning. You hear a which which could equally be Thanks or Tanks, which would you go with?
Bayesian Learning A powerfu and growing approach in machine earning We use it in our own decision making a the time You hear a which which coud equay be Thanks or Tanks, which woud you go with? Combine
More informationEvolutionary Product-Unit Neural Networks for Classification 1
Evoutionary Product-Unit Neura Networs for Cassification F.. Martínez-Estudio, C. Hervás-Martínez, P. A. Gutiérrez Peña A. C. Martínez-Estudio and S. Ventura-Soto Department of Management and Quantitative
More informationPolar Snakes: a fast and robust parametric active contour model
Poar Snakes: a fast and robust parametric active contour mode Christophe Coewet To cite this version: Christophe Coewet. Poar Snakes: a fast and robust parametric active contour mode. IEEE Int. Conf. on
More informationA proposed nonparametric mixture density estimation using B-spline functions
A proposed nonparametric mixture density estimation using B-spine functions Atizez Hadrich a,b, Mourad Zribi a, Afif Masmoudi b a Laboratoire d Informatique Signa et Image de a Côte d Opae (LISIC-EA 4491),
More informationStatistics for Applications. Chapter 7: Regression 1/43
Statistics for Appications Chapter 7: Regression 1/43 Heuristics of the inear regression (1) Consider a coud of i.i.d. random points (X i,y i ),i =1,...,n : 2/43 Heuristics of the inear regression (2)
More informationDepartment of Statistics & Operations Research, Aligarh Muslim University, Aligarh, India
Open Journal of Optimization, 04, 3, 68-78 Publised Online December 04 in SciRes. ttp://www.scirp.org/ournal/oop ttp://dx.doi.org/0.436/oop.04.34007 Compromise Allocation for Combined Ratio Estimates of
More informationSolution of Wave Equation by the Method of Separation of Variables Using the Foss Tools Maxima
Internationa Journa of Pure and Appied Mathematics Voume 117 No. 14 2017, 167-174 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-ine version) ur: http://www.ijpam.eu Specia Issue ijpam.eu Soution
More informationProblem set 6 The Perron Frobenius theorem.
Probem set 6 The Perron Frobenius theorem. Math 22a4 Oct 2 204, Due Oct.28 In a future probem set I want to discuss some criteria which aow us to concude that that the ground state of a sef-adjoint operator
More informationSource and Relay Matrices Optimization for Multiuser Multi-Hop MIMO Relay Systems
Source and Reay Matrices Optimization for Mutiuser Muti-Hop MIMO Reay Systems Yue Rong Department of Eectrica and Computer Engineering, Curtin University, Bentey, WA 6102, Austraia Abstract In this paper,
More informationStochastic Variational Inference with Gradient Linearization
Stochastic Variationa Inference with Gradient Linearization Suppementa Materia Tobias Pötz * Anne S Wannenwetsch Stefan Roth Department of Computer Science, TU Darmstadt Preface In this suppementa materia,
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc
More informationWorst Case Analysis of the Analog Circuits
Proceedings of the 11th WSEAS Internationa Conference on CIRCUITS, Agios Nikoaos, Crete Isand, Greece, Juy 3-5, 7 9 Worst Case Anaysis of the Anaog Circuits ELENA NICULESCU*, DORINA-MIOARA PURCARU* and
More informationEfficiently Generating Random Bits from Finite State Markov Chains
1 Efficienty Generating Random Bits from Finite State Markov Chains Hongchao Zhou and Jehoshua Bruck, Feow, IEEE Abstract The probem of random number generation from an uncorreated random source (of unknown
More informationBP neural network-based sports performance prediction model applied research
Avaiabe onine www.jocpr.com Journa of Chemica and Pharmaceutica Research, 204, 6(7:93-936 Research Artice ISSN : 0975-7384 CODEN(USA : JCPRC5 BP neura networ-based sports performance prediction mode appied
More informationFFTs in Graphics and Vision. Spherical Convolution and Axial Symmetry Detection
FFTs in Graphics and Vision Spherica Convoution and Axia Symmetry Detection Outine Math Review Symmetry Genera Convoution Spherica Convoution Axia Symmetry Detection Math Review Symmetry: Given a unitary
More informationFunction Composition and Chain Rules
Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function
More informationUniprocessor Feasibility of Sporadic Tasks with Constrained Deadlines is Strongly conp-complete
Uniprocessor Feasibiity of Sporadic Tasks with Constrained Deadines is Strongy conp-compete Pontus Ekberg and Wang Yi Uppsaa University, Sweden Emai: {pontus.ekberg yi}@it.uu.se Abstract Deciding the feasibiity
More information830. Nonlinear dynamic characteristics of SMA simply supported beam in axial stochastic excitation
8. Noninear dynamic characteristics of SMA simpy supported beam in axia stochastic excitation Zhi-Wen Zhu 1, Wen-Ya Xie, Jia Xu 1 Schoo of Mechanica Engineering, Tianjin University, 9 Weijin Road, Tianjin
More informationResearch Article On the Lower Bound for the Number of Real Roots of a Random Algebraic Equation
Appied Mathematics and Stochastic Anaysis Voume 007, Artice ID 74191, 8 pages doi:10.1155/007/74191 Research Artice On the Lower Bound for the Number of Rea Roots of a Random Agebraic Equation Takashi
More informationWidth of Percolation Transition in Complex Networks
APS/23-QED Width of Percoation Transition in Compex Networs Tomer Kaisy, and Reuven Cohen 2 Minerva Center and Department of Physics, Bar-Ian University, 52900 Ramat-Gan, Israe 2 Department of Computer
More informationTrainable fusion rules. I. Large sample size case
Neura Networks 19 (2006) 1506 1516 www.esevier.com/ocate/neunet Trainabe fusion rues. I. Large sampe size case Šarūnas Raudys Institute of Mathematics and Informatics, Akademijos 4, Vinius 08633, Lithuania
More informationAM:BM. Graz University of Technology Institute of Applied Mechanics
M:BM Graz University of Tecnoogy Institute of ppied Mecanics Preprint No 0/01 Finite Eement Pate Formuation for te coustica Investigation of Tin ir Layers Ping Rong, Otto von Estorff Institute of Modeing
More informationStrauss PDEs 2e: Section Exercise 1 Page 1 of 7
Strauss PDEs 2e: Section 4.3 - Exercise 1 Page 1 of 7 Exercise 1 Find the eigenvaues graphicay for the boundary conditions X(0) = 0, X () + ax() = 0. Assume that a 0. Soution The aim here is to determine
More informationTracking Control of Multiple Mobile Robots
Proceedings of the 2001 IEEE Internationa Conference on Robotics & Automation Seou, Korea May 21-26, 2001 Tracking Contro of Mutipe Mobie Robots A Case Study of Inter-Robot Coision-Free Probem Jurachart
More informationHYDROGEN ATOM SELECTION RULES TRANSITION RATES
DOING PHYSICS WITH MATLAB QUANTUM PHYSICS Ian Cooper Schoo of Physics, University of Sydney ian.cooper@sydney.edu.au HYDROGEN ATOM SELECTION RULES TRANSITION RATES DOWNLOAD DIRECTORY FOR MATLAB SCRIPTS
More informationA Neural-Network Approach for Visual Cryptography and Authorization
Neura-Networ pproac for Visua Cryptograpy and utorization ai-wen Yue Computer Science and Engineering atung University aiwan twyu@mai.cse.ttu.edu.tw Sucen Ciang Computer Science and Engineering atung University
More informationON THE PERFORMANCE OF ROUGH INCLINED STEPPED COMPOSITE BEARINGS WITH MICROPOLAR FLUID
Journa of Marine Science and Tecnoogy, Vo. 8, o., pp. -4 () O THE PERFORMACE OF ROUGH ICLIED STEPPED COMPOSITE BEARIGS WITH MICROPOLAR FLUID eminat Bujappa aduvinamani and Siddangouda Apparao Key words:
More informationFrom Margins to Probabilities in Multiclass Learning Problems
From Margins to Probabiities in Muticass Learning Probems Andrea Passerini and Massimiiano Ponti 2 and Paoo Frasconi 3 Abstract. We study the probem of muticass cassification within the framework of error
More informationIssues Causal Modeling is Usually Unidirectional
Fuzzy Diagnosis Kai Goebe Bi Cheetham RPI/GE Goba Research goebe@cs.rpi.edu cheetham@cs.rpi.edu Diagnosis In diagnosis, we are trying to find the right cause for a set of symptoms Diagnosis is Driven by
More informationCryptanalysis of PKP: A New Approach
Cryptanaysis of PKP: A New Approach Éiane Jaumes and Antoine Joux DCSSI 18, rue du Dr. Zamenhoff F-92131 Issy-es-Mx Cedex France eiane.jaumes@wanadoo.fr Antoine.Joux@ens.fr Abstract. Quite recenty, in
More informationMathematical Scheme Comparing of. the Three-Level Economical Systems
Appied Mathematica Sciences, Vo. 11, 2017, no. 15, 703-709 IKAI td, www.m-hikari.com https://doi.org/10.12988/ams.2017.7252 Mathematica Scheme Comparing of the Three-eve Economica Systems S.M. Brykaov
More informationRegularized Regression
Regularized Regression David M. Blei Columbia University December 5, 205 Modern regression problems are ig dimensional, wic means tat te number of covariates p is large. In practice statisticians regularize
More informationON THE COMPRESSION OF RECURRENT NEURAL NETWORKS WITH AN APPLICATION TO LVCSR ACOUSTIC MODELING FOR EMBEDDED SPEECH RECOGNITION
ON THE COMPRESSION OF RECURRENT NEURAL NETWORKS WITH AN APPLICATION TO LVCSR ACOUSTIC MODELING FOR EMBEDDED SPEECH RECOGNITION Roit Prabavakar Ouais Asarif Antoine Bruguier Ian McGraw Googe Inc. {prabavakar,oasa,tonybruguier,imcgraw}@googe.com
More information6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17. Solution 7
6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17 Soution 7 Probem 1: Generating Random Variabes Each part of this probem requires impementation in MATLAB. For the
More informationBayesian Unscented Kalman Filter for State Estimation of Nonlinear and Non-Gaussian Systems
Bayesian Unscented Kaman Fiter for State Estimation of Noninear and Non-aussian Systems Zhong Liu, Shing-Chow Chan, Ho-Chun Wu and iafei Wu Department of Eectrica and Eectronic Engineering, he University
More informationUnconditional security of differential phase shift quantum key distribution
Unconditiona security of differentia phase shift quantum key distribution Kai Wen, Yoshihisa Yamamoto Ginzton Lab and Dept of Eectrica Engineering Stanford University Basic idea of DPS-QKD Protoco. Aice
More informationORTHOGONAL MULTI-WAVELETS FROM MATRIX FACTORIZATION
J. Korean Math. Soc. 46 2009, No. 2, pp. 281 294 ORHOGONAL MLI-WAVELES FROM MARIX FACORIZAION Hongying Xiao Abstract. Accuracy of the scaing function is very crucia in waveet theory, or correspondingy,
More informationStatistical Inference, Econometric Analysis and Matrix Algebra
Statistica Inference, Econometric Anaysis and Matrix Agebra Bernhard Schipp Water Krämer Editors Statistica Inference, Econometric Anaysis and Matrix Agebra Festschrift in Honour of Götz Trenker Physica-Verag
More informationTe comparison of dierent models M i is based on teir relative probabilities, wic can be expressed, again using Bayes' teorem, in terms of prior probab
To appear in: Advances in Neural Information Processing Systems 9, eds. M. C. Mozer, M. I. Jordan and T. Petsce. MIT Press, 997 Bayesian Model Comparison by Monte Carlo Caining David Barber D.Barber@aston.ac.uk
More informationIdentification of macro and micro parameters in solidification model
BULLETIN OF THE POLISH ACADEMY OF SCIENCES TECHNICAL SCIENCES Vo. 55, No. 1, 27 Identification of macro and micro parameters in soidification mode B. MOCHNACKI 1 and E. MAJCHRZAK 2,1 1 Czestochowa University
More informationTurbo Codes. Coding and Communication Laboratory. Dept. of Electrical Engineering, National Chung Hsing University
Turbo Codes Coding and Communication Laboratory Dept. of Eectrica Engineering, Nationa Chung Hsing University Turbo codes 1 Chapter 12: Turbo Codes 1. Introduction 2. Turbo code encoder 3. Design of intereaver
More informationResearch Article Optimal Control of Probabilistic Logic Networks and Its Application to Real-Time Pricing of Electricity
Hindawi Pubishing Corporation Mathematica Probems in Engineering Voume 05, Artice ID 950, 0 pages http://dxdoiorg/055/05/950 Research Artice Optima Contro of Probabiistic Logic Networks and Its Appication
More informationA Theory of Universal AI
A Theory of Universa AI Literature Marcus Hutter Kircherr, Li, and Vitanyi Presenter Prashant J. Doshi CS594: Optima Decision Maing A Theory of Universa Artificia Inteigence p.1/18 Roadmap Caim Bacground
More informationHRL-Local Infinite Triangular Array Languages
1 Engineering, echnoogy echniques Vo.59: e16161076, January-December 2016 http://dx.doi.org/10.1590/1678-4324-2016161076 ISSN 1678-4324 Onine Edition BRAZILIAN ARCHIVES OF BIOLOGY AND ECHNOLOGY A N I N
More informationCombining reaction kinetics to the multi-phase Gibbs energy calculation
7 th European Symposium on Computer Aided Process Engineering ESCAPE7 V. Pesu and P.S. Agachi (Editors) 2007 Esevier B.V. A rights reserved. Combining reaction inetics to the muti-phase Gibbs energy cacuation
More information