Nonlinear Blind Source Separation Using Hybrid Neural Networks*
|
|
- Bennett Floyd
- 6 years ago
- Views:
Transcription
1 Nolear Bld Source Separato Usg Hybrd Neural Networks* Chu-Hou Zheg,2, Zh-Ka Huag,2, chael R. Lyu 3, ad Tat-g Lok 4 Itellget Computg Lab, Isttute of Itellget aches, Chese Academy of Sceces, P.O.Box 3, Hefe, Ahu, Cha 2 Departmet of Automato, Uversty of Scece ad Techology of Cha 3 Computer Scece & Egeerg Dept., The Chese Uversty of Hog Kog, Hog Kog 4 Iformato Egeerg Dept., The Chese Uversty of Hog Kog, Shat, Hog Kog zhegch@m.ac.c Abstract. Ths paper proposes a ovel algorthm based o mmzg mutual formato for a specal case of olear bld source separato: postolear bld source separato. A etwork composed of a set of radal bass fucto (RBF) etworks, a set of multlayer perceptro ad a lear etwork s used as a demxg system to separate sources post-olear mxtures. The expermetal results show that our proposed method s effectve, ad they also show that the local character of the RBF etwork s uts allows a sgfcat speedup the trag of the system. Itroducto Bld source separato (BSS) stataeous ad covolute lear mxture has bee tesvely studed over the last decade. ost of the bld separato algorthms are based o the theory of the depedet compoet aalyss (ICA) whe the mxture model s lear [,2]. However, geeral real-world stuato, olear mxture of sgals s geerally more prevalet. For olear demxg [6,7], may dffcultes occur ad the lear ICA s o loger applcable because of the complexty of olear parameters. I ths paper, we shall -deep vestgate a specal but mportat stace of olear mxtures,.e., post-olear (PNL) mxtures, ad gve out a ovel algortthm. 2 Post-olear xtures A mportat specal case of the geeral olear mxg model that cossts of so called post-olear mxtures troduced by Taleb ad Jutte [], ca be see as a hybrd of a lear stage followed by a olear stage. * Ths work was supported by the Natoal Scece Foudato of Cha (Nos.6472, ad 642). J. Wag et al. (Eds.): ISNN 26, LNCS 397, pp. 6 7, 26. Sprger-Verlag Berl Hedelberg 26
2 66 C.-H. Zheg et al. s u f x g v y s A u f x g v B y xg system Separatg system Fg.. The mxg separatg system for PNL I the post-olear mxtures model, the observatos x = ( x, x2, L, x ) T have the followg specfc form (as show Fg. ) x = f ajsj, =, L, () j= The correspodg vector-matrx form ca be wrtte as: x = f ( As ) (2) Cotrary to geeral olear mxtures, the PNL mxtures have a favorable separablty property. I fact, f the correspodg separatg model for post-olear mxtures, as show Fgure, are wrtte as: y = b g ( x ) (3) j j j j= The t ca be demostrated that [], uder weak codtos o the mxg matrx A ad o the source dstrbuto, the output depedece ca be obtaed f ad oly f =, L,., h = g o f are lear. For more detals, please refer to lteratures []. 3 Cotrast Fucto I ths paper, we use Shao s mutual formato as the measure of mutual depedece. It ca be defed as: I( y) = H( y ) H( y ) (4) where H( y) = p( y)log p( y) dy deotes Shao s dfferetal etropy. Accordg to the theory gve above, the separatg system of PNL we proposed ths paper s show Fg.2, where B ad g form the umxg structure for PNL, y are the extracted depedet compoets, ad ψ some olear mappgs, whch are used oly for the optmzato of the etwork.
3 Nolear Bld Source Separato Usg Hybrd Neural Networks 67 Assume that each fucto ψ ( φ, y) s the cumulatve probablty fucto (CPF) of the correspodg compoet y, the z are uformly dstrbuted [, ], Cosequetly, H( z ) = [7]. oreover, because ψ ( φ, y) are all cotuous ad mootoc creasg trasformatos (thus also vertble), the t ca be easly show that I( z) = I( y )[7]. Cosequetly, we ca obta I( y) = I( z) = H( z ) H( z) = H( z ) () Therefore, maxmzg H ( z ) s equvalet to mmzg I( y ). x ψ g B y ψ z x 2 y 2 ψ 2 z 2 g 2 x y ψ z g Fg. 2. The partcular structure of the umxg etwork It has bee proved the lterature [7] that, gve the costrats placed o ψ ( φ, y), the z s bouded to [, ], ad gve that ψ ( φ, y) s also costraed to be a cotuous creasg fucto, the maxmzg H( z ) wll lead ψ ( φ, y) to become the estmates of the CPFs of y. Cosequetly, y should be the duplcate of s wth just sg ad scale ambguty. Now, the fudametal problem that we should to solve s to optmze the etworks (formed by the g, B ad ψ blocks) by maxmzg H ( z ). 4 Usupervsed Learg of Separatg System Wth respect to the separato structure of ths paper, the jot probablstc desty fucto (PDF) of the output vector z ca be calculated as: p( x) p( z) = (6) det( B) g' ( θ, x ) ψ ' ( φ, y ) = = whch leads to the followg expresso of the jot etropy: ( ) ( ψ ) H( z ) = H( x ) + log det( B ) + E log g' ( θ, x ) + E log ' ( φ, y ) (7) = =
4 68 C.-H. Zheg et al. The mmzato of I( y ), whch s equal to maxmze H ( z ) here, requres the computato of ts gradet wth respect to the separato structure parameters B, θ ad φ. I ths paper, we use RBF [3,4] etwork to model the olear parametrc fuctos gk( θ k, xk), ad choose Gaussa kerel fucto as the actvato fucto of the hdde euros. I order to mplemet the costrats o the ψ fucto easy, we use multlayer perceptro to model the olear parametrc fuctos ψ ( φ, y ). k k k Expermet Results. Extractg Sources From xtures of Smulat Sgals I the frst expermet, the source sgals cosst of a susod sgal ad a fuy. curve sgal [],.e. s ( t ) = [(rem(t,27)-3)/9,((rem(t,23)-)/9) ] T, whch are show Fg.3 (a). The two source sgals are frst learly mxed wth the (radomly chose) mxture matrx: A = (8) The, the two olear dstorto fuctos f ( u) = f ( u) = tah( u) (9) 2 are appled to each mxture for producg a PNL mxture. Fg.3 (b) shows the separated sgals. To compare the performace of our proposed method wth other oes, we also use ISEP method [7] to coduct the related expermets based o the same data. The correlatos betwee the two recovered sgals separated by two methods ad the two orgal sources are reported Table.. Clearly, the separated sgals usg the method proposed ths paper s more smlar to the orgal sgals tha the other (a) - - (b) Fg. 3. The two set of sgals show. (a) Source sgals. (b) Separated sgals.
5 Nolear Bld Source Separato Usg Hybrd Neural Networks 69 Table. Correlatos betwee two orgal sources ad the two recovered sgals Expermet smulat sgals speech sgals y y 2 y y 2 ISEP S S ethod S ths paper S Extractg Sources from xtures of Speech Sgals To test the valdty of the algorthm proposed ths paper ulterorly, we also have expermetalzed usg real-lfe speech sgals. I ths expermet two speech sgals (wth 3 samples, samplg rate 8kHz, obtaed from /~relly/ kamra /d8.htm) are post-olearly mxed by: A= () 3 3 f( u) = ( u+ u ), f2 ( u) = u+ tah( u) () 2 6 The expermetal results are show Fg.4 ad Table., whch coforms the cocluso draw from the frst expermet. - - (a) (b) Fg. 4. The two set of speech sgals show. (a) Source sgals. (b) Separated sgals..3 Trag Speed We also performed tests whch we compared, o the same post-olear BSS problems, etworks whch the g blocks had LP structures. Table 2 shows the meas ad stadard devatos of epochs requred to reach the stop crtero, whch was based o the value of the objectve fucto H ( z ), for LP-based etworks ad RBF-based etworks.
6 7 C.-H. Zheg et al. Table 2. Comparso of trag speeds betwee LP-based ad RBF-based etworks Two superg Superg. ad subg. supergaussos RBF LP RBF LP ea St. dev From the two tables we ca see that the separatg results of the two methods are very smlar, but the RBF-based mplemetatos traed faster ad show a smaller oscllato of trag tmes (Oe epoch took approxmately the same tme both kds of etwork). Ths maly caused by the local character of RBF etworks. 6 Coclusos We proposed ths paper a ovel algorthm for post-olear bld source separato. Ths ew method works by optmzg a etwork wth a specalzed archtecture, usg the output etropy as the objectve fucto, whch s equvalet to the mutual formato crtero but eeds ot to calculate the margal etropy of the output. Fally, the expermetal results showed that ths method s compettve to other exstg oes. Refereces. Hyväre, A., Karhue, J., Oja, E.: Idepedet Compoet Aalyss. J. Wley, New York (2) 2. Hyväre, A., Pajue, P.: Nolear Idepedet Compoet Aalyss: Exstece ad Uqueess Results. Neural Networks, 2(3) (999) Huag, D.S.: Systematc Theory of Neural Networks for Patter Recogto. Publshg House of Electroc Idustry of Cha, Bejg (996) 4. Huag, D.S.: The Uted Adaptve Learg Algorthm for the Lk Weghts ad the Shape Parameters RBFN for Patter Recogto. Iteratoal Joural of Patter Recogto ad Artfcal Itellgece.(6) (997) Taleb, A., Jutte, C.: Source Separato Post- olear xtures. IEEE Tras. Sgal Processg, 47 (999) artez, Bray, D. A.: Nolear Bld Source Separato Usg Kerels. IEEE Tras. Neural Networks, 4() (23) Almeuda, L. B.: ISEP Lear ad Nolear ICA Based o utual Iformato. Joural of ache Learg Research.4(2) (23)
Functions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationA Robust Total Least Mean Square Algorithm For Nonlinear Adaptive Filter
A Robust otal east Mea Square Algorthm For Nolear Adaptve Flter Ruxua We School of Electroc ad Iformato Egeerg X'a Jaotog Uversty X'a 70049, P.R. Cha rxwe@chare.com Chogzhao Ha, azhe u School of Electroc
More informationAn Introduction to. Support Vector Machine
A Itroducto to Support Vector Mache Support Vector Mache (SVM) A classfer derved from statstcal learg theory by Vapk, et al. 99 SVM became famous whe, usg mages as put, t gave accuracy comparable to eural-etwork
More informationBayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information
Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More informationKernel-based Methods and Support Vector Machines
Kerel-based Methods ad Support Vector Maches Larr Holder CptS 570 Mache Learg School of Electrcal Egeerg ad Computer Scece Washgto State Uverst Refereces Muller et al. A Itroducto to Kerel-Based Learg
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More informationResearch on SVM Prediction Model Based on Chaos Theory
Advaced Scece ad Techology Letters Vol.3 (SoftTech 06, pp.59-63 http://dx.do.org/0.457/astl.06.3.3 Research o SVM Predcto Model Based o Chaos Theory Sog Lagog, Wu Hux, Zhag Zezhog 3, College of Iformato
More informationPrincipal Components. Analysis. Basic Intuition. A Method of Self Organized Learning
Prcpal Compoets Aalss A Method of Self Orgazed Learg Prcpal Compoets Aalss Stadard techque for data reducto statstcal patter matchg ad sgal processg Usupervsed learg: lear from examples wthout a teacher
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationABOUT ONE APPROACH TO APPROXIMATION OF CONTINUOUS FUNCTION BY THREE-LAYERED NEURAL NETWORK
ABOUT ONE APPROACH TO APPROXIMATION OF CONTINUOUS FUNCTION BY THREE-LAYERED NEURAL NETWORK Ram Rzayev Cyberetc Isttute of the Natoal Scece Academy of Azerbaa Republc ramrza@yahoo.com Aygu Alasgarova Khazar
More informationAnalysis of Lagrange Interpolation Formula
P IJISET - Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue, December 4. www.jset.com ISS 348 7968 Aalyss of Lagrage Iterpolato Formula Vjay Dahya PDepartmet of MathematcsMaharaja Surajmal
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationGenerating Multivariate Nonnormal Distribution Random Numbers Based on Copula Function
7659, Eglad, UK Joural of Iformato ad Computg Scece Vol. 2, No. 3, 2007, pp. 9-96 Geeratg Multvarate Noormal Dstrbuto Radom Numbers Based o Copula Fucto Xaopg Hu +, Jam He ad Hogsheg Ly School of Ecoomcs
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationStudy on a Fire Detection System Based on Support Vector Machine
Sesors & Trasducers, Vol. 8, Issue, November 04, pp. 57-6 Sesors & Trasducers 04 by IFSA Publshg, S. L. http://www.sesorsportal.com Study o a Fre Detecto System Based o Support Vector Mache Ye Xaotg, Wu
More informationLecture 9: Tolerant Testing
Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have
More informationA Sensitivity-Based Adaptive Architecture Pruning Algorithm for Madalines
Advaced Scece ad echology etters, pp.84-9 http://dx.do.org/0.457/astl.06.3.35 A Sestvty-Based Adaptve Archtecture Prug Algorthm for Madales Sa J, Pg Yag, Shumg Zhog, J Wag, Jeog-Uk Km Jagsu Egeerg Ceter
More informationResearch and Simulation of FECG Signal Blind Separation Algorithm Based on Gradient Method
Research Joural of Appled Sceces, Egeerg ad Techology 4(6): 2707-27, 202 ISSN: 2040-7467 Maxwell Scetfc Orgazato, 202 Submtted: March 23, 202 Accepted: Aprl 20, 202 Publshed: August 5, 202 Research ad
More informationAnalysis of Variance with Weibull Data
Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad
More informationBayesian Classification. CS690L Data Mining: Classification(2) Bayesian Theorem: Basics. Bayesian Theorem. Training dataset. Naïve Bayes Classifier
Baa Classfcato CS6L Data Mg: Classfcato() Referece: J. Ha ad M. Kamber, Data Mg: Cocepts ad Techques robablstc learg: Calculate explct probabltes for hypothess, amog the most practcal approaches to certa
More informationUnsupervised Learning and Other Neural Networks
CSE 53 Soft Computg NOT PART OF THE FINAL Usupervsed Learg ad Other Neural Networs Itroducto Mture Destes ad Idetfablty ML Estmates Applcato to Normal Mtures Other Neural Networs Itroducto Prevously, all
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationPROJECTION PROBLEM FOR REGULAR POLYGONS
Joural of Mathematcal Sceces: Advaces ad Applcatos Volume, Number, 008, Pages 95-50 PROJECTION PROBLEM FOR REGULAR POLYGONS College of Scece Bejg Forestry Uversty Bejg 0008 P. R. Cha e-mal: sl@bjfu.edu.c
More information13. Parametric and Non-Parametric Uncertainties, Radial Basis Functions and Neural Network Approximations
Lecture 7 3. Parametrc ad No-Parametrc Ucertates, Radal Bass Fuctos ad Neural Network Approxmatos he parameter estmato algorthms descrbed prevous sectos were based o the assumpto that the system ucertates
More informationResearch Article A New Derivation and Recursive Algorithm Based on Wronskian Matrix for Vandermonde Inverse Matrix
Mathematcal Problems Egeerg Volume 05 Artcle ID 94757 7 pages http://ddoorg/055/05/94757 Research Artcle A New Dervato ad Recursve Algorthm Based o Wroska Matr for Vadermode Iverse Matr Qu Zhou Xja Zhag
More informationBERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler
Mathematcal ad Computatoal Applcatos, Vol. 8, No. 3, pp. 293-300, 203 BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS Aysegul Ayuz Dascoglu ad Nese Isler Departmet of Mathematcs,
More informationA New Family of Transformations for Lifetime Data
Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several
More informationSupport vector machines II
CS 75 Mache Learg Lecture Support vector maches II Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Learl separable classes Learl separable classes: here s a hperplae that separates trag staces th o error
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationComparing Different Estimators of three Parameters for Transmuted Weibull Distribution
Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted
More information6.867 Machine Learning
6.867 Mache Learg Problem set Due Frday, September 9, rectato Please address all questos ad commets about ths problem set to 6.867-staff@a.mt.edu. You do ot eed to use MATLAB for ths problem set though
More informationThe Generalized Inverted Generalized Exponential Distribution with an Application to a Censored Data
J. Stat. Appl. Pro. 4, No. 2, 223-230 2015 223 Joural of Statstcs Applcatos & Probablty A Iteratoal Joural http://dx.do.org/10.12785/jsap/040204 The Geeralzed Iverted Geeralzed Expoetal Dstrbuto wth a
More informationKLT Tracker. Alignment. 1. Detect Harris corners in the first frame. 2. For each Harris corner compute motion between consecutive frames
KLT Tracker Tracker. Detect Harrs corers the frst frame 2. For each Harrs corer compute moto betwee cosecutve frames (Algmet). 3. Lk moto vectors successve frames to get a track 4. Itroduce ew Harrs pots
More informationDimensionality reduction Feature selection
CS 750 Mache Learg Lecture 3 Dmesoalty reducto Feature selecto Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 750 Mache Learg Dmesoalty reducto. Motvato. Classfcato problem eample: We have a put data
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationMAX-MIN AND MIN-MAX VALUES OF VARIOUS MEASURES OF FUZZY DIVERGENCE
merca Jr of Mathematcs ad Sceces Vol, No,(Jauary 0) Copyrght Md Reader Publcatos wwwjouralshubcom MX-MIN ND MIN-MX VLUES OF VRIOUS MESURES OF FUZZY DIVERGENCE RKTul Departmet of Mathematcs SSM College
More informationCS 1675 Introduction to Machine Learning Lecture 12 Support vector machines
CS 675 Itroducto to Mache Learg Lecture Support vector maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Mdterm eam October 9, 7 I-class eam Closed book Stud materal: Lecture otes Correspodg chapters
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More informationStatistical characteristics of the normalized Stokes parameters
Scece Cha Seres F: Iformato Sceces 008 SCIENCE IN CHINA PRESS Sprger www.sccha.com fo.sccha.com www.sprgerlk.com Statstcal characterstcs of the ormalzed Stokes parameters LIU Tao 1 WANG XueSog 1 & XIAO
More informationCubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem
Joural of Amerca Scece ;6( Cubc Nopolyomal Sple Approach to the Soluto of a Secod Order Two-Pot Boudary Value Problem W.K. Zahra, F.A. Abd El-Salam, A.A. El-Sabbagh ad Z.A. ZAk * Departmet of Egeerg athematcs
More informationSupport vector machines
CS 75 Mache Learg Lecture Support vector maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 75 Mache Learg Outle Outle: Algorthms for lear decso boudary Support vector maches Mamum marg hyperplae.
More informationDynamic Analysis of Axially Beam on Visco - Elastic Foundation with Elastic Supports under Moving Load
Dyamc Aalyss of Axally Beam o Vsco - Elastc Foudato wth Elastc Supports uder Movg oad Saeed Mohammadzadeh, Seyed Al Mosayeb * Abstract: For dyamc aalyses of ralway track structures, the algorthm of soluto
More informationSystematic Selection of Parameters in the development of Feedforward Artificial Neural Network Models through Conventional and Intelligent Algorithms
THALES Project No. 65/3 Systematc Selecto of Parameters the developmet of Feedforward Artfcal Neural Network Models through Covetoal ad Itellget Algorthms Research Team G.-C. Vosakos, T. Gaakaks, A. Krmpes,
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationReliability evaluation of distribution network based on improved non. sequential Monte Carlo method
3rd Iteratoal Coferece o Mecatrocs, Robotcs ad Automato (ICMRA 205) Relablty evaluato of dstrbuto etwork based o mproved o sequetal Mote Carlo metod Je Zu, a, Cao L, b, Aog Tag, c Scool of Automato, Wua
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationMedian as a Weighted Arithmetic Mean of All Sample Observations
Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationSolving Constrained Flow-Shop Scheduling. Problems with Three Machines
It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632
More informationBlock-Based Compact Thermal Modeling of Semiconductor Integrated Circuits
Block-Based Compact hermal Modelg of Semcoductor Itegrated Crcuts Master s hess Defese Caddate: Jg Ba Commttee Members: Dr. Mg-Cheg Cheg Dr. Daqg Hou Dr. Robert Schllg July 27, 2009 Outle Itroducto Backgroud
More informationLecture 12: Multilayer perceptrons II
Lecture : Multlayer perceptros II Bayes dscrmats ad MLPs he role of hdde uts A eample Itroducto to Patter Recoto Rcardo Guterrez-Osua Wrht State Uversty Bayes dscrmats ad MLPs ( As we have see throuhout
More informationA BRUTE-FORCE ANALYTICAL FORMULATION OF THE INDEPENDENT COMPONENTS ANALYSIS SOLUTION
A BRUTE-FORCE ANALYTICAL FORMULATION OF THE INDEPENDENT COMPONENTS ANALYSIS SOLUTION Dez Erdogmus, Aat Hegde, Keeth E. Hld II, M. Ca Ozturk, Jose C. Prcpe CNEL, Electrcal & Computer Eg. Dept., Uversty
More informationA Combination of Adaptive and Line Intercept Sampling Applicable in Agricultural and Environmental Studies
ISSN 1684-8403 Joural of Statstcs Volume 15, 008, pp. 44-53 Abstract A Combato of Adaptve ad Le Itercept Samplg Applcable Agrcultural ad Evrometal Studes Azmer Kha 1 A adaptve procedure s descrbed for
More informationPermutation Tests for More Than Two Samples
Permutato Tests for ore Tha Two Samples Ferry Butar Butar, Ph.D. Abstract A F statstc s a classcal test for the aalyss of varace where the uderlyg dstrbuto s a ormal. For uspecfed dstrbutos, the permutato
More informationVOL. 3, NO. 11, November 2013 ISSN ARPN Journal of Science and Technology All rights reserved.
VOL., NO., November 0 ISSN 5-77 ARPN Joural of Scece ad Techology 0-0. All rghts reserved. http://www.ejouralofscece.org Usg Square-Root Iverted Gamma Dstrbuto as Pror to Draw Iferece o the Raylegh Dstrbuto
More informationFeature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)
CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.
More informationNumerical Simulations of the Complex Modied Korteweg-de Vries Equation. Thiab R. Taha. The University of Georgia. Abstract
Numercal Smulatos of the Complex Moded Korteweg-de Vres Equato Thab R. Taha Computer Scece Departmet The Uversty of Georga Athes, GA 002 USA Tel 0-542-2911 e-mal thab@cs.uga.edu Abstract I ths paper mplemetatos
More informationA Study of the Reproducibility of Measurements with HUR Leg Extension/Curl Research Line
HUR Techcal Report 000--9 verso.05 / Frak Borg (borgbros@ett.f) A Study of the Reproducblty of Measuremets wth HUR Leg Eteso/Curl Research Le A mportat property of measuremets s that the results should
More informationContinuous Distributions
7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f
More informationStudy of Correlation using Bayes Approach under bivariate Distributions
Iteratoal Joural of Scece Egeerg ad Techolog Research IJSETR Volume Issue Februar 4 Stud of Correlato usg Baes Approach uder bvarate Dstrbutos N.S.Padharkar* ad. M.N.Deshpade** *Govt.Vdarbha Isttute of
More informationBinary classification: Support Vector Machines
CS 57 Itroducto to AI Lecture 6 Bar classfcato: Support Vector Maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 57 Itro to AI Supervsed learg Data: D { D, D,.., D} a set of eamples D, (,,,,,
More informationA New Measure of Probabilistic Entropy. and its Properties
Appled Mathematcal Sceces, Vol. 4, 200, o. 28, 387-394 A New Measure of Probablstc Etropy ad ts Propertes Rajeesh Kumar Departmet of Mathematcs Kurukshetra Uversty Kurukshetra, Ida rajeesh_kuk@redffmal.com
More information13. Artificial Neural Networks for Function Approximation
Lecture 7 3. Artfcal eural etworks for Fucto Approxmato Motvato. A typcal cotrol desg process starts wth modelg, whch s bascally the process of costructg a mathematcal descrpto (such as a set of ODE-s)
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationA Penalty Function Algorithm with Objective Parameters and Constraint Penalty Parameter for Multi-Objective Programming
Aerca Joural of Operatos Research, 4, 4, 33-339 Publshed Ole Noveber 4 ScRes http://wwwscrporg/oural/aor http://ddoorg/436/aor4463 A Pealty Fucto Algorth wth Obectve Paraeters ad Costrat Pealty Paraeter
More informationLecture 16: Backpropogation Algorithm Neural Networks with smooth activation functions
CO-511: Learg Theory prg 2017 Lecturer: Ro Lv Lecture 16: Bacpropogato Algorthm Dsclamer: These otes have ot bee subected to the usual scruty reserved for formal publcatos. They may be dstrbuted outsde
More informationECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham
ECE 559: Wreless Commucato Project Report Dversty Multplexg Tradeoff MIMO Chaels wth partal CSIT Hoa Pham. Summary I ths project, I have studed the performace ga of MIMO systems. There are two types of
More informationBAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION
Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL
More informationCIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights
CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:
More informationAn Improved Differential Evolution Algorithm Based on Statistical Log-linear Model
Sesors & Trasducers, Vol. 59, Issue, November, pp. 77-8 Sesors & Trasducers by IFSA http://www.sesorsportal.com A Improved Dfferetal Evoluto Algorthm Based o Statstcal Log-lear Model Zhehuag Huag School
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationESTIMATION OF MISCLASSIFICATION ERROR USING BAYESIAN CLASSIFIERS
Producto Systems ad Iformato Egeerg Volume 5 (2009), pp. 4-50. ESTIMATION OF MISCLASSIFICATION ERROR USING BAYESIAN CLASSIFIERS PÉTER BARABÁS Uversty of Msolc, Hugary Departmet of Iformato Techology barabas@t.u-msolc.hu
More informationConfidence Intervals for Double Exponential Distribution: A Simulation Approach
World Academy of Scece, Egeerg ad Techology Iteratoal Joural of Physcal ad Mathematcal Sceces Vol:6, No:, 0 Cofdece Itervals for Double Expoetal Dstrbuto: A Smulato Approach M. Alrasheed * Iteratoal Scece
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationOn Fuzzy Arithmetic, Possibility Theory and Theory of Evidence
O Fuzzy rthmetc, Possblty Theory ad Theory of Evdece suco P. Cucala, Jose Vllar Isttute of Research Techology Uversdad Potfca Comllas C/ Sata Cruz de Marceado 6 8 Madrd. Spa bstract Ths paper explores
More information1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.
CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy
More informationIt is Advantageous to Make a Syllabus as Precise as Possible: Decision-Theoretic Analysis
Joural of Iovatve Techology ad Educato, Vol. 4, 2017, o. 1, 1-5 HIKARI Ltd, www.m-hkar.com https://do.org/10.12988/jte.2017.61146 It s Advatageous to Make a Syllabus as Precse as Possble: Decso-Theoretc
More informationEntropy ISSN by MDPI
Etropy 2003, 5, 233-238 Etropy ISSN 1099-4300 2003 by MDPI www.mdp.org/etropy O the Measure Etropy of Addtve Cellular Automata Hasa Aı Arts ad Sceces Faculty, Departmet of Mathematcs, Harra Uversty; 63100,
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More informationLecture 2 - What are component and system reliability and how it can be improved?
Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected
More informationGrading learning for blind source separation
Vol. 46 No. 1 SCIENCE IN CHINA (Seres F) February 2003 Gradg learg for bld source separato ZHANG Xada ( ) 1,2, ZHU Xaolog (r ) 1 & BAO Zheg ( ) 1 1. Key Laboratory for Radar Sgal Processg, Xda Uversty,
More informationLecture 07: Poles and Zeros
Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto
More informationChapter 8. Inferences about More Than Two Population Central Values
Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationANALYSIS ON THE NATURE OF THE BASIC EQUATIONS IN SYNERGETIC INTER-REPRESENTATION NETWORK
Far East Joural of Appled Mathematcs Volume, Number, 2008, Pages Ths paper s avalable ole at http://www.pphm.com 2008 Pushpa Publshg House ANALYSIS ON THE NATURE OF THE ASI EQUATIONS IN SYNERGETI INTER-REPRESENTATION
More informationImage Decomposition of Partly Noisy Images
Avalable ole at wwwscecedrectcom Proceda Egeerg 9 () 6 66 Iteratoal Workshop o Iformato ad Electrocs Egeerg (IWIEE) Image Decomposto of Partly Nosy Images Ruhua u ab** Ruzh Ja a ad yu Su a a School of
More informationUniform asymptotical stability of almost periodic solution of a discrete multispecies Lotka-Volterra competition system
Iteratoal Joural of Egeerg ad Advaced Research Techology (IJEART) ISSN: 2454-9290, Volume-2, Issue-1, Jauary 2016 Uform asymptotcal stablty of almost perodc soluto of a dscrete multspeces Lotka-Volterra
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationNP!= P. By Liu Ran. Table of Contents. The P vs. NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Strategy 3. Prelmary theorem 4. Proof 5. Expla 6. Cocluso. Itroduce The P vs. NP problem s a major usolved problem computer scece. Iformally, t asks whether
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationTowards Multi-Layer Perceptron as an Evaluator Through Randomly Generated Training Patterns
Proceedgs of the 5th WSEAS It. Cof. o Artfcal Itellgece, Kowledge Egeerg ad Data Bases, Madrd, Spa, February 5-7, 26 (pp254-258) Towards Mult-Layer Perceptro as a Evaluator Through Ramly Geerated Trag
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationRademacher Complexity. Examples
Algorthmc Foudatos of Learg Lecture 3 Rademacher Complexty. Examples Lecturer: Patrck Rebesch Verso: October 16th 018 3.1 Itroducto I the last lecture we troduced the oto of Rademacher complexty ad showed
More informationA New Development on ANN in China Biomimetic Pattern Recognition and Multi Weight Vector Neurons
A New Developmet o ANN Cha Bommetc atter Recogto ad Mult Weght Vector Neuros houue Wag Lab of Artfcal Neural Networks. Ist. of emcoductors. CA. Beg 00083 Cha wsue@red.sem.ac.c Abstract. A ew model of patter
More informationFaults Classification of a Scooter Engine Platform Using Wavelet Transform and Artificial Neural Network
Proceedgs of the Iteratoal MultCoferece of Egeers ad Computer Scetsts 9 Vol I IMECS 9, March 8 -, 9, Hog Kog Faults Classfcato of a Scooter Ege Platform Usg Wavelet Trasform ad Artfcal Neural Network J.-D.
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More information