De-noising Method Based on Kernel Adaptive Filtering for Telemetry Vibration Signal of the Vehicle Test Kejun ZENG
|
|
- Ethelbert Mills
- 5 years ago
- Views:
Transcription
1 6th Internatonal Conference on Mechatroncs, Materals, Botechnology and Envronment (ICMMBE 6) De-nosng Method Based on Kernel Adaptve Flterng for elemetry Vbraton Sgnal of the Vehcle est Kejun ZEG PLA 955 Unt 94, Laonng Dalan, 63, Chna Keywords: elemetry; Kernel Adaptve Flterng; Vbraton Sgnal; De-nosng Abstract. A kernel adaptve flterng de-nosng method for telemetry sgnal was proposed. he telemetry vbraton sgnal s often nterfered wth Gaussan nose and mpulse nose at the same tme, the tradton de-nosng method cannot obtan good de-nosng performance. In the vehcle test, the vbraton sgnal has typcal non-statonary and non-lnear characterstcs, for whch lnear flterng method s falure. Kernel adaptve flterng transforms the nput data to hgh dmenson feature space and desgns a lnear method to solve the nonlnear problem. he proposed method uses kernel adaptve flterng to suppress the nose n the vbraton sgnal of the vehcle test under norm cost functon, whch can keep effectve under non-statonary and non-lnear condtons. he smulaton and test data processng results show the good performance of the proposed method whch can apply n the telemetry vbraton sgnal processng. Introducton elemetry sgnal s the man bass for the vehcle nteror ballstcs analyss and detecton, n whch the vbraton sgnal s the most representatve that can drectly reflect the response of the vehcle structure state under dfferent ncentve condtons, and t processng results can be used to determne the health status of the vehcle structure []. he telemetry sgnal s often nterfered wth nose durng the transmsson and recepton process by transmttng and recevng equpment and the transmsson of the external envronment nfluence. he nose n the sgnal decrease the average varance estmaton precson n tme doman analyss, furthermore, serous nose nterference can lead to the dffculty of frequency doman analyss and tme doman analyss. herefore, de-nosng s an mportant part n the preprocessng of telemetry vbraton sgnal. he analyss of lots of the expermental data show that the nose n the telemetry sgnal s often not a smple Gaussan nose, for the hgh bt error generated durng the transmsson process also lead to mpulse nose. herefore, the nose n the telemetry sgnal usually shows the mxed nose form of Gaussan nose and mpulse nose []. radton de-nosng method ncludes frequency doman flterng, medan flterng, wavelet de-nosng, sngular value decomposton (SVD) and emprcal mode decomposton (EMD) based on local wave analyss, n whch the wavelet threshold de-nosng method s most wdely used n engneerng. In the de-nosng methods, frequency doman flterng request sgnal meets the statonary dstrbuton, medan flterng s sutable for mpulse nose, the wavelet threshold de-nosng and SVD needs to set artfcal parameters whch s dffcult to obtan deal performance, EMD de-nosng takes the hgh ntrnsc mode functon (IMF) as the nose whch lack of theory bass. Meanwhle, all knds of the de-nosng methods meet the dffculty that to fnd the best combnaton ponts of nose suppresson and sgnal loss of detal nformaton. For the mxed nose form de-nosng, the sngle de-nosng method has poor performance, and n vehcle test data detecton proves that the telemetry sgnals often appear non-statonary characterstcs [3]. Kernel adaptve flterng provdes a new method for sgnal de-nosng, whch can map the nput sgnal to the hgh dmenson feature space to obtan good flterng performance under nonlnear condton. By usng the kernel adaptve flterng method, a new method of telemetry vbraton sgnal de-nosng was proposed, whch can solve the de-nosng problem for mxed nose form of Gaussan nose and mpulse nose and has good performance for non-statonary telemetry vbraton de-nosng. he computer smulaton and expermental data processng results show the 6. he authors - Publshed by Atlants Press 468
2 effectveness of the proposed method. Basc Prncples of Kernel Adaptve Flterng Kernel method provdes a robust nonlnear parameter modelng method [4]. So far, the kernel method has been successfully appled to support vector machne (SVM), kernel prncpal component analyss (KPCA) and Fsher dscrmnant analyss. he basc dea of kernel methods s that mappng the nput data to a hgh dmenson feature space by a reproducng kernel, such that the nner product n the feature space can be more effcent computed by kernel evaluaton. In the feature space, the non-lnear problem can be solved by lnear flterng method f the algorthm can be expressed as nner product form, whch can avod the complex computaton process. he mappng of the nput sgnal and hgh dmenson feature space s shown n Fg.. Where ϕ s the feature mappng and ϕ( u) s the feature vector n the feature space, thus the nner product can be expressed by kernel as follow ϕ( u) ϕ ( u) = k( uu, ) () Fg. onlnear mappng from nput space to feature space he nner product space and reproducng kernel Hlbert space (RKHS) space s essentally the same, and the most commonly used method s the development of kernel flters n RKHS, whch can mplement the lnear adaptve flterng by the lnear structure of RKHS. Compared wth the neural network, the kernel adaptve flter has unversal approxmaton ablty and convex optmzaton feature, and has no local mnmum. Kernel adaptve flterng s a memory ntensve operaton and the computatonal complexty wth dmenson exponental growth. However, under the lmted nput data, kernel adaptve flterng method can not only complete data processng off-lne, also can solve the problem of learnng onlne. Functon estmator Adaptve flter algorthm Fg. Basc prncple of LMS adaptve flter In the tradtonal adaptve flterng algorthm, LMS algorthm s robust, smple structure and the most commonly used, f the problem to be solved s lnear problems, LMS usually can get the 469
3 desred convergence performance. Fg. shows the typcal LMS flterng block dagram [5]. Let the nput-output sample data s { u (), d() },{ u (), d() },,{ u ( ), d( ) }, there has contnuous nput and output mappng relatons between contnuous samples f : U R. As long as the flterng algorthm s ft to the mappng relatonshp, the LMS adaptve flter can complete the fttng, dentfcaton and classfcaton etc. LMS algorthm s usually to mnmze the emprcal rsk objectve functon to acheve the optmal functon of the parameters of the estmator, whch s to obtan the optmal flter weghts, the emprcal rsk cost functon s J( w) = d () () wu () = Accordng to the stochastc gradent descent algorthm, the LMS can update the weght coeffcent usng the nstantaneous gradent as follow J ( w) = u() d () wu() (3) w = hus the nstantaneous gradent at teratve tmes s J( w ) = u () d ()- w ( -) u () (4) Accordng to the steepest descent algorthm, the LMS algorthm can be expressed as follow w () = w ( ) + µ u () d () w ( ) u () (5) Where µ s the study step sze whch controls the convergence rate and the convergence precson of LMS adaptve flterng. If the nstantaneous error s defned as follow e () = d () w( ) u () (6) hen the update formula of the LMS algorthm can be wrtten as [6] w() = w( ) +µ e () u () (7) LMS algorthm assumes that the flter s a lnear fnte mpulse response flter, f the mappng relatonshp between the nput and output samples s hghly non-lnear, and then the performance of LMS algorthm wll be drastcally decreased. Accordng to the prncple of kernel adaptve flterng, f the samples can be mapped to hgh dmenson feature space, the teratve algorthm can mplement as lnear problem. Let the mappng relatonshp s u() ϕ( u ()), for the sake of smplcty, let ϕ () = ϕ( u()), thus n the hgh dmensonal space, a new nput and output sample sequence s obtaned as{ ϕ (), d ()}. he LMS algorthm can be used n the hgh dmensonal feature space as follow e () = d () ω( ) ϕ () (8) ω() = ω( ) +µ e () ϕ () (9) However, the dmenson of ϕ n the feature space s too hgh and mplct expresson. herefore, an alternatve method s needed to complete the calculaton, and the teratve process of the teratve Eq.9 can be obtaned the follows concluson. ω() = ω( ) + µ e () j() = [ ω( ) + µ e ( ) j( ) ] + µ e ( ) j( ) = ω( ) + µ [ e ( ) j( ) + e ( ) j( ) ] = () = ω() + µ e( j) j( j) = µ e( j) j( j) 47
4 In Eq., t s assumed that ω () =, whch can meet most of the applcaton condtons. If the system get a new nput, the output of the system can be expressed as nner product form as follow. ω( ) ϕ( u ) = µ e( j) ϕ( j) ϕ( u ) () = µ e( j) j( j) j( u ) In ths way, the output of the flter can be evaluated very effcently by usng the kernel technque n the nput space. ω( ) ϕ( u ) = µ e( jk ) ( ϕ( j) ϕ ( u )) () In kernel adaptve flterng, t s no longer nvolved to update the weghts, the flterng operator s completed by all prevous estmate error and kernel evaluaton functon. Kernel adaptve flterng algorthm only requres the nner product operaton. he algorthm can save a lot of tme, but regardless of the LMS algorthm n the nput space and the feature space s essentally the same. Let f s the nonlnear mappng of the nput and output, the followng sequental learnng rules can be formed for the kernel adaptve flterng algorthm. - f- = µ e( jk ) ( u( j),.) = f-( u( )) = µ e( jk ) ( u( j), u( )) (3) e () = d ()- f- ( u()) f = f- + µ ek () ( u(),.) Eq.3 called kernel LMS (KLMS) algorthm, whch s the LMS algorthm n the RHKS. KLMS assgns a new kernel unt to the new tranng data, and the center of the new kernel unt s the nput data u (), the kernel coeffcent s µ e (). In the tranng process, the coeffcent and the center are stored n the memory. Fg.3 shows the KLMS algorthm structure. Where a() s the coeffcent vector at the teratve tmes and a j () s the j th component of a (). he system output for the nput ucan be gven by f( u) = µ e( jk ) ( u( j), u ) (4) Fg.3 he network topology of KLMS at teratve tmes 47
5 De-nosng Based on KLMS Kernel adaptve flterng s appled to non-lnear mappng, whch has a unque advantage n the processng of telemetry envronment parameters. elemetry envronmental parameters de-nosng can take the collected data as the tme sequence, whch s the sequental learnng sample, to realze parametrc fttng to complete de-nosng by usng kernel adaptve flterng. Let telemetry vbraton sgnal s xt () = xt () + vt () (5) Where xt () s the observed sgnal, xt () s the useful sgnal and vt () s the nose whch commonly s the mxed nose of Gaussan nose and mpulse nose. Let the cost functon s [ ] J( w) = yt () xt () (6) Where yt () s the output of the flter. Based on the cost functon Eq.6, the vbraton sgnal can be de-nosng by KLMS, where the kernel functon s selected as Gaussan kernel as follow k( uu, ) = exp α u u (7) he smulaton frequency hoppng sgnal s used to analyze the performance of the de-nosng method, whch has typcal non-statonary characterstc. he smulaton telemetry vbraton sgnal has the practcal applcaton background, that s, when the vehcle structure s abnormal, the frequency of the acquston sgnal s changed. he sample frequency of the smulaton sgnal s f s = 48 Hz, the center frequency of two sne sgnal are f = 5 Hz and f = 5 Hz respectvely. Let the SR=3dB. he waveforms before de-nosng by KLMS are shown n Fg.4 and Fg.5 respectvely. Fg.5 shows KLMS has good de-nosng performance for the smulaton sgnal. 4 Ampltude A me t/s Fg.4 Smulaton frequencey hoppng sgnal wth nose Ampltude A me t/s Fg.5 Smulaton frequencey hoppng sgnal after de-nosng o further llustrate the practcalty of the algorthm, hgh frequency vbraton sgnal collected by a vehcle test s used for processng, whch the sample frequency s 5kHz and waveform and frequency spectrum s shown n Fg.6. Fg.7 shows the de-nosng result of KLMS. he results show that KLMS can suppress the nose n the vbraton sgnal effectvely. 47
6 Ampltude A/g - Y(f) me t/s -4 Frequency f/hz Fg.6 Hgh frequency vbraton sgnal and ts frequency spectrum 4 Ampltude A/g - Y(f) me t/s -4 Frequency f/hz Fg.7 Hgh frequency vbraton sgnal after de-nosng Concluson hs work proposed a de-nosng method for telemetry sgnal based on kernel adaptve flterng. For the telemetry envronmental parameters n the vehcle test s often nterference wth mxed nose, the proposed method can obtan good de-nosng performance under non-statonary and non-lnear condton, whch has practcal applcaton sgnfcance n the telemetry vbraton sgnal de-nosng processng. he effectveness of the proposed method s proved by the smulaton sgnal and the measured sgnal processng results. References [] LIU X., LIAG H., XUA Z.W. elemetry vbraton sgnal anomaly detecton method based on fuzzy entropy of wavelet modulus maxma [J]. Journal of Vbraton and Shock, 6, 35(9): [] LIU X., XUA Z. W., LIAG H. elemetry vbraton sgnal abnormalty detecton method based on mult-scale spectral kurtoss map [J]. Journal of Projectles, Rockets, Mssles and Gudance, 5, 35(5): [3] Anton J., Randall R. B. he spectral kurtoss: a useful tool for characterzng non-statonary sgnals [J]. Mechancal Systems and Sgnal Processng, 6, (): [4] ZHAO J., LIAO X. F., WAG S. Y. Kernel least mean square wth sngle feedback [J]. IEEE Sgnal Processng Letter, 5, (7): [5] LIU J. C., ZHAO H. Z., QUA H. D., et al. Iteraton based varable step sze LMS algorthm and ts performance analyss [J]. Journal of Electroncs & Informaton echnology, 37(7): [6] Kwong R. H., Johnston E. W. A varable step sze LMS algorthm [J]. IEEE ransactons on Sgnal Processng, 99, 4(7):
RBF Neural Network Model Training by Unscented Kalman Filter and Its Application in Mechanical Fault Diagnosis
Appled Mechancs and Materals Submtted: 24-6-2 ISSN: 662-7482, Vols. 62-65, pp 2383-2386 Accepted: 24-6- do:.428/www.scentfc.net/amm.62-65.2383 Onlne: 24-8- 24 rans ech Publcatons, Swtzerland RBF Neural
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationA New Fault Diagnosis Method for Planetary Gearbox
Internatonal ournal of Performablty Engneerng, Vol. 2, No. 4, uly 26, pp 389-394 Totem Publsher, Inc., 4625 Stargazer Dr., Plano, Texas 7524, U.S.A A New Fault Dagnoss Method for Planetary Gearbox HAIPING
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationPop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing
Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationAn Improved multiple fractal algorithm
Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton
More informationRolling Bearing Fault Diagnosis Based on EMD-TEO and Mahalanobis Distance
Rollng Bearng Fault Dagnoss Based on EMD-TE and Mahalanobs Dstance Lu Chen, Hu Jameng, Lu Hongme and Wang Jng RLLG BEARG FAULT DAGSS BASED EMD-TE AD MAHALABS DSTACE. LU CHE, HU JAMEG, LU HGME AD WAG JG
More informationMultigradient for Neural Networks for Equalizers 1
Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationComparison of Wiener Filter solution by SVD with decompositions QR and QLP
Proceedngs of the 6th WSEAS Int Conf on Artfcal Intellgence, Knowledge Engneerng and Data Bases, Corfu Island, Greece, February 6-9, 007 7 Comparson of Wener Flter soluton by SVD wth decompostons QR and
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationParameter Estimation for Dynamic System using Unscented Kalman filter
Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informationStudy on Active Micro-vibration Isolation System with Linear Motor Actuator. Gong-yu PAN, Wen-yan GU and Dong LI
2017 2nd Internatonal Conference on Electrcal and Electroncs: echnques and Applcatons (EEA 2017) ISBN: 978-1-60595-416-5 Study on Actve Mcro-vbraton Isolaton System wth Lnear Motor Actuator Gong-yu PAN,
More informationAN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING
AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING Qn Wen, Peng Qcong 40 Lab, Insttuton of Communcaton and Informaton Engneerng,Unversty of Electronc Scence and Technology
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationSupport Vector Machines. Vibhav Gogate The University of Texas at dallas
Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest
More informationPattern Classification
Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher
More informationApplication research on rough set -neural network in the fault diagnosis system of ball mill
Avalable onlne www.ocpr.com Journal of Chemcal and Pharmaceutcal Research, 2014, 6(4):834-838 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Applcaton research on rough set -neural network n the
More informationA Fast Computer Aided Design Method for Filters
2017 Asa-Pacfc Engneerng and Technology Conference (APETC 2017) ISBN: 978-1-60595-443-1 A Fast Computer Aded Desgn Method for Flters Gang L ABSTRACT *Ths paper presents a fast computer aded desgn method
More informationADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING
1 ADVANCED ACHINE LEARNING ADVANCED ACHINE LEARNING Non-lnear regresson technques 2 ADVANCED ACHINE LEARNING Regresson: Prncple N ap N-dm. nput x to a contnuous output y. Learn a functon of the type: N
More informationChapter 12 Analysis of Covariance
Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty
More informationLinear Feature Engineering 11
Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19
More information829. An adaptive method for inertia force identification in cantilever under moving mass
89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,
More informationNeural networks. Nuno Vasconcelos ECE Department, UCSD
Neural networs Nuno Vasconcelos ECE Department, UCSD Classfcaton a classfcaton problem has two types of varables e.g. X - vector of observatons (features) n the world Y - state (class) of the world x X
More informationNon-linear Canonical Correlation Analysis Using a RBF Network
ESANN' proceedngs - European Smposum on Artfcal Neural Networks Bruges (Belgum), 4-6 Aprl, d-sde publ., ISBN -97--, pp. 57-5 Non-lnear Canoncal Correlaton Analss Usng a RBF Network Sukhbnder Kumar, Elane
More informationKernels in Support Vector Machines. Based on lectures of Martin Law, University of Michigan
Kernels n Support Vector Machnes Based on lectures of Martn Law, Unversty of Mchgan Non Lnear separable problems AND OR NOT() The XOR problem cannot be solved wth a perceptron. XOR Per Lug Martell - Systems
More informationLecture 12: Classification
Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationInternational Journal of Pure and Applied Sciences and Technology
Int. J. Pure Appl. Sc. Technol., 4() (03), pp. 5-30 Internatonal Journal of Pure and Appled Scences and Technology ISSN 9-607 Avalable onlne at www.jopaasat.n Research Paper Schrödnger State Space Matrx
More informationNeural Networks & Learning
Neural Netorks & Learnng. Introducton The basc prelmnares nvolved n the Artfcal Neural Netorks (ANN) are descrbed n secton. An Artfcal Neural Netorks (ANN) s an nformaton-processng paradgm that nspred
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationRadial-Basis Function Networks
Radal-Bass uncton Networs v.0 March 00 Mchel Verleysen Radal-Bass uncton Networs - Radal-Bass uncton Networs p Orgn: Cover s theorem p Interpolaton problem p Regularzaton theory p Generalzed RBN p Unversal
More informationPulse Coded Modulation
Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal
More informationAppendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationMultilayer Perceptron (MLP)
Multlayer Perceptron (MLP) Seungjn Cho Department of Computer Scence and Engneerng Pohang Unversty of Scence and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjn@postech.ac.kr 1 / 20 Outlne
More informationOther NN Models. Reinforcement learning (RL) Probabilistic neural networks
Other NN Models Renforcement learnng (RL) Probablstc neural networks Support vector machne (SVM) Renforcement learnng g( (RL) Basc deas: Supervsed dlearnng: (delta rule, BP) Samples (x, f(x)) to learn
More informationAtmospheric Environmental Quality Assessment RBF Model Based on the MATLAB
Journal of Envronmental Protecton, 01, 3, 689-693 http://dxdoorg/10436/jep0137081 Publshed Onlne July 01 (http://wwwscrporg/journal/jep) 689 Atmospherc Envronmental Qualty Assessment RBF Model Based on
More informationSuppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl
RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationFault Diagnosis of Autonomous Underwater Vehicles
Research Journal of Appled Scences, Engneerng and Technology 5(6): 407-4076, 03 SSN: 040-7459; e-ssn: 040-7467 Maxwell Scentfc Organzaton, 03 Submtted: March 3, 0 Accepted: January, 03 Publshed: Aprl 30,
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationStudy on Non-Linear Dynamic Characteristic of Vehicle. Suspension Rubber Component
Study on Non-Lnear Dynamc Characterstc of Vehcle Suspenson Rubber Component Zhan Wenzhang Ln Y Sh GuobaoJln Unversty of TechnologyChangchun, Chna Wang Lgong (MDI, Chna [Abstract] The dynamc characterstc
More informationSOC Estimation of Lithium-ion Battery Packs Based on Thevenin Model Yuanqi Fang 1,a, Ximing Cheng 1,b, and Yilin Yin 1,c. Corresponding author
Appled Mechancs and Materals Onlne: 2013-02-13 ISSN: 1662-7482, Vol. 299, pp 211-215 do:10.4028/www.scentfc.net/amm.299.211 2013 Trans Tech Publcatons, Swtzerland SOC Estmaton of Lthum-on Battery Pacs
More informationMultiple Sound Source Location in 3D Space with a Synchronized Neural System
Multple Sound Source Locaton n D Space wth a Synchronzed Neural System Yum Takzawa and Atsush Fukasawa Insttute of Statstcal Mathematcs Research Organzaton of Informaton and Systems 0- Mdor-cho, Tachkawa,
More informationLinear Classification, SVMs and Nearest Neighbors
1 CSE 473 Lecture 25 (Chapter 18) Lnear Classfcaton, SVMs and Nearest Neghbors CSE AI faculty + Chrs Bshop, Dan Klen, Stuart Russell, Andrew Moore Motvaton: Face Detecton How do we buld a classfer to dstngush
More informationNON-LINEAR CONVOLUTION: A NEW APPROACH FOR THE AURALIZATION OF DISTORTING SYSTEMS
NON-LINEAR CONVOLUTION: A NEW APPROAC FOR TE AURALIZATION OF DISTORTING SYSTEMS Angelo Farna, Alberto Belln and Enrco Armellon Industral Engneerng Dept., Unversty of Parma, Va delle Scenze 8/A Parma, 00
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationBasic Statistical Analysis and Yield Calculations
October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general
More informationMACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression
11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING
More informationJournal of Chemical and Pharmaceutical Research, 2014, 6(5): Research Article
Avalable onlne www.jocpr.com Journal of Chemcal and Pharmaceutcal Research, 014, 6(5):1683-1688 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Multple mode control based on VAV ar condtonng system
More informationCurve Fitting with the Least Square Method
WIKI Document Number 5 Interpolaton wth Least Squares Curve Fttng wth the Least Square Method Mattheu Bultelle Department of Bo-Engneerng Imperal College, London Context We wsh to model the postve feedback
More informationNeuro-Adaptive Design - I:
Lecture 36 Neuro-Adaptve Desgn - I: A Robustfyng ool for Dynamc Inverson Desgn Dr. Radhakant Padh Asst. Professor Dept. of Aerospace Engneerng Indan Insttute of Scence - Bangalore Motvaton Perfect system
More informationClassification as a Regression Problem
Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class
More informationAn identification algorithm of model kinetic parameters of the interfacial layer growth in fiber composites
IOP Conference Seres: Materals Scence and Engneerng PAPER OPE ACCESS An dentfcaton algorthm of model knetc parameters of the nterfacal layer growth n fber compostes o cte ths artcle: V Zubov et al 216
More information2 STATISTICALLY OPTIMAL TRAINING DATA 2.1 A CRITERION OF OPTIMALITY We revew the crteron of statstcally optmal tranng data (Fukumzu et al., 1994). We
Advances n Neural Informaton Processng Systems 8 Actve Learnng n Multlayer Perceptrons Kenj Fukumzu Informaton and Communcaton R&D Center, Rcoh Co., Ltd. 3-2-3, Shn-yokohama, Yokohama, 222 Japan E-mal:
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationUncertainty in measurements of power and energy on power networks
Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationAccurate Forecasting of Underground Fading Channel Based on Improved LS-SVM Anyi Wang1, a, Xi Xi1, b
nd Workshop on Advanced Research and echnology n Industry Applcatons (WARIA 06) Accurate Forecastng of Underground Fadng Channel Based on Improved LS-SVM Any Wang, a, X X, b College of Communcaton and
More informationrisk and uncertainty assessment
Optmal forecastng of atmospherc qualty n ndustral regons: rsk and uncertanty assessment Vladmr Penenko Insttute of Computatonal Mathematcs and Mathematcal Geophyscs SD RAS Goal Development of theoretcal
More informationA Multi-modulus Blind Equalization Algorithm Based on Memetic Algorithm Guo Yecai 1, 2, a, Wu Xing 1, Zhang Miaoqing 1
Internatonal Conference on Materals Engneerng and Informaton Technology Applcatons (MEITA 1) A Mult-modulus Blnd Equalzaton Algorthm Based on Memetc Algorthm Guo Yeca 1,, a, Wu Xng 1, Zhang Maoqng 1 1
More informationThe Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationIV. Performance Optimization
IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationUnknown input extended Kalman filter-based fault diagnosis for satellite actuator
Internatonal Conference on Computer and Automaton Engneerng (ICCAE ) IPCSI vol 44 () () IACSI Press, Sngapore DOI: 776/IPCSIV44 Unnown nput extended Kalman flter-based fault dagnoss for satellte actuator
More informationMULTICLASS LEAST SQUARES AUTO-CORRELATION WAVELET SUPPORT VECTOR MACHINES. Yongzhong Xing, Xiaobei Wu and Zhiliang Xu
ICIC Express Letters ICIC Internatonal c 2008 ISSN 1881-803 Volume 2, Number 4, December 2008 pp. 345 350 MULTICLASS LEAST SQUARES AUTO-CORRELATION WAVELET SUPPORT VECTOR MACHINES Yongzhong ng, aobe Wu
More informationAverage Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1
Average Decson hreshold of CA CFAR and excson CFAR Detectors n the Presence of Strong Pulse Jammng Ivan G. Garvanov and Chrsto A. Kabachev Insttute of Informaton echnologes Bulgaran Academy of Scences
More informationUsing Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*
Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationWhich Separator? Spring 1
Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal
More informationSupporting Information
Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationQuantifying Uncertainty
Partcle Flters Quantfyng Uncertanty Sa Ravela M. I. T Last Updated: Sprng 2013 1 Quantfyng Uncertanty Partcle Flters Partcle Flters Appled to Sequental flterng problems Can also be appled to smoothng problems
More informationStatistical machine learning and its application to neonatal seizure detection
19/Oct/2009 Statstcal machne learnng and ts applcaton to neonatal sezure detecton Presented by Andry Temko Department of Electrcal and Electronc Engneerng Page 2 of 42 A. Temko, Statstcal Machne Learnng
More informationTHE EFFECT OF TORSIONAL RIGIDITY BETWEEN ELEMENTS ON FREE VIBRATIONS OF A TELESCOPIC HYDRAULIC CYLINDER SUBJECTED TO EULER S LOAD
Journal of Appled Mathematcs and Computatonal Mechancs 7, 6(3), 7- www.amcm.pcz.pl p-issn 99-9965 DOI:.75/jamcm.7.3. e-issn 353-588 THE EFFECT OF TORSIONAL RIGIDITY BETWEEN ELEMENTS ON FREE VIBRATIONS
More informationStatistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA
14 th Internatonal Users Conference Sesson: ALE-FSI Statstcal Energy Analyss for Hgh Frequency Acoustc Analyss wth Zhe Cu 1, Yun Huang 1, Mhamed Soul 2, Tayeb Zeguar 3 1 Lvermore Software Technology Corporaton
More informationIdentification of Linear Partial Difference Equations with Constant Coefficients
J. Basc. Appl. Sc. Res., 3(1)6-66, 213 213, TextRoad Publcaton ISSN 29-434 Journal of Basc and Appled Scentfc Research www.textroad.com Identfcaton of Lnear Partal Dfference Equatons wth Constant Coeffcents
More informationOperating conditions of a mine fan under conditions of variable resistance
Paper No. 11 ISMS 216 Operatng condtons of a mne fan under condtons of varable resstance Zhang Ynghua a, Chen L a, b, Huang Zhan a, *, Gao Yukun a a State Key Laboratory of Hgh-Effcent Mnng and Safety
More informationNote 10. Modeling and Simulation of Dynamic Systems
Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada
More informationThe Two-scale Finite Element Errors Analysis for One Class of Thermoelastic Problem in Periodic Composites
7 Asa-Pacfc Engneerng Technology Conference (APETC 7) ISBN: 978--6595-443- The Two-scale Fnte Element Errors Analyss for One Class of Thermoelastc Problem n Perodc Compostes Xaoun Deng Mngxang Deng ABSTRACT
More informationBoostrapaggregating (Bagging)
Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod
More informationMultilayer Perceptrons and Backpropagation. Perceptrons. Recap: Perceptrons. Informatics 1 CG: Lecture 6. Mirella Lapata
Multlayer Perceptrons and Informatcs CG: Lecture 6 Mrella Lapata School of Informatcs Unversty of Ednburgh mlap@nf.ed.ac.uk Readng: Kevn Gurney s Introducton to Neural Networks, Chapters 5 6.5 January,
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationAdaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays *
Journal of Robotcs, etworkng and Artfcal Lfe, Vol., o. (September 04), 5-9 Adaptve Consensus Control of Mult-Agent Systems wth Large Uncertanty and me Delays * L Lu School of Mechancal Engneerng Unversty
More informationFinite Mixture Models and Expectation Maximization. Most slides are from: Dr. Mario Figueiredo, Dr. Anil Jain and Dr. Rong Jin
Fnte Mxture Models and Expectaton Maxmzaton Most sldes are from: Dr. Maro Fgueredo, Dr. Anl Jan and Dr. Rong Jn Recall: The Supervsed Learnng Problem Gven a set of n samples X {(x, y )},,,n Chapter 3 of
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationC4B Machine Learning Answers II. = σ(z) (1 σ(z)) 1 1 e z. e z = σ(1 σ) (1 + e z )
C4B Machne Learnng Answers II.(a) Show that for the logstc sgmod functon dσ(z) dz = σ(z) ( σ(z)) A. Zsserman, Hlary Term 20 Start from the defnton of σ(z) Note that Then σ(z) = σ = dσ(z) dz = + e z e z
More informationThe Finite Element Method
The Fnte Element Method GENERAL INTRODUCTION Read: Chapters 1 and 2 CONTENTS Engneerng and analyss Smulaton of a physcal process Examples mathematcal model development Approxmate solutons and methods of
More informationAdvanced Introduction to Machine Learning
Advanced Introducton to Machne Learnng 10715, Fall 2014 The Kernel Trck, Reproducng Kernel Hlbert Space, and the Representer Theorem Erc Xng Lecture 6, September 24, 2014 Readng: Erc Xng @ CMU, 2014 1
More informationMulti-user Detection Based on Weight approaching particle filter in Impulsive Noise
Internatonal Symposum on Computers & Informatcs (ISCI 2015) Mult-user Detecton Based on Weght approachng partcle flter n Impulsve Nose XIAN Jn long 1, a, LI Sheng Je 2,b 1 College of Informaton Scence
More informationINF 5860 Machine learning for image classification. Lecture 3 : Image classification and regression part II Anne Solberg January 31, 2018
INF 5860 Machne learnng for mage classfcaton Lecture 3 : Image classfcaton and regresson part II Anne Solberg January 3, 08 Today s topcs Multclass logstc regresson and softma Regularzaton Image classfcaton
More information