Research Article A Network Traffic Prediction Model Based on Quantum-Behaved Particle Swarm Optimization Algorithm and Fuzzy Wavelet Neural Network

Size: px
Start display at page:

Download "Research Article A Network Traffic Prediction Model Based on Quantum-Behaved Particle Swarm Optimization Algorithm and Fuzzy Wavelet Neural Network"

Transcription

1 Dscrete Dynamcs n ature and Socety Volume 26, Artcle ID 43556, pages Research Artcle A etwork Traffc Predcton Model Based on Quantum-Behaved Partcle Swarm Optmzaton Algorthm and Fuzzy Wavelet eural etwork Kun Zhang, Zhao Hu, Xao-Tng Gan, and Jan-Bo Fang School of Mathematcs and Statstcs, Chuxong ormal Unversty, Chuxong, Yunnan 675, Chna Correspondence should be addressed to Kun Zhang; zhangkunpost@qqcom Receved 2 ovember 25; Revsed 4 January 26; Accepted 3 February 26 Academc Edtor: Ahmed Kattan Copyrght 26 Kun Zhang et al Ths s an open access artcle dstrbuted under the Creatve Commons Attrbuton Lcense, whch permts unrestrcted use, dstrbuton, and reproducton n any medum, provded the orgnal work s properly cted Due to the fact that the fluctuaton of network traffc s affected by varous factors, accurate predcton of network traffc s regarded as a challengng task of the tme seres predcton process For ths purpose, a novel predcton method of network traffc based on QPSO algorthm and fuzzy wavelet neural network s proposed n ths paper Frstly, quantum-behaved partcle swarm optmzaton (QPSO) was ntroduced Then, the structure and operaton algorthms of WF are presented The parameters of fuzzy wavelet neural network were optmzed by QPSO algorthm Fnally, the QPSO-FW could be used n predcton of network traffc smulaton successfully and evaluate the performance of dfferent predcton models such as BP neural network, RBF neural network, fuzzy neural network, and FW-GA neural network Smulaton results show that QPSO-FW has a better precson and stablty n calculaton At the same tme, the QPSO-FW also has better generalzaton ablty, and t has a broad prospect on applcaton Introducton Wth the rapd development of computer network technology, network applcatons have nfltrated every corner of humansocetyandplayanmportantrolenvarousndustres and stuatons Snce the network topology structure s gradually complcated, the problem of network s emergences and congeston are more and more serous Through montorng and accuracy predcton of network traffc, t can prevent network congeston and can effectvely mprove the utlzaton rate of the network [] In general, the network traffc data s a knd of tme seres data and the problem of network traffc predcton s to forecast future network traffc rate varatons as precsely as possble based on the measured hstory The tradtonal predcton model, such as Markov model [2], ARMA (Autoregressve Movng Average) model [3], ARIMA (Autoregressve Integrated Movng Average) model [4], and FARIMA (Fractonal Autoregressve Integrated Movng Average) [5] model, has been proposed As the network traffc s affected by many factors, the network traffc tme seres show qute obvous multscale, long-range dependence, and nonlne characterstc The methods mentoned above have the weakness of lowlevel effcency [6] An artfcal neural network (A) s an analyss paradgm that s roughly modeled after the massvely parallel structure of the bran Artfcal neural networks can be thought of as black box devces that accept nputs and produceoutputsandareabletogvebetterperformancen dealng wth the nonlnear relatonshps between the output and the nput theoretcally [7] Although artfcal neural networks have been successfully used for modelng complex nonlnear systems and predctng sgnals for a wde range of engneerng applcatons, artfcal neural networks (As) have lmted ablty to characterze local features, such as dscontnutes n curvature, jumps n value or other edges [8] These local features, whch are located n tme and/or frequency, typcally embody mportant process-crtcal nformaton such as aberrant process modes or faults The fuzzy neural networks (F) are the hybrd systems whch combne both advantages of the fuzzy systems and artfcal neural networks The F possesses the merts of

2 2 Dscrete Dynamcs n ature and Socety the low-level learnng and computatonal power of neural networks, and the hgh-level human knowledge representaton and thnkng of fuzzy theory [9] A fuzzy wavelet neural network (FW) s a new network structure that combnes wavelet theory wth fuzzy logc and s The synthess of a fuzzy wavelet neural nference system ncludes the determnaton of the optmal defntons of the premse and the consequent part of fuzzy IF-THE rules [] However, many fuzzy neural network models, ncludng FW, have common problems derved from ther fundamental algorthm [] For example, the desgn process for F and FW combned tapped delays wth the backpropagaton (BP) algorthm to solve the dynamc mappng problems [2] Unfortunately, the BP tranng algorthm has some nherent defects [3, 4], such as low learnng speed, exstence of local mnma, and dffculty n choosng the proper sze of network to sut a gven problem Thus the systems whch employ basc fuzzynferencetheorymakethedegreeofeachruleextremely small and often make t underflow when the dmenson of the task s large In such a stuaton, the learnng and nference cannot be carred out correctly As a varant of PSO, quantum-behaved partcle swarm optmzaton (QPSO) s a novel optmzaton algorthm nspred by the fundamental theory of partcle swarm and features of quantum mechancs such as the use of Schrödnger equaton and potental feld dstrbuton [5] As a global optmzaton algorthm, the QPSO can seek many local mnmaandthusncreasethelkelhoodoffndngtheglobal mnmum Ths advantage of the QPSO can be appled to neural networks to optmze the topology and/or weght parameters [6] In order to predct the network traffc more accurately, a predcton model of network traffc based on QPSO algorthm and fuzzy wavelet neural network s proposed n ths paper The network traffc data s traned by QPSO and fuzzy wavelet neural network and weghts are progressvely updated untl the convergence crteron s satsfed The objectve functon to be mnmzed by the QPSO algorthm s the predcted error functon The rest of ths paper s arranged as follows Secton 2 gves a bref ntroducton to classcal PSO algorthm and quantum-behaved partcle swarm optmzaton (QPSO) algorthm In Secton 3, the fuzzy wavelet neural network s ntroduced and the fuzzy wavelet neural network based on QPSO (QPSO-FW) algorthm s presented n detal In Secton 4, smulaton results are presented Performance metrcs of the several predcton methods are analyzed and compared n Secton 5 Fnally, some conclusons are gven n Secton 6 2 Quantum-Behaved Partcle Swarm Optmzaton 2 Classcal Partcle Swarm Optmzaton Partcle swarm optmzaton (PSO) s an evolutonary computaton technque that s proposed by Kennedy and Eberhart n 995 [7] Smlarly to other genetc algorthms (GA), PSO s ntalzed wth a populaton of random solutons However, t s unlke GA, PSO does not have operators, such as crossover and mutaton In the PSO algorthm, each potental soluton, called partcles, moves around n a multdmensonal search space wth a velocty constantly updated by the partcle s own experence and the experence of the partcle s neghbors or the experence of the whole swarm [8] In the PSO, each partcle keeps track of ts coordnates n the search space whch are assocated wth the best soluton t has acheved so far and ths value s called pbest Another best value that s tracked by the global verson of the partcle swarm optmzer s the overall best value, and ts locaton, obtaned so far by any partcle n the populaton [9] Ths locaton s called gbest The process for mplementng the global verson of PSO s gven by the followng steps Step Intalze a populaton (array) of partcles wth random postons and veloctes n the D-dmensonal problem space For a D-dmensonal problem wth number of partcles, the poston vector X t and velocty vector V t are represented as where =,2,, X t =[Xt,,Xt,2,,Xt,D ], () V t =[V t,,vt,2,,vt,d ], Step 2 For each partcle, evaluate the desred optmzaton ftness functon n D varables Step 3 Compare each partcle s ftness evaluaton wth the partcle s pbest If the current value s better than pbest, then set the pbest valueequaltothecurrentvalueandthe pbest locaton equal to the current locaton n D-dmensonal space Step 4 Compare the ftness evaluaton wth the populaton s overall prevous best If the current value s better than gbest, then reset gbest to the current partcle s array ndex and value Step 5 Update the velocty and poston of the partcle accordng to (2) and (3), respectvely One has V t+ X t+ =Vt +c r (pbest t Xt ) (2) +c 2 r 2 (gbest t d Xt ), =Xt +Vt+, (3) where c and c 2 are two postve constants, known as the cogntve and socal coeffcents, whch control the relatve proporton of cognton and socal nteracton, respectvely, and the values of c and c 2 were decreased wth each teraton [2] r and r 2 are two random values n the range [, ] V t, X t,andpbestt arethevelocty,poston,andthepersonal best of th partcle n dth dmenson for the tth teraton, respectvely The gbest t d s the dth dmenson of best partcle n the swarm for the tth teraton

3 Dscrete Dynamcs n ature and Socety 3 Step 6 Loop to Step 2 untl a stop crteron s met, usually a suffcently good ftness or a maxmum number of teraton generatons 22 Quantum-Behaved Partcle Swarm Optmzaton Motvated by concepts n quantum mechancs and partcle swarm optmzaton, Sun et al proposed a new verson of PSO, quantum-behaved partcle swarm optmzaton (QPSO) [2] In the QPSO, the state of a partcle s depcted by a wave functon ψ(x, t), nstead of poston and velocty The probablty densty functon of the partcle s poston s ψ(x, t) 2 n poston X [22] Assume that, at teraton t, partcle moves n Ddmensonal space wth a δ potental well centered at pbest t,j on the dth dmenson The wave functon at teraton t+s gven by the followng equaton: ψ(x t+ )= exp ( Xt pbestt L t L t ), (4) where L t s the standard devaton of the double exponental dstrbuton, varyng wth teraton number t Hencethe probablty densty functon Q s defned as Q(X t+ )= ψ(xt+ ) 2 = L t exp ( 2 Xt+ pbestt L t and the probablty dstrbuton functon F s gven by the followng equaton: F(X t+ )= exp ( 2 Xt+ pbestt L t ) (5) ) (6) By usng Monte-Carlo method, the jth component of poston X at teraton t+can obtan by the followng equaton: X t+ =pbestt ± 2 Lt ln ( u t+ ), (7) where u t+ s a unform random number n the nterval [, ] The value of L t+ s calculated as L t =2α Ct d Xt, (8) where parameter α s known as the contracton-expanson (CE) coeffcent, whch can be tuned to control the convergence speed of the algorthms [23] C t s the mean best poston (mbest) and s defned as C t =(C t,ct 2,,Ct D ) =( M M = pbest t M,, pbest t M (9),2 M,, pbest t,d M ), = = where M stheszeofthepopulatonhencethepostonof the partcle s updated accordng to the followng equaton: X t+ =pbestt ±α Ct d Xt ln ( u t+ ) () From (4) and (), the new poston of the partcle s calculated as X t+ pbest t { +α Ct d Xt ln ( = { pbest t α Ct d Xt ln ( { u t+ u t+ ) k (5, ], ) k (, 5], () where k s a random number n the range [, ] α s lnearly decreasng factor from to 3 wth teraton as α t =α max α max α mn t, (2) t max where t max s the maxmum number teraton used n algorthm 3 Fuzzy Wavelet eural etwork Based on QPSO 3 The Wavelet Base Functon In L 2 (R),awaveletdctonary s constructed by dlatng and translatng from a wavelet base functonψ(t) of zero average [24]: + ψ (t) dt = (3) whch s dlated wth a scale parameter a and translated by b ψ a,b (t) = ψ (t b) a> (4) a a 32 Fuzzy Wavelet eural etwork The basc archtecture of fuzzy wavelet neural network could be descrbed as a set of Takag-Sugeno models Assume that there are r rules n therulebaseandthetakag-sugenofuzzyf-thenrulesare usually n the followng form: R :IF x s F,,x r s F r, THE y =α +α x + +α r x r, (5) where x,x 2,,x r are nput of T-S rule, F j s the th lngustc varable value of the jth nput, whch s a fuzzy set characterzed by wavelet functon α j s constant coeffcents whch are usually referred to as consequent parameters determned durng the tranng process Fgure shows the archtecture of the proposed FW modelng The FW s a 4-layer feedforward network and detaled descrptons and equatons for each layer are gven here

4 4 Dscrete Dynamcs n ature and Socety x x n u( ) u( ) u( ) u( ) Fgure : The archtecture of FW Layer (nput varables layer) Ths layer s the nput sgnals of the FW and each node of ths layer, respectvely, represents an nput lngustc varable The node output and thenodenputarerelatedby I () =x O () =I () =,2,,n, Σ Σ y y m (6) where I () and O () are, respectvely, the nput and output of th node n Layer Layer 2 (membershp functons layer) In ths layer, nodes represent fuzzy sets n the antecedents of fuzzy rules The outputs of ths layer are the values of the membershp functons The membershp functon s wavelet functon and s often taken as u j =φ( x b j a j = cos ( x b j 2a j ) ) exp ( 2 (x b j a j 2 ) ), (7) where u j s the jth membershp functon of x and j =,2,,p a j,bj are the dlaton and translaton parameter of wavelet functon In ths layer, the relaton between the output and nput s represented as I (2) =O (), O (2) =u (I (2) ) = cos ( O() 2a j b j ) exp ( 2 (O() where =,2,,n, j=,2,,p a j b j 2 ) ), (8) Layer 3 (rule layer) In ths layer, the number of rules s equal tothenumberofnodestheoutputcanbecalculatedas follows accordng to the AD (mn) operaton [2]: O (3) =I (3) = mn (O (2) j,o(2) 2j,,O(2) nj ) (9) Layer 4 (output layer) Ths layer conssts of output nodes The output are gven by I (4) k = m p O (3) ω(3) = j= y k =O (4) k =, (2) I (4) k m = p j= O(3) (2) To tran the parameters of FW, backpropagaton (BP) tranng algorthm s extensvely used as a powerful tranng method whch can be appled to the forward network archtecture [25] For ths purpose, mean square error (MSE) s selected as performance ndex whch s gven by J= 2 (D Y)T (D Y), (22) where D and Y are current and desred output values of network, correspondngly The all adjustable parameters of FW can be calculated by the followng formulas: ω (3) (t+) =ω (3) (t) η J ω (3) (t) +α Δω(3) (t), b (2) (t+) =b (2) J (t) η b (2) (t) +α Δb(2) (t), a (2) (t+) =a (2) (t) η J a (2) (t) +α Δa(2) (t), (23) where t represents the backward step number and η and α are the learnng and the momentum constants, dfferng n the ranges to and to 9, respectvely 33 Fuzzy Wavelet eural etwork Traned by QPSO Algorthm Computatonal ntellgence has ganed popularty n tranng of neural networks because of ther ablty to fnd a global soluton n a multdmensonal search space The QPSO algorthm s a global algorthm, whch has a strong ablty to fnd global optmstc results and QPSO algorthm has proven to have advantages than the classcal PSO due ts less control parameters [26] Therefore, by combnng the QPSO wth the fuzzy wavelet neural network, a new algorthm referred to as QPSO-FW algorthm s formulated n ths paper When QPSO algorthm s used to tran the FW model, a decson vector represents a partcular group of network

5 Dscrete Dynamcs n ature and Socety 5 parameters ncludng the connecton weght, the dlaton and translaton parameter It s further denoted as 9 8 X =(a,,,a,p,,a n,p,b,,,b,p,,b n,p,ω,,, ω,p,,ω m,p ), (24) where a and b are the dlaton and translaton parameter of wavelet functon n Layer 2 ω l,k are the connecton weght n (2) Snce a component of the poston corresponds to a network parameter, FW s structured accordng the partcle s poston vector Tranng the correspondng network by nputtng the tranng samples, we can obtan an error value computed by (22) In a word, the mean square error s adopted as the objectve functon to be mnmzed n FW based on QPSO The specfc procedure for the QPSO-FW algorthm canbesummarzedasfollows Step Defne the structure of the FW accordng to the nput and output sample Step 2 Treat the poston vector of each partcle as a group of network parameter by (24) Step 3 Intalze the populaton by randomly generatng the poston vector X of each partcle and set pbest =X Step 4 Evaluate m and α of QPSO algorthm usng (9) and (2), respectvely Step 5 Conclude the objectve functon of each partcle by (22) Step 6 (update pbest) Each partcle s current ftness value s compared wth prevous best value pbestif the current value s better than the pbest value, then set the pbest value to the current value Step 7 (update gbest) Determne the swarm best gbest as mnmum of all the partcles pbest Step 8 Judge the stoppng crtera, f the maxmal teratve tmes are met, stop the teraton, and the postons of partcles are the optmal soluton Otherwse, the procedure s repeated from Step 4 4 Smulaton Results Expermentaldatasetconsstsofhoursobservatonswhch comes from montorng the traffc between clents n our campus network and servers The mnmal tme nterval n network traffc tme seres s seconds Fgure 2 shows the normalzaton of network traffc tme seres In ths paper, the desgn of a dscrete flter predctor conssts n fndng the relaton between the future data x(n) and the past observatons x(n ),x(n 2),,x(n M), where M sthenumberofconsderednputelementsthe Fgure 2: The normalzaton of network traffc tme seres predctor relatonshp can be descrbed by the followng convoluton sum [27]: x (n) = M k= h o (k) x (n k), (25) where h o (k) (k =,2,,M)sthefltercoeffcentvector x(n k) s an k-step backward sample x(n) s the desred output In order to test the performance of the predcton model, the front s the tranng data, and the latter 2 s the predcton data The number of tme seres wndows was set as 3, whch meant that the forth of measurement data would be predcted from the past three of measurement data In the establshed predcton model base on QPSO- FW algorthm, the number of membershp functons s fve, the number of nput varables layer nodes s three, and the number of output layer nodes s one The populaton sze of QPSO algorthm s 2 partcles and D-dmensonal search space of partcle s 45 t max s 3 α max s and α mn s 5 The CE coeffcent decreases lnearly from to 3 durng the search process accordng to (2) and After 5 tmes teratons, the cost functon J of QPSO-FW neural network was 2887 The connecton weght between nput varables layer andoutputlayersgvenby a= [ [ ], [ ] b= [ [ ], [ ]

6 6 Dscrete Dynamcs n ature and Socety ω= 436, [ 965 ] [ 884 ] (26) where y sthemeanvalueandsgvenby y = = y (3) It can be seen that,f MSE =, the predcton performance s perfect, and f MSE =, the predcton s a trval predctor whch statstcally predcts the mean of the actual value If MSE >, t means that the predcton performance s worse than that of trval predctor [29] (3) MAPE (Mean Absolute Percentage Error) can calculate the predcton error as a percentage of the actual value MAPE s defned as MAPE = = y y y % (3) (4) Coeffcent correlaton s the covarance of the two varables dvded by the product of ther ndvdual standard devatons It s a normalzed measurement of how the two varables are lnearly related The coeffcent of correlaton (r) s gven as follows: where a s the dlaton parameter of the wavelet functon b s the translaton parameter of wavelet functon ω s theconnectonweghtoftheoutputlayerfgure3shows the membershp functons of nput varable x(t), x(t ), and x(t 2) n FW unts Fgure 4 shows the QPSO- FW convergence curves These predcton results show that the QPSO-FW model s an effectve, hgh-accuracy predcton model of network traffc n Fgure 5 5 Performance Metrcs In order to evaluate the predcton model more comprehensvely, the followng performance metrcs are used to estmate the predcton accuracy () MSE (mean square error) s a scale-dependent metrc whch quantfes the dfference between the predcted values andtheactualvaluesofthequanttybengpredctedby computng the average sum of squared errors [28]: MSE = = (y y ) 2, (27) where y s the actual value, y s the predcted value, and s the total number of predctons (2) MSE (ormalzed Mean Square Error) s defned as MSE = σ 2 (y y ) 2, (28) where σ 2 denotes the varance of the actual values durng the predcton nterval and s gven as follows: σ 2 = = = (y y) 2, (29) r= COV (Y, Y), (32) σ Y σ Y where σ Y and σ Y ndcate the standard devaton of the actual andthepredctedvaluesaregvenby(33) σ Y = = (y y) 2 (33) COV(X, Y) s the covarance between X and YItsobtaned as follows: COV = = (x x) (y y) (34) Values for the correlaton coeffcent range are [, ]If r=, there s a perfect postve correlaton between the actual and the predcted values, whereas r = ndcates a perfect negatve correlaton If r =, we have a complete lack of correlaton among the datasets (5) Coeffcent of effcency (CE) s defned as CE = = (y y ) 2 = (y y) 2, (35) where the doman of the effcency coeffcent s (, ] If CE =, there s a perfect ft between the observed andthepredcteddatawhenthepredctoncorrespondsto estmatng the mean of the actual values, CE = IfCE (, ], t ndcates that the average of the actual values s a better predctor than the analyzed predcton method The closer CE s to, the more accurate the predcton s In order to test the QPSO-FW method s valdty and accuracy, we carred out the experment whch s compared wth the other methods The predcton model based on BP

7 Dscrete Dynamcs n ature and Socety Input varable x(t) (a) Membershp functons of nput varable x(t) n FW unts 5 5 Input varable x(t ) (b) Membershp functons of nput varable x(t ) n FW unts 5 5 Input varable x(t 2) (c) Membershp functons of nput varable x(t 2) n FW unts Fgure 3: The membershp functons of nput varable x(t), x(t ),andx(t 2) n FW unts Mean square error Iteraton Fgure 4: The QPSO-FW convergence curves Table : Performance comparson of the sx predcton methods Method MSE MSE MAPE r CE QPSO-FW BP RBF F FW-GA ARIMA neural network s 3 layers, n whch the number of nput layer nodes s 3, the number of hdden layer nodes s 7, the number of output layer nodes s, and the number of teratons s In the predcton model based on RBF neural network, the radal based dstrbute functon spread s 5 The predcton model based on F neural network s 4 layers and the number of membershp functons s fve The number of teratons s The archtecture of predcton model based on fuzzy wavelet neural network and genetc algorthm (FW-GA) s the same wth the QPSO-FW method The populaton sze of GA s The crossover type s one-pont crossover, and crossover rate s 6 Mutaton rate s and the number of teratons s 5 [3] The predcton model based on ARIMA model s bult The estmaton of the model parameters s done usng Maxmum Lkelhood Estmaton and the best model s chosen as ARIMA (5,, 3) [3] Fgures 6, 7, 8, 9, and show that predcton results wth BP, RBF, F, and FW-GA neural network and ARIMA model, respectvely The performance comparson of the four predcton methods s shown n Table From Table, one can look further nto the predcton performance among the four predcton models By comparng the value of MSE, MSE, MAPE, coeffcent correlaton, and CE, QPSO- FW demonstrates better predcton accuracy than the other three methods Therefore, the expermental results n ths secton show that the predcton method based on QPSO- FW s much more effectve than BP, RBF, F, FW- GA, and ARIMA It can be seen that the predcton method based on QPSO-FW s a better method to predct the tme seres of network traffc In order to test the predcton stablty of each mode, the fve predcton methods were predcted tmes, respectvely Fgures, 2, and 3 show that predcton results wth QPSO- FW models are much more stable than BP, F, and FW-GA 6 Concluson Predctng the drecton of movements of network traffc s mportant as they enable us to detect potental network traffc jam spots Snce the network traffc s affected by many factors, the data of network traffc have the volatlty and self-smlarty features and the network traffc predcton becomes a challenge task In ths paper, the QPSO-FW method has been presented to predct the network traffc The QPSO-FW combnes the QPSO, whch has the mert of powerful global exploraton capablty, wth FW whch can extract the mappng relatons between the nput and output data The parameters of FW neural network are obtaned by quantum-behaved partcle swarm optmzaton (QPSO) and the tme seres of network traffc data was modeled by QPSO-FW Fnally, experments showed that QPSO-FW model has faster and better performance n

8 8 Dscrete Dynamcs n ature and Socety The network traffc Error Predcted value Actual value (a) The predcted results wth QPSO-FW method (b) The error between the actual value and ts predcted value Fgure 5: Predcton wth QPSO-FW model The network traffc Predcted value Actual value (a) The predcted results wth BP neural network Error (b) The error between the actual value and ts predcted value Fgure 6: Predcton results wth BP neural network The network traffc Predcted value Actual value (a) The predcted results wth RBF method Error (b) The error between the actual value and ts predcted value Fgure 7: Predcton results wth RBF neural network The network traffc Predcted value Actual value (a) The predcted results wth F method Error (b) The error between the actual value and ts predcted value Fgure 8: Predcton results wth F neural network

9 Dscrete Dynamcs n ature and Socety 9 The network traffc Predcted value Actual value (a) The predcted results wth FW-GA method Error (b) The error between the actual value and ts predcted value Fgure 9: Predcton results wth FW-GA method The network traffc Predcted value Actual value (a) The predcted results wth ARIMA (5,, 3) model Error (b) The error between the actual value and ts predcted value Fgure : Predcton results wth ARIMA method MAPE s MSE s QPSO-FW BP F FW-GA (a) MAPE hstogram of four predcton models QPSO-FW BP F FW-GA (b) MSE hstogram of four predcton models Fgure : MAPE and MSE hstogram of four predcton models MSE s Coeffcent of effcency (CE) s QPSO-FW BP F FW-GA (a) MSE hstogram of fve predcton models QPSO-FW BP F FW-GA (b) CE hstogram of fve predcton models Fgure 2: MSE and CE hstogram of four predcton models

10 Dscrete Dynamcs n ature and Socety Coeffcent correlaton (r) s QPSO-FW BP F FW-GA Fgure 3: Coeffcent correlaton hstogram of four predcton models predcton of nonlnear and nonstatonary tme seres than many pure neural networks Conflct of Interests The authors declare that there s no conflct of nterests regardng the publcaton of ths paper Acknowledgment Ths research was partally supported by the atonal atural Scence Foundaton of Chna (no 26) References [] H Mahmassan, Dynamc network traffc assgnment and smulaton methodology for advanced system management applcatons, etworks and Spatal Economcs, vol,no3,pp , 2 [2] A oguera, P Salvador, R Valadas et al, Markovan modellng of nternet traffc, n etwork Performance Engneerng, vol 5233 of Lecture otes n Computer Scence, pp 98 24, Sprnger, Berln, Germany, 2 [3] SYChangandH-CWu, ovelfastcomputatonalgorthm of the second-order statstcs for autoregressve movng-average processes, IEEE Transactons on Sgnal Processng, vol 57, no 2, pp , 29 [4] M-C Tan, S C Wong, J-M Xu, Z-R Guan, and P Zhang, An aggregaton approach to short-term traffc flow predcton, IEEE Transactons on Intellgent Transportaton Systems,vol, no, pp 6 69, 29 [5] Y Shu, Z Jn, L Zhang, L Wang, and O W W Yang, Traffc predcton usng FARIMA models, n Proceedngs of the IEEE Internatonal Conference on Communcatons (ICC 99), vol2, pp , IEEE, Vancouver, Canada, June 999 [6] R L, J-Y Chen, Y-J Lu, and Z-K Wang, WPAFIS: combne fuzzy neural network wth multresoluton for network traffc predcton, Chna Unverstes of Posts and Telecommuncatons,vol7,no4,pp88 93,2 [7] K Zhao, Global robust exponental synchronzaton of BAM recurrent Fs wth nfnte dstrbuted delays and dffuson terms on tme scales, Advances n Dfference Equatons, vol 24, artcle 37, 24 [8] EARyng,GLBlbro,andJ-CLu, Focusedlocallearnng wth wavelet neural networks, IEEE Transactons on eural etworks,vol3,no2,pp34 39,22 [9] D Ln, X Wang, F an, and Y Zhang, Dynamc fuzzy neural networks modelng and adaptve backsteppng trackng control of uncertan chaotc systems, eurocomputng,vol73,no6 8, pp , 2 [] R H Abyev and O Kaynak, Fuzzy wavelet neural networks for dentfcaton and control of dynamc plants a novel structure and a comparatve study, IEEE Transactons on Industral Electroncs,vol55,no8,pp333 34,28 [] H Iyatom and M Hagwara, Adaptve fuzzy nference neural network, Pattern Recognton, vol 37, no, pp , 24 [2] C-H Lee and C-C Teng, Identfcaton and control of dynamc systems usng recurrent fuzzy neural networks, IEEE Transactons on Fuzzy Systems,vol8,no4,pp ,2 [3] W L and Y Hor, An algorthm for extractng fuzzy rules basedonrbfneuralnetwork, IEEE Transactons on Industral Electroncs,vol53,no4,pp ,26 [4] G K Venayagamoorthy, Onlne desgn of an echo state network based wde area montor for a multmachne power system, eural etworks, vol 2, no 3, pp 44 43, 27 [5] W Fang, J Sun, and W Xu, A new mutated quantum-behaved partcle swarm optmzer for dgtal IIR flter desgn, EURASIP JournalonAdvancesnSgnalProcessng,vol29,ArtcleID , 7 pages, 29 [6] L dos Santos Coelho and V C Maran, Partcle swarm approach based on quantum mechancs and harmonc oscllator potental well for economc load dspatch wth valve-pont effects, Energy Converson and Management,vol49,no,pp , 28 [7] L D S Coelho, Gaussan quantum-behaved partcle swarm optmzaton approaches for constraned engneerng desgn problems, Expert Systems wth Applcatons, vol 37, no 2, pp , 2 [8] R Pol, Analyss of the publcatons on the applcatons of partcle swarm optmsaton, JournalofArtfcalEvolutonand Applcatons,vol28,ArtcleID68575,pages,28 [9] R C Eberhart and Y Sh, Computatonal Intellgence: Concepts to Implementatons, Elsever, Phladelpha, Pa, USA, 29 [2] S L Sabat, L dos Santos Coelho, and A Abraham, MES- FET DC model parameter extracton usng Quantum Partcle Swarm Optmzaton, Mcroelectroncs Relablty, vol 49, no 6, pp , 29 [2] J Sun, B Feng, and W Xu, Partcle swarm optmzaton wth partcles havng quantum behavor, n Proceedngs of the IEEE Congress on Evolutonary Computaton (CEC 4), pp325 33, Portland, Ore, USA, June 24 [22] M Clerc and J Kennedy, The partcle swarm-exploson, stablty, and convergence n a multdmensonal complex space, IEEE Transactons on Evolutonary Computaton, vol6,no, pp58 73,22 [23] J Sun, W Fang, V Palade, X Wu, and W Xu, Quantumbehaved partcle swarm optmzaton wth Gaussan dstrbuted

11 Dscrete Dynamcs n ature and Socety local attractor pont, Appled Mathematcs and Computaton, vol28,no7,pp ,2 [24] S Mallate, A Wavelet Tour of Sgnal Processng: The Sparse Way, Elsever, Phladelpha, Pa, USA, 29 [25] F-J Ln, C-H Ln, and P-H Shen, Self-constructng fuzzy neural network speed controller for permanent-magnet synchronous motor drve, IEEE Transactons on Fuzzy Systems, vol 9, no 5, pp , 2 [26] S M Mkk and A A Kshk, Quantum partcle swarm optmzaton for electromagnetcs, IEEE Transactons on Antennas and Propagaton, vol 54, no, pp , 26 [27] F H T Vera, G R Banch, and L L Lee, A network traffc predcton approach based on multfractal modelng, Journal of Hgh Speed etworks,vol7,no2,pp83 96,2 [28] M Barabas, G Boanea, A B Rus, V Dobrota, and J Domngo- Pascual, Evaluaton of network traffc predcton based on neural networks wth mult-task learnng and multresoluton decomposton, n Proceedngs of the IEEE 7th Internatonal Conference on Intellgent Computer Communcaton and Processng (ICCP ), pp 95 2, Cluj-apoca, Romana, August 2 [29] Y Lang, Real-tme VBR vdeo traffc predcton for dynamc bandwdth allocaton, IEEE Transactons on Systems, Man and Cybernetcs Part C: Applcatons and Revews, vol34,no,pp 32 47, 24 [3]J-TTsa,T-KLu,andJ-HChou, Hybrdtaguch-genetc algorthm for global numercal optmzaton, IEEE Transactons on Evolutonary Computaton, vol8,no4,pp , 24 [3] K Papagannak, Taft, Z-L Zhang, and C Dot, Long-term forecastng of Internet backbone traffc, IEEE Transactons on eural etworks,vol6,no5,pp 24,25

12 Advances n Operatons Research Volume 24 Advances n Decson Scences Volume 24 Appled Mathematcs Algebra Volume 24 Probablty and Statstcs Volume 24 The Scentfc World Journal Volume 24 Internatonal Dfferental Equatons Volume 24 Volume 24 Submt your manuscrpts at Internatonal Advances n Combnatorcs Mathematcal Physcs Volume 24 Complex Analyss Volume 24 Internatonal Mathematcs and Mathematcal Scences Mathematcal Problems n Engneerng Mathematcs Volume 24 Volume 24 Volume 24 Volume 24 Dscrete Mathematcs Volume 24 Dscrete Dynamcs n ature and Socety Functon Spaces Abstract and Appled Analyss Volume 24 Volume 24 Volume 24 Internatonal Stochastc Analyss Optmzaton Volume 24 Volume 24

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles 1 Internatonal Congress on Informatcs, Envronment, Energy and Applcatons-IEEA 1 IPCSIT vol.38 (1) (1) IACSIT Press, Sngapore Partcle Swarm Optmzaton wth Adaptve Mutaton n Local Best of Partcles Nanda ulal

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

APPLICATION OF RBF NEURAL NETWORK IMPROVED BY PSO ALGORITHM IN FAULT DIAGNOSIS

APPLICATION OF RBF NEURAL NETWORK IMPROVED BY PSO ALGORITHM IN FAULT DIAGNOSIS Journal of Theoretcal and Appled Informaton Technology 005-01 JATIT & LLS. All rghts reserved. ISSN: 199-8645 www.jatt.org E-ISSN: 1817-3195 APPLICATION OF RBF NEURAL NETWORK IMPROVED BY PSO ALGORITHM

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

An Improved multiple fractal algorithm

An Improved multiple fractal algorithm Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

A New Evolutionary Computation Based Approach for Learning Bayesian Network

A New Evolutionary Computation Based Approach for Learning Bayesian Network Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang

More information

A New Quantum Behaved Particle Swarm Optimization

A New Quantum Behaved Particle Swarm Optimization A New Quantum Behaved Partcle Swarm Optmzaton Mlle Pant Department of Paper Technology IIT Roorkee, Saharanpur Inda mllfpt@tr.ernet.n Radha Thangaraj Department of Paper Technology IIT Roorkee, Saharanpur

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Coke Ratio Prediction Based on Immune Particle Swarm Neural Networks

Coke Ratio Prediction Based on Immune Particle Swarm Neural Networks Send Orders for Reprnts to reprnts@benthamscence.ae 576 The Open Cybernetcs & Systemcs Journal, 05, 9, 576-58 Open Access Coke Rato Predcton Based on Immune Partcle Swarm Neural Networks Yang Ka,,*, Jn

More information

Riccardo Poli, James Kennedy, Tim Blackwell: Particle swarm optimization. Swarm Intelligence 1(1): (2007)

Riccardo Poli, James Kennedy, Tim Blackwell: Particle swarm optimization. Swarm Intelligence 1(1): (2007) Sldes largely based on: Rccardo Pol, James Kennedy, Tm Blackwell: Partcle swarm optmzaton. Swarm Intellgence 1(1): 33-57 (2007) Partcle Swarm Optmzaton Sldes largely based on: Rccardo Pol, James Kennedy,

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Multi-Robot Formation Control Based on Leader-Follower Optimized by the IGA

Multi-Robot Formation Control Based on Leader-Follower Optimized by the IGA IOSR Journal of Computer Engneerng (IOSR-JCE e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 19, Issue 1, Ver. III (Jan.-Feb. 2017, PP 08-13 www.osrjournals.org Mult-Robot Formaton Control Based on Leader-Follower

More information

A New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane

A New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane A New Scramblng Evaluaton Scheme based on Spatal Dstrbuton Entropy and Centrod Dfference of Bt-plane Lang Zhao *, Avshek Adhkar Kouch Sakura * * Graduate School of Informaton Scence and Electrcal Engneerng,

More information

RBF Neural Network Model Training by Unscented Kalman Filter and Its Application in Mechanical Fault Diagnosis

RBF Neural Network Model Training by Unscented Kalman Filter and Its Application in Mechanical Fault Diagnosis Appled Mechancs and Materals Submtted: 24-6-2 ISSN: 662-7482, Vols. 62-65, pp 2383-2386 Accepted: 24-6- do:.428/www.scentfc.net/amm.62-65.2383 Onlne: 24-8- 24 rans ech Publcatons, Swtzerland RBF Neural

More information

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods Indan Journal of Scence and Technology Entropy Generaton Mnmzaton of Pn Fn Heat Snks by Means of Metaheurstc Methods Amr Jafary Moghaddam * and Syfollah Saedodn Department of Mechancal Engneerng, Semnan

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

An improved multi-objective evolutionary algorithm based on point of reference

An improved multi-objective evolutionary algorithm based on point of reference IOP Conference Seres: Materals Scence and Engneerng PAPER OPEN ACCESS An mproved mult-objectve evolutonary algorthm based on pont of reference To cte ths artcle: Boy Zhang et al 08 IOP Conf. Ser.: Mater.

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Identification of Linear Partial Difference Equations with Constant Coefficients

Identification of Linear Partial Difference Equations with Constant Coefficients J. Basc. Appl. Sc. Res., 3(1)6-66, 213 213, TextRoad Publcaton ISSN 29-434 Journal of Basc and Appled Scentfc Research www.textroad.com Identfcaton of Lnear Partal Dfference Equatons wth Constant Coeffcents

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate Internatonal Journal of Mathematcs and Systems Scence (018) Volume 1 do:10.494/jmss.v1.815 (Onlne Frst)A Lattce Boltzmann Scheme for Dffuson Equaton n Sphercal Coordnate Debabrata Datta 1 *, T K Pal 1

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

Research Article Relative Smooth Topological Spaces

Research Article Relative Smooth Topological Spaces Advances n Fuzzy Systems Volume 2009, Artcle ID 172917, 5 pages do:10.1155/2009/172917 Research Artcle Relatve Smooth Topologcal Spaces B. Ghazanfar Department of Mathematcs, Faculty of Scence, Lorestan

More information

A Fast Computer Aided Design Method for Filters

A Fast Computer Aided Design Method for Filters 2017 Asa-Pacfc Engneerng and Technology Conference (APETC 2017) ISBN: 978-1-60595-443-1 A Fast Computer Aded Desgn Method for Flters Gang L ABSTRACT *Ths paper presents a fast computer aded desgn method

More information

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,

More information

An identification algorithm of model kinetic parameters of the interfacial layer growth in fiber composites

An identification algorithm of model kinetic parameters of the interfacial layer growth in fiber composites IOP Conference Seres: Materals Scence and Engneerng PAPER OPE ACCESS An dentfcaton algorthm of model knetc parameters of the nterfacal layer growth n fber compostes o cte ths artcle: V Zubov et al 216

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

A Neuro-Fuzzy System on System Modeling and Its. Application on Character Recognition

A Neuro-Fuzzy System on System Modeling and Its. Application on Character Recognition A Neuro-Fuzzy System on System Modelng and Its Applcaton on Character Recognton C. J. Chen 1, S. M. Yang 2, Z. C. Wang 3 1 Department of Avaton Servce Management Alethea Unversty Tawan, ROC 2,3 Department

More information

Multilayer Perceptrons and Backpropagation. Perceptrons. Recap: Perceptrons. Informatics 1 CG: Lecture 6. Mirella Lapata

Multilayer Perceptrons and Backpropagation. Perceptrons. Recap: Perceptrons. Informatics 1 CG: Lecture 6. Mirella Lapata Multlayer Perceptrons and Informatcs CG: Lecture 6 Mrella Lapata School of Informatcs Unversty of Ednburgh mlap@nf.ed.ac.uk Readng: Kevn Gurney s Introducton to Neural Networks, Chapters 5 6.5 January,

More information

The Chaotic Robot Prediction by Neuro Fuzzy Algorithm (2) = θ (3) = ω. Asin. A v. Mana Tarjoman, Shaghayegh Zarei

The Chaotic Robot Prediction by Neuro Fuzzy Algorithm (2) = θ (3) = ω. Asin. A v. Mana Tarjoman, Shaghayegh Zarei The Chaotc Robot Predcton by Neuro Fuzzy Algorthm Mana Tarjoman, Shaghayegh Zare Abstract In ths paper an applcaton of the adaptve neurofuzzy nference system has been ntroduced to predct the behavor of

More information

AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING

AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING Qn Wen, Peng Qcong 40 Lab, Insttuton of Communcaton and Informaton Engneerng,Unversty of Electronc Scence and Technology

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Non-linear Canonical Correlation Analysis Using a RBF Network

Non-linear Canonical Correlation Analysis Using a RBF Network ESANN' proceedngs - European Smposum on Artfcal Neural Networks Bruges (Belgum), 4-6 Aprl, d-sde publ., ISBN -97--, pp. 57-5 Non-lnear Canoncal Correlaton Analss Usng a RBF Network Sukhbnder Kumar, Elane

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

On the correction of the h-index for career length

On the correction of the h-index for career length 1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

Orientation Model of Elite Education and Mass Education

Orientation Model of Elite Education and Mass Education Proceedngs of the 8th Internatonal Conference on Innovaton & Management 723 Orentaton Model of Elte Educaton and Mass Educaton Ye Peng Huanggang Normal Unversty, Huanggang, P.R.Chna, 438 (E-mal: yepeng@hgnc.edu.cn)

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD 90 CHAPTER 7 STOCHASTIC ECOOMIC EMISSIO DISPATCH-MODELED USIG WEIGHTIG METHOD 7.1 ITRODUCTIO early 70% of electrc power produced n the world s by means of thermal plants. Thermal power statons are the

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

Statistical inference for generalized Pareto distribution based on progressive Type-II censored data with random removals

Statistical inference for generalized Pareto distribution based on progressive Type-II censored data with random removals Internatonal Journal of Scentfc World, 2 1) 2014) 1-9 c Scence Publshng Corporaton www.scencepubco.com/ndex.php/ijsw do: 10.14419/jsw.v21.1780 Research Paper Statstcal nference for generalzed Pareto dstrbuton

More information

Neural Networks & Learning

Neural Networks & Learning Neural Netorks & Learnng. Introducton The basc prelmnares nvolved n the Artfcal Neural Netorks (ANN) are descrbed n secton. An Artfcal Neural Netorks (ANN) s an nformaton-processng paradgm that nspred

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

CHAPTER IV RESEARCH FINDING AND DISCUSSIONS

CHAPTER IV RESEARCH FINDING AND DISCUSSIONS CHAPTER IV RESEARCH FINDING AND DISCUSSIONS A. Descrpton of Research Fndng. The Implementaton of Learnng Havng ganed the whole needed data, the researcher then dd analyss whch refers to the statstcal data

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Feature Selection & Dynamic Tracking F&P Textbook New: Ch 11, Old: Ch 17 Guido Gerig CS 6320, Spring 2013

Feature Selection & Dynamic Tracking F&P Textbook New: Ch 11, Old: Ch 17 Guido Gerig CS 6320, Spring 2013 Feature Selecton & Dynamc Trackng F&P Textbook New: Ch 11, Old: Ch 17 Gudo Gerg CS 6320, Sprng 2013 Credts: Materal Greg Welch & Gary Bshop, UNC Chapel Hll, some sldes modfed from J.M. Frahm/ M. Pollefeys,

More information

Research on Route guidance of logistic scheduling problem under fuzzy time window

Research on Route guidance of logistic scheduling problem under fuzzy time window Advanced Scence and Technology Letters, pp.21-30 http://dx.do.org/10.14257/astl.2014.78.05 Research on Route gudance of logstc schedulng problem under fuzzy tme wndow Yuqang Chen 1, Janlan Guo 2 * Department

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Journal of Chemical and Pharmaceutical Research, 2014, 6(5): Research Article

Journal of Chemical and Pharmaceutical Research, 2014, 6(5): Research Article Avalable onlne www.jocpr.com Journal of Chemcal and Pharmaceutcal Research, 014, 6(5):1683-1688 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Multple mode control based on VAV ar condtonng system

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

A PSO with Quantum Infusion Algorithm for Training Simultaneous Recurrent eural etworks

A PSO with Quantum Infusion Algorithm for Training Simultaneous Recurrent eural etworks A PO wth Quantum Infuson Algorthm for Tranng multaneous Recurrent eural etworks Bpul utel and Ganesh Kumar Venayagamoorthy Abstract multaneous Recurrent eural etwork (R ) s one of the most powerful neural

More information

Chapter 3 Describing Data Using Numerical Measures

Chapter 3 Describing Data Using Numerical Measures Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The

More information

Adaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays *

Adaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays * Journal of Robotcs, etworkng and Artfcal Lfe, Vol., o. (September 04), 5-9 Adaptve Consensus Control of Mult-Agent Systems wth Large Uncertanty and me Delays * L Lu School of Mechancal Engneerng Unversty

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

A Network Intrusion Detection Method Based on Improved K-means Algorithm

A Network Intrusion Detection Method Based on Improved K-means Algorithm Advanced Scence and Technology Letters, pp.429-433 http://dx.do.org/10.14257/astl.2014.53.89 A Network Intruson Detecton Method Based on Improved K-means Algorthm Meng Gao 1,1, Nhong Wang 1, 1 Informaton

More information

Atmospheric Environmental Quality Assessment RBF Model Based on the MATLAB

Atmospheric Environmental Quality Assessment RBF Model Based on the MATLAB Journal of Envronmental Protecton, 01, 3, 689-693 http://dxdoorg/10436/jep0137081 Publshed Onlne July 01 (http://wwwscrporg/journal/jep) 689 Atmospherc Envronmental Qualty Assessment RBF Model Based on

More information

Study on Active Micro-vibration Isolation System with Linear Motor Actuator. Gong-yu PAN, Wen-yan GU and Dong LI

Study on Active Micro-vibration Isolation System with Linear Motor Actuator. Gong-yu PAN, Wen-yan GU and Dong LI 2017 2nd Internatonal Conference on Electrcal and Electroncs: echnques and Applcatons (EEA 2017) ISBN: 978-1-60595-416-5 Study on Actve Mcro-vbraton Isolaton System wth Lnear Motor Actuator Gong-yu PAN,

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata TC XVII IMEKO World Congress Metrology n the 3rd Mllennum June 7, 3,

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Short Term Load Forecasting using an Artificial Neural Network

Short Term Load Forecasting using an Artificial Neural Network Short Term Load Forecastng usng an Artfcal Neural Network D. Kown 1, M. Km 1, C. Hong 1,, S. Cho 2 1 Department of Computer Scence, Sangmyung Unversty, Seoul, Korea 2 Department of Energy Grd, Sangmyung

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland

More information

U-Pb Geochronology Practical: Background

U-Pb Geochronology Practical: Background U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result

More information

Modeling of Dynamic Systems

Modeling of Dynamic Systems Modelng of Dynamc Systems Ref: Control System Engneerng Norman Nse : Chapters & 3 Chapter objectves : Revew the Laplace transform Learn how to fnd a mathematcal model, called a transfer functon Learn how

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

arxiv:cs.cv/ Jun 2000

arxiv:cs.cv/ Jun 2000 Correlaton over Decomposed Sgnals: A Non-Lnear Approach to Fast and Effectve Sequences Comparson Lucano da Fontoura Costa arxv:cs.cv/0006040 28 Jun 2000 Cybernetc Vson Research Group IFSC Unversty of São

More information

Uncertainty and auto-correlation in. Measurement

Uncertainty and auto-correlation in. Measurement Uncertanty and auto-correlaton n arxv:1707.03276v2 [physcs.data-an] 30 Dec 2017 Measurement Markus Schebl Federal Offce of Metrology and Surveyng (BEV), 1160 Venna, Austra E-mal: markus.schebl@bev.gv.at

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Grey prediction model in world women s pentathlon performance prediction applied research

Grey prediction model in world women s pentathlon performance prediction applied research Avalable onlne www.jocpr.com Journal of Chemcal and Pharmaceutcal Research, 4, 6(6):36-4 Research Artcle ISSN : 975-7384 CODEN(USA) : JCPRC5 Grey predcton model n world women s pentathlon performance predcton

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Multiple Sound Source Location in 3D Space with a Synchronized Neural System

Multiple Sound Source Location in 3D Space with a Synchronized Neural System Multple Sound Source Locaton n D Space wth a Synchronzed Neural System Yum Takzawa and Atsush Fukasawa Insttute of Statstcal Mathematcs Research Organzaton of Informaton and Systems 0- Mdor-cho, Tachkawa,

More information

Note 10. Modeling and Simulation of Dynamic Systems

Note 10. Modeling and Simulation of Dynamic Systems Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada

More information

Laboratory 1c: Method of Least Squares

Laboratory 1c: Method of Least Squares Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly

More information

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method Journal of Electromagnetc Analyss and Applcatons, 04, 6, 0-08 Publshed Onlne September 04 n ScRes. http://www.scrp.org/journal/jemaa http://dx.do.org/0.46/jemaa.04.6000 The Exact Formulaton of the Inverse

More information