Process Optimization by Soft Computing and Its Application to a Wire Bonding Problem
|
|
- Diana Karen Gilbert
- 5 years ago
- Views:
Transcription
1 Internatonal Journal of Appled Scence and Engneerng , : 59-7 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem Ch-Bn Cheng Department of Industral Engneerng and Management, Chaoyang Unversty of Technology, Wufeng, Tachung country 43, Tawan, ROC Abstract: Modelng and optmzaton of a process wth multple outputs s dscussed n ths paper A neuro-fuzzy system named MANFIS, whch comprses a fuzzy nference structure and neural network learnng ablty, s used to model a multple output process Optmzaton of such a process s formulated as a multple objectve decson makng problem, and a genetc algorthm and a numercal method are ntroduced, respectvely, to solve ths problem based on the MAN- FIS model We have used these two algorthms, respectvely, to solve a chemcal process optmzaton problem, and compared ther performances A combnaton of these two algorthms s also suggested to mprove performances of both algorthms The proposed approach s also appled to a wre-bondng problem n semconductor manufacturng Keywords: process optmzaton; soft computng; neuro-fuzzy system; genetc algorthm, multple objectve decson makng; wre bondng Introducton Process optmzaton s to fnd a settng of the controllable varables, or called nput varables, so as to obtan the best outcomes of a process The outcomes of a process are often referred to as the outputs or responses of a system In ths study, optmzaton of a process wth multple outputs s consdered For example, n a tool lfe problem, we attempt to determne the cuttng speed and depth of cut so as to obtan a maxmal lfe of the tool (a prmary response) and retan a satsfed rate of metal removed (a secondary response) at the same tme Response optmzaton methods are popular tools for process optmzaton Usually, these methods nclude two stages In the frst stage, we use regresson analyss to model a system's responses; that s, we dentfy the relatonshp between responses and nput varables through regresson functons In the second stage, we use optmzaton technques to obtan a settng of system parameters that gve system the most desrable responses Tradtonally, n the frst stage, lnear regresson wth the regressors n a frst-order or second-order polynomal form s used to approxmate the response surfaces However, frequently encountered n practce, systems are complcated and hghly nonlnear, and thus, lnear regresson s not sutable In recent years, nonparametrc regresson approaches, such as neural networks and fuzzy nference systems, are wdely adopted for modelng nonlnear systems These nonparametrc approaches learn the relatons between nput varables and responses drectly from Correspondng e-mal: cbcheng@malcyutedutw Accepted for Publcaton: Dec 23, Chaoyang Unversty of Technology, ISSN Int J Appl Sc Eng, , 59
2 Ch-Bn Cheng the observatons wthout assumng any pre-specfed functonal form The combnaton of fuzzy nference systems and neural networks, together wth genetc algorthms, create a new research area called soft computng Soft computng emerges as a computng approach that tres to mmc human's ablty of reasonng and learnng n an uncertan envronment One representatve technque of soft computng s neuro-fuzzy systems A neuro-fuzzy system s a fuzzy nference system presented n a network structure, and equpped wth neural network learnng abltes In ths study, we use a neuro-fuzzy system, named multple adaptve neuro-fuzzy nference system (MANFIS) [7], to model a system that has multple responses; and furthermore, we also use a genetc algorthm (GA) [5] to optmze ths system s responses based on the model of MANFIS A multple response system has m response y, y 2,, y m, whch are affected by a set of nput varables x = (x, x 2,, x p ) T Tradtonally, the relatons between responses and nput varables are defned through functons: y = f ( x ) + ε,, 2,, m, () = where f s the functonal relaton between x and the -th response y, and ε are d random errors wth zero means and constant varances σ 2, The objectve of the multple response optmzaton s to fnd a soluton x such that each response wll attan a compromsed optmum Many approaches have been proposed to solve the multple response optmzaton problem Derrnger and Such [4] transform each response functon nto a desrablty functon, and then maxmze the geometrc mean of the ndvdual desrablty functons to obtan a compromsed soluton Khur and Conlon [8] presented a procedure based on a dstance functon that calculates the overall closeness where the response functons acheve ther respectve optmum at the same set of condtons; a compromsed soluton s then found by mnmzng ths dstance functon over the expermental regon Pgnatello [3], Ames et al [] and Vnng [6] all propose to mnmze a measure based on a multvarate loss functon, whch evaluates the loss when responses devate from ther targets For the specal case of two responses, Myers and Carter [] ntroduced a dual response approach, whch optmzes the prmary response subject to an approprate constrant on the secondary response The dsadvantage of ther approach s that such an optmzaton scheme can be msleadng due to the unrealstc restrcton of forcng the constraned response to a specfc value [0] To remedy the dsadvantage of the approach of Myers and Carter [], Km and Ln [9] formulate the dual response problem as a multple objectve decson makng (MODM) programmng and ntroduce a fuzzy optmzaton methodology, whch s based on Zmmermann's maxmn approach [7] Ther approach optmzes the prmary response and the secondary response, smultaneously, by maxmzng a compromsed satsfacton degree of both responses The degrees of satsfacton of both the mean response and devaton are defned by membershp functons orgnated n fuzzy set theory Though the prevous approaches vared n ther soluton procedures, they commonly assumed lnear response surfaces In ths study, to deal wth nonlnear responses, the system s modeled by MANFIS, and the multple response optmzaton problem s formulated as an MODM However, snce we use the nonparametrc regresson tool MANFIS to model responses, exact functonal forms of responses are not known and hence dervatve-based optmzaton methods cannot be drectly appled to obtan the optmal soluton Therefore, we wll use a genetc algorthm as well as a numercal method to search optmal solutons on the response surfaces Performances of these two algorthms wll be compared The remander of ths paper s organzed as follows In the next secton, the archtecture 60 Int J Appl Sc Eng, ,
3 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem of MANFIS and ts learnng process are summarzed Secton 3 formulates the multple response optmzaton problem as an MODM Two optmzaton algorthms, a genetc algorthm and a numercal method, are presented n Secton 4 to solve the MODM For llustraton, Secton 5 uses the two algorthms, respectvely, to solve a chemcal process optmzaton problem To mprove the performances of both algorthms, we also suggest a combnaton of these two algorthms Computatonal results show ths combned algorthm s promsng Concludng remarks are gven n the last secton 2 Multple adaptve neuro-fuzzy nference system MANFIS s an extenson of the sn gle-output neuro-fuzzy system ANFIS [6], for producng multple outputs A neuro-fuzzy system can serve as a nonparametrc regresson tool, whch model the regresson relatonshp non-parametrcally wthout reference to any pre-specfed functonal form MAN- FIS can be vewed as an aggregaton of many ndependent ANFIS The archtecture of MANFIS s depcted n Fgure x x 2 x p ANFIS ANFIS 2 Fgure Archtecture of MANFI S Every sngle ANFIS n an MANFIS smulates the functonal relatons f, =,, m, n Equaton () ANFIS can be consdered as a network presentaton of a TSK fuzzy nference system [5], and the f-then rules n TSK are comprsed n the network structure To llustrate the archtecture of ANFIS, an example wth a two-dmensonal nput s vsualzed n Fgure 2 ANFIS m y y 2 y m Layer Layer 2 Layer 3 Layer 4 Layer 5 A w N z w x B w 2 N w 2 z 2 (to every node n Layer 4) ŷ x 2 A 2 w 3 N w 3 z 3 B 2 w4 N w 4 z 4 Fgure 2 Archtecture of ANFIS Int J Appl Sc Eng, , 6
4 Ch-Bn Cheng To reflect dfferent adaptve capabltes, the nodes n ANFIS are represented by crcles or squares, n whch, square nodes represent adaptve nodes and crcle nodes represent fxed nodes Adaptve nodes contan parameters that can be adjusted by learnng, whle the fxed nodes do not contan adjustable parameters In ths study, the adaptve nodes n layer of the ANFIS are parameterzed by Gaussan functons wth ther means and devatons Nodes n layer 2 are fxed nodes labeled Π, whch s a fuzzy conjuncton operator Functons of nodes n ths layer are to synthesze the nformaton from the frst layer The operator Π s defned as a multplcaton of all of ts ncomng sgnals, and output the frng strength w j, j=,,4 Nodes n layer 3 labeled by N smply performs a normalzaton of sgnals from layer 2 and output the normalzed frng strength w = w / w 4, j j r= j=,,4 The adaptve nodes n layer 4 of the ANFIS contan lnear functons of the nput varables wth ther coeffcents as the adjustable parameters; that s, z j = a j x +b j x 2 +c j, j=,,4 The sngle node n layer 5 s a fxed node, whch computes the overall output as the summaton of all ncomng sgnals: y ˆ = 4 w j z j j= Assumng that we have conducted an experment wth n runs on an m-response system, n observatons are collected wth the format of (x k, y k,,y k,,y mk ), k=,,n, where x k s the nput condton at the k-th run and y k s the -th response at the k-th run Wth these observatons, MANFIS can approxmate the multple responses y, =,,m, by mnmzng an error measure E defned as E = n m k = = ( y k k ) 2, (2) where ŷ k s the estmate of the -th response for the k-th run The mnmzaton of E s carred out n an teratve manner, whch r s referred to as a learnng process The learnng process of MANFIS termnates when the error measure E reduces to a satsfactory level Snce E s a summaton of the squared errors from m ndependent ANFIS, the learnng of MANFIS can be treated as the learnng of m ndependent ANFIS Furthermore, snce ANFIS s a mult-layered-feed-forward network, backpropagaton learnng algorthms used n neural networks can be drectly appled to ts learnng The detals of ths learnng process can be found n [6] 3 MODM formulaton of multple response optmzaton By means of the learnng process, MAN- FIS obtans an estmaton of desred outputs wth gven nputs Let ŷ, =,,m, be the -th output of MANFIS, and they are estmates of multple responses y,,y m, respectvely To ndcate these estmates are functons of the nput varables x, they wll be denoted as ŷ (x), =,,m Snce the system under dscusson has multple responses, the optmzaton of the system n fact nvolves the optmzaton of several ndvdual responses at the same tme For all the system responses, they can be dvded nto three sets: ) the-larger-the-better, denoted by L; 2) the-smaller-the-better, denoted by S; and 3) the-nomnal-the-best, denoted by N We have formulated ths optmzaton problem as a multple objectve decson makng problem wth the followng form [2]: max l, l L mn s, s S mn t Tt, t N st x B, (3) where T t s the nomnal target of the t-th response; and B s a feasble regon of x To solve the above multple objectve op- 62 Int J Appl Sc Eng, ,
5 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem tmzaton problem, we follow the dea of Zmmermann's maxmn approach [7] Accordng to the maxmn approach, the soluton of (3) can be obtaned by maxmzng an overall satsfactory degree among all ndvdual objectves n (3) That s, for each objectve, t has ts own satsfactory degree, and the overall satsfacton s an ntersecton of all ndvdual satsfactory degrees, where the ntersecton s defned through a mn operator The satsfactory degree for each objectve s evaluated by an user-defned membershp functon µ ˆ ( ˆ y y ) Let λ be the overall satsfactory degree, and then we can convert the orgnal MODM (3) to: max λ st µ ( ˆ ) λ, =,, m, y ˆ y x B, λ [ 0,] (4) Each response's membershp functon µ ˆ ( y ) should be well chosen so as to reflect ts characterstc For the response belonged to the set of the-larger-the-better, ts degree of satsfacton reaches when t s at max { ˆ = x B y } and then decreases monotoncally to 0 at mn { ˆ = x B y } A typcal membershp functon for y ˆ, L, could be stated as, f > ˆ y, ˆ y µ ( ˆ =, f ˆ ˆ ( ) ˆ y ) y, y x y L ˆ y (5) 0, f ( ) < ˆ x y, The above membershp functon s graphcally shown n Fgure 3 For the response belonged to the set of the-smaller-the-better, we set the satsfactory degree to when a response s at ŷ and then t decreases monotoncally to 0 at above membershp functon s depcted n Fgure 4 µ(ŷ ) Fgure 3 Membershp functon of µ ˆ ( y ) : ''the larger the better'' case y ˆ Such type of membershp functons can be expressed as, ˆ y µ ˆ ( y ) =, ˆ y 0, µ(ŷ ) 0 ŷ ŷ ŷ - f <, f, S, f > 0 ŷ ŷ ŷ - Fgure 4 Membershp functon of µ ˆ ( y ) : ''the smaller the better'' case Smlarly, for the response of the set of the-nomnal-the-best, the degree of satsfacton s maxmzed when t s at ts target T, and decreases as t s away from T Membershp functons of ths type can be defned as (6) Int J Appl Sc Eng, , 63
6 Ch-Bn Cheng T ˆ y, T ˆ y ( x) T ( ( x)) =, T 0, f < T, f T <, N, µ (7) elsewhere Membershp functon of (7) s depcted n Fgure 5 µ(ŷ ) 0 ŷ - T Fgure 5 Membershp functon of µ ˆ ( y ) : ''the nomnal the best'' case The problem formulaton of (4) cannot be drectly solved by the use of dervatve-based methods due to unknown functonal forms of y ˆ Dervatve-free methods such as genetc algorthm and smulated annealng are deally suted for solvng problems where dervatve nformaton s unavalable Alternatvely, we can approxmate the dervatves wth numercal methods In ths study, we wll apply GA and a numercal method, respectvely, to solve (4) 4 Soluton procedures In the prevous secton, we have formulated the multple response optmzaton problem as an MODM In ths secton, we suggest usng two dfferent algorthms, a genetc algorthm and a numercal method, to solve ths MODM ŷ ŷ 4 Genetc algorthm Genetc algorthm frst proposed by Holland [5] s a dervatve-free stochastc optmzaton approach based on the concepts of bologcal evolutonary processes GA encodes each pont n a soluton space nto a bnary bt strng called a chromosome Operatons of chromosomes ncludng selecton, crossover, and mutaton, are used to generate new chromosomes so as to explore the soluton space Each chromosome s evaluated by a ftness functon Such a ftness functon corresponds to the objectve functon of the orgnal problem A great varety of genetc algorthms have been proposed n the lterature In ths study, we wll just use a basc form of GA Nevertheless, t performs well as observed n our computaton results Ths genetc algorthm contans a roulette wheel selecton, a sngle pont crossover, and a random flppng mutaton The ftness of chromosomes s determned va (4) It s not straghtforward to determne the values of λ for a certan soluton by usng (4) Therefore, we rewrte (4) as max λ st λ = mn = x B,, m { µ ( ˆ ) }, y ˆ y (8) By employng the traned MANFIS, the formulaton of (8) s presented n a network form n Fgure 6, and λ can be drectly read from the output end of ths network Genetc algorthm for solvng the multple response optmzaton problem has been formulated n our earler paper [3] In ths paper, we further nvestgate ts performance wth computatonal experments n Secton 5 42 Numercal method A numercal method based on Lagrange relaxaton for solvng the multple response optmzaton problem has been formulated n 64 Int J Appl Sc Eng, ,
7 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem [2] Though ths earler method has the ANFIS µ(ŷ ) x ANFIS 2 µ(ŷ 2 ) x 2 mn λ x p ANFIS m µ(ŷ m ) Fgure 6 Network presentaton of formulaton (8) advantage of provdng an upper bound of the optmal soluton, t s rather complcated In ths paper, a smpler numercal method, whch drectly solves the prmal problem, s formulated as the follows Recallng the formulaton of (8), to ndcate λ beng a functon of x we denote t as λ(x) The gradent of λ(x) s defned as λ( x) x λ = : (9) λ( x) x p By fxng the values of all x k j, and by gvng a small ncrement x j on x j, the partal dervatve can be approxmated through λ(x) x j λ ( x ) λ j + j p λ j p (0) x j ( x,, x x,, x ) x j ( x,, x,, x ) After the gradent s determned, the maxmzaton of λ(x) can be done by an tera- tve manner through the updatng of x, subject to the feasble regon constrant The rule of ths updatng s x new = x old + s λ(x old ), () where s s a step sze The steps of ths numercal method are summarzed below Step 0 Intalzaton: set the teraton counter r = 0, the accuracy requrement τ, and the step sze s; arbtrarly choose ntal value x 0 wthn the feasble regon Step Gradent calculaton: calculate the gradent of λ through Eq (0) wth x r Step 2 Updatng of x: x r+ = x r + s λ(x r ) Step 3 If λ( x r+ ) - λ(x r ) τ, stop; otherwse, go to Step 4 Step 4 Increase the teraton counter r r + Go to Step Int J Appl Sc Eng, , 65
8 Ch-Bn Cheng 5 Computatonal comparson To llustrate our approach, a chemcal process optmzaton problem taken from Myers and Montgomery [2] s reproduced as the follows A chemcal process has three controllable varables: reacton tme (x ), temperature (x 2 ), and percent catalyst (x 3 ); and ts responses are percent converson (y ), and thermal actvty (y 2 ) For ths process, t s mportant to maxmze y whle y 2 s held between 55 and 60 wth a nomnal target 575 Experments are conducted wth dfferent setups of reacton tme, temperature, and percent catalyst to collect data of ths chemcal process 5 Modelng by MANFIS MANFIS s employed to model the response surfaces of the above chemcal process The MANFIS for ths problem has two output nodes correspondng to the two responses of ths process, and hence ths MANFIS conssts of two ndependent ANFIS The Fuzzy Toolbox n MATLAB software provdes functons of constructng, edtng and tranng of ANFIS We use ths software to construct two ndependent ANFIS networks and tran them by the expermental data The convergence behavor of one of the learnng process s shown n Fgure 7 Fgure 7 Convergence of the learnng of y 2 After completng the tranng of MANFIS, the multple response problem s solved by usng the formulaton of (8) Snce the response y belongs to the set of the-larger-the better, ts membershp functon should take the form of (5); and the response y 2 has a nomnal target, so t wll take the membershp functon (7) In order to determne these membershp functons, the maxmum and thermal actvty to be held between 55 and 60, therefore, t s reasonable to set 55 and 60 as mnmum for ndvdual response must be obtaned Maxmum and mnmum of responses can be obtaned by formulatng sngle objectve programmng problems for ndvdual responses, and solvng the problems wth any dervatve-free algorthm Alternatvely, they can also be subjectvely determned accordng to users' judgment or ther expectaton In our example, t s desred that the response of the mnmum and maxmum of ths response, respectvely Smlarly, the mnmum and ma- 66 Int J Appl Sc Eng, ,
9 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem xmum of the response of percent converson are set as 50 and 00, respectvely The possble ranges for x, x 2 and x 3 are set as [-2, 2] 52 Solvng by GA The genetc algorthm s mplemented on the MATLAB platform and run on an IBM compatble PC wth Pentum III-800 CPU Ten trals are conducted, wth the parameters n GA settng as: populaton sze = 24, cross-over rate = 07, and mutaton rate = 02 The results are lsted n Table, n whch, the second column s the tme (n seconds) consumed by each tral to obtan the best soluton, and the last two columns are the responses yelded by the best solutons From Table we can see that all the ten trals produce hgh qualty solutons, e all trals except the thrd tral obtan optmal solutons Nevertheless, they usually consume a lot of computaton tmes Table Results of chemcal process optmzaton by GA Tral Tme λ Responses y y Solvng by the numercal method The numercal method s also mplemented on the MATLAB platform and run on the same machne Ten trals are also carred out and ther results are shown n Table 2 The startng ponts n these trals are arbtrarly chosen We found that the qualty of solutons obtaned by ths numercal method cannot compete wth those obtaned by GA, and the startng ponts crtcally affect the results In number method should reach the optmal soluton very fase On the other hand, though partcular, four (Tral 3, 6, 8 and 9) out of ten trals are faled because of the startng ponts are fallng n a flat area of the response surface and hence no gradent can be found 54 Combnng GA and numercal method Though the numercal method faled to produce hgh qualty soluton, t can fast solve the problem If we can provde a startng pont n the vcnty of the optmal soluton, the GA usually takes a long tme to fnd a hgh qualty soluton, n the frst few generatons Int J Appl Sc Eng, , 67
10 Ch-Bn Cheng Table 2 Results of chemcal process optmzaton by the numercal method Tral Tme λ Responses y y Table 3 Results of chemcal process optmzaton by the combned algorthm Tral Alg Tme λ Responses y y 2 GA NM GA NM GA NM GA NM GA NM GA NM GA NM GA NM : no mprovement 68 Int J Appl Sc Eng, ,
11 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem The dea s to combne these two algorthms together That s, use GA to fnd a startng pont for the numercal method We have conducted 8 trals to justfy ths dea In each tral, GA s run frst for 20 generatons to obtan a soluton, and ths soluton wll serve as a startng pont for the numercal method Computatonal results are shown n Table 3, n whch, the second column s the algorthm used and NM denotes the numercal method In Tral, 3 and 4, the numercal method provdes sgnfcant mprovement of the startng solutons, and among whch, Tral and 4 produce hgh qualty solutons Though Tral 2, 5, 6, and 7 do not sgnfcantly mprove ther startng solutons, they all produce hgh qualty solutons It s observed that the startng solutons of these trals are already n good shapes; and ths may be why t s dffcult for the NM to mprove much on these startng solutons The fnal tral found no mprovement for ts startng soluton, possbly caused by the startng soluton fallng on a plateau of the response surface Though the results n Table 3 show mperfecton of the combned algorthm, we stll consder the combnaton of GA and numercal method s promsng for two reasons: ) ths combned algorthm consumes much less tme than GA to fnd a satsfactory soluton and, 2) t s possble to fnd a hgh qualty soluton n a moderate number of trals 6 Applcaton to a wre bondng problem Wre bondng s a weldng process, n whch wre and pad surface are brought nto ntmate contact by usng thn wre and a combnaton of heat, pressure and ultrasonc energy Dynamc random access memory (DRAM) chps and most commodty chps n plastc packages are assembled by wre bondng About 2-4 trllon wre nterconnectons are produced annually Wre bondng falures nclude bond off center, bond not stckng on de, wre breakng and so on In a producton envronment, wre pull strength s usually montored to mnmze process drft To acheve a stable performance of the wre bondng process, the operatng varables such as bondng parameters need to be strctly regulated Crtcal bondng parameters nclude bondng force, bondng tme, and ultrasonc power To fnd optmal setups of bondng parameters, tradtonally, a serous of bondng tests s performed by varyng bondng parameters to draw out the optmal bondng condtons Evaluaton of wre pull strength s used to defne the optmalty of bondng parameters In the evaluaton, three sets of curves of wre pull strength versus ultrasonc power, bondng tme, or bondng force can be obtaned by varyng one of these parameters whle holdng the other two constant at ther optmum In such an approach, the search s less effcent and frequently falls n a local optmum especally when the response surface s hghly nonlnear To demonstrate the potental usage of our approach n real-world problems, the proposed approach n Secton 4 s appled to the optmzaton of a wre bondng process n an IC packagng company n Tawan By fxng parameters of cut mode, heat, and loopng of the wre bonder, and varyng the parameters of bondng force, bondng tme, and ultrasonc power, a desgn of experment s conducted to collect data of the process Each of the three varable parameters s set wth three levels, and hence the experment results n a combnaton of 27 trals of bondng tests Each tral contans 00 replcatons, and the two concernng responses are average wre pull and ts devaton, where average wre pull s a the-larger-the-better response, and devaton s a the-smaller-the-better response Frstly, MANFIS s employed to model the responses of ths process To ensure the generalty of the MANFIS model, and to fully utlze the lmted number of expermental data, an extreme cross-valdaton technque called leave one-out cross-valdaton [4] s used The dea of cross-valdaton s to dvde the sample data nto a constructon Int J Appl Sc Eng, , 69
12 Ch-Bn Cheng sub-sample, whch forms the tranng data set, and a valdaton sub-sample, whch forms the test data set The leave one-out cross-valdaton s to dvde the sample sze n nto a tranng data set contanng n- observatons, and leave the rest sngle observaton as the test datum Such a technque consders the dvson of the observatons n all n possble ways The cross- valdaton crteron s defned as n m CV (P) = ( yk k [ O \ ]) 2, (2) nm = k = where P s the set of crtcal factors that affect the accuracy of MANFIS, and k [ O \ ] s an estmate of y k and t s obtaned from an MANFIS that s traned by the sample data excludng the -th datum The set of crtcal factors P contans only one factor, the number of nodes (n layer ) assocated wth an nput varable To fnd the best setup of P, CV(2), CV(3), and CV(4) s compared, and we found that CV(3) s the mnmum Wth the result of cross-valdaton, the MANFIS for modelng the wre bondng process s constructed as: two ndependent ANFIS, and n each ANFIS there are 3 nodes assocated wth each nput and hence resultng n 9 nodes n layer, 27 nodes n layer 2, 27 nodes n layer 3, and 27 nodes n layer 4 The optmzaton of the wre bondng process s modeled by the formulaton of (3), wth a prmary objectve of maxmzng the wre pull and a secondary objectve of mnmzng process varaton To construct membershp functons for these two objectves we need to know ther respect mnmum and maxmum as defned n Secton 3 The mnmum of wre pull s set as ts specfcaton (e ts mnmal requrement), and the maxmum of wre pull s determned accordng to past experence of runnng test on bondng The mnmum and maxmum of the process varaton are determned through a process performance ndex (Ppk) The defnton of Ppk for one-sded specfcaton (lower lmt only) s Ppk = µ p LSL, (3) 3σ p where µ p s the mean of the process, σ p s the devaton of the process, and LSL s the lower lmt of the process Snce the company s pursung sx-sgma process capablty, we use ths performance goal to determne the expected mnmum of the process varaton; that s, we set Ppk = 2 and nduce the mnmum of σ p as (µ p - LSL)/6 Furthermore, a company usually needs to reach a process capacty hgher than four-sgma to satsfy most customers, and hence we can determne the maxmum for δ p as (µ p - LSL)/399 By employng the genetc algorthm to solve the wre bondng optmzaton problem based on the formulaton of (8), we obtan a soluton that s better than the company s current software can fnd 7 Concludng remarks Ths study used a neuro-fuzzy network, MANFIS, to model a multple response system, and optmzes the system by a genetc algorthm and a numercal method respectvely MANFIS provdes the advantage of modelng a nonlnear and complcated system wthout the need of fndng sutable functonal forms for the system, and ts neural network learnng ablty also equps MANFIS wth hgh effcency n system modelng A chemcal process optmzaton problem s used to llustrate our approach From the computatonal results, t s found that GA always fnds process condtons that yeld very satsfed responses, though t consumes much computatonal tme On the other hand, the numercal method s fast but ts soluton qualty cannot compete wth GA's To mprove performances of these two algorthms, we combne GA and the numercal method by runnng GA frst for few generatons to obtan a 70 Int J Appl Sc Eng, ,
13 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem startng soluton for the numercal method Computatonal results show that ths combned algorthm s promsng The proposed approach of process optmzaton s appled to a wre-bondng problem n IC manufacturng References: [ ] Ames, A E, Mattucc, N S, Mac- Donald, G Szony, and Hawkns, D M 997 Qualty loss functons for optmzaton across multple response surfaces Journal of Qualty Technology, 29: [ 2] Cheng, C B 2000 Mult-response optmzaton based on a neuro-fuzzy system Neural Network World, 0: [ 3] Cheng, C B, Cheng, C J, and Lee, E S 2002 Neuro-fuzzy and genetc algorthm n multple response optmzaton Computers and Mathematcs wth Applcatons, 44: [ 4] Derrnger, G and Such, R 980 Smultaneous optmzaton of several response varables Journal of Qualty Technology, 2: [ 5] Holland, J H 975 Adaptaton n natural and artfcal systems Unversty of Mchgan Press, Mchgan [ 6] Jang, J S R 993 ANFIS: adaptve-network-based fuzzy nference system IEEE Transactons on Systems, Man and Cybernetcs, 23: [ 7] Jang, J S R, Sun, C T, and Mzutan, E 997 Neuro-Fuzzy and Soft Computng: a Computatonal Approach to Learnng and Machne Intellgence Prentce-Hall New Jersey [ 8] Khur, A I and Conlon, M 98 Smultaneous optmzaton of multple responses represented by polynomal regresson functons Technometrcs, 23: [ 9] Km, K J and Ln, D 998 Dual response surface optmzaton: a fuzzy modelng approach Journal of Qualty Technology, 30: -0 [0] Ln, D and Tu, W 995 Dual response surface optmzaton Journal of Qualty Technology, 27: [] Myers, R H and Carter, W H 973 Response surface technques for dual response systems Technometrcs, 5: [2] Myers, R H and Montgomery, D C 995 Response Surface Methodology John Wley and Sons, Inc New York [3] Pgnatello, J J Jr 993 Strateges for robust multresponse qualty engneerng IIE Transactons, 25: 5-5 [4] Stone, M 974 Cross-valdatory choce and assessment of statstcal predctons Journal of the Royal Statstcal Socety Seres B, 36: -47 [5] Takag, T and Sugeno, M 985 Fuzzy dentfcaton of systems and ts applcaton to modelng and control IEEE Transactons on Systems, Man, and Cybernetcs,5: 6-32 [6] Vnng, G G A 998 Compromse approach to multresponse optmzaton Journal of Qualty Technology, 30: [7] Zmmermann, H J 978 Fuzzy programmng and lnear programmng wth several objectve functons Fuzzy Sets and Systems, : Int J Appl Sc Eng, , 7
The Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationWinter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan
Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationSolving Nonlinear Differential Equations by a Neural Network Method
Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationFUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM
Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationSolving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study
Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationDetermining Transmission Losses Penalty Factor Using Adaptive Neuro Fuzzy Inference System (ANFIS) For Economic Dispatch Application
7 Determnng Transmsson Losses Penalty Factor Usng Adaptve Neuro Fuzzy Inference System (ANFIS) For Economc Dspatch Applcaton Rony Seto Wbowo Maurdh Hery Purnomo Dod Prastanto Electrcal Engneerng Department,
More informationIrene Hepzibah.R 1 and Vidhya.R 2
Internatonal Journal of Scentfc & Engneerng Research, Volume 5, Issue 3, March-204 374 ISSN 2229-558 INTUITIONISTIC FUZZY MULTI-OBJECTIVE LINEAR PROGRAMMING PROBLEM (IFMOLPP) USING TAYLOR SERIES APPROACH
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationSupport Vector Machines. Vibhav Gogate The University of Texas at dallas
Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationInteractive Bi-Level Multi-Objective Integer. Non-linear Programming Problem
Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationLOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin
Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence
More informationAnnexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances
ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationResource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud
Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal
More informationMarkov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationSupporting Information
Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to
More informationFuzzy Boundaries of Sample Selection Model
Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationLaboratory 1c: Method of Least Squares
Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly
More informationUsing Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*
Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationLab 2e Thermal System Response and Effective Heat Transfer Coefficient
58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More informationOn the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationEEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming
EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationLaboratory 3: Method of Least Squares
Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informationSecond Order Analysis
Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationWhich Separator? Spring 1
Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal
More informationIntroduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:
CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationWeek 5: Neural Networks
Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple
More informationSome modelling aspects for the Matlab implementation of MMA
Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationNatural Language Processing and Information Retrieval
Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationis the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors
Multple Lnear and Polynomal Regresson wth Statstcal Analyss Gven a set of data of measured (or observed) values of a dependent varable: y versus n ndependent varables x 1, x, x n, multple lnear regresson
More informationTime-Varying Systems and Computations Lecture 6
Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy
More informationNote 10. Modeling and Simulation of Dynamic Systems
Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationAn Admission Control Algorithm in Cloud Computing Systems
An Admsson Control Algorthm n Cloud Computng Systems Authors: Frank Yeong-Sung Ln Department of Informaton Management Natonal Tawan Unversty Tape, Tawan, R.O.C. ysln@m.ntu.edu.tw Yngje Lan Management Scence
More informationChapter - 2. Distribution System Power Flow Analysis
Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationSimultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals
Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationA New Evolutionary Computation Based Approach for Learning Bayesian Network
Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang
More informationAn Interactive Optimisation Tool for Allocation Problems
An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents
More informationRegularized Discriminant Analysis for Face Recognition
1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationCalculation of time complexity (3%)
Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add
More informationReal-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling
Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for
More informationBasic Statistical Analysis and Yield Calculations
October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general
More informationRSM Abstract Keywords:
( RSM Abstract In ths paper response surface method (RSM s explaned ntall as one of the most mportant tools of qualt mprovement, then a revew of the lterature s presented n relaton wth the optmzaton of
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationThe Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems
The Convergence Speed of Sngle- And Mult-Obectve Immune Algorthm Based Optmzaton Problems Mohammed Abo-Zahhad Faculty of Engneerng, Electrcal and Electroncs Engneerng Department, Assut Unversty, Assut,
More informationComputing Correlated Equilibria in Multi-Player Games
Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,
More informationLinear Feature Engineering 11
Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19
More informationThe Chaotic Robot Prediction by Neuro Fuzzy Algorithm (2) = θ (3) = ω. Asin. A v. Mana Tarjoman, Shaghayegh Zarei
The Chaotc Robot Predcton by Neuro Fuzzy Algorthm Mana Tarjoman, Shaghayegh Zare Abstract In ths paper an applcaton of the adaptve neurofuzzy nference system has been ntroduced to predct the behavor of
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationMulti response optimization in design of experiments considering capability index in bounded objectives method
Journal of Scentfc & Industral Research JAHAN et al: MULTI RESPONSE OPTIMIZATION IN DESIGN OF EPERIMENTS Vol. 69, January 00, pp. -6 Mult response optmzaton n desgn of eperments consderng capablty nde
More informationLecture 10 Support Vector Machines. Oct
Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationLecture 20: November 7
0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More information