Process Optimization by Soft Computing and Its Application to a Wire Bonding Problem

Size: px
Start display at page:

Download "Process Optimization by Soft Computing and Its Application to a Wire Bonding Problem"

Transcription

1 Internatonal Journal of Appled Scence and Engneerng , : 59-7 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem Ch-Bn Cheng Department of Industral Engneerng and Management, Chaoyang Unversty of Technology, Wufeng, Tachung country 43, Tawan, ROC Abstract: Modelng and optmzaton of a process wth multple outputs s dscussed n ths paper A neuro-fuzzy system named MANFIS, whch comprses a fuzzy nference structure and neural network learnng ablty, s used to model a multple output process Optmzaton of such a process s formulated as a multple objectve decson makng problem, and a genetc algorthm and a numercal method are ntroduced, respectvely, to solve ths problem based on the MAN- FIS model We have used these two algorthms, respectvely, to solve a chemcal process optmzaton problem, and compared ther performances A combnaton of these two algorthms s also suggested to mprove performances of both algorthms The proposed approach s also appled to a wre-bondng problem n semconductor manufacturng Keywords: process optmzaton; soft computng; neuro-fuzzy system; genetc algorthm, multple objectve decson makng; wre bondng Introducton Process optmzaton s to fnd a settng of the controllable varables, or called nput varables, so as to obtan the best outcomes of a process The outcomes of a process are often referred to as the outputs or responses of a system In ths study, optmzaton of a process wth multple outputs s consdered For example, n a tool lfe problem, we attempt to determne the cuttng speed and depth of cut so as to obtan a maxmal lfe of the tool (a prmary response) and retan a satsfed rate of metal removed (a secondary response) at the same tme Response optmzaton methods are popular tools for process optmzaton Usually, these methods nclude two stages In the frst stage, we use regresson analyss to model a system's responses; that s, we dentfy the relatonshp between responses and nput varables through regresson functons In the second stage, we use optmzaton technques to obtan a settng of system parameters that gve system the most desrable responses Tradtonally, n the frst stage, lnear regresson wth the regressors n a frst-order or second-order polynomal form s used to approxmate the response surfaces However, frequently encountered n practce, systems are complcated and hghly nonlnear, and thus, lnear regresson s not sutable In recent years, nonparametrc regresson approaches, such as neural networks and fuzzy nference systems, are wdely adopted for modelng nonlnear systems These nonparametrc approaches learn the relatons between nput varables and responses drectly from Correspondng e-mal: cbcheng@malcyutedutw Accepted for Publcaton: Dec 23, Chaoyang Unversty of Technology, ISSN Int J Appl Sc Eng, , 59

2 Ch-Bn Cheng the observatons wthout assumng any pre-specfed functonal form The combnaton of fuzzy nference systems and neural networks, together wth genetc algorthms, create a new research area called soft computng Soft computng emerges as a computng approach that tres to mmc human's ablty of reasonng and learnng n an uncertan envronment One representatve technque of soft computng s neuro-fuzzy systems A neuro-fuzzy system s a fuzzy nference system presented n a network structure, and equpped wth neural network learnng abltes In ths study, we use a neuro-fuzzy system, named multple adaptve neuro-fuzzy nference system (MANFIS) [7], to model a system that has multple responses; and furthermore, we also use a genetc algorthm (GA) [5] to optmze ths system s responses based on the model of MANFIS A multple response system has m response y, y 2,, y m, whch are affected by a set of nput varables x = (x, x 2,, x p ) T Tradtonally, the relatons between responses and nput varables are defned through functons: y = f ( x ) + ε,, 2,, m, () = where f s the functonal relaton between x and the -th response y, and ε are d random errors wth zero means and constant varances σ 2, The objectve of the multple response optmzaton s to fnd a soluton x such that each response wll attan a compromsed optmum Many approaches have been proposed to solve the multple response optmzaton problem Derrnger and Such [4] transform each response functon nto a desrablty functon, and then maxmze the geometrc mean of the ndvdual desrablty functons to obtan a compromsed soluton Khur and Conlon [8] presented a procedure based on a dstance functon that calculates the overall closeness where the response functons acheve ther respectve optmum at the same set of condtons; a compromsed soluton s then found by mnmzng ths dstance functon over the expermental regon Pgnatello [3], Ames et al [] and Vnng [6] all propose to mnmze a measure based on a multvarate loss functon, whch evaluates the loss when responses devate from ther targets For the specal case of two responses, Myers and Carter [] ntroduced a dual response approach, whch optmzes the prmary response subject to an approprate constrant on the secondary response The dsadvantage of ther approach s that such an optmzaton scheme can be msleadng due to the unrealstc restrcton of forcng the constraned response to a specfc value [0] To remedy the dsadvantage of the approach of Myers and Carter [], Km and Ln [9] formulate the dual response problem as a multple objectve decson makng (MODM) programmng and ntroduce a fuzzy optmzaton methodology, whch s based on Zmmermann's maxmn approach [7] Ther approach optmzes the prmary response and the secondary response, smultaneously, by maxmzng a compromsed satsfacton degree of both responses The degrees of satsfacton of both the mean response and devaton are defned by membershp functons orgnated n fuzzy set theory Though the prevous approaches vared n ther soluton procedures, they commonly assumed lnear response surfaces In ths study, to deal wth nonlnear responses, the system s modeled by MANFIS, and the multple response optmzaton problem s formulated as an MODM However, snce we use the nonparametrc regresson tool MANFIS to model responses, exact functonal forms of responses are not known and hence dervatve-based optmzaton methods cannot be drectly appled to obtan the optmal soluton Therefore, we wll use a genetc algorthm as well as a numercal method to search optmal solutons on the response surfaces Performances of these two algorthms wll be compared The remander of ths paper s organzed as follows In the next secton, the archtecture 60 Int J Appl Sc Eng, ,

3 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem of MANFIS and ts learnng process are summarzed Secton 3 formulates the multple response optmzaton problem as an MODM Two optmzaton algorthms, a genetc algorthm and a numercal method, are presented n Secton 4 to solve the MODM For llustraton, Secton 5 uses the two algorthms, respectvely, to solve a chemcal process optmzaton problem To mprove the performances of both algorthms, we also suggest a combnaton of these two algorthms Computatonal results show ths combned algorthm s promsng Concludng remarks are gven n the last secton 2 Multple adaptve neuro-fuzzy nference system MANFIS s an extenson of the sn gle-output neuro-fuzzy system ANFIS [6], for producng multple outputs A neuro-fuzzy system can serve as a nonparametrc regresson tool, whch model the regresson relatonshp non-parametrcally wthout reference to any pre-specfed functonal form MAN- FIS can be vewed as an aggregaton of many ndependent ANFIS The archtecture of MANFIS s depcted n Fgure x x 2 x p ANFIS ANFIS 2 Fgure Archtecture of MANFI S Every sngle ANFIS n an MANFIS smulates the functonal relatons f, =,, m, n Equaton () ANFIS can be consdered as a network presentaton of a TSK fuzzy nference system [5], and the f-then rules n TSK are comprsed n the network structure To llustrate the archtecture of ANFIS, an example wth a two-dmensonal nput s vsualzed n Fgure 2 ANFIS m y y 2 y m Layer Layer 2 Layer 3 Layer 4 Layer 5 A w N z w x B w 2 N w 2 z 2 (to every node n Layer 4) ŷ x 2 A 2 w 3 N w 3 z 3 B 2 w4 N w 4 z 4 Fgure 2 Archtecture of ANFIS Int J Appl Sc Eng, , 6

4 Ch-Bn Cheng To reflect dfferent adaptve capabltes, the nodes n ANFIS are represented by crcles or squares, n whch, square nodes represent adaptve nodes and crcle nodes represent fxed nodes Adaptve nodes contan parameters that can be adjusted by learnng, whle the fxed nodes do not contan adjustable parameters In ths study, the adaptve nodes n layer of the ANFIS are parameterzed by Gaussan functons wth ther means and devatons Nodes n layer 2 are fxed nodes labeled Π, whch s a fuzzy conjuncton operator Functons of nodes n ths layer are to synthesze the nformaton from the frst layer The operator Π s defned as a multplcaton of all of ts ncomng sgnals, and output the frng strength w j, j=,,4 Nodes n layer 3 labeled by N smply performs a normalzaton of sgnals from layer 2 and output the normalzed frng strength w = w / w 4, j j r= j=,,4 The adaptve nodes n layer 4 of the ANFIS contan lnear functons of the nput varables wth ther coeffcents as the adjustable parameters; that s, z j = a j x +b j x 2 +c j, j=,,4 The sngle node n layer 5 s a fxed node, whch computes the overall output as the summaton of all ncomng sgnals: y ˆ = 4 w j z j j= Assumng that we have conducted an experment wth n runs on an m-response system, n observatons are collected wth the format of (x k, y k,,y k,,y mk ), k=,,n, where x k s the nput condton at the k-th run and y k s the -th response at the k-th run Wth these observatons, MANFIS can approxmate the multple responses y, =,,m, by mnmzng an error measure E defned as E = n m k = = ( y k k ) 2, (2) where ŷ k s the estmate of the -th response for the k-th run The mnmzaton of E s carred out n an teratve manner, whch r s referred to as a learnng process The learnng process of MANFIS termnates when the error measure E reduces to a satsfactory level Snce E s a summaton of the squared errors from m ndependent ANFIS, the learnng of MANFIS can be treated as the learnng of m ndependent ANFIS Furthermore, snce ANFIS s a mult-layered-feed-forward network, backpropagaton learnng algorthms used n neural networks can be drectly appled to ts learnng The detals of ths learnng process can be found n [6] 3 MODM formulaton of multple response optmzaton By means of the learnng process, MAN- FIS obtans an estmaton of desred outputs wth gven nputs Let ŷ, =,,m, be the -th output of MANFIS, and they are estmates of multple responses y,,y m, respectvely To ndcate these estmates are functons of the nput varables x, they wll be denoted as ŷ (x), =,,m Snce the system under dscusson has multple responses, the optmzaton of the system n fact nvolves the optmzaton of several ndvdual responses at the same tme For all the system responses, they can be dvded nto three sets: ) the-larger-the-better, denoted by L; 2) the-smaller-the-better, denoted by S; and 3) the-nomnal-the-best, denoted by N We have formulated ths optmzaton problem as a multple objectve decson makng problem wth the followng form [2]: max l, l L mn s, s S mn t Tt, t N st x B, (3) where T t s the nomnal target of the t-th response; and B s a feasble regon of x To solve the above multple objectve op- 62 Int J Appl Sc Eng, ,

5 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem tmzaton problem, we follow the dea of Zmmermann's maxmn approach [7] Accordng to the maxmn approach, the soluton of (3) can be obtaned by maxmzng an overall satsfactory degree among all ndvdual objectves n (3) That s, for each objectve, t has ts own satsfactory degree, and the overall satsfacton s an ntersecton of all ndvdual satsfactory degrees, where the ntersecton s defned through a mn operator The satsfactory degree for each objectve s evaluated by an user-defned membershp functon µ ˆ ( ˆ y y ) Let λ be the overall satsfactory degree, and then we can convert the orgnal MODM (3) to: max λ st µ ( ˆ ) λ, =,, m, y ˆ y x B, λ [ 0,] (4) Each response's membershp functon µ ˆ ( y ) should be well chosen so as to reflect ts characterstc For the response belonged to the set of the-larger-the-better, ts degree of satsfacton reaches when t s at max { ˆ = x B y } and then decreases monotoncally to 0 at mn { ˆ = x B y } A typcal membershp functon for y ˆ, L, could be stated as, f > ˆ y, ˆ y µ ( ˆ =, f ˆ ˆ ( ) ˆ y ) y, y x y L ˆ y (5) 0, f ( ) < ˆ x y, The above membershp functon s graphcally shown n Fgure 3 For the response belonged to the set of the-smaller-the-better, we set the satsfactory degree to when a response s at ŷ and then t decreases monotoncally to 0 at above membershp functon s depcted n Fgure 4 µ(ŷ ) Fgure 3 Membershp functon of µ ˆ ( y ) : ''the larger the better'' case y ˆ Such type of membershp functons can be expressed as, ˆ y µ ˆ ( y ) =, ˆ y 0, µ(ŷ ) 0 ŷ ŷ ŷ - f <, f, S, f > 0 ŷ ŷ ŷ - Fgure 4 Membershp functon of µ ˆ ( y ) : ''the smaller the better'' case Smlarly, for the response of the set of the-nomnal-the-best, the degree of satsfacton s maxmzed when t s at ts target T, and decreases as t s away from T Membershp functons of ths type can be defned as (6) Int J Appl Sc Eng, , 63

6 Ch-Bn Cheng T ˆ y, T ˆ y ( x) T ( ( x)) =, T 0, f < T, f T <, N, µ (7) elsewhere Membershp functon of (7) s depcted n Fgure 5 µ(ŷ ) 0 ŷ - T Fgure 5 Membershp functon of µ ˆ ( y ) : ''the nomnal the best'' case The problem formulaton of (4) cannot be drectly solved by the use of dervatve-based methods due to unknown functonal forms of y ˆ Dervatve-free methods such as genetc algorthm and smulated annealng are deally suted for solvng problems where dervatve nformaton s unavalable Alternatvely, we can approxmate the dervatves wth numercal methods In ths study, we wll apply GA and a numercal method, respectvely, to solve (4) 4 Soluton procedures In the prevous secton, we have formulated the multple response optmzaton problem as an MODM In ths secton, we suggest usng two dfferent algorthms, a genetc algorthm and a numercal method, to solve ths MODM ŷ ŷ 4 Genetc algorthm Genetc algorthm frst proposed by Holland [5] s a dervatve-free stochastc optmzaton approach based on the concepts of bologcal evolutonary processes GA encodes each pont n a soluton space nto a bnary bt strng called a chromosome Operatons of chromosomes ncludng selecton, crossover, and mutaton, are used to generate new chromosomes so as to explore the soluton space Each chromosome s evaluated by a ftness functon Such a ftness functon corresponds to the objectve functon of the orgnal problem A great varety of genetc algorthms have been proposed n the lterature In ths study, we wll just use a basc form of GA Nevertheless, t performs well as observed n our computaton results Ths genetc algorthm contans a roulette wheel selecton, a sngle pont crossover, and a random flppng mutaton The ftness of chromosomes s determned va (4) It s not straghtforward to determne the values of λ for a certan soluton by usng (4) Therefore, we rewrte (4) as max λ st λ = mn = x B,, m { µ ( ˆ ) }, y ˆ y (8) By employng the traned MANFIS, the formulaton of (8) s presented n a network form n Fgure 6, and λ can be drectly read from the output end of ths network Genetc algorthm for solvng the multple response optmzaton problem has been formulated n our earler paper [3] In ths paper, we further nvestgate ts performance wth computatonal experments n Secton 5 42 Numercal method A numercal method based on Lagrange relaxaton for solvng the multple response optmzaton problem has been formulated n 64 Int J Appl Sc Eng, ,

7 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem [2] Though ths earler method has the ANFIS µ(ŷ ) x ANFIS 2 µ(ŷ 2 ) x 2 mn λ x p ANFIS m µ(ŷ m ) Fgure 6 Network presentaton of formulaton (8) advantage of provdng an upper bound of the optmal soluton, t s rather complcated In ths paper, a smpler numercal method, whch drectly solves the prmal problem, s formulated as the follows Recallng the formulaton of (8), to ndcate λ beng a functon of x we denote t as λ(x) The gradent of λ(x) s defned as λ( x) x λ = : (9) λ( x) x p By fxng the values of all x k j, and by gvng a small ncrement x j on x j, the partal dervatve can be approxmated through λ(x) x j λ ( x ) λ j + j p λ j p (0) x j ( x,, x x,, x ) x j ( x,, x,, x ) After the gradent s determned, the maxmzaton of λ(x) can be done by an tera- tve manner through the updatng of x, subject to the feasble regon constrant The rule of ths updatng s x new = x old + s λ(x old ), () where s s a step sze The steps of ths numercal method are summarzed below Step 0 Intalzaton: set the teraton counter r = 0, the accuracy requrement τ, and the step sze s; arbtrarly choose ntal value x 0 wthn the feasble regon Step Gradent calculaton: calculate the gradent of λ through Eq (0) wth x r Step 2 Updatng of x: x r+ = x r + s λ(x r ) Step 3 If λ( x r+ ) - λ(x r ) τ, stop; otherwse, go to Step 4 Step 4 Increase the teraton counter r r + Go to Step Int J Appl Sc Eng, , 65

8 Ch-Bn Cheng 5 Computatonal comparson To llustrate our approach, a chemcal process optmzaton problem taken from Myers and Montgomery [2] s reproduced as the follows A chemcal process has three controllable varables: reacton tme (x ), temperature (x 2 ), and percent catalyst (x 3 ); and ts responses are percent converson (y ), and thermal actvty (y 2 ) For ths process, t s mportant to maxmze y whle y 2 s held between 55 and 60 wth a nomnal target 575 Experments are conducted wth dfferent setups of reacton tme, temperature, and percent catalyst to collect data of ths chemcal process 5 Modelng by MANFIS MANFIS s employed to model the response surfaces of the above chemcal process The MANFIS for ths problem has two output nodes correspondng to the two responses of ths process, and hence ths MANFIS conssts of two ndependent ANFIS The Fuzzy Toolbox n MATLAB software provdes functons of constructng, edtng and tranng of ANFIS We use ths software to construct two ndependent ANFIS networks and tran them by the expermental data The convergence behavor of one of the learnng process s shown n Fgure 7 Fgure 7 Convergence of the learnng of y 2 After completng the tranng of MANFIS, the multple response problem s solved by usng the formulaton of (8) Snce the response y belongs to the set of the-larger-the better, ts membershp functon should take the form of (5); and the response y 2 has a nomnal target, so t wll take the membershp functon (7) In order to determne these membershp functons, the maxmum and thermal actvty to be held between 55 and 60, therefore, t s reasonable to set 55 and 60 as mnmum for ndvdual response must be obtaned Maxmum and mnmum of responses can be obtaned by formulatng sngle objectve programmng problems for ndvdual responses, and solvng the problems wth any dervatve-free algorthm Alternatvely, they can also be subjectvely determned accordng to users' judgment or ther expectaton In our example, t s desred that the response of the mnmum and maxmum of ths response, respectvely Smlarly, the mnmum and ma- 66 Int J Appl Sc Eng, ,

9 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem xmum of the response of percent converson are set as 50 and 00, respectvely The possble ranges for x, x 2 and x 3 are set as [-2, 2] 52 Solvng by GA The genetc algorthm s mplemented on the MATLAB platform and run on an IBM compatble PC wth Pentum III-800 CPU Ten trals are conducted, wth the parameters n GA settng as: populaton sze = 24, cross-over rate = 07, and mutaton rate = 02 The results are lsted n Table, n whch, the second column s the tme (n seconds) consumed by each tral to obtan the best soluton, and the last two columns are the responses yelded by the best solutons From Table we can see that all the ten trals produce hgh qualty solutons, e all trals except the thrd tral obtan optmal solutons Nevertheless, they usually consume a lot of computaton tmes Table Results of chemcal process optmzaton by GA Tral Tme λ Responses y y Solvng by the numercal method The numercal method s also mplemented on the MATLAB platform and run on the same machne Ten trals are also carred out and ther results are shown n Table 2 The startng ponts n these trals are arbtrarly chosen We found that the qualty of solutons obtaned by ths numercal method cannot compete wth those obtaned by GA, and the startng ponts crtcally affect the results In number method should reach the optmal soluton very fase On the other hand, though partcular, four (Tral 3, 6, 8 and 9) out of ten trals are faled because of the startng ponts are fallng n a flat area of the response surface and hence no gradent can be found 54 Combnng GA and numercal method Though the numercal method faled to produce hgh qualty soluton, t can fast solve the problem If we can provde a startng pont n the vcnty of the optmal soluton, the GA usually takes a long tme to fnd a hgh qualty soluton, n the frst few generatons Int J Appl Sc Eng, , 67

10 Ch-Bn Cheng Table 2 Results of chemcal process optmzaton by the numercal method Tral Tme λ Responses y y Table 3 Results of chemcal process optmzaton by the combned algorthm Tral Alg Tme λ Responses y y 2 GA NM GA NM GA NM GA NM GA NM GA NM GA NM GA NM : no mprovement 68 Int J Appl Sc Eng, ,

11 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem The dea s to combne these two algorthms together That s, use GA to fnd a startng pont for the numercal method We have conducted 8 trals to justfy ths dea In each tral, GA s run frst for 20 generatons to obtan a soluton, and ths soluton wll serve as a startng pont for the numercal method Computatonal results are shown n Table 3, n whch, the second column s the algorthm used and NM denotes the numercal method In Tral, 3 and 4, the numercal method provdes sgnfcant mprovement of the startng solutons, and among whch, Tral and 4 produce hgh qualty solutons Though Tral 2, 5, 6, and 7 do not sgnfcantly mprove ther startng solutons, they all produce hgh qualty solutons It s observed that the startng solutons of these trals are already n good shapes; and ths may be why t s dffcult for the NM to mprove much on these startng solutons The fnal tral found no mprovement for ts startng soluton, possbly caused by the startng soluton fallng on a plateau of the response surface Though the results n Table 3 show mperfecton of the combned algorthm, we stll consder the combnaton of GA and numercal method s promsng for two reasons: ) ths combned algorthm consumes much less tme than GA to fnd a satsfactory soluton and, 2) t s possble to fnd a hgh qualty soluton n a moderate number of trals 6 Applcaton to a wre bondng problem Wre bondng s a weldng process, n whch wre and pad surface are brought nto ntmate contact by usng thn wre and a combnaton of heat, pressure and ultrasonc energy Dynamc random access memory (DRAM) chps and most commodty chps n plastc packages are assembled by wre bondng About 2-4 trllon wre nterconnectons are produced annually Wre bondng falures nclude bond off center, bond not stckng on de, wre breakng and so on In a producton envronment, wre pull strength s usually montored to mnmze process drft To acheve a stable performance of the wre bondng process, the operatng varables such as bondng parameters need to be strctly regulated Crtcal bondng parameters nclude bondng force, bondng tme, and ultrasonc power To fnd optmal setups of bondng parameters, tradtonally, a serous of bondng tests s performed by varyng bondng parameters to draw out the optmal bondng condtons Evaluaton of wre pull strength s used to defne the optmalty of bondng parameters In the evaluaton, three sets of curves of wre pull strength versus ultrasonc power, bondng tme, or bondng force can be obtaned by varyng one of these parameters whle holdng the other two constant at ther optmum In such an approach, the search s less effcent and frequently falls n a local optmum especally when the response surface s hghly nonlnear To demonstrate the potental usage of our approach n real-world problems, the proposed approach n Secton 4 s appled to the optmzaton of a wre bondng process n an IC packagng company n Tawan By fxng parameters of cut mode, heat, and loopng of the wre bonder, and varyng the parameters of bondng force, bondng tme, and ultrasonc power, a desgn of experment s conducted to collect data of the process Each of the three varable parameters s set wth three levels, and hence the experment results n a combnaton of 27 trals of bondng tests Each tral contans 00 replcatons, and the two concernng responses are average wre pull and ts devaton, where average wre pull s a the-larger-the-better response, and devaton s a the-smaller-the-better response Frstly, MANFIS s employed to model the responses of ths process To ensure the generalty of the MANFIS model, and to fully utlze the lmted number of expermental data, an extreme cross-valdaton technque called leave one-out cross-valdaton [4] s used The dea of cross-valdaton s to dvde the sample data nto a constructon Int J Appl Sc Eng, , 69

12 Ch-Bn Cheng sub-sample, whch forms the tranng data set, and a valdaton sub-sample, whch forms the test data set The leave one-out cross-valdaton s to dvde the sample sze n nto a tranng data set contanng n- observatons, and leave the rest sngle observaton as the test datum Such a technque consders the dvson of the observatons n all n possble ways The cross- valdaton crteron s defned as n m CV (P) = ( yk k [ O \ ]) 2, (2) nm = k = where P s the set of crtcal factors that affect the accuracy of MANFIS, and k [ O \ ] s an estmate of y k and t s obtaned from an MANFIS that s traned by the sample data excludng the -th datum The set of crtcal factors P contans only one factor, the number of nodes (n layer ) assocated wth an nput varable To fnd the best setup of P, CV(2), CV(3), and CV(4) s compared, and we found that CV(3) s the mnmum Wth the result of cross-valdaton, the MANFIS for modelng the wre bondng process s constructed as: two ndependent ANFIS, and n each ANFIS there are 3 nodes assocated wth each nput and hence resultng n 9 nodes n layer, 27 nodes n layer 2, 27 nodes n layer 3, and 27 nodes n layer 4 The optmzaton of the wre bondng process s modeled by the formulaton of (3), wth a prmary objectve of maxmzng the wre pull and a secondary objectve of mnmzng process varaton To construct membershp functons for these two objectves we need to know ther respect mnmum and maxmum as defned n Secton 3 The mnmum of wre pull s set as ts specfcaton (e ts mnmal requrement), and the maxmum of wre pull s determned accordng to past experence of runnng test on bondng The mnmum and maxmum of the process varaton are determned through a process performance ndex (Ppk) The defnton of Ppk for one-sded specfcaton (lower lmt only) s Ppk = µ p LSL, (3) 3σ p where µ p s the mean of the process, σ p s the devaton of the process, and LSL s the lower lmt of the process Snce the company s pursung sx-sgma process capablty, we use ths performance goal to determne the expected mnmum of the process varaton; that s, we set Ppk = 2 and nduce the mnmum of σ p as (µ p - LSL)/6 Furthermore, a company usually needs to reach a process capacty hgher than four-sgma to satsfy most customers, and hence we can determne the maxmum for δ p as (µ p - LSL)/399 By employng the genetc algorthm to solve the wre bondng optmzaton problem based on the formulaton of (8), we obtan a soluton that s better than the company s current software can fnd 7 Concludng remarks Ths study used a neuro-fuzzy network, MANFIS, to model a multple response system, and optmzes the system by a genetc algorthm and a numercal method respectvely MANFIS provdes the advantage of modelng a nonlnear and complcated system wthout the need of fndng sutable functonal forms for the system, and ts neural network learnng ablty also equps MANFIS wth hgh effcency n system modelng A chemcal process optmzaton problem s used to llustrate our approach From the computatonal results, t s found that GA always fnds process condtons that yeld very satsfed responses, though t consumes much computatonal tme On the other hand, the numercal method s fast but ts soluton qualty cannot compete wth GA's To mprove performances of these two algorthms, we combne GA and the numercal method by runnng GA frst for few generatons to obtan a 70 Int J Appl Sc Eng, ,

13 Process Optmzaton by Soft Computng and Its Applcaton to a Wre Bondng Problem startng soluton for the numercal method Computatonal results show that ths combned algorthm s promsng The proposed approach of process optmzaton s appled to a wre-bondng problem n IC manufacturng References: [ ] Ames, A E, Mattucc, N S, Mac- Donald, G Szony, and Hawkns, D M 997 Qualty loss functons for optmzaton across multple response surfaces Journal of Qualty Technology, 29: [ 2] Cheng, C B 2000 Mult-response optmzaton based on a neuro-fuzzy system Neural Network World, 0: [ 3] Cheng, C B, Cheng, C J, and Lee, E S 2002 Neuro-fuzzy and genetc algorthm n multple response optmzaton Computers and Mathematcs wth Applcatons, 44: [ 4] Derrnger, G and Such, R 980 Smultaneous optmzaton of several response varables Journal of Qualty Technology, 2: [ 5] Holland, J H 975 Adaptaton n natural and artfcal systems Unversty of Mchgan Press, Mchgan [ 6] Jang, J S R 993 ANFIS: adaptve-network-based fuzzy nference system IEEE Transactons on Systems, Man and Cybernetcs, 23: [ 7] Jang, J S R, Sun, C T, and Mzutan, E 997 Neuro-Fuzzy and Soft Computng: a Computatonal Approach to Learnng and Machne Intellgence Prentce-Hall New Jersey [ 8] Khur, A I and Conlon, M 98 Smultaneous optmzaton of multple responses represented by polynomal regresson functons Technometrcs, 23: [ 9] Km, K J and Ln, D 998 Dual response surface optmzaton: a fuzzy modelng approach Journal of Qualty Technology, 30: -0 [0] Ln, D and Tu, W 995 Dual response surface optmzaton Journal of Qualty Technology, 27: [] Myers, R H and Carter, W H 973 Response surface technques for dual response systems Technometrcs, 5: [2] Myers, R H and Montgomery, D C 995 Response Surface Methodology John Wley and Sons, Inc New York [3] Pgnatello, J J Jr 993 Strateges for robust multresponse qualty engneerng IIE Transactons, 25: 5-5 [4] Stone, M 974 Cross-valdatory choce and assessment of statstcal predctons Journal of the Royal Statstcal Socety Seres B, 36: -47 [5] Takag, T and Sugeno, M 985 Fuzzy dentfcaton of systems and ts applcaton to modelng and control IEEE Transactons on Systems, Man, and Cybernetcs,5: 6-32 [6] Vnng, G G A 998 Compromse approach to multresponse optmzaton Journal of Qualty Technology, 30: [7] Zmmermann, H J 978 Fuzzy programmng and lnear programmng wth several objectve functons Fuzzy Sets and Systems, : Int J Appl Sc Eng, , 7

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Determining Transmission Losses Penalty Factor Using Adaptive Neuro Fuzzy Inference System (ANFIS) For Economic Dispatch Application

Determining Transmission Losses Penalty Factor Using Adaptive Neuro Fuzzy Inference System (ANFIS) For Economic Dispatch Application 7 Determnng Transmsson Losses Penalty Factor Usng Adaptve Neuro Fuzzy Inference System (ANFIS) For Economc Dspatch Applcaton Rony Seto Wbowo Maurdh Hery Purnomo Dod Prastanto Electrcal Engneerng Department,

More information

Irene Hepzibah.R 1 and Vidhya.R 2

Irene Hepzibah.R 1 and Vidhya.R 2 Internatonal Journal of Scentfc & Engneerng Research, Volume 5, Issue 3, March-204 374 ISSN 2229-558 INTUITIONISTIC FUZZY MULTI-OBJECTIVE LINEAR PROGRAMMING PROBLEM (IFMOLPP) USING TAYLOR SERIES APPROACH

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Laboratory 1c: Method of Least Squares

Laboratory 1c: Method of Least Squares Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com

More information

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient 58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Laboratory 3: Method of Least Squares

Laboratory 3: Method of Least Squares Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Second Order Analysis

Second Order Analysis Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Natural Language Processing and Information Retrieval

Natural Language Processing and Information Retrieval Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors Multple Lnear and Polynomal Regresson wth Statstcal Analyss Gven a set of data of measured (or observed) values of a dependent varable: y versus n ndependent varables x 1, x, x n, multple lnear regresson

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Note 10. Modeling and Simulation of Dynamic Systems

Note 10. Modeling and Simulation of Dynamic Systems Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

An Admission Control Algorithm in Cloud Computing Systems

An Admission Control Algorithm in Cloud Computing Systems An Admsson Control Algorthm n Cloud Computng Systems Authors: Frank Yeong-Sung Ln Department of Informaton Management Natonal Tawan Unversty Tape, Tawan, R.O.C. ysln@m.ntu.edu.tw Yngje Lan Management Scence

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

A New Evolutionary Computation Based Approach for Learning Bayesian Network

A New Evolutionary Computation Based Approach for Learning Bayesian Network Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

RSM Abstract Keywords:

RSM Abstract Keywords: ( RSM Abstract In ths paper response surface method (RSM s explaned ntall as one of the most mportant tools of qualt mprovement, then a revew of the lterature s presented n relaton wth the optmzaton of

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems The Convergence Speed of Sngle- And Mult-Obectve Immune Algorthm Based Optmzaton Problems Mohammed Abo-Zahhad Faculty of Engneerng, Electrcal and Electroncs Engneerng Department, Assut Unversty, Assut,

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Linear Feature Engineering 11

Linear Feature Engineering 11 Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19

More information

The Chaotic Robot Prediction by Neuro Fuzzy Algorithm (2) = θ (3) = ω. Asin. A v. Mana Tarjoman, Shaghayegh Zarei

The Chaotic Robot Prediction by Neuro Fuzzy Algorithm (2) = θ (3) = ω. Asin. A v. Mana Tarjoman, Shaghayegh Zarei The Chaotc Robot Predcton by Neuro Fuzzy Algorthm Mana Tarjoman, Shaghayegh Zare Abstract In ths paper an applcaton of the adaptve neurofuzzy nference system has been ntroduced to predct the behavor of

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Multi response optimization in design of experiments considering capability index in bounded objectives method

Multi response optimization in design of experiments considering capability index in bounded objectives method Journal of Scentfc & Industral Research JAHAN et al: MULTI RESPONSE OPTIMIZATION IN DESIGN OF EPERIMENTS Vol. 69, January 00, pp. -6 Mult response optmzaton n desgn of eperments consderng capablty nde

More information

Lecture 10 Support Vector Machines. Oct

Lecture 10 Support Vector Machines. Oct Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

10-701/ Machine Learning, Fall 2005 Homework 3

10-701/ Machine Learning, Fall 2005 Homework 3 10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40

More information

Lecture 20: November 7

Lecture 20: November 7 0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information