The Research of Algorithm for Data Mining Based on Fuzzy Theory

Size: px
Start display at page:

Download "The Research of Algorithm for Data Mining Based on Fuzzy Theory"

Transcription

1 The Research of Agorhm for Daa Mnng Based on Fuzzy Theory Wang Amn, L Je, Schoo of Compuer and Informaon Engneerng Anyang Norma Unversy Anyang, Chna Shenyang Insue of Compung Technoogy Chnese Academy of Scences Shenyang, Chna wam508@6.com, acky@vp.sna.com Journa of Dga Informaon Managemen ABSTRACT: Daa Mnng s a new fed n daa processng research. Suppor Vecor Machne (SVM s one of he new mehods usng n daa mnng, whch has ganed grea appcabe success. However, here are s peny of maons n SVM. For exampe, SVM won work f s ranng se conans unceran nformaon. In order o sove he probem presened above, hs paper dscusses he consranng programmng of fuzzy chance and he characersc of fuzzy cassfcaon as we as s expresson mehods. The agorhm for cassfyng Suppor Vecor Machne s aso ncuded n hs paper. Caegores and Subec Descrpors: H..8 [Daabase Appcaons]: Daa Mnng; I..3 [Deducon and Theorem Provng]: Fuzzy Genera Terms: Daa Mnng, Fuzzy Theory, Mnng Agorhm Keywords: Daa Mnng, Fuzzy Programmng, Fuzzy Cassfcaon, Fuzzy Lnear Separabe, Agorhm Receved: 8 Apr 03, Revsed 6 June 03, Acceped June 03. Inroducon Wh he adven of he nformaon age, humanknd s faced wh more and more nformaon processng probems such as daa sorage, organzaon and searches. These probems graduay ncrease n compexy n he herarchy. Ther scaes of space acves are growng. I s faser n me scae and more exensve and far-reachng n consequences and mpcaons. Daa mnng s a new fed n daa processng. I s a process ha dgs ou varous modes, summary and expor vaues from he known daa ses. Daa mnng s an nerdscpnary ha nvoves daabase echnoogy, machne earnng, sascs, neura neworks, knowedge engneerng, and hgh-performance cacuaon and so on. I has been wdey apped n ndusry, agrcuure, busness, economcs, heah and many oher ndusres. Suppor Vecor Machne (SVM s one of he new mehods usng n daa mnng. I was proposed by Vapnk e a [] [] [3]. Usng SVM, he probem of cassfcaon and regresson can be dea wh beer. SVM has been a research focus n machne earnng and was apped n many feds successfuy. Bu here are many maons n SVM. For exampe, when he ranng ses of SVM conan unceran nformaon, SVM w be ncapabe. In 00, Chunfu Ln and Shengde Wang, he professors of Tawan Unversy pu forward Fuzzy Suppor Vecor Machne (FSVM mehod wh Shgeo Abe and Takuya Inoue, he professors of Kobe Unversy. They made some mprovemens o SVM, bu dd no bud FSVM on agorhm eve. Ther work acks of he research on SVM ha conans unceran nformaon. To sove he probem of SVM conanng unceran nformaon (fuzzy parameers n common condons, we dscuss he consranng programmng of fuzzy chance and he characersc of fuzzy cassfcaon as we as s expresson mehods. The agorhm for cassfyng Suppor Vecor Machne s aso ncuded n hs paper.. Premnary Knowedge The research of hs paper s carred on n he gven possbe space whch s menoned n [6]. Journa of Dga Informaon Managemen Voume Number 5 Ocober 03 37

2 . Fuzzy Chance-consraned Programmng Defnon. Suppose A s a fuzzy subse n unverse of dscourse U. If U = R (se of rea number and A s a reguar cosed convex fuzzy se, A s caed fuzzy number, wren a. Defnon. Suppose a s a fuzzy number. If a s membershp funcon: µ a (x = r r r 3, r R ( =,, 3, x r, r r r x r, x = r x r 3, r r r x r 3 3 a s caed ranguar fuzzy number, wren a = (r, r. Rea number r and r are caed ranguar fuzzy number a s cener, ef and rgh endpons. Cener s he man ocaon of ranguar fuzzy number. Rea number a can be expressed as a speca ranguar fuzzy number a = (a, a, a. Defnon.3 Suppose f : R R R s a bnary funcon n rea number fed. a, b are fuzzy numbers. The membershp funcon of fuzzy number c = f (a, b can be defned as: µ c (z = sup{ mn (µ a (x, µ b (x x, y R, z = f (x, y}, z R Theorem. a = (r, r and b = (,, 3 are ranguar fuzzy numbers. ρ s a rea number. Then: a b = (r, r 3 ; ρ a = (ρr, ρr, ρr, ρ 0 3. (ρr 3, ρr, ρr, ρ < 0 Proof: The concuson can be drecy deduced from Defnon.3. Theorem. Suppose a = (r, r s ranguar fuzzy numbers. For any gven confdence eve λ (0 < λ, Pos {a 0} λ }( λ r λr. Proof: If Pos {a 0} λ, here mus be an esabshed r beween r 0 and r. If r 0, hen r < r 0, so r λ r ( λ r λr 0. If,, r λ (r r due o r < r, r r λ.e ( λ r λr 0. On he conrary, here are wo cases when( λ r λr 0. When r 0, Pos {a 0} =.e. Pos {a 0} λ; when r > 0, r r < 0, r r r λ.e Pos {a 0} λ due o ( λ r λr 0. ( ( Defnon.4 Programmng mn f s.. Pos{ f (x, ξ f } β Pos{ g (x, ξ 0, =,,..., p} α s caed fuzzy chance-consraned programmng [8]. In he programmng, x s decson varabe. ξ, ξ are fuzzy parameer vecors. f (x, ξ s obecve funcon. g (x, ξ 0, =,,..., p s consran condons. α, β (0 < α, β are he gven confdence eves of consran condon and obecve funcon. Pos { } s he possby measure of fuzzy even { }. Common fuzzy chance-consraned programmng s mn f (x s.. Pos{ h (x ξ c 0} f } λ ( - f (x s he funcon of decson varabe x. I s an obecve funcon ha does no conan fuzzy parameers. h (x s he funcon of decson varabe x. ξ s fuzzy number. c s rea number. h (x ξ c 0 s he consran condon. (0 < λ s he gven confdence eve. In [8], a souon of fuzzy chance-consraned programmng under norma crcumsances was pu forward. I convers fuzzy chance-consraned programmng o ceary equvaen programmng. Bu does no avaabe o he fuzzy chance-consraned programmng descrbed as (-. In hs paper, we provde a new souon of fuzzy chanceconsraned programmng descrbed as (-. Theorem.3 If ξ n fuzzy chance-consraned programmng equaon (- s ranguar fuzzy number.e. ξ = (r, r, ceary equvaen programmng of equaon (- s: mn f (x ( - s..( λ [r h (x r 3 h (x] λr h (x c 0 h (x = h(x 0 h(x,, h 0, h(x < 0 (x = 0, h(x 0. h(x, h(x < 0 I s an ordnary programmng ha equas o fuzzy chanceconsraned programmng descrbed as (-. Proof: Frs, we prove he cear equvaen cass of Pos{h (x ξ c 0} λ s: ( λ [r h (x r 3 h (x] λr h (x c 0 From he cacuaon of ranguar fuzzy number, h (xξ c s s a ranguar fuzzy number. Se h (x = h(x 0 h(x, 0, h(x < 0 h (x = 0, h(x 0. h(x, h(x < 0, 38 Journa of Dga Informaon Managemen Voume Number 5 Ocober 03

3 Then h (x, h (x are nonnegave and h (x = h (x h (x. So h(xξ c = (h (x h (xξ c = h (xξ h (xξ c = (h (xr, h (xr, h (xr 3 (h (xr, h (xr, h (xr 3 c = (h (xr h (xr 3 c, h (xr h (xr c, h (xr 3 h (xr c = (h (xr h (xr 3 c, (h (xr h (xr c, h (xr 3 h (xr c = (h (xr h (xr 3 c, h(xr c, h (xr 3 h (xr c From Theorem., he cear equvaen cass of Pos {h (xξ c} λ (0 < λ s ( λ [r h (x r 3 h (x] λr h (x c 0 Because fuzzy chance-consraned programmng equaon (- and ordnary programmng equaon (- have he same obecve funcon, and her consran condons are equa, fuzzy chance-consraned programmng equaon (- s equa o ordnary programmng equaon (-.. Characerscs of Fuzzy Cassfcaon Frs, we gve he defnon of cassfcaon. Defnon.5 Fnd a rue for ranng se S = {(x, y,...,(x, y } (x R n, y s fuzzy number ha means s fuzzy caegores =,..., of fuzzy number accordng o he oupu of gven ranng pons o deduce he correspondng fuzzy number y (means fuzzy caegores of x of any mode x. We ca hs probem fuzzy cassfcaon. The negra fuzzy nformaon suded n hs paper has hree fuzzy characerscs: fuzzy posve cass (sampe pons posve degree of membershp are more han negave one, fuzzy negave cass (sampe pons negave degree of membershp are more han posve one and cener cass (sampe pons posve degree of membershp and negave one are equa. Suppose sampe pons posve or negave degrees of membershp are δ or δ, δ, δ [0.5, ]. For convenence, we use δ [, 0.5] [0.5, ], make δ = δ, δ = δ. So, hree fuzzy characerscs can be descrbed by a speca ranguar fuzzy number as foow: y = (r, r = δ δ, δ, δ 3δ (, 0.5 δ δ ( - 3 3δ (, δ, δ δ, δ 0.5 ( Exampe of fuzzy posve cass: sampe pons posve degree of membershp s 0.9, and s negave degree of membershp s 0.. Ths fuzzy characersc can be descrbed by ranguar fuzzy number a = (0.58, 0.8,.0. In hs equaon, 0.8 s he cener of a. ( Exampe of fuzzy negave cass: sampe pons negave degree of membershp s 0.8, and s posve degree of membershp s 0.. Ths fuzzy characersc can be descrbed by ranguar fuzzy number b = (., 0.6, 0.. In hs equaon, 0.6 s he cener of b. (3 Exampe of cener cass: sampe pons posve degree of membershp s 0.5, and s negave degree of membershp s 0.5. Ths fuzzy characersc can be descrbed by ranguar fuzzy number c = (, 0,. In hs equaon, 0 s he cener of c. 3. FSVM Suppose he ranng se s S = {(x, y,...,(x, y } (3-. x R n, y s a ranguar fuzzy number as equaon (-3, =,...,. (x, y ( =,..., s fuzzy ranng pons. S s a fuzzy ranng se. Defnon 3. In equaon (-3, f δ (0.5, ], he correspondng fuzzy ranng pons are fuzzy posve pons. If δ [, 0.5, he correspondng fuzzy ranng pons are fuzzy negave pons. For smpcy, we do no consder he suaon of δ = 0.5 or δ = 0.5. Because he ranguar fuzzy number y = (, 0, does no provde posve or negave cass nformaon n hs suaon. To facae our research, we reorder he fuzzy ranng pons n he se. Pu he fuzzy posve cass pons n fron, and negave ones on back. Thus, we ge he fuzzy ranng se: S = {(x, y,..., (x p, y p, (x p, y p,..., (x, y } (3 - In equaon (3-, (x, y are fuzzy posve cass pons =,..., p. (x, y are fuzzy negave cass pons = p,...,. Defnon 3. Suppose he fuzzy ranng se s descrbed as equaon (3-, for he gven confdence eve λ (0 < λ, f has w R n, b R o make: Pos {y ((w. (x b } λ, =,...,, (3-3 We ca ranng se (3- fuzzy near separabe n he confdence eve λ. Now, we aso ca he queson of fuzzy cassfcaon fuzzy near separabe under confdence eve. As we a know, he basc condon of fuzzy near separabe s he npus of fuzzy posve cass pons and negave ones are separaed by possby λ (0 < λ. If he oupus of fuzzy ranng pons are a or, he fuzzy ranng se w degenerae o ordnary ranng se. Now, he near separabe of fuzzy ranng se becomes he near separabe of ordnary one. The fuzzy near separabe of fuzzy ranng se s he exenson of ordnary ses near separabe. In fuzzy ranng se, f ony we choose an approprae confdence eve, he fuzzy ranng se s s near separabe, ahough Journa of Dga Informaon Managemen Voume Number 5 Ocober 03 39

4 some ranng pons wh smaer membershp are mscassfed n he se. For exampe, hs s shown as Fgure : Suppose here are hree fuzzy ranng pons. Every pon s npu s one-dmensona. The oupus of fuzzy ranng pons (x, y and (x 3, y 3 are deermnae y = and y 3 =. The membershp degree of he frs fuzzy ranng pon ha beongs o negave cass s δ. Suppose δ = 0.5, 0.6, 0.7. x 3 = x = x = 0 y 3 = y = δ Fgure. The shown of fuzzy near separabe ( When δ = 0.5, accordng o equaon (-3, he correspondng ranguar fuzzy number y = (.94, 0.0,.9. So, he fuzzy ranng se s: S = {(x, y, (x, y, (x 3, y 3 } Choose λ = 0.7. If use separang hyper-pane x = 0, (w. x b =. So Pos{(y (( w. x b } = 0.7 > 0.7 And Pos{(y 3 (( w. x 3 b } = > 0.7 Pos{(y 3 (( w. x 3 b } = > 0.7 So, fuzzy ranng se S s near separabe under confdence eve λ = 0.7. ( When δ = 0.6, he correspondng ranguar fuzzy number y = (.53, 0.,.3. Choose λ = 0.47, smary, fuzzy ranng se s near separabe under confdence eve λ = ( When δ = 0.7, he correspondng ranguar fuzzy number y = (.6, 0.4, Choose λ = 0.08, smary, fuzzy ranng se S s near separabe under confdence eve λ = The probem of fuzzy cassfcaon has hree ypes: fuzzy near separabe (a he fuzzy ranng pons mee he condon of defnon 3.; approxmae fuzzy near separabe (mos of he fuzzy ranng pons mee he condon of defnon 3.; fuzzy nonnear (mos of he fuzzy ranng pons do no mee he condon of defnon 3.. Theorem 3. Under confdence eve λ (0 < λ, he cear equvaence cass of equaon (3-3 s: (( λ r 3 ((w. x b, =,..., p (3-4 (( λ r ((w. x b, = p,..., Proof: for any =,...,, se (w, b = ((w. x b, (w, b = 0, (w. x b > 0 ((w. x b, (w. x b 0 (w, b = (w. x b, (w. x b > 0 0, (w. x b 0 Accordng o heorem.3, ge he cear equvaence cass of Pos{( y (( w. x 3 b, =,..., } = Pos{( y (( w. x b 0} =, =,..., } λ s: ( λ [ r (w, b r 3 (w, b] λr (w, b 0, = (3-5 Under confdence eve λ (0 < λ, equaon (3-5 can be wren: (( λ r 3 ((w. x b, =,..., p (( λ r ((w. x b, = p,..., Tha s o say, under confdence eve λ (0 < λ, he cear equvaence cass of equaon (3-3 s equaon (3-4. In equaon (3-4, se k =, =,..., p ( λ r3 =, = p,..., ( λ r Then (3-5 can be expressed as (w. x b k, =,..., p (w. x b, = p,..., (3-6 Defnon 3.3 Consder he fuzzy near separabe probem gven by fuzzy ranng se equaon (3-3. We ca wo parae hyper-panes (w. x b = k and (w. x b = supporng hyper-panes abou fuzzy ranng se (3-3. If: (w. x b k, =,..., p mn{((w. x b } = k =,...p (w. x b, = p,..., max {((w. x b } = = p,... (3-7 k ( =,..., p, ( =,..., p s shown as equaon (3-7. k = mn {k }, = max { }. =,...p = p,... Obvousy, he par of supporng hyper-panes abou fuzzy ranng se (3-3 s unque. Dsance beween he par of supporng hyper-panes (w. x b = k and (w. x b = are k. We ca w nerva (k > 0 and < 0 are consans. 4. Fuzzy Lnear Separabe FSVMS Now we consder he near separabe probem of fuzzy 330 Journa of Dga Informaon Managemen Voume Number 5 Ocober 03

5 ranng se descrbed as equaon (3-. Under confdence eve λ (0 < λ, he probem of fuzzy cassfcaon ransform no fuzzy chance-consran programmng queson wh decson varabe (w, b T : mn w w, b s. Pos {y (4 - ((w. x b } λ, =,..., In equaon (4-, y ( =,..., s he ranguar fuzzy number of ranng se descrbed as equaon (3-. Pos{ }s possby measure of fuzzy even{ }. Theorem 4. Under confdence eve λ (0 < λ, he cear equvaen programmng of unceran chance-consran programmng descrbed as equaon (4- s he foowng quadrac programmng: mn w w, b s. (( λ r λr ((w. x b, =,..., p 3 (( λ r ((w. x b, = p,..., (4 - Proof: From he concuson of Theorem 3., we can draw hs concuson. In [], we know he opma souon of programmng (4- exss. Now, we w sove he dua programmng of quadrac programmng descrbed as equaon (4-. Theorem 4. he dua programmng of quadrac programmng descrbed as equaon (4- s: mn (A B C β Σ w, b = = p s.. (( λ r 3 Σ (( λ r = 0 = = p (4-3 0, =,..., p 0, = p,..., In equaon (4-3: A = B = = Σp s = = = C = Σ Σ = p q = p L (w, b, β, α = w ( β s (( λ r 3 (( λ r s3 λr s (x. x s (( λ r 3 (( λ r (x. x α q (( λ r (( λ r q (x. (, s s he subscrp of fuzzy posve cass pons,, q s he subscrp of fuzzy negave cass pons, β = (β,...,β p T, α = (α p,..., α T, (β, α T are decson varabes. Proof: Frs, we nduc Lagrange funcon Σ = p = ((( λ r 3 ((w. x b (( λ r ((w. x b In equaon (4-4, β = (β,...,β p T R p, α = (α p,..., α T R p,, are Lagrange mupers. Accordng o he defnon of Wofe anhess, we sove he mnmum of Lagrange funcon abou w, b. From he condon of exreme vaue: Ge = = b L (w, b, β, α = 0, L (w, b, β, α = 0 w (( λ r 3 Σ = p Σ = p (( λ r = 0 (4-5 w = (( λ r 3 x (( λ r x (4-6 Subsue equaon (4-6 no Lagrange funcon descrbed as equaon (4-4, and use equaon (4-5, we can ge he dua programmng of quadrac programmng descrbed as equaon (4-: max( Σ α (A B C = Σ β, = p s..σ p (( λ r 3 Σ (( λ r = 0 = = p (4-7 0, =,..., p = p,..., In equaon (4-7: A = B = = Σp s = = = C = Σ Σ = p q = p β s (( λ r 3 (( λ r s3 λr s (x. x s (( λ r 3 (( λ r (x. x α q (( λ r (( λ r q (x. β = (β,...β p T, α = (α p,...α T, (β, α T are decson varabe Conver he obecve funcon of quadrac programmng descrbed as equaon (4-7 o mnmum; we can ge equaon (4-3. The programmng descrbed as equaon (4-3 s a convex quadrac programmng. We sove s opma souon (β, α T = (β,...β p,α p,...α T. Se: w = = (( λ r 3 x b = (( λ r s3 λr s ( Σ = p s {s β s > 0}. or = Σ = p (( λ r (x. x s b = (( λ r q λr q ( Σ = p = (( λ r (x. α (( λ r x (( λ r 3 (x. x s (( λ r 3 (x. Journa of Dga Informaon Managemen Voume Number 5 Ocober 03 33

6 q {q α q > 0}. or And se g (x = (w. x b. We can prove he opma cassfcaon funcon (he mehod menoned n [] s: f (x = sgn (g(x = sgn ((w. x b, x R n (4-8 The opma separang hyper-pane s (w. x b = 0 The membershp funcon of opma cassfcaon funcon s µ (u = ϕ (u, 0 < u ϕ ( ϕ (u, ϕ ( u < 0, u > ϕ ( u < ϕ ( (4-9 In equaon (4-9, ϕ (u s he regresson funcon (monoone ncreasng funcon abou u geng from ε suppor vecor regresson. The consrucon mehod of ε suppor vecor regresson s: (a consruc he ranng se of regresson {(0, 0.5, (g (x, δ,...,(g (x p, δ p (4-0 (b use he ranng se as equaon (4-0, choose approprae ε > 0, penay parameer C > 0, choose near kerne as kerne funcon, consruc ε suppor vecor regresson. Smary, ϕ (u s he regresson funcon (monoone decreasng funcon abou u geng from ε suppor vecor regresson. The consrucon mehod of ε suppor vecor regresson s: (b consruc he ranng se of regresson {(0, 0.5, (g (x p, δ p,...,(g (x, δ (4- (c use he ranng se as equaon (4-, choose he same ε and C wh above, choose near kerne as kerne funcon, consruc ε suppor vecor regresson. ϕ ( s he vaue of funcon ϕ (u s nverse funcon a. ϕ ( s he vaue of funcon ϕ (u s nverse funcon a. Gven an npu x of es pon, subsue no equaon (4-8 and (4-9, we can ge f ( x = (or and s degree of membershp µ (g ( x. Conver hem o ranguar fuzzy number y. I s he oupu of es pons ha can refec he fuzzy cassfcaon of es pons (x, y. Ths cassfcaon shows he es pon s membershp of posve and negave cass. Through above dscusson, we can ge he agorhm for cassfyng Suppor Vecor Machnes. Ths agorhm s fuzzy near separabe. ( Gven he ranng se of fuzzy near separabe queson as equaon (3-, choose an approprae confdence eve λ (0 < λ o consruc quadrac programmng as equaon (4-3. ( Sove quadrac programmng as equaon (4-3, ge he opma souon (β, α T = (β,...β p, α p,...α T (3 Compung w = p Σ = (( λ r 3 x Σ = p α (( λ r x ; choose β, s posve componen β s or α s posve componen α. Accordngy, compue or q b = (( λ r s3 λr s ( Σ = p = (( λ r (x. x s b = (( λ r q λr q ( Σ = p = (( λ r (x. (( λ r 3 (x. x s (( λ r 3 (x. (4 Consruc opma separang hyper-pane (w. x b = 0. Accordngy, ge he opma cassfcaon funcon as equaon (4-8. (5 Use he ranng se as equaon (4-0 and (4- separaey, consruc ε suppor vecor regresson (choose approprae ε, penay parameer C, choose near kerne as kerne funcon. Ge regresson funcon ϕ (u and ϕ (u. Accordngy, consruc he membershp funcon of opma cassfcaon funcon as equaon (4-9. Normay, here s ony a e β and α are no zero n he opma souon (β,...β p, α p,...α T of quadrac programmng as equaon (4-3. The correspondng fuzzy ranng pons npu x and x are caed unceran suppor vecors. So, he opma cassfcaon funcon can be expressed as: f (x = sgn {( Σ (( λ r 3 (x x (FSV. Σ α (( λ r (x. x b } (FSV In hs equaon, (FSV s he se composed by a he unceran suppor vecors n fuzzy posve cass pons. (FSV s he se composed by a he unceran suppor vecors n fuzzy negave cass pons. If he oupus of fuzzy ranng pons are a or, he fuzzy ranng se w degenerae o ordnary ranng se. Now, he near separabe of fuzzy ranng se becomes he near separabe of ordnary one. 5. Numerca Expermenaon The unceran Suppor Vecor Cassfcaon Machne s bu on he bass of cassc SVM and fuzzy mahemacs. 33 Journa of Dga Informaon Managemen Voume Number 5 Ocober 03

7 To expan he raonay of our agorhm, we gve specfc daa o do numerca expermenaon. Suppose he npu of 6 ranng pons and her membershp degrees of posve (or negave cass are: x = (, T, s membershp degree of posve cass s (s membershp degree of negave cass s 0; x = (.7, T, s membershp degree of posve cass s 0.95 (s membershp degree of negave cass s 0.05; x 3 = (.5, T, s membershp degree of posve cass s 0.8 (s membershp degree of negave cass s 0.; x 4 = (0, 0 T, s membershp degree of negave cass s (s membershp degree of posve cass s 0; x 5 = (0.8, 0.5 T, s membershp degree of negave cass s 0.85 (s membershp degree of posve cass s 0.5; x 6 = (, 0.5 T, s membershp degree of negave cass s 0.8 (s membershp degree of posve cass s 0.. Accordng o he fuzzy characerscs and her expressons n fuzzy cassfcaon menoned n., conver he membershp degrees o ranguar fuzzy numbers; ge he foowng fuzzy ranng se: S = {(x, y, (x, y, (x 3, y 3, (x 4, y 4, (x 5, y 5, (x 6, y 6 } The oupus of ranng pons are ranguar fuzzy numbers. y = = (,,, y = (0.755, 0.9,, y 3 = (0., 0.6,., y 4 = = (,, y 5 = (.05, 0.7, 0.34, y 6 = (., 0.6, 0., Choose confdence eve λ = 0.8, we can verfy he fuzzy near separabe of ranng se S from Defnon 3.4. So: The opma separang hyper-pane s [x] [x] 4 = 0 Shown as Fgure : Fgure 3.Numerca expermena ( The opma cassfcaon funcon s: f (x = sgn (g(x = sgn ( [x] [x] 4 We consruc he membershp funcon of opma cassfcaon funcon: Use S = {(0, 0.5, (4,, (3.4, 0.95, (, 0.8} as fuzzy ranng se, choose ε = 0., C = 0 and he near kerne, consruc suppor vecor regresson, we can ge regresson funconϕ (u = 0.u 0.6. The membershp funcon of opma cassfcaon funcon s 0.0 g (x 0.6, 0 < g (x 4 µ (g (x = 0. g (x 0.6, 3.64 g (x 0, g (x > 4 g (x < 3.64 Suppose here are es pons npu x 7 = (, T, x 8 = (, 0 T Pu hem no f (x and µ (g (x, we ge f (x 7 = (fuzzy posve cass, s membershp degree of posve cass s 0.8 and negave s 0., so y 7 = (0., 0.6,. (ranguar fuzzy number; f (x 8 = (fuzzy negave cass, s membershp degree of negave cass s 0.8 and posve s 0.8, so y 8 = (.08, 0.64, 0. (ranguar fuzzy number. Compare Fuzzy Suppor Vecor Machne wh cassc suppor vecor machne. Frs, suppose fuzzy ranng se s: S = {(0, 0, ((0.8, 0.5,, ((, 0.5,, ((,,, ((.7,,, ((.5,, } Then he oupu of ranng pons ((.5,, w change: = (,, (0., 0.6,. (., 0.6, 0. (,, = So he oher fuzzy ranng ses are: S = {((0, 0, ((0.8, 0.5,, ((, 0.5,, ((,,, ((.7,,, ((.5,,, (.4, 0.6,.6} S 3 = {((0, 0, ((0.8, 0.5,, ((, 0.5,, ((,,, ((.7,,, ((.5,,, (.4, 0.6,.6} S 4 = {((0, 0, ((0.8, 0.5,, ((, 0.5,, ((,,, ((.7,,, ((.5,, } Choose λ = 0.8, we can verfy ha fuzzy ranng ses S, S, S 3, S 4 are fuzzy near separabe accordng Defnon 3.4. So, on he bass of he agorhm we propose n hs paper, we arrve a he opma separang hyper-pane are 4 sragh nes: : [x ] [x ] = ; : [x ] [x ] =.4; 3 : [x ].93 [x ] =.4; 4 : [x ].93 [x ] =.76; Shown as Fgure 3, he oupu of fuzzy ranng pons change: (,, (0., 0.6,. (., 0.6, 0. (,, and he sragh ne move as: 3 4. Ths change shows ha he fuzzy ranng pons membershp degrees Journa of Dga Informaon Managemen Voume Number 5 Ocober

8 of negave cass are ncreased and posve one decreased. From hs, can be seen ha he resu concdes wh nuve udgmens. 6. Acknowedgmen Fgure. Numerca expermena ( The auhors wsh o hank Compuer and Informaon Engneerng Schoo of Anyang Norma Unversy. L 4 L 3 L L References [] Vapnk, V. N. (998. Sasca Learnng Theory, New York: Wey. [] Vapnk, V. N. (995 The Naure of Sasca Learnng Theory, New York: Sprnger-Verag. [3] Neo, C. e a. (000. Inroducon o Suppor Vecor Machnes. Cambrdge Unversy Press. [4] Sakawa, M., Nshzak, I., Uemura, Y. (000. Ineracve fuzzy programmng for mu-eve near programmng probems wh fuzzy parameers, Fuzzy Ses and Sysems, 09, p [5] Lu, B. D., Zhao, R. Q. (998. Sochasc Programmng and Fuzzy Programmng. Tsnghua Unversy Press. [6] Deng, N. Y.,Tan, Y. J. (004. New Mehod n Daa Mnng: Suppor Vecor Machnes. Scence Press. [7] Mra, S., Pa, S. K., Mra, P. (00. Daa mnng n sof compung Communcang framework survey. IEEE Trans. Neura Neworks, 3 ( 3-4. [8] Kou, G., Xanao, L., Peng, Y. (003. Mupe crera near programmng approach J. C. o daa mnng. Modes, agorhm desgns and sofware deveopmen, Opmzaon Mehods and Sofware 8 ( Auhor Bography Wang Amn, born n 957. Professor and maser supervsor of compuer scence a Anyang Norma Unversy, Chna. Hs maor research neress ncude negen compung and fuzzy conro. L Je, born n 978. Lecure of compuer scence a Anyang Norma Unversy, Chna. Hs maor research neress ncude rea-me sysem and negen conro. 334 Journa of Dga Informaon Managemen Voume Number 5 Ocober 03

CHAPTER 7: CLUSTERING

CHAPTER 7: CLUSTERING CHAPTER 7: CLUSTERING Semparamerc Densy Esmaon 3 Paramerc: Assume a snge mode for p ( C ) (Chapers 4 and 5) Semparamerc: p ( C ) s a mure of denses Mupe possbe epanaons/prooypes: Dfferen handwrng syes,

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4 CS434a/54a: Paern Recognon Prof. Olga Veksler Lecure 4 Oulne Normal Random Varable Properes Dscrmnan funcons Why Normal Random Varables? Analycally racable Works well when observaon comes form a corruped

More information

V.Abramov - FURTHER ANALYSIS OF CONFIDENCE INTERVALS FOR LARGE CLIENT/SERVER COMPUTER NETWORKS

V.Abramov - FURTHER ANALYSIS OF CONFIDENCE INTERVALS FOR LARGE CLIENT/SERVER COMPUTER NETWORKS R&RATA # Vol.) 8, March FURTHER AALYSIS OF COFIDECE ITERVALS FOR LARGE CLIET/SERVER COMPUTER ETWORKS Vyacheslav Abramov School of Mahemacal Scences, Monash Unversy, Buldng 8, Level 4, Clayon Campus, Wellngon

More information

Lecture 11 SVM cont

Lecture 11 SVM cont Lecure SVM con. 0 008 Wha we have done so far We have esalshed ha we wan o fnd a lnear decson oundary whose margn s he larges We know how o measure he margn of a lnear decson oundary Tha s: he mnmum geomerc

More information

Sparse Kernel Ridge Regression Using Backward Deletion

Sparse Kernel Ridge Regression Using Backward Deletion Sparse Kerne Rdge Regresson Usng Backward Deeon Lng Wang, Lefeng Bo, and Lcheng Jao Insue of Inegen Informaon Processng 710071, Xdan Unversy, X an, Chna {wp, bf018}@163.com Absrac. Based on he feaure map

More information

Attribute Reduction Algorithm Based on Discernibility Matrix with Algebraic Method GAO Jing1,a, Ma Hui1, Han Zhidong2,b

Attribute Reduction Algorithm Based on Discernibility Matrix with Algebraic Method GAO Jing1,a, Ma Hui1, Han Zhidong2,b Inernaonal Indusral Informacs and Compuer Engneerng Conference (IIICEC 05) Arbue educon Algorhm Based on Dscernbly Marx wh Algebrac Mehod GAO Jng,a, Ma Hu, Han Zhdong,b Informaon School, Capal Unversy

More information

GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS. Youngwoo Ahn and Kitae Kim

GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS. Youngwoo Ahn and Kitae Kim Korean J. Mah. 19 (2011), No. 3, pp. 263 272 GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS Youngwoo Ahn and Kae Km Absrac. In he paper [1], an explc correspondence beween ceran

More information

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory Advanced Scence and Technoogy Letters Vo.83 (ISA 205), pp.60-65 http://dx.do.org/0.4257/ast.205.83.2 Research on Compex etworks Contro Based on Fuzzy Integra Sdng Theory Dongsheng Yang, Bngqng L, 2, He

More information

An introduction to Support Vector Machine

An introduction to Support Vector Machine An nroducon o Suppor Vecor Machne 報告者 : 黃立德 References: Smon Haykn, "Neural Neworks: a comprehensve foundaon, second edon, 999, Chaper 2,6 Nello Chrsann, John Shawe-Tayer, An Inroducon o Suppor Vecor Machnes,

More information

A Fuzzy Expert System for Solving Possibilistic Multiobjective Programming Problems

A Fuzzy Expert System for Solving Possibilistic Multiobjective Programming Problems A Fuzzy Exper Sysem or Sovng Posssc Muoecve Programmng Proems M. H. Rasmy a, W. F. A E-Wahe, A M. Raga c, M. M. E-Sherny * a Facuy o Compuer an Inormao Caro Unversy, Egyp. Eng. Mah. Dep. Facuy o Eng. E-Menoua

More information

Robust Output Tracking of Uncertain Large-Scale Input-Delay Systems via Decentralized Fuzzy Sliding Mode Control

Robust Output Tracking of Uncertain Large-Scale Input-Delay Systems via Decentralized Fuzzy Sliding Mode Control Inernaona Journa of Conro Scence and Engneerng (6: 57-7 DOI:.593/.conro.6.4 Robus Oupu rackng of Unceran Large-Scae Inpu-Deay Sysems va Decenrazed Fuzzy Sdng Mode Conro Chang-Che ng Chang Deparmen of Eecrca

More information

Short-term Load Forecasting Model for Microgrid Based on HSA-SVM

Short-term Load Forecasting Model for Microgrid Based on HSA-SVM MATEC Web of Conferences 73 0007 (08) hps://do.org/0.05/maecconf/08730007 SMIMA 08 Shor-erm Load Forecasng Mode for Mcrogrd Based on HSA-SVM Han Aoyang * Yu Lao An Shuhua Zhang Zhsheng 3* Qngdao Eecrc

More information

Dynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005

Dynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005 Dynamc Team Decson Theory EECS 558 Proec Shruvandana Sharma and Davd Shuman December 0, 005 Oulne Inroducon o Team Decson Theory Decomposon of he Dynamc Team Decson Problem Equvalence of Sac and Dynamc

More information

THE PREDICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS

THE PREDICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS THE PREICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS INTROUCTION The wo dmensonal paral dfferenal equaons of second order can be used for he smulaon of compeve envronmen n busness The arcle presens he

More information

Stochastic State Estimation and Control for Stochastic Descriptor Systems

Stochastic State Estimation and Control for Stochastic Descriptor Systems Sochasc Sae smaon and Conro for Sochasc Descrpor Sysems hwe Gao and aoyan Sh Schoo of ecrc and ecronc ngneerng ann Unversy ann 372, Chna e-ma: zhwegac@pubc.p..cn bsrac In hs paper, a sochasc observer s

More information

Computing Relevance, Similarity: The Vector Space Model

Computing Relevance, Similarity: The Vector Space Model Compung Relevance, Smlary: The Vecor Space Model Based on Larson and Hears s sldes a UC-Bereley hp://.sms.bereley.edu/courses/s0/f00/ aabase Managemen Sysems, R. Ramarshnan ocumen Vecors v ocumens are

More information

On One Analytic Method of. Constructing Program Controls

On One Analytic Method of. Constructing Program Controls Appled Mahemacal Scences, Vol. 9, 05, no. 8, 409-407 HIKARI Ld, www.m-hkar.com hp://dx.do.org/0.988/ams.05.54349 On One Analyc Mehod of Consrucng Program Conrols A. N. Kvko, S. V. Chsyakov and Yu. E. Balyna

More information

Lecture 6: Learning for Control (Generalised Linear Regression)

Lecture 6: Learning for Control (Generalised Linear Regression) Lecure 6: Learnng for Conrol (Generalsed Lnear Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure 6: RLSC - Prof. Sehu Vjayakumar Lnear Regresson

More information

Sparse Kernel Ridge Regression Using Backward Deletion

Sparse Kernel Ridge Regression Using Backward Deletion Sparse Kerne Rdge Regresson Usng Bacward Deeon Lng Wang, Lefeng Bo, and Lcheng Jao Insue of Inegen Informaon Processng 7007, Xdan Unversy, X an, Chna {wp, bf08}@63.com Absrac. Based on he feaure map prncpe,

More information

TSS = SST + SSE An orthogonal partition of the total SS

TSS = SST + SSE An orthogonal partition of the total SS ANOVA: Topc 4. Orhogonal conrass [ST&D p. 183] H 0 : µ 1 = µ =... = µ H 1 : The mean of a leas one reamen group s dfferen To es hs hypohess, a basc ANOVA allocaes he varaon among reamen means (SST) equally

More information

( t) Outline of program: BGC1: Survival and event history analysis Oslo, March-May Recapitulation. The additive regression model

( t) Outline of program: BGC1: Survival and event history analysis Oslo, March-May Recapitulation. The additive regression model BGC1: Survval and even hsory analyss Oslo, March-May 212 Monday May 7h and Tuesday May 8h The addve regresson model Ørnulf Borgan Deparmen of Mahemacs Unversy of Oslo Oulne of program: Recapulaon Counng

More information

Advanced Machine Learning & Perception

Advanced Machine Learning & Perception Advanced Machne Learnng & Percepon Insrucor: Tony Jebara SVM Feaure & Kernel Selecon SVM Eensons Feaure Selecon (Flerng and Wrappng) SVM Feaure Selecon SVM Kernel Selecon SVM Eensons Classfcaon Feaure/Kernel

More information

Approximate Analytic Solution of (2+1) - Dimensional Zakharov-Kuznetsov(Zk) Equations Using Homotopy

Approximate Analytic Solution of (2+1) - Dimensional Zakharov-Kuznetsov(Zk) Equations Using Homotopy Arcle Inernaonal Journal of Modern Mahemacal Scences, 4, (): - Inernaonal Journal of Modern Mahemacal Scences Journal homepage: www.modernscenfcpress.com/journals/jmms.aspx ISSN: 66-86X Florda, USA Approxmae

More information

Variants of Pegasos. December 11, 2009

Variants of Pegasos. December 11, 2009 Inroducon Varans of Pegasos SooWoong Ryu bshboy@sanford.edu December, 009 Youngsoo Cho yc344@sanford.edu Developng a new SVM algorhm s ongong research opc. Among many exng SVM algorhms, we wll focus on

More information

Cubic Bezier Homotopy Function for Solving Exponential Equations

Cubic Bezier Homotopy Function for Solving Exponential Equations Penerb Journal of Advanced Research n Compung and Applcaons ISSN (onlne: 46-97 Vol. 4, No.. Pages -8, 6 omoopy Funcon for Solvng Eponenal Equaons S. S. Raml *,,. Mohamad Nor,a, N. S. Saharzan,b and M.

More information

Lecture Slides for INTRODUCTION TO. Machine Learning. ETHEM ALPAYDIN The MIT Press,

Lecture Slides for INTRODUCTION TO. Machine Learning. ETHEM ALPAYDIN The MIT Press, Lecure Sdes for INTRODUCTION TO Machne Learnng ETHEM ALPAYDIN The MIT Press, 2004 aaydn@boun.edu.r h://www.cme.boun.edu.r/~ehem/2m CHAPTER 7: Cuserng Semaramerc Densy Esmaon Paramerc: Assume a snge mode

More information

Lecture VI Regression

Lecture VI Regression Lecure VI Regresson (Lnear Mehods for Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure VI: MLSC - Dr. Sehu Vjayakumar Lnear Regresson Model M

More information

DITAN: A TOOL FOR OPTIMAL SPACE TRAJECTORY DESIGN

DITAN: A TOOL FOR OPTIMAL SPACE TRAJECTORY DESIGN DITAN: A TOOL FOR OPTIMAL SPACE TRAJECTORY DESIGN Massmano Vase Deparmen o Aerospace Engneerng Gasgow Unversy Gasgow Ruedger Jehn ESA/ESOC Inroducon o DITAN Fna Remarks Agenda Oune DITAN (drec Inerpaneary

More information

Robust and Accurate Cancer Classification with Gene Expression Profiling

Robust and Accurate Cancer Classification with Gene Expression Profiling Robus and Accurae Cancer Classfcaon wh Gene Expresson Proflng (Compuaonal ysems Bology, 2005) Auhor: Hafeng L, Keshu Zhang, ao Jang Oulne Background LDA (lnear dscrmnan analyss) and small sample sze problem

More information

Introduction to Boosting

Introduction to Boosting Inroducon o Boosng Cynha Rudn PACM, Prnceon Unversy Advsors Ingrd Daubeches and Rober Schapre Say you have a daabase of news arcles, +, +, -, -, +, +, -, -, +, +, -, -, +, +, -, + where arcles are labeled

More information

CHAPTER 10: LINEAR DISCRIMINATION

CHAPTER 10: LINEAR DISCRIMINATION CHAPER : LINEAR DISCRIMINAION Dscrmnan-based Classfcaon 3 In classfcaon h K classes (C,C,, C k ) We defned dscrmnan funcon g j (), j=,,,k hen gven an es eample, e chose (predced) s class label as C f g

More information

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!) i+1,q - [(! ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL The frs hng o es n wo-way ANOVA: Is here neracon? "No neracon" means: The man effecs model would f. Ths n urn means: In he neracon plo (wh A on he horzonal

More information

Lecture 2 L n i e n a e r a M od o e d l e s

Lecture 2 L n i e n a e r a M od o e d l e s Lecure Lnear Models Las lecure You have learned abou ha s machne learnng Supervsed learnng Unsupervsed learnng Renforcemen learnng You have seen an eample learnng problem and he general process ha one

More information

THE POLYNOMIAL TENSOR INTERPOLATION

THE POLYNOMIAL TENSOR INTERPOLATION Pease ce hs arce as: Grzegorz Berna, Ana Ceo, The oynoma ensor neroaon, Scenfc Research of he Insue of Mahemacs and Comuer Scence, 28, oume 7, Issue, ages 5-. The webse: h://www.amcm.cz./ Scenfc Research

More information

Bayes rule for a classification problem INF Discriminant functions for the normal density. Euclidean distance. Mahalanobis distance

Bayes rule for a classification problem INF Discriminant functions for the normal density. Euclidean distance. Mahalanobis distance INF 43 3.. Repeon Anne Solberg (anne@f.uo.no Bayes rule for a classfcaon problem Suppose we have J, =,...J classes. s he class label for a pxel, and x s he observed feaure vecor. We can use Bayes rule

More information

Department of Economics University of Toronto

Department of Economics University of Toronto Deparmen of Economcs Unversy of Torono ECO408F M.A. Economercs Lecure Noes on Heeroskedascy Heeroskedascy o Ths lecure nvolves lookng a modfcaons we need o make o deal wh he regresson model when some of

More information

HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD

HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD Journal of Appled Mahemacs and Compuaonal Mechancs 3, (), 45-5 HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD Sansław Kukla, Urszula Sedlecka Insue of Mahemacs,

More information

Relative controllability of nonlinear systems with delays in control

Relative controllability of nonlinear systems with delays in control Relave conrollably o nonlnear sysems wh delays n conrol Jerzy Klamka Insue o Conrol Engneerng, Slesan Techncal Unversy, 44- Glwce, Poland. phone/ax : 48 32 37227, {jklamka}@a.polsl.glwce.pl Keywor: Conrollably.

More information

Comb Filters. Comb Filters

Comb Filters. Comb Filters The smple flers dscussed so far are characered eher by a sngle passband and/or a sngle sopband There are applcaons where flers wh mulple passbands and sopbands are requred Thecomb fler s an example of

More information

Solution in semi infinite diffusion couples (error function analysis)

Solution in semi infinite diffusion couples (error function analysis) Soluon n sem nfne dffuson couples (error funcon analyss) Le us consder now he sem nfne dffuson couple of wo blocks wh concenraon of and I means ha, n a A- bnary sysem, s bondng beween wo blocks made of

More information

Track Properities of Normal Chain

Track Properities of Normal Chain In. J. Conemp. Mah. Scences, Vol. 8, 213, no. 4, 163-171 HIKARI Ld, www.m-har.com rac Propes of Normal Chan L Chen School of Mahemacs and Sascs, Zhengzhou Normal Unversy Zhengzhou Cy, Hennan Provnce, 4544,

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecure 0 Canoncal Transformaons (Chaper 9) Wha We Dd Las Tme Hamlon s Prncple n he Hamlonan formalsm Dervaon was smple δi δ Addonal end-pon consrans pq H( q, p, ) d 0 δ q ( ) δq ( ) δ

More information

The Analysis of the Thickness-predictive Model Based on the SVM Xiu-ming Zhao1,a,Yan Wang2,band Zhimin Bi3,c

The Analysis of the Thickness-predictive Model Based on the SVM Xiu-ming Zhao1,a,Yan Wang2,band Zhimin Bi3,c h Naonal Conference on Elecrcal, Elecroncs and Compuer Engneerng (NCEECE The Analyss of he Thcknesspredcve Model Based on he SVM Xumng Zhao,a,Yan Wang,band Zhmn B,c School of Conrol Scence and Engneerng,

More information

John Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany

John Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany Herarchcal Markov Normal Mxure models wh Applcaons o Fnancal Asse Reurns Appendx: Proofs of Theorems and Condonal Poseror Dsrbuons John Geweke a and Gann Amsano b a Deparmens of Economcs and Sascs, Unversy

More information

. The geometric multiplicity is dim[ker( λi. number of linearly independent eigenvectors associated with this eigenvalue.

. The geometric multiplicity is dim[ker( λi. number of linearly independent eigenvectors associated with this eigenvalue. Lnear Algebra Lecure # Noes We connue wh he dscusson of egenvalues, egenvecors, and dagonalzably of marces We wan o know, n parcular wha condons wll assure ha a marx can be dagonalzed and wha he obsrucons

More information

Example: Suppose we want to build a classifier that recognizes WebPages of graduate students.

Example: Suppose we want to build a classifier that recognizes WebPages of graduate students. Exampe: Suppose we want to bud a cassfer that recognzes WebPages of graduate students. How can we fnd tranng data? We can browse the web and coect a sampe of WebPages of graduate students of varous unverstes.

More information

Towards the Optimization of Access Control List

Towards the Optimization of Access Control List ISSN 000-982 CODEN RUXUEW E-a: os@scasaccn Journa of Sofware Vo8 No4 Apr 2007 pp978 986 hp://wwwosorgcn DOI: 0360/os80978 Te/Fax: +86-0-626263 2007 by Journa of Sofware A rghs reserved + ( 00084 Towards

More information

Normal Random Variable and its discriminant functions

Normal Random Variable and its discriminant functions Noral Rando Varable and s dscrnan funcons Oulne Noral Rando Varable Properes Dscrnan funcons Why Noral Rando Varables? Analycally racable Works well when observaon coes for a corruped snle prooype 3 The

More information

Training Algorithm of Adaptive Neural Fuzzy Inference System Based on Improved SRUKF

Training Algorithm of Adaptive Neural Fuzzy Inference System Based on Improved SRUKF IAEG Inernaona Journa of Compuer Scence, 44:4, IJCS_44_4_ ranng Agorhm of Adapve eura Fuy Inference Sysem Based on Improved SRUKF Wang Hong and Gao onghu Absrac o sove he probem of ow predcon accuracy

More information

MARKOV CHAIN AND HIDDEN MARKOV MODEL

MARKOV CHAIN AND HIDDEN MARKOV MODEL MARKOV CHAIN AND HIDDEN MARKOV MODEL JIAN ZHANG JIANZHAN@STAT.PURDUE.EDU Markov chan and hdden Markov mode are probaby the smpest modes whch can be used to mode sequenta data,.e. data sampes whch are not

More information

Supporting information How to concatenate the local attractors of subnetworks in the HPFP

Supporting information How to concatenate the local attractors of subnetworks in the HPFP n Effcen lgorh for Idenfyng Prry Phenoype rcors of Lrge-Scle Boolen Newor Sng-Mo Choo nd Kwng-Hyun Cho Depren of Mhecs Unversy of Ulsn Ulsn 446 Republc of Kore Depren of Bo nd Brn Engneerng Kore dvnced

More information

Online Supplement for Dynamic Multi-Technology. Production-Inventory Problem with Emissions Trading

Online Supplement for Dynamic Multi-Technology. Production-Inventory Problem with Emissions Trading Onlne Supplemen for Dynamc Mul-Technology Producon-Invenory Problem wh Emssons Tradng by We Zhang Zhongsheng Hua Yu Xa and Baofeng Huo Proof of Lemma For any ( qr ) Θ s easy o verfy ha he lnear programmng

More information

Chapter Lagrangian Interpolation

Chapter Lagrangian Interpolation Chaper 5.4 agrangan Inerpolaon Afer readng hs chaper you should be able o:. dere agrangan mehod of nerpolaon. sole problems usng agrangan mehod of nerpolaon and. use agrangan nerpolans o fnd deraes and

More information

M. Y. Adamu Mathematical Sciences Programme, AbubakarTafawaBalewa University, Bauchi, Nigeria

M. Y. Adamu Mathematical Sciences Programme, AbubakarTafawaBalewa University, Bauchi, Nigeria IOSR Journal of Mahemacs (IOSR-JM e-issn: 78-578, p-issn: 9-765X. Volume 0, Issue 4 Ver. IV (Jul-Aug. 04, PP 40-44 Mulple SolonSoluons for a (+-dmensonalhroa-sasuma shallow waer wave equaon UsngPanlevé-Bӓclund

More information

( ) () we define the interaction representation by the unitary transformation () = ()

( ) () we define the interaction representation by the unitary transformation () = () Hgher Order Perurbaon Theory Mchael Fowler 3/7/6 The neracon Represenaon Recall ha n he frs par of hs course sequence, we dscussed he chrödnger and Hesenberg represenaons of quanum mechancs here n he chrödnger

More information

A New Excitation Control for Multimachine Power Systems II: Robustness and Disturbance Attenuation Analysis

A New Excitation Control for Multimachine Power Systems II: Robustness and Disturbance Attenuation Analysis 88 Inernaona Journa of Conro Hars Auomaon E Psaks and and Sysems Anono vo T Aexandrds no (speca edon) pp 88-95 June 5 A New Excaon Conro for umachne Power Sysems II: Robusness and Dsurbance Aenuaon Anayss

More information

Volatility Interpolation

Volatility Interpolation Volaly Inerpolaon Prelmnary Verson March 00 Jesper Andreasen and Bran Huge Danse Mares, Copenhagen wan.daddy@danseban.com brno@danseban.com Elecronc copy avalable a: hp://ssrn.com/absrac=69497 Inro Local

More information

EEM 486: Computer Architecture

EEM 486: Computer Architecture EEM 486: Compuer Archecure Lecure 4 ALU EEM 486 MIPS Arhmec Insrucons R-ype I-ype Insrucon Exmpe Menng Commen dd dd $,$2,$3 $ = $2 + $3 sub sub $,$2,$3 $ = $2 - $3 3 opernds; overfow deeced 3 opernds;

More information

CHAPTER 2: Supervised Learning

CHAPTER 2: Supervised Learning HATER 2: Supervsed Learnng Learnng a lass from Eamples lass of a famly car redcon: Is car a famly car? Knowledge eracon: Wha do people epec from a famly car? Oupu: osve (+) and negave ( ) eamples Inpu

More information

Robustness Experiments with Two Variance Components

Robustness Experiments with Two Variance Components Naonal Insue of Sandards and Technology (NIST) Informaon Technology Laboraory (ITL) Sascal Engneerng Dvson (SED) Robusness Expermens wh Two Varance Componens by Ana Ivelsse Avlés avles@ns.gov Conference

More information

Testing a new idea to solve the P = NP problem with mathematical induction

Testing a new idea to solve the P = NP problem with mathematical induction Tesng a new dea o solve he P = NP problem wh mahemacal nducon Bacground P and NP are wo classes (ses) of languages n Compuer Scence An open problem s wheher P = NP Ths paper ess a new dea o compare he

More information

2/20/2013. EE 101 Midterm 2 Review

2/20/2013. EE 101 Midterm 2 Review //3 EE Mderm eew //3 Volage-mplfer Model The npu ressance s he equalen ressance see when lookng no he npu ermnals of he amplfer. o s he oupu ressance. I causes he oupu olage o decrease as he load ressance

More information

. The geometric multiplicity is dim[ker( λi. A )], i.e. the number of linearly independent eigenvectors associated with this eigenvalue.

. The geometric multiplicity is dim[ker( λi. A )], i.e. the number of linearly independent eigenvectors associated with this eigenvalue. Mah E-b Lecure #0 Noes We connue wh he dscusson of egenvalues, egenvecors, and dagonalzably of marces We wan o know, n parcular wha condons wll assure ha a marx can be dagonalzed and wha he obsrucons are

More information

Econ107 Applied Econometrics Topic 5: Specification: Choosing Independent Variables (Studenmund, Chapter 6)

Econ107 Applied Econometrics Topic 5: Specification: Choosing Independent Variables (Studenmund, Chapter 6) Econ7 Appled Economercs Topc 5: Specfcaon: Choosng Independen Varables (Sudenmund, Chaper 6 Specfcaon errors ha we wll deal wh: wrong ndependen varable; wrong funconal form. Ths lecure deals wh wrong ndependen

More information

Advanced time-series analysis (University of Lund, Economic History Department)

Advanced time-series analysis (University of Lund, Economic History Department) Advanced me-seres analss (Unvers of Lund, Economc Hsor Dearmen) 3 Jan-3 Februar and 6-3 March Lecure 4 Economerc echnues for saonar seres : Unvarae sochasc models wh Box- Jenns mehodolog, smle forecasng

More information

CH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC

CH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC CH.3. COMPATIBILITY EQUATIONS Connuum Mechancs Course (MMC) - ETSECCPB - UPC Overvew Compably Condons Compably Equaons of a Poenal Vecor Feld Compably Condons for Infnesmal Srans Inegraon of he Infnesmal

More information

RELATIONSHIP BETWEEN VOLATILITY AND TRADING VOLUME: THE CASE OF HSI STOCK RETURNS DATA

RELATIONSHIP BETWEEN VOLATILITY AND TRADING VOLUME: THE CASE OF HSI STOCK RETURNS DATA RELATIONSHIP BETWEEN VOLATILITY AND TRADING VOLUME: THE CASE OF HSI STOCK RETURNS DATA Mchaela Chocholaá Unversy of Economcs Braslava, Slovaka Inroducon (1) one of he characersc feaures of sock reurns

More information

Ordinary Differential Equations in Neuroscience with Matlab examples. Aim 1- Gain understanding of how to set up and solve ODE s

Ordinary Differential Equations in Neuroscience with Matlab examples. Aim 1- Gain understanding of how to set up and solve ODE s Ordnary Dfferenal Equaons n Neuroscence wh Malab eamples. Am - Gan undersandng of how o se up and solve ODE s Am Undersand how o se up an solve a smple eample of he Hebb rule n D Our goal a end of class

More information

Graduate Macroeconomics 2 Problem set 5. - Solutions

Graduate Macroeconomics 2 Problem set 5. - Solutions Graduae Macroeconomcs 2 Problem se. - Soluons Queson 1 To answer hs queson we need he frms frs order condons and he equaon ha deermnes he number of frms n equlbrum. The frms frs order condons are: F K

More information

A NEW TECHNIQUE FOR SOLVING THE 1-D BURGERS EQUATION

A NEW TECHNIQUE FOR SOLVING THE 1-D BURGERS EQUATION S19 A NEW TECHNIQUE FOR SOLVING THE 1-D BURGERS EQUATION by Xaojun YANG a,b, Yugu YANG a*, Carlo CATTANI c, and Mngzheng ZHU b a Sae Key Laboraory for Geomechancs and Deep Underground Engneerng, Chna Unversy

More information

The Dynamic Programming Models for Inventory Control System with Time-varying Demand

The Dynamic Programming Models for Inventory Control System with Time-varying Demand The Dynamc Programmng Models for Invenory Conrol Sysem wh Tme-varyng Demand Truong Hong Trnh (Correspondng auhor) The Unversy of Danang, Unversy of Economcs, Venam Tel: 84-236-352-5459 E-mal: rnh.h@due.edu.vn

More information

( ) [ ] MAP Decision Rule

( ) [ ] MAP Decision Rule Announcemens Bayes Decson Theory wh Normal Dsrbuons HW0 due oday HW o be assgned soon Proec descrpon posed Bomercs CSE 90 Lecure 4 CSE90, Sprng 04 CSE90, Sprng 04 Key Probables 4 ω class label X feaure

More information

Survival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System

Survival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System Communcaons n Sascs Theory and Mehods, 34: 475 484, 2005 Copyrgh Taylor & Francs, Inc. ISSN: 0361-0926 prn/1532-415x onlne DOI: 10.1081/STA-200047430 Survval Analyss and Relably A Noe on he Mean Resdual

More information

Neural network-based athletics performance prediction optimization model applied research

Neural network-based athletics performance prediction optimization model applied research Avaabe onne www.jocpr.com Journa of Chemca and Pharmaceutca Research, 04, 6(6):8-5 Research Artce ISSN : 0975-784 CODEN(USA) : JCPRC5 Neura networ-based athetcs performance predcton optmzaton mode apped

More information

5th International Conference on Advanced Design and Manufacturing Engineering (ICADME 2015)

5th International Conference on Advanced Design and Manufacturing Engineering (ICADME 2015) 5h Inernaonal onference on Advanced Desgn and Manufacurng Engneerng (IADME 5 The Falure Rae Expermenal Sudy of Specal N Machne Tool hunshan He, a, *, La Pan,b and Bng Hu 3,c,,3 ollege of Mechancal and

More information

Regularized Multiple-Criteria Linear Programming Via Second Order Cone Programming Formulations

Regularized Multiple-Criteria Linear Programming Via Second Order Cone Programming Formulations Regularzed Mulple-Crera Lnear Programmng Va Second Order Cone Programmng Formulaons Zhquan Q Research Cener on Fcous Economy & Daa Scence Chnese Academy of Scences Bejng 0090 Chna qzhquan@gucas.ac.cn Yngje

More information

Fuzzy Set Theory in Modeling Uncertainty Data. via Interpolation Rational Bezier Surface Function

Fuzzy Set Theory in Modeling Uncertainty Data. via Interpolation Rational Bezier Surface Function Appled Mahemacal Scences, Vol. 7, 013, no. 45, 9 38 HIKARI Ld, www.m-hkar.com Fuzzy Se Theory n Modelng Uncerany Daa va Inerpolaon Raonal Bezer Surface Funcon Rozam Zakara Deparmen of Mahemacs, Faculy

More information

Response of MDOF systems

Response of MDOF systems Response of MDOF syses Degree of freedo DOF: he nu nuber of ndependen coordnaes requred o deerne copleely he posons of all pars of a syse a any nsan of e. wo DOF syses hree DOF syses he noral ode analyss

More information

On computing differential transform of nonlinear non-autonomous functions and its applications

On computing differential transform of nonlinear non-autonomous functions and its applications On compung dfferenal ransform of nonlnear non-auonomous funcons and s applcaons Essam. R. El-Zahar, and Abdelhalm Ebad Deparmen of Mahemacs, Faculy of Scences and Humanes, Prnce Saam Bn Abdulazz Unversy,

More information

Clustering (Bishop ch 9)

Clustering (Bishop ch 9) Cluserng (Bshop ch 9) Reference: Daa Mnng by Margare Dunham (a slde source) 1 Cluserng Cluserng s unsupervsed learnng, here are no class labels Wan o fnd groups of smlar nsances Ofen use a dsance measure

More information

Machine Learning Linear Regression

Machine Learning Linear Regression Machne Learnng Lnear Regresson Lesson 3 Lnear Regresson Bascs of Regresson Leas Squares esmaon Polynomal Regresson Bass funcons Regresson model Regularzed Regresson Sascal Regresson Mamum Lkelhood (ML)

More information

Improved Stumps Combined by Boosting for Text Categorization

Improved Stumps Combined by Boosting for Text Categorization 1000-985/00/13(08)1361-07 00 Journa of Sofware Vo.13, No.8 Improved Sumps Comned y Boosng for Tex Caegorzaon DIAO L-, HU Ke-yun, LU Yu-chang, SHI Chun-y (Sae Key Laoraory of Inegen Technoogy and Sysem,

More information

GMM parameter estimation. Xiaoye Lu CMPS290c Final Project

GMM parameter estimation. Xiaoye Lu CMPS290c Final Project GMM paraeer esaon Xaoye Lu M290c Fnal rojec GMM nroducon Gaussan ure Model obnaon of several gaussan coponens Noaon: For each Gaussan dsrbuon:, s he ean and covarance ar. A GMM h ures(coponens): p ( 2π

More information

Secure and Fast Digital Signatures using BCH Codes

Secure and Fast Digital Signatures using BCH Codes 0 IJCSNS Inernaona Journa of Compuer Scence and Nework Secury, VOL6 No0, Ocober 006 Secure and Fas Dga Sgnaures usng BCH Codes Omessaâd HAMDI *, Sam HARARI ** and Ammar BOUALLEGUE ***, (*),(***) SYSCOM

More information

e-journal Reliability: Theory& Applications No 2 (Vol.2) Vyacheslav Abramov

e-journal Reliability: Theory& Applications No 2 (Vol.2) Vyacheslav Abramov June 7 e-ournal Relably: Theory& Applcaons No (Vol. CONFIDENCE INTERVALS ASSOCIATED WITH PERFORMANCE ANALYSIS OF SYMMETRIC LARGE CLOSED CLIENT/SERVER COMPUTER NETWORKS Absrac Vyacheslav Abramov School

More information

S. J. Sadjadi*, Mir.B.Gh. Aryanezhad & H.A. Sadeghi

S. J. Sadjadi*, Mir.B.Gh. Aryanezhad & H.A. Sadeghi Inernaona Journa o Indusra Engneerng & Producon Research (009) pp. ecember 009, Voume 0, Number Inernaona Journa o Indusra Engneerng & Producon Research ISSN: 008889 Journa Webse: hp://ijiepr.us.ac.r/

More information

Lecture 18: The Laplace Transform (See Sections and 14.7 in Boas)

Lecture 18: The Laplace Transform (See Sections and 14.7 in Boas) Lecure 8: The Lalace Transform (See Secons 88- and 47 n Boas) Recall ha our bg-cure goal s he analyss of he dfferenal equaon, ax bx cx F, where we emloy varous exansons for he drvng funcon F deendng on

More information

Outline. Probabilistic Model Learning. Probabilistic Model Learning. Probabilistic Model for Time-series Data: Hidden Markov Model

Outline. Probabilistic Model Learning. Probabilistic Model Learning. Probabilistic Model for Time-series Data: Hidden Markov Model Probablsc Model for Tme-seres Daa: Hdden Markov Model Hrosh Mamsuka Bonformacs Cener Kyoo Unversy Oulne Three Problems for probablsc models n machne learnng. Compung lkelhood 2. Learnng 3. Parsng (predcon

More information

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5 TPG460 Reservor Smulaon 08 page of 5 DISCRETIZATIO OF THE FOW EQUATIOS As we already have seen, fne dfference appromaons of he paral dervaves appearng n he flow equaons may be obaned from Taylor seres

More information

A NOVEL NETWORK METHOD DESIGNING MULTIRATE FILTER BANKS AND WAVELETS

A NOVEL NETWORK METHOD DESIGNING MULTIRATE FILTER BANKS AND WAVELETS A NOVEL NEWORK MEHOD DESIGNING MULIRAE FILER BANKS AND WAVELES Yng an Deparmen of Elecronc Engneerng and Informaon Scence Unversy of Scence and echnology of Chna Hefe 37, P. R. Chna E-mal: yan@usc.edu.cn

More information

EEL 6266 Power System Operation and Control. Chapter 5 Unit Commitment

EEL 6266 Power System Operation and Control. Chapter 5 Unit Commitment EEL 6266 Power Sysem Operaon and Conrol Chaper 5 Un Commmen Dynamc programmng chef advanage over enumeraon schemes s he reducon n he dmensonaly of he problem n a src prory order scheme, here are only N

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecure 9 Hamlonan Equaons of Moon (Chaper 8) Wha We Dd Las Tme Consruced Hamlonan formalsm H ( q, p, ) = q p L( q, q, ) H p = q H q = p H = L Equvalen o Lagrangan formalsm Smpler, bu

More information

ABSTRACT KEYWORDS. Bonus-malus systems, frequency component, severity component. 1. INTRODUCTION

ABSTRACT KEYWORDS. Bonus-malus systems, frequency component, severity component. 1. INTRODUCTION EERAIED BU-MAU YTEM ITH A FREQUECY AD A EVERITY CMET A IDIVIDUA BAI I AUTMBIE IURACE* BY RAHIM MAHMUDVAD AD HEI HAAI ABTRACT Frangos and Vronos (2001) proposed an opmal bonus-malus sysems wh a frequency

More information

SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β

SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β SARAJEVO JOURNAL OF MATHEMATICS Vol.3 (15) (2007), 137 143 SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β M. A. K. BAIG AND RAYEES AHMAD DAR Absrac. In hs paper, we propose

More information

January Examinations 2012

January Examinations 2012 Page of 5 EC79 January Examnaons No. of Pages: 5 No. of Quesons: 8 Subjec ECONOMICS (POSTGRADUATE) Tle of Paper EC79 QUANTITATIVE METHODS FOR BUSINESS AND FINANCE Tme Allowed Two Hours ( hours) Insrucons

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecure 9 Hamlonan Equaons of Moon (Chaper 8) Wha We Dd Las Tme Consruced Hamlonan formalsm Hqp (,,) = qp Lqq (,,) H p = q H q = p H L = Equvalen o Lagrangan formalsm Smpler, bu wce as

More information

Sampling Procedure of the Sum of two Binary Markov Process Realizations

Sampling Procedure of the Sum of two Binary Markov Process Realizations Samplng Procedure of he Sum of wo Bnary Markov Process Realzaons YURY GORITSKIY Dep. of Mahemacal Modelng of Moscow Power Insue (Techncal Unversy), Moscow, RUSSIA, E-mal: gorsky@yandex.ru VLADIMIR KAZAKOV

More information

Chapter 6: AC Circuits

Chapter 6: AC Circuits Chaper 6: AC Crcus Chaper 6: Oulne Phasors and he AC Seady Sae AC Crcus A sable, lnear crcu operang n he seady sae wh snusodal excaon (.e., snusodal seady sae. Complee response forced response naural response.

More information

Mixtures Experiments with Mixing Errors

Mixtures Experiments with Mixing Errors Mures Epermens h Mng Errors Aaa Ahuba & Aeander N. Donev Frs verson: June 009 Research Repor No. 0, 009, Probaby and Sascs Group Schoo o Mahemacs, he Unversy o Mancheser Mures Epermens h Mng Errors Aaa

More information

Structural Optimization Using Metamodels

Structural Optimization Using Metamodels Srucural Opmzaon Usng Meamodels 30 Mar. 007 Dep. o Mechancal Engneerng Dong-A Unvers Korea Kwon-Hee Lee Conens. Numercal Opmzaon. Opmzaon Usng Meamodels Impac beam desgn WB Door desgn 3. Robus Opmzaon

More information