Automatic Digital Modulation Identification in Dispersive Channels

Size: px
Start display at page:

Download "Automatic Digital Modulation Identification in Dispersive Channels"

Transcription

1 roceedngs of e 5 WSEAS Internatona Conference on eecommuncatons and Informatc Istanbu, urey, ay 7-9, 006 (pp409-44) Automatc Dgta oduaton Identfcaton n Dspersve Channes AAOLLAH EBRAHIZADEH, SEYED ALIREZA SEYEDIN Department of Eectrca and Computer Engneerng, Ferdows Unversty of ashad, Noushrvan Insttute of echnoogy IRAN Abstract: - Automatc moduaton type dentfcaton (AI) has seen ncreasng demand for bo mtary and cvan, nowadays. ost of prevous meods have been proposed on cassfcaton of moduatons n addtve whte Gaussan nose (AWGN) channes. However n rea word scenaro communcaton channes suffer from dsperson (fadng). hs paper proposes a nove automatc dgta moduaton types dentfer (ADI) n dspersve envronment. In e ADI s structure, undesred effects of channe are mtgated by an equazer. Hgher order cumuants and moments (up to egh) are used as features and cassfcaton s performed by a mutcass SV-based cassfer. Smuaton resuts show at ADI s abe to dentfy dfferent types of moduatons (e.g. QA64, V.9, and ASK8) w hgh accuracy even at ow SNRs. Key-Words: - Statstca pattern recognton, moduaton, support vector machne, dspersve envronment. Introducton Automatc moduaton type dentfer s a system at recognzes e moduaton type of receved sgna automatcay, and has many appcatons such as eectronc surveance, reat evauaton, sgna confrmaton, spectrum management, software rado, etc. Whst, eary researches were concentrated on anaog moduaton e recent contrbutons n e subect focus more on dgta communcatons due to ncreasng usage of dgta moduatons n many nove appcatons. Generay, AI meods can be categorzed n two man categores: decson eoretc (D) and pattern recognton (R). D approaches use probabstc and hypoess testng arguments to formuate e recognton probem and to obtan e cassfcaton rue [-]. he maor drawbacs of ese approaches are er very hgh computatona compexty, dffcuty wn e mpementaton and ac of robustness to mode msmatch. R approache however, do not need such carefu treatment. R approaches many dvded nto two subsystems: e feature extracton subsystem and e recognton subsystem. he former subsystem s responsbe for extractng promnent characterstcs from receved sgna whch are caed features and e atter, cassfer, s empoyed to ndcate e membershp of moduaton type [-6]. R approaches are smpe to mpement; however, seectons of two subsystems are serous probems. ost of prevous meods have been proposed on cassfcaton of moduatons n AWGNchannes [-8], [-4]. However, n rea word communcaton channe such as wreess communcaton envronment suffer from dsperson (fadng) and most of recognzers at are desgned for AWGN do not preserve er performance under mparment condtons. Research on AI, over fadng channes has been ony performed n a few wors [9-], [5-6]. In [9-0], cassfcaton between SK and SK4 n a fat Rayegh fadng are proposed. In [] a quasoptma souton based on e approxmaton of e og-ehood functon s proposed. In [5], e moduatons were dentfed by appyng e nearest neghbor rue n a two-dmensona feature space. In [6], an dentfer usng neura networ based on combnatons of dfferent order of moments s proposed to dscrmnate dgta moduatons n mutpa fadng. hs paper proposes a nove ADI n tme dsperson channes.fgure shows e scheme of ADI. In s structure, re-processng modue performs: reecton of nose outsde of sgna bandwd, normazaton, carrer frequency estmaton, recovery of compex enveope, etc. Equazaton modue mtgates e channe at s presented n secton. Secton 3 descrbe feature extracton modue. Secton 4, presents e cassfer. In secton 5, some expermenta resuts are shown for consdered dgta moduaton set {SK, SK4, SK8, ASK8, QA3, V9, Star-QA8, and QA64}. Fnay n secton 6 concusons are presented.

2 roceedngs of e 5 WSEAS Internatona Conference on eecommuncatons and Informatc Istanbu, urey, ay 7-9, 006 (pp409-44) Receved sgna reprocessng Equazaton Features extracton Cassfer ype of moduaton Fgure: Structure of ADI Channe equazaton In dgta communcaton accordng to e changes n e message frequency, message amptude, message phase, or changes n amptude and phase, we have four man dgta moduaton technque frequency shft eyng (FSK), amptude shft eyng (ASK), phase shft eyng (SK) and quadrature amptude moduaton (QA), respectvey. ost of em are apped n -ary form [7]. In rea word stuatons e transmsson channe s a crtca factor at may cause unrecoverabe dstortons on e sgna, especay n hgher order dgta moduaton where e effect of channe may corrupt e sgna consteaton. In order to mtgate e dsperson effects of e propagaton channe, an equazaton stage s empoyed n e recever. In AI appcaton e tranng sequence at s needed for adustng equazer coeffcents s not avaabe. Hence, e equazaton must be done bndy. When e type of moduaton s unnown, usuay, e Fractonay Spaced Equazer- Constant oduus Agorm (FSE-CA) s one of e commony used bnd equazaton agorm whch are desgned to undo e channe effect wout any nowedge of e channe tsef [8]. he FSE-CA s e ntegraton of two dfferent parts: e constant moduus agorms (CA) and e fractona spaced equazer (FSE). he constant moduus agorm (CA) s a stochastc gradent agorm, desgned to force e equazer weght to eep a constant enveop on e receved sgnas. hu t s desgned for probems where e sgna of nterest has a constant enveope property. However, extensve smuatons have shown at t can st be used n amptude-phase moduaton type but e success of equazaton s decreased w ncreasng of order. As a resut, e CA s expected to have better performance for FSK and SK raer an QA types. he CA cost functon s gven by: J ( ) = E{( y( ) γ ) } () where y () s e equazer output and γ caed e dsperson constant defned by (). 4,0 γ = (),0 where 4, 0 and, 0 are four and second order moment respectvey. he cost functon J () s mnmzed teratvey usng a gradent based agorm w update equaton. In any standard CA equazaton system, e coeffcent taps are baud-spaced. However, t s often desred to use an equazer w taps spaced at a fracton of e data symbo perod. hs confguraton gves e extra degrees of freedom to perform addtona fterng. Such a scheme s caed fractona spaced equazaton (FSE). We assume at e receved sgna s: x ( t ) = = s ( ) h ( t ) + υ ( t ) (3) = where h (t) s e channe mpuse response, s() e sequence of nformaton and υ(t) s AWGN. he response h(t) s assumed to be of fnte eng. Fractonay spaced channe output resutng from tmes oversampng w respect to symbo rate may be wrtten as: t x ) = s( ) h( ) + ( ) = ( ν (4) An equvaent representaton may be formed usng -channe parae fter ban mode. hen e output of e sub-channe h () s gven by: = x ( ) = s( ) h ( ) + ν ( ) : = 0,..., (5) Now, we assume an equazer w () whch s used n cascade w each subchanne h (). he equazer coeffcents (taps) are adusted usng FSE- CA agorm: w ( + ) = w ( ) + ζ x ( ) y ( )( y ( ) γ ) (6) where ζ s e step sze parameter and: x ( ) = [ x ( ),..., x ( ( N )),..., (7) x ( ),..., x ( ( N ))] and superscrpt denotes e subchanne,.e., fractonay samped data are organzed on subchanne bass. It shoud be mentoned because of fractona sampng n channe equazaton stage, e symbo rate needs to be nown or to be estmated pror to choosng e sampng rate 3 Features extracton In AI t s most mportant to fnd a set of features whch coud be used to dscrmnate e members of consdered moduaton set. Among e dfferent types of features at we have evauated and ex-

3 roceedngs of e 5 WSEAS Internatona Conference on eecommuncatons and Informatc Istanbu, urey, ay 7-9, 006 (pp409-44) permented, hgher order moments and hgher order cumuants up to eght, produced e most effectve features. hese features provde a good way to descrbe e shape of e consteaton. Foowng subsecton brefy descrbe ese features. 3. oments (om.s) robabty dstrbuton moments are a generazaton of concept of e expected vaue, and can be used to defne e characterstcs of a probabty densty functon. Reca at e genera expresson moment of random varabe s gven by [9]: µ = ( s µ ) f ( s) ds (8) where µ s e mean of e random varabe. he defnton for e moment for a fnte eng dscrete sgna s gven by: = N = µ ( s µ) f ( s ) (9) where N s e data eng. In s study sgnas are assumed to be zero mean. hus Eq. (9) becomes: = N s = µ f ( s ) (0) Next, e auto-moment of e random varabe may be defned as foows: p q q = E[ s ( s ) ] () pq where p caed moment order and s stands for compex conugaton. Assume a zero-mean dscrete sgna sequence of e form s = a + b. Usng (), dfferent orders of moment derved, e.g.: = E[ s ( s ) ] = E[( a + b) ( a b)] () 4 4 = E[ a b ] 3. Cumuants (Cum.s) Consder a scaar zero mean random varabe s w characterstc functon: ts f ˆ ( t) = E{ e } (3) Expandng e ogarm of e characterstc functon as a ayor sere one obtans: r ( t) r ( t) og fˆ( t) = ( t) + + L + +L (4) r! e constants, n (4), caed e cumuants. he symbosm for p order of cumuant s smar to e p order moment. ore specay: C pq = Cum[ 3..., s, s 443,..., s ] (5) ( p q) terms ( q) terms For exampe: C = Cum( s ) (6) 8 It can be computed reaton between moments and cumuants. 3.3 Reaton between Cum.s and om.s he n order cumuant s a functon of e moments of orders up to ncudng n. oments may be expressed n terms of cumuants as: s,.., s = Cum s... um s (7) [ n ] { } [ ] [{ } ] v v v where e summaton ndex s over a parttons v = ( v,..., v q ) for e set of ndexes (,,..., n ), and q s e number of eements n a gven partton. Cumuants may be aso be derved n terms of moments. he n order cumuant of a dscrete sgna s (n) s gven by: q Cum [.., sn ] = ( ) ( q )! E[ s ].. E[ s ] (8) v v v q where e summaton s beng performed on a parttons v = ( v,..., v q ) for e set of ndces (,,..., n ).For exampe: 3 C63 = (9) 4 C 80 = (0) abe shows chosen features for consdered set (eoretca vaues under e constrant of unt varance). In s tabe, for smpfyng, we substtute e moduatons SK, SK4, SK8, ASK8, QA3, V9, Star-QA8 and QA64 w,, 3, 4, 5, 6, 7 and 8 respectvey. abe: Chosen features C C C C Support Vectors achne (SV) Support Vector achne (SV) s a supervsed machne earnng technque at can be apped for bo bnary and mut-cass cassfcaton [30]. he SV s based on structura rs mnmzaton (SR) prncpe at gves t to have hghy generazaton abty comparson oer approaches (e.g. neura networ etc.[3]. 4. Bnary SV he bnary SV performs cassfcaton tass by constructng optma separatng hyperpanes (OSH).

4 roceedngs of e 5 WSEAS Internatona Conference on eecommuncatons and Informatc Istanbu, urey, ay 7-9, 006 (pp409-44) OSH maxmzes e margn between e two nearest data ponts beongng to two separate casses. he dea of SV can be expressed as foows. Suppose e tranng set, d ( x, y ), =,,...,, x R, y {, + } can be separated by e hyperpane w x + b = 0, where w r s weght vector and b s bas. If s hyperpane maxmze e margn, en e foowng nequaty s vad for a nput data: y ( w x + b),for a x =,,..., () he margn of e hyper-pane s / w r, u e probem s: maxmzng e margn by mnmzng of w subect to (), at s a convex quadratc programmng (Q) probem at Lagrange mutpers are used to sove t: L = w λ [ y ( w x + b) ] () = where λ, =,..., are e Lagrange mutpers ( λ 0).he souton to s Q probem s gven by mnmzng L w respect to w and b. After dfferentatng L w respect to w and b and settng e dervatves equa to 0, yeds: w λ x (3) = = y It can obtan e dua varabes Lagrangan by mposng e Karush-Kuhn-ucer (KK) condtons: L = λ λ λ y y x x (4) d = = = o fnd e OSH, t must maxmze L d under e constrants of λ = 0, and λ 0.hose tranng = y ponts for whch e equaty n () hods are caed support vectors (SV) at can satsfy λ f 0. he optma bas s gven by: b = y w x (5) for any support vector x. For nput data w a hgh nose eve, SV uses soft margns can be expressed as foows w e ntroducton of e non-negatve sac varabesξ, =,..., : y ( w x + b) ξ for =,,..., (6) o obtan e OSH, t shoud be mnmzng e Φ = w + C ξ subect to constrants (6), = where C s reguarzaton constant at contros how heavy tranng errors are penazed. In e nonneary case e SV map e tranng pont nonneary, to a hgh-dmensona feature r r space usng erne functon K( x, x ), where near separaton may be possbe. he famous erne functons are near, poynoma, rada bass functon (RBF), and sgmod. Havng seected a erne functon, e Q probem s: Ld = λ λλ y y K( x, x ) (7) = = = After tranng, e foowng, e decson functon, becomes: f ( x) = sgn( y λ K( x, x ) + b ) (8) = 4. utcass SV-based cassfer In s research, we have derved at a nove, smpe and effectve souton for combnng bnary SVs to construct a mut-cass cassfer. In our agorm, we use an approach smar to e one reported n reported n [3]. Our approach can be descrbed as foows: Let { : =,,.., N} be N cassesof sgnas.we construct N cassfers { f : =,,.., N} and each cassfer s traned by e meod of one-cassversus-e-rest; at e cassfer f s traned for versus e rest of e casses. hen n e sgna cassfcaton phase, e cassfers perform accordng to e foowng decson rue: x f f = max{ f ( x) f 0; =,..., N } (9) where e functon f (x) provdes e dstance of x to e decson surfaces. 5 Expermenta resuts In smuatons we have used e channe mode at has been ntroduced n [33]. ADI was tested under condtons: typca urban propagaton envronment, mobe speed =85 m/h. SNR eves are consdered 0-0 db. he symbo rate s assumed to be nown (or estmated). Whe cassfyng usng our mut-cass SV-based, we used bo Gaussan RBF (GRBF) and poynoma (OLY) erne functons and obtaned a tte bt better performance n e case of OLY; however, e computatona speed of cassfcaton was faster n e case of GRBF. Hence, we used GRBF n our experments r r w K( x, x ) = exp( / x ).abes -4 x show confuson matrx for ree seected SNR eve db, 8dB and 7dB. As we see, e resuts mpy how ADI can dentfy moduaton type w e hgh accuracy n dspersve channes even at ow SNR. hs s due e two facts: chosen nove fea-

5 roceedngs of e 5 WSEAS Internatona Conference on eecommuncatons and Informatc Istanbu, urey, ay 7-9, 006 (pp409-44) tures and cassfer. he chosen feature have hghy effectve propertes n sgna representaton at enabe e cassfer to separate moduaton set w hgh accuracy, on e oer hand, e SVs act exceent on non-separabe data (ow SNR). abe: Confuson matrx at SNR=dB (%) abe3: Confuson matrx at SNR=8dB (%) abe4: Confuson matrx at SNR=7dB (%) As mentoned n secton, CA shows good resuts for SK type but for QA type when e number of states ncreases (hgher order) and/or e SNR eve decrease ts performance degrades. However, smuatons mpy good resuts for ese types of moduatons. he reason for s property shoud be ooed for n chosen features and cassfer at cover e weaness of equazer. For comparson e performance of SV w oer cassfer, we consder a rada bass functon neura networ (RBF-NN) [34]. abe5, show e performance of RBF-NN for smar stuaton n SNR=dB (ow SNR). It s found n ow SNR e RBF-NN shows poor performance. he reason maybe at, n ow SNR e constructon of neura networ s not proper. It shoud be mentoned, ough, e success rate of RBF-based system s ower an SV- based system, but t s hgher an a system at uses oer features and RBF-NN as a cassfer. abe6 shows e performance of a system at utzes RBF-NN and features n [9]. abe5: Confuson matrx at SNR=dB for RBF-NN abe6: SNR=dB for RBF-NN and features n [9] (%) Concuson AI s an mportant ssue n communcaton ntegence and eectronc support measure systems. In s paper, we present ADI to dentfy dgta moduatons types n dspersve channes. ADI uses hgher order moments and cumuants up to eght as features and a mutcass SV-based cassfer. Smuaton resuts show ADI s abe to dscrmnate dfferent types of moduatons w hgh accuracy even at ow SNR. References: [] C.- S. Long, K.. Chugg, and A. oydoro Furer resuts for dgta quadrature moduaton cassfcaton n AWGN, roc. ILCO,994, pp [] A. oydoro and K. Km, On e detecton and cassfcaton of quadrature dgta moduaton n broadband nose, IEEE rans. Commun.,Vo.38, No.8,990, pp.99-. [3] C. Le artret, and D. Botea, A genera maxmum ehood cassfer for moduaton cassfcaton, roc. ICASS, Vo. 4, 998, pp [4]. anagotou, and A. oydoro Lehood rato tests for moduaton cassfcaton roc. ILCO, 000, pp [5] E. E. Azzouz, and A. K. Nand, Automatc dentfcaton of dgta moduaton Sgna rocessng, Vo. 47, No., 995, pp

6 roceedngs of e 5 WSEAS Internatona Conference on eecommuncatons and Informatc Istanbu, urey, ay 7-9, 006 (pp409-44) [6] J. A. S axmum-ehood moduaton cassfcaton for SK/QA, roc. ILCO, 999, pp [7] W. We and J.. ende, axmumehood cassfcaton for dgta amptudephase moduaton IEEE rans. Commun., 000,Vo. 48, pp [8] K.. Chugg, C. S. Long and A. oydorocombned ehood power estmaton and mutpe hypoess moduaton cassfcaton, roc. Asomar Conf., 996, pp [9] L. Hong and K. C. Ho, BSK and QSK moduaton cassfcaton w unnown sgna eve, roc. ILCO, 000, pp [0] L. Hong and K. C. Ho, Cassfcaton of BSK and QSK sgnas w unnown sgna eve usng e Bayes technque, roc. IEEE ISCAS, 003, pp. IV.I-IVA. [] A. E. E-ahdy and N.. Narnaz, Cassfcaton of mutpe -ary frequency-shft eyng sgnas over a Rayegh fadng channe, IEEE rans. Commun., Vo. 50, 00, pp [] D. S. Car, G. Hagedorn, B. Jame and C. er, III, Neura networ recognton of sgna moduaton type Artfca Neura Networs In Engneerng, 997, pp [3] A.K. Nand, E.E. Azzouz, Agorms for automatc moduaton recognton of communcaton sgna IEEE rans. Commun., Vo. 46, No. 4, 998, pp , 998. [4]. Rchterova, Sgna moduaton recognton based on meod of artfca neura networ roc. rogress In Eectromagnetc Research Symposum, 005, pp [5] B.G. obasser, Dgta moduaton cassfcaton usng consteaton shape, Sgna rocessng, Vo. 80, 000, pp [6]. Feng, L. Ge, Adaptve dbscan-based agorm for consteaton reconstructon and moduaton dentfcaton, roc. ICASS, 004, pp [7] A. O. Hero, and H. Hadnead-ehram, Dgta moduaton cassfcaton usng power moment matrce roc. ICASS, 998, pp [8] K.C. Ho, W. roopw and Y.. Chan, oduaton dentfcaton of dgta sgnas by waveet transform, roc. IEE,Radar, Sonar Navg., Vo.47, No.4, 000, pp [9] A. Swam, and B.. Sader, Herarchca dgta moduaton cassfcaton usng cumuant IEEE rans. Comm., Vo. 48, No. 3, pp , 000. [0] S. Z. Hsue, and S. S. Soman, Automatc moduaton cassfcaton usng Zero-Crossng, roc. IEE, Vo. 37, No. 6, 990, pp [] C. L.. Seher, Automatc moduaton recognton w a herarchca neura networ, roc. ILCO, pp. 5, 993. [] L. ngquan, X. Xanc, L. Lemng, Cycc spectra features based moduaton recognton, roc. Comm. ech., Vo., pp , 998. [3] A. Ebrahmzadeh, and S. A. Seyedn, Automatc ps moduaton dentfcaton usng wpa and mp, roc. CIS, 005, pp [4] Z. Yaqn, Automatc dgta moduaton recognton usng artfca neura networ roc. ICNNS, 003, pp [5] H. Yoshoa, A fast moduaton recognton technque usng nearest neghbor rues w optmzed reshod for moduaton cassfcaton n Rayegh fadng channe roc. WC, 00, pp [6] A. Ebrahmzadeh, and S. A. Seyedn, A prneura moduaton dentfcaton n fadng channe roc. CIS, 005, pp [7] J. G. roa Dgta Communcaton New Yor: cgraw-h, 00. [8] R. Johnson,. Schnter,. Endre J. Behm, D. Brown and R. Casa Bnd equazaton usng e Constant oduus crteron: A revew, roc. IEEE, Vo. 86, No. 0, 998, pp [9]. ccuagh, ensor eods n Statstc Chapman & Ha, 987. [30] C. Corte and V. Vapnc, Support vector networ, achne Learnng, Vo. 0, 995, pp.- 5. [3] C. Burge A tutora on support vector machnes for pattern recognton, Data nng and Knowedge Dscovery, Vo., 998, pp -67. [3] B. E. Boser, and V. Vapn, A tranng agorm for optma margn cassfer 5 AC, 996. [33]. Hoehor, A statstca dsceret-tme mode for e wssus mutpa channe, IEEE rans. Vehcuar ech., Vo. 4, No. 4, 99, pp [34] S. Chen, C. F. N. Cowan, and.. Grant, Orogona east squares earnng agorm for rada bass networ IEEE rans. Neura Networ Vo., 99, pp

A Novel Hierarchical Method for Digital Signal Type Classification

A Novel Hierarchical Method for Digital Signal Type Classification Proceedngs of the 6th WSEAS Internatona Conference on Apped Informatcs and Communcatons, Eounda, Greece, August 8-0, 006 (pp388-393) A Nove Herarchca Method for Dgta Sgna ype Cassfcaton AAOLLAH EBRAHIMZADEH,

More information

Example: Suppose we want to build a classifier that recognizes WebPages of graduate students.

Example: Suppose we want to build a classifier that recognizes WebPages of graduate students. Exampe: Suppose we want to bud a cassfer that recognzes WebPages of graduate students. How can we fnd tranng data? We can browse the web and coect a sampe of WebPages of graduate students of varous unverstes.

More information

Optimum Selection Combining for M-QAM on Fading Channels

Optimum Selection Combining for M-QAM on Fading Channels Optmum Seecton Combnng for M-QAM on Fadng Channes M. Surendra Raju, Ramesh Annavajjaa and A. Chockangam Insca Semconductors Inda Pvt. Ltd, Bangaore-56000, Inda Department of ECE, Unversty of Caforna, San

More information

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory Advanced Scence and Technoogy Letters Vo.83 (ISA 205), pp.60-65 http://dx.do.org/0.4257/ast.205.83.2 Research on Compex etworks Contro Based on Fuzzy Integra Sdng Theory Dongsheng Yang, Bngqng L, 2, He

More information

Image Classification Using EM And JE algorithms

Image Classification Using EM And JE algorithms Machne earnng project report Fa, 2 Xaojn Sh, jennfer@soe Image Cassfcaton Usng EM And JE agorthms Xaojn Sh Department of Computer Engneerng, Unversty of Caforna, Santa Cruz, CA, 9564 jennfer@soe.ucsc.edu

More information

Demodulation of PPM signal based on sequential Monte Carlo model

Demodulation of PPM signal based on sequential Monte Carlo model Internatona Journa of Computer Scence and Eectroncs Engneerng (IJCSEE) Voume 1, Issue 1 (213) ISSN 232 428 (Onne) Demoduaton of M sgna based on seuenta Monte Caro mode Lun Huang and G. E. Atkn Abstract

More information

MARKOV CHAIN AND HIDDEN MARKOV MODEL

MARKOV CHAIN AND HIDDEN MARKOV MODEL MARKOV CHAIN AND HIDDEN MARKOV MODEL JIAN ZHANG JIANZHAN@STAT.PURDUE.EDU Markov chan and hdden Markov mode are probaby the smpest modes whch can be used to mode sequenta data,.e. data sampes whch are not

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS A DIMESIO-REDUCTIO METHOD FOR STOCHASTIC AALYSIS SECOD-MOMET AALYSIS S. Rahman Department of Mechanca Engneerng and Center for Computer-Aded Desgn The Unversty of Iowa Iowa Cty, IA 52245 June 2003 OUTLIE

More information

Associative Memories

Associative Memories Assocatve Memores We consder now modes for unsupervsed earnng probems, caed auto-assocaton probems. Assocaton s the task of mappng patterns to patterns. In an assocatve memory the stmuus of an ncompete

More information

NONLINEAR SYSTEM IDENTIFICATION BASE ON FW-LSSVM

NONLINEAR SYSTEM IDENTIFICATION BASE ON FW-LSSVM Journa of heoretca and Apped Informaton echnoogy th February 3. Vo. 48 No. 5-3 JAI & LLS. A rghts reserved. ISSN: 99-8645 www.jatt.org E-ISSN: 87-395 NONLINEAR SYSEM IDENIFICAION BASE ON FW-LSSVM, XIANFANG

More information

Neural network-based athletics performance prediction optimization model applied research

Neural network-based athletics performance prediction optimization model applied research Avaabe onne www.jocpr.com Journa of Chemca and Pharmaceutca Research, 04, 6(6):8-5 Research Artce ISSN : 0975-784 CODEN(USA) : JCPRC5 Neura networ-based athetcs performance predcton optmzaton mode apped

More information

Nested case-control and case-cohort studies

Nested case-control and case-cohort studies Outne: Nested case-contro and case-cohort studes Ørnuf Borgan Department of Mathematcs Unversty of Oso NORBIS course Unversty of Oso 4-8 December 217 1 Radaton and breast cancer data Nested case contro

More information

WAVELET-BASED IMAGE COMPRESSION USING SUPPORT VECTOR MACHINE LEARNING AND ENCODING TECHNIQUES

WAVELET-BASED IMAGE COMPRESSION USING SUPPORT VECTOR MACHINE LEARNING AND ENCODING TECHNIQUES WAVELE-BASED IMAGE COMPRESSION USING SUPPOR VECOR MACHINE LEARNING AND ENCODING ECHNIQUES Rakb Ahmed Gppsand Schoo of Computng and Informaton echnoogy Monash Unversty, Gppsand Campus Austraa. Rakb.Ahmed@nfotech.monash.edu.au

More information

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory Proceedngs of the 2009 IEEE Internatona Conference on Systems Man and Cybernetcs San Antono TX USA - October 2009 Mutspectra Remote Sensng Image Cassfcaton Agorthm Based on Rough Set Theory Yng Wang Xaoyun

More information

Note 2. Ling fong Li. 1 Klein Gordon Equation Probablity interpretation Solutions to Klein-Gordon Equation... 2

Note 2. Ling fong Li. 1 Klein Gordon Equation Probablity interpretation Solutions to Klein-Gordon Equation... 2 Note 2 Lng fong L Contents Ken Gordon Equaton. Probabty nterpretaton......................................2 Soutons to Ken-Gordon Equaton............................... 2 2 Drac Equaton 3 2. Probabty nterpretaton.....................................

More information

Optimal and Suboptimal Linear Receivers for Time-Hopping Impulse Radio Systems

Optimal and Suboptimal Linear Receivers for Time-Hopping Impulse Radio Systems MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.mer.com Optma and Suboptma Lnear Recevers for Tme-Hoppng Impuse Rado Systems Snan Gezc Hsash Kbayash H. Vncent Poor Andreas F. Mosch TR2004-052 May

More information

3. Stress-strain relationships of a composite layer

3. Stress-strain relationships of a composite layer OM PO I O U P U N I V I Y O F W N ompostes ourse 8-9 Unversty of wente ng. &ech... tress-stran reatonshps of a composte ayer - Laurent Warnet & emo Aerman.. tress-stran reatonshps of a composte ayer Introducton

More information

Predicting Model of Traffic Volume Based on Grey-Markov

Predicting Model of Traffic Volume Based on Grey-Markov Vo. No. Modern Apped Scence Predctng Mode of Traffc Voume Based on Grey-Marov Ynpeng Zhang Zhengzhou Muncpa Engneerng Desgn & Research Insttute Zhengzhou 5005 Chna Abstract Grey-marov forecastng mode of

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks Shengyang Sun, Changyou Chen, Lawrence Carn Suppementary Matera: Learnng Structured Weght Uncertanty n Bayesan Neura Networks Shengyang Sun Changyou Chen Lawrence Carn Tsnghua Unversty Duke Unversty Duke

More information

Sparse Training Procedure for Kernel Neuron *

Sparse Training Procedure for Kernel Neuron * Sparse ranng Procedure for Kerne Neuron * Janhua XU, Xuegong ZHANG and Yanda LI Schoo of Mathematca and Computer Scence, Nanng Norma Unversty, Nanng 0097, Jangsu Provnce, Chna xuanhua@ema.nnu.edu.cn Department

More information

REAL-TIME IMPACT FORCE IDENTIFICATION OF CFRP LAMINATED PLATES USING SOUND WAVES

REAL-TIME IMPACT FORCE IDENTIFICATION OF CFRP LAMINATED PLATES USING SOUND WAVES 8 TH INTERNATIONAL CONERENCE ON COMPOSITE MATERIALS REAL-TIME IMPACT ORCE IDENTIICATION O CRP LAMINATED PLATES USING SOUND WAVES S. Atobe *, H. Kobayash, N. Hu 3 and H. ukunaga Department of Aerospace

More information

Short-Term Load Forecasting for Electric Power Systems Using the PSO-SVR and FCM Clustering Techniques

Short-Term Load Forecasting for Electric Power Systems Using the PSO-SVR and FCM Clustering Techniques Energes 20, 4, 73-84; do:0.3390/en40073 Artce OPEN ACCESS energes ISSN 996-073 www.mdp.com/journa/energes Short-Term Load Forecastng for Eectrc Power Systems Usng the PSO-SVR and FCM Custerng Technques

More information

Supervised Learning. Neural Networks and Back-Propagation Learning. Credit Assignment Problem. Feedforward Network. Adaptive System.

Supervised Learning. Neural Networks and Back-Propagation Learning. Credit Assignment Problem. Feedforward Network. Adaptive System. Part 7: Neura Networ & earnng /2/05 Superved earnng Neura Networ and Bac-Propagaton earnng Produce dered output for tranng nput Generaze reaonaby & appropratey to other nput Good exampe: pattern recognton

More information

Linear Classification, SVMs and Nearest Neighbors

Linear Classification, SVMs and Nearest Neighbors 1 CSE 473 Lecture 25 (Chapter 18) Lnear Classfcaton, SVMs and Nearest Neghbors CSE AI faculty + Chrs Bshop, Dan Klen, Stuart Russell, Andrew Moore Motvaton: Face Detecton How do we buld a classfer to dstngush

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

A General Column Generation Algorithm Applied to System Reliability Optimization Problems

A General Column Generation Algorithm Applied to System Reliability Optimization Problems A Genera Coumn Generaton Agorthm Apped to System Reabty Optmzaton Probems Lea Za, Davd W. Cot, Department of Industra and Systems Engneerng, Rutgers Unversty, Pscataway, J 08854, USA Abstract A genera

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

The University of Auckland, School of Engineering SCHOOL OF ENGINEERING REPORT 616 SUPPORT VECTOR MACHINES BASICS. written by.

The University of Auckland, School of Engineering SCHOOL OF ENGINEERING REPORT 616 SUPPORT VECTOR MACHINES BASICS. written by. The Unversty of Auckand, Schoo of Engneerng SCHOOL OF ENGINEERING REPORT 66 SUPPORT VECTOR MACHINES BASICS wrtten by Vojsav Kecman Schoo of Engneerng The Unversty of Auckand Apr, 004 Vojsav Kecman Copyrght,

More information

An Improved multiple fractal algorithm

An Improved multiple fractal algorithm Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton

More information

Application of support vector machine in health monitoring of plate structures

Application of support vector machine in health monitoring of plate structures Appcaton of support vector machne n heath montorng of pate structures *Satsh Satpa 1), Yogesh Khandare ), Sauvk Banerjee 3) and Anrban Guha 4) 1), ), 4) Department of Mechanca Engneerng, Indan Insttute

More information

Sensitivity Analysis Using Neural Network for Estimating Aircraft Stability and Control Derivatives

Sensitivity Analysis Using Neural Network for Estimating Aircraft Stability and Control Derivatives Internatona Conference on Integent and Advanced Systems 27 Senstvty Anayss Usng Neura Networ for Estmatng Arcraft Stabty and Contro Dervatves Roht Garhwa a, Abhshe Hader b and Dr. Manoranan Snha c Department

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

The Entire Solution Path for Support Vector Machine in Positive and Unlabeled Classification 1

The Entire Solution Path for Support Vector Machine in Positive and Unlabeled Classification 1 Abstract The Entre Souton Path for Support Vector Machne n Postve and Unabeed Cassfcaton 1 Yao Lmn, Tang Je, and L Juanz Department of Computer Scence, Tsnghua Unversty 1-308, FIT, Tsnghua Unversty, Bejng,

More information

Correspondence. Performance Evaluation for MAP State Estimate Fusion I. INTRODUCTION

Correspondence. Performance Evaluation for MAP State Estimate Fusion I. INTRODUCTION Correspondence Performance Evauaton for MAP State Estmate Fuson Ths paper presents a quanttatve performance evauaton method for the maxmum a posteror (MAP) state estmate fuson agorthm. Under dea condtons

More information

Performance of SDMA Systems Using Transmitter Preprocessing Based on Noisy Feedback of Vector-Quantized Channel Impulse Responses

Performance of SDMA Systems Using Transmitter Preprocessing Based on Noisy Feedback of Vector-Quantized Channel Impulse Responses Performance of SDMA Systems Usng Transmtter Preprocessng Based on Nosy Feedback of Vector-Quantzed Channe Impuse Responses Du Yang, Le-Lang Yang and Lajos Hanzo Schoo of ECS, Unversty of Southampton, SO7

More information

GENERATION OF GOLD-SEQUENCES WITH APPLICATIONS TO SPREAD SPECTRUM SYSTEMS

GENERATION OF GOLD-SEQUENCES WITH APPLICATIONS TO SPREAD SPECTRUM SYSTEMS GENERATION OF GOLD-SEQUENCES WITH APPLICATIONS TO SPREAD SPECTRUM SYSTEMS F. Rodríguez Henríquez (1), Member, IEEE, N. Cruz Cortés (1), Member, IEEE, J.M. Rocha-Pérez (2) Member, IEEE. F. Amaro Sánchez

More information

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING 1 ADVANCED ACHINE LEARNING ADVANCED ACHINE LEARNING Non-lnear regresson technques 2 ADVANCED ACHINE LEARNING Regresson: Prncple N ap N-dm. nput x to a contnuous output y. Learn a functon of the type: N

More information

On Uplink-Downlink Sum-MSE Duality of Multi-hop MIMO Relay Channel

On Uplink-Downlink Sum-MSE Duality of Multi-hop MIMO Relay Channel On Upn-Downn Sum-MSE Duat of Mut-hop MIMO Rea Channe A Cagata Cr, Muhammad R. A. handaer, Yue Rong and Yngbo ua Department of Eectrca Engneerng, Unverst of Caforna Rversde, Rversde, CA, 95 Centre for Wreess

More information

9 Adaptive Soft K-Nearest-Neighbour Classifiers with Large Margin

9 Adaptive Soft K-Nearest-Neighbour Classifiers with Large Margin 9 Adaptve Soft -Nearest-Neghbour Cassfers wth Large argn Abstract- A nove cassfer s ntroduced to overcome the mtatons of the -NN cassfcaton systems. It estmates the posteror cass probabtes usng a oca Parzen

More information

GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION. Machine Learning

GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION. Machine Learning CHAPTER 3 GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION Machne Learnng Copyrght c 205. Tom M. Mtche. A rghts reserved. *DRAFT OF September 23, 207* *PLEASE DO NOT DISTRIBUTE

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Delay tomography for large scale networks

Delay tomography for large scale networks Deay tomography for arge scae networks MENG-FU SHIH ALFRED O. HERO III Communcatons and Sgna Processng Laboratory Eectrca Engneerng and Computer Scence Department Unversty of Mchgan, 30 Bea. Ave., Ann

More information

Downlink Power Allocation for CoMP-NOMA in Multi-Cell Networks

Downlink Power Allocation for CoMP-NOMA in Multi-Cell Networks Downn Power Aocaton for CoMP-NOMA n Mut-Ce Networs Md Shpon A, Eram Hossan, Arafat A-Dwe, and Dong In Km arxv:80.0498v [eess.sp] 6 Dec 207 Abstract Ths wor consders the probem of dynamc power aocaton n

More information

Optimization of JK Flip Flop Layout with Minimal Average Power of Consumption based on ACOR, Fuzzy-ACOR, GA, and Fuzzy-GA

Optimization of JK Flip Flop Layout with Minimal Average Power of Consumption based on ACOR, Fuzzy-ACOR, GA, and Fuzzy-GA Journa of mathematcs and computer Scence 4 (05) - 5 Optmzaton of JK Fp Fop Layout wth Mnma Average Power of Consumpton based on ACOR, Fuzzy-ACOR, GA, and Fuzzy-GA Farshd Kevanan *,, A Yekta *,, Nasser

More information

Natural Language Processing and Information Retrieval

Natural Language Processing and Information Retrieval Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support

More information

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION European Journa of Mathematcs and Computer Scence Vo. No. 1, 2017 ON AUTOMATC CONTNUTY OF DERVATONS FOR BANACH ALGEBRAS WTH NVOLUTON Mohamed BELAM & Youssef T DL MATC Laboratory Hassan Unversty MORO CCO

More information

Chapter 6 Hidden Markov Models. Chaochun Wei Spring 2018

Chapter 6 Hidden Markov Models. Chaochun Wei Spring 2018 896 920 987 2006 Chapter 6 Hdden Markov Modes Chaochun We Sprng 208 Contents Readng materas Introducton to Hdden Markov Mode Markov chans Hdden Markov Modes Parameter estmaton for HMMs 2 Readng Rabner,

More information

CS 3710: Visual Recognition Classification and Detection. Adriana Kovashka Department of Computer Science January 13, 2015

CS 3710: Visual Recognition Classification and Detection. Adriana Kovashka Department of Computer Science January 13, 2015 CS 3710: Vsual Recognton Classfcaton and Detecton Adrana Kovashka Department of Computer Scence January 13, 2015 Plan for Today Vsual recognton bascs part 2: Classfcaton and detecton Adrana s research

More information

Polite Water-filling for Weighted Sum-rate Maximization in MIMO B-MAC Networks under. Multiple Linear Constraints

Polite Water-filling for Weighted Sum-rate Maximization in MIMO B-MAC Networks under. Multiple Linear Constraints 2011 IEEE Internatona Symposum on Informaton Theory Proceedngs Pote Water-fng for Weghted Sum-rate Maxmzaton n MIMO B-MAC Networks under Mutpe near Constrants An u 1, Youjan u 2, Vncent K. N. au 3, Hage

More information

A finite difference method for heat equation in the unbounded domain

A finite difference method for heat equation in the unbounded domain Internatona Conerence on Advanced ectronc Scence and Technoogy (AST 6) A nte derence method or heat equaton n the unbounded doman a Quan Zheng and Xn Zhao Coege o Scence North Chna nversty o Technoogy

More information

Diversity Combining of Signals with Different Modulation Levels in Cooperative Relay Networks 1

Diversity Combining of Signals with Different Modulation Levels in Cooperative Relay Networks 1 Dversty Combnng of gnas wth Dfferent oduaton Leves n Cooperatve Reay Networks Akram Bn edq and Ham Yankomerogu Broadband Communcatons and Wreess ystems BCW Centre Department of ystems and Computer Engneerng

More information

Characterizing Probability-based Uniform Sampling for Surrogate Modeling

Characterizing Probability-based Uniform Sampling for Surrogate Modeling th Word Congress on Structura and Mutdscpnary Optmzaton May 9-4, 3, Orando, Forda, USA Characterzng Probabty-based Unform Sampng for Surrogate Modeng Junqang Zhang, Souma Chowdhury, Ache Messac 3 Syracuse

More information

On the Equality of Kernel AdaTron and Sequential Minimal Optimization in Classification and Regression Tasks and Alike Algorithms for Kernel

On the Equality of Kernel AdaTron and Sequential Minimal Optimization in Classification and Regression Tasks and Alike Algorithms for Kernel Proceedngs of th European Symposum on Artfca Neura Networks, pp. 25-222, ESANN 2003, Bruges, Begum, 2003 On the Equaty of Kerne AdaTron and Sequenta Mnma Optmzaton n Cassfcaton and Regresson Tasks and

More information

IDENTIFICATION OF NONLINEAR SYSTEM VIA SVR OPTIMIZED BY PARTICLE SWARM ALGORITHM

IDENTIFICATION OF NONLINEAR SYSTEM VIA SVR OPTIMIZED BY PARTICLE SWARM ALGORITHM Journa of Theoretca and Apped Informaton Technoogy th February 3. Vo. 48 No. 5-3 JATIT & LLS. A rghts reserved. ISSN: 99-8645 www.att.org E-ISSN: 87-395 IDENTIFICATION OF NONLINEAR SYSTEM VIA SVR OPTIMIZED

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Cyclic Codes BCH Codes

Cyclic Codes BCH Codes Cycc Codes BCH Codes Gaos Feds GF m A Gaos fed of m eements can be obtaned usng the symbos 0,, á, and the eements beng 0,, á, á, á 3 m,... so that fed F* s cosed under mutpcaton wth m eements. The operator

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder. PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n

More information

Interference Alignment and Degrees of Freedom Region of Cellular Sigma Channel

Interference Alignment and Degrees of Freedom Region of Cellular Sigma Channel 2011 IEEE Internatona Symposum on Informaton Theory Proceedngs Interference Agnment and Degrees of Freedom Regon of Ceuar Sgma Channe Huaru Yn 1 Le Ke 2 Zhengdao Wang 2 1 WINLAB Dept of EEIS Unv. of Sc.

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

DISTRIBUTED PROCESSING OVER ADAPTIVE NETWORKS. Cassio G. Lopes and Ali H. Sayed

DISTRIBUTED PROCESSING OVER ADAPTIVE NETWORKS. Cassio G. Lopes and Ali H. Sayed DISTRIBUTED PROCESSIG OVER ADAPTIVE ETWORKS Casso G Lopes and A H Sayed Department of Eectrca Engneerng Unversty of Caforna Los Angees, CA, 995 Ema: {casso, sayed@eeucaedu ABSTRACT Dstrbuted adaptve agorthms

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Support Vector Machines

Support Vector Machines Separatng boundary, defned by w Support Vector Machnes CISC 5800 Professor Danel Leeds Separatng hyperplane splts class 0 and class 1 Plane s defned by lne w perpendcular to plan Is data pont x n class

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Evaluation of classifiers MLPs

Evaluation of classifiers MLPs Lecture Evaluaton of classfers MLPs Mlos Hausrecht mlos@cs.ptt.edu 539 Sennott Square Evaluaton For any data set e use to test the model e can buld a confuson matrx: Counts of examples th: class label

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Optimal Guaranteed Cost Control of Linear Uncertain Systems with Input Constraints

Optimal Guaranteed Cost Control of Linear Uncertain Systems with Input Constraints Internatona Journa Optma of Contro, Guaranteed Automaton, Cost Contro and Systems, of Lnear vo Uncertan 3, no Systems 3, pp 397-4, wth Input September Constrants 5 397 Optma Guaranteed Cost Contro of Lnear

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

On the Power Function of the Likelihood Ratio Test for MANOVA

On the Power Function of the Likelihood Ratio Test for MANOVA Journa of Mutvarate Anayss 8, 416 41 (00) do:10.1006/jmva.001.036 On the Power Functon of the Lkehood Rato Test for MANOVA Dua Kumar Bhaumk Unversty of South Aabama and Unversty of Inos at Chcago and Sanat

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

The Application of BP Neural Network principal component analysis in the Forecasting the Road Traffic Accident

The Application of BP Neural Network principal component analysis in the Forecasting the Road Traffic Accident ICTCT Extra Workshop, Bejng Proceedngs The Appcaton of BP Neura Network prncpa component anayss n Forecastng Road Traffc Accdent He Mng, GuoXucheng &LuGuangmng Transportaton Coege of Souast Unversty 07

More information

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton

More information

COXREG. Estimation (1)

COXREG. Estimation (1) COXREG Cox (972) frst suggested the modes n whch factors reated to fetme have a mutpcatve effect on the hazard functon. These modes are caed proportona hazards (PH) modes. Under the proportona hazards

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Support Vector Machines

Support Vector Machines /14/018 Separatng boundary, defned by w Support Vector Machnes CISC 5800 Professor Danel Leeds Separatng hyperplane splts class 0 and class 1 Plane s defned by lne w perpendcular to plan Is data pont x

More information

Differentiating Gaussian Processes

Differentiating Gaussian Processes Dfferentatng Gaussan Processes Andrew McHutchon Aprl 17, 013 1 Frst Order Dervatve of the Posteror Mean The posteror mean of a GP s gven by, f = x, X KX, X 1 y x, X α 1 Only the x, X term depends on the

More information

Probability Density Function Estimation by different Methods

Probability Density Function Estimation by different Methods EEE 739Q SPRIG 00 COURSE ASSIGMET REPORT Probablty Densty Functon Estmaton by dfferent Methods Vas Chandraant Rayar Abstract The am of the assgnment was to estmate the probablty densty functon (PDF of

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

we have E Y x t ( ( xl)) 1 ( xl), e a in I( Λ ) are as follows:

we have E Y x t ( ( xl)) 1 ( xl), e a in I( Λ ) are as follows: APPENDICES Aendx : the roof of Equaton (6 For j m n we have Smary from Equaton ( note that j '( ( ( j E Y x t ( ( x ( x a V ( ( x a ( ( x ( x b V ( ( x b V x e d ( abx ( ( x e a a bx ( x xe b a bx By usng

More information

Development of whole CORe Thermal Hydraulic analysis code CORTH Pan JunJie, Tang QiFen, Chai XiaoMing, Lu Wei, Liu Dong

Development of whole CORe Thermal Hydraulic analysis code CORTH Pan JunJie, Tang QiFen, Chai XiaoMing, Lu Wei, Liu Dong Deveopment of whoe CORe Therma Hydrauc anayss code CORTH Pan JunJe, Tang QFen, Cha XaoMng, Lu We, Lu Dong cence and technoogy on reactor system desgn technoogy, Nucear Power Insttute of Chna, Chengdu,

More information

Chapter 6. Rotations and Tensors

Chapter 6. Rotations and Tensors Vector Spaces n Physcs 8/6/5 Chapter 6. Rotatons and ensors here s a speca knd of near transformaton whch s used to transforms coordnates from one set of axes to another set of axes (wth the same orgn).

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

The line method combined with spectral chebyshev for space-time fractional diffusion equation

The line method combined with spectral chebyshev for space-time fractional diffusion equation Apped and Computatona Mathematcs 014; 3(6): 330-336 Pubshed onne December 31, 014 (http://www.scencepubshnggroup.com/j/acm) do: 10.1164/j.acm.0140306.17 ISS: 3-5605 (Prnt); ISS: 3-5613 (Onne) The ne method

More information

[WAVES] 1. Waves and wave forces. Definition of waves

[WAVES] 1. Waves and wave forces. Definition of waves 1. Waves and forces Defnton of s In the smuatons on ong-crested s are consdered. The drecton of these s (μ) s defned as sketched beow n the goba co-ordnate sstem: North West East South The eevaton can

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

Application of Particle Swarm Optimization to Economic Dispatch Problem: Advantages and Disadvantages

Application of Particle Swarm Optimization to Economic Dispatch Problem: Advantages and Disadvantages Appcaton of Partce Swarm Optmzaton to Economc Dspatch Probem: Advantages and Dsadvantages Kwang Y. Lee, Feow, IEEE, and Jong-Bae Par, Member, IEEE Abstract--Ths paper summarzes the state-of-art partce

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

Research Article H Estimates for Discrete-Time Markovian Jump Linear Systems

Research Article H Estimates for Discrete-Time Markovian Jump Linear Systems Mathematca Probems n Engneerng Voume 213 Artce ID 945342 7 pages http://dxdoorg/11155/213/945342 Research Artce H Estmates for Dscrete-Tme Markovan Jump Lnear Systems Marco H Terra 1 Gdson Jesus 2 and

More information

Adaptive Beamforming in Multi path fading Channels for Voice Enhancements

Adaptive Beamforming in Multi path fading Channels for Voice Enhancements Adaptve Beamformng n ut path fadng Channes for Voce Enhancements usnan Abbas Internatona Isamc Unversty Isamabad Waqas Ahmed Internatona Isamc Unversty Isamabad Shehzad Ashraf Internatona Isamc Unversty

More information

Andre Schneider P622

Andre Schneider P622 Andre Schneder P6 Probem Set #0 March, 00 Srednc 7. Suppose that we have a theory wth Negectng the hgher order terms, show that Souton Knowng β(α and γ m (α we can wrte β(α =b α O(α 3 (. γ m (α =c α O(α

More information