REPORT DOCUMENTATION PAGE

Size: px
Start display at page:

Download "REPORT DOCUMENTATION PAGE"

Transcription

1 REPOR DOCUMEAIO PAGE Frm Apprved OMB Public reprting burden fr this cllectin f infrmatin is estimated t average 1 hur per respnse, including the time fr reviewing instructins, searching data surces, gathering and maintaining the data needed, and cmpleting and reviewing the cllectin f infrmatin. Send cmments regarding this burden estimate r any ther aspect f this cllectin f infrmatin, including suggestins fr reducing this burden t Washingtn Headquarters Service, Directrate fr Infrmatin Operatins and Reprts, 115 Jeffersn Davis Highway, Suite 104, Arlingtn, VA 0-430, and t the Office f Management and Budget, Paperwr Reductin Prject ( ) Washingtn, DC PLEASE DO O REUR YOUR FORM O HE ABOVE ADDRESS. 1. REPOR DAE (DD-MM-YYYY) APR ILE AD SUBILE. REPOR YPE Cnference Paper Pstprint CURVAURE OLIEARIY MEASURE AD FILER DIVERGECE DEECOR FOR OLIEAR RACKIG PROBLEMS 3. DAES COVERED (Frm - ) Jun 08 Jul 08 5a. CORAC UMBER In-Huse 5b. GRA UMBER 5c. PROGRAM ELEME UMBER 670F 6. AUHOR(S) Ruixin iu, Pramd K. Varshney, Mar Alfrd, Adnan Bubal, Eric Jnes and Maria Scal 5d. PROJEC UMBER 5e. ASK UMBER 459E E 5f. WORK UI UMBER 7. PERFORMIG ORGAIZAIO AME(S) AD ADDRESS(ES) AFRL/RIEA 55 Brs Rad Rme Y SPOSORIG/MOIORIG AGECY AME(S) AD ADDRESS(ES) AFRL/RIEA 55 Brs Rad Rme Y PERFORMIG ORGAIZAIO REPOR UMBER 10. SPOSOR/MOIOR'S ACROYM(S) 11. SPOSORIG/MOIORIG AGECY REPOR UMBER AFRL-RI-RS-P DISRIBUIO AVAILABILIY SAEME Apprved fr Public Release; Distributin Unlimited. PA# WPAFB SUPPLEMEARY OES Paper presented at the Infrmatin Fusin 008 Internatinal Cnference, Jun 30-Jul 3 in Clgne, Germany. One r mre f the authrs is a U.S. Gvernment emplyee wring within the scpe f their Gvernment jb; therefre, the U.S. Gvernment is jint wner f the wr and has the right t cpy, distribute and use the wr. 14. ABSRAC Experimental results shw that fr a weely nnlinear tracing prblem, the extended Kalman filter and the unscented Kalman filter are gd chices, while a particle filter shuld be used fr prblems with strng nnlinearity. quantitatively determine the nnlinearity f a nnlinear tracing prblem, we prpse tw types f measures: ne is the differential gemetry curvature measure and the ther is based n the nrmalied innvatin squared (IS) f the Kalman filter. Simulatin results shw that bth measures can effectively quantify the nnlinearity f the prblem. he IS is capable f detecting the filter divergence nline. he curvature measure is mre suitable fr quantifying the nnlinearity f a tracing prblem as determined via simulatins. 15. SUBJEC ERMS racing, extended Kalman filter, unscented Kalman filter, particle filter, nnlinearity measures 16. SECURIY CLASSIFICAIO OF: 17. LIMIAIO OF ABSRAC a. REPOR U b. ABSRAC U c. HIS PAGE U UU 18. UMBER OF PAGES 9 19a. AME OF RESPOSIBLE PERSO Mar Alfrd 19b. ELEPOE UMBER (Include area cde) /A Standard Frm 98 (Rev. 8-98) Prescribed by ASI-Std Z39-18

2 Curvature nlinearity Measure and Filter Divergence Detectr fr nlinear racing Prblems Ruixin iu and Pramd K. Varshney Depart. f Electrical Engineering & Cmputer Science Syracuse University Syracuse, ew Yr, 1344, U.S.A. rniu@ecs.syr.edu Abstract Several nnlinear filtering techniques are investigated fr nnlinear tracing prblems. Experimental results shw that fr a wealy nnlinear tracing prblem, the extended Kalman filter and the unscented Kalman filter are gd chices, while a particle filter shuld be used fr prblems with strng nnlinearity. quantitatively determine the nnlinearity f a nnlinear tracing prblem, we prpse tw types f measures: ne is the differential gemetry curvature measure and the ther is based n the nrmalied innvatin squared (IS) f the Kalman filter. Simulatin results shw that bth measures can effectively quantify the nnlinearity f the prblem. he IS is capable f detecting the filter divergence nline. he curvature measure is mre suitable fr quantifying the nnlinearity f a tracing prblem as determined via simulatins. Keywrds: racing, extended Kalman filter, unscented Kalman filter, particle filter, nnlinearity measures. 1 Intrductin Fr nnlinear target tracing prblems with nnlinear dynamics r nnlinear measurements, there exist many nnlinear filtering techniques. A cmprehensive tutrial f these nnlinear techniques is given in [1]. In this paper, we investigate several f the mst ppular nnlinear filtering techniques, including the extended Kalman filter (EKF) [], the unscented Kalman filter (UKF) [3] and the particle filter (PF) [4-5]. Being parametric filtering methds based n the classical Kalman filter framewr, the EKF and the UKF incur nly a mdest amunt f cmputatinal cst and lead t near-ptimal perfrmances in prblems with wea nnlinearity. Hwever, in many highly nnlinear prblems, the EKF r the UKF may diverge, as shwn later in this paper. he PF, a simulatin-based nnparametric algrithm, has better perfrmances than the EKF and the UKF in these difficult highly nnlinear cases. But its implementatin requires a significantly larger amunt f cmputatin. Cnsidering the advantages and disadvantages f these filters, naturally we can emply different filtering Mar Alfrd, Adnan Bubal, Eric Jnes, and Maria Scal Air Frce Research Labratry/RIEA Rme, ew Yr 13441, U.S.A Mar.Alfrd@rl.af.mil algrithms fr prblems with different degrees f nnlinearity. In this paper, we study tw types f nnlinearity measures t quantitatively determine the nnlinearity f a nnlinear prblem. he first measure is based n the curvature measure [6], which cmpares the magnitude f the secnd-rder term with that f the firstrder term in a aylr series expansin f the nnlinear prblem. Recently, the curvature measures have been adpted in indicating the nnlinearity fr trajectry estimatin prblems [7-9]. Here, we use them t determine the nnlinearity in the tracing prblem. We als prpse the nrmalied innvatin squared (IS) [] f the Kalman filter, as a measure f nnlinearity and f filter divergence. In Sectin, a brief intrductin t the three nnlinear tracing algrithms is prvided. racing examples with strng and wea nnlinearities t illustrate the necessity f nnlinearity measures are presented in Sectin 3. he curvature nnlinearity measure and the divergence detectr based n Kalman filter s innvatin are prpsed in Sectin 4. here, the effectiveness f these tw measures is verified by simulatin results. Cnclusins are drawn in Sectin 5. nlinear filtering techniques Fr a target tracing prblem with nnlinear target mtin mdel and/r nnlinear measurements, ne f the mst ppular filtering techniques is the EKF, which is a minimum mean square errr (MMSE) estimatr based n the aylr series expansin f the nnlinear dynamics r the nnlinear measurement []. It is very easy t implement and requires nly mdest amunt f cmputatinal pwer. In the first-rder EKF the state distributin is apprximated by a Gaussian randm variable which is then prpagated analytically thrugh the first-rder lineariatin f the nnlinear system r nnlinear measurement. herefre, it can be viewed as prviding ``first-rder'' apprximatins t the ptimal terms. hese apprximatins, hwever, can intrduce large errrs in the true psterir mean and cvariance f the nnlinearly 1

3 transfrmed (Gaussian) randm variable, which may lead t sub-ptimal perfrmance and smetimes divergence f the filter, especially in strngly nnlinear estimatin prblems. he UKF addresses sme apprximatin issues f the first-rder EKF. In a UKF, he state distributin is again represented by a Gaussian randm variable, but is nw specified using a minimal set f carefully chsen sample pints. hese sample pints cmpletely capture the true mean and cvariance f the Gaussian randm variable, and when prpagated thrugh the true nn-linear system, capture the psterir mean and cvariance accurately t the 3rd rder (aylr series expansin). Fr details and the implementatin f the UKF, the readers are referred t [3]. Anther very ppular strategy fr estimating the state f a nnlinear system as a set f bservatins becmes available nline is t use sequential Mnte-Carl methds, als nwn as the particle filter (PF). hese methds allw fr a cmplete representatin f the psterir prbability density functin (pdf) f the states, s that any statistical estimates, such as the mean, mde, variance and urtsis can be easily cmputed. hey can, therefre, deal with any nnlinearity r prbability distributins [5]. he basic idea f the particle filter begins with using a set f particles and their assciated weights t apprximate the state psterir pdf. hese particles are prpagated frm ne time t the next accrding t the target mtin mdel, and their weights are updated based n the incming measurements. It has been shwn in [5] that under mild cnditins, the apprximatin f the density functin cnverges t the true psterir state prbability density functin almst surely as the number f particles ges t infinity. In this paper, we adpt a very simple and ppular versin f the PF, the sequential imprtance resampling (SIR) particle filtering algrithm [5]. 3 Mtivating examples F = in which is the time interval between tw adjacent samples. v dentes the er-mean white Gaussian nise with cvariance matrix Q 3 /3 / 0 0 / 0 0 Q = q /3 / 0 0 / where q is a scalar. Fr a radar that reprts range-bearing measurements, the measurement mdel can be mathematically written as where = h( x ) + w (4) is the radar measurement, ( ξ ξs) + ( η η s) hx ( ) = 1 tan [( η ηs) /( ξ ξs) ] ( ξ, η ) is the target psitin at time, and ( ξs, η s ) is the psitin f the radar. w dentes the measurement nise, which is Gaussian with er mean and cvariance matrix R. As we can see, the mtin mdel is linear and Gaussian. But the measurements are nnlinear functins f the target state. () (5) (3) te that fr the EKF, Jacbian f measurement is given by 3.1 arget and measurement mdels We assume that the target mtin is mdeled as fllws x = Fx + v 1 (1) J ξ η 0 0 ξ + η ξ + η = ηj ξj 0 0 ξ + η ξ + η (6) where x = [ ξξηη & & ]' is the target state at time, cnsisting f psitins and velcities alng ξ and η axes in a tw-dimensinal Cartesian crdinate system. F is the state transitin matrix where ξ = ξ 1 ξ and s η = η 1 η. s 3. A single radar with strng nnlinearity In this experiment, we assume that there is a single radar sensr that is tracing the target. An example fr the target trajectry has been shwn in Fig. 1. First, we investigate a case with highly nnlinear measurements. We assume that the range measurements

4 are very accurate, with a range errr standard deviatin (s.d.) f 10 m, and the bearing measurements are relatively carse, with a bearing errr s.d. f 3. Given the gemetry in Fig. 1, it can be shwn that the uncertainty regin f the target psitin based n the range and the bearing measurements is part f a thin ring with its span prprtinal t the s.d. f the bearing measurement. 4 able I. te that in the PF, 10 particles have been used. As we can see, the cmputatinal csts fr the PF are much higher than thse f the EKF and the UKF. able I. Average number f flating pint peratins per iteratin fr different algrithms EKF UKF PF Fig. 1 Gemetry f the target trajectry and the radar sensr. 4 In the experiment, the PF uses 10 particles. he rt mean square errrs (RMSEs) are btained by taing an average ver 100 Mnte-Carl simulatin runs. In Fig., the RMSEs f psitin estimates are shwn. Since the RMSEs f velcity estimates exhibit similar behavirs t thse f psitin estimates, they are nt shwn t save space. Frm Fig., it is clear that the EKF s averaged RMSEs are much higher than thse f the ther tw algrithms. his is because in sme Mnte-Carl runs, the EKF diverges. Since an unscented transfrm has been used in the UKF, the UKF prvides significant imprvement ver the EKF. he PF utperfrms the UKF, at the cst f much mre cmputatinal cmplexity. 3.3 A single radar with wea nnlinearity Secnd, we investigate a case with less nnlinearity in the measurements. We assume that the range measurement errr has a s.d. f 100 m, and the bearing measurement errr has a s.d. f 1. As shwn in Fig. 3, all the three algrithms have perfrmances clse t each ther. his implies that fr a recursive estimatin prblem with wea nnlinearity, the EKF r the UKF shuld be used t save the cmputatinal cst, while at the same time t achieve the same perfrmances as that f the PF. 3.4 Cmputatinal cmplexities quantitatively cmpare the cmplexities f different algrithms, the average number f flating pint peratins per iteratin fr each algrithm is listed in Fig. RMSEs in psitin estimates by different tracing algrithms. riangle: EKF. Square: UKF. Circle: PF. Fig. 3 RMSEs in psitin estimates by different tracing algrithms. riangle: EKF. Square: UKF. Circle: PF. 4 nlinearity measures Frm the examples in the last sectin, we can see that under different circumstances, it is desirable t apply different filtering algrithms. Fr a tracing prblem with 3

5 wea nnlinearity, the EKF and the UKF are gd chices, since they prvide near-ptimal tracing perfrmances, while at the same time have much less cmputatin cmplexity than the PF. Hwever, in a highly nnlinear prblem, the PF shuld be used, since the EKF and the UKF are prne t divergence in such a prblem. As a result, it is imprtant t develp a metric t gauge the nnlinearity f the estimatin prblem. Fr the tracing prblem with linear dynamic mdel and nnlinear measurement mdel, the nnlinearity is brught by the nnlinear measurements. We prpse the parametereffects curvature and intrinsic curvature, similar t thse used in [7], t measure the nnlinearity in the measurements. Hwever, we als bserve that the curvature measures can nt prvide a direct and timely indicatin f the divergence f the EKF r the UKF. detect the divergence f a filter in a timely manner, we als develp a Chi-square detectr based n the innvatin f the Kalman filter, which checs the cnsistency f the filter, and detects the filter divergence when it ccurs. 4.1 Curvature nnlinearity measures We try t measure the nnlinearity in the measurements using curvature measures [6], as prpsed in [7]. In [7], the measures have been used in trajectry estimatin prblems. Here we apply them fr measuring and detecting the nnlinearity in target tracing prblems. he nnlinear measurement mdel (4) can be rewritten as = h( p) + w (7) where p = [ξ η ]' is the target s crdinates at time, since is nt a functin f the target s velcity at time. In a EKF, the nnlinear measurement is apprximated by the first rder aylr series expansin f hp ( ) abut the predicted target psitin : where p hp ( ) hp ( ) + H& ( p )( p p ) (8) hp ( ) H & n np ( p ) =, H & ( p ) R (9) 1 1 p p= p 1 where n and n p are the dimensins f the measurement and the target psitin, respectively. he first-rder EKF uses the linear apprximatin by ignring the higher rder terms in the aylr series expansin. he linear apprximatin in the EKF is valid nly if the measurement functin is relatively flat near p and the hence the tangent plane apprximatin in (8) is valid. aing the aylr series expansin f (7) up t the secnd rder, we have hp ( ) hp ( 1 ) + H& ( p 1 )( p p 1 + ( p p )' H&& ( p 1 )( p p where h ( p) ( p ) =, H( p ) R m && mij 1 1 pi p j p= p 1 n np np (10) m = 1, L, n, i, j = 1, L, np Accrding t the linear apprximatin (8), hp ( ) lies in the plane tangent t the measurement surface at the pint p. herefre, the lineariatin in the measurement mdel is equivalent t apprximating the measurement surface by the tangent plane at p. he tangent plane is a gd apprximatin t the measurement surface if the nrm f the quadratic term ( p p )' H&& ( p 1 )( p p is negligible cmpared with the nrm f the linear term H& ( p 1 )( p p. It is useful t decmpse the quadratic term n the right hand side f (10) int cmpnents in the tangent plane and rthgnal t the tangent plane., (11) In rder t define the curvature measures f nnlinearity, velcity vectrs and acceleratin vectrs [6] are intrduced, which frm the Jacbian and Hessian, respectively. he n 1 velcity vectrs are defined by h1( p ) h ( p ) h& n ( i p = L (1) pi p p= p i 1 p= p 1 i = 1,, Ln p and H& ( p = h& 1 ( p 1 ) L h& n ( p ) (13) p he n 1 symmetric acceleratin vectrs are defined by hp ( ) ( p ) =, h ( p ) R && ij 1 ij 1 pi p j p= p 1 i, j = 1, L, n p n 1 (14) he acceleratin vectrs are decmpsed int cmpnents in the tangent plane and rthgnal t the tangent plane. Let H&& np np m( p ) R dente the mth face f the acceleratin array 4

6 m11 ( p L m1 n ( p ) p H&& ( p m = L L L mn 1 ( p ) h ( p ) p L && mnpnp m= 1,, Ln ( 15) he prjectin matrix P which prjects an n 1 vectr int the tangent plane is defined by 1 P (16) = H& ( p 1 ) H& '( p ) H& ( p 1 ) H& '( p 1) herefre, we can decmpse an acceleratin vectr int cmpnents tangent and rthgnal t the tangent plane. Let h && ( ij p 1) and ( p ) dente the tangential and ij 1 rthgnal cmpnents f the acceleratin vectr ( p ), respectively. hen ij 1 ( p ) = P ( p ) p I P h p ( p ) ( p ) ( p ) ij 1 ij 1 ij ( 1 ) = ( )&& ij( ij 1 = ij 1 + ij 1 (17) f r i, j = 1, L, n. Use f (17) fr the quadratic term in p (10) gives ' Hp ( ) ' H && ( = && p 1 ) + ' H&& ( p (18) where = p p (19) Bates and Watts [6] define the parameter-effects curvature K and intrinsic curvature K as tw measures f nnlinearity, which cmpare the quadratic term with the linear term in the directin f the vectr in the parameter space. hese tw curvature measures are defined as 4. K K ' H&& ( p = Hp & ( ' H&& ( p = Hp & ( ) 1 Chi-square detectr based n innvatin (0) (1) chec if the EKF r UKF diverges, a very effective way is t calculate the nrmalied innvatin squared (IS) [] f the EKF r UKF and cmpare it with a threshld. he IS is defined as 1 IS = [ h( x )]' S [ h( x )] () 1 1 where h( x ) is the innvatin f the EKF r the UKF, and S = J P J + R (3) 1 ' is the cvariance matrix f the innvatin, which is prvided by the filter. When the linear and Gaussian assumptin is reasnably gd, the innvatin is a ermean Gaussian and its cvariance is given by S. In such a case, the IS fllws a Chi-square distributin with n degrees f freedm. Hwever, when the filter diverges, the IS will n lnger fllw a Chi-square distributin. Hence, we prpse t chec if the IS falls int the 1 α cnfidence regin fr a Chi-square randm variable with n degrees f freedm, t judge if the filter diverges. Here α is a very small number, which is actually determined by the false alarm rate f the Chi-square detectr. 4.3 Experimental results A single radar with strng nnlinearity In this experiment, we assume that there is a single radar sensr that is tracing the target. he gemetry f the radar and the trajectry is similar t that shwn in Fig. 1. First, we investigate a case with highly nnlinear measurements. We assume that the range measurements are very accurate, with a range errr standard deviatin (s.d.) f 10 m, and the bearing measurements are relatively carse, with a bearing errr s.d. f 4. Fr a single Mnte-Carl run, the target state estimatin errrs are pltted in Fig. 4 fr different algrithms. It can be seen that the EKF diverges, while the PF and the UKF cnverges and have very similar perfrmances. In Fig. 5, the parameter-effects curvature defined in (0) have been pltted fr the EKF and the UKF. It is clear that the maximum curvature measure fr the EKF (arund 100) is much greater than that f the UKF (belw 1), indicating that the EKF is nt wring prperly. Hwever, the curvature measures can nt indicate the divergence f the EKF in real time, since its pea value ccurs a lng time after the EKF diverges. 5

7 In Fig. 8, the curvature measures fr the EKF and the UKF are pltted. It is clear that due t the lw nnlinearity, the curvature measures are very small. Similarly, the ISs fr the EKF and the UKF are within the 98% cnfidence regin fr all the time, as illustrated in Fig. 9. Fig. 4 RMSEs in psitin by different tracing algrithms w bearing sensrs In this experiment, we assume that tw bearing-nly sensrs are used t prvide psitinal infrmatin t the tracer. he target trajectry and the psitins f the tw sensrs are shwn in Fig. 10. Each sensr has a measurement errr s.d. f 3. In Fig. 6, the ISs are shwn fr the EKF and the UKF. It is evident that fr mst f the time, the IS f the EKF is utside the ne-sided 98% cnfidence regin f the Chisquare distributin with tw degrees f freedm, crrectly indicating the EKF is diverging. On the cntrary, the IS fr the UKF is inside the 98% cnfidence regin at all f the time. It is clear that the Chi-square detectr based n the innvatin f the Kalman filter is effective in detecting the filter divergence in real time. Fig. 6 ISs fr the EKF and the UKF. Dashed line dentes the ne-sided 98% cnfidence regin. Fig. 5 Curvature measures fr the EKF and the UKF A single radar with wea nnlinearity We investigate a case with very wea nnlinearity in the measurements. We assume that the range measurement errr has a s.d. f 100 m, and the bearing measurement has a s.d. f 1. As we can see frm Fig. 7, bth the EKF and the UKF wr well and have perfrmances which are very clse t that f the PF. Fig. 7 racing perfrmances f different tracing algrithms. 6

8 regin. he pea values f its curvature measures are much greater than thse f the EKF. Fig. 8 Curvature measures fr the EKF and the UKF. In summary, bth the curvature measure and the IS are effective measures f the nnlinearity f the nnlinear tracing prblems. One prblem with the curvature measure is that its evaluatin requires the true value f the target psitin [ ξ η ] ', which is nt available n-line. One pssible slutin is t use the updated psitin estimate [ ξ ', which is generated by the filter, t η ] replace [ξ η ] '. his estimated value, hwever, is nt rbust, especially when the filter itself is diverging. On the ther hand, ne can certainly use the curvature measures ffline via simulatins, t evaluate the nnlinearity f a specific tracing prblem, with all the pre-specified parameters. he IS, hwever, des nt require the nwledge f the true [ ξη ] ', since the innvatin is simply the difference between the predicted measurement prvided by the filter, and the incming measurement. As we have bserved in the experiments, the IS is very effective in indicating the divergence f the filter, when there is significant mismatch between its estimatin errr and its calculated cvariance matrix. Fig. 9 ISs fr the EKF and the UKF. he dashed line dentes the ne-sided 98% cnfidence regin. Fig. 11 racing perfrmances f different tracing algrithms. Fig. 10 Gemetry f the target trajectry and the bearing sensrs. he tracing perfrmances, the curvature measures and the ISs are pltted in Figs , respectively. It can be seen that the UKF diverges in the first 50 secnds, during which time, its IS falls utside the 98% cnfidence 5 Cnclusin In this paper, we investigated different nnlinear filtering techniques, including the EKF, the UKF, and the PF fr nnlinear target tracing prblems under varius scenaris. heir tracing perfrmances were cmpared and their cmplexities were evaluated in terms f the numbers f flating pint peratins. It was shwn that fr a tracing prblem with wea nnlinearity, the EKF and the UKF are near-ptimal and it is nt necessary t 7

9 emply the cmputatinally expensive particle filter. Hwever, fr prblems with strng nnlinearity, particle filters shuld be used t get reliable tracing perfrmances. Acnwledgment his wr was supprted by the USAF AFRL under Cntract FA C We are grateful t Mar Ka and im Bumpus fr valuable discussins during the curse f this wr. References [1] Z. Chen, ``Bayesian filtering: Frm Kalman filters t particle filters, and beynd, Adaptive Syst. Lab., McMaster Univ., Hamiltn, O, Canada. [Online], [] Y. Bar-Shalm, X.R. Li, and. Kirubarajan, Estimatin with Applicatins t racing and avigatin, ew Yr: Wiley, 001. Fig. 1 Curvature measures fr the EKF and the UKF ver time. [3] S.J. Julier, J.K. Uhlmann, ``A ew Extensin f the Kalman Filter t nlinear Systems, Int. Symp. Aerspace/Defense Sensing, Simul. and Cntrls, Orland, FL,1997. [4]. Grdn, D. Salmnd, and A. F. M. Smith, vel apprach t nnlinear and nn-gaussian Bayesian state estimatin, in Prceedings IEE-F, vl. 140, pp , [5] A. Ducet,. de Freitas, and. Grdn, Sequential Mnte Carl Methds in Practice. Statistics fr Engineering and Infrmatin Science. ew Yr: Springer-Verlag, 001. [6] D.M. Bates and D.G. Watts, nlinear Regressin Analysis and its Applicatins, Jhn Wiley, Fig. 13 ISs fr the EKF and the UKF. he dashed line dentes the ne-sided 98% cnfidence regin. measure the nnlinearity f the tracing prblem, we explred tw types f measures. One type f measure is based n the curvature measures, which cmpares the magnitude f the secnd-rder term with that f the firstrder term in a aylr series expansin f the nnlinear prblem. he secnd measure calculates the nrmalied innvatin squared (IS) f the Kalman filter, which indicates filter divergence when it exceeds a certain threshld. Experiments shw that bth measures are effective in measuring the nnlinearity f the prblem. he curvature measures are mre suitable fr the ffline peratin while the IS can detect filter divergence nline in real time. 8 [7] M. Mallic, B. F. La Scala and S. Arulampalam ``Differential Gemetry Measures f nlinearity fr the Bearing-Only racing Prblem, SPIE Cnference n Signal Prcessing, Sensr Fusin and arget Recgnitin, Vl 5809, Orland, FL, USA, March 005. [8] M. Mallic, and B.F. La Scala, ``Differential Gemetry Measures f nlinearity fr Grund Mving arget Indicatr (GMI) Filtering, Prceedings f the 8th Internatinal cnference n Infrmatin Fusin, pp. 19-6, July 005. [9] M. Mallic and B. F. La Scala, ``Differential Gemetry Measures f nlinearity fr the Vide racing Prblem, SPIE Cnference n Signal Prcessing, Sensr Fusin and arget Recgnitin, Vl 635, Orland, FL, USA, April 006.

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) > Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);

More information

Distributions, spatial statistics and a Bayesian perspective

Distributions, spatial statistics and a Bayesian perspective Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics

More information

Least Squares Optimal Filtering with Multirate Observations

Least Squares Optimal Filtering with Multirate Observations Prc. 36th Asilmar Cnf. n Signals, Systems, and Cmputers, Pacific Grve, CA, Nvember 2002 Least Squares Optimal Filtering with Multirate Observatins Charles W. herrien and Anthny H. Hawes Department f Electrical

More information

Determining the Accuracy of Modal Parameter Estimation Methods

Determining the Accuracy of Modal Parameter Estimation Methods Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system

More information

, which yields. where z1. and z2

, which yields. where z1. and z2 The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin

More information

SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis

SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm

More information

ENSC Discrete Time Systems. Project Outline. Semester

ENSC Discrete Time Systems. Project Outline. Semester ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding

More information

the results to larger systems due to prop'erties of the projection algorithm. First, the number of hidden nodes must

the results to larger systems due to prop'erties of the projection algorithm. First, the number of hidden nodes must M.E. Aggune, M.J. Dambrg, M.A. El-Sharkawi, R.J. Marks II and L.E. Atlas, "Dynamic and static security assessment f pwer systems using artificial neural netwrks", Prceedings f the NSF Wrkshp n Applicatins

More information

Performance Bounds for Detect and Avoid Signal Sensing

Performance Bounds for Detect and Avoid Signal Sensing Perfrmance unds fr Detect and Avid Signal Sensing Sam Reisenfeld Real-ime Infrmatin etwrks, University f echnlgy, Sydney, radway, SW 007, Australia samr@uts.edu.au Abstract Detect and Avid (DAA) is a Cgnitive

More information

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised

More information

A Scalable Recurrent Neural Network Framework for Model-free

A Scalable Recurrent Neural Network Framework for Model-free A Scalable Recurrent Neural Netwrk Framewrk fr Mdel-free POMDPs April 3, 2007 Zhenzhen Liu, Itamar Elhanany Machine Intelligence Lab Department f Electrical and Cmputer Engineering The University f Tennessee

More information

Methods for Determination of Mean Speckle Size in Simulated Speckle Pattern

Methods for Determination of Mean Speckle Size in Simulated Speckle Pattern 0.478/msr-04-004 MEASUREMENT SCENCE REVEW, Vlume 4, N. 3, 04 Methds fr Determinatin f Mean Speckle Size in Simulated Speckle Pattern. Hamarvá, P. Šmíd, P. Hrváth, M. Hrabvský nstitute f Physics f the Academy

More information

ROUNDING ERRORS IN BEAM-TRACKING CALCULATIONS

ROUNDING ERRORS IN BEAM-TRACKING CALCULATIONS Particle Acceleratrs, 1986, Vl. 19, pp. 99-105 0031-2460/86/1904-0099/$15.00/0 1986 Grdn and Breach, Science Publishers, S.A. Printed in the United States f America ROUNDING ERRORS IN BEAM-TRACKING CALCULATIONS

More information

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised

More information

Enhancing Performance of MLP/RBF Neural Classifiers via an Multivariate Data Distribution Scheme

Enhancing Performance of MLP/RBF Neural Classifiers via an Multivariate Data Distribution Scheme Enhancing Perfrmance f / Neural Classifiers via an Multivariate Data Distributin Scheme Halis Altun, Gökhan Gelen Nigde University, Electrical and Electrnics Engineering Department Nigde, Turkey haltun@nigde.edu.tr

More information

Kinematic transformation of mechanical behavior Neville Hogan

Kinematic transformation of mechanical behavior Neville Hogan inematic transfrmatin f mechanical behavir Neville Hgan Generalized crdinates are fundamental If we assume that a linkage may accurately be described as a cllectin f linked rigid bdies, their generalized

More information

Physics 2010 Motion with Constant Acceleration Experiment 1

Physics 2010 Motion with Constant Acceleration Experiment 1 . Physics 00 Mtin with Cnstant Acceleratin Experiment In this lab, we will study the mtin f a glider as it accelerates dwnhill n a tilted air track. The glider is supprted ver the air track by a cushin

More information

CS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007

CS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007 CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is

More information

Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Key Wrds: Autregressive, Mving Average, Runs Tests, Shewhart Cntrl Chart

Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Key Wrds: Autregressive, Mving Average, Runs Tests, Shewhart Cntrl Chart Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Sandy D. Balkin Dennis K. J. Lin y Pennsylvania State University, University Park, PA 16802 Sandy Balkin is a graduate student

More information

Module 4: General Formulation of Electric Circuit Theory

Module 4: General Formulation of Electric Circuit Theory Mdule 4: General Frmulatin f Electric Circuit Thery 4. General Frmulatin f Electric Circuit Thery All electrmagnetic phenmena are described at a fundamental level by Maxwell's equatins and the assciated

More information

SAMPLING DYNAMICAL SYSTEMS

SAMPLING DYNAMICAL SYSTEMS SAMPLING DYNAMICAL SYSTEMS Melvin J. Hinich Applied Research Labratries The University f Texas at Austin Austin, TX 78713-8029, USA (512) 835-3278 (Vice) 835-3259 (Fax) hinich@mail.la.utexas.edu ABSTRACT

More information

Part 3 Introduction to statistical classification techniques

Part 3 Introduction to statistical classification techniques Part 3 Intrductin t statistical classificatin techniques Machine Learning, Part 3, March 07 Fabi Rli Preamble ØIn Part we have seen that if we knw: Psterir prbabilities P(ω i / ) Or the equivalent terms

More information

You need to be able to define the following terms and answer basic questions about them:

You need to be able to define the following terms and answer basic questions about them: CS440/ECE448 Sectin Q Fall 2017 Midterm Review Yu need t be able t define the fllwing terms and answer basic questins abut them: Intr t AI, agents and envirnments Pssible definitins f AI, prs and cns f

More information

Pattern Recognition 2014 Support Vector Machines

Pattern Recognition 2014 Support Vector Machines Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft

More information

On Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION

On Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION Malaysian Jurnal f Mathematical Sciences 4(): 7-4 () On Huntsberger Type Shrinkage Estimatr fr the Mean f Nrmal Distributin Department f Mathematical and Physical Sciences, University f Nizwa, Sultanate

More information

Resampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017

Resampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017 Resampling Methds Crss-validatin, Btstrapping Marek Petrik 2/21/2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins in R (Springer, 2013) with

More information

Modelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA

Modelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview

More information

Checking the resolved resonance region in EXFOR database

Checking the resolved resonance region in EXFOR database Checking the reslved resnance regin in EXFOR database Gttfried Bertn Sciété de Calcul Mathématique (SCM) Oscar Cabells OECD/NEA Data Bank JEFF Meetings - Sessin JEFF Experiments Nvember 0-4, 017 Bulgne-Billancurt,

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical

More information

Aerodynamic Separability in Tip Speed Ratio and Separability in Wind Speed- a Comparison

Aerodynamic Separability in Tip Speed Ratio and Separability in Wind Speed- a Comparison Jurnal f Physics: Cnference Series OPEN ACCESS Aerdynamic Separability in Tip Speed Rati and Separability in Wind Speed- a Cmparisn T cite this article: M L Gala Sants et al 14 J. Phys.: Cnf. Ser. 555

More information

ENGI 4430 Parametric Vector Functions Page 2-01

ENGI 4430 Parametric Vector Functions Page 2-01 ENGI 4430 Parametric Vectr Functins Page -01. Parametric Vectr Functins (cntinued) Any nn-zer vectr r can be decmpsed int its magnitude r and its directin: r rrˆ, where r r 0 Tangent Vectr: dx dy dz dr

More information

Statistics, Numerical Models and Ensembles

Statistics, Numerical Models and Ensembles Statistics, Numerical Mdels and Ensembles Duglas Nychka, Reinhard Furrer,, Dan Cley Claudia Tebaldi, Linda Mearns, Jerry Meehl and Richard Smith (UNC). Spatial predictin and data assimilatin Precipitatin

More information

initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur

initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur Cdewrd Distributin fr Frequency Sensitive Cmpetitive Learning with One Dimensinal Input Data Aristides S. Galanpuls and Stanley C. Ahalt Department f Electrical Engineering The Ohi State University Abstract

More information

Flipping Physics Lecture Notes: Simple Harmonic Motion Introduction via a Horizontal Mass-Spring System

Flipping Physics Lecture Notes: Simple Harmonic Motion Introduction via a Horizontal Mass-Spring System Flipping Physics Lecture Ntes: Simple Harmnic Mtin Intrductin via a Hrizntal Mass-Spring System A Hrizntal Mass-Spring System is where a mass is attached t a spring, riented hrizntally, and then placed

More information

Resampling Methods. Chapter 5. Chapter 5 1 / 52

Resampling Methods. Chapter 5. Chapter 5 1 / 52 Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and

More information

Numerical Simulation of the Thermal Resposne Test Within the Comsol Multiphysics Environment

Numerical Simulation of the Thermal Resposne Test Within the Comsol Multiphysics Environment Presented at the COMSOL Cnference 2008 Hannver University f Parma Department f Industrial Engineering Numerical Simulatin f the Thermal Respsne Test Within the Cmsl Multiphysics Envirnment Authr : C. Crradi,

More information

Learning to Control an Unstable System with Forward Modeling

Learning to Control an Unstable System with Forward Modeling 324 Jrdan and Jacbs Learning t Cntrl an Unstable System with Frward Mdeling Michael I. Jrdan Brain and Cgnitive Sciences MIT Cambridge, MA 02139 Rbert A. Jacbs Cmputer and Infrmatin Sciences University

More information

Performance Comparison of Nonlinear Filters for Indoor WLAN Positioning

Performance Comparison of Nonlinear Filters for Indoor WLAN Positioning Perfrmance Cmparisn f Nnlinear Filters fr Indr WLAN Psitining Hui Wang Andrei Szab Jachim Bamberger Learning Systems Infrmatin and Cmmunicatins Crprate Technlgy Siemens AG Munich Germany Email: {hui.wang.ext.andrei.szab.jachim.bamberger}@siemens.cm

More information

CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS

CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS 1 Influential bservatins are bservatins whse presence in the data can have a distrting effect n the parameter estimates and pssibly the entire analysis,

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins

More information

Admissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs

Admissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs Admissibility Cnditins and Asympttic Behavir f Strngly Regular Graphs VASCO MOÇO MANO Department f Mathematics University f Prt Oprt PORTUGAL vascmcman@gmailcm LUÍS ANTÓNIO DE ALMEIDA VIEIRA Department

More information

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,

More information

Slide04 (supplemental) Haykin Chapter 4 (both 2nd and 3rd ed): Multi-Layer Perceptrons

Slide04 (supplemental) Haykin Chapter 4 (both 2nd and 3rd ed): Multi-Layer Perceptrons Slide04 supplemental) Haykin Chapter 4 bth 2nd and 3rd ed): Multi-Layer Perceptrns CPSC 636-600 Instructr: Ynsuck Che Heuristic fr Making Backprp Perfrm Better 1. Sequential vs. batch update: fr large

More information

Comparison of hybrid ensemble-4dvar with EnKF and 4DVar for regional-scale data assimilation

Comparison of hybrid ensemble-4dvar with EnKF and 4DVar for regional-scale data assimilation Cmparisn f hybrid ensemble-4dvar with EnKF and 4DVar fr reginal-scale data assimilatin Jn Pterjy and Fuqing Zhang Department f Meterlgy The Pennsylvania State University Wednesday 18 th December, 2013

More information

and the Doppler frequency rate f R , can be related to the coefficients of this polynomial. The relationships are:

and the Doppler frequency rate f R , can be related to the coefficients of this polynomial. The relationships are: Algrithm fr Estimating R and R - (David Sandwell, SIO, August 4, 2006) Azimith cmpressin invlves the alignment f successive eches t be fcused n a pint target Let s be the slw time alng the satellite track

More information

Fall 2013 Physics 172 Recitation 3 Momentum and Springs

Fall 2013 Physics 172 Recitation 3 Momentum and Springs Fall 03 Physics 7 Recitatin 3 Mmentum and Springs Purpse: The purpse f this recitatin is t give yu experience wrking with mmentum and the mmentum update frmula. Readings: Chapter.3-.5 Learning Objectives:.3.

More information

February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA

February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA Mental Experiment regarding 1D randm walk Cnsider a cntainer f gas in thermal

More information

Hypothesis Tests for One Population Mean

Hypothesis Tests for One Population Mean Hypthesis Tests fr One Ppulatin Mean Chapter 9 Ala Abdelbaki Objective Objective: T estimate the value f ne ppulatin mean Inferential statistics using statistics in rder t estimate parameters We will be

More information

Tree Structured Classifier

Tree Structured Classifier Tree Structured Classifier Reference: Classificatin and Regressin Trees by L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stne, Chapman & Hall, 98. A Medical Eample (CART): Predict high risk patients

More information

Kinetic Model Completeness

Kinetic Model Completeness 5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins

More information

1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp

1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp THE POWER AND LIMIT OF NEURAL NETWORKS T. Y. Lin Department f Mathematics and Cmputer Science San Jse State University San Jse, Califrnia 959-003 tylin@cs.ssu.edu and Bereley Initiative in Sft Cmputing*

More information

MODULE 1. e x + c. [You can t separate a demominator, but you can divide a single denominator into each numerator term] a + b a(a + b)+1 = a + b

MODULE 1. e x + c. [You can t separate a demominator, but you can divide a single denominator into each numerator term] a + b a(a + b)+1 = a + b . REVIEW OF SOME BASIC ALGEBRA MODULE () Slving Equatins Yu shuld be able t slve fr x: a + b = c a d + e x + c and get x = e(ba +) b(c a) d(ba +) c Cmmn mistakes and strategies:. a b + c a b + a c, but

More information

Lab 1 The Scientific Method

Lab 1 The Scientific Method INTRODUCTION The fllwing labratry exercise is designed t give yu, the student, an pprtunity t explre unknwn systems, r universes, and hypthesize pssible rules which may gvern the behavir within them. Scientific

More information

NOTE ON A CASE-STUDY IN BOX-JENKINS SEASONAL FORECASTING OF TIME SERIES BY STEFFEN L. LAURITZEN TECHNICAL REPORT NO. 16 APRIL 1974

NOTE ON A CASE-STUDY IN BOX-JENKINS SEASONAL FORECASTING OF TIME SERIES BY STEFFEN L. LAURITZEN TECHNICAL REPORT NO. 16 APRIL 1974 NTE N A CASE-STUDY IN B-JENKINS SEASNAL FRECASTING F TIME SERIES BY STEFFEN L. LAURITZEN TECHNICAL REPRT N. 16 APRIL 1974 PREPARED UNDER CNTRACT N00014-67-A-0112-0030 (NR-042-034) FR THE FFICE F NAVAL

More information

What is Statistical Learning?

What is Statistical Learning? What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,

More information

INTERNATIONAL JOURNAL OF CIVIL AND STRUCTURAL ENGINEERING Volume 1, No 3, 2010

INTERNATIONAL JOURNAL OF CIVIL AND STRUCTURAL ENGINEERING Volume 1, No 3, 2010 Prbabilistic Analysis f Lateral Displacements f Shear in a 20 strey building Samir Benaissa 1, Belaid Mechab 2 1 Labratire de Mathematiques, Université de Sidi Bel Abbes BP 89, Sidi Bel Abbes 22000, Algerie.

More information

Time, Synchronization, and Wireless Sensor Networks

Time, Synchronization, and Wireless Sensor Networks Time, Synchrnizatin, and Wireless Sensr Netwrks Part II Ted Herman University f Iwa Ted Herman/March 2005 1 Presentatin: Part II metrics and techniques single-hp beacns reginal time znes ruting-structure

More information

COMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d)

COMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d) COMP 551 Applied Machine Learning Lecture 9: Supprt Vectr Machines (cnt d) Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Class web page: www.cs.mcgill.ca/~hvanh2/cmp551 Unless therwise

More information

A Matrix Representation of Panel Data

A Matrix Representation of Panel Data web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins

More information

3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression

3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression 3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets

More information

k-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels

k-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t

More information

Revision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax

Revision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax .7.4: Direct frequency dmain circuit analysis Revisin: August 9, 00 5 E Main Suite D Pullman, WA 9963 (509) 334 6306 ice and Fax Overview n chapter.7., we determined the steadystate respnse f electrical

More information

Sequential Allocation with Minimal Switching

Sequential Allocation with Minimal Switching In Cmputing Science and Statistics 28 (1996), pp. 567 572 Sequential Allcatin with Minimal Switching Quentin F. Stut 1 Janis Hardwick 1 EECS Dept., University f Michigan Statistics Dept., Purdue University

More information

COASTAL ENGINEERING Chapter 2

COASTAL ENGINEERING Chapter 2 CASTAL ENGINEERING Chapter 2 GENERALIZED WAVE DIFFRACTIN DIAGRAMS J. W. Jhnsn Assciate Prfessr f Mechanical Engineering University f Califrnia Berkeley, Califrnia INTRDUCTIN Wave diffractin is the phenmenn

More information

Chapter 3: Cluster Analysis

Chapter 3: Cluster Analysis Chapter 3: Cluster Analysis } 3.1 Basic Cncepts f Clustering 3.1.1 Cluster Analysis 3.1. Clustering Categries } 3. Partitining Methds 3..1 The principle 3.. K-Means Methd 3..3 K-Medids Methd 3..4 CLARA

More information

Observability-based Rules for Designing Consistent EKF SLAM Estimators

Observability-based Rules for Designing Consistent EKF SLAM Estimators 1 Observability-based Rules fr Designing Cnsistent EKF SLAM Estimatrs Guquan P Huang, Anastasis I Murikis, and Stergis I Rumelitis Dept f Cmputer Science and Engineering, University f Minnesta, Minneaplis,

More information

Simple Linear Regression (single variable)

Simple Linear Regression (single variable) Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins

More information

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9. Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.

More information

POLARISATION VISUAL PHYSICS ONLINE. View video on polarisation of light

POLARISATION VISUAL PHYSICS ONLINE. View video on polarisation of light VISUAL PHYSICS ONLINE MODULE 7 NATURE OF LIGHT POLARISATION View vide n plarisatin f light While all the experimental evidence s far that supprts the wave nature f light, nne f it tells us whether light

More information

EDA Engineering Design & Analysis Ltd

EDA Engineering Design & Analysis Ltd EDA Engineering Design & Analysis Ltd THE FINITE ELEMENT METHOD A shrt tutrial giving an verview f the histry, thery and applicatin f the finite element methd. Intrductin Value f FEM Applicatins Elements

More information

Beam Combining and Atmospheric Propagation of High Power Lasers

Beam Combining and Atmospheric Propagation of High Power Lasers Naval Research Labratry Washingtn, DC 0375-530 NRL/MR/6790--11-9371 Beam Cmbining and Atmspheric Prpagatin f High Pwer Lasers Phillip Sprangle Jseph Peñan Beam Physics Branch Plasma Physics Divisin Bahman

More information

The blessing of dimensionality for kernel methods

The blessing of dimensionality for kernel methods fr kernel methds Building classifiers in high dimensinal space Pierre Dupnt Pierre.Dupnt@ucluvain.be Classifiers define decisin surfaces in sme feature space where the data is either initially represented

More information

Bayesian nonparametric modeling approaches for quantile regression

Bayesian nonparametric modeling approaches for quantile regression Bayesian nnparametric mdeling appraches fr quantile regressin Athanasis Kttas Department f Applied Mathematics and Statistics University f Califrnia, Santa Cruz Department f Statistics Athens University

More information

Marginal Conceptual Predictive Statistic for Mixed Model Selection

Marginal Conceptual Predictive Statistic for Mixed Model Selection Open Jurnal f Statistics, 06, 6, 39-53 Published Online April 06 in Sci http://wwwscirprg/jurnal/js http://dxdirg/0436/js0660 Marginal Cnceptual Predictive Statistic fr Mixed Mdel Selectin Cheng Wenren,

More information

Math Foundations 20 Work Plan

Math Foundations 20 Work Plan Math Fundatins 20 Wrk Plan Units / Tpics 20.8 Demnstrate understanding f systems f linear inequalities in tw variables. Time Frame December 1-3 weeks 6-10 Majr Learning Indicatrs Identify situatins relevant

More information

Elements of Machine Intelligence - I

Elements of Machine Intelligence - I ECE-175A Elements f Machine Intelligence - I Ken Kreutz-Delgad Nun Vascncels ECE Department, UCSD Winter 2011 The curse The curse will cver basic, but imprtant, aspects f machine learning and pattern recgnitin

More information

A New Evaluation Measure. J. Joiner and L. Werner. The problems of evaluation and the needed criteria of evaluation

A New Evaluation Measure. J. Joiner and L. Werner. The problems of evaluation and the needed criteria of evaluation III-l III. A New Evaluatin Measure J. Jiner and L. Werner Abstract The prblems f evaluatin and the needed criteria f evaluatin measures in the SMART system f infrmatin retrieval are reviewed and discussed.

More information

Introduction: A Generalized approach for computing the trajectories associated with the Newtonian N Body Problem

Introduction: A Generalized approach for computing the trajectories associated with the Newtonian N Body Problem A Generalized apprach fr cmputing the trajectries assciated with the Newtnian N Bdy Prblem AbuBar Mehmd, Syed Umer Abbas Shah and Ghulam Shabbir Faculty f Engineering Sciences, GIK Institute f Engineering

More information

Early detection of mining truck failure by modelling its operation with neural networks classification algorithms

Early detection of mining truck failure by modelling its operation with neural networks classification algorithms RU, Rand GOLOSINSKI, T.S. Early detectin f mining truck failure by mdelling its peratin with neural netwrks classificatin algrithms. Applicatin f Cmputers and Operatins Research ill the Minerals Industries,

More information

ELECTRON CYCLOTRON HEATING OF AN ANISOTROPIC PLASMA. December 4, PLP No. 322

ELECTRON CYCLOTRON HEATING OF AN ANISOTROPIC PLASMA. December 4, PLP No. 322 ELECTRON CYCLOTRON HEATING OF AN ANISOTROPIC PLASMA by J. C. SPROTT December 4, 1969 PLP N. 3 These PLP Reprts are infrmal and preliminary and as such may cntain errrs nt yet eliminated. They are fr private

More information

Lecture 02 CSE 40547/60547 Computing at the Nanoscale

Lecture 02 CSE 40547/60547 Computing at the Nanoscale PN Junctin Ntes: Lecture 02 CSE 40547/60547 Cmputing at the Nanscale Letʼs start with a (very) shrt review f semi-cnducting materials: - N-type material: Obtained by adding impurity with 5 valence elements

More information

Group Report Lincoln Laboratory. The Angular Resolution of Multiple Target. J. R. Sklar F. C. Schweppe. January 1964

Group Report Lincoln Laboratory. The Angular Resolution of Multiple Target. J. R. Sklar F. C. Schweppe. January 1964 Grup Reprt 1964-2 The Angular Reslutin f Multiple Target J. R. Sklar F. C. Schweppe January 1964 Prepared. tract AF 19 (628)-500 by Lincln Labratry MASSACHUSETTS INSTITUTE OF TECHNOLOGY Lexingtn, M The

More information

Chapter 3 Kinematics in Two Dimensions; Vectors

Chapter 3 Kinematics in Two Dimensions; Vectors Chapter 3 Kinematics in Tw Dimensins; Vectrs Vectrs and Scalars Additin f Vectrs Graphical Methds (One and Tw- Dimensin) Multiplicatin f a Vectr b a Scalar Subtractin f Vectrs Graphical Methds Adding Vectrs

More information

3D KMC simulation on the precipitation in the annealed ternary alloy system

3D KMC simulation on the precipitation in the annealed ternary alloy system 3D KM simulatin n the precipitatin in the annealed ternary ally system Xuan Zhang, Mengqi Huang Abstract Kinetic Mnte arl methd is used t study the precipitatin phenmenn in binary and ternary ally system,

More information

ECE 545 Project Deliverables

ECE 545 Project Deliverables ECE 545 Prject Deliverables Tp-level flder: _ Secnd-level flders: 1_assumptins 2_blck_diagrams 3_interface 4_ASM_charts 5_surce_cde 6_verificatin 7_timing_analysis 8_results

More information

Uncertainties in TRP Measurements Due to Finite Range Lengths

Uncertainties in TRP Measurements Due to Finite Range Lengths Uncertainties in TRP Measurements Due t Finite Range Lengths James D Huff Carl W Sirles The Hwland Cmpany, Inc 4540 Atwater Curt, Suite 107 Bufrd, Gergia 30518 Abstract Ttal Radiated Pwer (TRP) and Ttal

More information

Comparing Several Means: ANOVA. Group Means and Grand Mean

Comparing Several Means: ANOVA. Group Means and Grand Mean STAT 511 ANOVA and Regressin 1 Cmparing Several Means: ANOVA Slide 1 Blue Lake snap beans were grwn in 12 pen-tp chambers which are subject t 4 treatments 3 each with O 3 and SO 2 present/absent. The ttal

More information

Collocation Map for Overcoming Data Sparseness

Collocation Map for Overcoming Data Sparseness Cllcatin Map fr Overcming Data Sparseness Mnj Kim, Yung S. Han, and Key-Sun Chi Department f Cmputer Science Krea Advanced Institute f Science and Technlgy Taejn, 305-701, Krea mj0712~eve.kaist.ac.kr,

More information

Modeling the Nonlinear Rheological Behavior of Materials with a Hyper-Exponential Type Function

Modeling the Nonlinear Rheological Behavior of Materials with a Hyper-Exponential Type Function www.ccsenet.rg/mer Mechanical Engineering Research Vl. 1, N. 1; December 011 Mdeling the Nnlinear Rhelgical Behavir f Materials with a Hyper-Expnential Type Functin Marc Delphin Mnsia Département de Physique,

More information

The Kullback-Leibler Kernel as a Framework for Discriminant and Localized Representations for Visual Recognition

The Kullback-Leibler Kernel as a Framework for Discriminant and Localized Representations for Visual Recognition The Kullback-Leibler Kernel as a Framewrk fr Discriminant and Lcalized Representatins fr Visual Recgnitin Nun Vascncels Purdy H Pedr Mren ECE Department University f Califrnia, San Dieg HP Labs Cambridge

More information

Lead/Lag Compensator Frequency Domain Properties and Design Methods

Lead/Lag Compensator Frequency Domain Properties and Design Methods Lectures 6 and 7 Lead/Lag Cmpensatr Frequency Dmain Prperties and Design Methds Definitin Cnsider the cmpensatr (ie cntrller Fr, it is called a lag cmpensatr s K Fr s, it is called a lead cmpensatr Ntatin

More information

Technical Bulletin. Generation Interconnection Procedures. Revisions to Cluster 4, Phase 1 Study Methodology

Technical Bulletin. Generation Interconnection Procedures. Revisions to Cluster 4, Phase 1 Study Methodology Technical Bulletin Generatin Intercnnectin Prcedures Revisins t Cluster 4, Phase 1 Study Methdlgy Release Date: Octber 20, 2011 (Finalizatin f the Draft Technical Bulletin released n September 19, 2011)

More information

FIELD QUALITY IN ACCELERATOR MAGNETS

FIELD QUALITY IN ACCELERATOR MAGNETS FIELD QUALITY IN ACCELERATOR MAGNETS S. Russenschuck CERN, 1211 Geneva 23, Switzerland Abstract The field quality in the supercnducting magnets is expressed in terms f the cefficients f the Furier series

More information

Figure 1a. A planar mechanism.

Figure 1a. A planar mechanism. ME 5 - Machine Design I Fall Semester 0 Name f Student Lab Sectin Number EXAM. OPEN BOOK AND CLOSED NOTES. Mnday, September rd, 0 Write n ne side nly f the paper prvided fr yur slutins. Where necessary,

More information

Edinburgh Research Explorer

Edinburgh Research Explorer Edinburgh Research Explrer Supprting User-Defined Functins n Uncertain Data Citatin fr published versin: Tran, TTL, Dia, Y, Suttn, CA & Liu, A 23, 'Supprting User-Defined Functins n Uncertain Data' Prceedings

More information

Math 302 Learning Objectives

Math 302 Learning Objectives Multivariable Calculus (Part I) 13.1 Vectrs in Three-Dimensinal Space Math 302 Learning Objectives Plt pints in three-dimensinal space. Find the distance between tw pints in three-dimensinal space. Write

More information

Simulation of Line Outage Distribution Factors (L.O.D.F) Calculation for N-Buses System

Simulation of Line Outage Distribution Factors (L.O.D.F) Calculation for N-Buses System Simulatin f Line Outage Distributin Factrs (L.O.D.F) Calculatin fr N-Buses System Rashid H. AL-Rubayi Department f Electrical Engineering, University f Technlgy Afaneen A. Abd Department f Electrical Engineering,

More information

BASD HIGH SCHOOL FORMAL LAB REPORT

BASD HIGH SCHOOL FORMAL LAB REPORT BASD HIGH SCHOOL FORMAL LAB REPORT *WARNING: After an explanatin f what t include in each sectin, there is an example f hw the sectin might lk using a sample experiment Keep in mind, the sample lab used

More information

UNIV1"'RSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. CUMULATIVE SUM CONTROL CHARTS FOR THE FOLDED NORMAL DISTRIBUTION

UNIV1'RSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. CUMULATIVE SUM CONTROL CHARTS FOR THE FOLDED NORMAL DISTRIBUTION UNIV1"'RSITY OF NORTH CAROLINA Department f Statistics Chapel Hill, N. C. CUMULATIVE SUM CONTROL CHARTS FOR THE FOLDED NORMAL DISTRIBUTION by N. L. Jlmsn December 1962 Grant N. AFOSR -62..148 Methds f

More information

MODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards:

MODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards: MODULE FOUR This mdule addresses functins SC Academic Standards: EA-3.1 Classify a relatinship as being either a functin r nt a functin when given data as a table, set f rdered pairs, r graph. EA-3.2 Use

More information