16 5 V o l. 16 N o. 5 CON T ROL A N D D EC IS ION 2001 9 Sep t. 2001 : 100120920 (2001) 0520518205, (, 410082) :,, : ; ; : T P 14: A M ultisen sor Information Fusion and Its Application: A Survey W A N G Y ao2nan, L I S hu2tao (Co llege of E lectrical and Info rm ation Engineering, H unan U niversity, Changsha 410082, Ch ina) Abstract: M ultisenso r info rm ation fusion is being app lied to a w ide variety of fields such as autom ated target recognition, battlefield surveillance, guidance and contro l of autonom ous veh icles, robo tics, in2 dustrial p rocess contro l, m edical diagno stics, im age p rocessing and pattern recognition. T he concep t of m ultisenso r info rm ation fusion is introduced, and the p roblem of p rocessing m odel and fusion level of m ultisenso r info rm ation fusion are discussed. A review of the state of the art and developm ent trend are p resented. Key words: m ultisenso r; info rm ation fusion; com p lex industrial p rocess contro l 1, [1 3 ],,,,, 1,,, : 1) ; 2) ; 3) ; : 2000206216; : 2000209213 : 863 (8632511298452002) : (1957 ),,,,, ; (1972 ),,,,
16 5 : 519 1 4), : 1) ; 2) ; 3) ; 4) ; 5) ( ) 2 : 1) : ( ) 2) :, 3) :, 4) :, 5) :, 6) :,, 7) :, 8) : 3 2 2 [4 ],,, [2 3 ] 3, ( 3) 3 (a),,, ( ), ( ), 3 3 (a) (b) (c)
520 2 0 0 1,,, 3 (b), [8, 9 ],,, [10 ],,, 3 (c) [11, 12 ],,,, X 2,, [13, 14 ],,,,, 3,, : [15 ], 1) 4 :,, [16, 17 ] ;, 2) : 2, 2, 2 [3 ], -, 2,, 2 [18, 19 ], 4 4. 1, () [5 7 ],,, ESM 4. 2 : D emp ster2 Shafer, : [20, 21 ] [22, 23 ] [24 26 ] [27 ],, [ 28 ] 4, ;,,
16 5 : 521, ;,, ( ), 5 4,,,, : 1),,, [29 ] ( +, +, +, + ), 2), 3), 4), : [ 1 ] W altz E, L ilnas J. M ultisenso r data fusion [M ]. Bo ston: A rtech House, 1990. [ 2 ] H all D L, L linas J. A n introduction to m ultisenso r data fusion [J ]. P roc IEEE, 1997, 85 (1): 6223. [3 ] V arshney P K. M ultisenso r data fusion [J ]. J Eclec Comm u Eng, 1997, 9 (6): 2452253. [ 4 ] W h ite F E. D ata fusion lexicon: D ata fusion subpanel of the jo int directo rs of labo rato ries technical panel fo r C3[R ]. San D iego, 1991. [5 ] W altz E, Buede D M. D ata fusion and decision suppo rt fo r comm and and contro l [J ]. M an & Cybern, 1986, 16 (6): 8652879. IEEE T rans on Syst, [6 ] Comparato V G. Fusion T he key to tactical m ission success[j ]. SP IE, 1988, 93 (1): 227. [7 ] H am ilton M K, K ipp T A. A TR arch itecture fo r m ulti2 senso r fusion [J ]. SP IE, 1996, 275 (5): 1262133. [ 8 ] A bidim A, Gonzalez R C. D ata fusion in robo tics and m ach ine intelligence[m ]. Bo ston: A cadem ic, 1992. [9 ] M urphy R R. D emp ster2shafer theo ry fo r senso r fusion in autonomous mobile robo ts[j ]. A utom, 1998, 14 (2): 1972206. IEEE T rans on Robo t [ 10 ],,. [M ]. :,
522 2 0 0 1 1998. [ 11 ] M urphy R R. Senso r and info rm ation fusion fo r im 2 p roved vision2based veh icle guidance [ J ]. IEEE Ex2 pert, 1998, 13 (6): 49256. [ 12 ] N eira J, T ardo s J D, Ho rn J et al. Fusing range and intensity im age fo r mobile robo t localization [J ]. IEEE T rans on Robo t A utom, 1999, 15 (1): 76284. [13 ] Katyal S, K ram er E L, N oz M E et al. Fusion of im 2 m uno scinti graphy SPECT w ith CT of the chest in pa2 tients w ith non2sm all cell lung cancer[j ]. Cancer R es, 1995, 55 (S): 575925763. [ 14 ] H ernandez A I, Garrault G, M o ra F et al. M ultisen2 so r fusion fo r atrial and ventricular activity detection in co ronary care m onito ring [ J ]. IEEE T rans on B iom ed Eng, 1999, 46 (10): 118621190. [ 15 ] N unez J. M ultireso lution2based im age fusion w ith ad2 ditive w avelet decom po sition [ J ]. IEEE T rans on Geo sci R emo te Sening, 1999, 37 (3): 120421211. [ 16 ] B ruzzone L, P rieto D F, Serp ico S B. A neural2statis2 tical app roach to m ultitem po ral and m ultisource re2 m o te2sensing im age classification [J ]. IEEE T rans on Geo sci R emo te Sening, 1999, 37 (3): 135021359. [ 17 ] Benedik tsson J A, Kanellopoulo s İ C lassification of m ultisource and hyperspectral data based on decision fusion [J ]. IEEE T rans on Geo sci R emo te Sening, 1999, 37 (3): 136721377. [18 ] Ben2Yacoub S, A bdeljaoued Y, M ayo raz E. Fusion of face and speech data fo r person identity verification [J ]. IEEE T rans N eural N etw o rk s, 1999, 10 (5): 10652 1074. [ 19 ] Jain A K. A m ultimodal biom etric system using finger2 p rints, face and speech [A ]. P roc 2nd Int Conf A udio2 video Based B iom etric Person A uthentication [ C ]. W ash ington, 1999. 1822187. [ 20 ] R usso F, R amponi G. Fuzzy m ethods fo r m ultisenso r data fusion [J ]. IEEE T rans on Instrum M eas, 1994, 43 (2): 2882294. [ 21 ] Chanusso t J, M auris G, L am bert P. Fuzzy fusion techniques fo r linear features detection in m ultitem po2 ral SA R im ages [J ]. Sening, 1999, 37 (3): 129221305. IEEE T rans on Geo sci R emo te [22 ] W an W, F raser D. M ultisource data fusion w ith m ul2 tip le self2o rganizing m ap s [J ]. R emo te Sening, 1999, 37 (3): 134421349. IEEE T rans on Geo sci [23 ] J im enez L O, M o rales2m o rell A, C reus A. C lassifica2 tion of hyperdim ensional data based on feature and de2 cision app roaches using p ro jection pursuit, m ajo rity vo ting and neural netw o rk s[j ]. R emo te Sening, 1999, 37 (3): 136021365. IEEE T rans on Geo sci [24 ] M allat S G. A theo ry fo r m ultireso lution signal de2 compo sition: T he w avelet rep resentation [J ]. IEEE T rans on Pattern A nal M ach ine Intell, 1989, 11 (7): 6742693. [25 ] Zhang Z, B lum R S. A catego rization of m ultiscale2de2 compo sition2based im age fusion schem es w ith a perfo r2 m ance study fo r a digital cam era app lication [J ]. IEEE, 1999, 87 (8): 131521326. P roc [26 ] L i S T, W ang Y N. M ultisenso r im age fusion using discrete m ultiw avelet transfo rm [A ]. P roc of the 3rd Int Conf on V isual Computing [C ]. M exico, 2000. 932 103. [27 ] Ben2Yacoub S, A bdeljaoued Y, M ayo ran E. Fusion of face and speech data fo r person identity verification [ J ]. IEEE T rans on N eural N etw o rk s, 1999, 10 (5): 106521074. [ 28 ]. 863 [R ]. :, 2000. 1502200. [29 ]. [M ]. :, 1999. 18221. LQ Bayes