A Unifying Multi-Label Temporal Kernel Machine with Its Application to Video Annotation

A Ufy Lb Tm K h wh I A V A GJ Q Uvy f Thy f h Xh H f Rh A Y R f h R&D G HJ Zh f Av Thy Am v m f mv v bw, h v. h h b h y. Th h hv vv hh w m. I h f m, h vy by by f. Hwv, h mh h h fm bw h v y hv m. Evv fm h f m, h mh h m x h f h f v f f h m f h. Hwv h b f h f, h fm f h mh b by h h f. I h, h m f h v mh h bv bm. I my h w m bw hm by h v Lb (L) mh. Fhm h v m by m fm q, w x h mh x h h m fm h v. fy, mk h L mh b h mv fm bw H kv (H) h fm h v. W m h fm bw h h h fh h h f m h wy TREVID. A b hw, fm fm h mh b. bj D: H.3.1 [Ifm Rv]: Ay Ixx mh; I.2.10 [Af I]: V U v y G Tm: Ahm, Thy, Exm A Ky W h: V A, Lb,, Tm K Ah : G.J. Q, Dm f Am, Uvy f Thy f h, 96 Jzh R, Hf, Ah 230027, h; m: qj@m... X.. H, f Rh A, 49 Zhh R, 100080 Bj, h; m:xh@mf.m Y. R, f h R&D G, 49 Zhh R, 100080 Bj, h; m:y@mf.m H.J. Zh, f Av Thy, 49 Zhh R, 100080 Bj, h; m:hjzh@mf.m m mk /h y f f h m wh f f m v h h m b f f mm v, h A yh/v, h f h b,, v h y by m f h A, I. T y hw, bh, v, b q f m / f. 20XX A 00000000/20XX/00000001 $5.00 A J Nm, V. X, N. X, XX 20XX, 1 25.

2 GJ Q. F. 1. m mb xm fm TREVID. 1. INTRODUTION Wh xv m f b v h I (.., Yb, VE, Yh! V, my v hm b.), ffv x h h v bm m m v. A b hq v x h, mv v h b m h h mm h mmy [Nh 2002][k. 2006]. I m v wh f h f, (.., b, ky, m,.), bj (..,,, f,.), v (.., xf, mh,.) m (..,,.)[Nh. 2005][k. 2006]. I h, w wh mb v wh v b by m b h m m. F 1 m kyfm f h mb v. F xm, v b f, wk my. I h mb bm, m y h v. I m w v, h TREVID h my vh wb, h v f mb by f h h h y. vv xv f f m, mb mh m mx h m. W w f mb v h. 1.1 V A wh Lb b v h vv hh w m: v, x B F (BF) [J. 2006]. I h, w h h m: h fy mb. W x vw h h m. 1.1.1 m I: Iv A. Th mh h f m v,.., hy h v vy y. Thy h h bw h v. I m, h mh y h mb m whh vy /b b h ma J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 3... Lwv F Lwv F Lwv F O F h h R Wk O F R Wk F O 0/1 0/1 0/1 0/1 0/1 0/1 h R V F Wk 0/1 0/1 0/1 0/1 0/1 0/1 0/1 0/1 0/1 0/1 0/1 0/1 F m: Iv D m : BF Th m: I Lb Ah F. 2. Th mb v mh h m. Fm fm h hm, hy h v V, BF L.. b z h m. F xm, V h (V) [ hwty 2000] wh hh y m f, h f whh y m h /b f. Oh xm f h m xmm Ey (E) [Nm. 1999], f Rk (R) [T. 2007]. I F 2, w v f h m h fm fwh. A, f v V f v. I bf, h f h m fm h v f by f. Hwv my w bm, v f x vy wh h h, h h. h v y hv m. F xm, h f w f h wh h f wh b h k mmy. O h h h, m m whh b y m fm wv f, m mx.., mh, y ff b vy m h m bw h wv f. I, h mx b b f b h b wh h h. F, h f mh b b f bh w wk v. Thf, w b vy hf x h b wh h m h. 1.1.2 m II: x B F A. A w m v v, h m b h v. I m f h f h by wh x B F (BF) y. y hm b z h m. F xm, [W. 2004] yb mf f v. Eh f y m by A J Nm, V. X, N. X, XX 20XX.

4 GJ Q. f, h f y hhy v mv h y f h v f. [mh Nh 2003] w Dmv F (DF) h m h kw h f by m v b f v f. A V h f h f h v f. Th fwh f F 2 hw h m h. Av f y b,.., [Hm. 2004] L R (LR) f h v. [J. 2006] BFb v mh. U vv h h fw f x v, h m w h z h f mv f h. [Nh. 2002] bb By h xy m h h bw h m hh f h whh b h y v y m. [Zh. 2007] v h w f h v by v f f h. Ivy b v h xb fm mv h y f h. Hwv h x m xm hw h h BF mh hv mvm v h v. I v fm v b w h h byb. F xm, [Hm. 2004] 3 f 8 b fm by h f wh LR f h. Th b fm h fw : (1) BF mh b h by wh f hm. Hwv, h f h v b b hf h h f. A, h f b by h. Fm hh f vw, h BF mh fw h f L mmm by D. [ 1982], b hy my mm vb v h f whh b h f. (2) A y m fm h ff f h f. I BF mh, h m b w f h h m f h f y ff m h m h f. Ufy, h bw h y mx, ff v f h f, h h b k h z by. 1.1.3 m III: Ufy b A. I h, w w h h m f v h bm f h f m. Th w m w my m bh h v h fy fm, h f Lmmm w b by. Th hm fwh f F 2 h v Lb (L) mh. A w, h mh h h fw v m h BF m: (1) Th h fw h f Lmmm [ 1982]. B h mz f h my, A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 5 hv h bm BF. (2) Th m ffy my m h v w h. Th k f vf h ff m f m h hf fy. T mmz, h f m. Th m m by. I, h h m h h. 1.2 V A wh Tm q B h bv mb bm, m v h h m fm h v q b h v, y f h v, h fy,, mh. Th y x m h wk whh m z m fm f v. Th h hv vv hh w h. I h f y, m m f f ym v m. F xm, [X h 2002] m h y bk v v by h ym f h m f wh H kv (H). Th mh y b wv f ym v m h h v m m, h v [Ebh. 2006]. F xm, wh fy, hf whh ky,. Th h y z h h v v. F xm, [Ebh. 2006] v h m h m h v v. Th mh m h ym f fm xm f v v fh. Hwv, h b fm h f m. Th f b h v b. Thf, h h f f h f h ym f h v v. I v h f L mmm [ 1982] h h h v b h f ym. Th m bm [W. 2006] w. I f m mv kyw, b whh Rm F (RF) [Lffy. 2001] h bw h y f h kyw. T h bv bm, w w m k h v mb fm. I v h w wv f ym b h v v. fy, m k by v h mv fm bw h m h fm h v q. A b, v h w mh whh h y f h v h ym. I, h wv f ym fy fmwk, h h f L mmm by. Fhm, h m k b y h mb k wh y x mxy f h hm. A J Nm, V. X, N. X, XX 20XX.

6 GJ Q. Th f h z fw. I 2, w v f h v Lb (L) mh, h f m, h y. Fhm w w x h bw h h Gbb Rm F (GRF) [Wk 1995], b whh w hw v hw h h h v w h. 3 h m k f v. Th k b y L k fm v Lb Tm (LT) K, whh h hhv wv f ym fy k mh. Fy, 4, w w xm h bhmk TREVID hw h h h h fm v h fh hm bh f m. 2. ORRELATIVE ULTILABEL VIDEO ANNOTATION I h, w w h v mb (L) m f v m. I 2.1, w w h mhm fm f h mb f f, hw h h f h bw h v wv f, w h bw h ff. Th 2.2, w w b h f h L m. I 2.3, w w v bb f h L m b Gbb m f. 2.1 Lb f F Bf w mv fh, w f f m. L x = (x 1, x 2,, x D ) T X h f v x fm v ; L y Y = {+1, 1} K h K m b v f xm, wh h y y {+1, 1} f y h mmbh f h xm h h. X Y h f b f h, vy. Th hm m mv f F (x, y; w) = w, θ(x, y) (1) wh θ(x, y) v f m fm X Y w f v whh h m f v w h h ( b ); w h mb wh v. Wh h mv f, f x, h b v y b by mxmz v h m y y = mx F (x, y; w) (2) y Y A b h x, h mv f b vy h Gbb m f (GRF) [Wk 1995] fmwk wh h f f v θ(x, y). Th f θ(x, y) hhm f v, wh m b w y fw. A b hw h w y f m y f m f v h, vy. Ty I. Th m f v m: θ, (x, y) = x δ [[y = ]], {+1, 1}, 1 D, 1 K (3) A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 7 wh δ [[y = ]] f h k v 1 f h 0 hw; D K h m f w v f v X h mb f h vy. Th f θ(x, y) v m h bw h w v f x h b y k (1 k K) f h. Thy hv h m fy h V whh m h bw h wv f hhv. Hwv, w hv, h f mb hm y f m h bw h b wv f wh h m f ff. Thf, h m y f θ(x, y) q v h bw h ff. Ty II. Th m f : θ m,,q (x, y) = δ [[y = m]] δ [[y q = ]] m, {+1, 1}, 1 < q K (4) wh h m h by b (v v b), b q h. Th m v h b f b. N h, bh v v wh h m. F xm, h b b v h f wh x f w wf v h y h m m. N h w m hh m h w, b w q m m. A b hw 5, h 2 m fy ff bw h m mxy mxy, hv f mvm h fm. By h bv w y f m h, w b h f v θ(x, y). I ff h h m f v θ(x, y) 2KD + 4K 2 = 2K(D + K 1). Wh K D, h m f θ(x, y) w b xy hh. F xm, f K = 39 D = 200, θ(x, y) w hv 18, 564 m. Hwv, h v hk h f δ [[ ]] Eq. (3) (4). Th ky h mhm fm. A, h k f (.. h ) bw h w v, θ(x, y) θ( x, ỹ), b vy m fm θ(x, y), θ( x, ỹ) = x, x 1 k K δ [[y k = ỹ k ]] + 1 <q K δ [[y = ỹ ]] δ [[y q = ỹ q ]](5) wh x, x h v h wv f v x x. W h k h v Lb (L) K h v mh v Lb V A h. I wh h, y h k f K(x, x) (h G K, ym K) b b f x, x h v V, mv f h b wh h f h k. I h x b, w w h f h m. A b b, h bv m k w b xy h f h f v θ(x, y). 2.2 L h f F I h, w w hw h f m (1) wh h k (5). Th fw m v h v V ( b V b f [ hwty 2000]) f A J Nm, V. X, N. X, XX 20XX.

8 GJ Q. v f h [Th. 2004]. Gv xm x b v y fm h {x, y } =1, Eq. (1) (2), mf wh w hv F (y) = F (x, y ) F (x, y) = w, θ (y) 0, y y, y Y (6) wh θ (y) = θ(x, y ) θ(x, y). Thf, h m k w h m w b x ˆR({x, y } =1; w) = 1 (x, y; w) (7) =1 y y,y Y wh (x, y; w) f h { 1 f w, θ (y) 0, y y (x, y; w) =, y Y; 0 f w, θ (y) > 0, y y, y Y. O f m w h mmz h m ˆR({x, y } =1 ; w). h m ffy,, w h fw vx whh b (x, y; w) v y mmz h f : h (x, y; w) = (1 w, θ (y) ) + (9) wh ( ) + h f. y, w w f h fw m h k whh b ˆR({x, y } =1 ; w): ˆR h ({x, y } =1; w) = 1 =1 (8) y y,y Y h(x, y; w) (10) Ay, w fm z v f ˆR h ({x, y } =1 ; w) h mmz mb f h m z m Ω( w 2 ) v vf f h m. Th m w { ˆRh ({x, y } =1; w) + λ Ω ( w 2)} (11) wh Ω y my f, λ m ff bw h m k h z. A [ hwty 2000], h z m v m mh h b f h h by m θ(x, y), θ( x, ỹ) hv h m f v F (θ(x, y); w), F (θ( x, ỹ); w). h mh m v v h v f f h. I, h bv mz bm b v by vx q bm. m wh V [ hwty 2000], by k vb ξ (y) f h (x, y), h mz fm (11) b w 1 m w 2 w 2 + λ =1 y y,y Y ξ (y) (12).. w, θ (y) 1 ξ (y), ξ (y) 0y y, y Y O L m α (y) h bv q fm h L KhKhTk (KKT) hm [By Vbh 2004], h bv bm fh h fw vx q A J Nm, V. X, N. X, XX 20XX.

I A Ufy Lb Tm K h wh I A V A 9 0/1 y 1 y 4 0/1 F O I I Th f bw I y 6 0/1 h R 0/1 y 5 I I 0/1 y 3 Wk 0/1 y 2 F. 3. Gbb Rm F f v mb. Th bw h f,q(y, y q x) bw. bm (Q): mx α α (y) 1 2,y y h qy,y y j,ỹ y j α (y)α j(ỹ) θ (y), θ j(ỹ)..0 y y,y Y α(y) λ, y y, y Y, 1 (13) w = 1,y Y α (y) θ (y) (14) Dff fm h vb h v V whh y h f bv h b (x, y ), 1, h L (13) m f b y, whh m h b f y. W vy f h v h b vb y whh m v h (9) y = mx y y F (x, y; w) F (y ) < 1. A v m f h v vb α (y ), w mz v h h mmy vb Q v (.. O [ hwty 2000]). 2.3 A Jf Gbb Rm F f Lb R I h w v v f mb m hh Gbb Rm F (GRF). D mhm b GRF b f [Wk 1995]. W w Eq. (1) F (x, y; w) = w, θ(x, y) = D (y ; x) + (,q) N V,q(y, y q ; x) (15) A J Nm, V. X, N. X, XX 20XX.

10 GJ Q. D (y ; x) = 1 D, {+1, 1} w, θ, (x, y) V,q (y, y q ; x) = m, {+1, 1} wm,,q θ,q m, (x, y) wh = { 1 K} f x f h wh vy v, N = {(, q) 1 < q K} h f. Fm h GRF f vw, h f f m f N f j f h. F xm, F 3, h GRF h 6, f,, mh, wk, h by h, h (, mh), (f, ), ( mh, wk ), whh h hbh N f GRF. I h L fmwk, h N f f h,.., h GRF h fy. Nw w f h y f f GRF v xm x { H(y x, w) = F (x, y; w) = D (y ; x) + } (,q) N V,q(y, y q ; x) (17) h w hv h bby m f b v y v x h fm (y x, w) = (16) 1 x { H(y x, w)} (18) Z(x, w) wh Z(x, w) = y Y x { H(y x, w)} h f. h bby f wh x fm x w f bb h y v v h Y [Wk 1995]. I b y h wh f h b b v y, mxmz (y x, w) h xmm A (A) q mmz h y f H(y x, w) qvy mxmz F (x, y; w), whh wh Eq. (2). Thf, h L m y qv h bv f GRF. B h GRF f mb v, h L m w h bby. b Eq. (17) (18), w hv wh (y x, w) = 1 Z(x, w) (y x),q(y, y q x) (19) (,q) N (y x) = x{d (y ; x)},q (y, y q x) = x{v,q (y, y q ; x)} H (y x, w) h b f w y f m. Th f y,.., (y x), f h bby f b y f h v x. Th f m h bw h b h wv f x. N h (y x) y f h f y f f Eq. (3), h fm m h h f y f h m θ(x, y) v h bw x h v b. Th m b h y f h m,q (y, y q x). Th f v m h bw h ff, hf f Eq. (4) f h f h b. A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 11 Th bv jf h m h f v θ(x, y) f h mb bm v m. I h x, w w v m fh b h GRF. 2.3.1 Lb V. O h f f b, h b v y b b fm Eq. (2). Th m h m b b v Y f h b. Hwv, h z f h Y w bm xy wh h m f h mb K, h h m f b v y mb. F xm, wh K = 39, h z 2 39 5.5 10 11. Fy, fm h v bw L GRF 4, h f h b v y b fm h GRF fm. Thf, my xm f hq GRF b y, h A m, Gbb m,. fy, h xm hq w b b h m vb α (y) (14). Fw h bv b GRF, w v h fm f h GRF y f y. h y f m fm Eq. (14). b (14) (1) h k (5), w b h fw q: F ( x, ȳ; w) = 1,y Y α (y) θ (y), θ( x, ȳ) = D (y ; x) + (,q) N Ṽ,q(y (20), y q ; x) wh D (ȳ ; x) = 1,y Y α (y)k(x, x){ δ [[y = ȳ ]] δ [[y = ȳ ]] } Ṽ,q (ȳ, ȳ q ; x) = 1,y Y α (y){ δ [[y = ȳ ]] δ [[y q = ȳ q ]] δ [[y = ȳ ]] δ [[y q = ȳ q ]] } A h h y f { H(ȳ x, w) = D (ȳ ; x) + } (,q) N Ṽ,q(ȳ, ȳ q ; x) h bby fm f GRF b w 1 { (ȳ x, w) = Z( x, w) x H(ȳ x, } w) (23) wh Z( x, w) = y Y { x H(y x, } w) h f f h y f. Wh h bv bb GRF fm, w I (I) [Wk 1995] f f f y ffv y mm. Oh ff xm f hq (.., A m,.) b y v h bv fm. 2.3.2. Th f hm v m x h by b v. Hwv, f h v v, w w k v h f h m k f x. Wh h, h v v b k h by f h. H w v k hm b h bby fm (Eq. 23). Gv h v y, h x f y f h (22) A J Nm, V. X, N. X, XX 20XX. (21)

12 GJ Q. A Am Bh B B h mtv L w D Em ExF F F U Gvm y N D Off O h y R ky w Tk Ub V WkR WWf Wh Wh WWf WkR V Ub Tk w ky R y h O Off N D y Gvm F U F ExF Em D w L mtv h B B Bh Am A F. 4. Th mz m fm bw h f h 39 h LOL. Th m b h f h vm h xm ( 5). b m wh E(y x, y \ ) = (y = +1 x, y \ ) (y = 1 x, y \ ) (y x, y \ ) = x{ H(y y \ x,w)} Z = x{f (x,y y \ ;w)} Z (24) Z (x, y \ ) = x{ H(y y y \ x, w)} (25) {+1, 1} h f h. Th w h b x k h v f. 2.4 A I: I I 2.3, w hv v h bw h hm GRF. A h b, h hbh N f h, f L, h b. Hwv,, m my hv h wk, bh v v. F xm, h (, wk ), ( mh, ) hv my, h y, h /b f w b h /b f h (.., hy y y). B h bv, w y vv h y h N, y h k f (5) L bm θ(x, y), θ( x, ỹ) = x, x 1 k K δ [[y k = ỹ k ]] + (,q) N δ [[y = ỹ ]] δ [[y q = ỹ q ]] (26). Th f b my m by x my by v h. I hm, w m A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 13 A Am Bh B B h mtv L w D Em ExF F FU Gvm y ND Off O h y R ky w Tk Ub V WkR WWf Wh Wh WWf WkR V Ub Tk w ky R y h O Off ND y Gvm FU F ExF Em D w L mtv h B B Bh Am A F. 5. Th h m mz m fm. Th wh bk h wh f. whh h xv x b q. F, w h mz m fm [Y 2003] m h f h (, q) NmI(, q) = I(, q) m{h(), H(q)} wh I(, q) h m fm f h q, f by I(, q) = y,y q (y, y q ) (y, y q ) (y ) (y q ) H() h m y f f by (27) (28) H() = y {+1, 1} (y ) (y ) (29) H h b bb (y ) (y q ) b m fm h b h f h. A h fm hy [Y 2003], h h NmI(, q), h h bw q. h mz m f h h fw v: I mz h v [0, 1]: 0 NmI(, q) 1; NmI(, q) = 0 wh h q y ; NmI(, ) = 1 Th bv wh b, b y v b h bv f. Fm h bv, w f h h mz m fm h v [0, 1] by h mmm y. Wh h, h mz m fm y h, whh v h b f v v xm f h v. Fm h mz m fm, h wh h hh. F 4 h A J Nm, V. X, N. X, XX 20XX.

14 GJ Q. F. 6. Th v mb m k mh: I f v f m (UR) H f v v q. Th m m h b m bw h H m k b h m. By h m k L k mh, h L m (LT) k mh b b. D hm b 3 mz m fm bw h 39 LOL. Th bh h, h h mz m fm, h h f h. F xm, ( b h, w wf ), ( wh, m ). hv mz m fm. Th wh F 5 h. 3. ORRELATIVE ULTILABEL TEORAL KERNEL AHINE FOR VIDEO ANNOTATION I h, w w m k mh h bv v mb v fmwk. A fm 1.2, h m fm f v q m hz h h v ym wh v, y v v. W w m k h f ym v q. I L K f Eq. 5, w hv h h x, x v h wv f v x x b b by y h k f. Thf w mb k h hz h ym f v q. T h m k, f m (x, x) bw w v x, x h k b m hh x K(x, x) = x { (x, x) σ 2 wh σ h k. A w kw, h KbkLb Dv (KLD) wf m fm hy [v Thm 1991]. I b m h b bw w m. Thf, f m ym m h m ym f v q, KLD h b m bw hm. I h, w H kv (H) h ym m. fy, f v q (h h bh h ), w bv O = {, = 1,, T } wh h h f v f fm h v. L h b Q {1,, Q} A J Nm, V. X, N. X, XX 20XX. } (30)

A Ufy Lb Tm K h wh I A V A 15 h f h fm by. Th bby,j h bw h j. F h, h bv b ( ). I h, w G x (G) h bv b: b ( ) = ( = ) = =1 λ N( µ, Σ ) (31) wh λ q, µq, Σq h mx ff, h m v v mx f h G m vy, v h. F my, h v mx m b. Gv w v q h v H Θ, Θ, w m h KLD [v Thm 1991] bw hm: D KL (Θ Θ ) = (O Θ) (O Θ) (O Θ) (32) Hwv, h x fm x f h KLD bw h w H. Th m hfw h m h KLD h m [B 2004]. B h w f m. I h, w w v xm h [L. 2007] h b my m ffy h h h. I m m b xm f KLD bw w H. Th xm mv fm h fw b h b h h f v y [v Thm 1991]: LEA 1. Gv w mx b f = L =1 w f = L =1 v, h KLD bw hm b by D KL (f ) D KL (w v) + L =1 w D KL (f ) (33) wh D KL (w v) = L =1 w w v. Th qy y fw h m qy (. 31 f [v Thm 1991]). L bkw vb β () = ( +1 T =, Θ) h bby h h q +1 T bv v h π = [ π 1 π 2 π Q ] T h b. Th h b f h wh bv q b m by h BmWh hm [Rb 1989] (O Θ) = Q π β () (34) Thf b mm, h KLD bw w H Θ, Θ b m fm Lmm D KL (Θ Θ ) ( Q = D KL =1 π β () Q =1 π β ) () D KL (π π) + Q =1 π D KL (β () β ) (35) () Th m D KL (β () β ) () b m by z h fw v f =1 A J Nm, V. X, N. X, XX 20XX.

16 GJ Q. m: β () = b ( ) Q,j β +1 (j) (36) j=1 Th D KL (β () β ) () D KL (b b ) + D KL (, ã, ) + Q =1,j D KL (β +1 (j) β ) +1 (j) (37) W f D = [D 1 D 2 D Q ] T wh D = D KL (β () β ) () = [ 1 2 Q ] T wh = D KL (b b ) + D KL (, ã, ). Th Eq. (35) (37) h b w D KL (Θ Θ ) D KL (π π) + π T D 1 (38) D + A D +1 wh A = (,j ) Q Q h mx. Thf, w hv ( D KL (Θ Θ ) T 1 ) D KL (π π) + π T A 1 + A T 1 D Am h h m Θ y y b γ x,.., =1 (39) γ T A = γ T m πt A = γ T (40) Thf, mb h Eq. (39) (40), h KLD bw w H b D KL (Θ Θ ) ( 1 = m T T D KL Θ Θ ) γ T = Q } (41) γ {D KL (b b ) + D KL (, ã, ) =1 my, w b h v KLD ( ) Q } D KL Θ Θ γ {D KL ( b b ) + D KL (ã,, ) =1 Wh γ h y b f h m Θ. h ymm KLD ( D Θ Θ ) Q } 1 2 γ {D KL (b b ) + D KL (, ã, ) =1 Q } (43) γ {D KL ( b b ) + D KL (ã,, ) + 1 2 =1 b h bv b f h ymm KLD Eq. (30), w b h m k bw w v q K(Θ, Θ) = Q x =1 γ {D KL (b b )+D KL ( Q, ã, )}+ γ {D KL ( b b )+D KL (ã,, )} =1 2σ 2 A J Nm, V. X, N. X, XX 20XX. (42) (44)

A Ufy Lb Tm K h wh I A V A 17 Wh h bv m k, w f h v Lb Tm K (LTK) by Eq. (44) Eq. (5) K ( θ(x, y), θ( x, ỹ) ) = Q x =1 Q γ {D KL (b b )+D KL (, ã, )}+ γ {D KL ( b b )+D KL (ã,, )} =1 2σ 2 1 k K δ [[y k = ỹ k ]] + 1 <q K δ [[y = ỹ ]] δ [[y q = ỹ q ]] h mb m k y h bw h h b h m v f v q. I h, w Eq. (45) by v Lb Tm (LT) K. Fy, h KLD bw h w G b b, b h bv q b xm hh fm [Gb Awz 2005]. D KL (b b ) = 1 2 2 =1 λ k=1 (45) N(x,k µ, Σ ) N(x,k µ, Σ ) (46) Wh h m f h bv f v, x,k h m f ( Σ x,k = µ + ( )k, k = 1,, Σ ) x,+k = µ, k = 1,, (47) k Th m my h m v f h G b N(x µ, Σ ),.., h h m b v. 3.1 A Uv Rf A 3.1, w b xm h b x KLD bw w H. Th w m hv h m mb Q. Hwv, hy y h w v q, h bw h v my b h m fm 1 Q. h bw h h w m b h h h. T b h b, w f Uv Rf (UR) fm f q,.., m v q fm h. Th v w v, H b fm h UR. h m fm h UR, h w hv b bw h m. Th, h b b w b mh h h h m fm h y m. I h, h xmm A (A) hq [Gv L 1994] h H. Fmy, v h m Θ UR f h UR w bv O f h w v q, w m h w H Θ. W Θ UR h m. A [Gv L 1994], h Exxmz (E) hm h Θ y v x f h m v f G,.. T µ α µ =1 + (1 α) ( =, m = O, Θ) T =1 ( =, m = O, Θ) (48) A J Nm, V. X, N. X, XX 20XX.

18 GJ Q. 0 1 2 3 4 5 6 7 8 9 10 11 12 0 2000 4000 6000 8000 10000 12000 14000 16000 Th mb f b Th mb f v F. 7. Th mb f b f h v LOL A. 0 5000 10000 15000 20000 25000 30000 35000 40000 A A m B h B B h m T V L w D E m E x F F F U G v m y N D O f f O h y R k y w T k U b V W k R W W f W h F. 8. V h b LOL wh m h mx m v h m α h wh f v h b bw h v m h. W w α b 0.7 h xm. Th f h h m fw h E hm. 4. EXERIENT I h, w h hm h wy bhmk TREVID. W w hw h xm w k mh. (1) h mb k mh b 2. I x h v h L k. (2) h mb m k mh b 3. I h m fm L k m h wv f ym LT k h. W w m hm wh h fh mh h f m. A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 19 4.1 TREVID D T v h v hm, w h xm h bhmk TREVID 2005 [TREVID ]. Th f h m wy by my h f mm m[mb. 2006][h. 2006][Hm. 2006]. Th b 170 h b w Ab, Eh h. Th w v f my m 61, 901 bh. F h bh, 39 mb LOL [Nh. 2005]. Th f w f, m y, //,, bj, vy, v, h. F 8 h h b h. Ivy, my f h hv f m bw h h. v, h v y f by h mz m fm ( F 6). F 7 h mb f h TREVID. A hw, my bh (71.32%) hv m h b, m bh v b wh 11. h h mb bh h v w h f v fm bw h v h y f x h h bw h v. 4.2 Exm F fm v, w m hm wh w fh h f m. Th f h, IV h, h mb f m by V ( h f f F 2.) whh y h ; h h h v by x f v h f h f h [Gb w 2004]. I mm, w h V f h f v. W h xb f h BF h. Th v v 3 wh 65% (40,000 bh), 16% (10,000 bh) v h m 19% (11,901 bh). F BF, h fh w : (32000 bh) f h v V h f, h h (8000 bh) f h x f h f. F fm v, w h ff fm m Av (A) h TREVID k v m h hm h. Th A h / v fv hhy k v bh. W v h A v h 39 h m v (A), whh h v v. Th m f h hm m hh v h fm h v. F f m, h f h 3 m hm h h b fm h h m. fy, w m b m h L: h ff m λ h G k bwh σ f h G k f x, x Eq. (5) (24). Thy vy fm {0.5, 1.0, 10, 100} {0.65, 1.0, 1.5, 2.0} v h v. my, h ff m λ h G k bwh σ h IV BF vy A J Nm, V. X, N. X, XX 20XX.

20 GJ Q. 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 A A m B h B B h m T V L w D E m E x F F F U G v m y N D O f f O h y R k y w T k U b V W k R W W f W h A IV BF L(I) F. 9. Th fm m f IV, BF L(I). fm {0.5, 1.0, 10, 100} {0.65, 1.0, 1.5, 2.0}, h b h v h. 4.3 Exm O: v Lb K h I h, w xm TREVID. Tw ff m h xm. I h f xm, k h m h k f Eq. (5). W h mh by L(I) xm. I h, w h y b 4.1 b f h b h f. Ay, h k f Eq. (26), h h by L(II). A bh h x v k f wv f h kyfm f h bh [H. 2006], 1. Bkw m Lb (225D): b 5by5 v f m Lb ; 2. Tx (20D); 3. Wv Tx (128D); 4. E Db Ly (75D); m mv f 5. F (7D): f h f mb, f, h f h f. h f x y y kyfm, hy by F (F), whh ff fm h Dym F (DF) m k (Eq. (44)). 4.3.1 Exm I: Fyv. W f xm f h mb mh L (I) wh h fyv. I b bw h. F 9 h fm f L(I) m h f IV (f m) BF ( m). Th fw bv b b: A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 21 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 A A m B h B B h m T V L w D E m E x F F F U G v m y N D O f f O h y R k y w T k U b V W k R W W f W h A IV BF L(I) L(II) F. 10. Th fm m f IV, BF, L (I) L(II). L(I) b b 15.4% 12.2% v mvm A m IV BF. m h mvm f BF (2%) v h b IV, h mvm f. L(I) fm h b 28 f h 39. m f h mvm f, h ff (477% b h IV 260% b h BF), mh (68% b h IV 160% b h BF), wk (55% b h IV 48% b h BF). L(I) m m IV BF. F xm, h 12% 14% w vy 11% 17% b vy. A 4.1, h fm f. Nx b w L(II), whh v h bm b m b fm mvm. 4.3.2 Exm II: yv. Fw h h 2.4, h bm b v by mv wh f. F 6 h mz m y bw. Thy m h vm whh v, b NOT h. Th v mz m fm y Av EN = 0.02. A m f hm f m b m my. Fw h, h hh T h EN my m b T h EN = 2Av EN h h y wh mz m y h T h EN mv. F 5 hw h. A w, h v h hv v m.. w wf b h y h w b v,.. m wh wh f v bh. F 10 h fm f L(II) wh h m IV, BF L(I). W f L(II) h h b v fm m h h hm. I fm IV, BF L(I) by 17%, 14% 2%, vy. A J Nm, V. X, N. X, XX 20XX.

22 GJ Q. F. 11. Th ym f m k: h wv f x h f fm, h x f h H fm UR. I h f h x y kyfm f h bh. Fhm, L(II) h m b fm mvm v 39 m IV BF. F xm, b w, L(I) v w fm h IV BF. I h y, L(II) b 71% 3% mvm m IV 58% 1% mvm m BF wh. I mmy, L(II) h b h b b v A mvm w b fm h v 39. 4.4 Exm Tw: Lb Tm K h I h, w v h LT k mh 3. A fm, h mh fh h m fm f v q. m h fm L mh h y x f h kyfm f v bh, h LT k mh h ym f h m f h v. h ym m f mv h m bw ff v. A 3, bh q f v fm, h wv f x h fm q h h y kyfm f h bh. T h f x m, w x f vy fm. I, w y x h f h f fm. Th x f h h H f h bh. I m, A v f m f 5000 v bh whh my fm h. Th f h bh, H fm h UR Eq. (48) E hm ( 3.2 f ). Th wv f x h v fm h m h f xm. Hwv, hy x fm q ym m, w hm Dym F (DF) ( F 11). F h k f h f m, w fw h m xm xm. Tb 1 h fm f LT k mh wh h m f IV, BF, L(I), L(II). Fm h, w f Th LT mh h h b v fm m f A. I fm h IV, BF, L(I) L(II) by 35.0%, 31.3%, 17.0%, 14.7%. A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 23 IV BF L(I) IL(II) LT A 0.1005 0.1019 0.1712 0.2325 0.2563 Am 0.5265 0.5336 0.5302 0.55824 0.7193 B h 0.087 0.0798 0.0849 0.0707 0.0779 B 0.3375 0.3538 0.3486 0.3585 0.3952 B 0.0669 0.0724 0.0602 0.1147 0.1706 0.2469 0.2673 0.2983 0.3296 0.4185 h 0.0981 0.0709 0.1277 0.182 0.2558 m TV 0.3773 0.3927 0.3976 0.3438 0.379 L 0.0112 0.014 0.03 0.0438 0.0483 0.1462 0.1568 0.294 0.232 0.2558 w 0.3073 0.3598 0.3775 0.3676 0.4053 D 0.1047 0.1053 0.0902 0.125 0.1378 Em 0.1174 0.1687 0.14 0.1171 0.1291 Ex F 0.1773 0.1768 0.2755 0.3447 0.38 F 0.8779 0.8782 0.8854 0.9062 0.9762 FU 0.0571 0.0563 0.0759 0.084 0.0926 Gvm 0.0774 0.0838 0.1029 0.1515 0.167 0.3147 0.3206 0.4347 0.4156 0.5228 0.2208 0.2391 0.183 0.232 0.2558 y 0.2202 0.2337 0.2405 0.2571 0.2394 0.1367 0.135 0.1397 0.148 0.1632 ND 0.0462 0.0381 0.0633 0.0664 0.0932 Off 0.044 0.0706 0.2541 0.1053 0.1161 O 0.823 0.8517 0.8695 0.8607 0.8166 h 0.095 0.0998 0.1595 0.1561 0.2949 0.8441 0.8535 0.8453 0.844 0.9856 y 0.0301 0.0253 0.02 0.058 0.0639 0.0026 0.0016 0.0039 0.0096 0.0106 R 0.2169 0.2158 0.2249 0.2656 0.2928 ky 0.4204 0.4261 0.4281 0.4213 0.4645 w 0.3625 0.37 0.3179 0.374 0.4123 0.2025 0.2194 0.329 0.3226 0.3998 0.8109 0.8448 0.889 0.8283 0.9132 Tk 0.0552 0.0529 0.0727 0.1381 0.1523 Ub 0.151 0.1528 0.1517 0.1861 0.2052 V 0.2596 0.2511 0.2537 0.2675 0.2949 Wk R 0.2094 0.2188 0.3251 0.2565 0.3828 W Wf 0.2049 0.2219 0.3055 0.2642 0.2913 Wh 0.22 0.169 0.2898 0.2765 0.3364 A 0.2463 0.2534 0.2843 0.2901 0.3326 Tb I. Th v v 39 LO f h fv hm: IV, BF, L(I), L(II), LT. Th LT h b v fm f h hm, fm h h f hm 30 f 39. LT h b fm 30 f h wh 39. v, f v,.., Ex F, ND, h, Wk R, h LT fm h h f mh, b k v f h m ym h v. A J Nm, V. X, N. X, XX 20XX.

24 GJ Q. 5. ONLUION W v Lb (L) k mh h v h b h f h v. I x h v h fm. Fhm, m k b h L fm fm v Lb Tm (LT) k mh. Th w k mh k y f ym b m. I by h f mmm wh y x h v. Exm bhmk TREVID m h f mvm b m h fh hm h h w m f v. REFERENE BERG, B. A. 2004. kv h m h y. W f. BOYD,. AND VANDENBERGHE, L. 2004. vx Omz. mb Uvy. ABELL,. AND ET AL. 2006. Ibm h v2006 v v ym. I TRE V Rv Ev (TREVID). HANG,.F. AND ET AL. 2006. mb vy v2006 v h hhv f x. I TRE V Rv Ev (TREVID). OVER, T. AND THOA, J. 1991. Em f fm hy. Jh Wy, Nw Yk, UA. RITIANINI, N. AND HAWETAYLOR, J. 2000. A v mh h kb mh. mb Uvy. EBADOLLAHI,., XIE, L., HANG,.F., AND ITH, J. R. 2006. V v mm ym. I IEEE I f IE. GAUVAIN, J.L. AND LEE,.H. 1994. xmm m f mv mx bv f mkv h. IEEE T h A 2, 2, 291 298. GODBOLE,. AND ARAWAGI,. 2004. Dmv mh f mb f. I AKDD. GOLDBERGER, J. AND ARONOWITZ, H. 2005. A m bw mm b h fm k. I INTEREEH. HAUTANN, A., HEN,.Y., AND HRITEL,. 2004. f x: Ifm TREVID 2004. I TRE V Rv Ev O. HAUTANN, A. G. AND ET AL. 2006. b w v. I TRE V Rv Ev (TREVID). HUA, X.., EI, T., LAI, W., WANG,., TANG, J., QI, G.J., LI, L., AND GU, Z. 2006. f h v 2006 hhv f x h x. I O. f h TREVID wkh. JIANG, W., HANG,.F., AND LOUI, A. 2006. Av b f wh b. I f IEEE I f Im. LAFFERTY, J., ALLU, A., AND EREIRA, F. 2001. m f: bb m f m b q. I. f I f IL. LIU,., OONG, F. K., AND ZHOU, J.L. 2007. Dvb my m f k m v. I IEEE I f IA. ARR, D. 1982. V. W.H.Fm my. NAHADE,., KOZINTEV, I., AND HUANG, T. 2002. F h fmwk f m v x. IEEE T. VT 12, 1 (J.). NAHADE,. R. 2002. hq v mm. I IEEE Wkh m. NAHADE,. R., KENNEDY, L., KENDER, J. R., HANG,.F., ITH, J. R., OVER,., AND HAUTANN, A. 2005. A h y f mm f TREVID 2005. I IB Rh R R23612 (W0505104). NIGA, K., LAFFERTY, J., AND ALLU, A. 1999. U mxmm y f x f. I IJAI99 Wkh h L f Ifm F. 61 67. A J Nm, V. X, N. X, XX 20XX.

A Ufy Lb Tm K h wh I A V A 25 RABINER, L. R. 1989. A h mkv m h. f h IEEE 77, 2, 257 286. ITH, J. R. AND NAHADE,. 2003. m m x m v. I f IEEE I f m Ex. NOEK,. G.., WORRING,., GEERT, J.., GEUEBROEK, J.., AND EULDER, A. W.. 2006. Th h bm f m f 101 m mm. I f h A I f m. Bb, UA, 421 430. TANG, J., HUA, X.., QI, G.J., WANG,., EI, T., AND WU, X. 2007. v mf k f v. I A I f m. TREVID. h://www..v/j/v/. TOHANTARIDI, I., HOFANN, T., JOAHI, T., AND ALTUN, Y. 2004. v mh f. I. f I f IL. WANG, T., LI, J., DIAO, Q., HU, W., ZHANG, Y., AND DULONG,. 2006. m v m f. I. f IEEE VR Wkh. WINKLER, G. 1995. Im y, m f ym mh: A mhm. V, B, Hb. WU, Y., TENG, B. L., AND ITH, J. R. 2004. Oyb mf f v. I f IEEE I f m Ex. XIE, L. AND HANG,.F. 2002. y f v wh h mkv m. I IEEE I f IA. YAO, Y. Y. 2003. Ey m, mxmm y, m., h Ifmh m f kw vy m, 115 136. ZHA, Z.J., EI, T., HUA, X.., QI, G.J., AND WANG, Z. 2007. Rf v by x w. I A I f m. Rv Jy 2008; XX XXXX A J Nm, V. X, N. X, XX 20XX.