htt://www.cub.buffalo.edu Iteratve Method for Searchng Otmal Clafer Combnaton Functon Sergey Tulyakov Chaohong Wu Venu Govndaraju Unverty at Buffalo
Identfcaton ytem: Alce Bob htt://www.cub.buffalo.edu Bometrc Alcaton Fngerrnt matchng 6 Face matchng.35.57 f S f S arg max =... Verfcaton ytem: Alce 6.35 f S > θ Accet Reject f f f f Queton: f we fnd otmal and t necearly?
htt://www.cub.buffalo.edu Handwrtten Word Recognton Identfcaton ytem: Amhert Buffalo WMR 5.6 7.4 CMR.5.8 f S f S arg max =... Verfcaton ytem: Amhert 5.6.5 f S > θ Accet Reject f f f f Queton: f we fnd otmal and t necearly?
htt://www.cub.buffalo.edu Verfcaton Sytem Pattern clafcaton aroach clae genune and motor verfcaton attemt Bometrc core Imotor Genune Bometrc core Mnmum rk mnmzaton crtera: otmal decon boundare concde wth the contour of lkelhood rato functon: f gen lr = m f = The roblem eay can drectly recontruct dente or ue multle attern clafcaton algorthm SVM etc. f lr
htt://www.cub.buffalo.edu Lkelhood Rato Combnaton Functon for Identfcaton Sytem Mnmzng mclafcaton cot:...... j ω ω > Clafy a rather than ω ω j Aume that core agned to dfferent clae are ndeendent:............... m gen m = = ω ω ω ω The nequalty become:............ m j j gen m m gen m >
htt://www.cub.buffalo.edu Lkelhood Rato Combnaton Functon for Identfcaton Sytem Or: gen m > gen m j j j j Thu obtaned lkelhood rato combnaton rule: The nut hould be clafed a arg max =... f lr If core agned by clafer to dfferent clae are ndeendent then lkelhood rato combnaton rule the otmal combnaton rule for dentfcaton ytem
Exerment htt://www.cub.buffalo.edu Handwrtten word recognzer: CMR WMR; lexcon of ze 680 word Bometrc matcher: fngerrnt l\v and face G from IST BSSR et; 988 enrolled eron Total Tral t Matcher Correct nd Matcher Correct Both Correct Ether Correct Lkelhood Rato Weghted Sum CMR & WMR 647 3366 4744 3005 505 493 505 l & C 598 4870 4856 3937 5789 587 586 l & G 598 4870 4635 3774 573 5737 57 Exermental error? - The erformance of lkelhood rato combnaton rule for handwrtten word recognzer wore than the erformance of a ngle WMR recognzer
htt://www.cub.buffalo.edu Verfcaton Sytem: WMR & CMR
htt://www.cub.buffalo.edu Verfcaton Sytem: bometrc l & C
htt://www.cub.buffalo.edu Verfcaton Sytem: bometrc l & G
htt://www.cub.buffalo.edu Deendence of Identfcaton Tral Score Lkelhood rato combnaton fal for dentfcaton ytem Thu we can not aume that dentfcaton tral core agned to dfferent clae are ndeendent Correlaton of genune core wth ome tattc of motor core dentfcaton tral et: t Im nd Im 3 rd Im mean CMR.4359.4755.477.45 WMR.7885.785.7673.5685 l.364.3400.3389.96 C.49.53.56.440 G.339.800.87.593
htt://www.cub.buffalo.edu Obervaton of Score Deendence T.K. Ho PhD the 993: mage qualty nfluence OCR core and rank rovde more nformaton durng combnaton OCR A.95 B.89 C.76 OCR A.80 B.54 C.43 convert core to rank ue to core
Hyothetcal dente of genune and motor core: htt://www.cub.buffalo.edu Examle How uch dtrbuton were generated? Cae : genune and motor core are amled ndeendently from correondng dente Cae : n every dentfcaton tral: m = gen Verfcaton ytem : both cae have ame erformance Identfcaton ytem : econd cae ha erfect erformance genune core alway on to Concluon: erformance of a matcher n dentfcaton ytem can be dfferent from t erformance n verfcaton ytem
htt://www.cub.buffalo.edu Examle Combne two matcher: one a n cae another a n cae Lkelhood rato combnaton rule: Incorrectly clafed dentfcaton tral: ω Cae matcher Cae matcher f + ω lr = = 0. 0. Wnner Concluon: the lkelhood rato combnaton rule mght have wore erformance n dentfcaton ytem than ngle matcher a n CMR&WMR ex
Genune core Imotor core Examle 3 = x y gen gen + m = xm + y htt://www.cub.buffalo.edu xgen ~ X gen xm ~ X m y ~ gen X m Y - ndeendent dtrbuton X - gauan y - the ame for dentfcaton tral Can rove: the otmal combnaton functon for dentfcaton ytem wth uch dtrbuton f + lr =
Examle 3 htt://www.cub.buffalo.edu Deendng on the dtrbuton of the otmal combnaton functon can dffer gnfcantly from the one of dentfcaton ytem. Y E.g.: Y unformly dtrbuted on [ 0 ] Concluon: genune and motor core dtrbuton mght not have enough nformaton to deduce the otmal combnaton functon for dentfcaton ytem.
htt://www.cub.buffalo.edu Tranng Ung Identfcaton Tral Score Set Bometrc core Imotor Genune Bometrc core Imotor Genune Bometrc core Bometrc core o! Bometrc core Imotor Bometrc core Genune The tranng of the dentfcaton ytem combnaton hould roce core from one dentfcaton tral a a ngle tranng amle.
htt://www.cub.buffalo.edu Aroxmatng Otmal Combnaton Functon n Identfcaton Sytem Algorthm: Intalze ome combnaton functon Do for all dentfcaton tral: Get core from ame dentfcaton tral Adjut combnaton functon Crtera for adjutng combnaton functon: genune core hould be obly better than any motor core of the ame dentfcaton tral et
htt://www.cub.buffalo.edu Condered Algorthm Bet Imotor Lkelhood Rato: where motor denty traned ung the et of bet motor determned teratvely Sum of logtc functon Combnaton functon hould be monotonc o aroxmate t a a um of monotonc logtc functon The coeffcent are choen o that the genune core earated from the bet motor core n current dentfcaton tral teratve algorthm M f ' M m M gen M f = 0 + = + + + + + j M M M M e l α α α α α
htt://www.cub.buffalo.edu Identfcaton Sytem Performance Lkelhood Rato Weghted um Bet Imotor Lkelhood Rato Logtc Sum Weghted Sum + Identfcaton Model CMR&WMR 493 505 49 5005.5 505.5 l & C 587 586 5803 583 586 l & G 5737 57 574 5753 5760
htt://www.cub.buffalo.edu Bg Pcture Preented combnaton rule are of low comlexty combnaton tye. Ung other tye medum II dentfcaton model can gnfcantly mrove erformance. Identfcaton model nherently account for core deendence.
htt://www.cub.buffalo.edu Identfcaton Model for l&c
htt://www.cub.buffalo.edu Identfcaton Model for l&g
htt://www.cub.buffalo.edu Identfcaton Model for WMR&CMR Verfcaton Sytem