Speaker Identification using Spectrograms of Varying Frame Sizes

Transcription

1 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 Spkr Idnifiion using Sprogrms of Vrying Frm Sizs H. B. Kkr Phd,Snior Profssor, Compur Dp., MPSTME, NMIMS Univrsiy Mumbi, 4-56, Indi. Vishli Kulkrni PhD Sholr, ssoi Profssor, EXTC Dp., MPSTME, NMIMS Univrsiy. Mumbi, 4-56, Indi. Prshn Gikr, Nishn Gup Sudn B.Th) EXTC Dp., MPSTME, NMIMS Univrsiy. Mumbi, 4-56, Indi. BSTCT In his ppr, x dpndn spkr rogniion lgorihm bsd on sprogrm is proposd. Th sprogrms hv bn gnrd using Disr Fourir Trnsform for vrying frm sizs wih 25 nd 5 ovrlp bwn sph frms. Fur vor xrion hs bn don by using h row mn vor of h sprogrms. For fur mhing, wo disn msurs, nmly Eulidn disn nd Mnhn disn hv bn usd. Th rsuls hv bn ompud using wo dbss: lolly rd dbs nd spkr rogniion dbs. Th mximum ury is for n ovrlp of 5 bwn sph frms wih Mnhn disn s similriy msur. Gnrl Trms Spkr Idnifiion, Sprogrms Kywords Disr Fourir Trnsform DFT), ow Mn, Eulidn Disn, Mnhn disn 1. INTODUCTION Th gol of uomi spkr rogniion sysms is o xr, hrriz nd rogniz h informion in h sph signl for onvying spkr idniy [1]. Spkr rogniion is dividd ino wo rs: spkr idnifiion nd spkr vrifiion. Spkr idnifiion is diding if spkr is spifi prson or is mong group of prsons [1]. Spkr vrifiion is diding if spkr is who h/sh lims o b [2]. Spkr vrifiion is 1:1 mh whr on spkr's voi is mhd o on mpl whrs spkr idnifiion is 1: N mh whr h voi is omprd gins N mpls. lgorihms dvlopd for spkr rogniion dpnd on whhr h sysm bing nlyzd is bsd on x dpndn or x indpndn sph smpls. In x dpndn rogniion, h phrs is known o h sysm nd n b fixd or prompd. In x indpndn rogniion h sysm mus b bl o rogniz h spkr from ny x [1, 4, nd 5]. sprogrm dsribs how h sprl dnsiy of signl vris wih im. Th mos ommonly usd form of sph sprogrm is h frquny vrsus im plo wih hird dimnsion indiing h mpliud of priulr frquny priulr im rprsnd by h innsiy or olor of h poin in h img. Th onp of using sprogrms for spkr idnifiion hs bn round for dds. On of h firs mps for uomi spkr rogniion wr md in h 19s [3]; by using filr bnks nd orrling wo digil sprogrms for similriy msur [6]. suls of xprimns rld o spkr idnifiion by sph sprogrms hv bn omprd nd disussd s rly s 1969[7]. Svrl hniqus hv bn dvlopd for prn mhing in sph signls using sprogrms. Thniqu in [8] dsribs h sprogrm bnd s lusr nd is mn pixl vlu, h nroid of lusr. Hn, givn n unknown spkr's urn of known word, w would b looking for h dbs smpl of h priulr word wih ordrd lusr nroids hving h loss Eulidn disn wih hos of h unknown spkr. Comprison of rnsformions suh s h DCT, Hr nd Wlsh on h sprogrms hs bn disussd in [9]. Using row mn on Kkr s rnsform of sprogrm imgs of diffrn frm sizs for spkr idnifiion [1] nd pplying 2D DCT on full/blok sprogrm nd 1D DCT on row mn of sprogrm [11] hv shown fvorbl rsuls. Th ppr is orgnizd s follows; Sion 2 dsribs h sprogrm gnrion hniqu, Sion 3 xplins h fur vor xrion pross, in sion 4 h fur mhing hs bn xplind, followd by h dision mking in Sion 5, in Sion 6 brif dsripion of h dbs is givn. Sion 7 disusss h rsuls nd onlusion is givn in Sion SPECTOGM GENETION For h prsn work on Spkr Idnifiion, sprogrms hv bn gnrd using h following sps [12, 13]: 1. Th sph signl hs bn firs dividd ino frms, of sizs from 32 o 512 wih sp siz of 32 wih n ovrlp of 25 or Ths frms hv bn rrngd olumn wis o form mrix. E.g. if h sph signl is on dimnsionl signl of This is firs dividd ino frms of 256 smpls h wih n ovrlp of 25 bwn onsuiv frms i.. ovrlp of 64. Ths 229 frms r hn rrngd olumn wis o form mrix of dimnsion Disr Fourir Trnsform DFT) hs hn bn pplid o his mrix olumn wis. 4. Th sprogrm hs hn bn plod s h bsolu mgniud of his rnsform mrix. In Fig. 1 ) sph signl of on of h spkr in h dbs is shown. Fig. 1 shows h sprogrm gnrd for his sph signl using psudo olors. Thr is lo of informion in h mporl-sprl dynmis onind in h ompl sph signl h n hlp spkr-idniy. Fig. 2 shows h sprogrms of wo diffrn spkrs for wo diffrn irions of h sm snn. Fig. 2 ) shows h sprogrm of spkr 1 for irion 1. Fig. 2 shows h sprogrm of spkr 2 for irion 1. s n b sn hr is lo of diffrn bwn hs wo sprogrms. Fig. 2 ) shows h sprogrm of spkr 1 for irion 2. Thr is similriy bwn Fig. 2 ) nd Fig. 2 ). Fig. 2 d) shows h sprogrm of spkr 2 for irion 2. Thr is 27

2 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 ) Fig. 1 Sph nd is sprogrm ) Spkr 1, irion 1 Spkr2,irion1 ) Spkr 1, irion 2 d) Spkr 2, irion 2 Fig. 2 Sprogrms of h sm snn for wo diffrn spkrs for frm siz of 256 wih 25 ovrlp. ) Spkr 1, irion 1 b) Spkr 2, irion 1 ) Spkr 1, irion 2 d) Spkr 2, irion 2. 28

3 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 similriy bwn Fig. 2 nd Fig. 2 d). Thus s n b sn visully, h sprogrm hs h mporl-sprl informion whih n b usd o idnify spkr. 3. FETUE VECTO EXTCTION Th produr for fur vor xrion is givn blow: Th sprogrms of ll h sph wvforms hv bn gnrd for h diffrn frm sizs s dsribd in sion 2. Th mn of h bsolu vlus of h rows of h sprogrm mrix is hn luld. Ths row mns form olumn vor M 1), whr M is h numbr of rows in h sprogrm mrix. This olumn vor forms h fur vor for h sph smpl. Th fur vors for ll h sph smpls hv bn luld for diffrn vlus of n frm siz) nd sord in h dbs. 4. FETUE MTCHING In h work proposd in his ppr wo disn msurs, Mnhn Disn MD) nd Eulidn Disn ED) hv bn xplord nd ompriv prformn of boh hs bn givn. Mnhn disn MD) [15] is dfind s h Minkowiski disn of h ordr 1 or 1-norm disn whr p=1). Th 1-norm disn is lld h xib norm or Mnhn disn, bus i is h disn r would driv in iy lid ou in squr bloks if hr r no onwy srs). In n dimnsions, h MD bwn wo poins nd B is givn by q. 1), whr xi or yi) is h oordin of or B) in dimnsion i. n d x y 1) B i i i 1 Eulidn disn is dfind s h Minkowiski disn of h ordr 2 or 2-norm disn whr p=2). Eulidn Disn ED) [14, 15] is dfind s h srigh lin disn bwn wo poins. I is wh would b obind if h disn bwn wo poins wr msurd wih rulr: h "inuiiv" id of disn. In n dimnsions, h ED bwn wo poins nd B is givn by q. 2), whr xi or yi) is h oordin of or B) in dimnsion i. n 1/ 2 2 d B xi yi 2) i 1 indx i h yilds h minimum disn, whr i is givn by q. 3). i = min i disx, Si) 3) whr h minimum is kn ovr h spkr dbs S. In h opn s idnifiion sk, h dision is givn s givn by q. 4). i, p dis X, Si ) 4), rj Whr Θi is h hrshold. Th hrshold n b s h sm for ll spkrs, or i n b spkr-dpndn. Th hrshold is drmind so h dsird bln bwn h wo yps of rrors Fls pn ) nd Fls jion F) is hivd [5, 16]. F nd r givn by q. 5) nd q. 6) rspivly. F = ru lims rjd/ol ru lims) = imposr lims pd/ol imposr lims) i 5) 6) G = F 7) G givn by q. 7) is dfind s h Gnuin pn G), in prng. Thus is h rror wih whih n imposr is pd nd F is h rror wih whih gnuin or ru spkr is rjd. Thr is rd-off bwn h wo rrors. Whn h dision hrshold Θ i is inrsd: inrss bu F drss, nd vi vrs. Th bln bwn hs wo dpnds on h ppliion. Sin ihr of h wo yps of rrors n b rdud h xpns of n inrs in h ohr, msur of ovrll sysm prformn mus spify h lvls of boh yps of rrors. Th rd-off bwn nd F is funion of h dision hrshold. nd F r plod gins h dision hrshold. Th poin of inrsion of hs wo urvs is dfind s h Equl Error EE). Th EE is h vlu for whih h nd F r qul. Th sysm prformn n b givn by Prformn indx PI), whih is dfind s givn by q. 8). PI ) = -EE ) 8) 5. DECISION MKING Th finl sp in spkr rogniion pross is h dision mking. Th fur xrion nd prn mhing r sm for diffrn spkr rogniion sks, bu h dision dpnds on h sk: losd s or opn s. L us dno gnrlly spkr modl of spkr i by Si, nd l S = {S1,,SN} b h spkr dbs of N known spkrs. Wihou ssuming spifi spkr modl/lssifir, l sorx, Si) b h mh sor bwn h unknown spkr s fur vors X = {x1,.,xt} nd h spkr modl Si. In h s of disn bsd lssifirs, minimum disn orrsponds o bs mh. In losd-s spkr idnifiion sk, h dision is simply h spkr 5. DTBSE DESCIPTION 5.1 Lolly Crd Dbs Th sph smpls usd in his work r rordd using Sound Forg 4.5. Th smpling frquny is Hz 8 bi, mono PCM smpls). Tbl I shows h dbs dsripion. Th smpls r olld from diffrn spkrs. Fiv irions of four diffrn snns,, nd ) of vrying lnghs r rordd from h of h spkrs. Twny smpls pr spkr r kn. For x dpndn idnifiion, four irions of priulr snn r kp in h dbs nd h rmining on irion is usd for sing. Ths sph signls hv mpliud rng of -1 o

4 5.2 Vois for Spkr ogniion Vrsion 1.1 Th Spkr ogniion Dbs onsiss of lphonilly rordd sph spnning wlv olld ovr wo yr priod. Ths sph signls hv vry low mpliud rng. Ths signls r sld up o h lvl -1 o +1. lso prprossing ws don o rmov h long siln prs in bwn h words. Prmr Lngug Tbl1. Dsripion of Lol Dbs No. of Spkrs 17 Sph yp ording ondiions Smpling frquny soluion Prmr Lngug Smpl hrrisis English d sph, mirophon rordd Norml Hz 8 bps Tbl2. Dsripion of Dbs No. of Spkrs 77 Sph yp ording ondiions Smpling frquny soluion Smpl hrrisis English d sph, lphonilly rordd Norml Hz 16 bps 6. ESULTS ND DISCUSSION Th xprimns hv bn prformd on sprogrms of diffrn frm sizs wih 25 nd 5 ovrlp bwn onsuiv frms. In h firs s of xprimn, sprogrms gnrd wih 25 ovrlp hv bn onsidrd. Th rsuls hv bn ompud on h four snns,, nd ) of h lol dbs nd on phrs of h dbs. Th row mn whih forms olumn vor s dsribd in sion 3 forms h fur vor. For losd s idnifiion, h fur vors hv bn luld for h rfrn sph smpls nd sord in h dbs. For sing, h s sph smpl hs bn similrly prossd nd fur vor hs bn ompud. Th similriy msur Eulidn disn ED) or Mnhn Disn MD) bwn h dbs fur vors nd s u r y ) 4 2 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 fur vor hs bn luld. Th spkr whos rfrn fur vor givs h minimum disn wih h s fur vor hs bn dlrd s h spkr rognizd. Fig. 3 shows h prformn of DFT sprogrm for vrying frms sizs wih 25 ovrlp for h diffrn snns. Fig. 3 ) shows h rsuls wih ED s similriy msur. I n b sn from h rsuls h, ury inrss s h fur vor siz is inrsd up o rin vlu for ll h snns. fr h h ury drss or rmins lmos h sm lvl. Th mximum ury for is for fur vor of siz 4, for i is 85.4 for fur vor of siz 4. givs mximum ury of for fur vor of siz 32. givs mximum ury of 9.65 whih is obind for fur vor of siz 352. Th dbs givs omprivly lowr rsuls wih mximum ury of for fur vor of siz 64. Fig. 3 shows h rsuls wih MD s similriy msur. Th mximum ury for is for fur vor of siz 96, for i is for fur vor of siz 512. givs mximum ury of for fur vor of siz 4. givs mximum ury of whih is obind for fur vor of siz 224. Th dbs givs omprivly lowr rsuls wih mximum ury of for fur vor of siz 1. Th omprison of h bs prformn of DFT sprogrm wih 25 ovrlp for ED nd MD r shown in Tbl 3. In h work proposd in his ppr, opn s idnifiion hs bn don on on snn from h lol dbs, for whih h sph smpls from h imposr spkrs hv bn olld. Thr r 31 imposr spkrs. For h opn s idnifiion, Fls jion F) nd Fls pn ) hv bn luld for for h frm siz of 352 nd 224 wih 25 ovrlp for ED nd MD rspivly by vrying h hrshold. Fig. 4 ) shows h r for nd F wih ED for vrying hrshold. Th EE is 13.7 nd h PI is Fig. 4 shows h r for nd F wih MD for vrying hrshold. Th EE is 16.9 nd h PI is In h problm of Spkr Idnifiion, h prmr EE dos no ply ny imporn rol. Howvr, h hrshold vlu, whih givs h mrgin of oprion for, is imporn. Hn for ompring prformn of DFT for hrshold prmr, h rio of mximum prmissibl hrshold nd rossovr poin EE) of nd F hs bn onsidrd. Th onfli for sm rio is rsolvd by onsidring G poin whr is. Tbl 4 givs h ompriv hrshold prformn of DFT sprogrm wih 25 ovrlp for nd G wih rsp o boh similriy msurs ED nd MD. ury of DFT sprogrm wih ED for diffrn frm sizs wih 25 ovrlp No. of fur vors ) 3

5 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 ury of DFT Sprogrm wih MD for diffrn frm sizs wih 25 ovrlp 9 7 u 5 r y 1 ) No. of fur vors Fig. 3: ury of DFT sprogrm wih 25 ovrlp bwn frms. ) wih ED nd b) wih MD F Prformn of DFT Sprogrm for 25 ovrlp EE=13.7 PI= Thrshold Eulidn disn) F Prformn of DFT Sprogrm for 25 ovrlp EE=16.9 PI=83.1 Thrshold Mnhn disn) F F ) Fig. 4. -F for DFT sprogrm for frm siz of 352 nd 224 wih 25 ovrlp for ED nd MD rspivly for vrying hrshold. Tbl 3 Bs rsuls for DFT sprogrm wih 25 ovrlp Snn Tol smpls sd ED s similriy msur Fur vor ury ) MD s similriy msur Fur vor ury ) Tbl 4 Comprison of Thrshold of DFT sprogrm wih 25 ovrlp for nd G wih ED nd MD. Similriy msur G for Thrshold EE ED MD ury of DFT sprogrm wih ED for vrying frm sizs wih 5 ovrlp u r y ) No. of fur vors ) 31

6 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 ury of DFT sprogrm for vrying frm sizs wih 5 ovrlp u r y ) No. of fur vors Fig. 5: ury of DFT sprogrm wih 5 ovrlp bwn frms. ) wih ED nd b) wih MD F Prformn of DFT Sprogrm wih 5 ovrlp EE=12.65 PI= Thrshold Eulidn disn) -F Prformn of DFT Sprogrm wih 5 ovrlp EE=18 PI=82 Thrshold Mnhn disn) F F ) Fig. 6: -F for DFT sprogrm for frm siz of 192 wih 5 ovrlp for ED nd MD for vrying hrshold. Tbl 5 Bs rsuls for DFT sprogrm wih 5 ovrlp Snn Tol smpls sd ED s similriy msur Fur vor ury ) MD s similriy msur Fur vor ury ) Tbl 6 Comprison of Thrshold of DFT sprogrm wih 5 ovrlp for nd G wih ED nd MD. Similriy msur G for EE Thrshold ED mpliud MD In h sond s of xprimn, sprogrms gnrd wih 5 ovrlp hv bn onsidrd. Fig. 5 shows h rsuls obind for h diffrn frm sizs wih 5 ovrlp. Fig. 5 ) shows h rsuls wih ED s similriy msur. Th bs rsul is whih hs bn obind for for fur vor of siz 192. Fig. 5 shows h rsuls wih MD s similriy msur. Th bs rsul is whih is obind for for fur vor of siz 384. Th omprison of h bs prformn of DFT sprogrm for 5 ovrlp wih ED nd MD is shown in Tbl 5. For h opn s idnifiion, F nd ws luld for for h frm siz of 192 wih 5 ovrlp by vrying h hrshold. Fig. 6 ) shows h r for nd F wih ED s h hrshold. Th EE is nd h PI is Fig. 6 shows h r for nd F wih ED for vrying hrshold. Th EE is 18 nd h PI is 82. Tbl 6 givs h ompriv hrshold prformn of DFT sprogrm wih 5 ovrlp for nd G wih rsp o boh similriy msurs ED nd MD. From hs xprimns i n b obsrvd h: Th ury inrss s h fur vor siz frm siz) is inrsd. I n b obsrvd h for ED, 25 ovrlp givs mximum ury of for frm siz of 32, whrs 5 ovrlp givs sm ury for frm siz of 192 rduing h ompuionl omplxiy by for of For MD, h mximum ury wih 25 ovrlp is nd i inrss o wih 5 ovrlp. s fr s /F rsuls r onrnd, h prformn is muh br wih 5 ovrlp. I n b sn h for 5 ovrlp, MD givs br prformn wih G of for hrshold lvl of of h EE. 32

7 Inrnionl Journl of Compur ppliions ) Volum 5 No.2, July 212 ury lso dpnds on h nur nd lngh of h snns in h dbs. Th rsuls obind for nd whih r longr hn nd r br. Insrumnion usd for rording voi lso plys n imporn rol in diding h ury of spkr idnifiion. Th rsuls of dbs r poorr s omprd o h lol dbs bus is lphoni rording whrs for h dbs mirophon, whih hs lrgr bndwidh, hs bn usd. 7. CONCLUSION In his ppr, w hv proposd hniqu for xdpndn spkr idnifiion for losd s s wll s opn s using row mn of sprogrms i n b obsrvd h ury inrss wih h siz of fur vor. lso 5 ovrlp givs omprbl rsuls wih lssr ompuionl omplxiy. Mnhn disn MD) hs dg ovr Eulidn disn ED). Th mximum ury is wih 5 ovrlp wih MD s similriy. Th sudy is ongoing nd diffrn hniqus o xr h furs from h sprogrm r bing xplord. 8. EFEENCES [1] D.. ynolds, n ovrviw of uomi Spkr ogniion Thnology, ICSSP 22, pp [2] J. M. Nik, Spkr Vrifiion: Tuoril, IEEE Communiions Mgzin, Jnury 199, pp [3] S. Furui, Fify yrs of progrss in sph nd spkr rogniion, Pro. 148h S Ming, 24. [4] F. Bimbo, J.-F. Bonsr, C. Frdouill, G. Grvir, I. Mgrin-Chgnollu, S. Mignir, T. Mrlin, J. Org- Grí, D.Provsk-Dlréz, nd D.. ynolds, uoril on x-indpndn spkr vrifiion, EUSIP J. ppl. Signl Pross., no. 1, pp , 24. [5] Josph P. Cmpbll, Jr., Snior Mmbr, IEEE, Spkr ogniion: Tuoril, Prodings of h IEEE, vol. 85, no. 9, pp , Spmbr [6] S. Pruznsky, Prn-mhing produr for uomi lkr rogniion, J..S.., 35, pp , by Sph Sprogrms, Sin Volum 166, pp ) [8] T. Du, Tx Dpndn Spkr Idnifiion Bsd on Sprogrms, Prodings of Img nd Vision Compuing Nw Zlnd 27, pp , Hmilon, Nw Zlnd, Dmbr 27. [9] Dr. H. B. Kkr, Dr. Tnuj K. Srod, Shhi J. Nu, Prhi J. Nu, "Spkr Idnifiion Using 2-D DCT, Wlsh nd Hr On Full nd Blok Sprogrm", IJCSE) Inrnionl Journl on Compur Sin nd Enginring Vol. 2, No. 5, 21, [1] Dr. H. B. Kkr, Vishli Kulkrni, Spkr Idnifiion using row Mn of Hr nd Kkr s Trnsform on Sprogrms of Diffrn Frm Sizs, Inrnionl Journl of dvnd Compur Sin nd ppliions, Spil Issu on rifiil Inllign. [11] H. B. Kkr, Tnuj Srod, Shhi Nu, Prhi Nu, Prformn Comprison Of 2-D DCT On Full/Blok Sprogrm nd 1-D DCT On ow Mn Of Sprogrm For Spkr Idnifiion, Sld) CSC-Inrnionl Journl of Biomris nd Bioinformis IJBB), Volum 4): Issu 3). [12]. V. Oppnhim, Sph sprogrms using h fs Fourir rnsform, IEEE Sprum, vol. 7, pp , ugus 197. [13] W. Konig, H. K. Dunn, nd L. Y. Ly, Th sound sprogrph, Journl of h ousil Soiy of mri, vol. 18, pp , [14] Pul E. Blk, "Eulidn disn", Diionry of lgorihms nd D Sruurs [onlin]. [15] Pul E. Blk, d., U.S. Nionl Insiu of Sndrds nd Thnology.17 Dmbr 24. vilbl from: hp:// [16] Miki Krus nd Hrold F. Tipon, Hndbook of Informion Suriy Mngmn, urbh Publiions, CC Prss, ISBN: [7]. H. Bol, F. S. Coopr, E. E. Dvid, Jr., P. B. Dns, J. M. Pik nd K. N. Svns Idnifiion of Spkr 33