FACE RECOGNITION USING ARTIFICIAL NEURAL NETWORKS IN PARALLEL ARCHITECTURE

Transcription

1 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: FACE RECOGITIO USIG ARTIFICIAL EURAL ETWORKS I ARALLEL ARCHITECTURE BATYRKHA OMAROV, AZIZAH SULIMA, 3 KAISAR KUSHIBAR hd caddat of Collg of Iformato Tchology, Uvrst Taga asoal, Kuala Lumur, Malaysa rof. Madya Dr., Collg of Iformato Tchology, Uvrst Taga asoal 3 Mastr, Uvrsty of Burgudy, L Crusot, Frac. E-mal: batyaha@gmal.com, azzah@ut.du.my, 3 kukaba.fm@gmal.com ABSTRACT Fac dtcto ad rcogto s th ma asct for dffrt mortat aras such as vdo survllac, bomtrcs, trv gam alcatos, huma comutr tro ad accss cotrol systms. Ths systms rqur fast ral tm dtcto ad rcogto wth hgh rcogto rat. I ths ar w roos mlmtato of th Artfcal ural twork by usg hgh rformac comutg archtctur basd o Grahcs rocssg Ut to gt fac rcogto wth hgh accuracy ad mor sdu. Thr, w cosdr a aralll trag aroach for backroagato algorthm for fac rcogto. For th hgh rformac of fac rcogto t was usd Comut Ufd Dvc Archtctur (CUDA o a GU. Th rmtal rsults dmostrat a sgfcat dcras o cutg tms ad gratr sdu tha sral mlmtato. Kywords: Artfcal ural tworks, CUDA, Fac rcogto, GU, aralll Comutg.. ITRODUCTIO owadays, Fac dtcto ad rcogto has bcom far-famd ara of mag rocssg ad aalyss ad comutr vso rsarch. Maly w mt such kd of systms vrywhr, for aml, scurty systms, socal tworks, smart hos, tc. [, ]. Usg ad mag facal rcogto algorthms ar roosd to stmat ad gv dcso o whr that fac s locatd. I ow cas, accordg to th drcto ach mag s classfd to svral classs as lft, rght, u ad straght. For som tys of such kd of roblms usg a artfcal ural twork (A wll b o of th most ffctv mthods [3]. I addto, Backroagato algorthm wll srv o of th to os of commoly usd algorthms for A larg tchqu. I ths cas, backroagato algorthm s bult of arts of trcoctd uros, whr ach ut has ral-valud uts ad rturs a sgl ral-valud outut. It s commoly usd A larg mthod, whch s sutabl for tasks whr th larg targt fucto s dfd ovr scm that ca b dscrbd by a rdfd faturs vctor or vctor of l valus. Also, outut rsult may b ral-valud, dscrtvalud or vctor of ral ad dscrt valud attrbuts. Furthrmor, trag amls may cota som rrors ad f assssmt of th lard fucto may b rqurd. All ths fors mak A a ffctv mthod mag rcogto roblm. Som rsarch of artcular alcato mts o [4, 5]. O of th ma dffcults of A s th sgfcat amout of tm dd th trag has rformac to solv coml roblms. Ddg o grow of umbr of hdd layrs ad uros, th rqurd tm to A larg rocss ad w stac assssmt tm grows by las ad bouds. O th othr had, th rat of succssful classfcato dds o growg of umbr of hdd layr ad uros. So, gral, th mor trag stacs th twork s guaratd, th mor ffctv rsult ca b achvd. Thus, t s vry mortat to carry out trag wth a cosdrabl umbr of uros th hdd layr ad wth a larg umbr of trag amls, ad wth sdg rlatvly low trag tm. 38

2 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: Th statmt that ach layr maks ts ow calculato ddtly from othr uros lads us to ay layr aralll calculatos whch ca tak lac, ad a aralll archtctur whch ca b usd for ths uros... Motvato owadays, facal rcogto s a v ad ual rsarch ara. Ths s comosd by multl aras as comutr vso, attr rcogto, mag rocssg, artfcal tllgc, artfcal ural tworks ad comutr archtcturs. Thr ar may alcatos that us fac rcogto for scurty goals as accss cotrol or scurty systms. Th systm gvs good rsults, maly wh th fgrrt systm caot b usd to th rcogto goal. I st of th rlabl mthods of dtfcato systms such as fgrrtg or rs scag, facal rcogto s attrv bcaus of th frdly rorts usd. It s clarly s that, thr ar may challgs o facal rcogto roblm whch ar rlatd to rlablty ad calculatv cost, ad tm cost of th tchqu. Th ma goal of th rsarch s mrovg fac rcogto usg artfcal ural twork, roductvty crasg va th us of larg-scal aralll data rocssg, rachd by th mlmtato of artfcal ural twork archtctur basd o Grahc rocssg ut.. RELATED WORKS Wth th dvlomt of w tchologs w hav mult-cor rocssors ad grahc rocssg uts (GU wth sgfcat owr our dskto ad srvrs, avalabl to vryo. Usg aralll comutg tchqus for artfcal ural twork ad d larg has bcom a buddg rsarch ara by usg currt modr hardwar. I [6] authors gvs a rsarch survy of th stat of th art aralll comutr hardwar from th rsctv of a ural tworks usr focusg o th rformac of A o affordabl aralll comutr hardwar such as clustrs, mult-cor rocssor machs, workstatos ad Cs. Ldholm t al. [7] ad Ryoo t al. [8] cosdr GU-rlatd roblms cocrg covtoal aralll rograms. Thy study VIFIA s Tsla ufd grahcs ad Thy study dvlog aralll rograms o th bass o CUDA rogrammg AI that ca b rformd basd o VIDIA s Tsla ufd grahcs ad VIDIA GUs comutg archtctur. I thr rsarch, thy cosdr CUDA as a tso of C/C++ rogrammg laguag that dvlors wrtg rograms call cors. Cors ar carrd to ffct aralll through a st of thrads. Also, thy dscuss som othr aroachs cocrg to GU as OCL, GI Acclrator ad Brook. ckolls t al. [9] ad Ch t al. [0] trat wth CU basd aralll calculato aroachs as MI (Mssag assg Itrfac, OM or thrads. Most of th works hav to dal wth CU ad GU basd aralll comutg o a vry commo lvl oly ad ot rovdg a alcabl assssmt scaro for a scfc targt. Jag t al. [] dals wth Mult-Layr rctro basd (ML tt dtcto algorthm rformd OM ad CUDA. Thy trd to smlfy th algorthm for all usrs, v for thos usrs who do ot hav vry good kowldg about rogrammg o GU. Thy cosdr that ML cossts of o ut layr ad o outut layr, also o or mor hdd layrs. A dffculty of thr schm s dscrbg a short assssmt scto. I cotrast, our rsarch basd o Backroagato algorthm ad focuss mor scfcally o th assssmt dtals. Th authors also amd mrovmts rlatg th comutato tms of thr alcato from usg aralllzato. Xavr t al. [] dal wth aralll trag of Backroagato usg CUDA mlmtato of Basc Lar Algbra Subrogram. Thy comard mlmtato o classcal CU ad CUDA varato of hdd uros ad comarg th rformac of CU ad GU cuto. Shtal t al. [3] comar CU Matlab ad GU mlmtato for attr rcogto algorthm, cocrtly, rcogz had wrtt dgts. Summarzg, our rsarch w am multcor vrsus GU usg aralll comutg, o th othr had our work rorts ural twork fac 39

3 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: rcogto roblm usg Backroagato aradgm by gvg scfc aramtrs. May mthods ca b foud usg aralll comutg of ural tworks that hav b mlmtd o dffrt archtcturs. For stac, thrck t al. [4] dscrbd svral aroachs for ural twork trag. I [5] dscrbs th dffrt aralllzato lvls of ural twork. Also, [6] dvdd Data aralll catgory to two tys as Structural data aralll catgory ad Toologcal data aralll catgory. Fgur llustrats a CUDA rogrammg ad mmory modl that s basd o a aralll comut block calld grd. Thr, a ovrlook of th thrads rug sd th dvc structur s gv. It ca b s as artg of host hardwar CU ad GU dvc, that thrad rocssg orgazd blocks s saratd to grds of th rocssg. Thr, krls hav dffrt grd aramtrs as ts dmsoalty. As Fgur llustrats, th sz of blocks ad grd of krl s dffrt from th o usd by krl. Ths rsarch work focuss o mach larg, aralll comutg wth hgh rformac, usg GU comutg, as t mlmts algorthm that cosdrably mrovs A trag tm as cotrastd a squtal fac rcogto algorthm. Summg u, our work o th o had w aalyz th mult-cor vrsus GU rformac gas by aralllzato, but o th othr had w also aalyz th alcato bhavor of ural twork fac rcogto by a sw of roblm scfc aramtrs. I addto, our rsarch w mlmt ad ru a dffrt umbr of hdd uros ad cors for rocssg. 3. GU ARCHITECTURE AD CUDA ROGRAMMIG MODEL GUs wr dsgd to rform grahc rocsss o comutrs. owadays, thy hav larg comutg owr affordd by thousads of rocssg uts that suort fast clock sds. I th last dcad GUs hav b usd to solv comlcatd tasks owg to hgh-owr aralll hardwar archtctur. Grahc rocssors hav a hug comutato cay for aralll comutg of Imag rdrg ssu. CUDA has C basd rogrammg modl sur asy mlmt all-uros comutato. GU s rogrammabl uts ar a multl rocssor that cossts of a st of a sgl rogram multl-data (SIMD rocssor. For gratr ffccy, GU rocsss lmts that ar calld vrtcs or fragmts ar usd aralll th dtcal rogram. Each lmt s ot ddt o th othrs, ad rogrammg modl lmts caot trrlat wth ach othr. GU rograms structur follows ths mthod: ach lmt s rocssd aralll by a dvdual rogram. Fgur. CUDA rogrammg modl (courtsy: VIDIA 3.. CUDA Mmory Modl CUDA mmory modl accss ruls ar gv Fgur, th dtald laato s gv Tabl. CUDA archtctur s costructd by a scalabl array of mult-rocssors, wth ach of thm havg ght scalar rocssors, a shard mmory ch, ad a multthradg ut. Multrocssor crats ad maags, also cuts aralll thrads wth dmshd cost. Th thrads ar costructd blocks, whch ar ru a sgl multrocssor. I ow cas, blocks ar costructd grds. 40

4 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: A rovds a commoly rcal mthod for survsd larg ad usurvsd larg fuctos from gv samls. Thr w us ral valud, dscrt valud, ad vctor valud fuctos. Thr ar som algorthms that allow attug twork aramtrs to fd th bst ft trag st of ut ad outut aramtrs. A s stabl to rrors of trag data ad abl to b succssfully ald to ssus as mag rocssg, sch rcogto, ad mag rcogto [3]. Fgur. CUDA Mmory Modl rogram CUDA calls a grd, ad t wll b ru th GU. Blocks ar umbrd ad srad to avalabl multrocssors. Thrads ru to th dvc ad hav accss to mmory sd th dvc. Thrads hav accss to rgstrs ad th mmory for radg ad wrtg sg mmory sacs as a shard mmory, a local mmory, ad a global mmory. A shard mmory usd by th thrads, th local mmory of th thrad, ad th global mmory of th GU. Blocks hav accss to shard mmory for radg ad wrtg. Costat ad tturs mmors ca b accssd by th grd for radg oly. Tabl. Mmory Modl Accss Ruls Mmory sac Wh accssd Rul Rgstr By thrad Rad/Wrt Local By thrad Rad/Wrt Shard By block Rad/Wrt Global By grd Rad/Wrt Costat By grd Rad Oly Ttur By grd Rad Oly 4. FACE RECOGITIO USIG ARTIFICIAL EURAL ETWORKS I GU 4. Mathmatcal Modl ad Mthods rogram CUDA calls a grd, ad t wll b ru th GU Fgur 3. A s schma Fgur 3 llustrats gral structur of a A. A work wth a st of uros that coctd wth ach othr. Each uro rcvs ut data, fulfll som lar combatos ad rtur th rsult, whch s th assssmt of som fucto f for th valu a. Th frst st s to modfy th backroagato algorthm so that t ca b mlmtd a SIMD fasho. I backroagato algorthm, ut attrs ar rstd to th ural twork. Basd o th ut attr th twork calculats a outut attr. Aftr that th outut s comard wth a dsrd attr, ad a rror vctor s calculatd. Th comutd rror wll b backroagatd by th twork. Basd o th rror amout o ach cocto, th wghts of th twork ar chagd. Aftr, th twork rcvs t attr, ad th rvous rocdur s ratd. I th aralll vrso of th backroagato, th wghts wll b stord stad of chagg aftr ach tmlat. Aftr th frst calculato svral thrads, th stord wghts ar addd, ad th th wghts ar udatd, ddg o th chag of total wght ar comutd. 4

5 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: Lt, cosdr a twork whch wth outut to solv th task wth trag attrs. aralll backroagato algorthm trs to fd a ma squard rror for o trag. Th wghts ar udatd as ( ad ( formulas. w ϑ ρ k ρ ( ( ds ( k ( w ( ( ds ( Whr, ds s th dsrd outut ad ds s th ual outut of th -th outut uro for th -th trag attr, ϑ, w ar th frst ad scod stag wghts, s ough small st sz, ad k k ar th k-th ad -th ut valus to th frst ad scod stags rsctvly. As w cocrd bfor, th twork comut th wght chags owg to all trag attrs, also, add thm u, aftr, udat th wghts o th bass of th varato of th total wght gathr ovr th full sw. I th cosstt mlmtato, wght udat s commttd aftr ach trag. So, th cosstt mlmtato, th wght chags ar calculatd as followg (3 ad (4 formulas. w ρ ( ( ds (3 ϑ k ρ k ( w( ( ds (4 Ths aroach works vry slowly th srs mlmtato. Howvr, usg th SIMD backroagato aroach allows aralllzato th data lvl. Each twork calculats a wght varato vctor of th tr twork aralll at th sam tm. Aftr that, th wght vctor of th twork s udatd o th bass of th total wght varato vctor. So, owg to aralllzato w wll achv mor sd. I th t art of our rsarch, w wll la SIMD backroagato aroach. 4.. Smulato of Backroagato algorthm aralll archtctur Th ma coct of Backroagato smulato aralll archtctur s th mult layr rctro. I othr words, t s a layrd ural twork wth a dffrt umbr of hdd layrs. Scally, ach uro s assocatd wth ach layr uro of a adact layr. For survsd larg w us th Backroagato algorthm. It s a gradt dsct mthod to dtrm combato of wghts btw layrs for comarso ut ad gv outut valus. Fdforward assssmt s dfd by (5 roagato fucto. (5 t O( t w, Whr, w, s rrst th cocto wghts ad O s th outut valu of th uro. Rato of ut, adact ad outut layrs s dfd by th followg quato systm, whr ut, outut, hdd ar ut valu, hdd layr s vctor, ad outut vctor. hdd f( w ut outut f( w hdd (6 Also, w s th wght matr btw th ut ad hdd layrs, ad w s th wght matr btw hdd ad outut layrs. Th vato fucto s rrstd by th sgmod fucto (7. y + λ (7 Also, w us tradtoal formulas as (4 to lar backroagato algorthm. w w Whr, α ε a α (8 w ad m ( a h a m ( a w ad wmatrs rsctvly. m w m w s th wght valu of Fgur 4 llustrats a schma for sgl uro. I th frst lac, a lar combato of ut data wll b mad. 4

6 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: Whr, M s th umbr of hdd uros, s th outut valu of th -th hdd uro. Ad, w gt Fgur 4. Schma of sgl uro of A t, w wll fd th dffrc btw rrors of sral ad aralll vrso of backroagato algorthm. Th total ma squard rror for a twork wth outut uros for a roblm wth trag attrs s as followg: w + w+ θ w+ θ (3 E ( ds (9 w ( (4 t, w cosdr wght varato btw hdd layr ad outut layr. Th rcvd rsults ca b radly gralzd to mor tha o hdd layr th cas of ural twork cossts of svral hdd layrs. Ev, thr s o hdd layr th th hdd layr wll b th sam as th ut layr. Basd o th cha rul, w ca dtrm th rat of rror chag rgardg to w as th followg formula: Usg formulas (0, ( quato (4 w gt w ( ( ds of (5 Usg gradt dsct mthod, th wght varato for w w fd w Whr w ( ds (0 ( W cosdr a sgmodal vato fucto as y, mor rcsly t wll b th λ + followg form: a+ w + θ ( w ρ (6 ( ( ds Whr s th st sz small costat umbr. ow, lt s cosdr ν k as th wght coct btw k-th ut ad -th hdd uros, ad w gt (7 E Whr, ( ds ds + + w θ 43

7 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: K w + θ k (8 sw. I th cosstt mlmtato, th wght rwal s fulflld aftr ach trag attr. So, usg (6 ad (3, th wght varato ar calculatd as th followg formulas: s th outut of th -th hdd uro for - th trag attr, K s th umbr of ut uros, s th k-th bt of th -th trag k attr. Usg th cha rul o mor tm, w fd v k Usg (0: v k (9 w+ θ w ( ds + w θ E + (0 Ad w ( ( ds w ad v k ρ ρ k (4 ( (5 ( ( ds w ( ( ds Fgur 5 llustrats dsct sts got by movg to th fror lmt of a arabolod usg ad aromat vrso of gradt dsct algorthm. Th SIMD backroagato mthod uss th algorthm bcaus of t uss aralllsm of data lvl. Each twork calculats a vctor of wght chags for all wghts th gv twork o th bass o th gv trag attr. Aftr comltg th sw wght varato vctors wll b addd u ad wght vctors ar udatd o th bass of th wght varato vctor. Usg th mthod s th rsult of data lvl aralllsm. I th t art of our rsarch w wll la aralll aroach mlmtato of th roblm. v k k ( ( w gt v k ( k ( w ( Shar dsct wght chag s ( ds v k ρ k ( w ( ( ds (3 Th twork comuts th wght varato by raso of all th trag attrs, ad adds thm togthr, aftr udat th wghts o th bass o th total wght varato gathrd ovr th whol Fgur 5. Dsct ath to th mmum of a arabold. 4. A aralll Aroach A fac rcogto systm cossts of two arts as larg ad rcogto. At th larg art, svral mags of o rso wll b gv, ad th systm wll b trad wth th hl 44

8 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: of survsor rturg th dtfcato of th gv rso th mag. At th rcogto art, o mag wll b show to th camra, ad th systm wll try to fd to whom th mag blogs. Fgur 6 llustrats th block schm of th CUDA basd o aralll rocssg fac rcogto. Fgur 7. Fac dtcto from svral forshortgs. Aftr dtctg a fac, th fatur tro ad vrfcato rocss s rformd as a scod st. Aftr fac rcogto, th dtctd ad rocssd facal mag s comard to a databas of facs to dcd who that rso s. Fgur 8 llustrats fac rcogto rocss. Fac rcogto occurs by dtrmg d of th rcogzd rso. Fgur 6. A Orgazato o CUDA Thr ar two data storags - th o usd for storg th wghts that ar gratd durg th trag stag of th twork ad th scod o usd for storg th fac mags of ol who must b rcogzd. Th fac rcogto algorthm uss a databas of 0,000 fac mags tak from 500 ol. I th t art w dscuss th rsults of fac rcogto ad CUDA basd aralll rocssd fac rcogto. 5. EXERIMET RESULTS AD DISCUSSIO A fac rcogto systm grally volvs two ma stags: fac dtcto ad fac dtfcato. I th fac dtcto stag, th systm sarchs for ay facs. Th, t taks a mag of th fac. Followg ths, mag rocssg clas u th facal mag to black-wht colors. Durg th dtcto rocss, a commo fatur for fac dtcto s a st of adact rctagls that l abov th y ad th chk ara. Th osto of ths rctagls s dfd rlatv to a dtcto wdow that s lk a boudg bo to th targt obct. I our ar, a fac ca b dtctd from svral forshortgs. Imlmtd rsults ar show Fgur Rsults Fgur 8. Fac rcogto rocss. All th bchmarks cosst of,000 trag tratos. Each trag trato clud o forward ad o backroagato ad th varato of wghts. To tst th bhavor of th systm, w usd o trato for a attr. So, th umbr of ut attrs was,000. To tra, w us 0,000 fac mags from 500 ol (thr,,000 of thm ar frotal mags, th othrs ar th mags wth som agls, ad th systm was ru th sral ad aralll vrso. For dvrsty w tak th fac mags wth dffrt motos such as sml, surrs, sadss, agr, ad laugh. Tabl gvs formato about charrstcs of fac mags that wr usd th rmtal art of th rsarch. Tabl. Charrstcs of th mags th databas. Itm umbr of mags Fac mags 0000 Multl fac mags 500 Frotal fac mags

9 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: Ecuto Tms I ths scto, w rort ad dscuss th cuto tm of oratos ad th rsults of th GU mlmtg of th roosd SIMD backroagato algorthm ad fac comar fac rcogto rats cosqutly ad aralll cuto Comar squtal ad aralll trag Squtal cuto tm wll b solvd by t formula: t squtal ( t I + t (6 + t Whr, t, t, t 3 ar tm of forward ass, tm of backward ass for trag ctur, ad tm for udatg th wghts rsctvly. I s umbr of mags. aralll cuto tm wll b solvd usg t formula: 3 sdu ffccy ( Ecuto tm aalyss Ths subscto comars squtal ad aralll cuto tms ( scods ad aalyss rformac rsults of th algorthm for GU. Tabl 3 ad Fgur 9 rort th avrag cuto tms for squtal ad aralll mlmtato, ad sdu valu. Tabl 3. Ecuto tms comarg squtal ad aralll cuto mag sz squtal cuto tm (scod aralll cuto tm (scod sdu valu ,7 I { t aralll_ + t aralll_} t aralll_ 3 t aralll + (7 Whr, t aralll_, t aralll _, t aralll_ 3 ar tm of forward ass, tm of backward ass for trag ctur, ad tm for udatg th wghts rsctvly, s umbr of ods. Sdu rato wll b solvd by usg formula (8 tsqutal sdu (8 t aralll Whr, tsqutal ad t aralll ar tm st to forward ass, ad backward roagato for trag ctur, rsctvly. Fgur 9. Squtal ad aralll cuto tm comarso Sdu aalyss Fgur 0 llustrats sdu chags for 3040 ad 060 sz mags wh umbr of ut uros from 8 utl 04. It s clarly s that, wh th sz of ut uros grow, aralll trag gvs grat advatag. Effccy wll fd from dvdg sd u rato to umbr of ods: 46

10 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: sd u. Thrfor, our smulato rsults cofrm th ffctvss of our aroach ad dmostrat cras fac rcogto rat owg to ural twork trag ad fast rocssg tm that s achvd by vrtu of GU CUDA aralllsm. I addto, tacklg th roblm of fast multl fac rcogto s lad by usg GU CUDA ad ural twork tchqus. Fgur 0. Sdu Aalyss ddg o hdd uros. AUTHOR COTRIBUTIOS B.S. Omarov rovdd A trag, aralll Backroagato algorthms; rformd th rmts wth aralll ad sral fac rcogto, ad lord fac dtcto ad rcogto algorthms. Also, ths rsults ar art of cotrbutos towards hs hd work at Uvrst Taga asoal by survsg Azzah Sulma who wrot th outl of th artcl ad gudd th drcto of our ar, ad advsd th roof mthod of th smulato ad rmtal rsults. Kasar Kushbar rovdd rmts wth mag rocssg. All authors rovdd substatv commts. Coflct of trsts Th authors dclar that thr s o coflct of trsts rgardg th ublcato of ths artcl. Ackowldgmt Ths ublcato s fudd by Malaysa s Mstry of Educato (MOE through th LRGS fud (00303LRGS. 6. COCLUSIO W roos th mrovmt of fac rcogto usg ural twork ad aralll comutg through GU. Th systm was dscrbd trms of th mathmatcal modl ad ural twork algorthms to dvlo rcogto rat ad Back-roagato s a tratv, gradt sarch, survsd algorthm whch ca b vwd as multlayr o-lar mthod that ca r-cod ts ut sac th hdd layrs ad thrby solv hard larg roblms. Th twork s trad usg A tchqu utl a good agrmt btw rdctd ga sttgs ad ual gas s rachd. Durg last thr dcads, th assssmt of ottal of th sustaabl co-frdly altratv sourcs ad rfmt tchology has tak lac to a stag so that coomcal ad rlabl owr ca b roducd. Dffrt rwabl sourcs ar avalabl at dffrt gograhcal locatos clos to loads, thrfor, th latst trd s to hav dstrbutd or dsrsd owr systm. Eamls of such systms ar wd-dsl, wddsl-mcro-hydro-systm wth or wthout multlcty of grato to mt th load dmad. Ths systms ar kow as hybrd owr systms. To hav automatc rv load voltag cotrol SVC dvc hav b cosdrd. Th mult-layr fd-forward A toolbo of MATLAB 6.5 wth th rror back-roagato trag mthod s mloyd. REFRECES: [] g, C., Savvds, M. ad Khosla,.: Ral-tm fac vrfcato systm o a cll-ho usg advacd corrlato fltrs, roc. of 4th IEEE Worksho o Automatc Idtfca-to Advacd Tchologs, IEEE 005 [] Vkatarama, K., Qdwa, S. ad Vayakumar, B.: Fac authtcato from cll ho camra mags wth llumato ad tmoral varatos, IEEE Tras. o Systms, Ma, ad Cybrtcs, art C, vol. 35, IEEE 005 [3] Mtchll, Tom: Mach Larg. McGraw Hll

11 Joural of Thortcal ad Ald Iformato Tchology 30 th Stmbr 06. Vol.9. o JATIT & LLS. All rghts rsrvd. ISS: E-ISS: [4] Rumlhart, D., Wdrow, B. ad Lhr, M.: Th basc das ural tworks, Commucatos of th ACM, 37( ACM 994 [5] Jua ablo Balar, Martí Rodríguz, ad Srgo smachow Ctro d Cálculo, Facultad d Igría. Facal Rcogto Usg ural tworks ovr GGU. Uvrsdad d la Rúblca, Uruguay 0 [6] U. Sffrt, Artfcal ural tworks o massvly aralll comutr hardwar, urocomutg 57 ( , w Ascts urocomutg: 0th Euroa Symosum o Artfcal ural tworks 00. [7] E. Ldholm, J. ckolls, S. Obrma, J. Motrym, VIDIA Tsla: A Ufd Grahcs ad Comutg Archtctur, IEEE Mcro 8 ( [8] S. Ryoo, C. I. Rodrgus, S. S. Baghsorkh, S. S. Sto, D. B. Krk,W.-m.W. Hwu, Otmzato rcls ad alcato rformac valuato of a multthradd GU usg CUDA, : rocdgs of th 3th ACM SIGLA Symosum o rcls ad rc of aralll rogrammg, o 08, ACM, w York, Y, USA, 008, [9] J. ckolls, I. Buck, M. Garlad, K. Skadro, Scalabl aralll rogrammg wth CUDA, Quu - GU Comutg 6 ( [0] S. Ch, M. Boyr, J. Mg, D. Tara, J. W. Shaffr, K. Skadro, A rformac study of gral-uros alcatos o grahcs rocssors usg CUDA, Joural of aralll ad Dstrbutd Comutg 68 (0 ( , gral-uros rocssg usg Grahcs rocssg Uts. do:doi: 0.06/.dc [] H. Jag, A. ark, K. Jug, ural twork Imlmtato Usg CUDA ad OM, Dgtal Imag Comutg: Tchqus ad Alcatos 0 ( [] Srra-Cato, Xavr, Madra-Ramrz, Fracsco, V. Uc-Cta, aralll trag of a back-roagato ural twork usg cuda, : rocdgs of th 00 th Itratoal Cofrc o Mach Larg ad Alcatos, ICMLA 0, IEEE Comutr Socty, Washgto, DC, USA, 00, do:0.09/icmla URL htt://d.do.org/0.09/icmla.00.5 [3] S. Lahabar,. Agrawal,. J. arayaa, Hgh rformac attr rcogto o gu, : atoal Cofrc o Comutr Vso, attr Rcogto, Imag rocssg ad Grahcs (CVRIG 08, 008, URL htt://cvt.t.ac./ars/shtal08hgh.df [4] M. thck, M. Lddl,.Wrst, Z. Huag, aralllzato of a backroagato ural twork o a clustr comutr, : Itratoal cofrc o aralll ad dstrbutd comutg ad systms (DCS 003,