ICDE Data quality problem is increasing in DB applications. Dedicated venues: IQIS, CleanDB, IQ

Transcription

1 Goup Lnkae Byun-Won On Penn tate Unvesty UA Nck Koudas Unvesty of Toonto Canada Donwon Lee Penn tate Unvesty UA Dvesh vastava AT&T Labs UA ICDE 007 Motvaton Data qualty poble s nceasn n DB applcatons Dedcated venues: IQI CleanDB IQ Reasons Tanscpton eos Lack of standads fo ecodn felds Eos due to poo desn: e update anoales ssn key constant ICDE 007 / Goup Lnkae

2 Recod Lnkae Detenn f two ecod enttes ae sla E Addess n CRM #: Donwon Lee 0 E. Foste Ave. #40 tate Collee PA 680 #: LEE Don 0 East Foste Avenue Apatent 40 Unvesty Pak PA Ctaton n Dtal Lbay #: G. alton and M. McGll Intoducton to Moden Infoaton Reteval McGaw-Hll983 #: [M83] G. alton et al. 983 ICDE 007 / Goup Lnkae 3 Landscape Abundant eseach n any dscplnes A.K.A. DB: appoxate on ee/pue ecod lnkae DL: ctaton atchn autho nae dsabuaton AI: dentty atchn NLP: wod sense dsabuaton IR: web quey esults clusten LI: nae authoty contol ICDE 007 / Goup Lnkae 4

3 Goup Lnkae Often entty s epesented as a oup of elatonal ecods shan a oup ID E An autho wth a oup of publcaton ecods A household n a census suvey wth a oup of faly ebes An ae wth a oup of sub-aes n a d Goup Lnkae Poble: to detene f two enttes epesented as oups ae appoxately the sae o not ICDE 007 / Goup Lnkae 5 Goup Lnkae Exaple T. Cuse Collateal 04 The Last aua 03 Mnoty Repot 0 Vanlla ky 0 ofa-jupn Vanlla ky The Last aua Msson Ipossble Msson Ipossble TX04 PP0Q03 ICDE 007 / Goup Lnkae 6 3

4 Popula Goup laty Jaccad Intutve cheap to un Eo-pone s = Bpatte Matchn Cadnalty Wehted Rch Expensve to un Q: Can we cobne Jaccad and Bpatte Matchn fo Goup Lnkae? ICDE 007 / Goup Lnkae 7 Intuton fo Bette laty Two oups ae sla f: A lae facton of eleents n the two oups fo atchn eleent pas Thee s hh enouh slaty between atchn pas of ndvdual eleents that consttute the two oups ICDE 007 / Goup Lnkae 8 4

5 Goup laty Two oups of eleents: = { } = { } The oup easue BM s the noalzed weht of the axu bpatte atchn M n the bpatte aph N = U E= X BM s such that BM θ s M = + M s s = Use-set Paaetes ICDE 007 / Goup Lnkae 9 Exaple = 0.3 Θ = 0.9 = spase bpatte aph BM s s M = + M = = = 0.53 < Θ 3+ 3 Theefoe <>! M: ax-weht bpatte atchn ICDE 007 / Goup Lnkae 0 5

6 Challene Each BM oup easue uses the axu weht bpatte atchn Bellan-Fod: OV E Hunaan: OV 3 Lae nube of oups to atch ONM N M ICDE 007 / Goup Lnkae oluton: Geedy atchn Bpatte atchn coputaton s expensve because of the equeent No node n the bpatte aph can have oe than one ede ncdent on t Let s elax ths constant: Fo each eleent e n fnd an eleent e n wth the hhest eleent-level slaty Fo each eleent e n fnd an eleent e n wth the hhest eleent-level slaty ICDE 007 / Goup Lnkae 6

7 7 ICDE 007 / Goup Lnkae 3 Uppe/Lowe Bounds s UB s + = s LB s + = M s BM M s + = ICDE 007 / Goup Lnkae 4 Uppe/Lowe Bounds Popetes: Nueato of UB s at least as lae as that of BM Denonato of UB s no lae than that of BM => UB s the uppe-bound of BM s UB s + = M s BM M s + =

8 Theoe & Aloth BM UB s s Theoe IF UB < θ BM < θ LB BM s s Theoe ELE IF LB θ BM θ ELE copute BM Goal: BM θ ICDE 007 / Goup Lnkae 5 MAX Heustcs MAX s = s ax Two oups wth hh BM wll shae at least one pa of vey sla eleents Use MAX to quckly dentfy those No uaantee of avodn false dentfcaton We poposed 4 oup slaty easues: BM UB LB and MAX ICDE 007 / Goup Lnkae 6 8

9 Evaluaton Evaluated each veson vs. Jon veson Use bbloaphy data set fo ACM and DBLP dtal lbaes Authos wth hs/he publcaton lsts Vaous cases Real vs. ynthetc Unfo vs. kewed Jaccad vs. 4 poposals BM UB LB and MAX Hybd as blockn ethod Man evaluaton etc: AVG ecall ICDE 007 / Goup Lnkae 7 BM vs. Jaccad : Left:300 DBLP oups Rht: ACM oups + /3 o 3 duy oups Jaccad ets confused easly ICDE 007 / Goup Lnkae 8 9

10 BM vs. Jaccad : Left:00 ACM oups Rht: Left + 00 eoneous oups 30% 45% 60% ICDE 007 / Goup Lnkae 9 MAX vs. UB RNet: Left:00 DBLP oups on AI topcs Rht: ACM oups ICDE 007 / Goup Lnkae 0 0

11 ACM Dataset RNet: Left:00 DBLP oups on AI topcs Rht: ACM oups UB0 BMk ICDE 007 / Goup Lnkae Concluson When enttes have a oup of eleents n the oup lnkae s useful and effcent Dectons Moe effcent pleentaton => Appoxate Goup Lnkae Heachcal Goup Lnkae: OLAP Goup => Tee Gaph Applcaton to Iae Reteval ICDE 007 / Goup Lnkae