INF5820 MT 26 OCT 2012

Size: px

Start display at page:

Download "INF5820 MT 26 OCT 2012"

Kerry Barnett
5 years ago
Views:

1 INF582 MT 26 OCT 22 H22 Jn Tor Lønnng Tody Ssl hn rnslon: Th nosy hnnl odl Word-bsd IBM odl Trnng

2 SMT xpl En o lgd n r d bygg..9 h.6 d.3.9 rgh.9 wh.4 buldng.45 oo.3 rd.25 srgh.7 by.3 onsruon.33 prprd.5 our.2 o.2 brly. onsrud.2 dsh. ood.5 ours.7 Slrly or: pos -2 2x3 pos -3 pos 2-4 pos 3-5 4x5 pos 6-8 os4 pos 6 x3x3 3 ny os5 pos 7 5x3x3 3 ny rgh wh 2.7x -2 rgh wh buldng.7x -8 rgh o.5x - rgh wh onsruon 5.4x -8 rgh by 9.7x -2 rgh wh brly 8.7x -9 ours o.5x -4 ours o brly.5x -6 2

3 Algnn Lngh o Englsh srng: =7 Lngh o orgn srng: =9 An lgnn s vor o lngh h nry An lgnn s vor o lngh h nry nubr bwn nd Th xpl: < 2 9 > = < > 3

4 4 Algnn Arl rsrons Arl rsrons: Svrl orgn words y b lgnd wh h s E word A orgn word nno b lgnd o or hn on E word IBM Modl Consdr ll possbl lgnns : For h lgnn us h gnrv odl: Sply h odl ssupons

5 5 Fgur Th gnrv odl: Ch h l h h Choos h lngh o h orgn srng Whh E word rnsls o h rs F word Wh s h rnslon o hs word? Whh E word rnsls o h -h F d h h F word gvn h hos so r Wh s h rnslon o hs word gvn h hos so r

6 6 Assupons pproxons s onsn ndpndn o nd E ll lgnns h s probbly dds o h word rnslon probbly only dpnds on sour word IBM odl Spls o s norlson or Forul 4.7 n h SMT boo Th boo gos no

7 rr son I h rnng orpus ws lgnd h odl ould b lrnd by ounng: C C I w hd nown h rnslon probbls w ould hv ound h os probbl lgnn. W nhr now word probbls nor lgnn: Chn nd gg probl EM-lgorh: w y lrn h wo sulnously Trnng h d. Inlz h prr vlus. Wh no no s h unorly 2. Assgn probbls o ll possbl lgnns Clld h xpon sp pply odl o d 3. Coll ronl ouns C : How ny s s rnsld s wghd wh h vrous lgnns 4. Norlz C o g Clld h xzon sp s odl ro ouns 5. Rp ro 2 s long s you l 7

8 8 Assgn probbls o lgnns sp 2 xpon Gol: opu Sn w hv W now W now Nssry splon Ths quls Bus Rdus h probl ro h ordr +^ o roughly *

9 Too ny lgnns Words= Algn ll bllons Gnrl d W wn o s how probbl snn s gvn snn W now h rnslon probbls o h word pr W ould onsdr: On lgnn Clul h probbly or h lgnn Su ovr ll lgnns Bu w do nsd For h word n s: How probbl s h hs s rnslon o on o h words n Mulply h probls ovr h words n 9

10 ung hs oghr So r Hn Forul 4. Mxzon sp Counng or on snn Subsung n or p nd dong so non-rvl lulon: p ; Counng ovr h whol orpus nd norlz ; ;

11 Obsrv Th oruls gh b rghnng bu Th d s or nuv: Unor nlzon hunddog = /3 bdog = /3 bdog = /3 hundb = /3 bb = /3 bb = /3 hundbrd = /3 bbrd = /3 bbrd = /3 hund = /3 b = /3 b = / Dog b dog Hund b hund hunddog= bdog = hundb = bb = hund = b = Dog brd Hund b hunddog= bdog = hundbrd = bbrd = hund = b =

12 Dog b dog Hund b hund Dog brd Hund b hunddog= bdog = /2 hundb = ½ bb = /4 hund = /2 b = /4 hunddog= /3 bdog = /3 hundbrd = /3 bbrd = /3 hund = /3 b = /3 ; ; ' ' hund dog ' ' { hund b b} hunddog = bdog = bdog = hundb = bb = bb = hundbrd = bbrd = bbrd = hund = b = b = ; ; ' ' hund dog ' ' { hund b b} hunddog = +/3 bdog = /2 bdog = /3 hundb = ½ bb = ¼ bb = hundbrd = /3 bbrd = bbrd = /3 hund = ½+/3 b = /3+/4 b = /3 hund dog = 4/3/4/3+/2+/3=8/ hunddog = bdog = bdog = hundb = bb = bb = hundbrd = bbrd = bbrd = hund = b = b = 2

13 Ar so rons s r. 2nd r. 5h r. 25h r h hund b.7647 b dog hund dog b dog b b hund b b brd hund.5 brd b.5 Ar so rons s r. 2nd r. 5h r. 25h r h hund b b dog hund dog b dog b b hund b b brd hund brd b

INF5820/INF9820 LANGUAGE TECHNOLOGICAL APPLICATIONS. Jan Tore Lønning, Lecture 4, 14 Sep

INF5820/INF9820 LANGUAGE TECHNOLOGICAL ALICATIONS Jn Tor Lønning Lctur 4 4 Sp. 206 tl@ii.uio.no Tody 2 Sttisticl chin trnsltion: Th noisy chnnl odl Word-bsd Trining IBM odl 3 SMT xpl 4 En kokk lgd n rtt