INF582 MT 26 OCT 22 H22 Jn Tor Lønnng l@.uo.no Tody Ssl hn rnslon: Th nosy hnnl odl Word-bsd IBM odl Trnng
SMT xpl En o lgd n r d bygg..9 h.6 d.3.9 rgh.9 wh.4 buldng.45 oo.3 rd.25 srgh.7 by.3 onsruon.33 prprd.5 our.2 o.2 brly. onsrud.2 dsh. ood.5 ours.7 Slrly or: pos -2 2x3 pos -3 pos 2-4 pos 3-5 4x5 pos 6-8 os4 pos 6 x3x3 3 ny os5 pos 7 5x3x3 3 ny rgh wh 2.7x -2 rgh wh buldng.7x -8 rgh o.5x - rgh wh onsruon 5.4x -8 rgh by 9.7x -2 rgh wh brly 8.7x -9 ours o.5x -4 ours o brly.5x -6 2
Algnn Lngh o Englsh srng: =7 Lngh o orgn srng: =9 An lgnn s vor o lngh h nry An lgnn s vor o lngh h nry nubr bwn nd Th xpl: < 2 9 > = < 3 4 4 4 5 7 6> 3
4 Algnn Arl rsrons Arl rsrons: Svrl orgn words y b lgnd wh h s E word A orgn word nno b lgnd o or hn on E word IBM Modl Consdr ll possbl lgnns : For h lgnn us h gnrv odl: Sply h odl ssupons
5 Fgur 25.23 Th gnrv odl: Ch h l h h Choos h lngh o h orgn srng Whh E word rnsls o h rs F word Wh s h rnslon o hs word? Whh E word rnsls o h -h F d h h F word gvn h hos so r Wh s h rnslon o hs word gvn h hos so r
6 Assupons pproxons s onsn ndpndn o nd E ll lgnns h s probbly dds o h word rnslon probbly only dpnds on sour word IBM odl Spls o s norlson or Forul 4.7 n h SMT boo Th boo gos no
rr son I h rnng orpus ws lgnd h odl ould b lrnd by ounng: C C I w hd nown h rnslon probbls w ould hv ound h os probbl lgnn. W nhr now word probbls nor lgnn: Chn nd gg probl EM-lgorh: w y lrn h wo sulnously Trnng h d. Inlz h prr vlus. Wh no no s h unorly 2. Assgn probbls o ll possbl lgnns Clld h xpon sp pply odl o d 3. Coll ronl ouns C : How ny s s rnsld s wghd wh h vrous lgnns 4. Norlz C o g Clld h xzon sp s odl ro ouns 5. Rp ro 2 s long s you l 7
8 Assgn probbls o lgnns sp 2 xpon Gol: opu Sn w hv W now W now Nssry splon Ths quls Bus Rdus h probl ro h ordr +^ o roughly * 2 2.........
Too ny lgnns Words= 2 3 4 6 8 Algn. 8 8 24 279936 34ll bllons Gnrl d W wn o s how probbl snn s gvn snn W now h rnslon probbls o h word pr W ould onsdr: On lgnn Clul h probbly or h lgnn Su ovr ll lgnns Bu w do nsd For h word n s: How probbl s h hs s rnslon o on o h words n Mulply h probls ovr h words n 9
ung hs oghr So r Hn Forul 4. Mxzon sp Counng or on snn Subsung n or p nd dong so non-rvl lulon: p ; Counng ovr h whol orpus nd norlz ; ;
Obsrv Th oruls gh b rghnng bu Th d s or nuv: Unor nlzon hunddog = /3 bdog = /3 bdog = /3 hundb = /3 bb = /3 bb = /3 hundbrd = /3 bbrd = /3 bbrd = /3 hund = /3 b = /3 b = /3 3 3 3 Dog b dog Hund b hund hunddog= bdog = hundb = bb = hund = b = Dog brd Hund b hunddog= bdog = hundbrd = bbrd = hund = b =
Dog b dog Hund b hund Dog brd Hund b hunddog= bdog = /2 hundb = ½ bb = /4 hund = /2 b = /4 hunddog= /3 bdog = /3 hundbrd = /3 bbrd = /3 hund = /3 b = /3 ; ; ' ' hund dog ' ' { hund b b} hunddog = bdog = bdog = hundb = bb = bb = hundbrd = bbrd = bbrd = hund = b = b = ; ; ' ' hund dog ' ' { hund b b} hunddog = +/3 bdog = /2 bdog = /3 hundb = ½ bb = ¼ bb = hundbrd = /3 bbrd = bbrd = /3 hund = ½+/3 b = /3+/4 b = /3 hund dog = 4/3/4/3+/2+/3=8/3.65385 hunddog = bdog = bdog = hundb = bb = bb = hundbrd = bbrd = bbrd = hund = b = b = 2
Ar so rons s r. 2nd r. 5h r. 25h r h hund.588235 b.7647 b.235294 dog hund.65385 dog b.23769 dog b.53846 b hund.666667 b b.333333 brd hund.5 brd b.5 Ar so rons s r. 2nd r. 5h r. 25h r h hund.588235.64758.8929.998457 b.7647.4363.6729.22 b.235294.2922.349.42 dog hund.65385.675859.773893.947458.9663 dog b.23769.23764.24793.5254.33968 dog b.53846.86527.33 b hund.666667.69848.4749.535 b b.333333.3952.58259.994648 brd hund.5.342932.97766 6.-7 brd b.5.65768.92234.999999 3