Hindi Generation from Interlingua (UNL) Om P. Damani, IIT Bombay (Joint work with S. Singh, M. Dalal, V. Vachhani, P.

Size: px

Start display at page:

Download "Hindi Generation from Interlingua (UNL) Om P. Damani, IIT Bombay (Joint work with S. Singh, M. Dalal, V. Vachhani, P."

Victor Maxwell
5 years ago
Views:

1 Hindi Generation from Interlingua (UNL) Om P. Damani, IIT Bombay (Joint work with S. Singh, M. Dalal, V. Vachhani, P. Bhattacharya)

2 Cross Lingual Information Access: Language Independent Representation

3 System Architecture for Achieving Cross Lingual Information Access Hindi, English, or Marathi Query Enconvertor UNL Expression Search Module UNL Documents UNL Documents Output Generator Hindi Deconvertor Marathi Deconvertor Results in Hindi Results in Marathi

4 Universal Networking Language (UNL) ins agt obj John(iof>person) rice(icl>food) [UNL:1] John(iof>person)) rice(icl>food)) spoon(icl>artifact)) [\UNL]

5 UNL Scopes: Representing Embeddings obj Contact(..) agt obj(contact(icl>communicate(agt>person, plc :01 farmer pur or this region you nam pur(contact(icl>communicate(agt>person, agt(contact(icl>communicate(agt>person, taluka nam manchar ka(icl>geographicalarea):4a) anchar(icl>geographical place):2r) khatav nam:01(taluka(icl>geographical area):4a,khatav(icl>geographical area):3u) For this, you contact the farmers of Manchar region or of Khatav taluka

6 HinD (Hindi Deconverter): Yet Another Deconversion Engine Manati Deco HinD Output Quality Suffix uom U I iyom om @N,@NA,@NOTCH,@F,@pl,@oblique agt aoj obj ins Agt L L L Aoj L L Obj R Ins Suffix Tense Aspect Mood N Gen P V E -e @male 3 rd e @male 3 rd - @male 3 rd I saktii 3 rd A Simplicity of Specification

7 HinD Architecture Deconversion = Transfer + Generation

8 Step-through the Deconverter obj contact pur farmer plc :01 or taluka nam khatav this region agt you manchar nam Module UNL Expression Lexeme Selection Case Identification Morphology Generation Function Word Insertion Linearization Output obj(contact( स पर क क स न यह आप क ष त र त ल क म चर खट व contact farmer this you region taluka manchar khatav स पर कक स न * यह आप क ष त र * त ल क * म चर खट व contact farmer * this you region * taluka * manchar khatav स पर क क ज ए क स न इस आप क ष त र contact.@imperative farmer.@pl this you region त ल क म चर खट व taluka manchar Khatav स पर कक ज ए क स न क इसक ल ए आप क ष त र contact farmers this for you region य त ल क क म चर खट व or taluka of Manchar Khatav इसक ल ए आप म चर क ष त र य खट व This for you manchar region or khatav त ल क क क स न क स पर कक ज ए taluka of farmers contact

9 Lexeme Selection [स पर क]{}"contact(icl>communicate(agt>person,obj>person)) (V,VOA,VOA-ACT,VOA-COMM,VLTN,TMP,CJNCT,N-V,link,Va) [पहच न क व यक त ]{}"contact(icl>representative) (N,ANIMT,FAUNA,MML,PRSN,Na) Lexical Choice is unambiguous obj contact स पक agt farmer कस न pur this यह you आप

10 Case Marking Relation Parent+ Parent- Child+ Child- Obj V VINT N Agt N Depends on UNL Relation and the properties of the nodes Case get transferred from head to modifiers obj contact स पक agt *farmer कस न pur this यह you आप

11 Morphology Generation: Nouns The boy saw me. लड़क न म झ द ख Boys saw me. लड़क न म झ द ख The King saw me. र ज न म झ द ख Kings saw me. र ज ऒ न म झ द ख Suffix uom U I iyom om @N,@NA,@NOTCH,@F,@pl,@oblique

12 Verb Morphology Suffix Tense Aspect Mood N Gen P V E -e @male 3 rd e @male 3 rd - @male 3 rd I saktii 3 rd A lad,ka iktaba do o rha qaa (The boy was giving the book) Suffixes mentioned in the rules get attached to the stems selected from the Stem Dictionary

13 After Morphology Generation obj farmer कस न contact स पक pur this यह agt you आप obj farmer कस न contact स पक क जए pur this इस agt you आप

14 Function Word Insertion स पक क जए कस न यह आप त ल क म चर खट व स पक क जए कस न क इसक लए आप य त ल क क म चर खट व Rel Par+ Chi- Par- Chi+ Ch/FW Obj V VINT क obj farmer कस न क contact स पक क जए pur this इसक लए agt you आप

15 Linearization obj Contact स पक क जए agt plc farmer pur this you इस आप म चर This you manchar region :01 taluka or region nam खट व त ल क कस न khatav taluka farmers nam manchar स पक contact khatav

16 Syntax Planning: Assumptions The relative word order of a UNL relation s relata does not depend on: Semantic Independence: the semantic properties of the relata. contact pur this Context Independence: the rest of the expression. The relative word order of various relations sharing a relatum does not depend on Local Ordering: the rest of the expression. obj farmer contact pur this agt you

17 Syntax Planning: Strategy obj farmer contact pur agt you Divide a nodes relations in Before_set = {obj,pur,agt} After_set = {} this region taluka manch khatav agt aoj obj ins Agt L L L Aoj L L obj pur Topo Sort each group: pur agt obj this you farmer Obj R Ins agt Final order: this you farmer contact

18 Syntax Planning Algo this you manchar region taluka farmer contact this you manchar region taluka farmer Contact manchar region taluka farmer contact taluka manchar this you region farmer contact Output After Current Before Current Stack you this farmer agt obj pur plc Contact nam or region khatav manchar taluka nam :01

19 All Together (UNL -> Hindi) Module UNL Expression Lexeme Selection Case Identification Morphology Generation Function Word Insertion Syntax Linearization Output obj(contact(.. स पक कस न यह आप त ल क म चर खट व contact farmer this you region taluka manchar khatav स पक कस न * * यह आप त ल क * म चर खट व contact farmer * this you region * taluka * manchar khatav स पक क जए कस न यह आप contact.@imperative farmer.@pl this you region त ल क म चर खट व taluka manchar Khatav स पक क जए कस न क इसक लए आप contact farmers this for you region य त ल क क म चर खट व or taluka of Manchar Khatav इसक लए आप म चर य खट व This for you manchar region or khatav त ल क क कस न क स पक क जए taluka of farmers contact

20 How to Evaluate UNL Deconversion UNL -> Hindi Reference Translation needs to be generated from UNL Needs expertise Compromise: Generate reference translation from original English sentence from which UNL was generated Works if you assume that UNL generation was perfect Note that fidelity is not an issue

21 Input Detail Marathi -> English -> UNL 901 Sentences from Agriculture Domain English: Median length 14 word, std dev 7.5 Hindi Reference translation generated from English

22 Manual Evaluation Guidelines Fluency of the given translation is: (4) Perfect: Good grammar (3) Fair: Easy-to-understand but flawed grammar (2) Acceptable: Broken - understandable with effort (1) Nonsense: Incomprehensible Adequacy: How much meaning of the reference sentence is conveyed in the translation: (4) All: No loss of meaning (3) Most: Most of the meaning is conveyed (2) Some: Some of the meaning is conveyed (1) None: Hardly any meaning is conveyed

23 Sample Translations Hindi Output कवक क क रण आम क न ज क प य य द झ लस रह ह 0.5 तशत क ब ड म ण 10 ल टर प न क स थ त छ ड़क ज न च हए पर ण क अन प नय मत प स फल क अ छ व क लए ख द क ख र क द ज न च हए Fluency 2 3 Adequacy 3 4 हम म थ क फसल क ब द ब त ह म थ और ध नय फसल क अ बढ़न य अ बढ़न बत 1 1 ज व वक स मण स इसक जड़ भ वत ह त ह इम क प र ट इट क प रव र क स ब धत ह त ह और थ ड़ यह श त रम ग क स थ सम न दखत ह

24 Results BLEU Fluency Adequacy Geometric Average Arithmetic Average Standard Deviation Pearson Cor. BLEU Pearson Cor. Fluency Number of sentences Fluency vs Adequacy Fluency Good Correlation between Fluency and BLUE Strong Correlation between Fluency and Adequacy Can do large scale evaluation using Fluency alone Caution: Domain diversity, Speaker diversity Adequacy 1 Adequacy 2 Adequacy 3 Adequacy 4

25 Future Work Extend to Marathi and other languages Test in domains other than agriculture

26 Thanks!!

DEPARTMENT OF MECHANICAL ENGINEERING MONAD UNIVERSITY, HAPUR

DEPARTMENT OF MECHANICAL ENGINEERING MONAD UNIVERSITY, HAPUR Session - (2018-2019) Programme Name: Student s Name: Father s Name: Enrollment Number: Course Name: Course Code: Assignment Number: Date of Submission: Course Faculty Signature Course: DIPME-211 Strength