From Language towards. Formal Spatial Calculi
|
|
- Dylan Bell
- 5 years ago
- Views:
Transcription
1 From Language towards Formal Spatial Calculi Parisa Kordjamshidi Martijn Van Otterlo Marie-Francine Moens Katholieke Universiteit Leuven Computer Science Department CoSLI August
2 Introduction Goal: What is placed Where Key points Multimodal environment Unrestricted language Formal spatial representation Relational machine learning Spatial extraction and reasoning Current experiments & Future plans 2
3 Motivation(Multimodal Environment) 1. so from here exactly opposite is my desk. 2. and next to that left of that is my computer, perhaps a meter away. 3. (breathing) ähm. 4. next to that at the wall is my kitchen, first there is my fridge all the way to the right. Room Description [Bateman, et.al, 2006] 3
4 Two level of semantics Language side and Spatial Role Labeling: Automatic labeling of natural language with a set of spatial roles. Space side and Spatial Formalizing Automatic mapping of the output of SpRL to formal relations in spatial calculi. 4
5 Spatial role labeling task Trajectory Landmark Landmark Give me that book on the table in the living room. ON(book,table) IN(table, living room) Spatial Indicator Trajectory Spatial Indicator IN(book,living room)? 5
6 Labeling the parse tree 6
7 Holistic spatial semantics The entity whose location or motion is of relevance. A binary component; whether there is perceived motion or not. Motion Trajector Landmark Path The reference entity in relation to which the location or motion of the trajector is determined. In terms of its beginning, middle and end. The direction along the axes provided by the different frames of reference. Direction Frame of Reference Region A region of space which is defined in relation to a landmark. Three types of frame of reference: intrinsic, relative or absolute. 7
8 Relational representation TRAJECTOR(id, token) LANDMARK(id, token, path) SPATIAL-INDICATOR(id, token,general-type, specific-type, spatial-value) MOTION-INDICATOR(id, token) SR(id, trajector, landmark, spatial-indicator, frame-of-reference, motion-indicator) 8
9 (Example: The vase is in the living room on the table under the window.) <TRAJECTOR id= 1 > The vase </TRAJECTOR> <LANDMARK id= 1 path= ZERO > the living room </LANDMARK> <LANDMARK id= 2 path= ZERO > the table </LANDMARK> <LANDMARK id= 3 path= ZERO >the window </LANDMARK > <SPATIAL-INDICATOR id= 1 general-type= REGION specific-type= RCC8 spatial-value= NTPP > in </SPATIAL-INDICATOR> <SPATIAL-INDICATOR id= 2 general-type= REGION specific-type= RCC8 spatial-value= EC > on </SPATIAL-INDICATOR> <SPATIAL-INDICATOR id= 3 general-type= DIRECTION specific-type= RELATIVE spatial-value= BELOW > under </SPATIAL-INDICATOR> <SR id= 1 trajector= 1 landmark= 1 spatial-indicator= 1 frame-of-reference= INTRINSIC motion-indicator= NIL /> <SR id= 2 trajector= 1 landmark= 2 spatial-indicator= 2 frame-of-reference= INTRINSIC motion-indicator= NIL /> <SR id=3 trajector=1 landmark=3 spatial-indicator=3 frame-of-reference=intrinsic motionindicator=nil/> [Ref. LREC2010] 9
10 Spatial reasoning Extraction for Reasoning or Reasoning for Extraction? The vase is on the table to your left. on(vase,table) left(table, you) left(vase,you)? The vase is on the ground to your left. on(vase, ground) left(vase,you) on(you,ground)? 10
11 Mapping to formal spatial relations (Spatial formalizing) Spatial Relations Region Direction Distance Qualitative RCC8 Absolute Relative Quantitative close... PO DC TPP-1 TPP EC NTPP NTPP-1 EQ West South East North SW SW NW LEFT RIGHT FRONT BELOW BEHIND ABOVE 30 km... SE 11
12 GUM ontology 12
13 Mapping to spatial calculi and next to that left of that is my computer, perhaps a meter away. Computer Desk LeftProjectionExt [distance: 1m] next-to(computer,that) DC(computer,that) left-of(computer,that) LEFT(computer, that) a-meter-away(computer,that) DC(computer,that) + In this way: Distance(computer, that, a meter) first: For reasoning we can gain reasoning based on RCC+ Directions+ Distances. It means a combination of spatial calculus. second: These extracted relations are uncertain, we need learning from examples + probabilistic logical inference. third: these capacities are gathered in statistical relational learning
14 Representation towards spatial reasoning 1. opposite(desk, here) FRONT(desk, here) 2. next-to(computer,that) DC(computer,that) left-of(computer,that) LEFT(computer, that) a-meter-away(computer,that) DC(computer,that) + Distance(computer, that, a meter) 4. next-to(kitchen,computer) DC(kitchen,computer) at(kitchen, wall) EC(kitchen,wall) first(fridge,nil) ClOSE( fridge, you) right(fridge,you) RIGHT(fridge,you) 5. In(water-can, corner) TPP(water-can, corner) In(flowers, corner) TPP(flowers, corner) 1. er, so from here exactly opposite is my desk. 2. and next to that left of that is my computer, perhaps a meter away. 3. (breathing) ähm, (1) [er]. 4. next to that at the wall is my kitchen, first there is my fridge all the way to the right. 5. in the corner where there s also my flowers, is my watering can. 6. and there is my stove, and the table with my sugar bowl is also at the side of the fridge. 7. left of that. 8. yes, and er - so to say behind me but left, er, is the entrance door 9. then further to the right of me directly is my dining table. 10. and er, how is it,from my position let s say between er twelve o clock and three o clock there is directly the TV set 11. and er, to the right of that is my sofa,which I cannot sit on you know, only the guests 12. and also my,er, beautiful coffee table. 14
15 Representation towards spatial reasoning Utterance Locatum Relatum GUM Category 1 Desk Self NonprojectionAxial: opposite 2 Computer Desk LeftProjectionExt [distance: 1m] 4 Kitchen Computer HorizontalProjectionExt: next 4 Kitchen Wall ExternalConnection: at 4 Fridge Kitchen RightProjectionInt: rightmost 4 Fridge Corner Containment: in 5 Houseplant Corner Utterance Containment: NL Spatial in relation Formal Spatial Relation 6 Stove There 1 opposite(desk, ExternalConnection: here) at FRONT(desk, here) 6 {Stove, kitchen table} Fridge 2 next-to(computer,that) HorizontalProjectionExt: side of DC(computer,that) 6 7 {Stove, kitchen table} Fridge left-of(computer,that) LeftProjectionExt LEFT(computer, that) 9 Entrance Self BackProjectionExt a-meter-away(computer,that) DC(computer,that) + 10 Dining table Self RightProjectionExt Distance(computer, that, a meter) 4 next-to(kitchen,computer) DC(kitchen,computer) at(kitchen, wall) EC(kitchen,wall) first(fridge, NIL) CLOSE( fridge, you) right(fridge,you) RIGHT(fridge,you) 5 In(water-can, corner) TPP(water-can, corner) In(flowers, corner) TPP(flowers, corner) 15
16 Grounded spatial communication A table-top scene : the apples are on the table A street-scale scene : the car is in front of the church 1. Selection of appropriate reference object(s) 2. Adoption of appropriate reference frame 3. Use of correct spatial prepositions
17 Spatial Puzzle Text Spatial Role Labeling Mapping NL to Spatial Ontology Mapping to Formal Spatial Relations Discourse Level Extracts Spatial Reasoning Grounding Spatial Relations Image/ Video 17
18 Current experiments (Preposition disambiguation) The book is on the table. TPP Data on: spatial sense Sentence Linguistically motivated features extracted from parser, dependency tree, semantic role labeler. Preposition Disambigation using Machine Learning(Mallet) The meeting is on Monday. Preposition with spatial sense on: temporal sense 18
19 Current experiments (Extraction of trajector and landmark) GUM Data Sentence Linguistically motivated features extracted from parser, dependency tree, semantic role labeler. Argument Identification and Classification The book is on the table. Classify the words with respect to the detected spatial indicator on. Spatial Indicator Word-based Constituent-based Sentence (parse tree) labeled with spatial roles Word-based the: None book: Trajector is : None the : None table: Landmark Sequence-tagging 19
20 Current experiments Preposition disambiguation gaining 87.4% accuracy, outperforming the previous works by 1.3% increase. SemEval07 data (Litkowski and Hargraves, 2007).. gaining 88% accuracy over spatial prepositions. Extraction of trajector and landmark 20
21 Conclusion & Future directions Conclusion Introduced two semantic levels for mapping language to spatial calculi Covering spatial semantics including dynamic and static spatial information Promising experimental results 21
22 Conclusion & Future directions Ongoing work and Future directions Getting annotated corpus for the whole scheme (currently working on CLEF, IAPRTC-12 Image Benchmark) Statistical relational learning for the whole automatic mapping (injecting background knowledge to the system in a logical formalization) Spatial reasoning, combining multimodal information 22
23 Thank you! Questions? 23
Machine Learning for Interpretation of Spatial Natural Language in terms of QSR
Machine Learning for Interpretation of Spatial Natural Language in terms of QSR Parisa Kordjamshidi 1, Joana Hois 2, Martijn van Otterlo 1, and Marie-Francine Moens 1 1 Katholieke Universiteit Leuven,
More informationSpatial Role Labeling CS365 Course Project
Spatial Role Labeling CS365 Course Project Amit Kumar, akkumar@iitk.ac.in Chandra Sekhar, gchandra@iitk.ac.in Supervisor : Dr.Amitabha Mukerjee ABSTRACT In natural language processing one of the important
More informationSpatial Role Labeling: Towards Extraction of Spatial Relations from Natural Language
Spatial Role Labeling: Towards Extraction of Spatial Relations from Natural Language PARISA KORDJAMSHIDI, MARTIJN VAN OTTERLO and MARIE-FRANCINE MOENS Katholieke Universiteit Leuven This article reports
More informationDepartment of Computer Science and Engineering Indian Institute of Technology, Kanpur. Spatial Role Labeling
Department of Computer Science and Engineering Indian Institute of Technology, Kanpur CS 365 Artificial Intelligence Project Report Spatial Role Labeling Submitted by Satvik Gupta (12633) and Garvit Pahal
More informationSemEval-2012 Task 3: Spatial Role Labeling
SemEval-2012 Task 3: Spatial Role Labeling Parisa Kordjamshidi Katholieke Universiteit Leuven parisa.kordjamshidi@ cs.kuleuven.be Steven Bethard University of Colorado steven.bethard@ colorado.edu Marie-Francine
More informationCLEF 2017: Multimodal Spatial Role Labeling (msprl) Task Overview
CLEF 2017: Multimodal Spatial Role Labeling (msprl) Task Overview Parisa Kordjamshidi 1, Taher Rahgooy 1, Marie-Francine Moens 2, James Pustejovsky 3, Umar Manzoor 1 and Kirk Roberts 4 1 Tulane University
More informationGlobal Machine Learning for Spatial Ontology Population
Global Machine Learning for Spatial Ontology Population Parisa Kordjamshidi, Marie-Francine Moens KU Leuven, Belgium Abstract Understanding spatial language is important in many applications such as geographical
More informationCLEF 2017: Multimodal Spatial Role Labeling (msprl) Task Overview
CLEF 2017: Multimodal Spatial Role Labeling (msprl) Task Overview Parisa Kordjamshidi 1(B), Taher Rahgooy 1, Marie-Francine Moens 2, James Pustejovsky 3, Umar Manzoor 1, and Kirk Roberts 4 1 Tulane University,
More informationSemEval-2013 Task 3: Spatial Role Labeling
SemEval-2013 Task 3: Spatial Role Labeling Oleksandr Kolomiyets, Parisa Kordjamshidi, Steven Bethard and Marie-Francine Moens KU Leuven, Celestijnenlaan 200A, Heverlee 3001, Belgium University of Colorado,
More informationUTD: Ensemble-Based Spatial Relation Extraction
UTD: Ensemble-Based Spatial Relation Extraction Jennifer D Souza and Vincent Ng Human Language Technology Research Institute University of Texas at Dallas Richardson, TX 75083-0688 {jld082000,vince}@hlt.utdallas.edu
More informationFrom Descriptions to Depictions: A Conceptual Framework
Preprint version. Please refer to the publisher s version for authoritative text. Cite as: Vasardani, M., Timpf, S., Winter, S., & Tomko, M. (2013). From Descriptions to Depictions: A Conceptual Framework.
More informationExtracting Spatial Information From Place Descriptions
Extracting Spatial Information From Place Descriptions Arbaz Khan Department of Computer Science and Engineering Indian Institute of Technology Kanpur Uttar Pradesh, India arbazk@iitk.ac.in Maria Vasardani
More informationSpatial relations in natural language. A constraint-based approach
Spatial relations in natural language A constraint-based approach Øyvind Nordsted Wedøe Master s Thesis Spring 2014 Spatial relations in natural language Øyvind Nordsted Wedøe 30th April 2014 ii Contents
More informationAnnotation tasks and solutions in CLARIN-PL
Annotation tasks and solutions in CLARIN-PL Marcin Oleksy, Ewa Rudnicka Wrocław University of Technology marcin.oleksy@pwr.edu.pl ewa.rudnicka@pwr.edu.pl CLARIN ERIC Common Language Resources and Technology
More informationNAACL HLT Spatial Language Understanding (SpLU-2018) Proceedings of the First International Workshop
NAACL HLT 2018 Spatial Language Understanding (SpLU-2018) Proceedings of the First International Workshop June 6, 2018 New Orleans, Louisiana c 2018 The Association for Computational Linguistics Order
More informationBringing machine learning & compositional semantics together: central concepts
Bringing machine learning & compositional semantics together: central concepts https://githubcom/cgpotts/annualreview-complearning Chris Potts Stanford Linguistics CS 244U: Natural language understanding
More informationMaschinelle Sprachverarbeitung
Maschinelle Sprachverarbeitung Parsing with Probabilistic Context-Free Grammar Ulf Leser Content of this Lecture Phrase-Structure Parse Trees Probabilistic Context-Free Grammars Parsing with PCFG Other
More informationMaschinelle Sprachverarbeitung
Maschinelle Sprachverarbeitung Parsing with Probabilistic Context-Free Grammar Ulf Leser Content of this Lecture Phrase-Structure Parse Trees Probabilistic Context-Free Grammars Parsing with PCFG Other
More informationTALP at GeoQuery 2007: Linguistic and Geographical Analysis for Query Parsing
TALP at GeoQuery 2007: Linguistic and Geographical Analysis for Query Parsing Daniel Ferrés and Horacio Rodríguez TALP Research Center Software Department Universitat Politècnica de Catalunya {dferres,horacio}@lsi.upc.edu
More informationGeographic Analysis of Linguistically Encoded Movement Patterns A Contextualized Perspective
Geographic Analysis of Linguistically Encoded Movement Patterns A Contextualized Perspective Alexander Klippel 1, Alan MacEachren 1, Prasenjit Mitra 2, Ian Turton 1, Xiao Zhang 2, Anuj Jaiswal 2, Kean
More informationInformation Extraction from Text
Information Extraction from Text Jing Jiang Chapter 2 from Mining Text Data (2012) Presented by Andrew Landgraf, September 13, 2013 1 What is Information Extraction? Goal is to discover structured information
More informationSieve-Based Spatial Relation Extraction with Expanding Parse Trees
Sieve-Based Spatial Relation Extraction with Expanding Parse Trees Jennifer D Souza and Vincent Ng Human Language Technology Research Institute University of Texas at Dallas Richardson, TX 75083-0688 {jld082000,vince}@hlt.utdallas.edu
More informationDriving Semantic Parsing from the World s Response
Driving Semantic Parsing from the World s Response James Clarke, Dan Goldwasser, Ming-Wei Chang, Dan Roth Cognitive Computation Group University of Illinois at Urbana-Champaign CoNLL 2010 Clarke, Goldwasser,
More informationAnnotating Spatial Containment Relations Between Events. Kirk Roberts, Travis Goodwin, and Sanda Harabagiu
Annotating Spatial Containment Relations Between Events Kirk Roberts, Travis Goodwin, and Sanda Harabagiu Problem Previous Work Schema Corpus Future Work Problem Natural language documents contain a large
More informationNATURAL LANGUAGE PROCESSING. Dr. G. Bharadwaja Kumar
NATURAL LANGUAGE PROCESSING Dr. G. Bharadwaja Kumar Sentence Boundary Markers Many natural language processing (NLP) systems generally take a sentence as an input unit part of speech (POS) tagging, chunking,
More informationChunking with Support Vector Machines
NAACL2001 Chunking with Support Vector Machines Graduate School of Information Science, Nara Institute of Science and Technology, JAPAN Taku Kudo, Yuji Matsumoto {taku-ku,matsu}@is.aist-nara.ac.jp Chunking
More informationMaintaining Relational Consistency in a Graph-Based Place Database
Maintaining Relational Consistency in a Graph-Based Place Database Hao Chen Department of Infrastructure Engineering, Geomatics The University of Melbourne Email: hchen@student.unimelb.edu.au Introduction
More informationRepresenting structured relational data in Euclidean vector spaces. Tony Plate
Representing structured relational data in Euclidean vector spaces Tony Plate tplate@acm.org http://www.d-reps.org October 2004 AAAI Symposium 2004 1 Overview A general method for representing structured
More informationpursues interdisciplinary long-term research in Spatial Cognition. Particular emphasis is given to:
The Transregional Collaborative Research Center SFB/TR 8 Spatial Cognition: Reasoning, Action, Interaction at the Universities of Bremen and Freiburg, Germany pursues interdisciplinary long-term research
More informationProbabilistic Context-free Grammars
Probabilistic Context-free Grammars Computational Linguistics Alexander Koller 24 November 2017 The CKY Recognizer S NP VP NP Det N VP V NP V ate NP John Det a N sandwich i = 1 2 3 4 k = 2 3 4 5 S NP John
More informationLatent Variable Models in NLP
Latent Variable Models in NLP Aria Haghighi with Slav Petrov, John DeNero, and Dan Klein UC Berkeley, CS Division Latent Variable Models Latent Variable Models Latent Variable Models Observed Latent Variable
More informationGeoVISTA Center, Department of Geography, The Pennsylvania State University, PA, USA
Formally grounding spatio-temporal thinking Klippel, A., Wallgrün, J. O., Yang, J., Li, R., & Dylla, F. (in print, 2012). Formally grounding spatio temporal thinking. Cognitive Processing. Alexander Klippel
More informationClock-Modeled Ternary Spatial Relations for Visual Scene Analysis
Clock-Modeled Ternary Spatial Relations for Visual Scene Analysis Joanna Isabelle Olszewska School of Computing and Engineering, University of Huddersfield Queensgate, Huddersfield, HD1 3DH, United Kingdom
More informationA proof theoretical account of polarity items and monotonic inference.
A proof theoretical account of polarity items and monotonic inference. Raffaella Bernardi UiL OTS, University of Utrecht e-mail: Raffaella.Bernardi@let.uu.nl Url: http://www.let.uu.nl/ Raffaella.Bernardi/personal
More informationMachine Learning for natural language processing
Machine Learning for natural language processing Classification: Maximum Entropy Models Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Summer 2016 1 / 24 Introduction Classification = supervised
More informationCS626: NLP, Speech and the Web. Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 14: Parsing Algorithms 30 th August, 2012
CS626: NLP, Speech and the Web Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 14: Parsing Algorithms 30 th August, 2012 Parsing Problem Semantics Part of Speech Tagging NLP Trinity Morph Analysis
More information10/17/04. Today s Main Points
Part-of-speech Tagging & Hidden Markov Model Intro Lecture #10 Introduction to Natural Language Processing CMPSCI 585, Fall 2004 University of Massachusetts Amherst Andrew McCallum Today s Main Points
More informationA Supertag-Context Model for Weakly-Supervised CCG Parser Learning
A Supertag-Context Model for Weakly-Supervised CCG Parser Learning Dan Garrette Chris Dyer Jason Baldridge Noah A. Smith U. Washington CMU UT-Austin CMU Contributions 1. A new generative model for learning
More informationLaconic: Label Consistency for Image Categorization
1 Laconic: Label Consistency for Image Categorization Samy Bengio, Google with Jeff Dean, Eugene Ie, Dumitru Erhan, Quoc Le, Andrew Rabinovich, Jon Shlens, and Yoram Singer 2 Motivation WHAT IS THE OCCLUDED
More informationNatural Language Processing CS Lecture 06. Razvan C. Bunescu School of Electrical Engineering and Computer Science
Natural Language Processing CS 6840 Lecture 06 Razvan C. Bunescu School of Electrical Engineering and Computer Science bunescu@ohio.edu Statistical Parsing Define a probabilistic model of syntax P(T S):
More informationhow to *do* computationally assisted research
how to *do* computationally assisted research digital literacy @ comwell Kristoffer L Nielbo knielbo@sdu.dk knielbo.github.io/ March 22, 2018 1/30 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 class Person(object):
More informationPersonal Project: Shift-Reduce Dependency Parsing
Personal Project: Shift-Reduce Dependency Parsing 1 Problem Statement The goal of this project is to implement a shift-reduce dependency parser. This entails two subgoals: Inference: We must have a shift-reduce
More informationSemantic Role Labeling via Tree Kernel Joint Inference
Semantic Role Labeling via Tree Kernel Joint Inference Alessandro Moschitti, Daniele Pighin and Roberto Basili Department of Computer Science University of Rome Tor Vergata 00133 Rome, Italy {moschitti,basili}@info.uniroma2.it
More informationToponym Disambiguation using Ontology-based Semantic Similarity
Toponym Disambiguation using Ontology-based Semantic Similarity David S Batista 1, João D Ferreira 2, Francisco M Couto 2, and Mário J Silva 1 1 IST/INESC-ID Lisbon, Portugal {dsbatista,msilva}@inesc-id.pt
More informationHidden Markov Models
CS 2750: Machine Learning Hidden Markov Models Prof. Adriana Kovashka University of Pittsburgh March 21, 2016 All slides are from Ray Mooney Motivating Example: Part Of Speech Tagging Annotate each word
More informationModeling Complex Temporal Composition of Actionlets for Activity Prediction
Modeling Complex Temporal Composition of Actionlets for Activity Prediction ECCV 2012 Activity Recognition Reading Group Framework of activity prediction What is an Actionlet To segment a long sequence
More informationA Context-Free Grammar
Statistical Parsing A Context-Free Grammar S VP VP Vi VP Vt VP VP PP DT NN PP PP P Vi sleeps Vt saw NN man NN dog NN telescope DT the IN with IN in Ambiguity A sentence of reasonable length can easily
More informationLogic Background (1A) Young W. Lim 12/14/15
Young W. Lim 12/14/15 Copyright (c) 2014-2015 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any
More informationLeaving Some Stones Unturned: Dynamic Feature Prioritization for Activity Detection in Streaming Video
In Proceedings of the European Conference on Computer Vision (ECCV), 26 Leaving Some Stones Unturned: Dynamic Feature Prioritization for Activity Detection in Streaming Video Yu-Chuan Su and Kristen Grauman
More informationClick Prediction and Preference Ranking of RSS Feeds
Click Prediction and Preference Ranking of RSS Feeds 1 Introduction December 11, 2009 Steven Wu RSS (Really Simple Syndication) is a family of data formats used to publish frequently updated works. RSS
More informationEmpirical Methods in Natural Language Processing Lecture 11 Part-of-speech tagging and HMMs
Empirical Methods in Natural Language Processing Lecture 11 Part-of-speech tagging and HMMs (based on slides by Sharon Goldwater and Philipp Koehn) 21 February 2018 Nathan Schneider ENLP Lecture 11 21
More informationA Probabilistic Forest-to-String Model for Language Generation from Typed Lambda Calculus Expressions
A Probabilistic Forest-to-String Model for Language Generation from Typed Lambda Calculus Expressions Wei Lu and Hwee Tou Ng National University of Singapore 1/26 The Task (Logical Form) λx 0.state(x 0
More informationAn Inquisitive Formalization of Interrogative Inquiry
An Inquisitive Formalization of Interrogative Inquiry Yacin Hamami 1 Introduction and motivation The notion of interrogative inquiry refers to the process of knowledge-seeking by questioning [5, 6]. As
More informationGlobal Behaviour Inference using Probabilistic Latent Semantic Analysis
Global Behaviour Inference using Probabilistic Latent Semantic Analysis Jian Li, Shaogang Gong, Tao Xiang Department of Computer Science Queen Mary College, University of London, London, E1 4NS, UK {jianli,
More informationFirst Order Logic (1A) Young W. Lim 11/18/13
Copyright (c) 2013. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software
More informationFormal Semantics Of Verbs For Knowledge Inference
Formal Semantics Of Verbs For Knowledge Inference Igor Boyko, Ph.D. Logical Properties Inc., Montreal, Canada igor_m_boyko@hotmail.com Abstract This short paper is focused on the formal semantic model:
More informationNEURAL LANGUAGE MODELS
COMP90042 LECTURE 14 NEURAL LANGUAGE MODELS LANGUAGE MODELS Assign a probability to a sequence of words Framed as sliding a window over the sentence, predicting each word from finite context to left E.g.,
More informationThe Relevance of Spatial Relation Terms and Geographical Feature Types
The Relevance of Spatial Relation Terms and Geographical Feature Types Reporter Chunju Zhang Date: 2012-05-29 1 2 Introduction Classification of Spatial Relation Terms 3 4 5 Calculation of Relevance Conclusion
More informationSound Recognition in Mixtures
Sound Recognition in Mixtures Juhan Nam, Gautham J. Mysore 2, and Paris Smaragdis 2,3 Center for Computer Research in Music and Acoustics, Stanford University, 2 Advanced Technology Labs, Adobe Systems
More informationTask-Oriented Dialogue System (Young, 2000)
2 Review Task-Oriented Dialogue System (Young, 2000) 3 http://rsta.royalsocietypublishing.org/content/358/1769/1389.short Speech Signal Speech Recognition Hypothesis are there any action movies to see
More informationCapturing Argument Relationships for Chinese Semantic Role Labeling
Capturing Argument Relationships for Chinese Semantic Role abeling ei Sha, Tingsong Jiang, Sujian i, Baobao Chang, Zhifang Sui Key aboratory of Computational inguistics, Ministry of Education School of
More informationIndoor Scene Knowledge Acquisition using a Natural Language Interface Saranya Kesavan and Nicholas A. Giudice
Indoor Scene Knowledge Acquisition using a Natural Language Interface Saranya Kesavan and Nicholas A. Giudice School of Computing and Information Science Spatial Informatics Program, University of Maine
More informationIntelligent GIS: Automatic generation of qualitative spatial information
Intelligent GIS: Automatic generation of qualitative spatial information Jimmy A. Lee 1 and Jane Brennan 1 1 University of Technology, Sydney, FIT, P.O. Box 123, Broadway NSW 2007, Australia janeb@it.uts.edu.au
More informationMulti-theme Sentiment Analysis using Quantified Contextual
Multi-theme Sentiment Analysis using Quantified Contextual Valence Shifters Hongkun Yu, Jingbo Shang, MeichunHsu, Malú Castellanos, Jiawei Han Presented by Jingbo Shang University of Illinois at Urbana-Champaign
More informationOn rigid NL Lambek grammars inference from generalized functor-argument data
7 On rigid NL Lambek grammars inference from generalized functor-argument data Denis Béchet and Annie Foret Abstract This paper is concerned with the inference of categorial grammars, a context-free grammar
More informationSYNTHER A NEW M-GRAM POS TAGGER
SYNTHER A NEW M-GRAM POS TAGGER David Sündermann and Hermann Ney RWTH Aachen University of Technology, Computer Science Department Ahornstr. 55, 52056 Aachen, Germany {suendermann,ney}@cs.rwth-aachen.de
More informationCombining binary constraint networks in qualitative reasoning
Combining binary constraint networks in qualitative reasoning Jason Jingshi Li 1,2 and Tomasz Kowalski 1 and Jochen Renz 1,2 and Sanjiang Li 3 Abstract. Constraint networks in qualitative spatial and temporal
More informationParsing. Probabilistic CFG (PCFG) Laura Kallmeyer. Winter 2017/18. Heinrich-Heine-Universität Düsseldorf 1 / 22
Parsing Probabilistic CFG (PCFG) Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Winter 2017/18 1 / 22 Table of contents 1 Introduction 2 PCFG 3 Inside and outside probability 4 Parsing Jurafsky
More informationAdding ternary complex roles to ALCRP(D)
Adding ternary complex roles to ALCRP(D) A.Kaplunova, V. Haarslev, R.Möller University of Hamburg, Computer Science Department Vogt-Kölln-Str. 30, 22527 Hamburg, Germany Abstract The goal of this paper
More informationAdaptive Multi-Compositionality for Recursive Neural Models with Applications to Sentiment Analysis. July 31, 2014
Adaptive Multi-Compositionality for Recursive Neural Models with Applications to Sentiment Analysis July 31, 2014 Semantic Composition Principle of Compositionality The meaning of a complex expression
More informationSurface Reasoning Lecture 2: Logic and Grammar
Surface Reasoning Lecture 2: Logic and Grammar Thomas Icard June 18-22, 2012 Thomas Icard: Surface Reasoning, Lecture 2: Logic and Grammar 1 Categorial Grammar Combinatory Categorial Grammar Lambek Calculus
More informationarxiv: v2 [cs.cl] 20 Aug 2016
Solving General Arithmetic Word Problems Subhro Roy and Dan Roth University of Illinois, Urbana Champaign {sroy9, danr}@illinois.edu arxiv:1608.01413v2 [cs.cl] 20 Aug 2016 Abstract This paper presents
More informationNatural Language Processing 1. lecture 7: constituent parsing. Ivan Titov. Institute for Logic, Language and Computation
atural Language Processing 1 lecture 7: constituent parsing Ivan Titov Institute for Logic, Language and Computation Outline Syntax: intro, CFGs, PCFGs PCFGs: Estimation CFGs: Parsing PCFGs: Parsing Parsing
More informationA DOP Model for LFG. Rens Bod and Ronald Kaplan. Kathrin Spreyer Data-Oriented Parsing, 14 June 2005
A DOP Model for LFG Rens Bod and Ronald Kaplan Kathrin Spreyer Data-Oriented Parsing, 14 June 2005 Lexical-Functional Grammar (LFG) Levels of linguistic knowledge represented formally differently (non-monostratal):
More informationNatural Language Processing
Natural Language Processing Word vectors Many slides borrowed from Richard Socher and Chris Manning Lecture plan Word representations Word vectors (embeddings) skip-gram algorithm Relation to matrix factorization
More informationCLRG Biocreative V
CLRG ChemTMiner @ Biocreative V Sobha Lalitha Devi., Sindhuja Gopalan., Vijay Sundar Ram R., Malarkodi C.S., Lakshmi S., Pattabhi RK Rao Computational Linguistics Research Group, AU-KBC Research Centre
More informationarxiv: v3 [cs.lg] 14 Jan 2018
A Gentle Tutorial of Recurrent Neural Network with Error Backpropagation Gang Chen Department of Computer Science and Engineering, SUNY at Buffalo arxiv:1610.02583v3 [cs.lg] 14 Jan 2018 1 abstract We describe
More information6.891: Lecture 24 (December 8th, 2003) Kernel Methods
6.891: Lecture 24 (December 8th, 2003) Kernel Methods Overview ffl Recap: global linear models ffl New representations from old representations ffl computational trick ffl Kernels for NLP structures ffl
More informationLab 12: Structured Prediction
December 4, 2014 Lecture plan structured perceptron application: confused messages application: dependency parsing structured SVM Class review: from modelization to classification What does learning mean?
More informationMidterm sample questions
Midterm sample questions CS 585, Brendan O Connor and David Belanger October 12, 2014 1 Topics on the midterm Language concepts Translation issues: word order, multiword translations Human evaluation Parts
More informationLearning Features from Co-occurrences: A Theoretical Analysis
Learning Features from Co-occurrences: A Theoretical Analysis Yanpeng Li IBM T. J. Watson Research Center Yorktown Heights, New York 10598 liyanpeng.lyp@gmail.com Abstract Representing a word by its co-occurrences
More informationDistinguish between different types of scenes. Matching human perception Understanding the environment
Scene Recognition Adriana Kovashka UTCS, PhD student Problem Statement Distinguish between different types of scenes Applications Matching human perception Understanding the environment Indexing of images
More informationComplexity of Probabilistic Disambiguation
Chapter 3 Complexity of Probabilistic Disambiguation Probabilistic disambiguation, represented by the DOP model, constitutes one of the two methods of disambiguation that this thesis combines. A major
More informationCMU at SemEval-2016 Task 8: Graph-based AMR Parsing with Infinite Ramp Loss
CMU at SemEval-2016 Task 8: Graph-based AMR Parsing with Infinite Ramp Loss Jeffrey Flanigan Chris Dyer Noah A. Smith Jaime Carbonell School of Computer Science, Carnegie Mellon University, Pittsburgh,
More informationBar-Hillel and the Division of Labor in Language
Bar-Hillel and the Division of Labor in Language On the interaction of grammar, logic, and pragmatics Luka Crnič November 2, 2015 Language, Logic and Cognition Center http://scholars.huji.ac.il/llcc Luka
More informationThe Formal Representation of Scientific Knowledge with Prolog
The Formal Representation of Scientific Knowledge with Prolog Rolf Plötzner Department of Psychology University of Freiburg Germany TU-Hamburg-Harburg, Februar 1998 1 Overview 1. Theoretical foundations
More informationLECTURER: BURCU CAN Spring
LECTURER: BURCU CAN 2017-2018 Spring Regular Language Hidden Markov Model (HMM) Context Free Language Context Sensitive Language Probabilistic Context Free Grammar (PCFG) Unrestricted Language PCFGs can
More informationThe SUBTLE NL Parsing Pipeline: A Complete Parser for English Mitch Marcus University of Pennsylvania
The SUBTLE NL Parsing Pipeline: A Complete Parser for English Mitch Marcus University of Pennsylvania 1 PICTURE OF ANALYSIS PIPELINE Tokenize Maximum Entropy POS tagger MXPOST Ratnaparkhi Core Parser Collins
More informationLC Graphs for the Lambek calculus with product
LC Graphs for the Lambek calculus with product Timothy A D Fowler July 18, 2007 1 Introduction The Lambek calculus, introduced in Lambek (1958), is a categorial grammar having two variants which will be
More informationPenn Treebank Parsing. Advanced Topics in Language Processing Stephen Clark
Penn Treebank Parsing Advanced Topics in Language Processing Stephen Clark 1 The Penn Treebank 40,000 sentences of WSJ newspaper text annotated with phrasestructure trees The trees contain some predicate-argument
More informationThe Research on Syntactic Features in Semantic Role Labeling
23 6 2009 11 J OU RNAL OF CH IN ESE IN FORMA TION PROCESSIN G Vol. 23, No. 6 Nov., 2009 : 100320077 (2009) 0620011208,,,, (, 215006) :,,,( NULL ),,,; CoNLL22005 Shared Task WSJ 77. 54 %78. 75 %F1, : ;;;;
More informationJointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument Interaction
Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument Interaction Feng Qian,LeiSha, Baobao Chang, Zhifang Sui Institute of Computational Linguistics, Peking
More informationThe Noisy Channel Model and Markov Models
1/24 The Noisy Channel Model and Markov Models Mark Johnson September 3, 2014 2/24 The big ideas The story so far: machine learning classifiers learn a function that maps a data item X to a label Y handle
More informationCorpus annotation with a linguistic analysis of the associations between event mentions and spatial expressions
Corpus annotation with a linguistic analysis of the associations between event mentions and spatial expressions Jin-Woo Chung Jinseon You Jong C. Park * School of Computing Korea Advanced Institute of
More informationFinal exam of ECE 457 Applied Artificial Intelligence for the Spring term 2007.
Spring 2007 / Page 1 Final exam of ECE 457 Applied Artificial Intelligence for the Spring term 2007. Don t panic. Be sure to write your name and student ID number on every page of the exam. The only materials
More informationMultiword Expression Identification with Tree Substitution Grammars
Multiword Expression Identification with Tree Substitution Grammars Spence Green, Marie-Catherine de Marneffe, John Bauer, and Christopher D. Manning Stanford University EMNLP 2011 Main Idea Use syntactic
More informationTransition-based Dependency Parsing with Selectional Branching
Transitionbased Dependency Parsing with Selectional Branching Presented at the 4th workshop on Statistical Parsing in Morphologically Rich Languages October 18th, 2013 Jinho D. Choi University of Massachusetts
More informationMeaning and Reference INTENSIONAL AND MODAL LOGIC. Intensional Logic. Frege: Predicators (general terms) have
INTENSIONAL AND MODAL LOGIC Meaning and Reference Why do we consider extensions to the standard logical language(s)? Requirements of knowledge representation / domain modelling Intensional expressions:
More informationUniversität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen. Language Models. Tobias Scheffer
Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen Language Models Tobias Scheffer Stochastic Language Models A stochastic language model is a probability distribution over words.
More informationLecture 2: Probability, Naive Bayes
Lecture 2: Probability, Naive Bayes CS 585, Fall 205 Introduction to Natural Language Processing http://people.cs.umass.edu/~brenocon/inlp205/ Brendan O Connor Today Probability Review Naive Bayes classification
More information