Unification. Two Routes to Deep Structure. Unification. Unification Grammar. Martin Kay. Stanford University University of the Saarland

Size: px
Start display at page:

Download "Unification. Two Routes to Deep Structure. Unification. Unification Grammar. Martin Kay. Stanford University University of the Saarland"

Transcription

1 Two Routes to Deep Structure Derivational! Transformational! Procedural Deep Unidirectional Transformations Surface Stanford University University of the Saarland Constraint-based! Declarative Deep Surface 1 2 Grammar Functional Grammar FUG Lexical Functional Grammar LFG Generalized Phrase Structure Grammar GPSG PATR II Attribute Report 1 Report 2 Combined Report eyes blue blue blue hair black or brown brown or red brown accent Italian Italian wife see below see below see below children Ahemed & Angela Rebecca & Angela Ahmed, Angela & Rebecca age middle 48 Middle Categorial Grammar CUG Head Driven Phrase Structure Grammar HPSG Wife eyes brown brown weight 247 lbs 112 Kg 247 lbs disposition surly surly 3 4

2 ?- p(a, Q, b) = p(a, A, A). no?- p(a, Q, R) = p(a, A, A). A = a, Q = a, R = a yes?- p(q(a, a), r(x, X), s(y, Y))=p(X, Y, Z). Basic Attribute-Value X = q(a,a), Y = r(q(a,a),q(a,a)), Z = s(r(q(a,a),q(a,a)),r(q(a,a),q(a,a)))? 5 6 Path Graph < PHON > = Antonio < SYN > = noun < SYN NUM > = sg < SEM > = 'antonio PHON SYN SEM Antonio NUM 'antonio' sg noun 7 8

3 Attribute-value Matrix (AVM) phon Antonio num sg cat noun sem antonio Atomic Values number sg Complex Values agr number sg person 3 Coreference of Values number sg agr 1 person 3 subj age PHON SUBJ PRED Tigger meows PHON Tigger AGR NUMBER sing PHON meows AGR NUMBER sing Unified Values PHON SUBJ PRED Tigger meows PHON Tigger AGR 1 NUMBER sing PHON meows AGR 1 NUMBER sing PHON AGR vp AGR sg Tigger meows NUMBER sing!! AGR PHON AGR PHON AGR vp 3sg Tigger meows PERSON 3rd Tigger meows NUMBER sing PERSON 3rd 11 12

4 English Agreement The dog sleeps The dogs sleep Agreement and Subcategoriztion The dog slept The dogs slept The sheep sleeps The sheep sleep The sheep slept Not head driven! The sheep that was in the barn slept The sheep that were in the barn slept The sheep that was in the barn sleeps The sheep that were in the barn sleep German Case Head Percolation Der Junge sah den Lehrer Den Lehrer sah der Junge Das Mädchen sah der Junge der Junge sah das Mädchen Die Lehrerin sah den Lehrer Die Lehrerin sah das Mädchen VP[TENSE = t, NUM= n]! V[SUB=0, TENSE= t, NUM= n] VP[TENSE= t, NUM= n]! V[SUB=1, TENSE= t, NUM= n] NP VP[TENSE= t t, NUM= n]! V[SUB=2, TENSE= t, NUM= n] Sbar V[SUB=0, TENSE=pres, NUM=sg]! 'disappears' 'walks' V[SUB=1, TENSE=pres, NUM=sg]! 'sees' 'likes' V[SUB=2, TENSE=pres, NUM=sg]! 'says' 'claims' 15 16

5 Head Percolation Head Percolation VP[TENSE = t, NUM= n]! V[SUB=0, TENSE= t, NUM= n] VP[TENSE= t, NUM= n]! V[SUB=1, TENSE= t, NUM= n] NP VP[TENSE= t t, NUM= n]! V[SUB=2, TENSE= t, NUM= n] Sbar VP[TENSE = t, NUM= n]! V[SUB=0, TENSE= t, NUM= n] VP[TENSE= t, NUM= n]! V[SUB=1, TENSE= t, NUM= n] NP VP[TENSE= t t, NUM= n]! V[SUB=2, TENSE= t, NUM= n] Sbar V[SUB=0, TENSE=pres, NUM=pl]! 'disappear' 'walk' V[SUB=1, TENSE=pres, NUM=pl]! 'see' 'like' V[SUB=2, TENSE=pres, NUM=pl]! 'say' 'claim' V[SUB=0, TENSE=past, NUM= x]! 'disappeared' 'walked' V[SUB=1, TENSE=past, NUM= x]! 'saw' 'liked' V[SUB=2, TENSE=past, NUM= x]! 'said' 'claimed' PHON sleeps v LEVEL 2 SC2 AGR NP PERS 3 NUM sg CASE nom Lexicalization Agreement Subcategorization Head driven! PHON sleeps v LEVEL 2 SC2 AGR SC1 AGR NP PERS 3 NUM sg CASE nom NP PERS 3 CASE nom v SC3 1! 1 SC2 v SC2 1 v! SC1 1 v

6 Disjunction as Conjunction P I you she they sleeps _ X X sleep _ slept X X 2 was nom acc gen dat masc neut fem plur der das die die den das die die des des der der dem dem der den German Noun Morphology Disjunction as Conjunction nom acc gen dat masc neut fem plur P I you she they sleeps _ X X sleep _ slept X X 2 was Strong Weak Nom Acc Gen Dat Nom Acc Gen Dat M F N P M F N P M F N P M F N P M F N P M F N P M F N P M F N P A A A A A A A A A B B B B 2 2 der 1 C C C C D D D D E E E E F F F F G G G G H H H H I I I I 2 2 Frau I I I I 2 2 der Frau A A B B B B ein 1 1 C C C C D D E E F F F F F F F F G G G G H H I I großes 1 1 I I I I J J J J K K K K K K K K L L L L M M M M Haus 1 1 N N N N ein Großes Haus 23 24

7 What about this? Typed Feature Structures PERS v NUM 3 CASE indic Type Hierarchy case-type A particular attribute admits values of a particular type, and AVM's of a particular type admit attributes drawn from a particular set. gen-dat acc-dat nom-gen nom-acc dat gen acc nom 27 28

8 Types Type Definition 3rd sg. not 3rd sg. Specifies what features are allowable for objects of the given type. Specifies what types may unify. 1st sg. 2nd sg. 1st pl. 2nd pl. 3rd pl Typed Feature Structures Feature Structures are given sort or type names Type names correspond to classes of linguistic objects, which are, in addition, described by feature structures Certain features are appropriate for certain types Types constitute a hierarchy of Typed FS s Two feature structures f 1 and f 2, with types t 1 and t 2, unify iff The (untyped) feature structures unify, and The greatest lower bound of t 1 and t 2 is non empty 3sgmas-agr AGR 3sgmas NUMBER sg PERSON 3 GENDER MAS nom-acc CASE cval OBL -! nom-acc CASE nom-gen cval CASE OBL - cval OBL +,

9 Type Inheritance verb +subj+3sg+obj +subj+obj+that +subj+that +subj +subj+iobj+obj +subj+obj finite 3sg 1args 2args active passive +subj-3sg-obj +passive +subj +that +obj +iobj loves loved loved Trans+3sg Trans-3sg Intrans-3sg Intrans+3sg Type Definitions The child sleeps The children sleep The child slept The children slept The child finds the ball The children find the ball The child found the ball The children found the ball The child hands the ball to the teacher The children hand the ball to the teacher The child handed the ball to the teacher The children handed the ball to the teacher 35 finite: 3rd-sg: finite SYN SYN AGR 1 SUBJ np agr SYN AGR 1 AGR 1 NUM sg PERSON 3 36

10 Type Inheritance 2arg: SEM REL atom ARG1 ARG2 arg arg sem intransitive: SYN SUBJ np CASE nom transitive: intransitive 2arg SYN OBJ CASE acc np

The Formal Architecture of. Lexical-Functional Grammar. Ronald M. Kaplan and Mary Dalrymple

The Formal Architecture of. Lexical-Functional Grammar. Ronald M. Kaplan and Mary Dalrymple The Formal Architecture of Lexical-Functional Grammar Ronald M. Kaplan and Mary Dalrymple Xerox Palo Alto Research Center 1. Kaplan and Dalrymple, ESSLLI 1995, Barcelona Architectural Issues Representation:

More information

Tree Adjoining Grammars

Tree Adjoining Grammars Tree Adjoining Grammars Feature Structure Based TAG Laura Kallmeyer & Benjamin Burkhardt HHU Düsseldorf WS 2017/2018 1 / 20 Outline 1 Why feature structures? 2 Basics of feature structure logic 3 Feature

More information

Grammar and Feature Unification

Grammar and Feature Unification Grammar and Feature Unification Problems with CF Phrase Structure Grammars Difficult to capture dependencies between constituents the boy runs the boys run * the boy run * the boys runs Problems with CF

More information

Topics in LFG: Issues in NP Coordination. Louisa 4.332

Topics in LFG: Issues in NP Coordination. Louisa 4.332 Topics in LFG: Issues in NP Coordination Louisa Sadler;louisa@essex.ac.uk; 4.332 1 Resolution Person Resolution (1) José José y and yo I José and I speak hablamos speak.1pl 2 (2) PERS 1 NUM PL CONJ AND

More information

HPSG: Binding Theory

HPSG: Binding Theory HPSG: Binding Theory Doug Arnold doug@essexacuk Introduction Binding Theory is to do with the syntactic restrictions on the distribution of referentially dependent items and their antecedents: reflexives/reciprocals

More information

Ling 240 Lecture #15. Syntax 4

Ling 240 Lecture #15. Syntax 4 Ling 240 Lecture #15 Syntax 4 agenda for today Give me homework 3! Language presentation! return Quiz 2 brief review of friday More on transformation Homework 4 A set of Phrase Structure Rules S -> (aux)

More information

Context-free grammars for natural languages

Context-free grammars for natural languages Context-free grammars Basic definitions Context-free grammars for natural languages Context-free grammars can be used for a variety of syntactic constructions, including some non-trivial phenomena such

More information

1. Background. Task: Determine whether a given string of words is a grammatical (well-formed) sentence of language L i or not.

1. Background. Task: Determine whether a given string of words is a grammatical (well-formed) sentence of language L i or not. Constraints in Syntax [1] Phrase Structure and Derivations Düsseldorf LSA/DGfS Summerschool 2002 Gereon Müller (IDS Mannheim) gereon.mueller@ids-mannheim.de 1. Background Task: Determine whether a given

More information

Feature Constraint Logics. for Unication Grammars. Gert Smolka. German Research Center for Articial Intelligence and. Universitat des Saarlandes

Feature Constraint Logics. for Unication Grammars. Gert Smolka. German Research Center for Articial Intelligence and. Universitat des Saarlandes Feature Constraint Logics for Unication Grammars Gert Smolka German Research Center for Articial Intelligence and Universitat des Saarlandes Stuhlsatzenhausweg 3, D-66123 Saarbrucken, Germany smolka@dfki.uni-sb.de

More information

Some binding facts. Binding in HPSG. The three basic principles. Binding theory of Chomsky

Some binding facts. Binding in HPSG. The three basic principles. Binding theory of Chomsky Some binding facts Binding in HPSG Binding theory has to do with constraining referentially dependent elements in terms of what is a possible antecedent, or binder. Introduction to HPSG June, 009 (1) John

More information

Grundlagenmodul Semantik All Exercises

Grundlagenmodul Semantik All Exercises Grundlagenmodul Semantik All Exercises Sommersemester 2014 Exercise 1 Are the following statements correct? Justify your answers in a single short sentence. 1. 11 {x x is a square number} 2. 11 {x {y y

More information

A DOP Model for LFG. Rens Bod and Ronald Kaplan. Kathrin Spreyer Data-Oriented Parsing, 14 June 2005

A DOP Model for LFG. Rens Bod and Ronald Kaplan. Kathrin Spreyer Data-Oriented Parsing, 14 June 2005 A DOP Model for LFG Rens Bod and Ronald Kaplan Kathrin Spreyer Data-Oriented Parsing, 14 June 2005 Lexical-Functional Grammar (LFG) Levels of linguistic knowledge represented formally differently (non-monostratal):

More information

WORKSHEET. Área: ingles Periodo: 1 Fecha: 26 feb al 2 Mar. Competencia: writing and grammar comprehension. Uses of the past tenses Part I

WORKSHEET. Área: ingles Periodo: 1 Fecha: 26 feb al 2 Mar. Competencia: writing and grammar comprehension. Uses of the past tenses Part I WORKSHEET Área: ingles Periodo: 1 Fecha: 26 feb al 2 Mar. Tema: Past Tenses Grado: 11th grade Competencia: writing and grammar comprehension Uses of the past tenses Part I The simple past tense is also

More information

HPSG II: the plot thickens

HPSG II: the plot thickens Syntactic Models 2/21/06 HPSG II: the plot thickens 1 Passive: a lexical rule that rearranges ARG-ST! (1) Passive Lexical Rule < 1, tv - lxm ARG - ST INDEX i < FPSP 1 a, > part - lxm SYN HEAD FORM pass

More information

1 Rules in a Feature Grammar

1 Rules in a Feature Grammar 27 Feature Grammars and Unification Drew McDermott drew.mcdermott@yale.edu 2015-11-20, 11-30, 2016-10-28 Yale CS470/570 1 Rules in a Feature Grammar Grammar rules look like this example (using Shieber

More information

Ling 5801: Lecture Notes 7 From Programs to Context-Free Grammars

Ling 5801: Lecture Notes 7 From Programs to Context-Free Grammars Ling 5801: Lecture otes 7 From Programs to Context-Free rammars 1. The rules we used to define programs make up a context-free grammar A Context-Free rammar is a tuple C,X,S,R, where: C is a finite set

More information

Proseminar on Semantic Theory Fall 2013 Ling 720 The Proper Treatment of Quantification in Ordinary English, Part 1: The Fragment of English

Proseminar on Semantic Theory Fall 2013 Ling 720 The Proper Treatment of Quantification in Ordinary English, Part 1: The Fragment of English The Proper Treatment of Quantification in Ordinary English, Part 1: The Fragment of English We will now explore the analysis of English that Montague puts forth in his seminal paper, PTQ. As we ve already

More information

C SC 620 Advanced Topics in Natural Language Processing. Lecture 21 4/13

C SC 620 Advanced Topics in Natural Language Processing. Lecture 21 4/13 C SC 620 Advanced Topics in Natural Language Processing Lecture 21 4/13 Reading List Readings in Machine Translation, Eds. Nirenburg, S. et al. MIT Press 2003. 19. Montague Grammar and Machine Translation.

More information

Computationele grammatica

Computationele grammatica Computationele grammatica Docent: Paola Monachesi Contents First Last Prev Next Contents 1 Unbounded dependency constructions (UDCs)............... 3 2 Some data...............................................

More information

Ch. 2: Phrase Structure Syntactic Structure (basic concepts) A tree diagram marks constituents hierarchically

Ch. 2: Phrase Structure Syntactic Structure (basic concepts) A tree diagram marks constituents hierarchically Ch. 2: Phrase Structure Syntactic Structure (basic concepts) A tree diagram marks constituents hierarchically NP S AUX VP Ali will V NP help D N the man A node is any point in the tree diagram and it can

More information

Unification Grammars and Off-Line Parsability. Efrat Jaeger

Unification Grammars and Off-Line Parsability. Efrat Jaeger Unification Grammars and Off-Line Parsability Efrat Jaeger October 1, 2002 Unification Grammars and Off-Line Parsability Research Thesis Submitted in partial fulfillment of the requirements for the degree

More information

Topics in Lexical-Functional Grammar. Ronald M. Kaplan and Mary Dalrymple. Xerox PARC. August 1995

Topics in Lexical-Functional Grammar. Ronald M. Kaplan and Mary Dalrymple. Xerox PARC. August 1995 Projections and Semantic Interpretation Topics in Lexical-Functional Grammar Ronald M. Kaplan and Mary Dalrymple Xerox PARC August 199 Kaplan and Dalrymple, ESSLLI 9, Barcelona 1 Constituent structure

More information

CAS LX 522 Syntax I Fall 2000 October 10, 2000 Week 5: Case Theory and θ Theory. θ-theory continued

CAS LX 522 Syntax I Fall 2000 October 10, 2000 Week 5: Case Theory and θ Theory. θ-theory continued CAS LX 522 Syntax I Fall 2000 October 0, 2000 Paul Hagstrom Week 5: Case Theory and θ Theory θ-theory continued From last time: verbs have θ-roles (e.g., Agent, Theme, ) to assign, specified in the lexicon

More information

Computational Linguistics

Computational Linguistics Computational Linguistics Dependency-based Parsing Clayton Greenberg Stefan Thater FR 4.7 Allgemeine Linguistik (Computerlinguistik) Universität des Saarlandes Summer 2016 Acknowledgements These slides

More information

A Context-Free Grammar

A Context-Free Grammar Statistical Parsing A Context-Free Grammar S VP VP Vi VP Vt VP VP PP DT NN PP PP P Vi sleeps Vt saw NN man NN dog NN telescope DT the IN with IN in Ambiguity A sentence of reasonable length can easily

More information

What is a natural syntactic model for frame-semantic composition?

What is a natural syntactic model for frame-semantic composition? What is a natural syntactic model for frame-semantic composition? Timm Lichte, Laura Kallmeyer & Rainer Osswald University of Düsseldorf, Germany CTF14, August 26, 214 SFB 991 1 / 26 Overview natural syntax

More information

Computational Linguistics. Acknowledgements. Phrase-Structure Trees. Dependency-based Parsing

Computational Linguistics. Acknowledgements. Phrase-Structure Trees. Dependency-based Parsing Computational Linguistics Dependency-based Parsing Dietrich Klakow & Stefan Thater FR 4.7 Allgemeine Linguistik (Computerlinguistik) Universität des Saarlandes Summer 2013 Acknowledgements These slides

More information

Bringing machine learning & compositional semantics together: central concepts

Bringing machine learning & compositional semantics together: central concepts Bringing machine learning & compositional semantics together: central concepts https://githubcom/cgpotts/annualreview-complearning Chris Potts Stanford Linguistics CS 244U: Natural language understanding

More information

STRUCTURAL NON-CORRESPONDENCE IN TRANSLATION

STRUCTURAL NON-CORRESPONDENCE IN TRANSLATION STRUCTURAL NON-CORRESPONDENCE IN TRANSLATION Louisa Sadler, Dept. of Language and Linguistics, University of Essex, Wivenhoe Park, Colchester, CO4 3SQ, Essex, UK. louisa@uk.ac.essex Henry S. Thompson,

More information

Model-Theory of Property Grammars with Features

Model-Theory of Property Grammars with Features Model-Theory of Property Grammars with Features Denys Duchier Thi-Bich-Hanh Dao firstname.lastname@univ-orleans.fr Yannick Parmentier Abstract In this paper, we present a model-theoretic description of

More information

Dependency grammar. Recurrent neural networks. Transition-based neural parsing. Word representations. Informs Models

Dependency grammar. Recurrent neural networks. Transition-based neural parsing. Word representations. Informs Models Dependency grammar Morphology Word order Transition-based neural parsing Word representations Recurrent neural networks Informs Models Dependency grammar Morphology Word order Transition-based neural parsing

More information

Creation constructions and frames

Creation constructions and frames Creation constructions and frames Udo Klein, Marcus Kracht and Ralf Vogel Universität Bielefeld Collaborative Research Centre Alignment in Communication (SFB 673, funded by the German Research Foundation,

More information

Computational Psycholinguistics Lecture 2: human syntactic parsing, garden pathing, grammatical prediction, surprisal, particle filters

Computational Psycholinguistics Lecture 2: human syntactic parsing, garden pathing, grammatical prediction, surprisal, particle filters Computational Psycholinguistics Lecture 2: human syntactic parsing, garden pathing, grammatical prediction, surprisal, particle filters Klinton Bicknell & Roger Levy LSA 2015 Summer Institute University

More information

Parsing with Context-Free Grammars

Parsing with Context-Free Grammars Parsing with Context-Free Grammars Berlin Chen 2005 References: 1. Natural Language Understanding, chapter 3 (3.1~3.4, 3.6) 2. Speech and Language Processing, chapters 9, 10 NLP-Berlin Chen 1 Grammars

More information

Other types of Movement

Other types of Movement Other types of Movement So far we seen Wh-movement, which moves certain types of (XP) constituents to the specifier of a CP. Wh-movement is also called A-bar movement. We will look at two more types of

More information

Simpler Syntax. Ling : Sign-Based Construction Grammar Instructor: Ivan A. Sag URL:

Simpler Syntax. Ling : Sign-Based Construction Grammar Instructor: Ivan A. Sag URL: Simpler Syntax Ling 7800-065: Sign-Based Construction Grammar Instructor: Ivan A. Sag (sag@stanford.edu) URL: http://lingo.stanford.edu/sag/li11-sbcg 1/ 58 Constructs ] [mtr sign construct : dtrs nelist(sign)

More information

Center for Research in Urdu Language Processing National University of Computer and Emerging Sciences, Lahore Pakistan

Center for Research in Urdu Language Processing National University of Computer and Emerging Sciences, Lahore Pakistan Reference No: Revision History: POS ID: UPOS13 Name Change Date Version Description of Changes Omar Javed 06 th November, 0.1 Created 04 Sara Hussain 20 th Dec, 2004 4.1.0.0 Modified (added TENSE feature)

More information

Minimal Recursion Semantics: an Introduction

Minimal Recursion Semantics: an Introduction Minimal Recursion Semantics: an Introduction (Mexico City 2000) Ann Copestake Daniel Flickinger Carl Pollard Ivan A. Sag 1/ 31 Desiderata for Computational Semantics: Expressive Adequacy: The framework

More information

An introduction to German Syntax. 1. Head directionality: A major source of linguistic divergence

An introduction to German Syntax. 1. Head directionality: A major source of linguistic divergence An introduction to German Syntax 19 January 2018 1. Head directionality: A major source of linguistic divergence In English, heads uniformly precede their complements: (1) a. [ kiss Mary] a. * [ Mary kiss]

More information

The relation of surprisal and human processing

The relation of surprisal and human processing The relation of surprisal and human processing difficulty Information Theory Lecture Vera Demberg and Matt Crocker Information Theory Lecture, Universität des Saarlandes April 19th, 2015 Information theory

More information

Entropy. Leonoor van der Beek, Department of Alfa-informatica Rijksuniversiteit Groningen. May 2005

Entropy. Leonoor van der Beek, Department of Alfa-informatica Rijksuniversiteit Groningen. May 2005 Entropy Leonoor van der Beek, vdbeek@rug.nl Department of Alfa-informatica Rijksuniversiteit Groningen May 2005 What is entropy? Entropy is a measure of uncertainty or surprise or disorder. Entropy was

More information

Recap: Lexicalized PCFGs (Fall 2007): Lecture 5 Parsing and Syntax III. Recap: Charniak s Model. Recap: Adding Head Words/Tags to Trees

Recap: Lexicalized PCFGs (Fall 2007): Lecture 5 Parsing and Syntax III. Recap: Charniak s Model. Recap: Adding Head Words/Tags to Trees Recap: Lexicalized PCFGs We now need to estimate rule probabilities such as P rob(s(questioned,vt) NP(lawyer,NN) VP(questioned,Vt) S(questioned,Vt)) 6.864 (Fall 2007): Lecture 5 Parsing and Syntax III

More information

(7) a. [ PP to John], Mary gave the book t [PP]. b. [ VP fix the car], I wonder whether she will t [VP].

(7) a. [ PP to John], Mary gave the book t [PP]. b. [ VP fix the car], I wonder whether she will t [VP]. CAS LX 522 Syntax I Fall 2000 September 18, 2000 Paul Hagstrom Week 2: Movement Movement Last time, we talked about subcategorization. (1) a. I can solve this problem. b. This problem, I can solve. (2)

More information

Moreno Mitrović. The Saarland Lectures on Formal Semantics

Moreno Mitrović. The Saarland Lectures on Formal Semantics ,, 3 Moreno Mitrović The Saarland Lectures on Formal Semantics λ- λ- λ- ( λ- ) Before we move onto this, let's recall our f -notation for intransitive verbs 1/33 λ- ( λ- ) Before we move onto this, let's

More information

Reflexives in the Correspondence Architecture

Reflexives in the Correspondence Architecture Reflexives in the Correspondence Architecture Ash Asudeh Carleton University University of Iceland July 2, 2009 1 Introduction The standard LFG theory of the syntax of anaphora (Dalrymple 1993) is rather

More information

Compositionality and Syntactic Structure Marcus Kracht Department of Linguistics UCLA 3125 Campbell Hall 405 Hilgard Avenue Los Angeles, CA 90095

Compositionality and Syntactic Structure Marcus Kracht Department of Linguistics UCLA 3125 Campbell Hall 405 Hilgard Avenue Los Angeles, CA 90095 Compositionality and Syntactic Structure Marcus Kracht Department of Linguistics UCLA 3125 Campbell Hall 405 Hilgard Avenue Los Angeles, CA 90095 1543 kracht@humnet.ucla.edu 1. The Questions ➀ Why does

More information

Reconsidering agreement

Reconsidering agreement Reconsidering agreement Dr. Tania Avgustinova Habilitationskolloquium, 8. Juli 2003 Universität des Saarlandes 8 July 2003 Habilitationskolloquium, Universität des Saarlandes 2 The range of the phenomenon

More information

1 Write the subject pronoun for each picture. Use the words in the box.

1 Write the subject pronoun for each picture. Use the words in the box. 1 Write the subject pronoun for each picture. Use the words in the box. I he she it we they 1 2_ 3 4 5_ 6 2. Label the pictures. Use the words in the box. Add the. chairs blackboard book desks rubber ruler

More information

S NP VP 0.9 S VP 0.1 VP V NP 0.5 VP V 0.1 VP V PP 0.1 NP NP NP 0.1 NP NP PP 0.2 NP N 0.7 PP P NP 1.0 VP NP PP 1.0. N people 0.

S NP VP 0.9 S VP 0.1 VP V NP 0.5 VP V 0.1 VP V PP 0.1 NP NP NP 0.1 NP NP PP 0.2 NP N 0.7 PP P NP 1.0 VP  NP PP 1.0. N people 0. /6/7 CS 6/CS: Natural Language Processing Instructor: Prof. Lu Wang College of Computer and Information Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang The grammar: Binary, no epsilons,.9..5

More information

Generalized Quantifiers Logical and Linguistic Aspects

Generalized Quantifiers Logical and Linguistic Aspects Generalized Quantifiers Logical and Linguistic Aspects Lecture 1: Formal Semantics and Generalized Quantifiers Dag Westerståhl University of Gothenburg SELLC 2010 Institute for Logic and Cognition, Sun

More information

Parsing with CFGs L445 / L545 / B659. Dept. of Linguistics, Indiana University Spring Parsing with CFGs. Direction of processing

Parsing with CFGs L445 / L545 / B659. Dept. of Linguistics, Indiana University Spring Parsing with CFGs. Direction of processing L445 / L545 / B659 Dept. of Linguistics, Indiana University Spring 2016 1 / 46 : Overview Input: a string Output: a (single) parse tree A useful step in the process of obtaining meaning We can view the

More information

Parsing with CFGs. Direction of processing. Top-down. Bottom-up. Left-corner parsing. Chart parsing CYK. Earley 1 / 46.

Parsing with CFGs. Direction of processing. Top-down. Bottom-up. Left-corner parsing. Chart parsing CYK. Earley 1 / 46. : Overview L545 Dept. of Linguistics, Indiana University Spring 2013 Input: a string Output: a (single) parse tree A useful step in the process of obtaining meaning We can view the problem as searching

More information

Artificial Intelligence

Artificial Intelligence CS344: Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 20-21 Natural Language Parsing Parsing of Sentences Are sentences flat linear structures? Why tree? Is

More information

Parsing with Context-Free Grammars

Parsing with Context-Free Grammars Parsing with Context-Free Grammars CS 585, Fall 2017 Introduction to Natural Language Processing http://people.cs.umass.edu/~brenocon/inlp2017 Brendan O Connor College of Information and Computer Sciences

More information

24 Exercises in Linguistic Analysis

24 Exercises in Linguistic Analysis 24 Exercises in Linguistic Analysis DBS Software Design for the Hear and the Speak Mode of a Talking Robot Preprint June 25, 2017 ROLAND HAUSSER 1989 2011 Professor für Computerlinguistik Friedrich Alexander

More information

Tree-Adjoining Grammars for Optimality Theory Syntax

Tree-Adjoining Grammars for Optimality Theory Syntax Tree-Adjoining Grammars for Optimality Theory Syntax Virginia Savova Department of Cognitive Science Johns Hopkins University savova@jhu.edu Robert Frank Department of Cognitive Science Johns Hopkins University

More information

Alessandro Mazzei MASTER DI SCIENZE COGNITIVE GENOVA 2005

Alessandro Mazzei MASTER DI SCIENZE COGNITIVE GENOVA 2005 Alessandro Mazzei Dipartimento di Informatica Università di Torino MATER DI CIENZE COGNITIVE GENOVA 2005 04-11-05 Natural Language Grammars and Parsing Natural Language yntax Paolo ama Francesca yntactic

More information

Extensions to the Logic of All x are y: Verbs, Relative Clauses, and Only

Extensions to the Logic of All x are y: Verbs, Relative Clauses, and Only 1/53 Extensions to the Logic of All x are y: Verbs, Relative Clauses, and Only Larry Moss Indiana University Nordic Logic School August 7-11, 2017 2/53 An example that we ll see a few times Consider the

More information

Parsing Beyond Context-Free Grammars: Tree Adjoining Grammars

Parsing Beyond Context-Free Grammars: Tree Adjoining Grammars Parsing Beyond Context-Free Grammars: Tree Adjoining Grammars Laura Kallmeyer & Tatiana Bladier Heinrich-Heine-Universität Düsseldorf Sommersemester 2018 Kallmeyer, Bladier SS 2018 Parsing Beyond CFG:

More information

CAS LX 500 Topics in Linguistics: Questions Spring 2006 March 2, b: Prosody and Japanese wh-questions

CAS LX 500 Topics in Linguistics: Questions Spring 2006 March 2, b: Prosody and Japanese wh-questions CAS LX 500 Topics in Linguistics: Questions Spring 2006 March 2, 2006 Paul Hagstrom 7b: Prosody and Japanese wh-questions Prosody by phase Prosody and syntax seem to fit quite tightly together. Ishihara,

More information

Lecture 7: Relations

Lecture 7: Relations Lecture 7: Relations 1 Relation Relation between two objects signify some connection between them. For example, relation of one person being biological parent of another. If we take any two people at random,

More information

Logical Translations Jean Mark Gawron San Diego State University. 1 Introduction 2

Logical Translations Jean Mark Gawron San Diego State University. 1 Introduction 2 Logical Translations Jean Mark Gawron San Diego State University Contents 1 Introduction 2 2 Truth-Functional Connectives 2 2.1 And................................ 2 2.2 Or.................................

More information

13A. Computational Linguistics. 13A. Log-Likelihood Dependency Parsing. CSC 2501 / 485 Fall 2017

13A. Computational Linguistics. 13A. Log-Likelihood Dependency Parsing. CSC 2501 / 485 Fall 2017 Computational Linguistics CSC 2501 / 485 Fall 2017 13A 13A. Log-Likelihood Dependency Parsing Gerald Penn Department of Computer Science, University of Toronto Based on slides by Yuji Matsumoto, Dragomir

More information

A Supertag-Context Model for Weakly-Supervised CCG Parser Learning

A Supertag-Context Model for Weakly-Supervised CCG Parser Learning A Supertag-Context Model for Weakly-Supervised CCG Parser Learning Dan Garrette Chris Dyer Jason Baldridge Noah A. Smith U. Washington CMU UT-Austin CMU Contributions 1. A new generative model for learning

More information

Chiastic Lambda-Calculi

Chiastic Lambda-Calculi Chiastic Lambda-Calculi wren ng thornton Cognitive Science & Computational Linguistics Indiana University, Bloomington NLCS, 28 June 2013 wren ng thornton (Indiana University) Chiastic Lambda-Calculi NLCS,

More information

Unterspezifikation in der Semantik Scope Semantics in Lexicalized Tree Adjoining Grammars

Unterspezifikation in der Semantik Scope Semantics in Lexicalized Tree Adjoining Grammars in der emantik cope emantics in Lexicalized Tree Adjoining Grammars Laura Heinrich-Heine-Universität Düsseldorf Wintersemester 2011/2012 LTAG: The Formalism (1) Tree Adjoining Grammars (TAG): Tree-rewriting

More information

Relative Constructions of Swahili and Machine Translation

Relative Constructions of Swahili and Machine Translation Relative Constructions of Swahili and Machine Translation Arvi Hurskainen Institute for Asian and African Studies, Box 59 FIN-00014 University of Helsinki, Finland arvi.hurskainen@helsinki.fi Abstract

More information

Cyclic Inputs. Surface Generation (Part II) Ambiguity-preserving Generation. Ambiguity-preserving Generation. Ambiguity-preserving Generation

Cyclic Inputs. Surface Generation (Part II) Ambiguity-preserving Generation. Ambiguity-preserving Generation. Ambiguity-preserving Generation Cyli Inputs The set of strings tht grmmr reltes to yli input struture might e non-ontext-free Surfe Genertion (Prt II) Amiguity-preserving Genertion Amiguity-preserving Genertion Motivtion Motivtion ()

More information

7.1 What is it and why should we care?

7.1 What is it and why should we care? Chapter 7 Probability In this section, we go over some simple concepts from probability theory. We integrate these with ideas from formal language theory in the next chapter. 7.1 What is it and why should

More information

The SUBTLE NL Parsing Pipeline: A Complete Parser for English Mitch Marcus University of Pennsylvania

The SUBTLE NL Parsing Pipeline: A Complete Parser for English Mitch Marcus University of Pennsylvania The SUBTLE NL Parsing Pipeline: A Complete Parser for English Mitch Marcus University of Pennsylvania 1 PICTURE OF ANALYSIS PIPELINE Tokenize Maximum Entropy POS tagger MXPOST Ratnaparkhi Core Parser Collins

More information

Iterated Galois connections in arithmetic and linguistics. J. Lambek, McGill University

Iterated Galois connections in arithmetic and linguistics. J. Lambek, McGill University 1 Iterated Galois connections in arithmetic and linguistics J. Lambek, McGill University Abstract: Galois connections may be viewed as pairs of adjoint functors, specialized from categories to partially

More information

Complexity of Natural Languages Mildly-context sensitivity T1 languages

Complexity of Natural Languages Mildly-context sensitivity T1 languages Complexity of Natural Languages Mildly-context sensitivity T1 languages Introduction to Formal Language Theory day 4 Wiebke Petersen & Kata Balogh Heinrich-Heine-Universität NASSLLI 2014 Petersen & Balogh

More information

Hierarchical and Linear Constraints on Structure

Hierarchical and Linear Constraints on Structure Hierarchical and Linear Constraints on Structure Peter Sells Sandbjerg Ph.D. course June 14 16, 2006 Part II 1 OT Evaluations (1) CP XP C C IP Pro/Adv NP Adv I I Adv/Neg/NQ/Pro VP V Pro V NP NP PP V Prt

More information

Penn Treebank Parsing. Advanced Topics in Language Processing Stephen Clark

Penn Treebank Parsing. Advanced Topics in Language Processing Stephen Clark Penn Treebank Parsing Advanced Topics in Language Processing Stephen Clark 1 The Penn Treebank 40,000 sentences of WSJ newspaper text annotated with phrasestructure trees The trees contain some predicate-argument

More information

Focus in complex noun phrases

Focus in complex noun phrases Focus in complex noun phrases Summary In this paper I investigate the semantics of association with focus in complex noun phrases in the framework of Alternative Semantics (Rooth 1985, 1992). For the first

More information

Transformational Priors Over Grammars

Transformational Priors Over Grammars Transformational Priors Over Grammars Jason Eisner Johns Hopkins University July 6, 2002 EMNLP This talk is called Transformational Priors Over Grammars. It should become clear what I mean by a prior over

More information

a. Develop a fragment of English that contains quantificational NPs. b. Develop a translation base from that fragment to Politics+λ

a. Develop a fragment of English that contains quantificational NPs. b. Develop a translation base from that fragment to Politics+λ An Algebraic Approach to Quantification and Lambda Abstraction: Applications to the Analysis of English (1) Ingredients on the Table a. A logical language with both quantification and lambda abstraction

More information

Sharpening the empirical claims of generative syntax through formalization

Sharpening the empirical claims of generative syntax through formalization Sharpening the empirical claims of generative syntax through formalization Tim Hunter University of Minnesota, Twin Cities NASSLLI, June 2014 Part 1: Grammars and cognitive hypotheses What is a grammar?

More information

Implementing morphology and phonology

Implementing morphology and phonology Implementing morphology and phonology We begin with a simple problem: a lexicon of some natural language is given as a list of words. Suggest a data structure that will provide insertion and retrieval

More information

A Study of Entanglement in a Categorical Framework of Natural Language

A Study of Entanglement in a Categorical Framework of Natural Language A Study of Entanglement in a Categorical Framework of Natural Language Dimitri Kartsaklis 1 Mehrnoosh Sadrzadeh 2 1 Department of Computer Science University of Oxford 2 School of Electronic Engineering

More information

CAS LX 523 Syntax II Spring 2001 March 13, (1) A qp. Kayne, Richard (1995). The antisymmetry of syntax. Cambridge, MA: MIT Press.

CAS LX 523 Syntax II Spring 2001 March 13, (1) A qp. Kayne, Richard (1995). The antisymmetry of syntax. Cambridge, MA: MIT Press. CAS LX 52 Syntax II Spring 200 March, 200 Paul Hagstrom Week 7: Antisymmetry Kayne, Richard (995). The antisymmetry of syntax. Cambridge, MA: MIT Press. Koopman, Hilda (2000). The spec-head configuration.

More information

Chunks and Dependencies and Human Sentence Processing. Steven Abney University of Tübingen

Chunks and Dependencies and Human Sentence Processing. Steven Abney University of Tübingen Chunks and ependencies and Human entence Processing teven Abney University of Tübingen What are Chunks Introspection about sentence processing in reading old man in park was feeding pigeons [ old man ]

More information

Lexicalized Syntax and Topology for Non-projective Dependency Grammar

Lexicalized Syntax and Topology for Non-projective Dependency Grammar Lexicalized Syntax and Topology for Non-projectie Dependency Grammar Denys Duchier 1 Programming Systems Lab Uniersität des Saarlandes Saarbrücken, Germany Abstract We propose a lexicalized formulation

More information

DT2118 Speech and Speaker Recognition

DT2118 Speech and Speaker Recognition DT2118 Speech and Speaker Recognition Language Modelling Giampiero Salvi KTH/CSC/TMH giampi@kth.se VT 2015 1 / 56 Outline Introduction Formal Language Theory Stochastic Language Models (SLM) N-gram Language

More information

Parsing. Based on presentations from Chris Manning s course on Statistical Parsing (Stanford)

Parsing. Based on presentations from Chris Manning s course on Statistical Parsing (Stanford) Parsing Based on presentations from Chris Manning s course on Statistical Parsing (Stanford) S N VP V NP D N John hit the ball Levels of analysis Level Morphology/Lexical POS (morpho-synactic), WSD Elements

More information

Name: Chemistry-Ms. Pickett Date: Element: Chemistry 6 Comprehensive Exam: Study Guide 1. Laboratory Safety a. Procedures b. Lab Equipment/ measurement tools 2. Properties of Matter a. Types of Matter

More information

A Computational Approach to Minimalism

A Computational Approach to Minimalism A Computational Approach to Minimalism Alain LECOMTE CLIPS-IMAG BP-53 38041 Grenoble, cedex 9, France Email: Alain.Lecomte@upmf-grenoble.fr Abstract The aim of this paper is to recast minimalist principles

More information

Predicates, Quantifiers and Nested Quantifiers

Predicates, Quantifiers and Nested Quantifiers Predicates, Quantifiers and Nested Quantifiers Predicates Recall the example of a non-proposition in our first presentation: 2x=1. Let us call this expression P(x). P(x) is not a proposition because x

More information

Two-phase Implementation of Morphological Analysis

Two-phase Implementation of Morphological Analysis Two-phase Implementation of Morphological Analysis Arvi Hurskainen Institute for Asian and African Studies, Box 59 FIN-00014 University of Helsinki, Finland arvi.hurskainen@helsinki.fi Abstract SALAMA

More information

INTRODUCTION TO LOGIC. Propositional Logic. Examples of syntactic claims

INTRODUCTION TO LOGIC. Propositional Logic. Examples of syntactic claims Introduction INTRODUCTION TO LOGIC 2 Syntax and Semantics of Propositional Logic Volker Halbach In what follows I look at some formal languages that are much simpler than English and define validity of

More information

HPSG Tutorial. LSA Linguistic Institute Lexington KY July 7, Emily M. Bender

HPSG Tutorial. LSA Linguistic Institute Lexington KY July 7, Emily M. Bender HPSG Tutoral LSA Lngustc Insttute Lexngton KY July, 01 Emly M. Bender 1 Overvew Introducton: Shared assumptons, hgh-level overvew Key deas Theoretcal commtments Extensons Shared assumptons Generatve approach:

More information

INF4820: Algorithms for Artificial Intelligence and Natural Language Processing. Hidden Markov Models

INF4820: Algorithms for Artificial Intelligence and Natural Language Processing. Hidden Markov Models INF4820: Algorithms for Artificial Intelligence and Natural Language Processing Hidden Markov Models Murhaf Fares & Stephan Oepen Language Technology Group (LTG) October 27, 2016 Recap: Probabilistic Language

More information

Introduction to Semantics. Common Nouns and Adjectives in Predicate Position 1

Introduction to Semantics. Common Nouns and Adjectives in Predicate Position 1 Common Nouns and Adjectives in Predicate Position 1 (1) The Lexicon of Our System at Present a. Proper Names: [[ Barack ]] = Barack b. Intransitive Verbs: [[ smokes ]] = [ λx : x D e. IF x smokes THEN

More information

Time Zones - KET Grammar

Time Zones - KET Grammar Inventory of grammatical areas Verbs Regular and irregular forms Pages 104-105 (Unit 1 Modals can (ability; requests; permission) could (ability; polite requests) Page 3 (Getting Started) Pages 45-47,

More information

Introduction to Semantics. The Formalization of Meaning 1

Introduction to Semantics. The Formalization of Meaning 1 The Formalization of Meaning 1 1. Obtaining a System That Derives Truth Conditions (1) The Goal of Our Enterprise To develop a system that, for every sentence S of English, derives the truth-conditions

More information

1 Predicates and Arguments

1 Predicates and Arguments Glue logic vs. Spreading Architecture in LFG * Avery Andrews, ANU, September, 2003 talk given at ALS2003, University of Newcastle, NSW comments welcome Although the f-structures of LFG look like an intuitively

More information

Design and Evaluation of the Linguistic Basis of an Automatic F-Structure Annotation Algorithm for the Penn-II Treebank

Design and Evaluation of the Linguistic Basis of an Automatic F-Structure Annotation Algorithm for the Penn-II Treebank Design and Evaluation of the Linguistic Basis of an Automatic F-Structure Annotation Algorithm for the Penn-II Treebank Mairead McCarthy M Sc m Computer Applications, School of Computing, Dublin City University

More information

phrase phrase phrase is added to (0; 1). On the basis of item 8 in (1; 2) and item 9 in (2; 3), the following edge is phrase head CASE : acc

phrase phrase phrase is added to (0; 1). On the basis of item 8 in (1; 2) and item 9 in (2; 3), the following edge is phrase head CASE : acc to entry (0; 1). In a similar way, the edge v HEAD : 1 : N U M : nelist SBCT : 1ST : RST : elist sg HEAD : CASE : is added to entry (1; ), by virtue of rule and \loves" and the edge pn HEAD : 1 : CASE

More information

Computers playing Jeopardy!

Computers playing Jeopardy! Computers playing Jeopardy! CSE 392, Computers Playing Jeopardy!, Fall 2011 Stony Brook University http://www.cs.stonybrook.edu/~cse392 1 Last class: grammars and parsing in Prolog Verb thrills VP Verb

More information

Proseminar on Semantic Theory Fall 2010 Ling 720. Remko Scha (1981/1984): Distributive, Collective and Cumulative Quantification

Proseminar on Semantic Theory Fall 2010 Ling 720. Remko Scha (1981/1984): Distributive, Collective and Cumulative Quantification 1. Introduction Remko Scha (1981/1984): Distributive, Collective and Cumulative Quantification (1) The Importance of Scha (1981/1984) The first modern work on plurals (Landman 2000) There are many ideas

More information