Categorial Grammar. Larry Moss NASSLLI. Indiana University
|
|
- Hollie Cox
- 5 years ago
- Views:
Transcription
1 1/37 Categorial Grammar Larry Moss Indiana University NASSLLI
2 2/37 Categorial Grammar (CG) CG is the tradition in grammar that is closest to the work that we ll do in this course. Reason: In CG, syntax and semantics are closely related. This set of slides first covers the basics of syntax in CG. The specific system is applicative categorial grammar, also called the Ajdukiewicz-Bar Hillel form. (But if these don t mean anything to you, don t worry.) Then we ll look at how semantics interfaces with syntax. Later on, we ll extend the syntax to be more real.
3 3/37 Syntactic categories in CG Basic syntactic categories A categorial grammar always begins with basic categories. You should think of these as simple syntactic categories. In our linguistic applications, we usually will take N, NP and S. But we could just as well take other basic categories, and to make this point, I ll present other choices as well, coming from formal language theory.
4 Syntactic categories in CG Slash categories If C and D are categories, so are C\D and C/D. It s very important to see the difference between the two slashes! I personally have names for these: \ look left / look right (mnemonic: go from bottom to top) But they have other names: backslash and slash, over and under. The overall idea is that they are directional versions of the usual division notation for fractions: X Y corresponds to both X\Y and X/Y 4/37
5 5/37 Examples of Categories First, here are some categories when the basic ones are S and NP S/S S\NP (S\NP)/NP ((S\NP)/NP)/S The idea These categories are going to play the role of parts of speech like nouns, noun phrases, adjectives, etc.
6 6/37 Another set of examples This time, let s let the basic categories be U, S, T, and Y Here are some categories: Y S/T (S\(U/Y))\U There are infinitely many categories.
7 7/37 Lexicon A lexicon is a set of pairs, consisting of a symbols together with a category. Our first lexicon (Dana, NP) (Kim, NP) (smiled, S\NP) (laughed, S\NP) (cried, S\NP) (praised, (S\NP)/NP) (teased, (S\NP)/NP) (interviewed, (S\NP)/NP) A given word usually is associated to more than one category.
8 8/37 Another example of a lexicon This time, we use S, T, U, X, and Y as the basic categories. The symbols here are the letters a, b, and c. Lexicon (a, T/X) (a, S/X) (b, X) (b, X/T) (a, U/Y) (a, S/Y) (c, Y) (c, Y/U)
9 9/37 Our first lexicon: explanation One uses a lexicon to make parse trees like praised: (NP\S)/NP Kim: NP Dana: NP praised Kim: NP\S Dana praised Kim: S If we take a tree t whose root is of category S\NP and put a tree u whose root is of category NP on the left of t, and then add a new root, the whole tree will be of category S. If we take a tree t whose root is of category (S\NP)/NP and put a tree u whose root is of category NP on the right of t, and then add a new root, the whole tree will be of category S\NP.
10 10/37 Example using our first lexicon praised: (S\NP)/NP Kim: NP Dana: NP praised Kim: S\NP Dana praised Kim: S The leaves must match the categories in the lexicon, and going up we use the construction principles that we just saw. The key point here is that S\NP is verb phrase.
11 11/37 A second lexicon Lexicon (a, T/X) (a, S/X) (b, X) (b, X/T) (a, U/Y) (a, S/Y) (c, Y) (c, Y/U) Let s parse abab as a string of category S: a : T/X b : X b : X/T ab : T a : S/X bab : X abab : S
12 12/37 Grammars and languages A categorial grammar is a pair G = (Lex, C) where Lex is a lexicon (over some set of atomic categories), and C is some fixed category. The language of G is the set of sequences of symbols from the lexicon which can be parsed by some tree whose root is labeled C.
13 13/37 Let s start with Example of a grammar and its language G 1 = (Lex 1, S), where Lex 1 is our first lexicion, repeated below: Lex 1 (Dana, NP) (Kim, NP) (smiled, S\NP) (laughed, S\NP) (cried, S\NP) (praised, (S\NP)/NP) (teased, (S\NP)/NP) (interviewed, (S\NP)/NP) The language of this grammar G 1 is the set containing the following 18 sequences of lexical items: Dana smiled Dana laughed Dana cried Kim smiled Kim laughed Kim cried Dana praised Dana Dana teased Dana Dana interviewed Dana Dana praised Kim Dana teased Kim Dana interviewed Kim Kim praised Dana Kim teased Dana Kim interviewed Dana Kim praised Kim Kim teased Kim Kim interviewed Kim
14 14/37 Second example of a grammar and its language Let s next consider G 2 = (Lex 2, S), where Lex 2 is our second lexicion, repeated below: Lex 2 (a, T/X) (a, S/X) (b, X) (b, X/T) (a, U/Y) (a, S/Y) (c, Y) (c, Y/U) The language of this grammar G 2 is harder to determine. It turns out to be {ab, abab, ababab, ababab,..., ac, acac, acacac, acacac,...}
15 15/37 Our third lexicon Lex 3 (Dana, NP) (Kim, NP) (smiled, S\NP) (laughed, S\NP) (cried, S\NP) (praised, (S\NP)/NP) (teased, (S\NP)/NP) (interviewed, (S\NP)/NP) (joyfully, (S\NP)\(S\NP)) (carefully, (S\NP)\(S\NP)) (excitedly, (S\NP)\(S\NP))
16 16/37 Two examples using adverbs smiled: S\NP joyfully: (S\NP)\(S\NP) Dana: NP smiled joyfully: S\NP Dana smiled joyfully: S Kim: NP criticized: (S\NP)/NP Dana: NP criticized Dana: S\NP carefully: (S\NP)\(S\NP) criticized Dana carefully: S\NP Kim criticized Dana carefully: S
17 17/37 NP coordination To get we add to the lexicon Farid and Bettina and Cynthia left (and, (NP\NP)/NP)
18 17/37 NP coordination To get we add to the lexicon Farid and Bettina and Cynthia left (and, (NP\NP)/NP) F : NP and : (NP\NP)/NP C : NP B : NP and C : NP\NP and : (NP\NP)/NP B and C : NP and B and C : NP\NP F and B and C : NP F and B and C left : S left : NP\S
19 18/37 Semantics begins here We have seen how to build complex categories in CG using the two directional slashes \ and /. We now carry out a parallel development on the semantic side, but with a few differences. We start with a syntax for semantics, generating a set of semantic types.
20 19/37 Semantic Types We begin with a set T 0 of basic types. Every basic type is a type. If σ and τ are types, so is (σ, τ). The set of all types is written T.
21 19/37 Semantic Types We begin with a set T 0 of basic types. Every basic type is a type. If σ and τ are types, so is (σ, τ). The set of all types is written T. Our main example is when the basic types are e and t, standing for entity and truth value.
22 19/37 Semantic Types We begin with a set T 0 of basic types. Every basic type is a type. If σ and τ are types, so is (σ, τ). The set of all types is written T. By the way σ is the Greek letter sigma, in lower-case. τ is similarly the Greek letter tau.
23 20/37 Semantic Types: examples Note that we drop often the comma, as is customary. e t (et) ((et), t) ((et)((et)t)).
24 21/37 Semantic Domains Let D be a function which assigns sets to the basic types. In our setting, the basic types are usually e and t, so we would have D(e) and D(t). We ll write these as D e and D t, since this is what everyone does.
25 21/37 Semantic Domains Let D be a function which assigns sets to the basic types. In our setting, the basic types are usually e and t, so we would have D(e) and D(t). We ll write these as D e and D t, since this is what everyone does. This function D can be extended to all types by the rule D (στ) = (D σ D τ ) This is the set of all functions from D σ to D τ. As a function, the domain of D is the set T of all types.
26 22/37 The idea behind the equation D (στ) = (D σ D τ ) Think of X\Y and X/Y in terms of functions: input\output input/output A phrase of type v : X\Y will be interpreted by a function [[v]] X\Y : Y interpretations X interpretations A phrase of type v : X/Y will be interpreted by a function [[v]] X/Y : Y interpretations X interpretations Either way, putting one phrase after another corresponds to function application.
27 23/37 Semantic Domains: Example Let s use D e = {a, b, c, d}, and D t = 2 = {0, 1}. Incidentally We ll always use the set 2 = {0, 1} = {false, true} for D t. D e is our set of entities, and this can be anything.
28 23/37 Semantic Domains: Example Let s use D e = {a, b, c, d}, and D t = 2 = {0, 1}. type σ D σ e {a, b, c, d} t 2 (et) functions f : {a, b, c, d} 2 ((et), t) functions from the set above to 2 (tt) the four functions from 2 to 2
29 Connecting the syntactic categories with the semantic types Here is how we connecting the syntactic categories with the semantic types. Let Cat 0 be the set of basic categories in the syntax, and let Cat be the full set of categories. We start with a function k : Cat 0 T. syntactic category X S N NP semantic type k(x) t (et) ((et)t) We then extend this to all syntactic categories by using function spaces for both directional slashes. We ll call the extended function k. 24/37
30 25/37 A picture of k and k Act I: k has domain Cat 0 S NP N Cat 0 k k k (e, (et, t)) e t (et, t) et (et, (et, t)) t T
31 26/37 A picture of k and k Act II: k extends k NP/N S NP N S\NP N\N Cat k k k k k k (et, (et, t)) e t (et, t) et ((et, t), t) (et, et) T
32 27/37 Connecting the syntactic categories with the semantic types syntactic category X name semantic type k(x) S sentence t N noun (et) NP noun phrase ((et)t) N/N adjective ((et)(et)) S\NP verb phrase (((et)t)t) (S\NP)\(S\NP) adverb ((((et)t)t)(((et)t)t)) (S\NP)/NP transitive verb (((et)t)(((et)t)t)) NP/N determiner (et, (et, t))
33 27/37 Connecting the syntactic categories with the semantic types syntactic category X name semantic type k(x) S sentence t N noun (et) NP noun phrase ((et)t) N/N adjective ((et)(et)) S\NP verb phrase (((et)t)t) (S\NP)\(S\NP) adverb ((((et)t)t)(((et)t)t)) (S\NP)/NP transitive verb (((et)t)(((et)t)t)) NP/N determiner (et, (et, t)) In more detail on how k is defined on the transitive verb category, k((s\np)/np) = (((et)t)(((et)t)t)) we are using the general definition that explains the chart: k(x\y) = (k(y), k(x)) k(y/x) = (k(x), k(y))
34 27/37 Connecting the syntactic categories with the semantic types syntactic category X name semantic type k(x) S sentence t N noun (et) NP noun phrase ((et)t) N/N adjective ((et)(et)) S\NP verb phrase (((et)t)t) (S\NP)\(S\NP) adverb ((((et)t)t)(((et)t)t)) (S\NP)/NP transitive verb (((et)t)(((et)t)t)) NP/N determiner (et, (et, t)) You can also see why people who work on this need special abbreviations for commonly-found semantic types.
35 28/37 What do we need to do semantics of a CG? That is, what is a model? We start with a specific CG, used for syntax. We have a set T of semantic types, and sets D σ, for σ T. Next, we must have a function and this induces an extension k : CAT 0 T k : CAT T This connects the syntactic categories with the semantic types.
36 What do we need to do semantics of a CG? That is, what is a model? We start with a specific CG, used for syntax. We have a set T of semantic types, and sets D σ, for σ T. Next, we must have a function and this induces an extension k : CAT 0 T k : CAT T This connects the syntactic categories with the semantic types. A lexical interpretation function [[ ]] is a function which takes an item in the lexicon, say (w, X), and gives some [[w]] X D k(x). This is what it takes to give a model. 28/37
37 29/37 The main point of the semantics, again Given: a categorical lexicon, k : CAT 0 T, and a lexical interpretation function Every parse tree in the grammar has a semantic correlate. Every node in the parse tree, say (v, X), has a correlate on the semantic side of the form [[v]] X D k(x). Each use of the CG cancellation rules v 1 : X/Y v 2 : Y v 1 v 2 : X v 1 : Y v 2 : X\Y v 1 v 2 : X corresponds to function application [[v 1 ]] X/Y [[v 2 ]] Y [[v 1 v 2 ]] X = [[v 1 ]] X/Y ([[v 2 ]] Y ) [[v 1 ]] Y [[v 2 ]] X\Y [[v 1 v 2 ]] X = [[v 2 ]] X\Y ([[v 1 ]] Y )
38 30/37 Algebra as grammar We take a single base type r, and as our lexicon we take plus : r/(r/r) minus : r/(r/r) times : r/(r/r) div2 : r/(r/r) v : r w : r x : r y : r z : r 1 : r 2 : r
39 31/37 We get terms in Polish notation plus : r/(r/r) v : r minus : r/(r/r) z : r plus v : r/r minus z : r/r plus v w : r minus z plus v w : r w : r This would correspond to the term usually written z (v + w).
40 32/37 Semantics The semantics will use higher-order (one-place) functions on the real numbers. We take D r = R. Then automatically, And D r r = R R. D r (r r) = R (R R).
41 Semantics As one particular model, we take [[v]] = 4 [[w]] = 2 [[x]] = 65 [[y]] = 3 [[z]] = 0 [[1]] = 1 [[2]] = 2 [[plus]](x)(y) = x + y [[minus]](x)(y) = x y [[times]](x)(y) = x y [[div2]](x)(y) = 2 x y The part in the middle is standard ; it would not be sensible to use any other choice. 33/37
42 34/37 We get terms in Polish notation plus : r/(r/r) v : r minus : r/(r/r) z : r plus v : r/r minus z : r/r plus v w : r minus z plus v w : r w : r After some calculation, [[minus z plus v w]] = [[z]] ([[v]] + [[w]]) = 0 (4 + 2) = 6
43 35/37 We get terms in Polish notation We are interested in a term corresponding to f(v, w, x, y, z) = x y 2 z (v+w). To fit it all on the screen, let s drop the types: minus x plus v minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2(t)(u) is supposed to mean 2 t u.
44 36/37 Can we determine the polarities of the variables from the tree? Go from the root to the leaves, marking green for red for The rule for propagating colors is: the right branches of completed nodes for div2 and minus flip colors. Otherwise, we keep colors as we go up the tree.
45 Can we determine the polarities of the variables from the tree? Go from the root to the leaves, marking green for red for The rule for propagating colors is: the right branches of completed nodes for div2 and minus flip colors. Otherwise, we keep colors as we go up the tree. minus x plus v minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w 36/37
46 Can we determine the polarities of the variables from the tree? Go from the root to the leaves, marking green for red for The rule for propagating colors is: the right branches of completed nodes for div2 and minus flip colors. Otherwise, we keep colors as we go up the tree. minus x plus v minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w 36/37
47 Can we determine the polarities of the variables from the tree? Go from the root to the leaves, marking green for red for The rule for propagating colors is: the right branches of completed nodes for div2 and minus flip colors. Otherwise, we keep colors as we go up the tree. minus x plus v minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w 36/37
48 Can we determine the polarities of the variables from the tree? Go from the root to the leaves, marking green for red for The rule for propagating colors is: the right branches of completed nodes for div2 and minus flip colors. Otherwise, we keep colors as we go up the tree. minus x plus v minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w 36/37
49 36/37 Can we determine the polarities of the variables from the tree? Go from the root to the leaves, marking green for red for minus x plus v minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w div2 minus x y minus z plus v w This agrees with what we saw before: f(v, w, x, y, z ).
50 This algorithm has a history It was first proposed in CG by van Benthem in the 1990 s to formalize the, notation. His proposal was then worked out by Sanchez-Valencia. (Older versions exists: e.g., Sommers.) Versions of it are even implemented in real-world CL systems: Rowan Nairn, Cleo Condoravdi, and Lauri Karttunen. Computing relative polarity for textual inference. In Proceedings of ICoS-5 (Inference in Computational Semantics), Buxton, UK, (Karttunen was an IU Linguistics PhD and spoke about this work at a distinguished alum talk here a few years ago.) 37/37
Monotonicity Calculus: What is for, and How it is Formulated
1/69 Monotonicity Calculus: What is for, and How it is Formulated Larry Moss Indiana University Nordic Logic School August 7-11, 2017 2/69 This class, and next What I plan to do is re-do the material on
More informationSurface Reasoning Lecture 2: Logic and Grammar
Surface Reasoning Lecture 2: Logic and Grammar Thomas Icard June 18-22, 2012 Thomas Icard: Surface Reasoning, Lecture 2: Logic and Grammar 1 Categorial Grammar Combinatory Categorial Grammar Lambek Calculus
More informationSyllogistic Logic and its Extensions
1/31 Syllogistic Logic and its Extensions Larry Moss, Indiana University NASSLLI 2014 2/31 Logic and Language: Traditional Syllogisms All men are mortal. Socrates is a man. Socrates is mortal. Some men
More informationINTRODUCTION TO LOGIC. Propositional Logic. Examples of syntactic claims
Introduction INTRODUCTION TO LOGIC 2 Syntax and Semantics of Propositional Logic Volker Halbach In what follows I look at some formal languages that are much simpler than English and define validity of
More informationNatural Logic. Larry Moss, Indiana University. October 23, UC Berkeley Logic Seminar
Natural Logic Larry Moss, Indiana University UC Berkeley Logic Seminar October 23, 2015 This talk deals with new logical systems tuned to natural language The raison d être of logic is the study of inference
More informationExtensions to the Logic of All x are y: Verbs, Relative Clauses, and Only
1/53 Extensions to the Logic of All x are y: Verbs, Relative Clauses, and Only Larry Moss Indiana University Nordic Logic School August 7-11, 2017 2/53 An example that we ll see a few times Consider the
More informationIntroduction to Semantics. Common Nouns and Adjectives in Predicate Position 1
Common Nouns and Adjectives in Predicate Position 1 (1) The Lexicon of Our System at Present a. Proper Names: [[ Barack ]] = Barack b. Intransitive Verbs: [[ smokes ]] = [ λx : x D e. IF x smokes THEN
More informationA proof theoretical account of polarity items and monotonic inference.
A proof theoretical account of polarity items and monotonic inference. Raffaella Bernardi UiL OTS, University of Utrecht e-mail: Raffaella.Bernardi@let.uu.nl Url: http://www.let.uu.nl/ Raffaella.Bernardi/personal
More informationIntroduction to Semantics. The Formalization of Meaning 1
The Formalization of Meaning 1 1. Obtaining a System That Derives Truth Conditions (1) The Goal of Our Enterprise To develop a system that, for every sentence S of English, derives the truth-conditions
More informationBringing machine learning & compositional semantics together: central concepts
Bringing machine learning & compositional semantics together: central concepts https://githubcom/cgpotts/annualreview-complearning Chris Potts Stanford Linguistics CS 244U: Natural language understanding
More informationParsing with Context-Free Grammars
Parsing with Context-Free Grammars Berlin Chen 2005 References: 1. Natural Language Understanding, chapter 3 (3.1~3.4, 3.6) 2. Speech and Language Processing, chapters 9, 10 NLP-Berlin Chen 1 Grammars
More informationA* Search. 1 Dijkstra Shortest Path
A* Search Consider the eight puzzle. There are eight tiles numbered 1 through 8 on a 3 by three grid with nine locations so that one location is left empty. We can move by sliding a tile adjacent to the
More informationParsing with CFGs L445 / L545 / B659. Dept. of Linguistics, Indiana University Spring Parsing with CFGs. Direction of processing
L445 / L545 / B659 Dept. of Linguistics, Indiana University Spring 2016 1 / 46 : Overview Input: a string Output: a (single) parse tree A useful step in the process of obtaining meaning We can view the
More informationParsing with CFGs. Direction of processing. Top-down. Bottom-up. Left-corner parsing. Chart parsing CYK. Earley 1 / 46.
: Overview L545 Dept. of Linguistics, Indiana University Spring 2013 Input: a string Output: a (single) parse tree A useful step in the process of obtaining meaning We can view the problem as searching
More informationRecent Progress on Monotonicity
Recent Progress on Monotonicity Thomas F. Icard, III 1 and Lawrence S. Moss 2 This paper serves two purposes. It is a summary of much work concerning formal treatments of monotonicity and polarity in natural
More informationSemantics and Generative Grammar. The Semantics of Adjectival Modification 1. (1) Our Current Assumptions Regarding Adjectives and Common Ns
The Semantics of Adjectival Modification 1 (1) Our Current Assumptions Regarding Adjectives and Common Ns a. Both adjectives and common nouns denote functions of type (i) [[ male ]] = [ λx : x D
More informationIntroduction to Semantic Parsing with CCG
Introduction to Semantic Parsing with CCG Kilian Evang Heinrich-Heine-Universität Düsseldorf 2018-04-24 Table of contents 1 Introduction to CCG Categorial Grammar (CG) Combinatory Categorial Grammar (CCG)
More informationSemantics and Generative Grammar. Expanding Our Formalism, Part 1 1
Expanding Our Formalism, Part 1 1 1. Review of Our System Thus Far Thus far, we ve built a system that can interpret a very narrow range of English structures: sentences whose subjects are proper names,
More informationNatural Language Processing : Probabilistic Context Free Grammars. Updated 5/09
Natural Language Processing : Probabilistic Context Free Grammars Updated 5/09 Motivation N-gram models and HMM Tagging only allowed us to process sentences linearly. However, even simple sentences require
More information27. THESE SENTENCES CERTAINLY LOOK DIFFERENT
27 HESE SENENCES CERAINLY LOOK DIEREN comparing expressions versus comparing sentences a motivating example: sentences that LOOK different; but, in a very important way, are the same Whereas the = sign
More informationScope Ambiguities through the Mirror
Scope Ambiguities through the Mirror Raffaella Bernardi In this paper we look at the interpretation of Quantifier Phrases from the perspective of Symmetric Categorial Grammar. We show how the apparent
More informationNatural Logic Welcome to the Course!
1/31 Natural Logic Welcome to the Course! Larry Moss Indiana University Nordic Logic School August 7-11, 2017 2/31 This course presents logical systems tuned to natural language The raison d être of logic
More informationCS626: NLP, Speech and the Web. Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 14: Parsing Algorithms 30 th August, 2012
CS626: NLP, Speech and the Web Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 14: Parsing Algorithms 30 th August, 2012 Parsing Problem Semantics Part of Speech Tagging NLP Trinity Morph Analysis
More information27. THESE SENTENCES CERTAINLY LOOK DIFFERENT
get the complete book: http://wwwonemathematicalcatorg/getullextullbookhtm 27 HESE SENENCES CERAINLY LOOK DIEREN comparing expressions versus comparing sentences a motivating example: sentences that LOOK
More informationContext Free Grammars
Automata and Formal Languages Context Free Grammars Sipser pages 101-111 Lecture 11 Tim Sheard 1 Formal Languages 1. Context free languages provide a convenient notation for recursive description of languages.
More informationThe Lambek-Grishin calculus for unary connectives
The Lambek-Grishin calculus for unary connectives Anna Chernilovskaya Utrecht Institute of Linguistics OTS, Utrecht University, the Netherlands anna.chernilovskaya@let.uu.nl Introduction In traditional
More informationComputational Models - Lecture 4 1
Computational Models - Lecture 4 1 Handout Mode Iftach Haitner. Tel Aviv University. November 21, 2016 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice Herlihy, Brown University.
More informationParsing. Based on presentations from Chris Manning s course on Statistical Parsing (Stanford)
Parsing Based on presentations from Chris Manning s course on Statistical Parsing (Stanford) S N VP V NP D N John hit the ball Levels of analysis Level Morphology/Lexical POS (morpho-synactic), WSD Elements
More informationA Supertag-Context Model for Weakly-Supervised CCG Parser Learning
A Supertag-Context Model for Weakly-Supervised CCG Parser Learning Dan Garrette Chris Dyer Jason Baldridge Noah A. Smith U. Washington CMU UT-Austin CMU Contributions 1. A new generative model for learning
More informationRelational Reasoning in Natural Language
1/67 Relational Reasoning in Natural Language Larry Moss ESSLLI 10 Course on Logics for Natural Language Inference August, 2010 Adding transitive verbs the work on R, R, and other systems is joint with
More informationSharpening the empirical claims of generative syntax through formalization
Sharpening the empirical claims of generative syntax through formalization Tim Hunter University of Minnesota, Twin Cities NASSLLI, June 2014 Part 1: Grammars and cognitive hypotheses What is a grammar?
More informationLing 5801: Lecture Notes 7 From Programs to Context-Free Grammars
Ling 5801: Lecture otes 7 From Programs to Context-Free rammars 1. The rules we used to define programs make up a context-free grammar A Context-Free rammar is a tuple C,X,S,R, where: C is a finite set
More informationCS460/626 : Natural Language
CS460/626 : Natural Language Processing/Speech, NLP and the Web (Lecture 23, 24 Parsing Algorithms; Parsing in case of Ambiguity; Probabilistic Parsing) Pushpak Bhattacharyya CSE Dept., IIT Bombay 8 th,
More informationThe Semantics of Definite DPs 1. b. Argument Position: (i) [ A politician ] arrived from Washington. (ii) Joe likes [ the politician ].
The Semantics of Definite DPs 1 Thus far, our semantics is able to interpret common nouns that occupy predicate position (1a). However, the most common position for common nouns to occupy is internal to
More informationArtificial Intelligence
CS344: Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 20-21 Natural Language Parsing Parsing of Sentences Are sentences flat linear structures? Why tree? Is
More informationGrammar and Feature Unification
Grammar and Feature Unification Problems with CF Phrase Structure Grammars Difficult to capture dependencies between constituents the boy runs the boys run * the boy run * the boys runs Problems with CF
More informationComputational Models - Lecture 4
Computational Models - Lecture 4 Regular languages: The Myhill-Nerode Theorem Context-free Grammars Chomsky Normal Form Pumping Lemma for context free languages Non context-free languages: Examples Push
More informationSemantics and Generative Grammar. A Little Bit on Adverbs and Events
A Little Bit on Adverbs and Events 1. From Adjectives to Adverbs to Events We ve just developed a theory of the semantics of adjectives, under which they denote either functions of type (intersective
More informationLecture 5: Semantic Parsing, CCGs, and Structured Classification
Lecture 5: Semantic Parsing, CCGs, and Structured Classification Kyle Richardson kyle@ims.uni-stuttgart.de May 12, 2016 Lecture Plan paper: Zettlemoyer and Collins (2012) general topics: (P)CCGs, compositional
More informationCompositionality and Syntactic Structure Marcus Kracht Department of Linguistics UCLA 3125 Campbell Hall 405 Hilgard Avenue Los Angeles, CA 90095
Compositionality and Syntactic Structure Marcus Kracht Department of Linguistics UCLA 3125 Campbell Hall 405 Hilgard Avenue Los Angeles, CA 90095 1543 kracht@humnet.ucla.edu 1. The Questions ➀ Why does
More informationLing 130 Notes: Syntax and Semantics of Propositional Logic
Ling 130 Notes: Syntax and Semantics of Propositional Logic Sophia A. Malamud January 21, 2011 1 Preliminaries. Goals: Motivate propositional logic syntax and inferencing. Feel comfortable manipulating
More informationModel-Theory of Property Grammars with Features
Model-Theory of Property Grammars with Features Denys Duchier Thi-Bich-Hanh Dao firstname.lastname@univ-orleans.fr Yannick Parmentier Abstract In this paper, we present a model-theoretic description of
More informationComputational Models - Lecture 4 1
Computational Models - Lecture 4 1 Handout Mode Iftach Haitner and Yishay Mansour. Tel Aviv University. April 3/8, 2013 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice
More informationIBM Model 1 for Machine Translation
IBM Model 1 for Machine Translation Micha Elsner March 28, 2014 2 Machine translation A key area of computational linguistics Bar-Hillel points out that human-like translation requires understanding of
More informationPropositional Logic. Testing, Quality Assurance, and Maintenance Winter Prof. Arie Gurfinkel
Propositional Logic Testing, Quality Assurance, and Maintenance Winter 2018 Prof. Arie Gurfinkel References Chpater 1 of Logic for Computer Scientists http://www.springerlink.com/content/978-0-8176-4762-9/
More informationProseminar on Semantic Theory Fall 2010 Ling 720. Remko Scha (1981/1984): Distributive, Collective and Cumulative Quantification
1. Introduction Remko Scha (1981/1984): Distributive, Collective and Cumulative Quantification (1) The Importance of Scha (1981/1984) The first modern work on plurals (Landman 2000) There are many ideas
More informationWhat we have done so far
What we have done so far DFAs and regular languages NFAs and their equivalence to DFAs Regular expressions. Regular expressions capture exactly regular languages: Construct a NFA from a regular expression.
More informationComputational Models - Lecture 3
Slides modified by Benny Chor, based on original slides by Maurice Herlihy, Brown University. p. 1 Computational Models - Lecture 3 Equivalence of regular expressions and regular languages (lukewarm leftover
More informationLet s Give Up. Larry Moss. North American Summer School on Logic, Language, and Information June 25-29, Indiana University 1/31
1/31 Let s Give Up Larry Moss Indiana University North American Summer School on Logic, Language, and Information June 25-29, 2018 2/31 Natural Logic: parallel studies I didn t have much to say on these,
More informationContexts for Quantification
Contexts for Quantification Valeria de Paiva Stanford April, 2011 Valeria de Paiva (Stanford) C4Q April, 2011 1 / 28 Natural logic: what we want Many thanks to Larry, Ulrik for slides! Program Show that
More informationA Multi-Modal Combinatory Categorial Grammar. A MMCCG Analysis of Japanese Nonconstituent Clefting
A Multi-Modal Combinatory Categorial Grammar Analysis of Japanese Nonconstituent Clefting Department of Linguistics The Ohio State University {kubota,esmith}@ling.osu.edu A basic cleft sentence Data Clefting
More informationX-bar theory. X-bar :
is one of the greatest contributions of generative school in the filed of knowledge system. Besides linguistics, computer science is greatly indebted to Chomsky to have propounded the theory of x-bar.
More informationParasitic Scope (Barker 2007) Semantics Seminar 11/10/08
Parasitic Scope (Barker 2007) Semantics Seminar 11/10/08 1. Overview Attempts to provide a compositional, fully semantic account of same. Elements other than NPs in particular, adjectives can be scope-taking
More informationA Polynomial Time Algorithm for Parsing with the Bounded Order Lambek Calculus
A Polynomial Time Algorithm for Parsing with the Bounded Order Lambek Calculus Timothy A. D. Fowler Department of Computer Science University of Toronto 10 King s College Rd., Toronto, ON, M5S 3G4, Canada
More informationLecture 3: Finite Automata
Administrivia Lecture 3: Finite Automata Everyone should now be registered electronically using the link on our webpage. If you haven t, do so today! I d like to have teams formed by next Monday at the
More informationCHAPTER 2 INTRODUCTION TO CLASSICAL PROPOSITIONAL LOGIC
CHAPTER 2 INTRODUCTION TO CLASSICAL PROPOSITIONAL LOGIC 1 Motivation and History The origins of the classical propositional logic, classical propositional calculus, as it was, and still often is called,
More informationNATURAL LOGIC 报告人 : 徐超哲学系逻辑学逻辑前沿问题讨论班 / 56
NATURAL LOGIC 报告人 : 徐超哲学系逻辑学逻辑前沿问题讨论班 2017.5.2 1 / 56 Background Extended Syllogistic Inference Logics with individual variables, RCA (opp) Inference with Monotonicity and Polarity Conclusion & Summary
More informationThe semantics of propositional logic
The semantics of propositional logic Readings: Sections 1.3 and 1.4 of Huth and Ryan. In this module, we will nail down the formal definition of a logical formula, and describe the semantics of propositional
More informationLanguages. Languages. An Example Grammar. Grammars. Suppose we have an alphabet V. Then we can write:
Languages A language is a set (usually infinite) of strings, also known as sentences Each string consists of a sequence of symbols taken from some alphabet An alphabet, V, is a finite set of symbols, e.g.
More informationChapter 1 Review of Equations and Inequalities
Chapter 1 Review of Equations and Inequalities Part I Review of Basic Equations Recall that an equation is an expression with an equal sign in the middle. Also recall that, if a question asks you to solve
More informationComputational Linguistics
Computational Linguistics Dependency-based Parsing Clayton Greenberg Stefan Thater FR 4.7 Allgemeine Linguistik (Computerlinguistik) Universität des Saarlandes Summer 2016 Acknowledgements These slides
More information1.1 The Language of Mathematics Expressions versus Sentences
The Language of Mathematics Expressions versus Sentences a hypothetical situation the importance of language Study Strategies for Students of Mathematics characteristics of the language of mathematics
More informationContinuations in Type Logical Grammar. Grafting Trees: (with Chris Barker, UCSD) NJPLS, 27 February Harvard University
Grafting Trees: Continuations in Type Logical Grammar Chung-chieh Shan Harvard University ccshan@post.harvard.edu (with Chris Barker, UCSD) NJPLS, 27 February 2004 Computational Linguistics 1 What a linguist
More informationQuantification in the predicate calculus
Quantification in the predicate calculus PHIL 43916 eptember 5, 2012 1. The problem posed by quantified sentences... 1 2. yntax of PC... 2 3. Bound and free iables... 3 4. Models and assignments... 4 5.
More informationCategorial Grammar. Algebra, Proof Theory, Applications. References Categorial Grammar, G. Morrill, OUP, 2011.
Categorial Grammar Algebra, Proof Theory, Applications References Categorial Grammar, G. Morrill, OUP, 2011. - The Logic of Categorial Grammars, R. Moot & Ch. Retore, Springer, FoLLI, 2012. Mehrnoosh Sadrzadeh
More informationSolving Equations by Adding and Subtracting
SECTION 2.1 Solving Equations by Adding and Subtracting 2.1 OBJECTIVES 1. Determine whether a given number is a solution for an equation 2. Use the addition property to solve equations 3. Determine whether
More informationLinguistics 819: Seminar on TAG and CCG. Introduction to Combinatory Categorial Grammar
Linguistics 819: Seminar on TAG and CCG Alexander Williams, 9 April 2008 Introduction to Combinatory Categorial Grammar Steedman and Dowty 1 The biggest picture Grammatical operations apply only to constituents.
More informationComputational Linguistics. Acknowledgements. Phrase-Structure Trees. Dependency-based Parsing
Computational Linguistics Dependency-based Parsing Dietrich Klakow & Stefan Thater FR 4.7 Allgemeine Linguistik (Computerlinguistik) Universität des Saarlandes Summer 2013 Acknowledgements These slides
More informationAdding Some. Larry Moss. Nordic Logic School August 7-11, Indiana University 1/37
1/37 Adding Some Larry Moss Indiana University Nordic Logic School August 7-11, 2017 2/37 What this chapter is about We started with the very small logic A of All x are y. And most recently we added verbs
More informationLecture 4: Finite Automata
Administrivia Lecture 4: Finite Automata Everyone should now be registered electronically using the link on our webpage. If you haven t, do so today! I dliketohaveteamsformedbyfriday,ifpossible,butnextmonday
More informationA Review of the Essentials of Extensional Semantics 1
A Review of the Essentials of Extensional Semantics 1 1. The Big Picture (1) Our Ultimate Goal A precise, formal theory of a particular sub-component the human language faculty: the ability to productively
More informationLecture 3: Finite Automata
Administrivia Lecture 3: Finite Automata Everyone should now be registered electronically using the link on our webpage. If you haven t, do so today! I d like to have teams formed by next Wednesday at
More informationCS 188 Introduction to AI Fall 2005 Stuart Russell Final
NAME: SID#: Section: 1 CS 188 Introduction to AI all 2005 Stuart Russell inal You have 2 hours and 50 minutes. he exam is open-book, open-notes. 100 points total. Panic not. Mark your answers ON HE EXAM
More informationLing 98a: The Meaning of Negation (Week 5)
Yimei Xiang yxiang@fas.harvard.edu 15 October 2013 1 Review Negation in propositional logic, oppositions, term logic of Aristotle Presuppositions Projection and accommodation Three-valued logic External/internal
More informationUNIT II REGULAR LANGUAGES
1 UNIT II REGULAR LANGUAGES Introduction: A regular expression is a way of describing a regular language. The various operations are closure, union and concatenation. We can also find the equivalent regular
More informationCMPT-825 Natural Language Processing. Why are parsing algorithms important?
CMPT-825 Natural Language Processing Anoop Sarkar http://www.cs.sfu.ca/ anoop October 26, 2010 1/34 Why are parsing algorithms important? A linguistic theory is implemented in a formal system to generate
More informationFundamentor Syllabus
Topic Topic Description Class 5- Level a Class 5- Level b Class 5- Level c De Cipher Codes Letter-letter Letter-number Juggling letters Thinking Hat Lateral Thinking Sequences Cubes and dices Colours and
More informationA syllogistic system for propositions with intermediate quantifiers
A syllogistic system for propositions with intermediate quantifiers Pasquale Iero 1, Allan Third 2, and Paul Piwek 1 1 School of Computing and Communications, The Open University, UK 2 Knowledge Media
More informationFLAC Context-Free Grammars
FLAC Context-Free Grammars Klaus Sutner Carnegie Mellon Universality Fall 2017 1 Generating Languages Properties of CFLs Generation vs. Recognition 3 Turing machines can be used to check membership in
More informationNAME: DATE: MATHS: Higher Level Algebra. Maths. Higher Level Algebra
Maths Higher Level Algebra It is not necessary to carry out all the activities contained in this unit. Please see Teachers Notes for explanations, additional activities, and tips and suggestions. Theme
More informationNatural Logic. Larry Moss, Indiana University. ASL North American Annual Meeting, March 19, 2010
Natural Logic Larry Moss, Indiana University ASL North American Annual Meeting, March 19, 2010 This talk deals with new logical systems tuned to natural language The raison d être of logic is the study
More informationMaths Higher Level Algebra
Maths Higher Level Algebra It is not necessary to carry out all the activities contained in this unit. Please see Teachers Notes for explanations, additional activities, and tips and suggestions. Theme
More informationParsing. Probabilistic CFG (PCFG) Laura Kallmeyer. Winter 2017/18. Heinrich-Heine-Universität Düsseldorf 1 / 22
Parsing Probabilistic CFG (PCFG) Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Winter 2017/18 1 / 22 Table of contents 1 Introduction 2 PCFG 3 Inside and outside probability 4 Parsing Jurafsky
More informationFocus in complex noun phrases
Focus in complex noun phrases Summary In this paper I investigate the semantics of association with focus in complex noun phrases in the framework of Alternative Semantics (Rooth 1985, 1992). For the first
More informationTheory of Computation
Theory of Computation (Feodor F. Dragan) Department of Computer Science Kent State University Spring, 2018 Theory of Computation, Feodor F. Dragan, Kent State University 1 Before we go into details, what
More information22c:145 Artificial Intelligence
22c:145 Artificial Intelligence Fall 2005 Propositional Logic Cesare Tinelli The University of Iowa Copyright 2001-05 Cesare Tinelli and Hantao Zhang. a a These notes are copyrighted material and may not
More informationFor all For every For each For any There exists at least one There exists There is Some
Section 1.3 Predicates and Quantifiers Assume universe of discourse is all the people who are participating in this course. Also let us assume that we know each person in the course. Consider the following
More information1 Rules in a Feature Grammar
27 Feature Grammars and Unification Drew McDermott drew.mcdermott@yale.edu 2015-11-20, 11-30, 2016-10-28 Yale CS470/570 1 Rules in a Feature Grammar Grammar rules look like this example (using Shieber
More informationHandout 3: PTQ Revisited (Muskens 1995, Ch. 4)
Handout 3: PTQ Revisited (Muskens 1995, Ch. 4) Semantics C (Spring 2010) Montague s PTQ article (Montague 1973), the paper in which he gave his Proper Treatment of Quantification, functions as the paradigm
More informationSuppose h maps number and variables to ɛ, and opening parenthesis to 0 and closing parenthesis
1 Introduction Parenthesis Matching Problem Describe the set of arithmetic expressions with correctly matched parenthesis. Arithmetic expressions with correctly matched parenthesis cannot be described
More informationPart of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch. COMP-599 Oct 1, 2015
Part of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch COMP-599 Oct 1, 2015 Announcements Research skills workshop today 3pm-4:30pm Schulich Library room 313 Start thinking about
More informationSequences and Information
Sequences and Information Rahul Siddharthan The Institute of Mathematical Sciences, Chennai, India http://www.imsc.res.in/ rsidd/ Facets 16, 04/07/2016 This box says something By looking at the symbols
More informationContext-Free Grammars and Languages. Reading: Chapter 5
Context-Free Grammars and Languages Reading: Chapter 5 1 Context-Free Languages The class of context-free languages generalizes the class of regular languages, i.e., every regular language is a context-free
More informationCA Compiler Construction
CA4003 - Compiler Construction Bottom Up Parsing David Sinclair Bottom Up Parsing LL(1) parsers have enjoyed a bit of a revival thanks to JavaCC. LL(k) parsers must predict which production rule to use
More information1 Alphabets and Languages
1 Alphabets and Languages Look at handout 1 (inference rules for sets) and use the rules on some examples like {a} {{a}} {a} {a, b}, {a} {{a}}, {a} {{a}}, {a} {a, b}, a {{a}}, a {a, b}, a {{a}}, a {a,
More informationLogic: The Big Picture
Logic: The Big Picture A typical logic is described in terms of syntax: what are the legitimate formulas semantics: under what circumstances is a formula true proof theory/ axiomatization: rules for proving
More informationLING 473: Day 10. START THE RECORDING Coding for Probability Hidden Markov Models Formal Grammars
LING 473: Day 10 START THE RECORDING Coding for Probability Hidden Markov Models Formal Grammars 1 Issues with Projects 1. *.sh files must have #!/bin/sh at the top (to run on Condor) 2. If run.sh is supposed
More informationLogic Background (1A) Young W. Lim 12/14/15
Young W. Lim 12/14/15 Copyright (c) 2014-2015 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any
More information1.2 The Role of Variables
1.2 The Role of Variables variables sentences come in several flavors true false conditional In this section, a name is given to mathematical sentences that are sometimes true, sometimes false they are
More informationa. Develop a fragment of English that contains quantificational NPs. b. Develop a translation base from that fragment to Politics+λ
An Algebraic Approach to Quantification and Lambda Abstraction: Applications to the Analysis of English (1) Ingredients on the Table a. A logical language with both quantification and lambda abstraction
More information