Learning Dependency-Based Compositional Semantics
|
|
- Isabella Lambert
- 5 years ago
- Views:
Transcription
1 Learning Dependency-Based Compositional Semantics Semantic Representations for Textual Inference Workshop Mar. 0, 0 Percy Liang Google/Stanford joint work with Michael Jordan and Dan Klein
2 Motivating Problem: Question Answering
3 Motivating Problem: Question Answering What is the largest city in California?
4 Motivating Problem: Question Answering What is the largest city in California? What is the largest city in a state bordering California?
5 Semantic Interpretation 4
6 Semantic Interpretation What is the largest city in a state bordering California? Phoenix 4
7 Semantic Interpretation What is the largest city in a state bordering California?? Phoenix 4
8 Semantic Interpretation What is the largest city in a state bordering California? argmax({c :city(c)^9s.state(s) ^ loc(c, s) ^ border(s,ca)}, population) Phoenix 4
9 Semantic Interpretation What is the largest city in a state bordering California? argmax({c :city(c) ^9s.state(s) ^ loc(c, s)^border(s,ca)}, population) Phoenix 4
10 Semantic Interpretation What is the largest city in a state bordering California? argmax({c :city(c) ^9s.state(s) ^ loc(c, s) ^ border(s,ca)}, population) Phoenix 4
11 Semantic Interpretation What is the largest city in a state bordering California? argmax({c : city(c) ^9s.state(s) ^ loc(c, s) ^ border(s,ca)}, population) Phoenix 4
12 Semantic Interpretation What is the largest city in a state bordering California? argmax({c : city(c) ^9s.state(s) ^ loc(c, s) ^ border(s,ca)}, population) computation Phoenix 4
13 Semantic Interpretation What is the largest city in a state bordering California?? computation Phoenix 4
14 Supervision for Semantic Interpretation 6
15 Supervision for Semantic Interpretation Detailed Supervision (current) What is the largest city in California? argmax({c : city(c) ^ loc(c,ca)}, population) 6
16 Supervision for Semantic Interpretation Detailed Supervision (current) What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) 6
17 Supervision for Semantic Interpretation Detailed Supervision (current) -doesn tscaleup What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) 6
18 Supervision for Semantic Interpretation Detailed Supervision (current) -doesn tscaleup What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) Natural Supervision (new) What is the largest city in California? Los Angeles 6
19 Supervision for Semantic Interpretation Detailed Supervision (current) -doesn tscaleup What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) Natural Supervision (new) What is the largest city in California? Los Angeles non-expert 6
20 Supervision for Semantic Interpretation Detailed Supervision (current) -doesn tscaleup What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) Natural Supervision (new) -scalesup What is the largest city in California? non-expert Los Angeles 6
21 Supervision for Semantic Interpretation Detailed Supervision (current) -doesn tscaleup - representation-dependent What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) Natural Supervision (new) -scalesup What is the largest city in California? non-expert Los Angeles 6
22 Supervision for Semantic Interpretation Detailed Supervision (current) -doesn tscaleup - representation-dependent What is the largest city in California? expert argmax({c : city(c) ^ loc(c,ca)}, population) Natural Supervision (new) -scalesup - representation-independent What is the largest city in California? Los Angeles non-expert 6
23 Outline Representation loc state border CA city major traverse river traverse AZ x Learning z w y Experiments 9
24 Considerations Computational: how to e ciently search exponential space? 0
25 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? Los Angeles 0
26 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? x.state(x) Los Angeles 0
27 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? x.city(x) Los Angeles 0
28 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? x.city(x) ^ loc(x, CA) Los Angeles 0
29 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? x.state(x) ^ border(x, CA) Los Angeles 0
30 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? population(ca) Los Angeles 0
31 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? argmax( x.city(x) ^ loc(x, CA), x.population(x)) Los Angeles 0
32 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? LF LF LF LF LF LF LF LF LF LF LF LF LF LF LF LF LF Los Angeles 0
33 Considerations Computational: how to e ciently search exponential space? What is the most populous city in California? LF LF LF LF LF LF LF LF LF LF LF LF LF LF LF LF LF Los Angeles Statistical: how to parametrize mapping from sentence to logical form? What is the most populous city in California? argmax( x.city(x) ^ loc(x, CA), x.population(x)) 0
34 Dependency-Based Compositional Semantics (DCS) What is the most populous city in California?
35 Dependency-Based Compositional Semantics (DCS) What is the most populous city in California? c argmax population city loc CA Los Angeles
36 Dependency-Based Compositional Semantics (DCS) What is the most populous city in California? c argmax population city loc CA Los Angeles Advantages of DCS: nice computational, statistical, linguistic properties
37 Where do the answers come from? What is the most populous city in California? c argmax population city loc CA Los Angeles
38 Where do the answers come from? What is the most populous city in California? c argmax population city loc CA Database Los Angeles
39 Database city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts state Alabama Alaska Arizona border Washington Oregon Washington Idaho Oregon Washington 3
40 Basic DCS Trees DCS tree Database city loc CA 4
41 Basic DCS Trees DCS tree Constraints Database city loc CA ADCStreeencodesaconstraint satisfaction problem (CSP) 4
42 Basic DCS Trees DCS tree Constraints Database city loc c city city San Francisco Chicago Boston CA ADCStreeencodesaconstraint satisfaction problem (CSP) 4
43 DCS tree Basic DCS Trees Constraints Database city loc CA c city ` loc city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts ADCStreeencodesaconstraint satisfaction problem (CSP) 4
44 DCS tree Basic DCS Trees Constraints Database city loc CA c city ` loc s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) 4
45 DCS tree Basic DCS Trees Constraints Database city loc CA c city c = ` ` loc s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) 4
46 DCS tree Basic DCS Trees Constraints Database city loc CA c city c = ` ` loc ` = s s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) 4
47 DCS tree Basic DCS Trees Constraints Database city loc CA c city c = ` ` loc ` = s s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) 4
48 DCS tree Basic DCS Trees Constraints Database city loc CA c city c = ` ` loc ` = s s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) 4
49 DCS tree Basic DCS Trees Constraints Database city loc CA c city c = ` ` loc ` = s s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) 4
50 DCS tree Basic DCS Trees Constraints Database city loc CA c city c = ` ` loc ` = s s CA city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts CA California ADCStreeencodesaconstraint satisfaction problem (CSP) Computation: dynamic programming ) time = O(# nodes) 4
51 Properties of DCS Trees loc state border CA city traverse river major traverse AZ 5
52 Properties of DCS Trees loc state border CA city traverse river major traverse AZ Trees 5
53 Properties of DCS Trees loc state border CA city traverse river major traverse AZ Linguistics Trees syntactic locality 5
54 Properties of DCS Trees loc state border CA city traverse river major traverse AZ Linguistics Trees Computation syntactic locality e cient interpretation 5
55 Divergence between Syntactic and Semantic Scope most populous city in California 6
56 Divergence between Syntactic and Semantic Scope most populous city in California Syntax city populous in most California 6
57 Divergence between Syntactic and Semantic Scope most populous city in California Syntax Semantics city populous in argmax( x.city(x) ^ loc(x, CA), x.population(x)) most California 6
58 Divergence between Syntactic and Semantic Scope most populous city in California Syntax Semantics city populous in argmax( x.city(x) ^ loc(x, CA), x.population(x)) most California 6
59 Divergence between Syntactic and Semantic Scope most populous city in California Syntax Semantics city populous in argmax( x.city(x) ^ loc(x, CA), x.population(x)) most California Problem: syntactic scope is lower than semantic scope 6
60 Divergence between Syntactic and Semantic Scope most populous city in California Syntax Semantics city populous in argmax( x.city(x) ^ loc(x, CA), x.population(x)) most California Problem: syntactic scope is lower than semantic scope If DCS trees look like syntax, how do we get correct semantics? 6
61 Solution: Mark-Execute most populous city in California Superlatives x c argmax population city loc CA 7
62 Solution: Mark-Execute most populous city in California Superlatives x Mark at syntactic scope c argmax population city loc CA 7
63 most populous city in California Solution: Mark-Execute Superlatives Execute at semantic scope Mark at syntactic scope population c argmax x city loc CA 7
64 Alaska borders no states. Solution: Mark-Execute Negation Execute at semantic scope Mark at syntactic scope AK x border state q no 7
65 Some river traverses every city. Solution: Mark-Execute Quantification (narrow) Execute at semantic scope Mark at syntactic scope river q x traverse city q some every 7
66 Some river traverses every city. Solution: Mark-Execute Quantification (wide) Execute at semantic scope Mark at syntactic scope river q x traverse city q some every 7
67 Some river traverses every city. Solution: Mark-Execute Quantification (wide) Execute at semantic scope Mark at syntactic scope river q x traverse city q some every Analogy: Montague s quantifying in, Carpenter s scoping constructor 7
68 Outline Representation loc state border CA city major traverse river traverse AZ x Learning z w y Experiments 8
69 Graphical Model z capital CA database w 9
70 Graphical Model z capital CA database w y Sacramento 9
71 Graphical Model z database capital CA w y Sacramento Interpretation: p(y z, w) (deterministic) 9
72 Graphical Model x capital of California? z database capital CA w y Sacramento Interpretation: p(y z, w) (deterministic) 9
73 Graphical Model x capital of California? parameters z database capital CA w y Sacramento Interpretation: p(y z, w) (deterministic) 9
74 Graphical Model parameters database x z capital of California? capital CA w y Sacramento Semantic Parsing: p(z x, ) (probabilistic) Interpretation: p(y z, w) (deterministic) 9
75 Plan x capital of California? parameters z capital What s possible? z Z(x) What s probable? p(z x, ) CA Learning from (x, y) data database w y Sacramento 0
76 Words to Predicates (Lexical Semantics) What is the most populous city in CA?
77 Words to Predicates (Lexical Semantics) CA What is the most populous city in CA? Lexical Triggers:. String match CA ) CA
78 Words to Predicates (Lexical Semantics) argmax What is the most populous city in CA? CA Lexical Triggers:. String match CA ) CA. Function words (0 words) most ) argmax
79 Words to Predicates (Lexical Semantics) city state river city state river argmax population population CA What is the most populous city in CA? Lexical Triggers:. String match CA ) CA. Function words (0 words) most ) argmax 3. Nouns/adjectives city ) city state river population
80 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] i most populous city in California j
81 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] i most populous k city in California j
82 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] C i,k C k,j i most populous k city in California j
83 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] population city c argmax loc CA C i,k C k,j i most populous k city in California j
84 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] city population loc population c c argmax CA city argmax loc CA C i,k C k,j i most populous k city in California j
85 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] city population loc population c c argmax CA city argmax loc CA C i,k C k,j i most populous k city in California j
86 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] city loc loc population c population CA city argmax c argmax loc CA C i,k C k,j i most populous k city in California j
87 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] city loc loc population c population CA city argmax c argmax loc CA C i,k C k,j i most populous k city in California j
88 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] city border loc population c population CA city argmax c argmax loc CA C i,k C k,j i most populous k city in California j
89 Predicates to DCS Trees (Compositional Semantics) C i,j = set of DCS trees for span [i, j] population c argmax city population c argmax loc CA city loc CA C i,k C k,j i most populous k city in California j
90 Plan x capital of California? parameters z capital What s possible? z Z(x) What s probable? p(z x, ) CA Learning from (x, y) data database w y Sacramento 3
91 Log-linear Model z: city loc CA x: city in California 4
92 Log-linear Model z: city loc CA x: city in California features(x, z) =( ) R d 4
93 Log-linear Model z: city loc CA x: city in California in features(x, z) =( loc :) R d 4
94 Log-linear Model z: city loc CA x: city in California in loc : city loc features(x, z) =( :) R d 4
95 Log-linear Model z: city loc CA x: city in California in loc : city loc : features(x, z) =( ) R d 4
96 Log-linear Model z: city loc CA x: city in California in loc : city loc : features(x, z) =( R d ) score(x, z) =features(x, z) 4
97 Log-linear Model z: city loc CA x: city in California in loc : city loc : features(x, z) =( ) R d score(x, z) =features(x, z) p(z x, ) = P e score(x,z) z 0 Z(x) escore(x,z0 ) 4
98 Plan x capital of California? parameters z capital What s possible? z Z(x) What s probable? p(z x, ) CA Learning from (x, y) data database w y Sacramento 5
99 Learning Objective Function: p(y z,w) p(z x, ) Interpretation Semantic parsing 6
100 Learning Objective Function: max p(y z,w) p(z x, ) Interpretation Semantic parsing 6
101 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing 6
102 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0, 0,...,0) 6
103 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0, 0,...,0) enumerate/score DCS trees 6
104 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0, 0,...,0) enumerate/score DCS trees k-best list tree tree tree3 tree4 tree5 6
105 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0.,.3,...,0.7) enumerate/score DCS trees numerical optimization (L-BFGS) k-best list tree tree tree3 tree4 tree5 6
106 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0.,.3,...,0.7) enumerate/score DCS trees numerical optimization (L-BFGS) k-best list tree3 tree8 tree6 tree tree4 6
107 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0.3,.4,...,0.6) enumerate/score DCS trees numerical optimization (L-BFGS) k-best list tree3 tree8 tree6 tree tree4 6
108 Learning Objective Function: max Pz p(y z,w) p(z x, ) Interpretation Semantic parsing EM-like Algorithm: parameters (0.3,.4,...,0.6) enumerate/score DCS trees numerical optimization (L-BFGS) k-best list tree3 tree8 tree tree4 tree9 6
109 Outline Representation loc state border CA city major traverse river traverse AZ x Learning z w y Experiments 7
110 US Geography Benchmark Standard semantic parsing benchmark since 990s 600 training examples, 80 test examples 8
111 US Geography Benchmark Standard semantic parsing benchmark since 990s 600 training examples, 80 test examples What is the highest point in Florida? How many states have a city called Rochester? What is the longest river that runs through a state that borders Tennessee? Of the states washed by the Mississippi river which has the lowest point? 8
112 US Geography Benchmark Standard semantic parsing benchmark since 990s 600 training examples, 80 test examples What is the highest point in Florida? ) answer(a,highest(a,(place(a),loc(a,b),const(b,stateid(florida))))) How many states have a city called Rochester? ) answer(a,count(b,(state(b),loc(c,b),const(c,cityid(rochester, ))),A)) What is the longest river that runs through a state that borders Tennessee? ) answer(a,longest(a,(river(a),traverse(a,b),state(b),next to(b,c),const(c,stateid(tennessee))))) Of the states washed by the Mississippi river which has the lowest point? ) answer(a,lowest(b,(state(a),traverse(c,a),const(c,riverid(mississippi)),loc(b,a),place(b)))) Supervision in past work: question + program 8
113 US Geography Benchmark Standard semantic parsing benchmark since 990s 600 training examples, 80 test examples What is the highest point in Florida? ) Walton County How many states have a city called Rochester? ) What is the longest river that runs through a state that borders Tennessee? ) Missouri Of the states washed by the Mississippi river which has the lowest point? ) Louisiana Supervision in past work: question + program Supervision in this work: question + answer 8
114 Input to Learning Algorithm Training data (600 examples) What is the highest point in Florida? ) Walton County How many states have a city called Rochester? ) What is the longest river that runs through a state that borders Tennessee? ) Missouri Of the states washed by the Mississippi river which has the lowest point? ) Louisiana 9
115 Input to Learning Algorithm Training data (600 examples) What is the highest point in Florida? ) Walton County How many states have a city called Rochester? ) What is the longest river that runs through a state that borders Tennessee? ) Missouri Of the states washed by the Mississippi river which has the lowest point? ) Louisiana Lexicon (75 words) city ) city state ) state mountain ) mountain, peak 9
116 Input to Learning Algorithm Training data (600 examples) What is the highest point in Florida? ) Walton County How many states have a city called Rochester? ) What is the longest river that runs through a state that borders Tennessee? ) Missouri Of the states washed by the Mississippi river which has the lowest point? ) Louisiana Lexicon (75 words) Database city ) city state ) state mountain ) mountain, peak city San Francisco Chicago Boston loc Mount Shasta California San Francisco California Boston Massachusetts state Alabama Alaska Arizona border Washington Oregon Washington Idaho Oregon Washington 9
117 Experiment On Geo, 50 training examples, 50 test examples test accuracy
118 Experiment On Geo, 50 training examples, 50 test examples System Description Lexicon (gen./spec.) Logical forms cgcr0 FunQL [Clarke et al., 00] test accuracy % cgcr0 30
119 Experiment On Geo, 50 training examples, 50 test examples System Description Lexicon (gen./spec.) Logical forms cgcr0 FunQL [Clarke et al., 00] dcs our system test accuracy % 78.9% cgcr0 dcs 30
120 Experiment On Geo, 50 training examples, 50 test examples System Description Lexicon (gen./spec.) Logical forms cgcr0 FunQL [Clarke et al., 00] dcs our system dcs + our system test accuracy % 78.9% 87.% cgcr0 dcs dcs + 30
121 Experiment On Geo, 600 training examples, 80 test examples 3
122 Experiment On Geo, 600 training examples, 80 test examples System Description Lexicon Logical forms test accuracy
123 Experiment On Geo, 600 training examples, 80 test examples System Description Lexicon Logical forms zc05 CCG [Zettlemoyer & Collins, 005] test accuracy % zc05 3
124 Experiment On Geo, 600 training examples, 80 test examples System Description zc05 CCG [Zettlemoyer & Collins, 005] zc07 relaxed CCG [Zettlemoyer & Collins, 007] Lexicon Logical forms test accuracy % 86.% 75 zc05 zc07 3
125 Experiment On Geo, 600 training examples, 80 test examples System Description zc05 CCG [Zettlemoyer & Collins, 005] zc07 relaxed CCG [Zettlemoyer & Collins, 007] kzgs0 CCG w/unification [Kwiatkowski et al., 00] Lexicon Logical forms 00 test accuracy % 86.% 88.9% 75 zc05 zc07 kzgs0 3
126 Experiment On Geo, 600 training examples, 80 test examples System Description zc05 CCG [Zettlemoyer & Collins, 005] zc07 relaxed CCG [Zettlemoyer & Collins, 007] kzgs0 CCG w/unification [Kwiatkowski et al., 00] dcs our system Lexicon Logical forms 00 test accuracy % 86.% 88.9% 88.6% 75 zc05 zc07 kzgs0 dcs 3
127 Experiment On Geo, 600 training examples, 80 test examples System Description zc05 CCG [Zettlemoyer & Collins, 005] zc07 relaxed CCG [Zettlemoyer & Collins, 007] kzgs0 CCG w/unification [Kwiatkowski et al., 00] dcs our system dcs + our system 00 Lexicon Logical forms test accuracy % 86.% 88.9% 88.6% 9.% 75 zc05 zc07 kzgs0 dcs dcs + 3
128 Some Intuition on Learning 3
129 Some Intuition on Learning parameters () search DCS trees (hard!) () numerical optimization k-best lists 3
130 Some Intuition on Learning () search DCS trees (hard!) parameters k-best lists () numerical optimization If no DCS tree on k-best list is correct, skip example in () 3
131 Some Intuition on Learning () search DCS trees (hard!) parameters k-best lists () numerical optimization If no DCS tree on k-best list is correct, skip example in () % examples trained on iteration 3
132 Some Intuition on Learning () search DCS trees (hard!) parameters k-best lists () numerical optimization If no DCS tree on k-best list is correct, skip example in () % examples trained on iteration E ect: automatic curriculum learning, learning improves search 3
133 Current Limitations 9
134 Only using forward information Current Limitations Execute program to get answer, but want to invert 9
135 Current Limitations Only using forward information Execute program to get answer, but want to invert Non-identifiability of program If all cities in database are in US, then can t distinguish {c : city(c)} and {c : city(c) ^ loc(c, US)} 9
136 Current Limitations Only using forward information Execute program to get answer, but want to invert Non-identifiability of program If all cities in database are in US, then can t distinguish {c : city(c)} and {c : city(c) ^ loc(c, US)} Unknown facts: How far is Los Angeles from Boston? Database has no distance information 9
137 Current Limitations Only using forward information Execute program to get answer, but want to invert Non-identifiability of program If all cities in database are in US, then can t distinguish {c : city(c)} and {c : city(c) ^ loc(c, US)} Unknown facts: How far is Los Angeles from Boston? Database has no distance information Unknown concepts: What states are landlocked? Need to induce database view for landlocked(x) = border(x, ocean) 9
138 Conclusion Goal: learn to answer questions from question/answer pairs 30
139 Conclusion Goal: learn to answer questions from question/answer pairs Empirical result: DCS (no logical forms) u existing systems (with logical forms) 30
140 Conclusion Goal: learn to answer questions from question/answer pairs Empirical result: DCS (no logical forms) u existing systems (with logical forms) Conceptual contribution: DCS trees Trees: connects dependency syntax with e cient evaluation 30
141 Conclusion Goal: learn to answer questions from question/answer pairs Empirical result: DCS (no logical forms) u existing systems (with logical forms) Conceptual contribution: DCStrees Trees: connects dependency syntax with e cient evaluation Mark-Execute: unifying framework for handling scope 30
142 thank you 35
Semantic Parsing with Combinatory Categorial Grammars
Semantic Parsing with Combinatory Categorial Grammars Yoav Artzi, Nicholas FitzGerald and Luke Zettlemoyer University of Washington ACL 2013 Tutorial Sofia, Bulgaria Learning Data Learning Algorithm CCG
More informationDriving Semantic Parsing from the World s Response
Driving Semantic Parsing from the World s Response James Clarke, Dan Goldwasser, Ming-Wei Chang, Dan Roth Cognitive Computation Group University of Illinois at Urbana-Champaign CoNLL 2010 Clarke, Goldwasser,
More informationCross-lingual Semantic Parsing
Cross-lingual Semantic Parsing Part I: 11 Dimensions of Semantic Parsing Kilian Evang University of Düsseldorf 1 / 94 Abbreviations NL natural language e.g., English, Bulgarian NLU natural language utterance
More informationIntroduction to Semantic Parsing with CCG
Introduction to Semantic Parsing with CCG Kilian Evang Heinrich-Heine-Universität Düsseldorf 2018-04-24 Table of contents 1 Introduction to CCG Categorial Grammar (CG) Combinatory Categorial Grammar (CCG)
More informationOutline. Learning. Overview Details Example Lexicon learning Supervision signals
Outline Learning Overview Details Example Lexicon learning Supervision signals 0 Outline Learning Overview Details Example Lexicon learning Supervision signals 1 Supervision in syntactic parsing Input:
More informationLecture 5: Semantic Parsing, CCGs, and Structured Classification
Lecture 5: Semantic Parsing, CCGs, and Structured Classification Kyle Richardson kyle@ims.uni-stuttgart.de May 12, 2016 Lecture Plan paper: Zettlemoyer and Collins (2012) general topics: (P)CCGs, compositional
More informationSequence labeling. Taking collective a set of interrelated instances x 1,, x T and jointly labeling them
HMM, MEMM and CRF 40-957 Special opics in Artificial Intelligence: Probabilistic Graphical Models Sharif University of echnology Soleymani Spring 2014 Sequence labeling aking collective a set of interrelated
More informationParsing with Context-Free Grammars
Parsing with Context-Free Grammars CS 585, Fall 2017 Introduction to Natural Language Processing http://people.cs.umass.edu/~brenocon/inlp2017 Brendan O Connor College of Information and Computer Sciences
More informationThe Infinite PCFG using Hierarchical Dirichlet Processes
S NP VP NP PRP VP VBD NP NP DT NN PRP she VBD heard DT the NN noise S NP VP NP PRP VP VBD NP NP DT NN PRP she VBD heard DT the NN noise S NP VP NP PRP VP VBD NP NP DT NN PRP she VBD heard DT the NN noise
More information, District of Columbia
State Capitals These are the State Seals of each state. Fill in the blank with the name of each states capital city. (Hint: You may find it helpful to do the word search first to refresh your memory.),
More informationJOINT PROBABILISTIC INFERENCE OF CAUSAL STRUCTURE
JOINT PROBABILISTIC INFERENCE OF CAUSAL STRUCTURE Dhanya Sridhar Lise Getoor U.C. Santa Cruz KDD Workshop on Causal Discovery August 14 th, 2016 1 Outline Motivation Problem Formulation Our Approach Preliminary
More informationHidden Markov Models. x 1 x 2 x 3 x N
Hidden Markov Models 1 1 1 1 K K K K x 1 x x 3 x N Example: The dishonest casino A casino has two dice: Fair die P(1) = P() = P(3) = P(4) = P(5) = P(6) = 1/6 Loaded die P(1) = P() = P(3) = P(4) = P(5)
More informationPreview: Making a Mental Map of the Region
Preview: Making a Mental Map of the Region Draw an outline map of Canada and the United States on the next page or on a separate sheet of paper. Add a compass rose to your map, showing where north, south,
More informationNatural Language Processing. Slides from Andreas Vlachos, Chris Manning, Mihai Surdeanu
Natural Language Processing Slides from Andreas Vlachos, Chris Manning, Mihai Surdeanu Projects Project descriptions due today! Last class Sequence to sequence models Attention Pointer networks Today Weak
More informationSequence Modelling with Features: Linear-Chain Conditional Random Fields. COMP-599 Oct 6, 2015
Sequence Modelling with Features: Linear-Chain Conditional Random Fields COMP-599 Oct 6, 2015 Announcement A2 is out. Due Oct 20 at 1pm. 2 Outline Hidden Markov models: shortcomings Generative vs. discriminative
More informationNorth American Geography. Lesson 2: My Country tis of Thee
North American Geography Lesson 2: My Country tis of Thee Unit Overview: As students work through the activities in this unit they will be introduced to the United States in general, different regions
More informationStructured Prediction Models via the Matrix-Tree Theorem
Structured Prediction Models via the Matrix-Tree Theorem Terry Koo Amir Globerson Xavier Carreras Michael Collins maestro@csail.mit.edu gamir@csail.mit.edu carreras@csail.mit.edu mcollins@csail.mit.edu
More informationBringing machine learning & compositional semantics together: central concepts
Bringing machine learning & compositional semantics together: central concepts https://githubcom/cgpotts/annualreview-complearning Chris Potts Stanford Linguistics CS 244U: Natural language understanding
More informationStatistical Methods for NLP
Statistical Methods for NLP Sequence Models Joakim Nivre Uppsala University Department of Linguistics and Philology joakim.nivre@lingfil.uu.se Statistical Methods for NLP 1(21) Introduction Structured
More informationLocation Option Details. 1. Florida
1. Florida Florida has the smallest number of earthquaes in the United States. Florida is the U.S. location where hurricanes are most frequent. Of the six deadliest hurricanes to hit the continental U.S.,
More informationScale Drawings and Maps
Name Date Class Practice A Use the map to answer the questions. 1. On the map, the distance from Newton to Cambridge is 2 cm. What is the actual distance? 2. On the map, the distance from Arlington to
More informationA Probabilistic Forest-to-String Model for Language Generation from Typed Lambda Calculus Expressions
A Probabilistic Forest-to-String Model for Language Generation from Typed Lambda Calculus Expressions Wei Lu and Hwee Tou Ng National University of Singapore 1/26 The Task (Logical Form) λx 0.state(x 0
More informationPart of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch. COMP-599 Oct 1, 2015
Part of Speech Tagging: Viterbi, Forward, Backward, Forward- Backward, Baum-Welch COMP-599 Oct 1, 2015 Announcements Research skills workshop today 3pm-4:30pm Schulich Library room 313 Start thinking about
More informationTo make a grammar probabilistic, we need to assign a probability to each context-free rewrite
Notes on the Inside-Outside Algorithm To make a grammar probabilistic, we need to assign a probability to each context-free rewrite rule. But how should these probabilities be chosen? It is natural to
More informationInvestigation 11.3 Weather Maps
Name: Date: Investigation 11.3 Weather Maps What can you identify weather patterns based on information read on a weather map? There have been some amazing technological advancements in the gathering and
More informationOutline. Learning. Overview Details
Outline Learning Overview Details 0 Outline Learning Overview Details 1 Supervision in syntactic parsing Input: S NP VP NP NP V VP ESSLLI 2016 the known summer school is V PP located in Bolzano Output:
More informationCSCE 222 Discrete Structures for Computing. Propositional Logic. Dr. Hyunyoung Lee. !!!!!! Based on slides by Andreas Klappenecker
CSCE 222 Discrete Structures for Computing Propositional Logic Dr. Hyunyoung Lee Based on slides by Andreas Klappenecker 1 Propositions A proposition is a declarative sentence that is either true or false
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 9: Expectation Maximiation (EM) Algorithm, Learning in Undirected Graphical Models Some figures courtesy
More informationA. Geography Students know the location of places, geographic features, and patterns of the environment.
Learning Targets Elementary Social Studies Grade 5 2014-2015 A. Geography Students know the location of places, geographic features, and patterns of the environment. A.5.1. A.5.2. A.5.3. A.5.4. Label North
More informationSemantics and Pragmatics of NLP
Semantics and Pragmatics of NLP Alex Ewan School of Informatics University of Edinburgh 28 January 2008 1 2 3 Taking Stock We have: Introduced syntax and semantics for FOL plus lambdas. Represented FOL
More informationQuasi-Second-Order Parsing for 1-Endpoint-Crossing, Pagenumber-2 Graphs
Quasi-Second-Order Parsing for 1-Endpoint-Crossing, Pagenumber-2 Graphs Junjie Cao, Sheng Huang, Weiwei Sun, Xiaojun Wan Institute of Computer Science and Technology Peking University September 5, 2017
More informationNatural Language Processing CS Lecture 06. Razvan C. Bunescu School of Electrical Engineering and Computer Science
Natural Language Processing CS 6840 Lecture 06 Razvan C. Bunescu School of Electrical Engineering and Computer Science bunescu@ohio.edu Statistical Parsing Define a probabilistic model of syntax P(T S):
More informationExpectation Maximization (EM)
Expectation Maximization (EM) The EM algorithm is used to train models involving latent variables using training data in which the latent variables are not observed (unlabeled data). This is to be contrasted
More informationStandard Indicator That s the Latitude! Students will use latitude and longitude to locate places in Indiana and other parts of the world.
Standard Indicator 4.3.1 That s the Latitude! Purpose Students will use latitude and longitude to locate places in Indiana and other parts of the world. Materials For the teacher: graph paper, globe showing
More informationCalifornia: Land and People Lesson 1: Locating California
California: Land and People Lesson 1: Locating California Hemisphere One half of the earth or another sphere Video on Hemispheres click here Relative location Where a place is compared to one or more other
More informationStatistical Methods for NLP
Statistical Methods for NLP Stochastic Grammars Joakim Nivre Uppsala University Department of Linguistics and Philology joakim.nivre@lingfil.uu.se Statistical Methods for NLP 1(22) Structured Classification
More informationState Geography Due: Tuesday, October 24, 2017
State Geography Due: Tuesday, October 24, 2017 Step 1: You will first go online to http://www.timeanddate.com/worldclock/distance.html. Click on calculators and from the drop down menu, click on distance
More informationLearning Goals of CS245 Logic and Computation
Learning Goals of CS245 Logic and Computation Alice Gao April 27, 2018 Contents 1 Propositional Logic 2 2 Predicate Logic 4 3 Program Verification 6 4 Undecidability 7 1 1 Propositional Logic Introduction
More informationNatural Language Processing : Probabilistic Context Free Grammars. Updated 5/09
Natural Language Processing : Probabilistic Context Free Grammars Updated 5/09 Motivation N-gram models and HMM Tagging only allowed us to process sentences linearly. However, even simple sentences require
More informationMeteorology 110. Lab 1. Geography and Map Skills
Meteorology 110 Name Lab 1 Geography and Map Skills 1. Geography Weather involves maps. There s no getting around it. You must know where places are so when they are mentioned in the course it won t be
More informationThe Noisy Channel Model and Markov Models
1/24 The Noisy Channel Model and Markov Models Mark Johnson September 3, 2014 2/24 The big ideas The story so far: machine learning classifiers learn a function that maps a data item X to a label Y handle
More informationHigh School World History Cycle 2 Week 2 Lifework
Name: Advisory: Period: High School World History Cycle 2 Week 2 Lifework This packet is due Monday, November 7 Complete and turn in on Friday for 10 points of EXTRA CREDIT! Lifework Assignment Complete
More informationLEARNING COMPOSITIONALITY
LARNING COMPOSIIONALIY Ignacio Cases with Christopher Potts Stanford University Meaning and Semantic Representation Compositional Semantics Semantic Parsing xecution Message Semantic Representation Denotation
More informationLecture 15. Probabilistic Models on Graph
Lecture 15. Probabilistic Models on Graph Prof. Alan Yuille Spring 2014 1 Introduction We discuss how to define probabilistic models that use richly structured probability distributions and describe how
More informationHI SUMMER WORK
HI-201 2018-2019 SUMMER WORK This packet belongs to: Dear Dual Enrollment Student, May 7 th, 2018 Dual Enrollment United States History is a challenging adventure. Though the year holds countless hours
More informationIntroduction to Semantics. The Formalization of Meaning 1
The Formalization of Meaning 1 1. Obtaining a System That Derives Truth Conditions (1) The Goal of Our Enterprise To develop a system that, for every sentence S of English, derives the truth-conditions
More informationLecture 5: Ecological distance metrics; Principal Coordinates Analysis. Univariate testing vs. community analysis
Lecture 5: Ecological distance metrics; Principal Coordinates Analysis Univariate testing vs. community analysis Univariate testing deals with hypotheses concerning individual taxa Is this taxon differentially
More informationA proof theoretical account of polarity items and monotonic inference.
A proof theoretical account of polarity items and monotonic inference. Raffaella Bernardi UiL OTS, University of Utrecht e-mail: Raffaella.Bernardi@let.uu.nl Url: http://www.let.uu.nl/ Raffaella.Bernardi/personal
More informationProbabilistic Reasoning. (Mostly using Bayesian Networks)
Probabilistic Reasoning (Mostly using Bayesian Networks) Introduction: Why probabilistic reasoning? The world is not deterministic. (Usually because information is limited.) Ways of coping with uncertainty
More informationExpectation Maximization Algorithm
Expectation Maximization Algorithm Vibhav Gogate The University of Texas at Dallas Slides adapted from Carlos Guestrin, Dan Klein, Luke Zettlemoyer and Dan Weld The Evils of Hard Assignments? Clusters
More informationAI Programming CS S-09 Knowledge Representation
AI Programming CS662-2013S-09 Knowledge Representation David Galles Department of Computer Science University of San Francisco 09-0: Overview So far, we ve talked about search, which is a means of considering
More informationLinear Dynamical Systems
Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations
More informationAlgorithms for Syntax-Aware Statistical Machine Translation
Algorithms for Syntax-Aware Statistical Machine Translation I. Dan Melamed, Wei Wang and Ben Wellington ew York University Syntax-Aware Statistical MT Statistical involves machine learning (ML) seems crucial
More informationMultivariate Statistics
Multivariate Statistics Chapter 6: Cluster Analysis Pedro Galeano Departamento de Estadística Universidad Carlos III de Madrid pedro.galeano@uc3m.es Course 2017/2018 Master in Mathematical Engineering
More informationChallenge 1: Learning About the Physical Geography of Canada and the United States
60ºN S T U D E N T H A N D O U T Challenge 1: Learning About the Physical Geography of Canada and the United States 170ºE 10ºW 180º 20ºW 60ºN 30ºW 1 40ºW 160ºW 50ºW 150ºW 60ºW 140ºW N W S E 0 500 1,000
More informationIntegrated Science I: Locating earthquake epicenters. Name Per Date
Integrated Science I: Locating earthquake epicenters. Name Per Date Whenever a significant earthquake occurs somewhere in the world, news media present reports about two issues; the size or magnitude of
More informationRank University AMJ AMR ASQ JAP OBHDP OS PPSYCH SMJ SUM 1 University of Pennsylvania (T) Michigan State University
Rank University AMJ AMR ASQ JAP OBHDP OS PPSYCH SMJ SUM 1 University of Pennsylvania 4 1 2 0 2 4 0 9 22 2(T) Michigan State University 2 0 0 9 1 0 0 4 16 University of Michigan 3 0 2 5 2 0 0 4 16 4 Harvard
More informationCSE446: Clustering and EM Spring 2017
CSE446: Clustering and EM Spring 2017 Ali Farhadi Slides adapted from Carlos Guestrin, Dan Klein, and Luke Zettlemoyer Clustering systems: Unsupervised learning Clustering Detect patterns in unlabeled
More informationLecture 5: Ecological distance metrics; Principal Coordinates Analysis. Univariate testing vs. community analysis
Lecture 5: Ecological distance metrics; Principal Coordinates Analysis Univariate testing vs. community analysis Univariate testing deals with hypotheses concerning individual taxa Is this taxon differentially
More informationLogic and machine learning review. CS 540 Yingyu Liang
Logic and machine learning review CS 540 Yingyu Liang Propositional logic Logic If the rules of the world are presented formally, then a decision maker can use logical reasoning to make rational decisions.
More informationGenerative Models for Sentences
Generative Models for Sentences Amjad Almahairi PhD student August 16 th 2014 Outline 1. Motivation Language modelling Full Sentence Embeddings 2. Approach Bayesian Networks Variational Autoencoders (VAE)
More informationIntelligent Systems (AI-2)
Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 19 Oct, 24, 2016 Slide Sources Raymond J. Mooney University of Texas at Austin D. Koller, Stanford CS - Probabilistic Graphical Models D. Page,
More informationPAC Generalization Bounds for Co-training
PAC Generalization Bounds for Co-training Sanjoy Dasgupta AT&T Labs Research dasgupta@research.att.com Michael L. Littman AT&T Labs Research mlittman@research.att.com David McAllester AT&T Labs Research
More informationMachine Learning for natural language processing
Machine Learning for natural language processing Hidden Markov Models Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Summer 2016 1 / 33 Introduction So far, we have classified texts/observations
More informationAmerican Tour: Climate Objective To introduce contour maps as data displays.
American Tour: Climate Objective To introduce contour maps as data displays. www.everydaymathonline.com epresentations etoolkit Algorithms Practice EM Facts Workshop Game Family Letters Assessment Management
More informationThe Semantics of Definite DPs 1. b. Argument Position: (i) [ A politician ] arrived from Washington. (ii) Joe likes [ the politician ].
The Semantics of Definite DPs 1 Thus far, our semantics is able to interpret common nouns that occupy predicate position (1a). However, the most common position for common nouns to occupy is internal to
More informationSummary of Natural Hazard Statistics for 2008 in the United States
Summary of Natural Hazard Statistics for 2008 in the United States This National Weather Service (NWS) report summarizes fatalities, injuries and damages caused by severe weather in 2008. The NWS Office
More informationPima Community College Students who Enrolled at Top 200 Ranked Universities
Pima Community College Students who Enrolled at Top 200 Ranked Universities Institutional Research, Planning and Effectiveness Project #20170814-MH-60-CIR August 2017 Students who Attended Pima Community
More informationNew Educators Campaign Weekly Report
Campaign Weekly Report Conversations and 9/24/2017 Leader Forms Emails Collected Text Opt-ins Digital Journey 14,661 5,289 4,458 7,124 317 13,699 1,871 2,124 Pro 13,924 5,175 4,345 6,726 294 13,086 1,767
More informationNatural Language Processing
Natural Language Processing Global linear models Based on slides from Michael Collins Globally-normalized models Why do we decompose to a sequence of decisions? Can we directly estimate the probability
More informationAdvanced Topics in LP and FP
Lecture 1: Prolog and Summary of this lecture 1 Introduction to Prolog 2 3 Truth value evaluation 4 Prolog Logic programming language Introduction to Prolog Introduced in the 1970s Program = collection
More informationSummary of Terminal Master s Degree Programs in Philosophy
Summary of Terminal Master s Degree Programs in Philosophy Faculty and Student Demographics All data collected by the ican Philosophical Association. The data in this publication have been provided by
More informationLanguage to Logical Form with Neural Attention
Language to Logical Form with Neural Attention Mirella Lapata and Li Dong Institute for Language, Cognition and Computation School of Informatics University of Edinburgh mlap@inf.ed.ac.uk 1 / 32 Semantic
More informationCS 331: Artificial Intelligence Propositional Logic I. Knowledge-based Agents
CS 331: Artificial Intelligence Propositional Logic I 1 Knowledge-based Agents Can represent knowledge And reason with this knowledge How is this different from the knowledge used by problem-specific agents?
More informationKnowledge-based Agents. CS 331: Artificial Intelligence Propositional Logic I. Knowledge-based Agents. Outline. Knowledge-based Agents
Knowledge-based Agents CS 331: Artificial Intelligence Propositional Logic I Can represent knowledge And reason with this knowledge How is this different from the knowledge used by problem-specific agents?
More informationGuided Reading Activity
Guided Reading Activity Lesson 1 Physical Features Essential Question: How does geography influence the way people live? A Vast Land Directions: Read the lesson and use your text to decide whether each
More informationJakarta International School 6 th Grade Formative Assessment Graphing and Statistics -Black
Jakarta International School 6 th Grade Formative Assessment Graphing and Statistics -Black Name: Date: Score : 42 Data collection, presentation and application Frequency tables. (Answer question 1 on
More informationGenerative and Discriminative Approaches to Graphical Models CMSC Topics in AI
Generative and Discriminative Approaches to Graphical Models CMSC 35900 Topics in AI Lecture 2 Yasemin Altun January 26, 2007 Review of Inference on Graphical Models Elimination algorithm finds single
More informationKathryn Robinson. Grades 3-5. From the Just Turn & Share Centers Series VOLUME 12
1 2 From the Just Turn & Share Centers Series VOLUME 12 Temperature TM From the Just Turn & Share Centers Series Kathryn Robinson 3 4 M Enterprises WriteMath Enterprises 2303 Marseille Ct. Suite 104 Valrico,
More informationThe exam is closed book, closed calculator, and closed notes except your one-page crib sheet.
CS 188 Fall 2015 Introduction to Artificial Intelligence Final You have approximately 2 hours and 50 minutes. The exam is closed book, closed calculator, and closed notes except your one-page crib sheet.
More information12. Dezember
1 Lehrstuhl für Künstliche Intelligenz Institut für Informatik Friedrich-Alexander-Universität Erlangen-Nürnberg 12. Dezember 2005 1 Alex Lascarides SPNLP Course http://homepages.inf.ed.ac.uk/alex/spnlp/02.slides.pdf
More informationPredicate Calculus. CS 270 Math Foundations of Computer Science Jeremy Johnson
Predicate Calculus CS 270 Math Foundations of Computer Science Jeremy Johnson Presentation uses material from Huth and Ryan, Logic in Computer Science: Modelling and Reasoning about Systems, 2nd Edition
More informationMovement-Generalized Minimalist Grammars
Movet-Generalized Minimalist Grammars Thomas Graf tgraf@ucla.edu tgraf.bol.ucla.edu University of California, Los Angeles LACL 2012 July 2, 2012 Outline 1 Monadic Second-Order Logic (MSO) Talking About
More informationUNIT II REGULAR LANGUAGES
1 UNIT II REGULAR LANGUAGES Introduction: A regular expression is a way of describing a regular language. The various operations are closure, union and concatenation. We can also find the equivalent regular
More informationTuning as Linear Regression
Tuning as Linear Regression Marzieh Bazrafshan, Tagyoung Chung and Daniel Gildea Department of Computer Science University of Rochester Rochester, NY 14627 Abstract We propose a tuning method for statistical
More information2005 Mortgage Broker Regulation Matrix
2005 Mortgage Broker Regulation Matrix Notes on individual states follow the table REG EXEMPTIONS LIC-EDU LIC-EXP LIC-EXAM LIC-CONT-EDU NET WORTH BOND MAN-LIC MAN-EDU MAN-EXP MAN-EXAM Alabama 1 0 2 0 0
More informationClub Convergence and Clustering of U.S. State-Level CO 2 Emissions
Methodological Club Convergence and Clustering of U.S. State-Level CO 2 Emissions J. Wesley Burnett Division of Resource Management West Virginia University Wednesday, August 31, 2013 Outline Motivation
More informationMINERALS THROUGH GEOGRAPHY
MINERALS THROUGH GEOGRAPHY INTRODUCTION Minerals are related to rock type, not political definition of place. So, the minerals are to be found in a variety of locations that doesn t depend on population
More informationIntelligent Systems (AI-2)
Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 19 Oct, 23, 2015 Slide Sources Raymond J. Mooney University of Texas at Austin D. Koller, Stanford CS - Probabilistic Graphical Models D. Page,
More informationConditional Random Field
Introduction Linear-Chain General Specific Implementations Conclusions Corso di Elaborazione del Linguaggio Naturale Pisa, May, 2011 Introduction Linear-Chain General Specific Implementations Conclusions
More informationPredicate Calculus. Formal Methods in Verification of Computer Systems Jeremy Johnson
Predicate Calculus Formal Methods in Verification of Computer Systems Jeremy Johnson Outline 1. Motivation 1. Variables, quantifiers and predicates 2. Syntax 1. Terms and formulas 2. Quantifiers, scope
More informationNLU: Semantic parsing
NLU: Semantic parsing Adam Lopez slide credits: Chris Dyer, Nathan Schneider March 30, 2018 School of Informatics University of Edinburgh alopez@inf.ed.ac.uk Recall: meaning representations Sam likes Casey
More informationLogic and Modelling. Introduction to Predicate Logic. Jörg Endrullis. VU University Amsterdam
Logic and Modelling Introduction to Predicate Logic Jörg Endrullis VU University Amsterdam Predicate Logic In propositional logic there are: propositional variables p, q, r,... that can be T or F In predicate
More informationOutline. Parsing. Approximations Some tricks Learning agenda-based parsers
Outline Parsing CKY Approximations Some tricks Learning agenda-based parsers 0 Parsing We need to compute compute argmax d D(x) p θ (d x) Inference: Find best tree given model 1 Parsing We need to compute
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning Expectation Maximization Mark Schmidt University of British Columbia Winter 2018 Last Time: Learning with MAR Values We discussed learning with missing at random values in data:
More informationA gentle introduction to Hidden Markov Models
A gentle introduction to Hidden Markov Models Mark Johnson Brown University November 2009 1 / 27 Outline What is sequence labeling? Markov models Hidden Markov models Finding the most likely state sequence
More informationPropositional Logic: Logical Agents (Part I)
Propositional Logic: Logical Agents (Part I) This lecture topic: Propositional Logic (two lectures) Chapter 7.1-7.4 (this lecture, Part I) Chapter 7.5 (next lecture, Part II) Next lecture topic: First-order
More informationGraph-Based Lexicon Expansion with Sparsity-Inducing Penalties
Graph-Based Lexicon Expansion with Sparsity-Inducing Penalties Dipanjan Das, LTI, CMU Google Noah Smith, LTI, CMU Thanks: André Martins, Amar Subramanya, and Partha Talukdar. This research was supported
More informationInformation theoretical approach for domain ontology exploration in large Earth observation image archives
Information theoretical approach for domain ontology exploration in large Earth observation image archives Mihai Datcu, Mariana Ciucu DLR Oberpfaffenhofen IGARSS 2004 KIM - Knowledge driven Information
More informationLing 130 Notes: Syntax and Semantics of Propositional Logic
Ling 130 Notes: Syntax and Semantics of Propositional Logic Sophia A. Malamud January 21, 2011 1 Preliminaries. Goals: Motivate propositional logic syntax and inferencing. Feel comfortable manipulating
More information