The word problem in Z 2 and formal language theory

Size: px
Start display at page:

Download "The word problem in Z 2 and formal language theory"

Transcription

1 The word problem in Z 2 and formal language theory Sylvain Salvati INRIA Bordeaux Sud-Ouest Topology and languages June 22-24

2 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

3 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

4 Group languages Group finite presentation: a finite set of generators Σ a finite set of defining equations E

5 Group languages Group finite presentation: a finite set of generators Σ a finite set of defining equations E Word problem: given w in Σ, is w = E 1? Group language: {w Σ w = E 1}

6 Group languages Group finite presentation: a finite set of generators Σ a finite set of defining equations E Word problem: given w in Σ, is w = E 1? Group language: {w Σ w = E 1} the word problem is in general undecidable (Novikov 1955, Boone 1958) the languages of different representation of a group a rationally equivalent relate algebraic properties of groups to language-theoretic properties of their group languages

7 Group languages Group finite presentation: a finite set of generators Σ a finite set of defining equations E Word problem: given w in Σ, is w = E 1? Group language: {w Σ w = E 1} the word problem is in general undecidable (Novikov 1955, Boone 1958) the languages of different representation of a group a rationally equivalent relate algebraic properties of groups to language-theoretic properties of their group languages Example: a group language is context free iff its underlying group is virtually free (Muller Schupp 1983)

8 A simple presentation of Z 2 Generators: {a; a; b; b} Defining equations: a 1 = a, b 1 = b, xy = yx a a b b The associated group language is O 2 = {w {a; a; b; b} w a = w a w b = w b }

9 O 2 and computational group theory Gilman (2005)

10 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

11 MIX MIX = {w {a; b; c} w a = w b = w c } MIX and O 2 are rationally equivalent

12 The Bach language Bach (1981) Wikipedia entry: language

13 The MIX language Marsh (1985) Conjecture: MIX is not an indexed language.

14 MIX and Tree Adjoining Grammars Joshi (1985) [MIX ] represents the extreme case of the degree of free word order permitted in a language. This extreme case is linguistically not relevant. [... ] TAGs also cannot generate this language although for TAGs the proof is not in hand yet.

15 MIX and Tree Adjoining Grammars Vijay Shanker, Weir, Joshi (1991)

16 MIX and mildly context sensitive languages Joshi, Vijay Shanker, Weir (1991)

17 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

18 Original paper

19 A generalization of context-free grammars Rule of a context free grammar: A w 1 B 1... w n B n w n+1 with A, B 1,..., B n non-terminals and w 1,... w n+1 string of terminals.

20 A generalization of context-free grammars Rule of a context free grammar: A w 1 B 1... w n B n w n+1 with A, B 1,..., B n non-terminals and w 1,... w n+1 string of terminals. A bottom-up view: A(w 1 x 1... w n x n w n+1 ) B 1 (x 1 ),..., B n (x n )

21 A generalization of context-free grammars Replace strings by tuple of strings: B(s 1,..., s m ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n )

22 A generalization of context-free grammars Replace strings by tuple of strings: B(s 1,..., s m ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) the strings s i are made of terminals and of the variables x i j,

23 A generalization of context-free grammars Replace strings by tuple of strings: B(s 1,..., s m ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) the strings s i are made of terminals and of the variables x i j, the variables x i j are pairwise distinct (otherwise we get Groenink s Literal Movement Grammars),

24 A generalization of context-free grammars Replace strings by tuple of strings: B(s 1,..., s m ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) the strings s i are made of terminals and of the variables x i j, the variables x i j are pairwise distinct (otherwise we get Groenink s Literal Movement Grammars), each variable x i j has at most one occurrence in the string s 1... s m (otherwise we get Parallel Multiple Context-Free Grammars).

25 Formal definition A m-mcfg(r) is a 4-tuple (N, T, P, S) such that: N is a ranked alphabet of non-terminals of max. rank m.

26 Formal definition A m-mcfg(r) is a 4-tuple (N, T, P, S) such that: N is a ranked alphabet of non-terminals of max. rank m. T is an alphabet of terminals

27 Formal definition A m-mcfg(r) is a 4-tuple (N, T, P, S) such that: N is a ranked alphabet of non-terminals of max. rank m. T is an alphabet of terminals P is a set of rules of the form: where: A(s 1,..., s k ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) A is a non-terminal of rank k, B i is non-terminal of rank k i, n r, the variables x i j are pairwise distinct, the strings si are in (T X ) with X = n ki i=1 j=1 {x j i}, each variable x i j has at most one occurrence in s 1... s k

28 Formal definition A m-mcfg(r) is a 4-tuple (N, T, P, S) such that: N is a ranked alphabet of non-terminals of max. rank m. T is an alphabet of terminals P is a set of rules of the form: where: A(s 1,..., s k ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) A is a non-terminal of rank k, B i is non-terminal of rank k i, n r, the variables x i j are pairwise distinct, the strings si are in (T X ) with X = n ki i=1 j=1 {x j i}, each variable x i j has at most one occurrence in s 1... s k S is a non-terminal of rank 1, the starting symbol.

29 The language generated by an MCFG Given an MCFG G = (N, T, P, S), if the following conditions holds: B 1 (s 1 1,..., s1 k 1 ),..., B n (s n 1,..., sn k n ) are derivable, A(s 1,..., s k ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) is a rule in P then A(t 1,..., t k ) with t i = s i [x i j s i j ] i [1;n],j [1;k i ] is derivable.

30 The language generated by an MCFG Given an MCFG G = (N, T, P, S), if the following conditions holds: B 1 (s 1 1,..., s1 k 1 ),..., B n (s n 1,..., sn k n ) are derivable, A(s 1,..., s k ) B 1 (x 1 1,..., x 1 k 1 ),..., B n (x n 1,..., x n k n ) is a rule in P then A(t 1,..., t k ) with t i = s i [x i j s i j ] i [1;n],j [1;k i ] is derivable. The language define by G, L(G) is: {w S(w) is derivable}

31 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ)

32 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ)

33 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ) Q(c, d)

34 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ) Q(c, d) Q(cc, dd)

35 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ) Q(c, d) Q(cc, dd) P(ɛ, ɛ)

36 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ) Q(c, d) Q(cc, dd) P(ɛ, ɛ) P(a, b)

37 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ) Q(c, d) Q(cc, dd) S(accbdd) P(ɛ, ɛ) P(a, b)

38 An example S(x 1y 1x 2y 2) P(x 1, x 2), Q(y 1, y 2) P(ax 1, bx 2) P(x 1, x 2) P(ɛ, ɛ) Q(cx 1, dx 2) Q(x 1, x 2) Q(ɛ, ɛ) Q(ɛ, ɛ) Q(c, d) Q(cc, dd) S(accbdd) P(ɛ, ɛ) P(a, b) S(a n c m b n d m ) P(a n, b n ), Q(c m, d m ) The language is: {a n c m b n d m n N m N}

39 The well-nestedness constraint I (x 1 y 1, y 2 x 2 ) J(x 1, x 2 ), K(y 1, y 2 ) I (x 1 y 1, x 2 y 2 ) J(x 1, x 2 ), K(y 1, y 2 ) A(x 1 z 1, z 2 x 2 y 1, y 2 y 3 x 3 ) B(x 1, x 2, x 3 ) C(y 1, y 2, y 3 ) D(z 1, z 2 ) A(z 1 x 1, y 1 x 2 z 2 y 2 x 3, y 3 ) B(x 1, x 2, x 3 ) C(y 1, y 2, y 3 ) D(z 1, z 2 )

40 MCFL wn and MCFL MCFL MCFL wn {a n 1... an m n N} {w m+1 w {a; b}, m N}

41 MCFL wn and MCFL MCFL {w 1... w nz nw nz n 1... z 1 w 1 z 0 w r 1... w r n n N, w i {c; d} +, z 0,..., z n D 1 } Staudacher 1993 Michaelis 2005 MCFL wn {a n 1... an m n N} {w m+1 w {a; b}, m N}

42 MCFL wn and MCFL MCFL {w 1... w nz nw nz n 1... z 1 w 1 z 0 w r 1... w r n n N, w i {c; d} +, z 0,..., z n D 1 } Staudacher 1993 Michaelis 2005 MCFL wn {a n 1... an m n N} {w m+1 w {a; b}, m N} {w#w#w w D 1 } Engelfriet, Skyum 1976

43 MCFL wn and MCFL MCFL {w 1... w nz nw nz n 1... z 1 w 1 z 0 w r 1... w r n n N, w i {c; d} +, z 0,..., z n D 1 } Staudacher 1993 Michaelis 2005 MCFL wn {a n 1... an m n N} {w m+1 w {a; b}, m N} {w#w#w w D 1 } Engelfriet, Skyum 1976 {w#w w D 1 } Kanazawa, S. 2010

44 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

45 A 2-MCFG for O 2 S(xy) Inv(x, y) Inv(x 1 y 1, y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 y 1 y 2, x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 x 2 y 1, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, x 2 y 1 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(αx 1 α, x 2 ) Inv(x 1, x 2 ) Inv(αx 1, αx 2 ) Inv(x 1, x 2 ) Inv(αx 1, x 2 α) Inv(x 1, x 2 ) Inv(x 1 α, αx 2 ) Inv(x 1, x 2 ) Inv(x 1 α, x 2 α) Inv(x 1, x 2 ) Inv(x 1, αx 2 α) Inv(x 1, x 2 ) Inv(x 1 y 1 x 2, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(ɛ, ɛ) where α {a; b}

46 A 2-MCFG for O 2 S(xy) Inv(x, y) Inv(x 1 y 1, y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 y 1 y 2, x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 x 2 y 1, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, x 2 y 1 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(αx 1 α, x 2 ) Inv(x 1, x 2 ) Inv(αx 1, αx 2 ) Inv(x 1, x 2 ) Inv(αx 1, x 2 α) Inv(x 1, x 2 ) Inv(x 1 α, αx 2 ) Inv(x 1, x 2 ) Inv(x 1 α, x 2 α) Inv(x 1, x 2 ) Inv(x 1, αx 2 α) Inv(x 1, x 2 ) Inv(x 1 y 1 x 2, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(ɛ, ɛ) well-nested binary rules non well-nested rules where α {a; b}

47 A 2-MCFG for O 2 S(xy) Inv(x, y) Inv(x 1 y 1, y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 y 1 y 2, x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 x 2 y 1, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, x 2 y 1 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(αx 1 α, x 2 ) Inv(x 1, x 2 ) Inv(αx 1, αx 2 ) Inv(x 1, x 2 ) Inv(αx 1, x 2 α) Inv(x 1, x 2 ) Inv(x 1 α, αx 2 ) Inv(x 1, x 2 ) Inv(x 1 α, x 2 α) Inv(x 1, x 2 ) Inv(x 1, αx 2 α) Inv(x 1, x 2 ) Inv(x 1 y 1 x 2, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(ɛ, ɛ) well-nested binary rules rules for constants non well-nested rules where α {a; b}

48 A 2-MCFG for O 2 S(xy) Inv(x, y) Inv(x 1 y 1, y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 y 1 y 2, x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1 x 2 y 1, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, x 2 y 1 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(αx 1 α, x 2 ) Inv(x 1, x 2 ) Inv(αx 1, αx 2 ) Inv(x 1, x 2 ) Inv(αx 1, x 2 α) Inv(x 1, x 2 ) Inv(x 1 α, αx 2 ) Inv(x 1, x 2 ) Inv(x 1 α, x 2 α) Inv(x 1, x 2 ) Inv(x 1, αx 2 α) Inv(x 1, x 2 ) Inv(x 1 y 1 x 2, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(ɛ, ɛ) terminal rule well-nested binary rules rules for constants non well-nested rules initial rule where α {a; b} Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable.

49 A graphical interpretation of O 2. Graphical interpretation of the word aaabaabaabbbbbaabbabbbbaaaabbbbbbbbaaa:

50 A graphical interpretation of O 2. Graphical interpretation of the word aaabaabaabbbbbaabbabbbbaaaabbbbbbbbaaa: The words in O 2 are precisely the words that are represented as closed curves: babbababbabbabbababbaaabbbabbaaaabbabbbaba

51 Parsing with the grammar Rule Inv(ax 1 a, x 2 ) Inv(x 1, x 2 ) Inv(abaabaaababbbabaaabbbabbbbaaaba, babbbbaaaaaababbaab) Inv(baabaaababbbabaaabbbabbbbaaab, babbbbaaaaaababbaab)

52 Parsing with the grammar Rule: Inv(x 1 y 1, y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(baabaaababbbabaaabbbabbbbaaab, babbbbaaaaaababbaab) Inv(bbbabaaabbbabbbbaaab, babbbbaaaaaaba) Inv(baabaaaba, bbaab)

53 Parsing with the grammar Rule Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(bbbabaaabbbabbbbaaab, babbbbaaaaaaba) Inv(bbbabaaabbbabbbbaaab, bbaaaaaa) Inv(babb, ba)

54 Parsing with the grammar Rule: Inv(x 1 b, bx 2 ) Inv(x 1, x 2 ) Inv(bbbabaaabbbabbbbaaab, bbaaaaaa) Inv(bbbabaaabbbabbbbaaa, baaaaaa)

55 Parsing with the grammar Rule: Inv(bx 1, bx 2 ) Inv(x 1, x 2 ) Inv(bbbabaaabbbabbbbaaa, baaaaaa) Inv(bbabaaabbbabbbbaaa, aaaaaa)

56 Parsing with the grammar Rule: Inv(x 1 y 1, y 2 x 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(bbabaaabbbabbbbaaa, aaaaaa) Inv(bbabaaabbbabbbb, aaa) Inv(aaa, aaa)

57 Parsing with the grammar Rule: Inv(bx 1 b, x 2 ) Inv(x 1, x 2 ) Inv(bbabaaabbbabbbb, aaa) Inv(babaaabbbabbb, aaa)

58 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

59 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 1: w 1 or w 2 equal ɛ:

60 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 1: w 1 or w 2 equal ɛ: w.l.o.g., w 1 ɛ, then by induction hypothesis, for any v 1 and v 2 different from ɛ such that w 1 = v 1 v 2, Inv(v 1, v 2 ) is derivable then: Inv(v 1, v 2 ) Inv(ɛ, ɛ) Inv(x 1 x 2, y 1 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(v 1 v 2 = w 1, ɛ)

61 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 2: w 1 = s 1 w 1 s 2 and w 2 = s 3 w 2 s 4 and for i, j {1; 2; 3; 4}, s.t. i j, {s i ; s j } {{a; a}; {b; b}}:

62 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 2: w 1 = s 1 w 1 s 2 and w 2 = s 3 w 2 s 4 and for i, j {1; 2; 3; 4}, s.t. i j, {s i ; s j } {{a; a}; {b; b}}: e.g., if i = 1, j = 2, s 1 = a and s 2 = a then by induction hypothesis Inv(w 1, w 2) is derivable and: Inv(w 1, w 2) Inv(ax 1 a, x 2 ) Inv(x 1, x 2 ) Inv(aw 1 a, w 2)

63 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 3: the curves representing w 1 and w 2 have a non-trivial intersection point:

64 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 3: the curves representing w 1 and w 2 have a non-trivial intersection point: v 1 v 3 A B w 1 w 2 Inv(v 1, v 4 ) Inv(v 2, v 3 ) Inv(v 1 v 2 = w 1, v 3 v 4 = w 2 ) v 4 v 2

65 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 4: the curve representing w 1 or w 2 starts or ends with a loop:

66 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 4: the curve representing w 1 or w 2 starts or ends with a loop: v 1 v 2 Inv(v 1, ɛ) Inv(v 2, w 2 ) Inv(v 1 v 2 = w 1, w 2 )

67 The proof of the Theorem Theorem: Given w 1 and w 2 such that w 1 w 2 O 2, Inv(w 1, w 2 ) is derivable. The proof is done by induction on the lexicographically ordered pairs ( w 1 w 2, max( w 1, w 2 )). There are five cases: Case 5: w 1 and w 2 do not start or end with compatible letters, the curve representing then do not intersect and do not start or end with a loop.

68 Case 5 No rule other than Inv(x 1 y 1 x 2, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) can be used.

69 Case 5 No rule other than Inv(x 1 y 1 x 2, y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) Inv(x 1, y 1 x 2 y 2 ) Inv(x 1, x 2 ), Inv(y 1, y 2 ) can be used.

70 The relevance of case 5 The word abbaabaaabbbbaaaba is not in the language of the grammar only containing the well-nested rules.

71

72

73 The relevance of case 5: a proof is now in hand Joshi (1985) [MIX ] represents the extreme case of the degree of free word order permitted in a language. This extreme case is linguistically not relevant. [... ] TAGs also cannot generate this language although for TAGs the proof is not in hand yet. Theorem (Kanazawa, S. 12) There is no 2-MCFL wn (or TAG) generating MIX or O 2.

74 Solving case 5: towards geometry

75 Solving case 5: towards geometry

76 Solving case 5: towards geometry

77 Solving case 5: towards geometry

78 Solving case 5: a geometrical invariant

79 Solving case 5: a geometrical invariant

80 Solving case 5: a geometrical invariant An invariant on the Jordan curve representing w 1 w 2 : w 1 = aw 1 a and w 2 = aw 2 a w 1 = aw 1 a and w 2 = aw 2 b w 1 = aw 1 a and w 2 = bw 2 a w 1 = aw 1 a and w 2 = bw 2 b

81 Solving case 5: a geometrical invariant An invariant on the Jordan curve representing w 1 w 2 : w 1 = aw 1 b and w 2 = aw 2 b w 1 = aw 1 b and w 2 = bw 2 a w 1 = aw 1 a and w 2 = a w 1 = aw 1 a and w 2 = b

82 Solving case 5: a geometrical invariant An invariant on the Jordan curve representing w 1 w 2 : w 1 = aw 1 b and w 2 = a w 1 = aw 1 b and w 2 = b

83 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

84 Jordan curves illustration from: A combinatorial introduction to topology by Michael Henle (Dover Publications).

85 A theorem on Jordan curves Theorem: If A and D are two points on a Jordan curve J such that there are two points A and D inside J such that AD = A D, then there are two points B and C pairwise distinct from A and D such that A, B, C, and D appear in that order on one of the arcs going from A to D and AD = BC. A D A D

86 A theorem on Jordan curves Theorem: If A and D are two points on a Jordan curve J such that there are two points A and D inside J such that AD = A D, then there are two points B and C pairwise distinct from A and D such that A, B, C, and D appear in that order on one of the arcs going from A to D and AD = BC. A D A D

87 A theorem on Jordan curves Theorem: If A and D are two points on a Jordan curve J such that there are two points A and D inside J such that AD = A D, then there are two points B and C pairwise distinct from A and D such that A, B, C, and D appear in that order on one of the arcs going from A to D and AD = BC. B C A D A D F E G H

88 A theorem on Jordan curves Theorem: If A and D are two points on a Jordan curve J such that there are two points A and D inside J such that AD = A D, then there are two points B and C pairwise distinct from A and D such that A, B, C, and D appear in that order on one of the arcs going from A to D and AD = BC. Applying this Theorem solves case 5.

89 A theorem on Jordan curves Theorem: If A and D are two points on a Jordan curve J such that there are two points A and D inside J such that AD = A D, then there are two points B and C pairwise distinct from A and D such that A, B, C, and D appear in that order on one of the arcs going from A to D and AD = BC. Applying this Theorem solves case 5.

90 A theorem on Jordan curves Theorem: If A and D are two points on a Jordan curve J such that there are two points A and D inside J such that AD = A D, then there are two points B and C pairwise distinct from A and D such that A, B, C, and D appear in that order on one of the arcs going from A to D and AD = BC. Applying this Theorem solves case 5.

91 Winding number Let wn(j, z) be the winding number of a closed curve around z. illustration from: A combinatorial introduction to topology by Michael Henle (Dover Publications).

92 An interesting Lemma Let exp : { C C {0} z e 2iπz. Lemma Given an simple arc AB such that AB = k N, we have: wn(exp( AB), 0) = k

93 Translation becomes rotation { C C {0} exp : z e 2iπz. B C B, C J I A, D A D I, J G, H O E, F F E G H

94 Translation becomes rotation { C C {0} exp : z e 2iπz. B C B, C J I A, D A D I, J O E, F F E

95 An interesting characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve.

96 Jordan curves and winding numbers illustration from: A combinatorial introduction to topology by Michael Henle (Dover Publications). Theorem: There is k { 1; 1} such that the winding number of Jordan curve around a point in its interior is k, its winding number around a point in its exterior is 0.

97 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof

98 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof by 1-periodicity of exp, if then exp( AD) is not a Jordan curve, AD contains a proper subarc BC such that AD = BC,

99 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof by 1-periodicity of exp, if then exp( AD) is not a Jordan curve, AD contains a proper subarc BC such that AD = BC, if exp( AD) is not a Jordan curve: take the closed curve C obtained by removing the closed subcurves of exp( AD) that have a negative winding number,

100 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof by 1-periodicity of exp, if then exp( AD) is not a Jordan curve, AD contains a proper subarc BC such that AD = BC, if exp( AD) is not a Jordan curve: take the closed curve C obtained by removing the closed subcurves of exp( AD) that have a negative winding number, take a proper closed subcurve D of C that is minimal for inclusion,

101 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof by 1-periodicity of exp, if then exp( AD) is not a Jordan curve, AD contains a proper subarc BC such that AD = BC, if exp( AD) is not a Jordan curve: take the closed curve C obtained by removing the closed subcurves of exp( AD) that have a negative winding number, take a proper closed subcurve D of C that is minimal for inclusion, D is a Jordan curve winding positively (i.e. once) around 0,

102 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof by 1-periodicity of exp, if then exp( AD) is not a Jordan curve, AD contains a proper subarc BC such that AD = BC, if exp( AD) is not a Jordan curve: take the closed curve C obtained by removing the closed subcurves of exp( AD) that have a negative winding number, take a proper closed subcurve D of C that is minimal for inclusion, D is a Jordan curve winding positively (i.e. once) around 0, D induces a proper subcurve J of exp( AD) whose winding number is 1,

103 Proving the characterization Lemma Given an simple arc AD such that AD = 1, we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Proof by 1-periodicity of exp, if then exp( AD) is not a Jordan curve, AD contains a proper subarc BC such that AD = BC, if exp( AD) is not a Jordan curve: take the closed curve C obtained by removing the closed subcurves of exp( AD) that have a negative winding number, take a proper closed subcurve D of C that is minimal for inclusion, D is a Jordan curve winding positively (i.e. once) around 0, D induces a proper subcurve J of exp( AD) whose winding number is 1, J induces a proper subarc BC of exp( AD) such that AD = BC.

104 The characterization on the example { C C {0} exp : z e 2iπz. B C B, C J I A, D A D I, J G, H O E, F F E G H

105 The characterization on the example { C C {0} exp : z e 2iπz. B C B, C J I A, D A D I, J O E, F F E

106 Yet another observation from algebraic topology Let s suppose that { AD = 1 and that A 0 = A = 0, A 1 = D = 1,..., A k = k C C {0} let exp : z e 2iπz. B C B, C J I A, D A 2 A 1 A0 A1 A2 A3 A D I, J G, H O E, F A0, A1 F E G H exp sums up the winding number of a Jordan curve around the A i s as the winding number around exp(a 0 ) = exp(0) = 1.

107 Proving the Theorem Let s suppose that AD = 1, Lemma Given an simple arc AD we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve.

108 Proving the Theorem Let s suppose that AD = 1, Lemma Given an simple arc AD we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Corollary: a simple path J from A to D (resp. D to A) does not contain B and C as required in the Theorem iff ϕ(j) is a Jordan curve of C {1} that winding 0 or 1 (resp. or 1) time around 1.

109 Proving the Theorem Let s suppose that AD = 1, Lemma Given an simple arc AD we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Corollary: a simple path J from A to D (resp. D to A) does not contain B and C as required in the Theorem iff ϕ(j) is a Jordan curve of C {1} that winding 0 or 1 (resp. or 1) time around 1. Corollary: if J is a simple closed curve of C composed with two curves J 1 and J 2 respectively going from A to D and D to A which do not contain points B and C as required in the Theorem then wn(exp(j), 1) = wn(exp(j 1 ), 1) + wn(ϕ(j 2 ), 1) 1.

110 Proving the Theorem Let s suppose that AD = 1, Lemma Given an simple arc AD we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Corollary: a simple path J from A to D (resp. D to A) does not contain B and C as required in the Theorem iff ϕ(j) is a Jordan curve of C {1} that winding 0 or 1 (resp. or 1) time around 1. Corollary: if J is a simple closed curve of C composed with two curves J 1 and J 2 respectively going from A to D and D to A which do not contain points B and C as required in the Theorem then wn(exp(j), 1) = wn(exp(j 1 ), 1) + wn(ϕ(j 2 ), 1) 1. Lemma: if J is a simple closed curve of C composed with two curves J 1 and J 2 respectively going from A to D and D to A such that 0 and 1 are in the interior of J, then wn(ϕ(j), 1) 2.

111 Proving the Theorem Let s suppose that AD = 1, Lemma Given an simple arc AD we have: AD contains a proper subarc BC such that AD = BC iff exp( AD) is not a Jordan curve. Corollary: a simple path J from A to D (resp. D to A) does not contain B and C as required in the Theorem iff ϕ(j) is a Jordan curve of C {1} that winding 0 or 1 (resp. or 1) time around 1. Corollary: if J is a simple closed curve of C composed with two curves J 1 and J 2 respectively going from A to D and D to A which do not contain points B and C as required in the Theorem then wn(exp(j), 1) = wn(exp(j 1 ), 1) + wn(ϕ(j 2 ), 1) 1. Lemma: if J is a simple closed curve of C composed with two curves J 1 and J 2 respectively going from A to D and D to A such that 0 and 1 are in the interior of J, then wn(ϕ(j), 1) 2. The Theorem follows by contradiction.

112 Outline The group language of Z 2 A similar problem in computational linguistics Multiple Context Free Grammars (MCFGs) A grammar for O 2 Proof of the Theorem A Theorem on Jordan curves Conjectures

113 Nederhof s conjecture Nederhof (2016) Conjecture: for every k, O k = {w {a 1, a 1..., a k, a k } 1 i k, w ai = w ai } is generated by the grammar with rules of the form: S(x 1... x k ) Inv(x 1,..., x k ) Inv(s 1,..., s k ) Inv(x 1,..., x k ), Inv(y 1,..., y k ) s 1... s k perm(x 1... x k y 1... y k ) Inv(x 1,..., αx i,..., αx j,..., x k ) Inv(x 1,..., x k ). Inv(ɛ,..., ɛ)

114 Status of the conjecture Positive arguments The conjecture has been tested on millions of examples

115 Status of the conjecture Positive arguments The conjecture has been tested on millions of examples In the case of Z 3, some cases can be solved using braiding arguments Negative argument

116 Status of the conjecture Positive arguments The conjecture has been tested on millions of examples In the case of Z 3, some cases can be solved using braiding arguments Negative argument for the case of Z 2 many arguments are strongly related to planarity no clear way of generalizing to higher dimensions

Multiple Context-free Grammars

Multiple Context-free Grammars Multiple Context-free Grammars Course 4: pumping properties Sylvain Salvati INRI Bordeaux Sud-Ouest ESSLLI 2011 The pumping Lemma for CFL Outline The pumping Lemma for CFL Weak pumping Lemma for MCFL No

More information

MIX is a 2-MCFL and the word problem in Z 2 is solved by a third-order collapsible pushdown automaton

MIX is a 2-MCFL and the word problem in Z 2 is solved by a third-order collapsible pushdown automaton MIX is a 2-MCFL and the word problem in Z 2 is solved by a third-order collapsible pushdown automaton Sylvain Salvati To cite this version: Sylvain Salvati. MIX is a 2-MCFL and the word problem in Z 2

More information

MIX Is Not a Tree-Adjoining Language

MIX Is Not a Tree-Adjoining Language MIX Is Not a Tree-Adjoining Language Makoto Kanazawa National Institute of Informatics 2 1 2 Hitotsubashi, Chiyoda-ku Tokyo, 101 8430, Japan kanazawa@nii.ac.jp Sylvain Salvati INRIA Bordeaux Sud-Ouest,

More information

LCFRS Exercises and solutions

LCFRS Exercises and solutions LCFRS Exercises and solutions Laura Kallmeyer SS 2010 Question 1 1. Give a CFG for the following language: {a n b m c m d n n > 0, m 0} 2. Show that the following language is not context-free: {a 2n n

More information

Multiple Context-Free Grammars

Multiple Context-Free Grammars Ogden s Lemma, Multiple Context-Free Grammars, and the Control Language Hierarchy Makoto Kanazawa National Institute of Informatics and SOKENDAI Japan Multiple Context-Free Grammars Introduced by Seki,

More information

Well-Nestedness Properly Subsumes Strict Derivational Minimalism

Well-Nestedness Properly Subsumes Strict Derivational Minimalism A revised version is to appear in: S. Pogodalla and J.-P. Prost (eds.), Logical Aspects of Computational Linguistics (LACL 2011), Lecture Notes in Artificial Intelligence Vol. 6736, pp. 112-128, Springer,

More information

A short proof that O 2 is an MCFL

A short proof that O 2 is an MCFL A short proof that O 2 is an MCFL Mark-Jan Nederhof School of Computer Science University of St Andrews, UK Astract We present a new proof that O 2 is a multiple context-free language. It contrasts with

More information

Solutions to Problem Set 3

Solutions to Problem Set 3 V22.0453-001 Theory of Computation October 8, 2003 TA: Nelly Fazio Solutions to Problem Set 3 Problem 1 We have seen that a grammar where all productions are of the form: A ab, A c (where A, B non-terminals,

More information

Finite Automata and Formal Languages TMV026/DIT321 LP Useful, Useless, Generating and Reachable Symbols

Finite Automata and Formal Languages TMV026/DIT321 LP Useful, Useless, Generating and Reachable Symbols Finite Automata and Formal Languages TMV026/DIT321 LP4 2012 Lecture 13 Ana Bove May 7th 2012 Overview of today s lecture: Normal Forms for Context-Free Languages Pumping Lemma for Context-Free Languages

More information

Multiple Context Free Grammars

Multiple Context Free Grammars Multiple Context Free Grammars Siddharth Krishna September 14, 2013 Abstract Multiple context-free grammars (MCFGs) are a generalization of context-free grammars that deals with tuples of strings. This

More information

Ogden s Lemma, Multiple Context-Free Grammars, and the Control Language Hierarchy

Ogden s Lemma, Multiple Context-Free Grammars, and the Control Language Hierarchy Ogden s Lemma, Multiple Context-Free Grammars, and the Control Language Hierarchy Makoto Kanazawa? National Institute of Informatics and SOKENDAI, 2 1 2 Hitotsubashi, Chiyoda-ku, Tokyo, 101 8430, Japan

More information

Introduction to Theory of Computing

Introduction to Theory of Computing CSCI 2670, Fall 2012 Introduction to Theory of Computing Department of Computer Science University of Georgia Athens, GA 30602 Instructor: Liming Cai www.cs.uga.edu/ cai 0 Lecture Note 3 Context-Free Languages

More information

Tree Adjoining Grammars

Tree Adjoining Grammars Tree Adjoining Grammars TAG: Parsing and formal properties Laura Kallmeyer & Benjamin Burkhardt HHU Düsseldorf WS 2017/2018 1 / 36 Outline 1 Parsing as deduction 2 CYK for TAG 3 Closure properties of TALs

More information

Computational complexity of commutative grammars

Computational complexity of commutative grammars Computational complexity of commutative grammars Jérôme Kirman Sylvain Salvati Bordeaux I University - LaBRI INRIA October 1, 2013 Free word order Some languages allow free placement of several words or

More information

This lecture covers Chapter 7 of HMU: Properties of CFLs

This lecture covers Chapter 7 of HMU: Properties of CFLs This lecture covers Chapter 7 of HMU: Properties of CFLs Chomsky Normal Form Pumping Lemma for CFs Closure Properties of CFLs Decision Properties of CFLs Additional Reading: Chapter 7 of HMU. Chomsky Normal

More information

This lecture covers Chapter 5 of HMU: Context-free Grammars

This lecture covers Chapter 5 of HMU: Context-free Grammars This lecture covers Chapter 5 of HMU: Context-free rammars (Context-free) rammars (Leftmost and Rightmost) Derivations Parse Trees An quivalence between Derivations and Parse Trees Ambiguity in rammars

More information

Grammars (part II) Prof. Dan A. Simovici UMB

Grammars (part II) Prof. Dan A. Simovici UMB rammars (part II) Prof. Dan A. Simovici UMB 1 / 1 Outline 2 / 1 Length-Increasing vs. Context-Sensitive rammars Theorem The class L 1 equals the class of length-increasing languages. 3 / 1 Length-Increasing

More information

The Pumping Lemma for Context Free Grammars

The Pumping Lemma for Context Free Grammars The Pumping Lemma for Context Free Grammars Chomsky Normal Form Chomsky Normal Form (CNF) is a simple and useful form of a CFG Every rule of a CNF grammar is in the form A BC A a Where a is any terminal

More information

Properties of Context-Free Languages

Properties of Context-Free Languages Properties of Context-Free Languages Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr

More information

Well-Nestedness Properly Subsumes Strict Derivational Minimalism

Well-Nestedness Properly Subsumes Strict Derivational Minimalism Well-Nestedness Properly Subsumes Strict Derivational Minimalism Makoto Kanazawa, Jens Michaelis, Sylvain Salvati, Ryo Yoshinaka To cite this version: Makoto Kanazawa, Jens Michaelis, Sylvain Salvati,

More information

Set Theory. CSE 215, Foundations of Computer Science Stony Brook University

Set Theory. CSE 215, Foundations of Computer Science Stony Brook University Set Theory CSE 215, Foundations of Computer Science Stony Brook University http://www.cs.stonybrook.edu/~cse215 Set theory Abstract set theory is one of the foundations of mathematical thought Most mathematical

More information

Computational Models - Lecture 5 1

Computational Models - Lecture 5 1 Computational Models - Lecture 5 1 Handout Mode Iftach Haitner. Tel Aviv University. November 28, 2016 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice Herlihy, Brown University.

More information

Linear conjunctive languages are closed under complement

Linear conjunctive languages are closed under complement Linear conjunctive languages are closed under complement Alexander Okhotin okhotin@cs.queensu.ca Technical report 2002-455 Department of Computing and Information Science, Queen s University, Kingston,

More information

60-354, Theory of Computation Fall Asish Mukhopadhyay School of Computer Science University of Windsor

60-354, Theory of Computation Fall Asish Mukhopadhyay School of Computer Science University of Windsor 60-354, Theory of Computation Fall 2013 Asish Mukhopadhyay School of Computer Science University of Windsor Pushdown Automata (PDA) PDA = ε-nfa + stack Acceptance ε-nfa enters a final state or Stack is

More information

Fundamentele Informatica II

Fundamentele Informatica II Fundamentele Informatica II Answer to selected exercises 5 John C Martin: Introduction to Languages and the Theory of Computation M.M. Bonsangue (and J. Kleijn) Fall 2011 5.1.a (q 0, ab, Z 0 ) (q 1, b,

More information

Introduction to Automata

Introduction to Automata Introduction to Automata Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr 1 /

More information

Non-context-Free Languages. CS215, Lecture 5 c

Non-context-Free Languages. CS215, Lecture 5 c Non-context-Free Languages CS215, Lecture 5 c 2007 1 The Pumping Lemma Theorem. (Pumping Lemma) Let be context-free. There exists a positive integer divided into five pieces, Proof for for each, and..

More information

What Is a Language? Grammars, Languages, and Machines. Strings: the Building Blocks of Languages

What Is a Language? Grammars, Languages, and Machines. Strings: the Building Blocks of Languages Do Homework 2. What Is a Language? Grammars, Languages, and Machines L Language Grammar Accepts Machine Strings: the Building Blocks of Languages An alphabet is a finite set of symbols: English alphabet:

More information

Comment: The induction is always on some parameter, and the basis case is always an integer or set of integers.

Comment: The induction is always on some parameter, and the basis case is always an integer or set of integers. 1. For each of the following statements indicate whether it is true or false. For the false ones (if any), provide a counter example. For the true ones (if any) give a proof outline. (a) Union of two non-regular

More information

Movement-Generalized Minimalist Grammars

Movement-Generalized Minimalist Grammars Movet-Generalized Minimalist Grammars Thomas Graf tgraf@ucla.edu tgraf.bol.ucla.edu University of California, Los Angeles LACL 2012 July 2, 2012 Outline 1 Monadic Second-Order Logic (MSO) Talking About

More information

Parsing. Context-Free Grammars (CFG) Laura Kallmeyer. Winter 2017/18. Heinrich-Heine-Universität Düsseldorf 1 / 26

Parsing. Context-Free Grammars (CFG) Laura Kallmeyer. Winter 2017/18. Heinrich-Heine-Universität Düsseldorf 1 / 26 Parsing Context-Free Grammars (CFG) Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Winter 2017/18 1 / 26 Table of contents 1 Context-Free Grammars 2 Simplifying CFGs Removing useless symbols Eliminating

More information

Grammar formalisms Tree Adjoining Grammar: Formal Properties, Parsing. Part I. Formal Properties of TAG. Outline: Formal Properties of TAG

Grammar formalisms Tree Adjoining Grammar: Formal Properties, Parsing. Part I. Formal Properties of TAG. Outline: Formal Properties of TAG Grammar formalisms Tree Adjoining Grammar: Formal Properties, Parsing Laura Kallmeyer, Timm Lichte, Wolfgang Maier Universität Tübingen Part I Formal Properties of TAG 16.05.2007 und 21.05.2007 TAG Parsing

More information

Formal Languages 2: Group Theory

Formal Languages 2: Group Theory 2: Group Theory Matilde Marcolli CS101: Mathematical and Computational Linguistics Winter 2015 Group G, with presentation G = X R (finitely presented) X (finite) set of generators x 1,..., x N R (finite)

More information

Epsilon-Free Grammars and Lexicalized Grammars that Generate the Class of the Mildly Context-Sensitive Languages

Epsilon-Free Grammars and Lexicalized Grammars that Generate the Class of the Mildly Context-Sensitive Languages psilon-free rammars and Leicalized rammars that enerate the Class of the Mildly Contet-Sensitive Languages Akio FUJIYOSHI epartment of Computer and Information Sciences, Ibaraki University 4-12-1 Nakanarusawa,

More information

Section Summary. Relations and Functions Properties of Relations. Combining Relations

Section Summary. Relations and Functions Properties of Relations. Combining Relations Chapter 9 Chapter Summary Relations and Their Properties n-ary Relations and Their Applications (not currently included in overheads) Representing Relations Closures of Relations (not currently included

More information

Context-Free Grammars: Normal Forms

Context-Free Grammars: Normal Forms Context-Free Grammars: Normal Forms Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr

More information

SCHEME FOR INTERNAL ASSESSMENT TEST 3

SCHEME FOR INTERNAL ASSESSMENT TEST 3 SCHEME FOR INTERNAL ASSESSMENT TEST 3 Max Marks: 40 Subject& Code: Automata Theory & Computability (15CS54) Sem: V ISE (A & B) Note: Answer any FIVE full questions, choosing one full question from each

More information

Warshall s algorithm

Warshall s algorithm Regular Expressions [1] Warshall s algorithm See Floyd-Warshall algorithm on Wikipedia The Floyd-Warshall algorithm is a graph analysis algorithm for finding shortest paths in a weigthed, directed graph

More information

Computational Models - Lecture 4 1

Computational Models - Lecture 4 1 Computational Models - Lecture 4 1 Handout Mode Iftach Haitner. Tel Aviv University. November 21, 2016 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice Herlihy, Brown University.

More information

Properties of Context-free Languages. Reading: Chapter 7

Properties of Context-free Languages. Reading: Chapter 7 Properties of Context-free Languages Reading: Chapter 7 1 Topics 1) Simplifying CFGs, Normal forms 2) Pumping lemma for CFLs 3) Closure and decision properties of CFLs 2 How to simplify CFGs? 3 Three ways

More information

06 From Propositional to Predicate Logic

06 From Propositional to Predicate Logic Martin Henz February 19, 2014 Generated on Wednesday 19 th February, 2014, 09:48 1 Syntax of Predicate Logic 2 3 4 5 6 Need for Richer Language Predicates Variables Functions 1 Syntax of Predicate Logic

More information

On rigid NL Lambek grammars inference from generalized functor-argument data

On rigid NL Lambek grammars inference from generalized functor-argument data 7 On rigid NL Lambek grammars inference from generalized functor-argument data Denis Béchet and Annie Foret Abstract This paper is concerned with the inference of categorial grammars, a context-free grammar

More information

FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY

FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY 15-453 FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Chomsky Normal Form and TURING MACHINES TUESDAY Feb 4 CHOMSKY NORMAL FORM A context-free grammar is in Chomsky normal form if every rule is of the form:

More information

Computational Models - Lecture 4 1

Computational Models - Lecture 4 1 Computational Models - Lecture 4 1 Handout Mode Iftach Haitner and Yishay Mansour. Tel Aviv University. April 3/8, 2013 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice

More information

Parsing. Probabilistic CFG (PCFG) Laura Kallmeyer. Winter 2017/18. Heinrich-Heine-Universität Düsseldorf 1 / 22

Parsing. Probabilistic CFG (PCFG) Laura Kallmeyer. Winter 2017/18. Heinrich-Heine-Universität Düsseldorf 1 / 22 Parsing Probabilistic CFG (PCFG) Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Winter 2017/18 1 / 22 Table of contents 1 Introduction 2 PCFG 3 Inside and outside probability 4 Parsing Jurafsky

More information

Theory of Computation

Theory of Computation Theory of Computation (Feodor F. Dragan) Department of Computer Science Kent State University Spring, 2018 Theory of Computation, Feodor F. Dragan, Kent State University 1 Before we go into details, what

More information

CS481F01 Prelim 2 Solutions

CS481F01 Prelim 2 Solutions CS481F01 Prelim 2 Solutions A. Demers 7 Nov 2001 1 (30 pts = 4 pts each part + 2 free points). For this question we use the following notation: x y means x is a prefix of y m k n means m n k For each of

More information

Computational Models - Lecture 3

Computational Models - Lecture 3 Slides modified by Benny Chor, based on original slides by Maurice Herlihy, Brown University. p. 1 Computational Models - Lecture 3 Equivalence of regular expressions and regular languages (lukewarm leftover

More information

Packet #2: Set Theory & Predicate Calculus. Applied Discrete Mathematics

Packet #2: Set Theory & Predicate Calculus. Applied Discrete Mathematics CSC 224/226 Notes Packet #2: Set Theory & Predicate Calculus Barnes Packet #2: Set Theory & Predicate Calculus Applied Discrete Mathematics Table of Contents Full Adder Information Page 1 Predicate Calculus

More information

Peano Arithmetic. CSC 438F/2404F Notes (S. Cook) Fall, Goals Now

Peano Arithmetic. CSC 438F/2404F Notes (S. Cook) Fall, Goals Now CSC 438F/2404F Notes (S. Cook) Fall, 2008 Peano Arithmetic Goals Now 1) We will introduce a standard set of axioms for the language L A. The theory generated by these axioms is denoted PA and called Peano

More information

cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska

cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska LECTURE 1 Course Web Page www3.cs.stonybrook.edu/ cse303 The webpage contains: lectures notes slides; very detailed solutions to

More information

0 Sets and Induction. Sets

0 Sets and Induction. Sets 0 Sets and Induction Sets A set is an unordered collection of objects, called elements or members of the set. A set is said to contain its elements. We write a A to denote that a is an element of the set

More information

Parsing Beyond Context-Free Grammars: Tree Adjoining Grammars

Parsing Beyond Context-Free Grammars: Tree Adjoining Grammars Parsing Beyond Context-Free Grammars: Tree Adjoining Grammars Laura Kallmeyer & Tatiana Bladier Heinrich-Heine-Universität Düsseldorf Sommersemester 2018 Kallmeyer, Bladier SS 2018 Parsing Beyond CFG:

More information

Chapter 6. Properties of Regular Languages

Chapter 6. Properties of Regular Languages Chapter 6 Properties of Regular Languages Regular Sets and Languages Claim(1). The family of languages accepted by FSAs consists of precisely the regular sets over a given alphabet. Every regular set is

More information

Definition: A binary relation R from a set A to a set B is a subset R A B. Example:

Definition: A binary relation R from a set A to a set B is a subset R A B. Example: Chapter 9 1 Binary Relations Definition: A binary relation R from a set A to a set B is a subset R A B. Example: Let A = {0,1,2} and B = {a,b} {(0, a), (0, b), (1,a), (2, b)} is a relation from A to B.

More information

FORMAL LANGUAGES, AUTOMATA AND COMPUTATION

FORMAL LANGUAGES, AUTOMATA AND COMPUTATION FORMAL LANGUAGES, AUTOMATA AND COMPUTATION DECIDABILITY ( LECTURE 15) SLIDES FOR 15-453 SPRING 2011 1 / 34 TURING MACHINES-SYNOPSIS The most general model of computation Computations of a TM are described

More information

Chomsky Normal Form and TURING MACHINES. TUESDAY Feb 4

Chomsky Normal Form and TURING MACHINES. TUESDAY Feb 4 Chomsky Normal Form and TURING MACHINES TUESDAY Feb 4 CHOMSKY NORMAL FORM A context-free grammar is in Chomsky normal form if every rule is of the form: A BC A a S ε B and C aren t start variables a is

More information

1 Introduction to Predicate Resolution

1 Introduction to Predicate Resolution 1 Introduction to Predicate Resolution The resolution proof system for Predicate Logic operates, as in propositional case on sets of clauses and uses a resolution rule as the only rule of inference. The

More information

What we have done so far

What we have done so far What we have done so far DFAs and regular languages NFAs and their equivalence to DFAs Regular expressions. Regular expressions capture exactly regular languages: Construct a NFA from a regular expression.

More information

{a, b, c} {a, b} {a, c} {b, c} {a}

{a, b, c} {a, b} {a, c} {b, c} {a} Section 4.3 Order Relations A binary relation is an partial order if it transitive and antisymmetric. If R is a partial order over the set S, we also say, S is a partially ordered set or S is a poset.

More information

Harvard CS 121 and CSCI E-207 Lecture 12: General Context-Free Recognition

Harvard CS 121 and CSCI E-207 Lecture 12: General Context-Free Recognition Harvard CS 121 and CSCI E-207 Lecture 12: General Context-Free Recognition Salil Vadhan October 11, 2012 Reading: Sipser, Section 2.3 and Section 2.1 (material on Chomsky Normal Form). Pumping Lemma for

More information

An Additional Observation on Strict Derivational Minimalism

An Additional Observation on Strict Derivational Minimalism 10 An Additional Observation on Strict Derivational Minimalism Jens Michaelis Abstract We answer a question which, so far, was left an open problem: does in terms of derivable string languages the type

More information

Philippe Flajolet & Analytic Combinatorics: Inherent Ambiguity of Context-Free Languages

Philippe Flajolet & Analytic Combinatorics: Inherent Ambiguity of Context-Free Languages Philippe Flajolet & Analytic Combinatorics: Inherent Ambiguity of Context-Free Languages Frédérique Bassino and Cyril Nicaud LIGM, Université Paris-Est & CNRS December 16, 2011 I first met Philippe in

More information

Music as a Formal Language

Music as a Formal Language Music as a Formal Language Finite-State Automata and Pd Bryan Jurish moocow@ling.uni-potsdam.de Universität Potsdam, Institut für Linguistik, Potsdam, Germany pd convention 2004 / Jurish / Music as a formal

More information

Geometric Constraints II

Geometric Constraints II Geometric Constraints II Realizability, Rigidity and Related theorems. Embeddability of Metric Spaces Section 1 Given the matrix D d i,j 1 i,j n corresponding to a metric space, give conditions under which

More information

Computability and Complexity

Computability and Complexity Computability and Complexity Push-Down Automata CAS 705 Ryszard Janicki Department of Computing and Software McMaster University Hamilton, Ontario, Canada janicki@mcmaster.ca Ryszard Janicki Computability

More information

Fall 1999 Formal Language Theory Dr. R. Boyer. Theorem. For any context free grammar G; if there is a derivation of w 2 from the

Fall 1999 Formal Language Theory Dr. R. Boyer. Theorem. For any context free grammar G; if there is a derivation of w 2 from the Fall 1999 Formal Language Theory Dr. R. Boyer Week Seven: Chomsky Normal Form; Pumping Lemma 1. Universality of Leftmost Derivations. Theorem. For any context free grammar ; if there is a derivation of

More information

How to write proofs - II

How to write proofs - II How to write proofs - II Problem (Ullman and Hopcroft, Page 104, Exercise 4.8). Let G be the grammar Prove that S ab ba A a as baa B b bs abb L(G) = { x {a, b} x contains equal number of a s and b s }.

More information

6.8 The Post Correspondence Problem

6.8 The Post Correspondence Problem 6.8. THE POST CORRESPONDENCE PROBLEM 423 6.8 The Post Correspondence Problem The Post correspondence problem (due to Emil Post) is another undecidable problem that turns out to be a very helpful tool for

More information

Context-Free and Noncontext-Free Languages

Context-Free and Noncontext-Free Languages Examples: Context-Free and Noncontext-Free Languages a*b* is regular. A n B n = {a n b n : n 0} is context-free but not regular. A n B n C n = {a n b n c n : n 0} is not context-free The Regular and the

More information

Exam: Synchronous Grammars

Exam: Synchronous Grammars Exam: ynchronous Grammars Duration: 3 hours Written documents are allowed. The numbers in front of questions are indicative of hardness or duration. ynchronous grammars consist of pairs of grammars whose

More information

A Very Elementary Proof of a Conjecture of B. and M. Shapiro for Cubic Rational Functions

A Very Elementary Proof of a Conjecture of B. and M. Shapiro for Cubic Rational Functions A Very Elementary Proof of a Conjecture of B. and M. Shapiro for Cubic Rational Functions Xander Faber and Bianca Thompson* Smith College January 2016 K = field with characteristic 0 K = algebraic closure

More information

arxiv: v2 [cs.fl] 29 Nov 2013

arxiv: v2 [cs.fl] 29 Nov 2013 A Survey of Multi-Tape Automata Carlo A. Furia May 2012 arxiv:1205.0178v2 [cs.fl] 29 Nov 2013 Abstract This paper summarizes the fundamental expressiveness, closure, and decidability properties of various

More information

Mildly Context-Sensitive Grammar Formalisms: Embedded Push-Down Automata

Mildly Context-Sensitive Grammar Formalisms: Embedded Push-Down Automata Mildly Context-Sensitive Grammar Formalisms: Embedded Push-Down Automata Laura Kallmeyer Heinrich-Heine-Universität Düsseldorf Sommersemester 2011 Intuition (1) For a language L, there is a TAG G with

More information

Chapter 1. Formal Definition and View. Lecture Formal Pushdown Automata on the 28th April 2009

Chapter 1. Formal Definition and View. Lecture Formal Pushdown Automata on the 28th April 2009 Chapter 1 Formal and View Lecture on the 28th April 2009 Formal of PA Faculty of Information Technology Brno University of Technology 1.1 Aim of the Lecture 1 Define pushdown automaton in a formal way

More information

Context-free Grammars and Languages

Context-free Grammars and Languages Context-free Grammars and Languages COMP 455 002, Spring 2019 Jim Anderson (modified by Nathan Otterness) 1 Context-free Grammars Context-free grammars provide another way to specify languages. Example:

More information

CS481F01 Solutions 6 PDAS

CS481F01 Solutions 6 PDAS CS481F01 Solutions 6 PDAS A. Demers 2 November 2001 1. Give a NPDAs that recognize the following languages: (a) The set of all strings in {0, 1} that contain twice as many 1s as 0s. (answer a) We build

More information

Lecture Notes 1 Basic Concepts of Mathematics MATH 352

Lecture Notes 1 Basic Concepts of Mathematics MATH 352 Lecture Notes 1 Basic Concepts of Mathematics MATH 352 Ivan Avramidi New Mexico Institute of Mining and Technology Socorro, NM 87801 June 3, 2004 Author: Ivan Avramidi; File: absmath.tex; Date: June 11,

More information

Plan for 2 nd half. Just when you thought it was safe. Just when you thought it was safe. Theory Hall of Fame. Chomsky Normal Form

Plan for 2 nd half. Just when you thought it was safe. Just when you thought it was safe. Theory Hall of Fame. Chomsky Normal Form Plan for 2 nd half Pumping Lemma for CFLs The Return of the Pumping Lemma Just when you thought it was safe Return of the Pumping Lemma Recall: With Regular Languages The Pumping Lemma showed that if a

More information

Predicate Calculus - Semantics 1/4

Predicate Calculus - Semantics 1/4 Predicate Calculus - Semantics 1/4 Moonzoo Kim CS Dept. KAIST moonzoo@cs.kaist.ac.kr 1 Introduction to predicate calculus (1/2) Propositional logic (sentence logic) dealt quite satisfactorily with sentences

More information

Chap. 7 Properties of Context-free Languages

Chap. 7 Properties of Context-free Languages Chap. 7 Properties of Context-free Languages 7.1 Normal Forms for Context-free Grammars Context-free grammars A where A N, (N T). 0. Chomsky Normal Form A BC or A a except S where A, B, C N, a T. 1. Eliminating

More information

Computational Models - Lecture 5 1

Computational Models - Lecture 5 1 Computational Models - Lecture 5 1 Handout Mode Iftach Haitner and Yishay Mansour. Tel Aviv University. April 10/22, 2013 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice

More information

CS 275 Automata and Formal Language Theory. Proof of Lemma II Lemma (II )

CS 275 Automata and Formal Language Theory. Proof of Lemma II Lemma (II ) CS 275 Automata and Formal Language Theory Course Notes Part II: The Recognition Problem (II) Additional Material Sect II.2.: Basics of Regular Languages and Expressions Anton Setzer (Based on a book draft

More information

Final exam study sheet for CS3719 Turing machines and decidability.

Final exam study sheet for CS3719 Turing machines and decidability. Final exam study sheet for CS3719 Turing machines and decidability. A Turing machine is a finite automaton with an infinite memory (tape). Formally, a Turing machine is a 6-tuple M = (Q, Σ, Γ, δ, q 0,

More information

Properties of context-free Languages

Properties of context-free Languages Properties of context-free Languages We simplify CFL s. Greibach Normal Form Chomsky Normal Form We prove pumping lemma for CFL s. We study closure properties and decision properties. Some of them remain,

More information

Lecture 11 Context-Free Languages

Lecture 11 Context-Free Languages Lecture 11 Context-Free Languages COT 4420 Theory of Computation Chapter 5 Context-Free Languages n { a b : n n { ww } 0} R Regular Languages a *b* ( a + b) * Example 1 G = ({S}, {a, b}, S, P) Derivations:

More information

Unambiguous Morphic Images of Strings

Unambiguous Morphic Images of Strings Unambiguous Morphic Images of Strings Daniel Reidenbach, University of Kaiserslautern A joint work with: Dominik D. Freydenberger, University of Kaiserslautern Johannes C. Schneider, University of Kaiserslautern

More information

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Lecture 14 Ana Bove May 14th 2018 Recap: Context-free Grammars Simplification of grammars: Elimination of ǫ-productions; Elimination of

More information

Observation 4.1 G has a proper separation of order 0 if and only if G is disconnected.

Observation 4.1 G has a proper separation of order 0 if and only if G is disconnected. 4 Connectivity 2-connectivity Separation: A separation of G of order k is a pair of subgraphs (H, K) with H K = G and E(H K) = and V (H) V (K) = k. Such a separation is proper if V (H) \ V (K) and V (K)

More information

Kreisel s Conjecture with minimality principle

Kreisel s Conjecture with minimality principle Kreisel s Conjecture with minimality principle Pavel Hrubeš November 9, 2008 Abstract We prove that Kreisel s Conjecture is true, if Peano arithmetic is axiomatised using minimality principle and axioms

More information

Theory of Computation - Module 3

Theory of Computation - Module 3 Theory of Computation - Module 3 Syllabus Context Free Grammar Simplification of CFG- Normal forms-chomsky Normal form and Greibach Normal formpumping lemma for Context free languages- Applications of

More information

Stochastic Finite Learning of Some Mildly Context-Sensitive Languages

Stochastic Finite Learning of Some Mildly Context-Sensitive Languages Stochastic Finite Learning of Some Mildly Context-Sensitive Languages John Case 1, Ryo Yoshinaka 2, and Thomas Zeugmann 3 1 Department of Computer and Information Sciences, University of Delaware case@mail.eecis.udel.edu

More information

THEORY OF COMPUTATION (AUBER) EXAM CRIB SHEET

THEORY OF COMPUTATION (AUBER) EXAM CRIB SHEET THEORY OF COMPUTATION (AUBER) EXAM CRIB SHEET Regular Languages and FA A language is a set of strings over a finite alphabet Σ. All languages are finite or countably infinite. The set of all languages

More information

615, rue du Jardin Botanique. Abstract. In contrast to the case of words, in context-free tree grammars projection rules cannot always be

615, rue du Jardin Botanique. Abstract. In contrast to the case of words, in context-free tree grammars projection rules cannot always be How to Get Rid of Projection Rules in Context-free Tree Grammars Dieter Hofbauer Maria Huber Gregory Kucherov Technische Universit t Berlin Franklinstra e 28/29, FR 6-2 D - 10587 Berlin, Germany e-mail:

More information

Computational Models - Lecture 4

Computational Models - Lecture 4 Computational Models - Lecture 4 Regular languages: The Myhill-Nerode Theorem Context-free Grammars Chomsky Normal Form Pumping Lemma for context free languages Non context-free languages: Examples Push

More information

Problem 1A. Suppose that f is a continuous real function on [0, 1]. Prove that

Problem 1A. Suppose that f is a continuous real function on [0, 1]. Prove that Problem 1A. Suppose that f is a continuous real function on [, 1]. Prove that lim α α + x α 1 f(x)dx = f(). Solution: This is obvious for f a constant, so by subtracting f() from both sides we can assume

More information

HASSE-MINKOWSKI THEOREM

HASSE-MINKOWSKI THEOREM HASSE-MINKOWSKI THEOREM KIM, SUNGJIN 1. Introduction In rough terms, a local-global principle is a statement that asserts that a certain property is true globally if and only if it is true everywhere locally.

More information

Derivational order and ACGs

Derivational order and ACGs Derivational order and ACGs Gregory M. Kobele 1 Jens Michaelis 2 1 University of Chicago, Chicago, USA 2 Bielefeld University, Bielefeld, Germany ACG@10, Bordeaux, December 7 9, 2011 Greg & Jens (Chicago

More information

Parikh s theorem. Håkan Lindqvist

Parikh s theorem. Håkan Lindqvist Parikh s theorem Håkan Lindqvist Abstract This chapter will discuss Parikh s theorem and provide a proof for it. The proof is done by induction over a set of derivation trees, and using the Parikh mappings

More information

APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF

APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF ELEMENTARY LINEAR ALGEBRA WORKBOOK/FOR USE WITH RON LARSON S TEXTBOOK ELEMENTARY LINEAR ALGEBRA CREATED BY SHANNON MARTIN MYERS APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF When you are done

More information