Context-Free Grammar

Transcription

1 Context-Free Grammar CFGs are more powerful than regular expressions. They are more powerful in the sense that whatever can be expressed using regular expressions can be expressed using context-free grammars, but they can also express languages that do not have regular expressions.

2 Context-Free Grammar

3 Example: Context-Free Grammar

4 Example Context-Free Grammar

5 Context-Free Grammar Construct a context free grammar for palindromes containing 0s and 1s.

6 Context-Free Grammar Construct a context free grammar for all integers (with sign) G ={V, Σ, R, S} V = {S, G, D, I}, Σ = {0, 1, 2, 3,., 9, +, -}

7 Derivation Trees

8 Derivation Trees

9 Derivation Trees

10 Derivation Trees

11 Derivation Tree

12 Ambiguity Consider the grammar for arithmetic expressions involving addition and multiplication operators: Consider the sentence ID+ID ID. This can be parsed in two different ways.

13 Ambiguity In the figure, the parse tree to the left gives the addition operator precedence over multiplication. In other words, an expression such as is evaluated as (3+5) 9 with a result of 72. Whereas, the tree to the right, does what is considered the standard practice in programming languages, i.e. giving precedence over +. The previous example would be evaluated as 3+(5 9) resulting in 48. A context free grammar G is ambiguous if there exists some w L(G), which is ambiguous. If G is the grammar Show that G is ambiguous.

14 Ambiguity To prove that G is ambiguous, we need to find a w L(G), which is ambiguous. Consider the word abababa.

15 Ambiguity

16 What about a + a a? Removing Ambiguity

17 Removing Ambiguity

18 Simplification of CFG If G is a CFG, then we can construct a simplified equivalent CFG G with the help of following steps: 1. Eliminate all null productions to get G Eliminate all unit productions in G 1 to get G Construct a reduced Grammar G from G 2.

19 Simplification of CFG 1.Elimination of null productions Let G 1 =(V, Σ,P,S) be the GFG having NO null productions. Consider the Grammar G whose productions are given below. Construct a Grammar G 1 without null productions generating L(G)-{ε}

20 Simplification of CFG Step 1: Construction of the set W of all nullable variables W 1 ={A 1 V A 1 ε is a production in P}={A,B} W i+1 = W i {K V there exists a production K α with α W i * } W 2 ={A,B} {S} as S AB is a production with AB W 1 * = { S,A,B} W 3 = W 2 = W 2 Erasing from RHS Construction of P : D b, S as, S AB, S a, S A, S B.

21 Simplification of CFG 2.Elimination of unit productions A unit production in a context free grammar G is a production of the form A B where A and B are variables(non terminals) in G. For such a variable A the following steps have to be applied: Step1: Construction of the set of variables derivable from A. W 0 (A)={A} W i+1 (A)=W i (A) {B V C B is in P with C W i (A) }

22 Simplification of CFG Step2: Construction of A productions The A-productions in G 2 are either (a) The non unit production in G 1 or (b) A α whenever B α is in G 1 with B W(A) and α V. Now we can define G 2, where P 2 is constructed using step2 for every A V

23 Simplification of CFG Example: Let the productions in G 1 be S AB, A a, B C b, C D, D E and E a W(B)={B,C,D,E}, W(C)={C,D,E}, W(D)={D,E} The productions P 2 in G 2 are: S AB, A a, B a b, C a, D a and E a

24 Simplification of CFG 3.Construction of reduced Grammars: Many productions in P may not be useful for the purpose of derivation. It would be better to eliminate (1) variables that do not derive any terminal string and (2) symbols that are not reachable from the start symbol. If G is a CFG, then we can find an equivalent grammar G such that each variable in G derives some terminal string. Let G2=(V, Σ,P,S). We can define G =(V, Σ,P,S) as follows.

25 a) Construction of V : We define W i V by recursion. Simplification of CFG W 1 ={A V there exists a production A ω where ω Σ*} W i+1 =W i {A V there exists some production A α with α (Σ W i )*} At some point W k =W k+1. Then we get V =W k. b) Construction of P. P ={A α A, α (V Σ)*}

26 Example: Let G be Simplification of CFG S AB, A a, B b, B C, and E c Find G such that every variable in G derives some terminal string. Here we get V ={S,A,B,E}. So P = S AB, A a, B b and E c

27 Simplification of CFG If G=(V, Σ,P,S), we can construct an equivalent grammar G = (V, Σ,P,S) such that every symbol in V Σ is derivable from S. a) Construction of Wi W 1 ={S}. W i+1 =W i {X (V Σ) there exists a production A α with A W i and α containing the symbol X } At some point W k =W k+1. b) Construction of V, Σ, P. V =V W k, Σ = Σ W k, P ={A α A W k }

28 Simplification of CFG Example: Consider G=({S,A,B,E}, {a,b,c},p,s), where P consists of S AB, A a, B b and E c. W 3 ={S,A,B} {a,b} V = {S,A,B}, Σ ={a,b} P = S AB, A a, B b

29 Simplification of CFG Find reduced grammars equivalent to the following 1) S AB CA, B BC AB, A a, C ab b. 2) S aaa, A Sb bcc DaA, C abb DD, E ac, D ada. Answers: 1) S CA, A a, C b 2) S aaa, A Sb bcc, C abb

30 Normal Forms for CFG In a context free grammar, the R.H.S of a production can be any string of variables and terminals. When the production in G satisfy certain restrictions, then G is said to be in a normal form. 1. Chomsky Normal Form(CNF) In CNF we have restrictions on the length of R.H.S and the nature of symbols in the R.H.S A CFG G is said to be in CNF, if every production is of the form A a, or A BC, and S ε. When ε is in L(G) we assume that S does not appear on the R.H.S of any production.

31 Normal Forms for CFG Example: Consider a CFG whose productions are S AB ε, A a, B b Is it in CNF? YES Reduction to CNF Consider an example. Let G be S ABC ac, A a, B b, C c. Except S ABC ac, all other productions are in the form required for CNF. The terminal a in ac can be replaced by a new variable D. By adding a new production D a. So S ac becomes S DC.

32 Normal Forms for CFG S ABC is not in the required form. So it can be replaced by two productions: S AE and E BC. It is important to note that unit productions and null productions are to be removed before substitutions. Elimination of terminals on R.H.S: If there is a terminal a i on the R.H.S of a production, then add a new variable (non terminal) C ai a i Restricting the number of variables on R.H.S: Consider productions of the form A A 1 A 2.A m. We introduce new productions A A 1 C 1, C 1 A 2 C 2,, C m-2 A m-1 A m

33 Example1: Reduce the following grammar G to CNF: S aad, A ab bab, B b, D d. Example2: Reduce the following grammar G to CNF: S aabb, A aa a, B bb b. Normal Forms for CFG Answer: S C a C 1, A C a B C b C 2, C 1 AD, C 2 AB, B b, D d, C a a, C b b. Answer: S C a C 1, C 1 AC 2, C 2 C b B, A C a A, B C b B, C a a, C b b, A a, B b.

34 Normal Forms for CFG Greibach Normal Form(GNF): A grammar is in GNF if every production is of the form A aα, where α V*. And a Σ. S ε is in G, when ε is in L(G) and we assume that S does not appear on the R.H.S of any production. Example: S aab ε, A bc, B b, C c is in GNF.

35 Normal Forms for CFG Lemma1: Let G be a CFG, and A Bλ be a production in P. Assume that P also has the following productions: B β 1 β 2. β s We can define P 1 =(P - {A Bλ}) {A β i λ 1 i s } Then G 1 having P 1 is also a CFG equivalent to G. Example: Consider G with the following productions: A Bab, B aa bb aa AB G 1 which is equivalent to G can be constructed with the following productions. A aaab bbab aaab ABab, B aa bb aa AB

36 Normal Forms for CFG Lemma2: Let G contains productions of the form A Aα 1 Aα 2. Aα r β 1 β 2. β s (β i s do not start with A) Let Z be a new variable in G 1, where P 1 is defined as follows: A β 1 β 2. β s A β 1 Z β 2 Z. β s Z. Z α 1 α 2. α r Z α 1 Z α 2 Z. α r Z Example: Consider G with the following productions: A abd bdb c AB AD

37 Normal Forms for CFG Then G 1, equivalent to G contains the following productions: A abd bdb c A abdz bdbz cz Z B D Z BZ DZ

38 Reduction to GNF Normal Forms for CFG Step1: Check whether the given grammar is in CNF. If not in CNF, make it in CNF. Rename the variables as A 1,A 2,.A n. With S=A 1. Step2: A i productions should be of the form A i A j λ such that i < j. If there are productions of the form A i A i λ, apply Lemma2 to get rid of such productions. Otherwise apply Lemma1. Step3: Modify Z i productions. Apply Lemma1 to eliminate productions of the form Z i A k λ.

39 Normal Forms for CFG Example1: Construct a grammar in GNF equivalent to the grammar: S AA a, A SS b Answer: The given grammar is in CNF. Let S be A 1 and A be A 2. A 1 A 2 A 2 A 1 a A 2 A 1 A 1 A 2 b A 1 productions are in the required form. A 2 b is also in the required form.

40 Apply Lemma1 to A 2 A 1 A 1. Normal Forms for CFG We need to apply Lemma2 to A 2 A 2 A 2 A 1. Let Z 2 be the new variable. Now we can eliminate A 1 A 2 A 2 using Lemma1.

41 We apply Lemma1 to get Normal Forms for CFG

42 Normal Forms for CFG

43 Normal Forms for CFG Example2: Convert the following grammar into GNF. Rename The productions are :

44 Normal Forms for CFG

45 Normal Forms for CFG

46 Normal Forms for CFG