Finite Automata Part One

Size: px

Start display at page:

Download "Finite Automata Part One"

Archibald Powers
6 years ago
Views:

1 Finite Automata Part One

2 Computability Theory

3 What problems can we solve with a computer?

4 What problems can we solve with a computer? What kind of computer?

5 Computers are Messy

6 Computers are Messy

7 Computers are Messy

8 Computers are Messy

9 We need a simpler way of discussing computing machines.

10 An automaton (plural: automata) is a mathematical model of a computing device.

11 Computers are Messy

12 Automata are Clean q q

13 Computers are Messy

14 Automata are Clean q q

15 Computers are Messy

16 Automata are Clean q q

17 Computers are Messy

18 Automata are Clean q q

19 Why Build Models? Mathematical simplicity. It is significantly easier to manipulate our abstract models of computers than it is to manipulate actual computers. Intellectual robustness. If we pick our models correctly, we can make broad, sweeping claims about huge classes of real computers by arguing that they're just special cases of our more general models.

20 Why Build Models? The models of computation we will explore in this class correspond to different conceptions of what a computer could do. Finite automata (next two weeks) are an abstraction of computers with finite resource constraints. Provide upper bounds for the computing machines that we can actually build. Turing machines (later) are an abstraction of computers with unbounded resources. Provide upper bounds for what we could ever hope to accomplish.

21 What problems can we solve with a computer?

22 What problems can we solve with a computer? What is a problem?

23 Problems with Problems Before we can talk about what problems we can solve, we need a formal definition of a problem. We want a definition that corresponds to the problems we want to solve, captures a large class of problems, and is mathematically simple to reason about. No one definition has all three properties.

24 Formal Language Theory

25 Strings An alphabet is a finite, nonempty set of symbols called characters. Typically, we use the symbol Σ to refer to an alphabet. A string over an alphabet Σ is a finite sequence of characters drawn from Σ. Example: If Σ = {a, b}, here are some valid strings over Σ: a aabaaabbabaaabaaaabbb abbababba The empty string has no characters and is denoted ε. Calling attention to an earlier point: since all strings are finite sequences of characters from Σ, you cannot have a string of infinite length.

26 Languages A formal language is a set of strings. We say that L is a language over Σ if it is a set of strings over Σ. Example: The language of palindromes over Σ = {a, b, c} is the set {ε, a, b, c, aa, bb, cc, aaa, aba, aca, bab, } The set of all strings composed from letters in Σ is denoted Σ*. Formally, we say that L is a language over Σ if L Σ*.

27 To Recap Languages are sets of strings, and strings are sequences of characters, and characters are elements of an alphabet.

28 The Model Fundamental Question: For what languages L can you design an automaton that takes as input a string, then decides whether the string is in L? The answer depends on the choice of L, the choice of automaton, and the definition of determines. In answering this question, we ll go through a whirlwind tour of models of computation and see how this seemingly abstract question has very real and powerful consequences.

29 To Summarize An automaton is an idealized mathematical computing machine. A language is a set of strings, a string is a (finite) sequence of characters, and a character is an element of an alphabet. Goal: Figure out in which cases we can build automata for particular languages.

30 What problems can we solve with a computer?

31 Finite Automata

32 A finite automaton is a simple type of mathematical machine for determining whether a string is contained within some language.

33 Each finite automaton consists of a set of states connected by transitions.

34 A Simple Finite Automaton q q

35 A Simple Finite Automaton q q Each Each circle circle represents represents aa state state of of the the automaton. automaton.

36 A Simple Finite Automaton q q

37 A Simple Finite Automaton q q One One special special state state isis designated designated as as the the state. state.

38 A Simple Finite Automaton q q

39 A Simple Finite Automaton q q

40 A Simple Finite Automaton q The The automaton automaton isis run run on on an an input input string string and and answers answers yes yes or or no. no. q

41 A Simple Finite Automaton q q

42 A Simple Finite Automaton q q

43 A Simple Finite Automaton q The The automaton automaton can can a be in one state at be in one state at a time. time. It It begins begins inin the the state. state. q

44 A Simple Finite Automaton q q

45 A Simple Finite Automaton q q

46 A Simple Finite Automaton q The The automaton automaton now now begins begins processing processing characters characters inin the the order order inin which which they they appear. appear. q

47 A Simple Finite Automaton q q

48 A Simple Finite Automaton q q

49 A Simple Finite Automaton q q Each Each arrow arrow inin this this diagram diagram represents represents aa transition. transition. The The automaton automaton always always follows follows the the transition transition corresponding corresponding to to the the current current symbol symbol being being read. read.

50 A Simple Finite Automaton q q

51 A Simple Finite Automaton q q

52 A Simple Finite Automaton q q

53 A Simple Finite Automaton q q

54 A Simple Finite Automaton q q After After transitioning, transitioning, the the automaton automaton considers considers the the next next symbol symbol inin the the input. input.

55 A Simple Finite Automaton q q

56 A Simple Finite Automaton q q

57 A Simple Finite Automaton q q

58 A Simple Finite Automaton q q

59 A Simple Finite Automaton q q

60 A Simple Finite Automaton q q

61 A Simple Finite Automaton q q

62 A Simple Finite Automaton q q

63 A Simple Finite Automaton q q

64 A Simple Finite Automaton q q

65 A Simple Finite Automaton q q

66 A Simple Finite Automaton q q

67 A Simple Finite Automaton q q

68 A Simple Finite Automaton q q

69 A Simple Finite Automaton q q

70 A Simple Finite Automaton q q

71 A Simple Finite Automaton q q

72 A Simple Finite Automaton q q

73 A Simple Finite Automaton q q

74 A Simple Finite Automaton q q

75 A Simple Finite Automaton q q

76 A Simple Finite Automaton Now Now that that the the automaton automaton has has q whether whether to to say say yes yes or or no. no. looked looked at at all all this this input, input, itit can can decide decide q

77 A Simple Finite Automaton Now Now that that the the automaton automaton has has q whether whether to to say say yes yes or or no. no. looked looked at at all all this this input, input, itit can can decide decide q The The double double circle circle indicates indicates that that this this state state isis an an accepting accepting state, state, so so the the automaton automaton outputs outputs yes. yes.

78 A Simple Finite Automaton Now Now that that the the automaton automaton has has q whether whether to to say say yes yes or or no. no. looked looked at at all all this this input, input, itit can can decide decide q The The double double circle circle indicates indicates that that this this state state isis an an accepting accepting state, state, so so the the automaton automaton outputs outputs yes. yes.

79 A Simple Finite Automaton Now Now that that the the automaton automaton has has q whether whether to to say say yes yes or or no. no. looked looked at at all all this this input, input, itit can can decide decide q The The double double circle circle indicates indicates that that this this state state isis an an accepting accepting state, state, so so the the automaton automaton outputs outputs yes. yes.

80 A Simple Finite Automaton q q

81 A Simple Finite Automaton q q

82 A Simple Finite Automaton q q

83 A Simple Finite Automaton q q

84 A Simple Finite Automaton q q

85 A Simple Finite Automaton q q

86 A Simple Finite Automaton q q

87 A Simple Finite Automaton q q

88 A Simple Finite Automaton q q

89 A Simple Finite Automaton q q

90 A Simple Finite Automaton q q

91 A Simple Finite Automaton q q

92 A Simple Finite Automaton q q

93 A Simple Finite Automaton q q

94 A Simple Finite Automaton q q

95 A Simple Finite Automaton q q

96 A Simple Finite Automaton q q

97 A Simple Finite Automaton q q

98 A Simple Finite Automaton q q

99 A Simple Finite Automaton q q

100 A Simple Finite Automaton q q

101 A Simple Finite Automaton q q

102 A Simple Finite Automaton q q

103 A Simple Finite Automaton q q

104 A Simple Finite Automaton q q

105 A Simple Finite Automaton q q

106 A Simple Finite Automaton q q

107 A Simple Finite Automaton q q

108 A Simple Finite Automaton q This This state state isis not not an an accepting accepting state, state, so so the the automaton automaton says says no. no. q

109 A Simple Finite Automaton q This This state state isis not not an an accepting accepting state, state, so so the the automaton automaton says says no. no. q

110 A Simple Finite Automaton q This This state state isis not not an an accepting accepting state, state, so so the the automaton automaton says says no. no. q

111 A Simple Finite Automaton q q

112 A Simple Finite Automaton q q Try Try itit yourself! yourself! Does Does the the automaton automaton accept accept (say (say yes) yes) or or reject reject (say (say no)? no)?

113 The Story So Far A finite automaton is a collection of states joined by transitions. Some state is designated as the state. Some states are designated as accepting states. The automaton processes a string by beginning in the state and following the indicated transitions. If the automaton ends in an accepting state, it accepts the input. Otherwise, the automaton rejects the input.

114 Time-Out For Announcements!

115 Problem Sets Problem Set Four was due at the of class today. You have three 24-hour late days to use throughout the quarter however you d like. Problem Set Five goes out today. It s due next Friday at the of class. Play around with just about everything we ve seen so far: graphs, binary relations, functions, cardinality, the pigeonhole principle, and induction! There is no checkpoint problem.

116 Problem Set Three PS3 has been graded. Here s the distribution: We re happy to chat with you about this problem set, the feedback you received, and how to tune and nudge things going forward. Feel free to stop by OH!

117 Your Questions

118 Is there a documentary or book that really changed the way you thought about something? Yes! Yes! The The books books Unlocking Unlocking the the Clubhouse Clubhouse and and Whistling Whistling Vivaldi Vivaldi completely completely changed changed how how II think think about about questions questions of of identity identity and and belonging. belonging. And And Jiro Jiro Dreams Dreams of of Sushi Sushi was was aa surprisingly surprisingly good good exploration exploration of of the the benefits benefits and and drawbacks drawbacks of of aa singleminded singleminded focus focus on on perfection perfection inin one one domain. domain.

119 Why do you hate philosophy/philosophers so much? I m I m sorry sorry that that I ve I ve given given that that impression! impression! Many Many of of the the foundational foundational ideas ideas inin computer computer science science and and mathematics mathematics are are due due to to philosophers philosophers like like Frege, Frege, Chomsky, Chomsky, and and Russell. Russell. II think think it s it s hugely hugely valuable valuable to to explore explore notions notions of of truth truth and and meaning meaning and and would would definitely definitely recommend recommend taking taking courses courses to to learn learn more more about about that! that!

120 Why should I or shouldn't I take a gap year if I REALLY love CS but have issues adjusting to the pace here? Taking Taking aa gap gap year year can can be be aa great great experience experience ifif you re you re strategic strategic about about when when you you take take itit and and what what you you want want to to accomplish, accomplish, but but it s it s certainly certainly not not for for everyone. everyone. II typically typically would would not not recommend recommend taking taking aa gap gap year year just just because because of of the the pace pace I m I m not not sure sure that that would would necessarily necessarily fix fix the the underlying underlying issue. issue. If If you re you re inin aa position position like like this this and and want want to to chat, chat, please please let let me me know! know! I m I m happy happy to to offer offer advice. advice.

121 Why do you use the number 37 everywhere? The The number number isis very very close close to to the the reciprocal reciprocal of of the the fine-structure fine-structure constant constant inin physics: physics: It It has has aa fun fun history. history. Plus, Plus, it s it s aa great great nothing-up-my-sleeve nothing-up-my-sleeve number number that that (usually) (usually) indicates indicates that that the the particular particular number number doesn t doesn t have have any any meaning. meaning.

122 Back to CS3!

123 Accepting States, Revisited q q q4

124 Accepting States, Revisited q q q4

125 Accepting States, Revisited q q q4

126 Accepting States, Revisited q q q4

127 Accepting States, Revisited q q q4

128 Accepting States, Revisited q q q4

129 Accepting States, Revisited q q q4

130 Accepting States, Revisited q q q4

131 Accepting States, Revisited q q q4

132 Accepting States, Revisited q q q4

133 Accepting States, Revisited q q q4

134 Accepting States, Revisited q q q4

135 Accepting States, Revisited q q q4

136 Accepting States, Revisited q q q4

137 A finite automaton does not accept as soon as it enters an accepting state. A finite automaton accepts if it ends in an accepting state.

138 What Does This Accept? q q q4

139 What Does This Accept? q q q4

140 What Does This Accept? q q q4

141 What Does This Accept? q q q4

142 What Does This Accept? q q q4

143 What Does This Accept? q q q4

144 What Does This Accept? q q q4

145 What Does This Accept? q No No matter matter where where we we in in the the automaton, automaton, q after after seeing seeing two two 's, 's, we we end end up up in in accepting accepting state state q.3. q4

146 What Does This Accept? q q q4

147 What Does This Accept? q q q4

148 What Does This Accept? q q q4

149 What Does This Accept? q q q4

150 What Does This Accept? q q q4

151 What Does This Accept? q q q4

152 What Does This Accept? q No No matter matter where where we we in in the the automaton, automaton, q after after seeing seeing two two 's, 's, we we end end up up in in accepting accepting state state qq5.5. q4

153 What Does This Accept? q q q4

154 What Does This Accept? q This This automaton automaton accepts accepts aa string string iff iff q the the string string ends ends in in or or.. q4

155 The language of an automaton is the set of strings that it accepts. If D is an automaton, we denote the language of D as ℒ(D). ℒ(D) = { w Σ* D accepts w }

156 A Small Problem q q

157 A Small Problem q q

158 A Small Problem q q

159 A Small Problem q q

160 A Small Problem q q

161 A Small Problem q q

162 A Small Problem q q

163 A Small Problem q q

164 A Small Problem q q

165 Another Small Problem, q, q,

166 Another Small Problem, q, q,

167 Another Small Problem, q, q,

168 Another Small Problem, q, q,

169 Another Small Problem, q, q,

170 Another Small Problem, q, q,

171 Another Small Problem, q, q,

172 Another Small Problem, q, q,

173 The Need for Formalism In order to reason about the limits of what finite automata can and cannot do, we need to formally specify their behavior in all cases. All of the following need to be defined or disallowed: What happens if there is no transition out of a state on some input? What happens if there are multiple transitions out of a state on some input?

174 DFAs A DFA is a Deterministic Finite Automaton DFAs are the simplest type of automaton that we will see in this course.

175 DFAs, Informally A DFA is defined relative to some alphabet Σ. For each state in the DFA, there must be exactly one transition defined for each symbol in Σ. This is the deterministic part of DFA. There is a unique state. There are zero or more accepting states.

176 Is this a DFA over {, }?

177 Is this a DFA over {, }? q q

178 Is this a DFA over {, }?

179 Is this a DFA over {, }? q q q4

180 Is this a DFA over {, }?

181 Is this a DFA over {, }? q q

182 Is this a DFA over {, }? q q

183 Is this a DFA over {, }?

184 Is this a DFA over {, }? q,, q,,

185 Is this a DFA over {, }?

186 Is this a DFA over {, }?, q, q,

187 Is this a DFA over {, }?, q, q,

188 Is this a DFA?

189 Is this a DFA?

190 Is this a DFA? Drinking Family of Aardvarks

191 Designing DFAs At each point in its execution, the DFA can only remember what state it is in. DFA Design Tip: Build each state to correspond to some piece of information you need to remember. Each state acts as a memento of what you're supposed to do next. Only finitely many different states only finitely many different things the machine can remember.

192 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three }

193 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q

194 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q

195 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q

196 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q

197 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q

198 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q

199 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q

200 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q

201 Recognizing Languages with DFAs L = { w {, }* the number of 's in w is congruent to two modulo three } q q Each Each state state remembers remembers the the remainder remainder of of the the number number of of 's 's seen seen so so far far modulo modulo three. three.

202 Recognizing Languages with DFAs L = { w {, }* w contains as a substring }

203 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q

204 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q

205 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q

206 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q

207 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q

208 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q

209 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q,

210 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q,

211 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q Σ

212 Recognizing Languages with DFAs L = { w {, }* w contains as a substring } q q Σ

213 More Elaborate DFAs L = { w {a, *, /}* w represents a C-style comment } Let s Let s have have the the aa symbol symbol be be aa placeholder placeholder for for some some character character that that isn t isn t aa star star or or slash. slash. Try Try designing designing aa DFA DFA for for comments! comments! Here s Here s some some test test cases cases to to help help you you check check your your work: work: Accepted: Rejected: /*a*/ /**/ /***/ /*aaa*aaa*/ /*a/a*/ /** /**/a/*aa*/ aaa/**/aa /*/ /**a/ //aaaa

214 More Elaborate DFAs L = { w {a, *, /}* w represents a C-style comment } Σ a, * Σ q5 /, a q / q * * a a, / / * q4

Finite Automata Part One

Finite Automata Part One Computability Theory What problems can we solve with a computer? What kind of computer? Computers are Messy http://www.intel.com/design/intarch/prodbref/27273.htm We need a simpler