Learning Moore Machines from Input-Output Traces
|
|
- Ethelbert Bell
- 5 years ago
- Views:
Transcription
1 Lerning Moore Mchines from Input-Output Trces Georgios Gintmidis 1 nd Stvros Tripkis 1,2 1 Alto University, Finlnd 2 UC Berkeley, USA
2 Motivtion: lerning models from blck boxes Inputs? Lerner Forml Model Outputs Mny pplictions: Verify tht blck-box component is sfe to use Dynmic mlwre nlysis... Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
3 Lerning FSMs from input-output trces IO-trces Lerned FSM 020 b 0122 bb 0122 b bb Lerner q 0 q 3 0 q 1 b 1, b q 2 2 b 2, b Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
4 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
5 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
6 Moore mchines 0 q 1 b 1, b q 0 q 3 q 2 b 2, b 2 (I, O, Q, q 0, δ, λ) input lphbet, I = {, b} output lphbet, O = {0, 1, 2} set of sttes, Q = {q 0, q 1, q 2, q 3 } initil stte, q 0 trnsition function, δ : Q I Q output function, λ : Q O Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
7 Moore mchines 0 q 1 b 1, b q 0 q 3 q 2 b 2, b 2 (I, O, Q, q 0, δ, λ) input lphbet, I = {, b} output lphbet, O = {0, 1, 2} set of sttes, Q = {q 0, q 1, q 2, q 3 } initil stte, q 0 trnsition function, δ : Q I Q output function, λ : Q O By definition, our mchines re deterministic nd complete. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
8 Input-output trces q 1 b 1, b 020 q 0 q 3 0 q 2 2 b 2, b b 0122 bb 0122 b bb Moore mchine Some I/O trces generted by the mchine Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
9 Consistency q 1 b 1, b 020 q 0 q 3 0 q 2 2 b 2, b b 0122 bb 0122 b bb This mchine is consistent with this set of trces. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
10 Consistency 0 r 1 b 1 r 0, b r 3 r 2 2 b 2, b 020 b 0122 bb 0122 b bb This mchine is inconsistent with this set of trces. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
11 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
12 A first ttempt t problem definition Given... Input lphbet, I Output lphbet, O Set of IO-trces, S (the trining set)... find Moore mchine M such tht: M is deterministic M is complete M is consistent with S Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
13 A trivil solution q 0 b b 022 q ɛ 0 b q 2 q b 1 b q b 2, b, b, b Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
14 A trivil solution q 0 b b 022 q ɛ 0 b q 2 q b 1 b q b 2, b, b, b This is clled the prefix-tree mchine. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
15 A trivil solution q 0 b b 022 q ɛ 0 b q 2 q b 1 b q b 2, b, b, b This is clled the prefix-tree mchine. Not quite solution: mchine incomplete... Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
16 A trivil solution q 0 b b 022 q ɛ 0 b q 2 q b 1 b q b 2, b, b, b... but esily completed with self-loops. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
17 Problems with the trivil solution (1) Poor generliztion, due to trivil completion with self-loops The mchine my be consistent with the trining set but how ccurte is it on test set? Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
18 Problems with the trivil solution (1) Poor generliztion, due to trivil completion with self-loops The mchine my be consistent with the trining set but how ccurte is it on test set? (2) Lrge number of sttes in the lerned mchine The prefix-tree mchine does not merge sttes t ll. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
19 Revised problem definition The LMoMIO problem (Lerning Moore Mchines Input-Output Trces): Given... Input lphbet, I Output lphbet, O Set of IO-trces, S (the trining set)... find Moore mchine M such tht: M is deterministic M is complete M is consistent with S... nd lso: M generlizes well (good ccurcy on -priori unknown test sets) M is smll (few sttes) M is found quickly (good lerning lgorithm complexity) Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
20 How to mesure ccurcy? We define three metrics: Strong, Medium, Wek test trce mchine output strong cc. medium cc. wek cc. bc bc bc bc bc Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
21 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
22 Relted work ctive A* [Angluin, 1987] pssive exct NP-hrd [Gold, 1978] heuristic K-tils [Biermnn & Feldmn, 1972] Gold's lgorithm [Gold, 1978] RPNI [Oncin & Grci, 1992] Genetic lgorithms Ant colony optimiztion Our work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
23 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
24 Identifiction in the limit Concept introduced in [Gold, 1967], in the context of forml lnguge lerning Lerning is seen s n infinite process Trining set keeps growing: S 0 S 1 S 2 Every input word is gurnteed to eventully pper in the trining set For ech S i, the lerner outputs mchine M i Identifiction in the limit := lerner outputs the right mchine fter some i Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
25 Identifiction in the limit Concept introduced in [Gold, 1967], in the context of forml lnguge lerning Lerning is seen s n infinite process Trining set keeps growing: S 0 S 1 S 2 Every input word is gurnteed to eventully pper in the trining set For ech S i, the lerner outputs mchine M i Identifiction in the limit := lerner outputs the right mchine fter some i A good pssive lerning lgorithm must identify in the limit. Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
26 Chrcteristic smples To prove identifiction in the limit, we use the notion of the Chrcteristic Smple [C. de l Higuer, 2010]: Concept existing for DFAs (deterministic finite utomt) we dpt it to Moore mchines Intuition: set of IO-trces tht covers the mchine (covers ll sttes, ll trnsitions) For miniml Moore mchine M = (I, O, Q, q 0, δ, λ), there exists CS of totl length O( Q 4 I ) Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
27 Chrcteristic smples To prove identifiction in the limit, we use the notion of the Chrcteristic Smple [C. de l Higuer, 2010]: Concept existing for DFAs (deterministic finite utomt) we dpt it to Moore mchines Intuition: set of IO-trces tht covers the mchine (covers ll sttes, ll trnsitions) For miniml Moore mchine M = (I, O, Q, q 0, δ, λ), there exists CS of totl length O( Q 4 I ) Chrteristic Smple Requirement (CSR): A lerning lgorithm stisfies CSR if it stisfies the following: If the trining set S is chrcteristic smple of miniml mchine M, then the lgorithm lerns from S mchine isomorphic to M. CSR cn be shown to imply identifiction in the limit Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
28 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
29 Three lerning lgorithms PTAP - Prefix Tree Acceptor Product PRPNI - Product RPNI MooreMI - Moore Mchine Inference Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
30 PTAP - Prefix Tree Acceptor Product This is the trivil solution we discussed erlier: q 0 b q ɛ q 2 b q b, b b b q b 1 2, b Drwbcks: Lrge number of sttes in lerned mchine Poor generliztion / ccurcy, b Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
31 PRPNI - Product RPNI Observtions: A DFA is specil cse of Moore mchine with binry output (ccept/reject) A Moore mchine cn be encoded s product of log 2 O DFAs Bsed on these observtions, PRPNI works s follows: Uses the RPNI lgorithm [J. Oncin nd P. Grci, 1992], which lerns DFAs Lerns severl DFAs tht encode the lerned Moore mchine Computes product of the lerned DFAs nd completes it Drwbcks: DFAs re lerned seprtely, therefore do not hve sme stte-trnsition structure = stte explosion during product computtion Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
32 PRPNI - Product RPNI Observtions: A DFA is specil cse of Moore mchine with binry output (ccept/reject) A Moore mchine cn be encoded s product of log 2 O DFAs Bsed on these observtions, PRPNI works s follows: Uses the RPNI lgorithm [J. Oncin nd P. Grci, 1992], which lerns DFAs Lerns severl DFAs tht encode the lerned Moore mchine Computes product of the lerned DFAs nd completes it Drwbcks: DFAs re lerned seprtely, therefore do not hve sme stte-trnsition structure = stte explosion during product computtion Invlid output codes Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
33 Invlid output codes Output lphbet: O = {0, 1, 2} Binry encoding of O: f = {0 00, 1 01, 2 10} b b b b b q 0 q 1 b b b q 2 r 0 r 1 s 0 s 1 s s 5 s 4 s b b b Invlid output code: 11 does not correspond to ny output symbol Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
34 MooreMI - Moore Mchine Inference Modified RPNI, tilored to Moore mchine lerning Like PRPNI, lerns severl DFAs tht encode the lerned Moore mchine Unlike PRPNI, lerned DFAs mintin sme stte-trnsition structure Therefore, no stte explosion during product computtion No invlid output codes either Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
35 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
36 Results Theorem 1 All three lgorithms return Moore mchines consistent with the IO-trces received s input. Theorem 2 The MooreMI lgorithm stisfies the chrcteristic smple requirement nd identifies in the limit. Experimentl evlution result: MooreMI is better not just in theory, but lso in prctice Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
37 Outline 1 Bckground 2 Forml problem definition 3 Relted work 4 Identifiction in the limit 5 Our lerning lgorithms 6 Results 7 Summry & future work Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
38 Summry Lerning deterministic, complete Moore mchines from input-output trces Chrcteristic smple for Moore mchines Three lgorithms to solve the problem MooreMI lgorithm identifies in the limit Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
39 Future work Extend to Mely mchines Lerning symbolic mchines Lerning from trces nd forml requirements (e.g. LTL formuls) Industril cse studies Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
40 Future work Extend to Mely mchines Lerning symbolic mchines Lerning from trces nd forml requirements (e.g. LTL formuls) Industril cse studies Thnk you! Questions? Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
41 References E. M. Gold. Lnguge identifiction in the limit. Informtion nd Control, 10(5): , A. W. Biermnn nd J. A. Feldmn. On the synthesis of finite-stte mchines from smples of their behvior. IEEE Trns. Comput., 21(6): , June E. M. Gold. Complexity of utomton identifiction from given dt. Informtion nd Control, 37(3): , D. Angluin. Lerning regulr sets from queries nd counterexmples. Inf. Comput., 75(2):87-106, J. Oncin nd P. Grci. Identifying regulr lnguges in polynomil time. In Advnces in Structurl nd Syntctic Pttern Recognition, pges , C. de l Higuer. Grmmticl Inference: Lerning Automt nd Grmmrs. CUP, Georgios Gintmidis (Alto University) Lerning Moore Mchines from Input-Output Trces December 8, / 32
Non Deterministic Automata. Linz: Nondeterministic Finite Accepters, page 51
Non Deterministic Automt Linz: Nondeterministic Finite Accepters, pge 51 1 Nondeterministic Finite Accepter (NFA) Alphbet ={} q 1 q2 q 0 q 3 2 Nondeterministic Finite Accepter (NFA) Alphbet ={} Two choices
More informationNon-Deterministic Finite Automata. Fall 2018 Costas Busch - RPI 1
Non-Deterministic Finite Automt Fll 2018 Costs Busch - RPI 1 Nondeterministic Finite Automton (NFA) Alphbet ={} q q2 1 q 0 q 3 Fll 2018 Costs Busch - RPI 2 Nondeterministic Finite Automton (NFA) Alphbet
More informationLearning Regular Languages over Large Alphabets
Irini-Eleftheri Mens VERIMAG, University of Grenoble-Alpes Lerning Regulr Lnguges over Lrge Alphbets 10 October 2017 Jury Members Oded Mler Directeur de thèse Lurent Fribourg Exminteur Dn Angluin Rpporteur
More informationTheory of Computation Regular Languages. (NTU EE) Regular Languages Fall / 38
Theory of Computtion Regulr Lnguges (NTU EE) Regulr Lnguges Fll 2017 1 / 38 Schemtic of Finite Automt control 0 0 1 0 1 1 1 0 Figure: Schemtic of Finite Automt A finite utomton hs finite set of control
More informationLecture 6 Regular Grammars
Lecture 6 Regulr Grmmrs COT 4420 Theory of Computtion Section 3.3 Grmmr A grmmr G is defined s qudruple G = (V, T, S, P) V is finite set of vribles T is finite set of terminl symbols S V is specil vrible
More informationTheory of Computation Regular Languages
Theory of Computtion Regulr Lnguges Bow-Yw Wng Acdemi Sinic Spring 2012 Bow-Yw Wng (Acdemi Sinic) Regulr Lnguges Spring 2012 1 / 38 Schemtic of Finite Automt control 0 0 1 0 1 1 1 0 Figure: Schemtic of
More informationGold s algorithm. Acknowledgements. Why would this be true? Gold's Algorithm. 1 Key ideas. Strings as states
Acknowledgements Gold s lgorithm Lurent Miclet, Jose Oncin nd Tim Otes for previous versions of these slides. Rfel Crrsco, Pco Cscuert, Rémi Eyrud, Philippe Ezequel, Henning Fernu, Thierry Murgue, Frnck
More informationFinite Automata. Informatics 2A: Lecture 3. John Longley. 22 September School of Informatics University of Edinburgh
Lnguges nd Automt Finite Automt Informtics 2A: Lecture 3 John Longley School of Informtics University of Edinburgh jrl@inf.ed.c.uk 22 September 2017 1 / 30 Lnguges nd Automt 1 Lnguges nd Automt Wht is
More informationNon Deterministic Automata. Formal Languages and Automata - Yonsei CS 1
Non Deterministic Automt Forml Lnguges nd Automt - Yonsei CS 1 Nondeterministic Finite Accepter (NFA) We llow set of possible moves insted of A unique move. Alphbet = {} Two choices q 1 q2 Forml Lnguges
More informationa,b a 1 a 2 a 3 a,b 1 a,b a,b 2 3 a,b a,b a 2 a,b CS Determinisitic Finite Automata 1
CS4 45- Determinisitic Finite Automt -: Genertors vs. Checkers Regulr expressions re one wy to specify forml lnguge String Genertor Genertes strings in the lnguge Deterministic Finite Automt (DFA) re nother
More information1.4 Nonregular Languages
74 1.4 Nonregulr Lnguges The number of forml lnguges over ny lphbet (= decision/recognition problems) is uncountble On the other hnd, the number of regulr expressions (= strings) is countble Hence, ll
More informationGood-for-Games Automata versus Deterministic Automata.
Good-for-Gmes Automt versus Deterministic Automt. Denis Kuperberg 1,2 Mich l Skrzypczk 1 1 University of Wrsw 2 IRIT/ONERA (Toulouse) Séminire MoVe 12/02/2015 LIF, Luminy Introduction Deterministic utomt
More informationInductive and statistical learning of formal grammars
Inductive nd sttisticl lerning of forml grmmrs Pierre Dupont Grmmr Induction Mchine Lerning Gol: to give the lerning ility to mchine Design progrms the performnce of which improves over time pdupont@info.ucl.c.e
More informationAnatomy of a Deterministic Finite Automaton. Deterministic Finite Automata. A machine so simple that you can understand it in less than one minute
Victor Admchik Dnny Sletor Gret Theoreticl Ides In Computer Science CS 5-25 Spring 2 Lecture 2 Mr 3, 2 Crnegie Mellon University Deterministic Finite Automt Finite Automt A mchine so simple tht you cn
More informationIntroduction to ω-autamata
Fridy 25 th Jnury, 2013 Outline From finite word utomt ω-regulr lnguge ω-utomt Nondeterministic Models Deterministic Models Two Lower Bounds Conclusion Discussion Synthesis Preliminry From finite word
More informationChapter 2 Finite Automata
Chpter 2 Finite Automt 28 2.1 Introduction Finite utomt: first model of the notion of effective procedure. (They lso hve mny other pplictions). The concept of finite utomton cn e derived y exmining wht
More informationAutomata and Languages
Automt nd Lnguges Prof. Mohmed Hmd Softwre Engineering Lb. The University of Aizu Jpn Grmmr Regulr Grmmr Context-free Grmmr Context-sensitive Grmmr Regulr Lnguges Context Free Lnguges Context Sensitive
More informationProbabilistic Model Checking Michaelmas Term Dr. Dave Parker. Department of Computer Science University of Oxford
Probbilistic Model Checking Michelms Term 2011 Dr. Dve Prker Deprtment of Computer Science University of Oxford Long-run properties Lst lecture: regulr sfety properties e.g. messge filure never occurs
More informationMinimal DFA. minimal DFA for L starting from any other
Miniml DFA Among the mny DFAs ccepting the sme regulr lnguge L, there is exctly one (up to renming of sttes) which hs the smllest possile numer of sttes. Moreover, it is possile to otin tht miniml DFA
More information12.1 Nondeterminism Nondeterministic Finite Automata. a a b ε. CS125 Lecture 12 Fall 2014
CS125 Lecture 12 Fll 2014 12.1 Nondeterminism The ide of nondeterministic computtions is to llow our lgorithms to mke guesses, nd only require tht they ccept when the guesses re correct. For exmple, simple
More informationAssignment 1 Automata, Languages, and Computability. 1 Finite State Automata and Regular Languages
Deprtment of Computer Science, Austrlin Ntionl University COMP2600 Forml Methods for Softwre Engineering Semester 2, 206 Assignment Automt, Lnguges, nd Computility Smple Solutions Finite Stte Automt nd
More informationOn Determinisation of History-Deterministic Automata.
On Deterministion of History-Deterministic Automt. Denis Kupererg Mich l Skrzypczk University of Wrsw YR-ICALP 2014 Copenhgen Introduction Deterministic utomt re centrl tool in utomt theory: Polynomil
More informationFormal Language and Automata Theory (CS21004)
Forml Lnguge nd Automt Forml Lnguge nd Automt Theory (CS21004) Khrgpur Khrgpur Khrgpur Forml Lnguge nd Automt Tle of Contents Forml Lnguge nd Automt Khrgpur 1 2 3 Khrgpur Forml Lnguge nd Automt Forml Lnguge
More informationFinite Automata. Informatics 2A: Lecture 3. Mary Cryan. 21 September School of Informatics University of Edinburgh
Finite Automt Informtics 2A: Lecture 3 Mry Cryn School of Informtics University of Edinburgh mcryn@inf.ed.c.uk 21 September 2018 1 / 30 Lnguges nd Automt Wht is lnguge? Finite utomt: recp Some forml definitions
More informationDeterministic Finite Automata
Finite Automt Deterministic Finite Automt H. Geuvers nd J. Rot Institute for Computing nd Informtion Sciences Version: fll 2016 J. Rot Version: fll 2016 Tlen en Automten 1 / 21 Outline Finite Automt Finite
More informationCS 330 Formal Methods and Models
CS 330 Forml Methods nd Models Dn Richrds, George Mson University, Spring 2017 Quiz Solutions Quiz 1, Propositionl Logic Dte: Ferury 2 1. Prove ((( p q) q) p) is tutology () (3pts) y truth tle. p q p q
More information1.3 Regular Expressions
56 1.3 Regulr xpressions These hve n importnt role in describing ptterns in serching for strings in mny pplictions (e.g. wk, grep, Perl,...) All regulr expressions of lphbet re 1.Ønd re regulr expressions,
More informationNondeterminism and Nodeterministic Automata
Nondeterminism nd Nodeterministic Automt 61 Nondeterminism nd Nondeterministic Automt The computtionl mchine models tht we lerned in the clss re deterministic in the sense tht the next move is uniquely
More informationNon-Deterministic Finite Automata
Non-Deterministic Finite Automt http://users.comlb.ox.c.uk/luke. ong/teching/moc/nf2up.pdf 1 Nondeterministic Finite Automton (NFA) Alphbet ={} q1 q2 2 Alphbet ={} Two choices q1 q2 3 Alphbet ={} Two choices
More informationLearning probabilistic finite automata
Lerning probbilistic finite utomt Colin de l Higuer University of Nntes Zdr, August 00 Acknowledgements Lurent Miclet, Jose Oncin, Tim Otes, Rfel Crrsco, Pco Cscubert, Rémi Eyrud, Philippe Ezequel, Henning
More informationNon-deterministic Finite Automata
Non-deterministic Finite Automt Eliminting non-determinism Rdoud University Nijmegen Non-deterministic Finite Automt H. Geuvers nd T. vn Lrhoven Institute for Computing nd Informtion Sciences Intelligent
More informationDeterministic Finite-State Automata
Deterministic Finite-Stte Automt Deepk D Souz Deprtment of Computer Science nd Automtion Indin Institute of Science, Bnglore. 12 August 2013 Outline 1 Introduction 2 Exmple DFA 1 DFA for Odd number of
More informationExtending Automated Compositional Verification to the Full Class of Omega-Regular Languages
Extending Automted Compositionl Verifiction to the Full Clss of Omeg-Regulr Lnguges Azdeh Frzn 1, Yu-Fng Chen 2, Edmund M. Clrke 1, Yih-Kuen Tsy 2, nd Bow-Yw Wng 3 1 Crnegie Mellon University 2 Ntionl
More informationCMPSCI 250: Introduction to Computation. Lecture #31: What DFA s Can and Can t Do David Mix Barrington 9 April 2014
CMPSCI 250: Introduction to Computtion Lecture #31: Wht DFA s Cn nd Cn t Do Dvid Mix Brrington 9 April 2014 Wht DFA s Cn nd Cn t Do Deterministic Finite Automt Forml Definition of DFA s Exmples of DFA
More information11.1 Finite Automata. CS125 Lecture 11 Fall Motivation: TMs without a tape: maybe we can at least fully understand such a simple model?
CS125 Lecture 11 Fll 2016 11.1 Finite Automt Motivtion: TMs without tpe: mybe we cn t lest fully understnd such simple model? Algorithms (e.g. string mtching) Computing with very limited memory Forml verifiction
More informationCS:4330 Theory of Computation Spring Regular Languages. Equivalences between Finite automata and REs. Haniel Barbosa
CS:4330 Theory of Computtion Spring 208 Regulr Lnguges Equivlences between Finite utomt nd REs Hniel Brbos Redings for this lecture Chpter of [Sipser 996], 3rd edition. Section.3. Finite utomt nd regulr
More informationHyper-minimisation of weighted finite automata
Hyper-minimistion of weighted finite utomt Dniel Quernheim nd ndres Mletti Institute for Nturl Lnguge Processing, University of Stuttgrt @ims.uni-stuttgrt.de ugust 18, 2011. Mletti nd D. Quernheim
More informationCMSC 330: Organization of Programming Languages. DFAs, and NFAs, and Regexps (Oh my!)
CMSC 330: Orgniztion of Progrmming Lnguges DFAs, nd NFAs, nd Regexps (Oh my!) CMSC330 Spring 2018 Types of Finite Automt Deterministic Finite Automt (DFA) Exctly one sequence of steps for ech string All
More informationAUTOMATA AND LANGUAGES. Definition 1.5: Finite Automaton
25. Finite Automt AUTOMATA AND LANGUAGES A system of computtion tht only hs finite numer of possile sttes cn e modeled using finite utomton A finite utomton is often illustrted s stte digrm d d d. d q
More information5.1 Definitions and Examples 5.2 Deterministic Pushdown Automata
CSC4510 AUTOMATA 5.1 Definitions nd Exmples 5.2 Deterministic Pushdown Automt Definitions nd Exmples A lnguge cn be generted by CFG if nd only if it cn be ccepted by pushdown utomton. A pushdown utomton
More informationRegular Languages and Applications
Regulr Lnguges nd Applictions Yo-Su Hn Deprtment of Computer Science Yonsei University 1-1 SNU 4/14 Regulr Lnguges An old nd well-known topic in CS Kleene Theorem in 1959 FA (finite-stte utomton) constructions:
More informationLecture 09: Myhill-Nerode Theorem
CS 373: Theory of Computtion Mdhusudn Prthsrthy Lecture 09: Myhill-Nerode Theorem 16 Ferury 2010 In this lecture, we will see tht every lnguge hs unique miniml DFA We will see this fct from two perspectives
More informationFoundations of XML Types: Tree Automata
1 / 43 Foundtions of XML Types: Tree Automt Pierre Genevès CNRS (slides mostly sed on slides y W. Mrtens nd T. Schwentick) University of Grenole Alpes, 2017 2018 2 / 43 Why Tree Automt? Foundtions of XML
More informationModel Reduction of Finite State Machines by Contraction
Model Reduction of Finite Stte Mchines y Contrction Alessndro Giu Dip. di Ingegneri Elettric ed Elettronic, Università di Cgliri, Pizz d Armi, 09123 Cgliri, Itly Phone: +39-070-675-5892 Fx: +39-070-675-5900
More informationFinite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018
Finite Automt Theory nd Forml Lnguges TMV027/DIT321 LP4 2018 Lecture 10 An Bove April 23rd 2018 Recp: Regulr Lnguges We cn convert between FA nd RE; Hence both FA nd RE ccept/generte regulr lnguges; More
More informationLexical Analysis Finite Automate
Lexicl Anlysis Finite Automte CMPSC 470 Lecture 04 Topics: Deterministic Finite Automt (DFA) Nondeterministic Finite Automt (NFA) Regulr Expression NFA DFA A. Finite Automt (FA) FA re grph, like trnsition
More informationRegular expressions, Finite Automata, transition graphs are all the same!!
CSI 3104 /Winter 2011: Introduction to Forml Lnguges Chpter 7: Kleene s Theorem Chpter 7: Kleene s Theorem Regulr expressions, Finite Automt, trnsition grphs re ll the sme!! Dr. Neji Zgui CSI3104-W11 1
More informationRecursively Enumerable and Recursive. Languages
Recursively Enumerble nd Recursive nguges 1 Recll Definition (clss 19.pdf) Definition 10.4, inz, 6 th, pge 279 et S be set of strings. An enumertion procedure for Turing Mchine tht genertes ll strings
More informationCS375: Logic and Theory of Computing
CS375: Logic nd Theory of Computing Fuhu (Frnk) Cheng Deprtment of Computer Science University of Kentucky 1 Tble of Contents: Week 1: Preliminries (set lgebr, reltions, functions) (red Chpters 1-4) Weeks
More information12.1 Nondeterminism Nondeterministic Finite Automata. a a b ε. CS125 Lecture 12 Fall 2016
CS125 Lecture 12 Fll 2016 12.1 Nondeterminism The ide of nondeterministic computtions is to llow our lgorithms to mke guesses, nd only require tht they ccept when the guesses re correct. For exmple, simple
More informationWorked out examples Finite Automata
Worked out exmples Finite Automt Exmple Design Finite Stte Automton which reds inry string nd ccepts only those tht end with. Since we re in the topic of Non Deterministic Finite Automt (NFA), we will
More informationAutomata Theory 101. Introduction. Outline. Introduction Finite Automata Regular Expressions ω-automata. Ralf Huuck.
Outline Automt Theory 101 Rlf Huuck Introduction Finite Automt Regulr Expressions ω-automt Session 1 2006 Rlf Huuck 1 Session 1 2006 Rlf Huuck 2 Acknowledgement Some slides re sed on Wolfgng Thoms excellent
More informationPart 5 out of 5. Automata & languages. A primer on the Theory of Computation. Last week was all about. a superset of Regular Languages
Automt & lnguges A primer on the Theory of Computtion Lurent Vnbever www.vnbever.eu Prt 5 out of 5 ETH Zürich (D-ITET) October, 19 2017 Lst week ws ll bout Context-Free Lnguges Context-Free Lnguges superset
More informationI. Theory of Automata II. Theory of Formal Languages III. Theory of Turing Machines
CI 3104 /Winter 2011: Introduction to Forml Lnguges Chter 13: Grmmticl Formt Chter 13: Grmmticl Formt I. Theory of Automt II. Theory of Forml Lnguges III. Theory of Turing Mchines Dr. Neji Zgui CI3104-W11
More informationCHAPTER 1 Regular Languages. Contents
Finite Automt (FA or DFA) CHAPTE 1 egulr Lnguges Contents definitions, exmples, designing, regulr opertions Non-deterministic Finite Automt (NFA) definitions, euivlence of NFAs nd DFAs, closure under regulr
More informationCSCI 340: Computational Models. Kleene s Theorem. Department of Computer Science
CSCI 340: Computtionl Models Kleene s Theorem Chpter 7 Deprtment of Computer Science Unifiction In 1954, Kleene presented (nd proved) theorem which (in our version) sttes tht if lnguge cn e defined y ny
More informationNondeterministic Biautomata and Their Descriptional Complexity
Nondeterministic Biutomt nd Their Descriptionl Complexity Mrkus Holzer nd Sestin Jkoi Institut für Informtik Justus-Lieig-Universität Arndtstr. 2, 35392 Gießen, Germny 23. Theorietg Automten und Formle
More informationDFA minimisation using the Myhill-Nerode theorem
DFA minimistion using the Myhill-Nerode theorem Johnn Högerg Lrs Lrsson Astrct The Myhill-Nerode theorem is n importnt chrcteristion of regulr lnguges, nd it lso hs mny prcticl implictions. In this chpter,
More informationHow to simulate Turing machines by invertible one-dimensional cellular automata
How to simulte Turing mchines by invertible one-dimensionl cellulr utomt Jen-Christophe Dubcq Déprtement de Mthémtiques et d Informtique, École Normle Supérieure de Lyon, 46, llée d Itlie, 69364 Lyon Cedex
More informationCS 267: Automated Verification. Lecture 8: Automata Theoretic Model Checking. Instructor: Tevfik Bultan
CS 267: Automted Verifiction Lecture 8: Automt Theoretic Model Checking Instructor: Tevfik Bultn LTL Properties Büchi utomt [Vrdi nd Wolper LICS 86] Büchi utomt: Finite stte utomt tht ccept infinite strings
More informationFormal Methods in Software Engineering
Forml Methods in Softwre Engineering Lecture 09 orgniztionl issues Prof. Dr. Joel Greenyer Decemer 9, 2014 Written Exm The written exm will tke plce on Mrch 4 th, 2015 The exm will tke 60 minutes nd strt
More informationModule 9: Tries and String Matching
Module 9: Tries nd String Mtching CS 240 - Dt Structures nd Dt Mngement Sjed Hque Veronik Irvine Tylor Smith Bsed on lecture notes by mny previous cs240 instructors Dvid R. Cheriton School of Computer
More informationModule 9: Tries and String Matching
Module 9: Tries nd String Mtching CS 240 - Dt Structures nd Dt Mngement Sjed Hque Veronik Irvine Tylor Smith Bsed on lecture notes by mny previous cs240 instructors Dvid R. Cheriton School of Computer
More informationRefined interfaces for compositional verification
Refined interfces for compositionl verifiction Frédéric Lng INRI Rhône-lpes http://www.inrilpes.fr/vsy Motivtion Enumertive verifiction of concurrent systems Prllel composition of synchronous processes
More informationGrammar. Languages. Content 5/10/16. Automata and Languages. Regular Languages. Regular Languages
5//6 Grmmr Automt nd Lnguges Regulr Grmmr Context-free Grmmr Context-sensitive Grmmr Prof. Mohmed Hmd Softwre Engineering L. The University of Aizu Jpn Regulr Lnguges Context Free Lnguges Context Sensitive
More informationState Minimization for DFAs
Stte Minimiztion for DFAs Red K & S 2.7 Do Homework 10. Consider: Stte Minimiztion 4 5 Is this miniml mchine? Step (1): Get rid of unrechle sttes. Stte Minimiztion 6, Stte is unrechle. Step (2): Get rid
More informationA tutorial on sequential functions
A tutoril on sequentil functions Jen-Éric Pin LIAFA, CNRS nd University Pris 7 30 Jnury 2006, CWI, Amsterdm Outline (1) Sequentil functions (2) A chrcteriztion of sequentil trnsducers (3) Miniml sequentil
More informationCS 275 Automata and Formal Language Theory
CS 275 Automt nd Forml Lnguge Theory Course Notes Prt II: The Recognition Problem (II) Chpter II.6.: Push Down Automt Remrk: This mteril is no longer tught nd not directly exm relevnt Anton Setzer (Bsed
More informationCS 188: Artificial Intelligence Spring 2007
CS 188: Artificil Intelligence Spring 2007 Lecture 3: Queue-Bsed Serch 1/23/2007 Srini Nrynn UC Berkeley Mny slides over the course dpted from Dn Klein, Sturt Russell or Andrew Moore Announcements Assignment
More informationLTL Translation Improvements in Spot
LTL Trnsltion Improvements in Spot Alexndre Duret-Lutz http://www.lrde.epit.fr/~dl/ VECoS'11 16 September 2011 Alexndre Duret-Lutz LTL Trnsltion Improvements 1 / 19 Context High-level
More informationMore on automata. Michael George. March 24 April 7, 2014
More on utomt Michel George Mrch 24 April 7, 2014 1 Automt constructions Now tht we hve forml model of mchine, it is useful to mke some generl constructions. 1.1 DFA Union / Product construction Suppose
More informationNFAs continued, Closure Properties of Regular Languages
Algorithms & Models of Computtion CS/ECE 374, Fll 2017 NFAs continued, Closure Properties of Regulr Lnguges Lecture 5 Tuesdy, Septemer 12, 2017 Sriel Hr-Peled (UIUC) CS374 1 Fll 2017 1 / 31 Regulr Lnguges,
More informationCS 275 Automata and Formal Language Theory
CS 275 utomt nd Forml Lnguge Theory Course Notes Prt II: The Recognition Prolem (II) Chpter II.5.: Properties of Context Free Grmmrs (14) nton Setzer (Bsed on ook drft y J. V. Tucker nd K. Stephenson)
More informationCMSC 330: Organization of Programming Languages
CMSC 330: Orgniztion of Progrmming Lnguges Finite Automt 2 CMSC 330 1 Types of Finite Automt Deterministic Finite Automt (DFA) Exctly one sequence of steps for ech string All exmples so fr Nondeterministic
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationCSCI FOUNDATIONS OF COMPUTER SCIENCE
1 CSCI- 2200 FOUNDATIONS OF COMPUTER SCIENCE Spring 2015 My 7, 2015 2 Announcements Homework 9 is due now. Some finl exm review problems will be posted on the web site tody. These re prcqce problems not
More informationCS 330 Formal Methods and Models
CS 330 Forml Methods nd Models Dn Richrds, section 003, George Mson University, Fll 2017 Quiz Solutions Quiz 1, Propositionl Logic Dte: Septemer 7 1. Prove (p q) (p q), () (5pts) using truth tles. p q
More informationDesigning finite automata II
Designing finite utomt II Prolem: Design DFA A such tht L(A) consists of ll strings of nd which re of length 3n, for n = 0, 1, 2, (1) Determine wht to rememer out the input string Assign stte to ech of
More informationNFAs and Regular Expressions. NFA-ε, continued. Recall. Last class: Today: Fun:
CMPU 240 Lnguge Theory nd Computtion Spring 2019 NFAs nd Regulr Expressions Lst clss: Introduced nondeterministic finite utomt with -trnsitions Tody: Prove n NFA- is no more powerful thn n NFA Introduce
More informationTuring Machines Part One
Turing Mchines Prt One Hello Hello Condensed Condensed Slide Slide Reders! Reders! Tody s Tody s lecture lecture consists consists lmost lmost exclusively exclusively of of nimtions nimtions of of Turing
More informationSpeech Recognition Lecture 2: Finite Automata and Finite-State Transducers. Mehryar Mohri Courant Institute and Google Research
Speech Recognition Lecture 2: Finite Automt nd Finite-Stte Trnsducers Mehryr Mohri Cournt Institute nd Google Reserch mohri@cims.nyu.com Preliminries Finite lphet Σ, empty string. Set of ll strings over
More informationThis lecture covers Chapter 8 of HMU: Properties of CFLs
This lecture covers Chpter 8 of HMU: Properties of CFLs Turing Mchine Extensions of Turing Mchines Restrictions of Turing Mchines Additionl Reding: Chpter 8 of HMU. Turing Mchine: Informl Definition B
More informationA likelihood-ratio test for identifying probabilistic deterministic real-time automata from positive data
A likelihood-rtio test for identifying proilistic deterministic rel-time utomt from positive dt Sicco Verwer 1, Mthijs de Weerdt 2, nd Cees Witteveen 2 1 Eindhoven University of Technology 2 Delft University
More informationPrefix-Free Subsets of Regular Languages and Descriptional Complexity
Prefix-Free Susets of Regulr Lnguges nd Descriptionl Complexity Jozef Jirásek Jurj Šeej DCFS 2015 Prefix-Free Susets of Regulr Lnguges nd Descriptionl Complexity Jozef Jirásek, Jurj Šeej 1/22 Outline Mximl
More informationTuring Machines Part One
Turing Mchines Prt One Wht problems cn we solve with computer? Regulr Lnguges CFLs Lnguges recognizble by ny fesible computing mchine All Lnguges Tht sme drwing, to scle. All Lnguges The Problem Finite
More informationFor convenience, we rewrite m2 s m2 = m m m ; where m is repeted m times. Since xyz = m m m nd jxyj»m, we hve tht the string y is substring of the fir
CSCI 2400 Models of Computtion, Section 3 Solutions to Homework 4 Problem 1. ll the solutions below refer to the Pumping Lemm of Theorem 4.8, pge 119. () L = f n b l k : k n + lg Let's ssume for contrdiction
More informationFaster Regular Expression Matching. Philip Bille Mikkel Thorup
Fster Regulr Expression Mtching Philip Bille Mikkel Thorup Outline Definition Applictions History tour of regulr expression mtching Thompson s lgorithm Myers lgorithm New lgorithm Results nd extensions
More informationHarvard University Computer Science 121 Midterm October 23, 2012
Hrvrd University Computer Science 121 Midterm Octoer 23, 2012 This is closed-ook exmintion. You my use ny result from lecture, Sipser, prolem sets, or section, s long s you quote it clerly. The lphet is
More informationa b b a pop push read unread
A Finite Automton A Pushdown Automton 0000 000 red unred b b pop red unred push 2 An Exmple A Pushdown Automton Recll tht 0 n n not regulr. cn push symbols onto the stck cn pop them (red them bck) lter
More informationFormal Languages and Automata
Moile Computing nd Softwre Engineering p. 1/5 Forml Lnguges nd Automt Chpter 2 Finite Automt Chun-Ming Liu cmliu@csie.ntut.edu.tw Deprtment of Computer Science nd Informtion Engineering Ntionl Tipei University
More information13 Learning with Queries
13 Lerning with Queries Among the more interesting remining theoreticl questions re: inference in the presence of noise, generl strtegies for interctive presenttion nd the inference of systems with semntics.
More informationNon-deterministic Finite Automata
Non-deterministic Finite Automt From Regulr Expressions to NFA- Eliminting non-determinism Rdoud University Nijmegen Non-deterministic Finite Automt H. Geuvers nd J. Rot Institute for Computing nd Informtion
More informationChapter Five: Nondeterministic Finite Automata. Formal Language, chapter 5, slide 1
Chpter Five: Nondeterministic Finite Automt Forml Lnguge, chpter 5, slide 1 1 A DFA hs exctly one trnsition from every stte on every symol in the lphet. By relxing this requirement we get relted ut more
More informationCISC 4090 Theory of Computation
9/6/28 Stereotypicl computer CISC 49 Theory of Computtion Finite stte mchines & Regulr lnguges Professor Dniel Leeds dleeds@fordhm.edu JMH 332 Centrl processing unit (CPU) performs ll the instructions
More informationReinforcement Learning
Reinforcement Lerning Tom Mitchell, Mchine Lerning, chpter 13 Outline Introduction Comprison with inductive lerning Mrkov Decision Processes: the model Optiml policy: The tsk Q Lerning: Q function Algorithm
More informationFormal languages, automata, and theory of computation
Mälrdlen University TEN1 DVA337 2015 School of Innovtion, Design nd Engineering Forml lnguges, utomt, nd theory of computtion Thursdy, Novemer 5, 14:10-18:30 Techer: Dniel Hedin, phone 021-107052 The exm
More informationInference of regular expressions/grammars for given data entities
Inference of regulr expressions/grmmrs for given dt entities Lis Busser University of Kiserslutern, Embedded Systems Group l busser13@cs.uni-kl.de Abstrct We consider three different lgorithmic ides to
More informationSpeech Recognition Lecture 2: Finite Automata and Finite-State Transducers
Speech Recognition Lecture 2: Finite Automt nd Finite-Stte Trnsducers Eugene Weinstein Google, NYU Cournt Institute eugenew@cs.nyu.edu Slide Credit: Mehryr Mohri Preliminries Finite lphet, empty string.
More informationCS103B Handout 18 Winter 2007 February 28, 2007 Finite Automata
CS103B ndout 18 Winter 2007 Ferury 28, 2007 Finite Automt Initil text y Mggie Johnson. Introduction Severl childrens gmes fit the following description: Pieces re set up on plying ord; dice re thrown or
More informationA New Grey-rough Set Model Based on Interval-Valued Grey Sets
Proceedings of the 009 IEEE Interntionl Conference on Systems Mn nd Cybernetics Sn ntonio TX US - October 009 New Grey-rough Set Model sed on Intervl-Vlued Grey Sets Wu Shunxing Deprtment of utomtion Ximen
More information