Supervisory Control under Partial Observation

Similar documents
Abstraction of Nondeterministic Automata Rong Su

On the Maximally-Permissive Range Control Problem in Partially-Observed Discrete Event Systems

arxiv: v1 [cs.fl] 13 Jul 2018

CS311 Computational Structures Regular Languages and Regular Grammars. Lecture 6

Prefix-Free Regular-Expression Matching

Non Deterministic Automata. Linz: Nondeterministic Finite Accepters, page 51

NON-DETERMINISTIC FSA

Technische Universität München Winter term 2009/10 I7 Prof. J. Esparza / J. Křetínský / M. Luttenberger 11. Februar Solution

CS 275 Automata and Formal Language Theory

Nondeterminism. Nondeterministic Finite Automata. Example: Moves on a Chessboard. Nondeterminism (2) Example: Chessboard (2) Formal NFA

CS 573 Automata Theory and Formal Languages

Regular languages refresher

Chapter 4 Regular Grammar and Regular Sets. (Solutions / Hints)

State Minimization for DFAs

Theory of Computation Regular Languages. (NTU EE) Regular Languages Fall / 38

For convenience, we rewrite m2 s m2 = m m m ; where m is repeted m times. Since xyz = m m m nd jxyj»m, we hve tht the string y is substring of the fir

Strong Bisimulation. Overview. References. Actions Labeled transition system Transition semantics Simulation Bisimulation

Chapter 2 Finite Automata

Supervisory Control: Advanced Theory and Applications

Chapter Five: Nondeterministic Finite Automata. Formal Language, chapter 5, slide 1

Non-Deterministic Finite Automata. Fall 2018 Costas Busch - RPI 1

Introduction to Group Theory

Regular expressions, Finite Automata, transition graphs are all the same!!

Fundamentals of Computer Science

Nondeterministic Automata vs Deterministic Automata

Theory of Computation Regular Languages

Logic Synthesis and Verification

Logic, Set Theory and Computability [M. Coppenbarger]

Homework 3 Solutions

Chapter 4 State-Space Planning

CS 301. Lecture 04 Regular Expressions. Stephen Checkoway. January 29, 2018

Coalgebra, Lecture 15: Equations for Deterministic Automata

Bisimulation, Games & Hennessy Milner logic

Probabilistic Model Checking Michaelmas Term Dr. Dave Parker. Department of Computer Science University of Oxford

Project 6: Minigoals Towards Simplifying and Rewriting Expressions

a,b a 1 a 2 a 3 a,b 1 a,b a,b 2 3 a,b a,b a 2 a,b CS Determinisitic Finite Automata 1

State Complexity of Union and Intersection of Binary Suffix-Free Languages

Centrum voor Wiskunde en Informatica REPORTRAPPORT. Supervisory control for nondeterministic systems

Behavior Composition in the Presence of Failure

NFAs and Regular Expressions. NFA-ε, continued. Recall. Last class: Today: Fun:

CONTROLLABILITY and observability are the central

Non-deterministic Finite Automata

1.4 Nonregular Languages

System Validation (IN4387) November 2, 2012, 14:00-17:00

CMSC 330: Organization of Programming Languages

CS 373, Spring Solutions to Mock midterm 1 (Based on first midterm in CS 273, Fall 2008.)

Automatic Synthesis of New Behaviors from a Library of Available Behaviors

Finite-State Automata: Recap

CSCI FOUNDATIONS OF COMPUTER SCIENCE

1. For each of the following theorems, give a two or three sentence sketch of how the proof goes or why it is not true.

C. C^mpenu, K. Slom, S. Yu upper boun of mn. So our result is tight only for incomplete DF's. For restricte vlues of m n n we present exmples of DF's

Hybrid Systems Modeling, Analysis and Control

Types of Finite Automata. CMSC 330: Organization of Programming Languages. Comparing DFAs and NFAs. NFA for (a b)*abb.

Lecture 6 Regular Grammars

Types of Finite Automata. CMSC 330: Organization of Programming Languages. Comparing DFAs and NFAs. Comparing DFAs and NFAs (cont.) Finite Automata 2

NFA DFA Example 3 CMSC 330: Organization of Programming Languages. Equivalence of DFAs and NFAs. Equivalence of DFAs and NFAs (cont.

The University of Nottingham SCHOOL OF COMPUTER SCIENCE A LEVEL 2 MODULE, SPRING SEMESTER MACHINES AND THEIR LANGUAGES ANSWERS

11.1 Finite Automata. CS125 Lecture 11 Fall Motivation: TMs without a tape: maybe we can at least fully understand such a simple model?

Running an NFA & the subset algorithm (NFA->DFA) CS 350 Fall 2018 gilray.org/classes/fall2018/cs350/

CS 2204 DIGITAL LOGIC & STATE MACHINE DESIGN SPRING 2014

Extended nonlocal games from quantum-classical games

Unfoldings of Networks of Timed Automata

f (x)dx = f(b) f(a). a b f (x)dx is the limit of sums

The Regulated and Riemann Integrals

Learning Partially Observable Markov Models from First Passage Times

On Implicative and Strong Implicative Filters of Lattice Wajsberg Algebras

Green s Theorem. (2x e y ) da. (2x e y ) dx dy. x 2 xe y. (1 e y ) dy. y=1. = y e y. y=0. = 2 e

Automata and Languages

Speech Recognition Lecture 2: Finite Automata and Finite-State Transducers. Mehryar Mohri Courant Institute and Google Research

Introduction to ω-autamata

Refined interfaces for compositional verification

Grammar. Languages. Content 5/10/16. Automata and Languages. Regular Languages. Regular Languages

2.4 Theoretical Foundations

CS375: Logic and Theory of Computing

CMSC 330: Organization of Programming Languages. DFAs, and NFAs, and Regexps (Oh my!)

Deterministic Finite Automata

CMPSCI 250: Introduction to Computation. Lecture #31: What DFA s Can and Can t Do David Mix Barrington 9 April 2014

The Double Integral. The Riemann sum of a function f (x; y) over this partition of [a; b] [c; d] is. f (r j ; t k ) x j y k

Petri Nets. Rebecca Albrecht. Seminar: Automata Theory Chair of Software Engeneering

CSC 473 Automata, Grammars & Languages 11/9/10

Closure Properties of Regular Languages

Compression of Palindromes and Regularity.

ɛ-closure, Kleene s Theorem,

Homework 4. 0 ε 0. (00) ε 0 ε 0 (00) (11) CS 341: Foundations of Computer Science II Prof. Marvin Nakayama

Graph Theory. Dr. Saad El-Zanati, Faculty Mentor Ryan Bunge Graduate Assistant Illinois State University REU. Graph Theory

Finite Automata-cont d

Harvard University Computer Science 121 Midterm October 23, 2012

Handout: Natural deduction for first order logic

Tutorial Worksheet. 1. Find all solutions to the linear system by following the given steps. x + 2y + 3z = 2 2x + 3y + z = 4.

Lecture 08: Feb. 08, 2019

Intermediate Math Circles Wednesday, November 14, 2018 Finite Automata II. Nickolas Rollick a b b. a b 4

3 Regular expressions

Finite Automata. Informatics 2A: Lecture 3. John Longley. 22 September School of Informatics University of Edinburgh

Anatomy of a Deterministic Finite Automaton. Deterministic Finite Automata. A machine so simple that you can understand it in less than one minute

1 PYTHAGORAS THEOREM 1. Given a right angled triangle, the square of the hypotenuse is equal to the sum of the squares of the other two sides.

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Lecture Summaries for Multivariable Integral Calculus M52B

Myhill-Nerode Theorem

Finite State Automata and Determinisation

Speech Recognition Lecture 2: Finite Automata and Finite-State Transducers

Transcription:

Supervisory Control under Prtil Observtion Dr Rong Su S1-B1b-59, Shool of EEE Nnyng Tehnologil University Tel: +65 6790-6042, Emil: rsu@ntu.edu.sg EE6226 Disrete Event Dynmi Systems 1

Outline Motivtion The Conept of Observbility Supervisor Synthesis under Prtil Observtion Exmple Conlusions EE6226 Disrete Event Dynmi Systems 2

Three Min Conepts in Control Controllbility llows you to improve the dynmis of system by feedbk e.g. ontrollbility in the RW supervisory ontrol theory Observbility llows you to deploy suh feedbk by using the system's output Optimlity gives rise to forml methods of ontrol synthesis e.g. supremlity in the RW supervisory ontrol theory EE6226 Disrete Event Dynmi Systems 3

Exmple G d b b Σ={,b,,d} Σ ={b,d} S d b EE6226 Disrete Event Dynmi Systems 4

Exmple (ont.) G b d:unobservble b Σ={,b,,d} Σ ={b,d} S d b EE6226 Disrete Event Dynmi Systems 5

Some Intuitions Supervisor n only t upon reeiving observble events Prtil observtion fores supervisor to be onservtive We n enble or disble n unobservble event EE6226 Disrete Event Dynmi Systems 6

Outline Motivtion The Conept of Observbility Supervisor Synthesis under Prtil Observtion Exmple Conlusions EE6226 Disrete Event Dynmi Systems 7

Observbility Given G φ(σ), let Σ o Σ nd P:Σ * Σ o * be the nturl projetion. A lnguge K L(G) is (G,P)-observble, if ( s K)( σ Σ) sσ L(G) K P -1 P(s)σ K= b b Σ o = {b} EE6226 Disrete Event Dynmi Systems 8

Or equivlently K L(G) is (G,P)-observble, if for ny s K, sʹ Σ * nd σ Σ, sσ L(G) K sʹσ L(G) P(s)=P(sʹ) sʹσ L(G) K or equivlently, sσ K sʹσ L(G) P(s)=P(sʹ) sʹσ K (Think bout why they re equivlent) EE6226 Disrete Event Dynmi Systems 9

Exmple 1 d Σ = {,b,,d} Σ o = {} K ={, b} K b Question: is K (G,P)-observble? yes EE6226 Disrete Event Dynmi Systems 10

Exmple 2 d Σ = {,b,,d} Σ o = {} K ={, b} K b d Question: is K (G,P)-observble? no EE6226 Disrete Event Dynmi Systems 11

Exmple 3 d Σ = {,b,,d} Σ o = {,} K ={, b} K b d Question: is K (G,P)-observble? yes EE6226 Disrete Event Dynmi Systems 12

(G,P)-observbility is deidble. But how? EE6226 Disrete Event Dynmi Systems 13

Proedure of Cheking Observbility : Step 1 Let G = (X,Σ,ξ,x 0,X m ) Suppose K is reognized by A = (Y,Σ,η,y 0,Y m ), i.e. K=L m (A) Let A' = G A = (X Y,Σ,ξ η,(x 0,y 0 ),X m Y m ) Sine K=L(A) L(G), we hve L(G A)=L(A) A stte (x,y) X Y is boundry stte of A' w.r.t. G, if ( s L(A')) ξ η((x 0,y 0 ),s)=(x,y), i.e. (x,y) is rehble from (x 0,y 0 ) ( σ Σ) ξ(x,σ)! η(y,σ)!, where! denotes is defined Let B be the olletion of ll boundry sttes of A' w.r.t. G B is finite set. (Why?) EE6226 Disrete Event Dynmi Systems 14

Proedure of Cheking Observbility : Step 2 For eh boundry stte (x,y) B, we define two sets T(x,y) := {s L(A') ξ η((x 0,y 0 ),s)=(x,y)} (T(x,y) is regulr, why?) Σ(x,y) := {σ Σ ξ(x,σ)! η(y,σ)!} Theorem K is observble w.r.t. G nd P, iff for ny boundry stte (x,y) B, P -1 P(T(x,y))Σ(x,y) K = EE6226 Disrete Event Dynmi Systems 15

Exmple d 2 2 Σ = {,b,,d} Σ o = {} K ={, b} 0 3 0 3 b b 1 G A 1 EE6226 Disrete Event Dynmi Systems 16

Exmple Step 1 d Σ = {,b,,d} Σ o = {} K ={, b} (0,0) b A'=G A (2,2) (1,1) (3,3) B={(1,1), (2,2)} EE6226 Disrete Event Dynmi Systems 17

Exmple Step 2 For the boundry stte (1,1) we hve T(1,1) = {b} Σ(1,1) = {} P -1 P(T(1,1))Σ(1,1) K = {b,} {,b} = {} For the boundry stte (2,2) we hve T(2,2) = {} Σ(2,2) = {d} P -1 P(T(2,2))Σ(2,2) K = {d} {,b} = K is not observble w.r.t. G nd P (0,0) b d (2,2) (1,1) (3,3) EE6226 Disrete Event Dynmi Systems 18

Properties of Observble Lnguges Suppose K 1 nd K 2 re losed, observble w.r.t. G nd P. Then K 1 K 2 is observble w.r.t. G nd P K 1 K 2 my not be observble w.r.t. G nd P Given plnt G, let O(G):={K L(G) K is losed nd observble w.r.t. G nd P} The prtilly ordered set (poset) (O(G), ) is meet-semi-lttie The gretest element my not exist (i.e. no supreml observble sublnguge) EE6226 Disrete Event Dynmi Systems 19

Exmple Σ={,b,,d,e} b e e Σ o ={} d d e G K 1 K 2 K 1 K 2 is observble, but K 1 K 2 is not. (Why?) EE6226 Disrete Event Dynmi Systems 20

Outline Motivtion The Conept of Observbility Supervisor Synthesis under Prtil Observtion Exmple Conlusions EE6226 Disrete Event Dynmi Systems 21

Min Existene Result Theorem 1 Let K L m (G) nd K. There exists proper supervisor iff K is ontrollble with respet to G K is observble with respet to G nd P K is L m (G)-losed, i.e. K = K L m (G) EE6226 Disrete Event Dynmi Systems 22

Supervision under Prtil Observtion Suppose K is ontrollble, observble nd L m (G)-losed. Let A=(Y,Σ o,η,y 0,Y m ) be the nonil reognizer of P(K). We onstrut new utomton S=(Y,Σ,λ,y 0,Y m ) s follow: For ny y Y, n event σ Σ Σ o is ontrol-relevnt w.r.t. y nd K, if ( s K) η(y 0,P(s))=y sσ K Let Σ(y) be the olletion of ll events in Σ Σ o ontrol-relevnt w.r.t. y, K We define the trnsition mp λ:y Σ Y s follows: λ is the sme s η over Y Σ o For ny y Y nd σ Σ(y), define λ(y,σ):=y (i.e. selfloop ll events of Σ(y) t y) For ll other (y,σ) pirs, λ(y,σ) is undefined S is proper supervisor of G under PO suh tht L m (S/G)=K EE6226 Disrete Event Dynmi Systems 23

Exmple d Σ = {,b,,d} Σ o = {} K ={, b} A, b b b S G K L m (S/G)=K? EE6226 Disrete Event Dynmi Systems 24

Diffiulty of Synthesis Given plnt G nd speifition SPEC, let O(G,SPEC):={K L m (G) L m (SPEC) K is ontrollble nd observble} Unfortuntely, there is no supreml element in O(G,SPEC). EE6226 Disrete Event Dynmi Systems 25

Solution 1: A New Supervisory Control Problem Given G, suppose we hve A E L(G) nd Σ=Σ o Σ. To synthesize supervisor S under prtil observtion suh tht A L(S/G) E (*) Let O(A) := {K A K is losed nd observble w.r.t. G nd P} Let C(E) := {K E K is losed nd ontrollble w.r.t. G} Theorem (Feng Lin) Assume A. The (*) problem hs solution S iff inf O(A) sup C(E) EE6226 Disrete Event Dynmi Systems 26

Solution 2 : The Conept of Normlity Given N M Σ *, we sy N is (M,P)-norml if N = M P -1 P(N) In prtiulr, tke N=M P -1 (K) for ny K Σ o*. Then N is (M,P)-norml. ( s 1,s 2 M) (s 1,s 2 ) ker P P(s 1 )=P(s 2 ) N/ker P M/ker P M EE6226 Disrete Event Dynmi Systems 27

Properties of Normlity Let N(E ; M) := {N E N is (M,P)-norml} for some E Σ * The poset (N(E ; M), ) is omplete lttie The union of (M,P)-norml sublnguges is norml (intuitive explntion?) The intersetion of (M,P)-norml sublnguges is norml (intuitive explntion?) Lin-Brndt formul : sup N(E ; M) = E P -1 P(M E) In TCT : N = Supnorm(E,M,Null/Imge) Let E L m (G), nd N(E ; L(G)):={N E N is (L(G),P)-norml} N(E ; M) is losed under rbitrry unions, but not under intersetions EE6226 Disrete Event Dynmi Systems 28

Reltionship between Normlity nd Observbility Let K L m (G). Then K is (L(G), P)-norml K is observble w.r.t. G nd P Let Σ(K) := {σ Σ ( s K) sσ L(G) K} Σ(K) is the olletion of ll boundry events of K w.r.t. G K is observble w.r.t. G, P Σ(K) Σ o K is (L(G),P)-norml EE6226 Disrete Event Dynmi Systems 29

Supervisory Control under Normlity Given plnt G nd speifition E, let C(G,E) := {K L m (G) L m (E) K is ontrollble w.r.t. G} We define new set S(G,E) := {K Σ * K C(G,E) N(L m (E),L(G)) L m (G)-losed} S(G,E) is nonempty nd losed under rbitrry unions. sup S(G,E) exists Supervisory Control nd Observtion Problem (SCOP) to ompute proper supervisor S under prtil observtion suh tht L m (S/G) = sup S(G,E) EE6226 Disrete Event Dynmi Systems 30

The TCT Proedure for SCOP Given plnt G nd speifition E, let A = Supsop(E,G,Null/Imge) L m (A) = sup S(G,E) Bsed on A, we onstrut proper supervisor S under prtil observtion Why n we do tht? Beuse sup S(G,E) is ontrollble nd observble EE6226 Disrete Event Dynmi Systems 31

Outline Motivtion The Conept of Observbility Supervisor Synthesis under Prtil Observtion Exmple Conlusions EE6226 Disrete Event Dynmi Systems 32

Wrehouse Collision Control Cr 1 Reeiving Dok Cr 2 Trffi Light Trk 1 Trk 2 Trk 3 Trk 4 Sensor Dispthing Dok EE6226 Disrete Event Dynmi Systems 33

Plnt Model Enter Trk 1 Enter Trk 2 Enter Trk 3 Enter Trk 4 C 1 C 2 11 12 13 15 0 1 2 3 4 21 22 23 25 Σ 1 = {11, 12, 13, 15}, Σ 1, = {11, 13, 15}, Σ 1,o = {11, 15} Σ 2 = {21, 22, 23, 25}, Σ 2, = {21, 23, 25}, Σ 2,o = {21, 25} EE6226 Disrete Event Dynmi Systems 34

Speifition To void ollision, C 1 nd C 2 n t reh the sme stte together Sttes (1,1), (2,2), (3,3) should be voided in C 1 C 2 EE6226 Disrete Event Dynmi Systems 35

Synthesis Proedure in TCT Crete the plnt G = Syn(C 1,C 2 ) (25 ; 40) Crete the speifition E = mutex(c 1,C 2,[(1,1),(2,2),(3,3)]) (20 ; 24) Supervisor Synthesis K = Supsop(E,G,[12,13,22,23]) (16 ; 16) EE6226 Disrete Event Dynmi Systems 36

Trnsition Struture of K 11 12 13 15 21 21 22 22 23 23 25 11 12 13 15 25 EE6226 Disrete Event Dynmi Systems 37

A Proper Supervisor S under Prtil Observtion 11 12,13 15 21 21 22,23 22,23 K = L m (S/G) 25 11 15 25 12,13 EE6226 Disrete Event Dynmi Systems 38

Some Ft Perform the following TCT opertion W = Condt(G,K) Only events 11 nd 21 re required to be disbled. Therefore, we only need one trffi light t Trk 1. EE6226 Disrete Event Dynmi Systems 39

A Slight Modifition Cr 1 Reeiving Dok Cr 2 Trffi Light Trk 1 Trk 2 Trk 3 Trk 4 Sensor Dispthing Dok Σ 1,o = {11, 15} Σ 2,o = {21, 25} Σ 1,o = {11, 13} Σ 2,o = {21, 23} EE6226 Disrete Event Dynmi Systems 40

Synthesis Result Crete the plnt G = Syn(C 1,C 2 ) (25 ; 40) Crete the speifition E = Mutex(C 1,C 2,[(1,1),(2,2),(3,3)]) (20 ; 24) Supervisor Synthesis K = Supsop(E,G,[12,15,22,25]) (empty) Explin intuitively why this n hppen (homework) EE6226 Disrete Event Dynmi Systems 41

Conlusions Prtil observtion is importnt for implementtion. A supervisor n mke move only bsed on observtions. The urrent observbility is not losed under set union. Thus, there is no supreml observble sublnguge (unfortuntely). Normlity is losed under set union. Thus, the supreml norml sublnguge exists. But the onept of normlity is too onservtive. EE6226 Disrete Event Dynmi Systems 42