A Formal Approach for Contextual Planning Management: Application to Smart Campus Environment.

Size: px
Start display at page:

Download "A Formal Approach for Contextual Planning Management: Application to Smart Campus Environment."

Transcription

1 A Forml Approch for Contextul Plnning Mngement: Appliction to Smrt Cmpus Environment Ahmed-Chwki Chouche, Aml El Fllh Seghrouchni, Jen-Michel Ilié, Djmel Eddine Sïdouni To cite this version: Ahmed-Chwki Chouche, Aml El Fllh Seghrouchni, Jen-Michel Ilié, Djmel Eddine Sïdouni. A Forml Approch for Contextul Plnning Mngement: Appliction to Smrt Cmpus Environment. Bzzn, An L.C.; Pichr, Krim. the 14th edition of the Ibero-Americn Conference on Artificil Intelligence, Nov 2014, Sntigo, Chile. Springer, Advnces in Artificil Intelligence - IBERAMIA 2014, 8864, pp , 2014, Lecture Notes in Artificil Intelligence. < < / _64>. <hl > HAL Id: hl Submitted on 9 Dec 2014 HAL is multi-disciplinry open ccess rchive for the deposit nd dissemintion of scientific reserch documents, whether they re published or not. The documents my come from teching nd reserch institutions in Frnce or brod, or from public or privte reserch centers. L rchive ouverte pluridisciplinire HAL, est destinée u dépôt et à l diffusion de documents scientifiques de niveu recherche, publiés ou non, émnnt des étblissements d enseignement et de recherche frnçis ou étrngers, des lbortoires publics ou privés.

2 A Forml Approch for Contextul Plnning Mngement: Appliction to Smrt Cmpus Environment Ahmed-Chwki Chouche 1,2, Aml El Fllh Seghrouchni 1, Jen-Michel Ilié 1 nd Djmel Eddine Sïdouni 2 1 LIP6 Lbortory, University of Pierre nd Mrie Curie 4 Plce Jussieu, Pris, Frnce {hmed.chouche,ml.elfllh,jen-michel.ilie}@lip6.fr 2 MISC Lbortory, University Constntine 2 Ali Mendjeli Cmpus, Constntine, Algeri sidouni@misc-umc.org Abstrct. In this pper, we ddress the building of mbient systems s utonomous nd context-wre intelligent gents. The originl contribution is n lgebric lnguge, nmely AgLOTOS, used to utomticlly build the pln of n gent from its intentions. As plns re formlly conceived s structured set of concurrent processes, we show how to define guidnce service, helping the gent to mximize the stisfction of its intentions. The underlying structure, clled Contextul Plnning System (CPS), tkes the contextul informtion into ccount to predict the bility to execute the processes in plns. The lst prt of the pper tlks bout our current experiment integrting the proposed technique to ssist user in smrt cmpus university. Keywords: context-wreness, BDI gent, plnning lnguge, plnning guidnce, smrt cmpus. 1 Introduction Multi-gent System (MAS) pproches offer interesting frmeworks for the development of mbient intelligence (AmI) systems, since their gents re considered s intelligent, proctive nd utonomous [1]. This pper introduces n efficient plnning mngement process into the rchitecture of the gent. In prticulr, we im t offering to ech AmI gent, powerful predictive service. Like in other recent MAS pproches, e.g. [2, 3], which re dedicted to the plnning nd the vlidtion of gents in MAS, we focus on one gent rther thn on the whole MAS. Regrding AmI systems, this eses us to consider whtever dynmic fetures in the environment for the gents nd to propose solutions consistent with the openness of the system. Belief-Desire-Intention (BDI) re well-known intentionl structure emphsizing the resoning tsks of the gent, up to obtin rtionlity properties. Such properties re relly pprecite in AmI systems since this enforces the confidence

3 on the system. The uthors of [4] took profit from the fct tht the pln of BDI gent cn be derived from its intentions, themselves resulting from the resoning of the BDI interpreter [5]. In this context, the AgLOTOS lnguge ws defined to specify the plns ccordingly to the following two criteri: (1) enhnce the modulr nd concurrent spects relted to the execution of plns, up to see the pln s composed of concurrent processes, (2) hndle the well-ordered composition of intentions, i.e. n gent cn ttribute weights to privilege execution with respect to some intentions. In this pper, the AgLOTOS lnguge is considered gin but its semntics is enriched to utomticlly produce stte trnsition structure, nmely Contextul Plnning System (CPS for short). The im is to cpture the evolution of the pln in predictive wy, mening tht ctions re supposed to be run successfully, but lso tht the context of the gent cn evolve under the execution of ctions. Automtic serches on this structure will llow us to propose guidnce services, prticulrly helpful for the decision of gent in expected contexts. Moreover, we im t showing how our forml pproch cn be embedded in the development of the AmI gents. To our opinion, this contributes to mking the opertionl bridge between AmI softwre engineering nd forml pproches. Our project consisting in the design of smrt university cmpus is the very right plce to embed our AmI gents rchitecture through flot of smrt-devices dedicted to ssisting users. In this project, the discovery of physicl loctions nd the moves of users re tken into ccount. Unlike pure MAS pproches, this cnnot be reduced to socil problem nd communiction between softwre gents. The outline of the pper is the following: Section 2 reclls the gent softwre rchitecture we consider, nmely the HoA rchitecture, nd its specific plnning lnguge used to ssocite plns with intentions. In Section 3, contextul plnning mngement is presented bsed on the building of the CPS structure. Section 4 detils the concrete stges of the smrt-cmpus project to conceive the AmI systems. A relistic scenrio is given s n illustrtion of the concepts proposed in the pper. The lst section concludes nd brings out our next perspectives. 2 The HoA Architecture nd its Plnning Lnguge Figure 1 highlights the gent rchitecture we consider for AmI systems. Clled Higher-order Agent rchitecture (HoA), it enhnces cler seprtion in three processes: The Context process is in chrge of the context informtion of the gent. It is triggered by new perceptions of the environment nd lso by internl events informing bout the executions of ctions. At low level, it is in chrge of observing the reliztion of the ction executions, in order to stte they re successfully chieved or not. The Mentl process corresponds to the resoning prt of the gent. It is notified by the context process so tht it cn be wre of the importnt context

4 Execution Context BDI Perc. Context Process Evt Plnning Mentl Process Process LibP internl event Actions Environment Fig. 1. Higher-order Agent rchitecture chnges nd cn provoke possible revisions of the beliefs (B), desires (D), nd intentions (I) dt. As highlighted in Figure 1, the mentl process represents the resoning mechnism, which mnges the BDI sttes of the gent. Triggered by the perceived events, it updtes the B,D nd I structures. In order to orgnize its selected intentions, the mentl process is ble to schedule them by ssociting with ech one given weight. The Plnning process is clled by the mentl process. Helped by librry of plns (LibP), it minly produces pln of ctions from the set of weighted intentions, but lso offers some services relted to the mngement of plns (see Section 3). Mentl process I Plnning process P Agent pln I = {i w0 0, iw1 1 {, },..., iwj j } P P P 0 1 j Intention plns P 0,0 P 0,1 P 0,k Elementry plns E 0,0 E 0,1 E 0,k Behvior expressions Fig. 2. Agent plnning structure In our pproch for ech BDI stte, the pln of the gent is described by using the AgLOTOS lnguge, s detiled in [4]. The lnguge itself extends the LOTOS lnguge [6] in order to specify concurrency between ctions in plns. In ddition s schemed by Figure 2, it refers to two level plnning structures: (1) the Agent pln is mde of sub-plns clled Intentions plns, ech one dedicted to chieve the ssocited selected intention; (2) ech intention pln is n lternte of severl sub-plns, clled Elementry plns, extrcted from the LibP librry. This llows one to consider different wys to chieve the ssocited intention.

5 Further, we ssume tht the LibP librry is indexed by the set of ll the possible intentions for the gent. Syntx of Elementry Plns. Ech elementry pln is specified by pir composed of nme to identify it nd n AgLOTOS expression to feture its behvior. Consider tht the nmes of elementry plns re rnged over P, Q,... nd tht the set of ll the possible behvior expressions is denoted E, rnged over E, F,... The AgLOTOS elementry expressions re written by composing (observble) ctions through the LOTOS opertors. The syntx of n elementry pln P is defined inductively s follows: P ::= E E ::= exit stop ; E E E ( O) hide L in E Elementry pln H ::= move(l) (H O, l Θ) x!(ν) x?(ν) (x Λ, ν M) = {, [L],, [ ],, [> } The expression of n elementry pln refers to (finite) set O of observble ctions which re prcticlly described s instntited predictes, below rnged over, b,... This set includes the subset H of the so-clled AmI primitives which represent the mobility nd communiction, bsed on the two following ssumptions bout the AmI system: (1) every gent cn perceive the enter nd leve of other gents in the AmI system, (2) it cn suggest some move between the AmI system loctions nd (3) it cn communicte with nother gent in the system. In the syntx, the primitive move(l) is used to represent the move of the ssisted user to some loction l (l Θ, finite set of loctions). The ction x!(ν) specifies the emission to the gent x (x Λ, the set of neighbor gents) of the messge ν (ν M, the set of possible messges), wheres, the expression x?(ν) mens tht the messge ν is received from some gent x. In ddition, two non-observble ctions re lso introduced, so tht the totl set of ctions is denoted Act = O {, δ}, where / O is the internl ction nd δ / O is prticulr observble ction which fetures the successful termintion of the considered elementry pln. The bsic expression stop specifies pln behvior without possible evolution nd exit represents the successful termintion of some pln. In the syntx, the set represents the stndrd LOTOS opertors: E [ ] E specifies non-deterministic choice, hide L in E hiding of the ctions of L tht pper in E with L being ny subset of O, E E sequentil composition nd E [> E the interruption. The LOTOS prllel composition, denoted E [L] E cn model both synchronous composition, E E if L = O, nd synchronous composition, E E if L =. In fct, the AgLOTOS lnguge exhibits rich expressivity such tht the sequentil executions of plns ppers to be only prticulr cse. Syntx of Agent Plns. The building of n gent pln requires dding the following AgLOTOS opertors to compose some elementry plns:

6 t the gent pln level, the prllel nd the sequentil composition opertors re used to build n gent pln from the intentions of the gent nd the ssocited weights. the lternte composition opertor, denoted, llows to specify n lternte of elementry plns. In prticulr, n intention is stisfied iff t lest one of the ssocited elementry plns is successfully terminted. Let P be the set of nmes used to identify the possible intention plns: P P nd let P be the set of nmes qulifying the possible gent plns: P P. P ::= P P P Intention pln P ::= P P P P P Agent pln With respect to the set of intentions I of the gent, the gent pln is formed in two steps: (1) by n extrction mechnism of elementry plns from the LibP librry, (2) by using the composition functions clled options nd pln: options : I P, yields for ny i I, n intention pln of the form P i = P libp (i) P. pln : 2 I P, cretes the finl gent pln P from the set of weighted intentions I. Depending on how I is ordered, the intention plns yielded by the different mppings P i = options(i) (i I) re composed by using the AgLOTOS composition opertors nd. The function weight : I N tht defines the weights of the intentions, in fct yields the wy to compose the corresponding intention plns. The intention plns corresponding to the sme weight re composed by using the concurrent prllel opertor. In contrst, the intention plns corresponding to distinct weights re ordered by using the sequentil opertor. For instnce, let I = {i 1 0, i 2 1, i 1 2, i 0 3} be the considered set of intentions, such tht the superscript informtion denotes weight vlue, nd let P 0, P 1, P 2, P 3 be their corresponding intention plns, the constructed gent pln could be viewed (t pln nme level) s: pln(i) = P 1 ( P 0 P 2 ) P 3. A Simple AmI Exmple. Let us consider the following AmI scenrio presented in [7], where Alice nd Bob re two users of some University, ech one ssisted by HoA softwre gent. The proposed problem of Alice is tht she cnnot mke the two following tsks in the sme time: (1) to meet with Bob in the loction l 1, nd (2) to get her exm copies from the loction l 2. Clerly, the Alice s desires re conflicting since Alice cnnot be in two distinct loctions simultneously. However, fter hving perceived tht Bob is in l 2, mening in the sme loction s the exm copies, Alice sks for his help to bring her the copies. The intentions of Alice nd Bob re specified seprtely within their respective gents. These lst ones cn pervsively coordinte to help chieving the intentions of their ssisted users. Here, the ctions in plns re simply expressed by using instntited predictes, like get copies(l 2 ). Intention plns re composed from elementry plns which re viewed s concurrent processes, terminted by exit, l LOTOS.

7 Alice s scenrio I A = {meeting(bob, l 1), sking(bob, get copies(l 2))} P A = Bob!(get copies(l 2)); exit meet(bob); exit Bob s scenrio I B = {meeting(alice, l 1), getting copies(l 2)} P B = get copies(l 2); exit move(l 1); meet(alice); exit The mentl process of n HoA gent cn order its set of intentions, ccording to some preferences of the ssisted user. For instnce, the intention set relted to Alice I A = {meeting(bob, l 1 ), sking(bob, get copies(l 2 ))} cn be ordered such tht weight(meeting(bob, l 1 )) < weight(sking(bob, get copies(l 2 )). The corresponding gent pln expression of Alice is: P A = Bob!(get copies(l 2 )); exit meet(bob); exit, which is built by using the options nd pln mppings. Py ttention tht some ctions cn be processed concurrently, so is the cse in the gent pln P B, for the intention plns get copies(l 2 ); exit nd move(l 1 ); meet(alice); exit. 3 Contextul Plnning System We show now how to build the Contextul Plnning System, denoted CPS for short, from the specifiction of n gent pln. It is trnsition system representing ll the possible evolutions of the pln. The building of these lst ones re formlly driven by semntics of AgLOTOS constrined by contextul informtion. As service instnce tht cn be defined t the plnning process level, guidnce mechnism is defined, tht works over the evolutions represented by the CPS. Building of the Contextul Plnning System. The AgLOTOS opertionl semntics is bsiclly derived from the one of LOTOS. A pir (E, P ) represents process identified by P, such tht its behvior expression is E. Bsic LOTOS semntics is detiled in [7] which formlizes how process cn evolve under the execution of ctions. In prticulr, the rule P :=E E E, specifies how P E (E, P ) pir is chnged to (E, P ) under ny ction. Actully, P := E mens to consider ny (E, P ) source pir nd P E mens chnging E to E for P under the execution of. As fr s AgLOTOS is concerned, these rules lso represent the opertionl semntics of elementry plns, viewed s processes. The next definition specifies how the expression of n gent pln is formed compositionlly from the expressions of the intentions plns of the gent, themselves built from n lternte of elementry plns nd their behvior expressions. With respect to some gent pln P, we introduce notion of configurtion of plns in order to specify tht prt of the pln cn lredy be executed. Further, the nottion [P ] represents the configurtion of the gent pln P, it is n AgLO- TOS expression, which is obtined by composition of the different intention pln configurtions of the gent, like (E, P ).

8 Definition 1. Any gent pln configurtion [P ] hs generic representtion defined by the following two rules: P ::= P P ::= k=1..n P k P k ::=E k [P ]::=( k=1..n E k, P ) P ::=P 1 P 2 {, } [P ]::=[P 1 ] [P 2 ] The plnning stte of the gent is now defined contextully, tking into ccount the gent loction nd the termintion informtion bout the different intention plns defined for the gent. Definition 2. A (contextul) plnning stte is tuple (C, l, T ), where C is n gent pln configurtion [P ], l corresponds to n expected loction for the gent, nd T is the subset of intention plns which will be terminted in this stte. Tble 1. Semntic rules of intention nd gent pln configurtions Intention pln level (Action) E E (E, P ) O {} (E, P ) E (E, P ) δ E (E, P ) Agent pln level (Action) (Communiction) (Mobility) (Sequence) (Prllel) C C (C,l,T ) C x!(ν) C (C,l,T ) O {} (C,l,T ) x!(ν) x Λ (C,l,T ) C move(l ) C l l (C,l,T ) move(l ) (C,l,T ) C 1 C 1 C 1 C 2 O {} C 1 C 2 C 1 C 1 O {} C 1 C 2 C 1 C 2 C 1 C 1 O {} C 2 C 1 C 2 C 1 (C,l,T ) C C C (C,l,T { P }) x?(ν) C (C,l,T ) x?(ν) x Λ (C,l,T ) C C move(l) (C,l,T ) (C,l,T ) C 1 C 1 C 2 C 1 C 1 C 2 C 1 C 2 C 1 C 1 C 1 C 2 C 1 C 1 C 2 C 1 C 2 C 1 Tble 1 shows the opertionl semntic rules defining the possible plnning stte chnges for the gent. These rules re pplied to produce the CP S, from n initil plnning stte, e.g. ([P ], l, ), mening tht the gent is initilly t

9 loction l, nd its pln configurtion is [P ]. There re two kinds of trnsition rules: Intention pln level: When n intention pln is ssumed to be treted, the left hnd side trnsition (C 1,, P, C 2 ), denoted C 1 C 2, expresses chnge of intention pln configurtion, from C 1 to C 2, nd ssumes the execution of the ction from E E nd P := E. The right hnd side trnsition highlights the termintion cse, keeping trce of the intention pln P tht is going to be terminted. By clling CN the set of ll the possible intention pln configurtions for the gent, the trnsition reltion is subset of CN O {} P CN. For ske of clrity, the trnsition (C 1,, nil, C 2 ) is simply denoted C 1 C 2. Observe tht due to the fct we consider predictive guidnce in this pper, only expected successful executions re tken into ccount, thus bstrcting tht pln my fil. Moreover, the semntics of the lternte opertor is reduced to simple non-deterministic choice of LOTOS: k=1..n E k [ ] k=1..n E k, in order to possibly tke into ccount every elementry pln to chieve the corresponding intention. Agent pln level: the possible chnges of the plnning sttes, like (C, l, T ), re expressed t this level. In the Communiction rules, the ction send x!(ν) (resp. receive x?(ν)) is constrined by the discovery of the gent x in its neighborhood. In the Mobility rule, the effect of the move(l ) ction yields the gent to be plced in l. The Action rules refer to the ones of the intention pln level. The left hnd side one exhibits the cse of regulr ction, wheres the right hnd side one specifies the termintion cse of some intention pln, which is dded to T. The building of the CPS tkes the three following contextul informtion into ccount: (1) the reched loction in plnning stte, (2) the set of intention plns tht re terminted when reching plnning stte, nd (3) more globlly, the set Λ of neighbors currently known by the gent. Definition 3. Let I be set of weighted intentions for the gent. The Contextul Plnning System (CP S) is lbeled kripke structure S, s 0, T r, L, T where: S is the set of (contextul) plnning sttes, s 0 = ([P ], l, ) S is the initil plnning stte of the gent, such tht [P ] is the gent pln configurtion of the gent nd l represents its current loction, T r S O {} S is the set of trnsitions which re denoted s s, L : S Θ is the loction lbeling function, T : S 2 P is the termintion lbeling function which cptures the terminted intention plns. Appliction to the scenrio. We reconsider the scenrio of Section 2. The pirs (E m, P m ) nd (E g, P g ) re two intention pln configurtions corresponding to Bob. The first one corresponds to the intention meeting(alice, l 1 ) nd the second one to getting copies(l 2 ), such tht E m = move(l 1 ); meet(alice); exit nd E g = get copies(l 2 ); exit.

10 getc s 0 {l 2 } move {l 2 } s 1 move getc s 2 {l 1 } meeting {l 2, P 1 } s 3 s 4 {l 1 } s 5 {l 1 } meeting getc move {l 1, P 1 } s 6 s 7 {l 1 } s 8 getc meeting {l 1, P 1 } s 9 s 10 {l 1, P 2 } {l 1, P 2 } s 11 {l 1, P 1, P 2 } Fig. 3. The CP S B corresponding to the gent pln P B The CPS corresponding to Bob, denoted CP S B, is illustrted in Figure 3. It is built from the initil CPS stte, s 0 = ([P B ], l 2, ), tking into ccount the current loction l 2 of Bob. In the figure, the dshed edges represent the unrelizble trnsitions from the sttes s {s 2, s 5, s 8 }, becuse pre(getc) = l 2 L(s). In CP S, the trnsitions from ny stte s only represent ctions tht re relizble. Like in STRIPS description lnguge [3], ctions to be executed re modeled by instntited predictes submitted to preconditions nd effects. In this pper, the preconditions only concern the contextul informtion known in tht stte. Let pre() be the precondition of ny ction, then pre(x!(ν)) = pre(x?(ν)) = (x Λ) nd for ny other ction, pre((l)) = l L(s). Plnning Guidnce. In order to guide the ssisted user, the plnning process cn select n execution trce through the CP S such tht the number of intention pln termintions is mximized, in respect to the mpping T of the plnning sttes. This cn be cptured with the notion of Mximum trce, bsed on trce mpping end : Σ 2 P used to specify the set end(σ) of the termintion ctions tht occur in trce σ Σ. From n lgorithmicl point of view, the configurtions hving the mximum number of terminted intention plns could be strightforwrdly detected by prsing the CP S structure, with regrds to the set of terminted intention plns of ech built plnning stte. By lbeling these sttes with specific proposition MAX, the serch of mximum trces is reduced to the trces which stisfies the (LTL) temporl logic property AF(MAX). Considering gin CP S B corresponding to Bob, n exmple of mximum trce derived from s 0 is the following, expressing tht Bob should get the copies before moving to the meeting with Alice: ((E g, P g) (E m, P m), l 2, ) getc ((E g, P g) (E m, P m), l 2, ) ((E m, P m), l 2, { P g}) P g move ((E m, P m), l 1, { P g}) meet ((E m, P m), l 1, { P g}) ((stop, P m), l 1, { P g, P m}) P m

11 4 Experimenttion: The Smrt-Cmpus Project We experiment our gent-bsed pproch in distributed system project clled Smrt-Cmpus. Our im is to design powerful system tht ssists users in their ctivities within complex university cmpus to better interct nd dpt to users needs nd demnds. This project is in progress but we concretely equip flot of Android Smrt-Devices 3 (SD) by the smrt-cmpus ppliction. In this ppliction, the softwre rchitecture is composed of n HoA gent nd specific grphicl user interfce (GUI) to interct with the user to be ssisted. Hence, this llows us n explicit presenttion of the resoning of n gent nd the concrete use of the guidnce service driven by the mentl process, ccording to the chnge of context process informtion. From smrt-cmpus rchitecture, we now scheme the deployment of the smrt-cmpus ppliction in the SD, nd the wy to develop the HoA gent min processes. Fig. 4. Smrt-cmpus rchitecture Smrt-Cmpus Architecture. The cmpus system is concretized by the smrtcmpus strting service which utomticlly runs the smrt-cmpus ppliction nd connects the SD to the "CAMPUS" network, through one of the possible WiFi Access Points (AP). As illustrted in Figure 4, the SD cn utomticlly ccess to the server SC Directory which is viewed s middlewre mintining the persistence of contextul informtion like the discovery nd the loctions of other users (through their SD) nd objects concerning the cmpus. The strting service is lso dedicted to declre the public informtion of the user to the server, in prticulr its loction. One of the specificity of this project is tht the HoA gent embedded in the SD remins utonomous when the SC directory cnnot be reched or when the user is exiting the cmpus. It cn continue ssisting the user, due to the context informtion nd persistent dt previously stored in the SD, cn be pervsively updted with the help of other neighbor gents. Context Process. The context process is bsed on services currently implemented over the smrt-cmpus rchitecture, bsed on physicl locliztion nd ()synchronous communiction mechnisms. They re supported by the smrtdevice API fcilities, in prticulr the WiFi API. As n exmple, the nvigtion 3 Devices: Google Nexus 5, 7 Android 4.4 KitKt (API level 19).

12 service tkes profit from the underlyied locliztion service to determine on the fly, the position nd the move of the ssisted user. Observe tht the locliztion service must work over the cmpus ground s well s the different stirs of the buildings. The best locliztion indoor technique is currently reserch in progress e.g. [8]. Currently, we use different WiFi ccess points within the cmpus to compute the geogrphicl loctions, since this works in both indoor nd outdoor loctions. Anywy, the locliztion process requires tune clibrtion phse to store specific informtion in the SC directory, concerning set of physicl reference points tht must be selected over the cmpus, s mentioned in the fingerprinting pproch. In our cse, informtion includes the physicl loction of the reference point (GPS), its symbolic nme (plce/room/corridor) nd bove ll the perceived signl ttenution (RSSI 4 ) from tht loction, in respect to the different WiFi ccess points. The locliztion service on the SD cn then compre its proper perceptions of the WiFi ttenution in respect to the sme references stored in the SC directory, so tht to deduce n pproximtion of its position through sttisticl computtions nd triltertion concepts. Mentl nd Plnning Processes To interct with the ssisted user, the GUI is n importnt issue of our ppliction. Figure 5 brings out n instnce of three relevnt screenshots of the developed GUI. Bob is here the ssisted user, being notified on his SD in rel time, of the evolution of its intentions, its current loction nd the (best) direction to meet Alice. Fig. 5. Smrt-cmpus scenrio The first one (left hnd side) shows the current weighted intentions mnged by the mentl process, coming from the ssisted user desires or the pervsive ctivity of the HoA gent. The second screen is debug view showing the gent pln nd ll the possible CPS trces. The contextul guidnce service llows the gent to ssist 4 RSSI: Received Signl Strength Indiction

13 the user in relizing his desires in proposing different lterntives of plns, optionlly inducing the proposition of sptil pths. The lst screen (right hnd side) highlights the used nvigtion interfce showing globl view of the cmpus during the execution of the Bob s scenrio. As specific GUI, grphicl mps re modern nd useful interfces for the users. The ppliction is ble to mnge the mps of the cmpus, over which dditionl lyers re used to render mps interctive nd to show different loctions nd pths. 5 Conclusion The lgebric lnguge AgLOTOS ppers to be powerful wy to express n AmI gent pln s set of concurrent processes, helped by n dpted pln librry describing elementry plns. The proposed opertionl semntics of AgLOTOS llows one to build Contextul Plnning System (CPS), for ny BDI stte of the gent. In respect to the current set of the gent intentions, the CPS structure llows to evlute ll the possible plns. Despite the concurrent execution of plns, the predictive mechnism we propose, llows to guide the gent contextully, over its next possible executions. The problem to serch n optiml solution mximizing the number of (sub) plns to be executed, is reduced to rechbility problem over the CPS structure. In the smrt cmpus project, the presented forml predictive technique is pplied to ssist users in their dily ctivities, bsed on bsic contextul informtion corresponding to sptil loction nd dynmic neighborhood. Hence, it cn lso be viewed s concrete sptil guidnce over the cmpus. References [1] Olru, A., Flore, A.M., El Fllh Seghrouchni, A.: A context-wre multi-gent system s middlewre for mbient intelligence. MONET 18(3) (2013) [2] Srdin, S., de Silv, L., Pdghm, L.: Hierrchicl plnning in BDI gent progrmming lnguges: forml pproch. In: AAMAS 06. (2006) [3] Meneguzzi, F., Zorzo, A.F., d Cost Mór, M., Luck, M.: Incorporting plnning into BDI gents. Sclble Computing: Prctice nd Experience 8 (2007) [4] Chouche, A.C., El Fllh Seghrouchni, A., Ilié, J.M., Sïdouni, D.E.: A dynmicl pln revising for mbient systems. Procedi Computer Science 32 (2014) [5] Ro, A.S., Georgeff, M.P.: An bstrct rchitecture for rtionl gents. In Nebel, B., Rich, C., Swrtout, W.R., eds.: KR, Morgn Kufmnn (1992) [6] Brinksm, E., ed.: ISO 8807, LOTOS - A Forml Description Technique Bsed on the Temporl Ordering of Observtionl Behviour. (1988) [7] Chouche, A.C., El Fllh Seghrouchni, A., Ilié, J.M., Sïdouni, D.E.: A Higherorder Agent model for mbient systems. Procedi Computer Science 21 (2013) [8] Glvn-Tejd, C.E., Grc-Vzquez, J.P., Grc-Cej, E., Crrsco-Jimnez, J.C., Bren, R.F.: Evlution of four clssifiers s cost function for indoor loction systems. Procedi Computer Science 32(0) (2014)

Acceptance Sampling by Attributes

Acceptance Sampling by Attributes Introduction Acceptnce Smpling by Attributes Acceptnce smpling is concerned with inspection nd decision mking regrding products. Three spects of smpling re importnt: o Involves rndom smpling of n entire

More information

Refined interfaces for compositional verification

Refined interfaces for compositional verification Refined interfces for compositionl verifiction Frédéric Lng INRI Rhône-lpes http://www.inrilpes.fr/vsy Motivtion Enumertive verifiction of concurrent systems Prllel composition of synchronous processes

More information

Bisimulation. R.J. van Glabbeek

Bisimulation. R.J. van Glabbeek Bisimultion R.J. vn Glbbeek NICTA, Sydney, Austrli. School of Computer Science nd Engineering, The University of New South Wles, Sydney, Austrli. Computer Science Deprtment, Stnford University, CA 94305-9045,

More information

KNOWLEDGE-BASED AGENTS INFERENCE

KNOWLEDGE-BASED AGENTS INFERENCE AGENTS THAT REASON LOGICALLY KNOWLEDGE-BASED AGENTS Two components: knowledge bse, nd n inference engine. Declrtive pproch to building n gent. We tell it wht it needs to know, nd It cn sk itself wht to

More information

New data structures to reduce data size and search time

New data structures to reduce data size and search time New dt structures to reduce dt size nd serch time Tsuneo Kuwbr Deprtment of Informtion Sciences, Fculty of Science, Kngw University, Hirtsuk-shi, Jpn FIT2018 1D-1, No2, pp1-4 Copyright (c)2018 by The Institute

More information

Strong Bisimulation. Overview. References. Actions Labeled transition system Transition semantics Simulation Bisimulation

Strong Bisimulation. Overview. References. Actions Labeled transition system Transition semantics Simulation Bisimulation Strong Bisimultion Overview Actions Lbeled trnsition system Trnsition semntics Simultion Bisimultion References Robin Milner, Communiction nd Concurrency Robin Milner, Communicting nd Mobil Systems 32

More information

CS 275 Automata and Formal Language Theory

CS 275 Automata and Formal Language Theory CS 275 Automt nd Forml Lnguge Theory Course Notes Prt II: The Recognition Problem (II) Chpter II.6.: Push Down Automt Remrk: This mteril is no longer tught nd not directly exm relevnt Anton Setzer (Bsed

More information

Convert the NFA into DFA

Convert the NFA into DFA Convert the NF into F For ech NF we cn find F ccepting the sme lnguge. The numer of sttes of the F could e exponentil in the numer of sttes of the NF, ut in prctice this worst cse occurs rrely. lgorithm:

More information

Reinforcement Learning

Reinforcement Learning Reinforcement Lerning Tom Mitchell, Mchine Lerning, chpter 13 Outline Introduction Comprison with inductive lerning Mrkov Decision Processes: the model Optiml policy: The tsk Q Lerning: Q function Algorithm

More information

How to simulate Turing machines by invertible one-dimensional cellular automata

How to simulate Turing machines by invertible one-dimensional cellular automata How to simulte Turing mchines by invertible one-dimensionl cellulr utomt Jen-Christophe Dubcq Déprtement de Mthémtiques et d Informtique, École Normle Supérieure de Lyon, 46, llée d Itlie, 69364 Lyon Cedex

More information

19 Optimal behavior: Game theory

19 Optimal behavior: Game theory Intro. to Artificil Intelligence: Dle Schuurmns, Relu Ptrscu 1 19 Optiml behvior: Gme theory Adversril stte dynmics hve to ccount for worst cse Compute policy π : S A tht mximizes minimum rewrd Let S (,

More information

p-adic Egyptian Fractions

p-adic Egyptian Fractions p-adic Egyptin Frctions Contents 1 Introduction 1 2 Trditionl Egyptin Frctions nd Greedy Algorithm 2 3 Set-up 3 4 p-greedy Algorithm 5 5 p-egyptin Trditionl 10 6 Conclusion 1 Introduction An Egyptin frction

More information

Vector potential quantization and the photon wave-particle representation

Vector potential quantization and the photon wave-particle representation Vector potentil quntiztion nd the photon wve-prticle representtion Constntin Meis, Pierre-Richrd Dhoo To cite this version: Constntin Meis, Pierre-Richrd Dhoo. Vector potentil quntiztion nd the photon

More information

CS 188 Introduction to Artificial Intelligence Fall 2018 Note 7

CS 188 Introduction to Artificial Intelligence Fall 2018 Note 7 CS 188 Introduction to Artificil Intelligence Fll 2018 Note 7 These lecture notes re hevily bsed on notes originlly written by Nikhil Shrm. Decision Networks In the third note, we lerned bout gme trees

More information

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn

More information

Duality # Second iteration for HW problem. Recall our LP example problem we have been working on, in equality form, is given below.

Duality # Second iteration for HW problem. Recall our LP example problem we have been working on, in equality form, is given below. Dulity #. Second itertion for HW problem Recll our LP emple problem we hve been working on, in equlity form, is given below.,,,, 8 m F which, when written in slightly different form, is 8 F Recll tht we

More information

Informe Técnico / Technical Report

Informe Técnico / Technical Report DEPARTAMENTO DE SISTEMAS INFORMÁTICOS Y COMPUTACIÓN UNIVERSIDAD POLITÉCNICA DE VALENCIA P.O. Box: 22012 E-46071 Vlenci (SPAIN) Informe Técnico / Technicl Report Ref. No.: DSIC-II/03/10 Pges: 30 Title:

More information

Finite Automata. Informatics 2A: Lecture 3. John Longley. 22 September School of Informatics University of Edinburgh

Finite Automata. Informatics 2A: Lecture 3. John Longley. 22 September School of Informatics University of Edinburgh Lnguges nd Automt Finite Automt Informtics 2A: Lecture 3 John Longley School of Informtics University of Edinburgh jrl@inf.ed.c.uk 22 September 2017 1 / 30 Lnguges nd Automt 1 Lnguges nd Automt Wht is

More information

Global Types for Dynamic Checking of Protocol Conformance of Multi-Agent Systems

Global Types for Dynamic Checking of Protocol Conformance of Multi-Agent Systems Globl Types for Dynmic Checking of Protocol Conformnce of Multi-Agent Systems (Extended Abstrct) Dvide Ancon, Mtteo Brbieri, nd Vivin Mscrdi DIBRIS, University of Genov, Itly emil: dvide@disi.unige.it,

More information

This lecture covers Chapter 8 of HMU: Properties of CFLs

This lecture covers Chapter 8 of HMU: Properties of CFLs This lecture covers Chpter 8 of HMU: Properties of CFLs Turing Mchine Extensions of Turing Mchines Restrictions of Turing Mchines Additionl Reding: Chpter 8 of HMU. Turing Mchine: Informl Definition B

More information

State space systems analysis (continued) Stability. A. Definitions A system is said to be Asymptotically Stable (AS) when it satisfies

State space systems analysis (continued) Stability. A. Definitions A system is said to be Asymptotically Stable (AS) when it satisfies Stte spce systems nlysis (continued) Stbility A. Definitions A system is sid to be Asymptoticlly Stble (AS) when it stisfies ut () = 0, t > 0 lim xt () 0. t A system is AS if nd only if the impulse response

More information

CS 275 Automata and Formal Language Theory

CS 275 Automata and Formal Language Theory CS 275 Automt nd Forml Lnguge Theory Course Notes Prt II: The Recognition Problem (II) Chpter II.5.: Properties of Context Free Grmmrs (14) Anton Setzer (Bsed on book drft by J. V. Tucker nd K. Stephenson)

More information

Coalgebra, Lecture 15: Equations for Deterministic Automata

Coalgebra, Lecture 15: Equations for Deterministic Automata Colger, Lecture 15: Equtions for Deterministic Automt Julin Slmnc (nd Jurrin Rot) Decemer 19, 2016 In this lecture, we will study the concept of equtions for deterministic utomt. The notes re self contined

More information

Reinforcement learning II

Reinforcement learning II CS 1675 Introduction to Mchine Lerning Lecture 26 Reinforcement lerning II Milos Huskrecht milos@cs.pitt.edu 5329 Sennott Squre Reinforcement lerning Bsics: Input x Lerner Output Reinforcement r Critic

More information

New Expansion and Infinite Series

New Expansion and Infinite Series Interntionl Mthemticl Forum, Vol. 9, 204, no. 22, 06-073 HIKARI Ltd, www.m-hikri.com http://dx.doi.org/0.2988/imf.204.4502 New Expnsion nd Infinite Series Diyun Zhng College of Computer Nnjing University

More information

Math 1B, lecture 4: Error bounds for numerical methods

Math 1B, lecture 4: Error bounds for numerical methods Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the

More information

Global Session Types for Dynamic Checking of Protocol Conformance of Multi-Agent Systems

Global Session Types for Dynamic Checking of Protocol Conformance of Multi-Agent Systems Globl Session Types for Dynmic Checking of Protocol Conformnce of Multi-Agent Systems (Extended Abstrct) Dvide Ancon, Mtteo Brbieri, nd Vivin Mscrdi DIBRIS, University of Genov, Itly emil: dvide@disi.unige.it,

More information

NFAs and Regular Expressions. NFA-ε, continued. Recall. Last class: Today: Fun:

NFAs and Regular Expressions. NFA-ε, continued. Recall. Last class: Today: Fun: CMPU 240 Lnguge Theory nd Computtion Spring 2019 NFAs nd Regulr Expressions Lst clss: Introduced nondeterministic finite utomt with -trnsitions Tody: Prove n NFA- is no more powerful thn n NFA Introduce

More information

Concepts of Concurrent Computation Spring 2015 Lecture 9: Petri Nets

Concepts of Concurrent Computation Spring 2015 Lecture 9: Petri Nets Concepts of Concurrent Computtion Spring 205 Lecture 9: Petri Nets Sebstin Nnz Chris Poskitt Chir of Softwre Engineering Petri nets Petri nets re mthemticl models for describing systems with concurrency

More information

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by. NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with

More information

CMSC 330: Organization of Programming Languages. DFAs, and NFAs, and Regexps (Oh my!)

CMSC 330: Organization of Programming Languages. DFAs, and NFAs, and Regexps (Oh my!) CMSC 330: Orgniztion of Progrmming Lnguges DFAs, nd NFAs, nd Regexps (Oh my!) CMSC330 Spring 2018 Types of Finite Automt Deterministic Finite Automt (DFA) Exctly one sequence of steps for ech string All

More information

Advanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004

Advanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004 Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when

More information

COMPUTER SCIENCE TRIPOS

COMPUTER SCIENCE TRIPOS CST.2011.2.1 COMPUTER SCIENCE TRIPOS Prt IA Tuesdy 7 June 2011 1.30 to 4.30 COMPUTER SCIENCE Pper 2 Answer one question from ech of Sections A, B nd C, nd two questions from Section D. Submit the nswers

More information

Administrivia CSE 190: Reinforcement Learning: An Introduction

Administrivia CSE 190: Reinforcement Learning: An Introduction Administrivi CSE 190: Reinforcement Lerning: An Introduction Any emil sent to me bout the course should hve CSE 190 in the subject line! Chpter 4: Dynmic Progrmming Acknowledgment: A good number of these

More information

Finite Automata. Informatics 2A: Lecture 3. Mary Cryan. 21 September School of Informatics University of Edinburgh

Finite Automata. Informatics 2A: Lecture 3. Mary Cryan. 21 September School of Informatics University of Edinburgh Finite Automt Informtics 2A: Lecture 3 Mry Cryn School of Informtics University of Edinburgh mcryn@inf.ed.c.uk 21 September 2018 1 / 30 Lnguges nd Automt Wht is lnguge? Finite utomt: recp Some forml definitions

More information

Introduction to spefication and verification Lecture Notes, autumn 2011

Introduction to spefication and verification Lecture Notes, autumn 2011 Introduction to spefiction nd verifiction Lecture Notes, utumn 2011 Timo Krvi UNIVERSITY OF HELSINKI FINLAND Contents 1 Introduction 1 1.1 The strting point............................ 1 1.2 Globl stte

More information

Chapter 14. Matrix Representations of Linear Transformations

Chapter 14. Matrix Representations of Linear Transformations Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn

More information

SYDE 112, LECTURES 3 & 4: The Fundamental Theorem of Calculus

SYDE 112, LECTURES 3 & 4: The Fundamental Theorem of Calculus SYDE 112, LECTURES & 4: The Fundmentl Theorem of Clculus So fr we hve introduced two new concepts in this course: ntidifferentition nd Riemnn sums. It turns out tht these quntities re relted, but it is

More information

THE QUADRATIC RECIPROCITY LAW OF DUKE-HOPKINS. Circa 1870, G. Zolotarev observed that the Legendre symbol ( a p

THE QUADRATIC RECIPROCITY LAW OF DUKE-HOPKINS. Circa 1870, G. Zolotarev observed that the Legendre symbol ( a p THE QUADRATIC RECIPROCITY LAW OF DUKE-HOPKINS PETE L CLARK Circ 1870, Zolotrev observed tht the Legendre symbol ( p ) cn be interpreted s the sign of multipliction by viewed s permuttion of the set Z/pZ

More information

Bernoulli Numbers Jeff Morton

Bernoulli Numbers Jeff Morton Bernoulli Numbers Jeff Morton. We re interested in the opertor e t k d k t k, which is to sy k tk. Applying this to some function f E to get e t f d k k tk d k f f + d k k tk dk f, we note tht since f

More information

Chapter 2 Finite Automata

Chapter 2 Finite Automata Chpter 2 Finite Automt 28 2.1 Introduction Finite utomt: first model of the notion of effective procedure. (They lso hve mny other pplictions). The concept of finite utomton cn e derived y exmining wht

More information

Infinite Geometric Series

Infinite Geometric Series Infinite Geometric Series Finite Geometric Series ( finite SUM) Let 0 < r < 1, nd let n be positive integer. Consider the finite sum It turns out there is simple lgebric expression tht is equivlent to

More information

A Framework for Efficient Representative Summarization of RDF Graphs

A Framework for Efficient Representative Summarization of RDF Graphs A Frmework for Efficient Representtive Summriztion of RDF Grphs Šejl Čebirić, Frnçois Gosdoué, Ion Mnolescu To cite this version: Šejl Čebirić, Frnçois Gosdoué, Ion Mnolescu. A Frmework for Efficient Representtive

More information

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Finite Automt Theory nd Forml Lnguges TMV027/DIT321 LP4 2018 Lecture 10 An Bove April 23rd 2018 Recp: Regulr Lnguges We cn convert between FA nd RE; Hence both FA nd RE ccept/generte regulr lnguges; More

More information

More on automata. Michael George. March 24 April 7, 2014

More on automata. Michael George. March 24 April 7, 2014 More on utomt Michel George Mrch 24 April 7, 2014 1 Automt constructions Now tht we hve forml model of mchine, it is useful to mke some generl constructions. 1.1 DFA Union / Product construction Suppose

More information

Recitation 3: More Applications of the Derivative

Recitation 3: More Applications of the Derivative Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech

More information

Formal languages, automata, and theory of computation

Formal languages, automata, and theory of computation Mälrdlen University TEN1 DVA337 2015 School of Innovtion, Design nd Engineering Forml lnguges, utomt, nd theory of computtion Thursdy, Novemer 5, 14:10-18:30 Techer: Dniel Hedin, phone 021-107052 The exm

More information

Parse trees, ambiguity, and Chomsky normal form

Parse trees, ambiguity, and Chomsky normal form Prse trees, miguity, nd Chomsky norml form In this lecture we will discuss few importnt notions connected with contextfree grmmrs, including prse trees, miguity, nd specil form for context-free grmmrs

More information

are fractions which may or may not be reduced to lowest terms, the mediant of ( a

are fractions which may or may not be reduced to lowest terms, the mediant of ( a GENERATING STERN BROCOT TYPE RATIONAL NUMBERS WITH MEDIANTS HAROLD REITER AND ARTHUR HOLSHOUSER Abstrct. The Stern Brocot tree is method of generting or orgnizing ll frctions in the intervl (0, 1 b strting

More information

CS 188: Artificial Intelligence Spring 2007

CS 188: Artificial Intelligence Spring 2007 CS 188: Artificil Intelligence Spring 2007 Lecture 3: Queue-Bsed Serch 1/23/2007 Srini Nrynn UC Berkeley Mny slides over the course dpted from Dn Klein, Sturt Russell or Andrew Moore Announcements Assignment

More information

Physics 116C Solution of inhomogeneous ordinary differential equations using Green s functions

Physics 116C Solution of inhomogeneous ordinary differential equations using Green s functions Physics 6C Solution of inhomogeneous ordinry differentil equtions using Green s functions Peter Young November 5, 29 Homogeneous Equtions We hve studied, especilly in long HW problem, second order liner

More information

Software Engineering using Formal Methods

Software Engineering using Formal Methods Softwre Engineering using Forml Methods Propositionl nd (Liner) Temporl Logic Wolfgng Ahrendt 13th Septemer 2016 SEFM: Liner Temporl Logic /GU 160913 1 / 60 Recpitultion: FormlistionFormlistion: Syntx,

More information

Designing finite automata II

Designing finite automata II Designing finite utomt II Prolem: Design DFA A such tht L(A) consists of ll strings of nd which re of length 3n, for n = 0, 1, 2, (1) Determine wht to rememer out the input string Assign stte to ech of

More information

Using QM for Windows. Using QM for Windows. Using QM for Windows LEARNING OBJECTIVES. Solving Flair Furniture s LP Problem

Using QM for Windows. Using QM for Windows. Using QM for Windows LEARNING OBJECTIVES. Solving Flair Furniture s LP Problem LEARNING OBJECTIVES Vlu%on nd pricing (November 5, 2013) Lecture 11 Liner Progrmming (prt 2) 10/8/16, 2:46 AM Olivier J. de Jong, LL.M., MM., MBA, CFD, CFFA, AA www.olivierdejong.com Solving Flir Furniture

More information

CS5371 Theory of Computation. Lecture 20: Complexity V (Polynomial-Time Reducibility)

CS5371 Theory of Computation. Lecture 20: Complexity V (Polynomial-Time Reducibility) CS5371 Theory of Computtion Lecture 20: Complexity V (Polynomil-Time Reducibility) Objectives Polynomil Time Reducibility Prove Cook-Levin Theorem Polynomil Time Reducibility Previously, we lernt tht if

More information

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS. THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem

More information

Math 8 Winter 2015 Applications of Integration

Math 8 Winter 2015 Applications of Integration Mth 8 Winter 205 Applictions of Integrtion Here re few importnt pplictions of integrtion. The pplictions you my see on n exm in this course include only the Net Chnge Theorem (which is relly just the Fundmentl

More information

The Regulated and Riemann Integrals

The Regulated and Riemann Integrals Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue

More information

Handout: Natural deduction for first order logic

Handout: Natural deduction for first order logic MATH 457 Introduction to Mthemticl Logic Spring 2016 Dr Json Rute Hndout: Nturl deduction for first order logic We will extend our nturl deduction rules for sententil logic to first order logic These notes

More information

2D1431 Machine Learning Lab 3: Reinforcement Learning

2D1431 Machine Learning Lab 3: Reinforcement Learning 2D1431 Mchine Lerning Lb 3: Reinforcement Lerning Frnk Hoffmnn modified by Örjn Ekeberg December 7, 2004 1 Introduction In this lb you will lern bout dynmic progrmming nd reinforcement lerning. It is ssumed

More information

Notes on specifying systems in EST

Notes on specifying systems in EST Robert Meolic, Ttjn Kpus: Notes on specifying systems in EST 1 Notes on specifying systems in EST Robert Meolic, Ttjn Kpus Fculty of EE & CS University of Mribor Robert Meolic, Ttjn Kpus: Notes on specifying

More information

Natural examples of rings are the ring of integers, a ring of polynomials in one variable, the ring

Natural examples of rings are the ring of integers, a ring of polynomials in one variable, the ring More generlly, we define ring to be non-empty set R hving two binry opertions (we ll think of these s ddition nd multipliction) which is n Abelin group under + (we ll denote the dditive identity by 0),

More information

Genetic Programming. Outline. Evolutionary Strategies. Evolutionary strategies Genetic programming Summary

Genetic Programming. Outline. Evolutionary Strategies. Evolutionary strategies Genetic programming Summary Outline Genetic Progrmming Evolutionry strtegies Genetic progrmming Summry Bsed on the mteril provided y Professor Michel Negnevitsky Evolutionry Strtegies An pproch simulting nturl evolution ws proposed

More information

Finite Automata Part Three

Finite Automata Part Three Finite Automt Prt Three Hello Hello Wonderful Wonderful Condensed Condensed Slide Slide Reders! Reders! The The first first hlf hlf of of this this lecture lecture consists consists lmost lmost exclusively

More information

Process Algebra CSP A Technique to Model Concurrent Programs

Process Algebra CSP A Technique to Model Concurrent Programs Process Algebr CSP A Technique to Model Concurrent Progrms Jnury 15, 2002 Hui Shi 1 Contents CSP-Processes Opertionl Semntics Trnsition systems nd stte mchines Bisimultion Firing rules for CSP Model-Checker

More information

Equality and Inequality in the Dataflow Algebra. A. J. Cowling

Equality and Inequality in the Dataflow Algebra. A. J. Cowling Verifiction nd Testing Reserch Group, Deprtment of Computer Science, University of Sheffield, Regent Court, 211, Portobello Street, Sheffield, S1 4DP, United Kingdom Emil: A.Cowling @ dcs.shef.c.uk Telephone:

More information

Riemann Sums and Riemann Integrals

Riemann Sums and Riemann Integrals Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 2013 Outline 1 Riemnn Sums 2 Riemnn Integrls 3 Properties

More information

Jonathan Mugan. July 15, 2013

Jonathan Mugan. July 15, 2013 Jonthn Mugn July 15, 2013 Imgine rt in Skinner box. The rt cn see screen of imges, nd dot in the lower-right corner determines if there will be shock. Bottom-up methods my not find this dot, but top-down

More information

Frobenius numbers of generalized Fibonacci semigroups

Frobenius numbers of generalized Fibonacci semigroups Frobenius numbers of generlized Fiboncci semigroups Gretchen L. Mtthews 1 Deprtment of Mthemticl Sciences, Clemson University, Clemson, SC 29634-0975, USA gmtthe@clemson.edu Received:, Accepted:, Published:

More information

Types of Finite Automata. CMSC 330: Organization of Programming Languages. Comparing DFAs and NFAs. Comparing DFAs and NFAs (cont.) Finite Automata 2

Types of Finite Automata. CMSC 330: Organization of Programming Languages. Comparing DFAs and NFAs. Comparing DFAs and NFAs (cont.) Finite Automata 2 CMSC 330: Orgniztion of Progrmming Lnguges Finite Automt 2 Types of Finite Automt Deterministic Finite Automt () Exctly one sequence of steps for ech string All exmples so fr Nondeterministic Finite Automt

More information

EVOLUTION OF INTELLIGENT AGENTS: A NEW APPROACH TO AUTOMATIC PLAN DESIGN. Dániel Kovács László

EVOLUTION OF INTELLIGENT AGENTS: A NEW APPROACH TO AUTOMATIC PLAN DESIGN. Dániel Kovács László EVOLUTION OF INTELLIGENT AGENTS: A NEW APPROACH TO AUTOMATIC PLAN DESIGN Dániel Kovács László Budpest University of Technology nd Economics Deprtment of Mesurement nd Informtion Systems Budpest, H-7, Mgyr

More information

Exam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1

Exam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1 Exm, Mthemtics 471, Section ETY6 6:5 pm 7:4 pm, Mrch 1, 16, IH-115 Instructor: Attil Máté 1 17 copies 1. ) Stte the usul sufficient condition for the fixed-point itertion to converge when solving the eqution

More information

Riemann Sums and Riemann Integrals

Riemann Sums and Riemann Integrals Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 203 Outline Riemnn Sums Riemnn Integrls Properties Abstrct

More information

CS103B Handout 18 Winter 2007 February 28, 2007 Finite Automata

CS103B Handout 18 Winter 2007 February 28, 2007 Finite Automata CS103B ndout 18 Winter 2007 Ferury 28, 2007 Finite Automt Initil text y Mggie Johnson. Introduction Severl childrens gmes fit the following description: Pieces re set up on plying ord; dice re thrown or

More information

Lecture 3: Equivalence Relations

Lecture 3: Equivalence Relations Mthcmp Crsh Course Instructor: Pdric Brtlett Lecture 3: Equivlence Reltions Week 1 Mthcmp 2014 In our lst three tlks of this clss, we shift the focus of our tlks from proof techniques to proof concepts

More information

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz

More information

Chapter Five: Nondeterministic Finite Automata. Formal Language, chapter 5, slide 1

Chapter Five: Nondeterministic Finite Automata. Formal Language, chapter 5, slide 1 Chpter Five: Nondeterministic Finite Automt Forml Lnguge, chpter 5, slide 1 1 A DFA hs exctly one trnsition from every stte on every symol in the lphet. By relxing this requirement we get relted ut more

More information

20 MATHEMATICS POLYNOMIALS

20 MATHEMATICS POLYNOMIALS 0 MATHEMATICS POLYNOMIALS.1 Introduction In Clss IX, you hve studied polynomils in one vrible nd their degrees. Recll tht if p(x) is polynomil in x, the highest power of x in p(x) is clled the degree of

More information

1 Online Learning and Regret Minimization

1 Online Learning and Regret Minimization 2.997 Decision-Mking in Lrge-Scle Systems My 10 MIT, Spring 2004 Hndout #29 Lecture Note 24 1 Online Lerning nd Regret Minimiztion In this lecture, we consider the problem of sequentil decision mking in

More information

Improper Integrals, and Differential Equations

Improper Integrals, and Differential Equations Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted

More information

Chapters 4 & 5 Integrals & Applications

Chapters 4 & 5 Integrals & Applications Contents Chpters 4 & 5 Integrls & Applictions Motivtion to Chpters 4 & 5 2 Chpter 4 3 Ares nd Distnces 3. VIDEO - Ares Under Functions............................................ 3.2 VIDEO - Applictions

More information

Sufficient condition on noise correlations for scalable quantum computing

Sufficient condition on noise correlations for scalable quantum computing Sufficient condition on noise correltions for sclble quntum computing John Presill, 2 Februry 202 Is quntum computing sclble? The ccurcy threshold theorem for quntum computtion estblishes tht sclbility

More information

CMSC 330: Organization of Programming Languages

CMSC 330: Organization of Programming Languages CMSC 330: Orgniztion of Progrmming Lnguges Finite Automt 2 CMSC 330 1 Types of Finite Automt Deterministic Finite Automt (DFA) Exctly one sequence of steps for ech string All exmples so fr Nondeterministic

More information

An approximation to the arithmetic-geometric mean. G.J.O. Jameson, Math. Gazette 98 (2014), 85 95

An approximation to the arithmetic-geometric mean. G.J.O. Jameson, Math. Gazette 98 (2014), 85 95 An pproximtion to the rithmetic-geometric men G.J.O. Jmeson, Mth. Gzette 98 (4), 85 95 Given positive numbers > b, consider the itertion given by =, b = b nd n+ = ( n + b n ), b n+ = ( n b n ) /. At ech

More information

Types of Finite Automata. CMSC 330: Organization of Programming Languages. Comparing DFAs and NFAs. NFA for (a b)*abb.

Types of Finite Automata. CMSC 330: Organization of Programming Languages. Comparing DFAs and NFAs. NFA for (a b)*abb. CMSC 330: Orgniztion of Progrmming Lnguges Finite Automt 2 Types of Finite Automt Deterministic Finite Automt () Exctly one sequence of steps for ech string All exmples so fr Nondeterministic Finite Automt

More information

CALCULUS WITHOUT LIMITS

CALCULUS WITHOUT LIMITS CALCULUS WITHOUT LIMITS The current stndrd for the clculus curriculum is, in my opinion, filure in mny spects. We try to present it with the modern stndrd of mthemticl rigor nd comprehensiveness but of

More information

DIRECT CURRENT CIRCUITS

DIRECT CURRENT CIRCUITS DRECT CURRENT CUTS ELECTRC POWER Consider the circuit shown in the Figure where bttery is connected to resistor R. A positive chrge dq will gin potentil energy s it moves from point to point b through

More information

Reversals of Signal-Posterior Monotonicity for Any Bounded Prior

Reversals of Signal-Posterior Monotonicity for Any Bounded Prior Reversls of Signl-Posterior Monotonicity for Any Bounded Prior Christopher P. Chmbers Pul J. Hely Abstrct Pul Milgrom (The Bell Journl of Economics, 12(2): 380 391) showed tht if the strict monotone likelihood

More information

4.4 Areas, Integrals and Antiderivatives

4.4 Areas, Integrals and Antiderivatives . res, integrls nd ntiderivtives 333. Ares, Integrls nd Antiderivtives This section explores properties of functions defined s res nd exmines some connections mong res, integrls nd ntiderivtives. In order

More information

Theoretical foundations of Gaussian quadrature

Theoretical foundations of Gaussian quadrature Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of

More information

12.1 Nondeterminism Nondeterministic Finite Automata. a a b ε. CS125 Lecture 12 Fall 2014

12.1 Nondeterminism Nondeterministic Finite Automata. a a b ε. CS125 Lecture 12 Fall 2014 CS125 Lecture 12 Fll 2014 12.1 Nondeterminism The ide of nondeterministic computtions is to llow our lgorithms to mke guesses, nd only require tht they ccept when the guesses re correct. For exmple, simple

More information

Decision Networks. CS 188: Artificial Intelligence Fall Example: Decision Networks. Decision Networks. Decisions as Outcome Trees

Decision Networks. CS 188: Artificial Intelligence Fall Example: Decision Networks. Decision Networks. Decisions as Outcome Trees CS 188: Artificil Intelligence Fll 2011 Decision Networks ME: choose the ction which mximizes the expected utility given the evidence mbrell Lecture 17: Decision Digrms 10/27/2011 Cn directly opertionlize

More information

Taylor Polynomial Inequalities

Taylor Polynomial Inequalities Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil

More information

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus Unit #9 : Definite Integrl Properties; Fundmentl Theorem of Clculus Gols: Identify properties of definite integrls Define odd nd even functions, nd reltionship to integrl vlues Introduce the Fundmentl

More information

Jack Simons, Henry Eyring Scientist and Professor Chemistry Department University of Utah

Jack Simons, Henry Eyring Scientist and Professor Chemistry Department University of Utah 1. Born-Oppenheimer pprox.- energy surfces 2. Men-field (Hrtree-Fock) theory- orbitls 3. Pros nd cons of HF- RHF, UHF 4. Beyond HF- why? 5. First, one usully does HF-how? 6. Bsis sets nd nottions 7. MPn,

More information

Homework Solution - Set 5 Due: Friday 10/03/08

Homework Solution - Set 5 Due: Friday 10/03/08 CE 96 Introduction to the Theory of Computtion ll 2008 Homework olution - et 5 Due: ridy 10/0/08 1. Textook, Pge 86, Exercise 1.21. () 1 2 Add new strt stte nd finl stte. Mke originl finl stte non-finl.

More information

1 Nondeterministic Finite Automata

1 Nondeterministic Finite Automata 1 Nondeterministic Finite Automt Suppose in life, whenever you hd choice, you could try oth possiilities nd live your life. At the end, you would go ck nd choose the one tht worked out the est. Then you

More information

Data Assimilation. Alan O Neill Data Assimilation Research Centre University of Reading

Data Assimilation. Alan O Neill Data Assimilation Research Centre University of Reading Dt Assimiltion Aln O Neill Dt Assimiltion Reserch Centre University of Reding Contents Motivtion Univrite sclr dt ssimiltion Multivrite vector dt ssimiltion Optiml Interpoltion BLUE 3d-Vritionl Method

More information

Chapter 0. What is the Lebesgue integral about?

Chapter 0. What is the Lebesgue integral about? Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous

More information

UNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3

UNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 UNIFORM CONVERGENCE Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 Suppose f n : Ω R or f n : Ω C is sequence of rel or complex functions, nd f n f s n in some sense. Furthermore,

More information