arxiv: v2 [cs.cl] 7 Apr 2016

Transcription

1 Self-organizaion of vocabularies under differen ineracion orders Javier Vera Faculad de Ingeniería y Ciencias Universidad Adolfo Ibáñez Avda. Diagonal Las Torres 60, Peñalolén, Saniago, Chile jxvera@gmail.com arxiv: v [cs.cl] 7 Apr 06 Absrac Tradiionally, he formaion of vocabularies has been sudied by agen-based models (specially, he Naming Game) ihich random pairs of agens negoiae wordmeaning associaions a each discree ime sep. This paper proposes a firs approximaion o a novel quesion: To wha exen he negoiaion of word-meaning associaions is influenced by he order in which he individuals inerac? Auomaa Neworks provide he adequae mahemaical framework o explore his quesion. Compuer simulaions sugges ha oodimensional laices he ypical feaures of he formaion of word-meaning associaions are recovered under random schemes ha updae small fracions of he populaion a he same ime. Inroducion To wha exen on a populaion of language users he formaion of a word-meaning associaion (he simples version of a vocabulary) is influenced by he order ihich he individuals inerac? Tradiionally, his problem has been sudied wihin agen-based models, specially, he Naming Game (Seels, 995; Seels, 996; Baronchelli e al., 006), ihich random pairs of agens (one speaker, one hearer) negoiae wordmeaning associaions a each discree ime sep. Naurally, in a more realisic scenario a some ime frame (for insance, a he same minue) muliple unrelaed communicaive ineracions occur. Auomaa Neworks (AN) (von Neumann, 966; Wolfram, 00) provide he adequae mahemaical framework o sress he self-organized naure of he formaion of vocabularies (Seels, 0; Loreo e al., 0). AN are exremely simple models where each verex of a se of verices (he nework) evolves following a local rule based on he saes of nearby verices. A each ime sep he enire se or a fracion of he se of verices (even one verex) is updaed. This model is herefore he naural accoun o describe he influence of he order ihich he individuals inerac on he consensus of he enire populaion. The main purpose of he definiion of an AN model is wofold: () o reproduce he ypical dynamics of he formaion of linguisic convenions (in paricular, of he Naming Game); and () o describe by compuer simulaions he dynamics of consensus formaion under differen orders of communicaive ineracions. The work is organized as follows. Secion explains basic noions and he local rules of he AN model. This is followed by compuer simulaions focused on he dynamics under four ineracion orders. Finally, a brief discussion abou he relaions beween he resuls and he formaion of language is presened. Auomaa Neworks The individuals are locaed on he verices of a conneced, simple and undireced graph G = (P,I), where P = {,...,n} is he se of verices (he populaion) and I = {,...,m} is he se of edges. In order o consrain he communicaive ineracions he neighborhood of he verex u P is defined as he se V u = {v P : (u,v) I}. The verex u uniquely ineracs wih is neighbors, locaed on V u. A se ofpwordsw is considered. Each individual is compleely characerized by is sae, which evolves wihin communicaive ineracions. The sae associaed o he individual u P is he pair (M u,x u ), where M u W is he memory o sore

2 words of u and x u M u is a word ha u conveys o is neighbors of V u. The se of words conveyed by he neighbors of he verex u is denoed W u = {x v : v V u }. Since he formaion of a language is based only on local ineracions, he verex u only accesses o he se W u. In principle i is reasonable o hink ha he verex u plays he role of hearer (i hears he words conveyed by he neighbors ofu), and he verices ofv u play he role of speaker (hey convey words o he verex u). In general communicaive ineracions in he AN model involve muliple speakers (he neighbors) and one hearer (he cenral verex). The AN model is he uple A = (G,Q,(f u : u P),φ), where Q is he se of all possible saes of he verices (Q = P(W) W, wherep(w) means he se of subses of W ); (f u : u P) is he family of local rules. The sae of a given verex u evolves aking ino accoun he saes of is neighbors of V u ; and φ is a funcion, he updaing scheme, ha gives he order ihich he verices are updaed. Four updaing schemes are considered: he sequenial scheme, where verices are updaed one by one in a prescribed order (a permuaion of he se of verices); he fully-asynchronous scheme, where verices are updaed one by one in an uniformly a random order; he synchronous scheme, where all verices are updaed a he same ime; and he α-asynchronous scheme, where each verex is updaed wih probabiliy α (Faès, 0). I is clear ha α = is equivalen o he synchronous scheme. A configuraion X() a is he se of saes {(M u (),x u ())} u P. The configuraion X(+) a ime sep + is given by he applicaion of local rules {f u } u P o a subse of individuals defined by he updaing scheme. There are wo special configuraions: () a cycle (a finie periodic se of configuraions); () and a fixed poin (a configuraion which is invarian under he applicaion of local rules). Two acions based on he Naming Game To model he formaion of consensus he local rule involves wo acions which updae he sae pair (M u,x u ) of each verex u P : he addiion (A) updaes M u by adding words; and he collapse (C) updaesm u by cancelling all is words, excep one of hem. Boh acions arise from laeral inhibiion sraegies proposed in he conex of he Naming Game (Seels, 995; Seels, 0). The addiion aemps o increase he chance of fuure successful ineracions. The collapse is he resul of local consensus wihin ineracions (he individuals remove he remaining words in successful conversaions). Two simple forms of hese acions are considered. Firs, he individuals add all he unknowords. This means ha he verex u P adds any word (conveyed by is neighbors) x W u, so ha x / M u. Second, in he case ha W u M u (all received words belong o he memory), he consrains of he AN model impose he definiion of a mechanism ha allows o discriminae beweeords. Indeed, he verex u receives one word from each neighbor ofv u. To assign differen values o he words each agen is endowed wih an inernal oal order for he se of words (equivalenly, if we consider W Z he agens are endowed wih he order <). The individuals choose o collapse in he minimum word conveyed in he neighborhood, ha is, he minimum of he se W u. Rules of he model Suppose ha a ime sep he verex u P has been seleced according o one of he updaing schemes. W u is he se of all words conveyed by he neighbors of he verex u. W u = B u N u, where B u = {x v (v V u ) (x v M u )} (he se of knowords) and N u = {x v (v V u ) (x v / M u )} (he se of unknowords). The subse B u W u conains he words conveyed by he neighbors which belong o he memorym u. In conras, N u W u conains he words of W u which do no belong o M u. The local rule f u reads f u = { if Nu, (A) (M i N u,x u ) if = N u, (C) ({min(b u )},min(b u )) The rule means ha in he case ha N u (ha is, if here are words of W u ha he verex u does no know) he memory M u is updaed

3 b b ({a,b},b) d ({a,b,c},b) c c (A) (C) ({a,b,c,d},b) ({a},a) x W. Then, (0) = n d (0) = n. Four updaing schemes: sequenial, fully asynchronous, synchronous and α-asynchronous (wih α in {0., 0.9}). A periodic laice wih Von Neumann neighborhood (four neares neighbors) wih n = 56 = 6556 verices for boh sequenial and fully asynchronous schemes, and n = 6 = 096 verices for boh synchronous and α- asynchronous schemes. 5. Resuls a 5 fully Figure : Example of he local rule. All individuals share he order a < b < c < d. Suppose ha a some ime sep he verex u has been choosen (he cenral verex). Four individuals paricipae of he ineracion: he cenral verex u and is hree neighbors of V u. Associaed o each acion of he local rule wo differen configuraions are showed. For he firs row (A), W u = B u N u = {b} {c,d}. For he second row (C), W u = B u = {a,b,c}. by adding he words of N u. In he oher case ( = N u ) he verex u collapses is memory in he minimum of he se B u (B u = W u ). Clearly, he conveyed word x u evenually changes in collapses. 5 Simulaions 5. Proocol To explicily describe he dynamics of he AN wo macroscopic measures are defined (Baronchelli e al., 006): he oal number of words of he sysem, () = u P M u () where M u is he size of he memory M u ; and he number of differeords (or synonyms), n d () = M u () u P where u P M u represens he union of all ses M u, u P. The simulaion proocol is defined by he following elemens. Averages of () and n d () over 00 iniial condiions where each verex is associaed o a differen sae of he form ({x},x), () n d () sequenial fully sequenial Figure : Evoluion of () and n d () under sequenial and fully-asynchronous updaing schemes. The populaion is locaed on a n = 56 periodic laice wih Von Neumann neighborhood (four neares neighbors). The simulaions run unil reach n d () =. (op) () versus. (boom) n d () versus. One sep means n verex updaes. y-axis is normalized by n. Only he firs 50 seps are showed. Black lines mean fully asynchronous scheme, whereas red depiced lines mean sequenial scheme. Boh schemes converge a 00. The dynamics of he AN under fullyasynchronous updaing scheme seems o reproduce he ypical behavior observed for he Naming Game on low-dimensional laices (Baronchelli e al., 006), as shown in Fig. (black lines). Indeed, he dynamics exhibis hree

4 5 synchronous () ().0 synchronous n d () 0. n d () Figure : Evoluion of () and n d () under synchronous updaing scheme. The populaion is locaed on a n = 6 periodic laice wih Von Neumann neighborhood (four neares neighbors). The simulaions run 00 seps. (op) () versus. (boom) n d () versus. One sep means n verex updaes. y-axis is normalized by n. Only he firs50 seps are showed. The dynamics for all iniial condiions leads o cycles of size. Figure : Evoluion of () and n d () under α-asynchronous updaing scheme. The populaion is locaed on a n = 6 periodic laice wih Von Neumann neighborhood (four neares neighbors). The simulaions run 00 seps. (op) () versus. (boom) n d () versus. α varies from {0., 0.9}. x-axis is normalized by α and y-axis is normalized by n. Only he firs 50 seps are showed. ypical domains. Firs, since a he beginning he individuals convey differeords a very fas increasing in () and a drasic decreasing in n d () are observed. Then, a peak in he number of words is reached, a () n. Finally, he dynamics eners in a very slow convergence o he consensus configuraion, where () = n and n d () =. The convergence is reached a 00 seps (only he firs 50 seps are showed). The dynamics under sequenial scheme presens some remarkable aspecs, as shown in Fig. (red depiced lines). The evoluion of he number of words reaches a very sharp peak of () 5n. This means ha a he peak each individual knows all he words conveyed by is neighbors (noice ha each verex has four neighbors). Anoher ineresing feaure of he dynamics is ha afer he peak he dynamics reaches a local maximum a. This fac requires furher mahemaical explanaion. Synchronous dynamics is exhibied in Fig. (blue lines). Approximaely afer 50 ime seps (one sep means ha all individuals have been updaed) he dynamics eners in a periodic behavior wih cycles of lengh. Thereby, he number of words () oscillaes beweennandn, whereas n d () converges o. In fac, ime seps ha correspond o even numbers (even seps) imply collapses ( () = n) and odd seps imply addiions ( () = n). Small ladder seps in he decreasing evoluion of n d () show ha a odd imes only addiions are allowed (and hen he conveyed words remain fixed). The dynamics under α-asynchronous scheme is exhibied in Fig.. The wo values of α (0.9 and 0.) are relaed o previous observaions. Firs, a α = 0.9 he dynamics presens oscillaions ha diminish over ime unil reach a final consensus fixed poin. Second, a α = 0. he dynamics seems o reproduce he behavior observed for he

5 Naming Game on low-dimensional laices (as he fully-asynchronous scheme). 6 Conclusion This shor paper inroduces a new heoreical framework o sudy he developmen of linguisic convenions, and in general, he formaion and evoluion of language. Despie ha he AN model is an absrac approximaion o he real problem, he work discusses how on a populaion of individuals endowed wih simple cogniive mechanisms language arises only from local ineracions. The work proposes wo imporan elemens o be discussed: () an alernaive (mahemaical) framework for agen-based sudies on language formaion; and () compuer simulaions suggesing ha oo-dimensional laices he ypical feaures of he formaion of linguisic convenions (as in he Naming Game) are recovered under random schemes ha updae small fracions of he populaion a he same ime (fully-asynchronous and α-asynchronous, associaed o α = 0.). [von Neumann966] John von Neumann Theory of Self-Reproducing Auomaa. Universiy of Illinois Press, Champain, IL. [Wolfram00] Sephen Wolfram. 00. A New Kind of Science. Wolfram Media, January. Acknowledgmens The auhor likes o hank CONICYT-Chile under he Docoral scholarship 088. References [Baronchelli e al.006] Andrea Baronchelli, Maddalena Felici, Emanuele Caglioi, Viorio Loreo, and Luc Seels Sharp ransiion owards shared vocabularies in muli-agen sysems. J. Sa. Mech., (P060). [Faès0] Nazim Faès. 0. A guided our of asynchronous cellular auomaa. In Jarkko Kari, Marin Kurib, and Andreas Malcher, ediors, Cellular Auomaa and Discree Complex Sysems, volume 855 of Lecure Noes in Compuer Science, pages 5 0. Springer Berlin Heidelberg. [Loreo e al.0] Viorio Loreo, Andrea Baronchelli, Animesh Mukherjee, Andrea Puglisi, and Francesca Tria. 0. Saisical physics of language dynamics. Journal of Saisical Mechanics: Theory and Experimen, 0(0):P0006. [Seels995] Luc Seels A self-organizing spaial vocabulary. Arificial Life, ():9. [Seels996] Luc Seels Self-organizing vocabularies. In Proceedings of Arificial Life V, Nara, Japan, pages 79 8, Nara, Japan. [Seels0] Luc Seels. 0. Modeling he culural evoluion of language. Physics of Life Reviews, 8():9 56, December.