arxiv:physics/ v3 [physics.class-ph] 17 Jun 2005

Transcription

1 Memoy Functions of the Additive Makov Chains: Applications to Complex Dynamic Systems axiv:physics/ v3 [physics.class-ph] 17 Jun 2005 S. S. Melnyk, O. V. Usatenko, and V. A. Yampol skii A. Ya. Usikov Institute fo Radiophysics and Electonics Ukainian Academy of Science, 12 Poskua Steet, Khakov, Ukaine A new appoach to descibing coelation popeties of complex dynamic systems with long-ange memoy based on a concept of additive Makov chains (Phys. Rev. E 68, (2003)) is developed. An equation connecting the memoy and coelation function of the system unde study is pesented. This equation allows econstucting a memoy function using a coelation function of the system. Effectiveness and obustness of the poposed method is demonstated by simple model examples. Memoy functions of concete coase-gained liteay texts ae found and thei univesal powe-law behavio at long distances is evealed. PACS numbes: a, Ga, e The poblem of long-ange coelated dynamic systems (LRCS) has been unde study fo a long time in many aeas of contempoay physics [1, 2], biology [3, 4], economics [4, 5], etc. [4, 6]. An impotant example of complex LRCS ae natually witten texts [7, 8, 9]. The efficient method fo investigating long-ange coelations in such systems consists in the decomposition of the space of states into a finite numbe of pats labelled by definite symbols, which ae natually odeed accoding to the dynamics of the system. The most fequently used method of the decomposition is based on the intoduction of two pats of the phase space. In othe wods, the appoach assumes mapping two kinds of states onto two symbols, say 0 and 1. Thus, the poblem is educed to investigating the statistical popeties of binay sequences. It might be thought that the coase gaining could esult in losing, at least, the shotange memoy in the sequence. The authos of Ref. [10, 11] consideed the Makov sequences with a many-valued alphabet. They demonstated that the mapping of a given sequence yam@ie.khakov.ua

2 2 into a small-alphabet sequence does not necessaily imply that the long-ange coelations pesented in the initial text would be peseved. Moeove, in geneal, the coase-gaining pocedue could lead to spuious long-ange coelations. Howeve, as was shown in Ref. [9], coase-gaining does not destoy the existing coelations in many eal symbolic systems. The statistical popeties of coase-gained texts depend, but not significantly, on the kind of mapping. This implies that only a small pat of all possible kinds of mapping can slightly change the initial coelations in the system. So, thee is no point in coding evey symbol (associating evey pat of the phase space of the system with its binay code) to analyze the coelation popeties of the texts, as it is done, fo example, in Ref. [8], but it is sufficient to use the coase-gaining pocedue. One of the ways to get a coect insight into the natue of coelations in a system consists in an ability of constucting a mathematical object (fo example, a coelated sequence of symbols) possessing the same statistical popeties as the initial system. Thee exist many algoithms fo geneating long-ange coelated sequences: the invese Fouie tansfomation [6], the expansion-modification Li method [12], the Voss pocedue of consequent andom additions [13], the coelated Levy walks [14], etc. [6, 15]. We believe that, among the above-mentioned methods, using the many-step Makov chains is one of the most impotant, because it offes a possibility to constuct a andom sequence with definite coelation popeties in the most natual way. This was demonstated in Ref. [16], whee the concept of additive Makov chain with the step-like memoy function (which allows the analytical teatment) was intoduced. Thee exist some dynamic systems (coase-gained sequences of Eukaya s DNA and dictionaies) with the coelation popeties that can be well descibed by this model. The concept of additivity, pimaily intoduced in pape [9], was late genealized fo the case of binay non-stationay Makov chains [17]. Anothe genealization was based on consideation of Makov sequences with a many-valued alphabet [10, 11]. In the pesent wok, we continue investigating into additive Makov chains with moe complex memoy functions. An equation connecting mutually-complementay chaacteistics of a andom sequence, i.e. the memoy and coelation functions, is obtained. Upon finding the memoy function of the oiginal andom sequence on the basis of the analysis of its statistical popeties, namely, its coelation function, we can build the coesponding Makov chain, which possesses the same statistical popeties as the initial sequence. Effectiveness and obustness of the poposed method is demonstated by simple model ex-

3 3 amples. This method is most essential fo some applications, e.g., fo the constuction of coelated sequence of elements which can be used to fabicate the effective filtes of electical o optical signals, Ref. [18]. The suggested method allowed us to find memoy functions of concete coase-gained liteay texts and to eveal thei univesal powe-law behavio at long distances. Let us conside a homogeneous binay sequence of symbols, a i = {0, 1}. To detemine the N-step Makov chain we have to intoduce the conditional pobability P(a i a i N, a i N+1,..., a i 1 ) of occuing the definite symbol a i (fo example, a i = 1) afte N- wod T N,i, whee T N,i stands fo the sequence of symbols a i N, a i N+1,...,a i 1. Thus, it is necessay to define 2 N values of the P-function coesponding to each possible configuation of the symbols in the N-wod a i N, a i N+1,...,a i 1. The value of N is efeed to as the memoy length of Makov chain. Consideing that we ae going to deal with the sequences possessing the memoy length of ode of 10 6, we need to make some simplification of the P-function. We suppose that it has the additive fom, N P(a i = 1 T N,i ) = f(a i k, k), (1) k=1 and coesponds to the additive influence of the pevious symbols upon the geneated one. The value of f(a i k, k) is the contibution of symbol a i k to the conditional pobability of occuing the symbol unity at the ith site. The homogeneity of the Makov chain is povided by the i-independence of conditional pobability Eq. (1). with Let us ewite Eq. (1) in an equivalent fom, N P(a i = 1 T N,i ) = b + F()(a i b), (2) =1 N f(0, ) =1 b =, F() = f(1, ) f(0, ). (3) 1 N F() =1 The constant b is the value of a i aveaged ove the whole sequence, b = ā: 1 ā = lim M 2M + 1 M i= M a i. (4) Indeed, accoding to the egodicity of the Makov chain, ā coincides with the value of a i

4 4 aveaged ove the ensemble of ealizations of the Makov chain. So, we can wite ā = P(a i = 1) = T N,i P(a i = 1 T N,i )P(T N,i ). (5) Hee P(a i = 1) is the pobability of occuing the symbol a i equal to unity and P(T N,i ) is the pobability of occuing the definite wod T N,i in the consideing ensemble of sequences. Substituting P(a i = 1 T N,i ) fom Eq. (2) into Eq. (5) and taking into account the obvious elation T N,i P(T N,i ) = 1, one gets, N N ā = b b F() + =1 =1F() P(T N,i )a i. (6) T N,i The sum P(T N,i )a i does not depend on the subscipt and obviously coincides with T N,i ā. So, we have ā = b + (ā b) F(). Fom this equation we conclude that b = ā. Thus, we can ewite Eq. (2) as N P(a i = 1 T N,i ) = ā + F()(a i ā). (7) =1 We efe to F() as the memoy function (MF). It descibes the stength of influence of pevious symbol a i upon a geneated one, a i. To the best of ou knowledge, the concept of memoy function fo many-step Makov chains was intoduced in Ref. [9]. The function P(..) contains the complete infomation about coelation popeties of the Makov chain. Typically, the coelation function and othe moments ae employed as the input chaacteistics fo the desciption of the coelated andom sequences. Howeve, the coelation function descibes not only the diect inteconnection of the elements a i and a i+, but also takes into account thei indiect inteaction via all othe intemediate elements. Ou appoach opeates with the oigin chaacteistics of the system, specifically, with the memoy function. The coelation and memoy functions ae mutual-complementay chaacteistics of a andom sequence in the following sense. The numeical analysis of a given andom sequence enables one to diectly detemine the coelation function athe than the memoy function. On the othe hand, it is possible to constuct a andom sequence using the memoy function, but not the coelation one. Theefoe, we believe that the investigation of memoy function of the coelated systems will pemit one to disclose thei intinsic popeties which povide the coelations between the elements.

5 5 A dichotomic symbols in a Makov chain can be thought of as the sequence of states of some paticle, which paticipates in a coelated Bownian motion. Evey element of the sequence coesponds to the instant change of paticle s coodinate. Evey L-wod (the sub-sequence of symbols of the length L in the sequence) can be egaded as one of the ealizations of the ensemble of coelated Bownian tajectoies in the tempoal inteval L. This point of view on the symbolic sequence makes it possible to use the statistical methods fo investigating the dynamic systems. We conside the distibution W L (k) of the wods of definite length L by the numbe k of unities in them, k i (L) = L a i+l, and the vaiance D(L) of k i (L), l=1 D(L) =< (k < k >) 2 >, (8) whee the definition of aveage value of g(k) is < g(k) >= L g(k)w L (k). It follows fom Eq. (7) that the positive MF values esult in the pesistent diffusion whee pevious displacements of the Bownian paticle in some diection povoke its consequent displacement in the same diection. The negative values of the MF coespond to the anti-pesistent diffusion whee the changes in the diection of motion ae moe pobable. In tems of the Ising model with long-ange paticles inteactions that could be natually associated with the Makov chains, the positive (negative) values of the MF coespond to the feomagnetic (antifeomagnetic) inteaction of paticles. The additive fom (1) of the conditional pobability function coesponds to the pai inteaction and disegad of many-paticles inteactions. The memoy function used in Refs. [9, 16] was chaacteized by the step-like behavio and defined by two paametes only: the memoy depth N and the stength of symbol s coelations. Such a memoy function descibes only one type of coelations in a given system, the pesistent o anti-pesistent one, which esults in the supe- o sub-linea dependence D(L) [19]. Obviously, both types of coelations can be obseved at diffeent scales in the same system. Thus, one needs to use moe complex memoy functions fo detailed desciption of the systems with both type of coelations. Besides, we have to find out a elation connecting the mutually-complementay chaacteistics of andom sequence, the memoy and coelation functions. We suggest below two methods fo finding the memoy function F() of a andom binay sequence with a known coelation function. The fist one is based on the minimization of a distance Dist between the Makov chain geneated by means of a sought-fo MF and the k=0

6 6 initial sequence of symbols. This distance is detemined by the fomula, 1 Dist = (a i P(a i = 1 T N,i )) 2 = lim M 2M + 1 with the conditional pobability P defined by Eq. (7). M i= M Let us expess distance (9) in tems of the coelation function, Fom Eqs. (7), (9), one obtains (a i P(a i = 1 T N,i )) 2, (9) K() = a i a i+ ā 2, K(0) = ā(1 ā), K( ) = K(). (10) Dist =, (a i ā)(a i ā)f()f( ) 2 (a i ā)(a i ā)f() + (a i ā) 2 =, K( )F()F( ) 2 K()F() + K(0). (11) The minimization equation, δdist δf() = 2 K( )F( ) 2K() = 0, (12) yields the elationship between the coelation and memoy functions, N K() = F( )K( ), 1. (13) =1 Equation (13) can also be deived by staightfowad calculation of the aveage a i a i+ in Eq. (10) using definition (7) of the memoy function. The second method esulting fom the fist one, establishes a elationship between the memoy function F() and the vaiance D(L), N M(, 0) = F( )M(, ), (14) =1 M(, ) = D( ) (D( ) + [D( + 1) D( )]). It is a set of linea equations fo F() with coefficients M(, ) detemined by D(). The elations, K() = [D( 1) 2D() + D( + 1)]/2 obtained in Ref. [9] and D( ) = D() ae used hee. Let us veify the obustness of ou method by numeical simulations. We conside a model tiangle memoy function,, 1 < 10, F() = , 10 < 20, 0, 20, (15)

7 7 F K FIG. 1: The initial memoy function Eq. (15) (solid line) and the econstucted one (dots) vs the distance. In inset, the coelation function K() obtained by a numeical analysis of the sequence constucted by means of the memoy function Eq. (15). K F FIG. 2: The model coelation function K() descibed by Eq. (16) (solid line). The dots coespond to the econstucted coelation function. In inset, the memoy function F() obtained by numeical solution of Eq. (13) with coelation function Eq. (16). pesented in Fig. 1 by solid line. Using Eq. (7), we constuct a andom non-biased, ā = 1/2, sequence of symbols {0, 1}. Then, with the aid of the constucted binay sequence of the length 10 6, we calculate numeically the coelation function K(). The esult of these calculations is pesented in inset Fig. 1. One can see that the coelation function K() mimics oughly the memoy function F() ove the egion In the egion > 20, the memoy function is equal to zeo but the coelation function does not vanish [20]. Then, using the obtained coelation function K(), we solve numeically Eq. (13). The esult is

8 8 shown in Fig. 1 by dots. One can see a good agement of initial, Eq. (15), and econstucted memoy functions F(). The main and vey nontivial esult of ou pape consists in the ability to constuct a binay sequence with an abitay pescibed coelation function by means of Eq. (13). As an example, let us conside the model coelation function, K() = 0.1 sin(), (16) pesented by the solid line in Fig. 2. We solve Eq. (13) numeically to find the memoy function F() using this coelation function. The esult is pesented in inset Fig. 2. Then we constuct the binay Makov chain using the obtained memoy function F(). To check up a obustness of the method, we calculate the coelation function K() of the constucted chain (the dots in Fig. 2) and compae it with Eq. (16). One can see an excellent ageement between the initial and econstucted coelation functions. Dn L Dn / D 0 1 L FIG. 3: The nomalized vaiance D n (L) fo the coase-gained text of Bible (solid line) and fo the sequence geneated by means of the econstucted memoy function F() (dots). The dotted staight line descibes the non-biased non-coelated Bownian diffusion, D 0 (L) = L/4. The inset demonstates the anti-pesistent dependence of atio D n (L)/D 0 (L) on L at shot distances. Let us demonstate the effectiveness of ou concept of the additive Makov chains when investigating the coelation popeties of coase gained liteay texts. Fist, we use the coase-gaining pocedue and map the lettes of the text of Bible [21] onto the symbols zeo and unity (hee, (a m) 0, (n z) 1). Then we examine the coelation popeties of the constucted sequence and calculate numeically the vaiance D(L). The esult of

9 9 simulation of the nomalized vaiance D n (L) = D(L)/4ā(1 ā) is pesented by the solid line in Fig. 3. The dominato 4ā(1 ā) in the equation fo the nomalized vaiance D n (L) is inseted in ode to take into account the inequality of the numbes of zeos and unities in the coase-gained liteay texts. The staight dotted line in this figue descibes the vaiance D 0 (L) = L/4, which coesponds to the non-biased non-coelated Bownian diffusion. The deviation of the solid line fom the dotted one demonstates the existence of coelations in the text. It is clealy seen that the diffusion is anti-pesistent at small distances, L < 300, (see inset Fig. 3) wheeas it is pesistent at long distances. The memoy function F() fo the coase-gained text of Bible at < 300 obtained by numeical solution of Eq. (14) is shown in Fig. 4. At long distances, > 300, the memoy function can be nicely appoximated by the powe function F() = , which is pesented by the dash-dotted line in inset Fig F F x10-4 1x FIG. 4: The memoy function F() fo the coase-gained text of Bible at shot distances. In inset, the powe-law deceasing potions of the F() plots fo seveal texts. The dots coespond to Pygmalion by B. Shaw. The solid line coesponds to powe-law fitting of this function. The dash dotted and dashed lines coespond to Bible in English and Russian, espectively. Note that the egion < 40 of negative anti-pesistent memoy function povides much longe distances L 300 of anti-pesistent behavio of the vaiance D(L). Ou study eveals the existence of two chaacteistic egions with diffeent behavio of the memoy function and, coespondingly, of pesistent and anti-pesistent potions in the D(L) dependence. This appeas to be a pominent featue of all texts witten in any language. The positive pesistent potions of the memoy functions ae given in inset Fig. 4 fo the

10 10 coase-gained English- and Russian-woded texts of Bible (dash-dotted and dashed lines, Refs. [21] and [22], coespondingly). Besides, fo compaison, the memoy function of the coase-gained text of Pygmalion by B. Shaw [23] is pesented in the same inset (dots), the powe-law fitting is shown by solid line. It is inteesting to note that the memoy function of any text mimics the coelation function, as it was found fo the model example Eq. (16). This fact is confimed by Fig. 5 whee the coelation function of the coase-gained text of Bible is shown. One can see that its behavio at both shot and long scales is simila to the memoy function pesented in Fig. 4. Howeve, the exponents in the powe-law appoximations of K() and F() functions diffe essentially K K FIG. 5: The coelation function K() fo the coase-gained text of Bible at shot distances. In inset, the powe-law deceasing potions of the K() plot fo the same text. The solid line coesponds to powe-law fitting of this function. Thus, we have demonstated the efficiency of desciption of the symbolic sequences with long-ange coelations in tems of the memoy function. An equation connecting the memoy and coelation functions of the system unde study is obtained. This equation allows econstucting a memoy function using a coelation function of the system. Actually, the memoy function appeas to be a suitable infomative visiting cad of any symbolic stochastic pocess. The effectiveness and obustness of the poposed method is demonstated by simple model examples. Memoy functions fo some concete examples of the coase-gained liteay texts ae constucted and thei powe-law behavio at long distances is evealed. Thus, we have shown the complexity of oganization of the liteay texts in

11 11 contast to a peviously discussed simple powe-law decease of coelations [24]. Ou theoy descibes not all statistical popeties of the binay symbolic sequences. Fo example, ou consideation cannot eflect the popety of diectivity of the texts since the theoy is based on the examination of the coelation function that is even by definition. This popety can be evealed only using the tenay (o of the highe ode) coelation functions. The linguistic aspects of the poblem also equie a egula and systematic study. We have examined the simplest examples o andom sequences, the dichotomic one. Nevetheless, ou peliminay consideation suggests that the pesented theoy can by genealized to the abitay additive Makov pocess with a finite o infinite numbe of states and with discete o continuous time. A study in this diection is in pogess. The poposed appoach can be used fo the analysis of othe coelated systems in diffeent fields of science. [1] U. Balucani, M. H. Lee, V. Tognetti, Phys. Rep. 373, 409 (2003). [2] I. M. Sokolov, Phys. Rev. Lett. 90, (2003). [3] R. F. Voss, Phys. Rev. Lett. 68, 3805 (1992). [4] H. E. Stanley et. al., Physica A 224,302 (1996). [5] R. N. Mantegna, H. E. Stanley, Natue (London) 376, 46 (1995). [6] A. Cziok, R. N. Mantegna, S. Havlin, and H. E. Stanley, Phys. Rev. E 52, 446 (1995). [7] A. Schenkel, J. Zhang, and Y. C. Zhang, Factals 1, 47 (1993). [8] P. Kokol, V. Podgoelec, Complexity Intenational, 7, 1 (2000). [9] O. V. Usatenko, V. A. Yampol skii, S. S. Mel nyk, and K. E. Kechedzhy, Phys. Rev. E 68, (2003). [10] S. L. Naasimhan, J. A. Nathan, and K. P. N. Muthy, Euophys. Lett. 69 (1), 22 (2005). [11] S. L. Naasimhan, J. A. Nathan, P. S. R. Kishna, and K. P. N. Muthy, axiv:cond-mat/ [12] W. Li, Euophys. Let. 10, 395 (1989). [13] R. F. Voss, in: Fundamental Algoithms in Compute Gaphics, ed. R. A. Eanshaw (Spinge, Belin, 1985) p [14] M. F. Shlesinge, G. M. Zaslavsky, and J. Klafte, Natue (London) 363, 31 (1993).

12 12 [15] I. F. Hebut, axiv:cond-mat/ [16] O. V. Usatenko and V. A. Yampol skii, Phys. Rev. Lett. 90, (2003). [17] S. Hod and U. Keshet, Phys. Rev. E 70, (R) (2004). [18] F. M. Izailev, A. A. Kokhin, and S. E. Ulloa, Phys. Rev. B 63, (R) (2001). [19] Note that we hee discuss the dependence of the vaiance D upon the length L that descibes the pesistent (o antipesistent) coelations in the wods of diffeent lengths L. This length does not coincides with the memoy length N, L N. The dependence D(L) is completely diffeent fom the dependence D on the memoy length N discussed in Ref. [10, 11]. [20] The existence of the additional tail in the coelation function is in ageement with Ref. [9] and coesponds to the well known fact that the coelation length is always lage then the egion of memoy function action. [21] The Old Testament of the King James Vesion of the Bible, [22] Russian Synodal LiO 31/7/91, http: //lib.u/ histian/bibliya/nowyj zawet.txt. [23] [24] I. Kante, D. A. Kessle, Phys. Rev. Lett. 74, 22 (1995).