Pnnng dynamc sysems of neworks wh Markovan swchng couplngs and conroller-node se Yujuan Han a, Wenlan Lu a,b,c,, Zhe L a, Tanpng Chen a,d a School of Mahemacal Scences, Fudan Unversy, Shangha 2433, Chna b Cenre for Compuaonal Sysems Bology, Fudan Unversy, Shangha 2433, Chna c Deparmen of Compuer Scence, The Unversy of Warwck, Covenry CV4 7AL, Uned Kngdom d School of Compuer Scence, Fudan Unversy, Shangha 2433, Chna arxv:44.6793v [cs.sy] 27 Apr 24 Absrac In hs paper, we sudy pnnng conrol problem of coupled dynamcal sysems wh sochascally swchng couplngs and sochascally seleced conroller-node se. Here, he couplng marces and he conroller-node ses change wh me, nduced by a connuous-me Markovan chan. By consrucng Lyapunov funcons, we esablsh racable suffcen condons for exponenally sably of he coupled sysem. Two scenaros are consdered here. Frs, we prove ha f each subsysem n he swchng sysem,.e. wh he fxed couplng, can be sablzed by he fxed pnnng conroller-node se, and n addon, he Markovan swchng s suffcenly slow, hen he me-varyng dynamcal sysem s sablzed. Second, n parcular, for he problem of spaal pnnng conrol of nework wh moble agens, we conclude ha f he sysem wh he average couplng and pnnng gans can be sablzed and he swchng s suffcenly fas, he me-varyng sysem s sablzed. Two numercal examples are provded o demonsrae he valdy of hese heorecal resuls, ncludng a swchng dynamcal sysem beween several sable sub-sysems, and a dynamcal sysem wh moble nodes and spaal pnnng conrol owards he nodes when hese nodes are beng n a predesgned regon. Keywords: pnnng conrol; coupled dynamcal sysem; Markovan swchng; spaal pnnng conrol. Inroducon Conrol and synchronzaon of large-scale dynamcal sysems have araced wde neress over he pas decades snce he new dscoveres of small-world and scale-free feaures [, 2]. When he nework canno be sablzed by self, many conrol sraeges are aken no accoun o force he nework o be sable. Among hese conrol sraeges, pnnng conrol s brllan because s easly realzable by conrollng a paral of he nodes nsead of all nodes n he nework. The general dea behnd pnnng conrol s o apply some local feedback conrollers only o a fracon of nodes and he res of nodes can be propagaed hrough he couplng among nodes. In mos exsng papers, auhors consdered wo dfferen pnnng sraeges: randomly pnnng and selecve pnnng based on he connecvy degrees. [3, 4] concluded ha pnnng of he mos hghly conneced nodes performance beer Correspondng auhor. Emal addresses: 92839@fudan.edu.cn (Yujuan Han), wenlan@fudan.edu.cn (Wenlan Lu), 2826@fudan.edu.cn (Zhe L),chen@fuan.edu.cn (Tanpng Chen) Ths work s jonly suppored by he Naonal Key Basc Research and Developmen Program (No. 2CB7343), he Naonal Naural Scences Foundaon of Chna under Gran Nos. 62732, 69745, and 627339, he Mare Cure Inernaonal Incomng Fellowshp from he European Commsson (FP7-PEOPLE-2-IIF-3242), and also he Laboraory of Mahemacs for Nonlnear Scence, Fudan Unversy. sablzably han he randomly pnnng scheme. [5]-[7] used Lyapunov funcons, maser sably funcons and algebrac properes of he couplng marx o sudy pnnng conrol of complex nework. [8]-[2] gave condons based on he graph opology of he nework guaraneeng sably. In hese papers, neworks wh me-nvaran lnks were consdered. [3] suded he global pnnng synchronzaon of Lorenz-ype dynamcal neworks wh boh fxed and swchng opologes. I was proved ha f each possble nework opology conans a dreced spannng ree and he dwell me of swchng s larger han a posve hreshold, global pnnng synchronsaon n swchng neworks wh a suable couplng srengh can be guaraneed. However, pnnng dynamc sysems of neworks wh sochascally swchng opologes s absen. Nong ha sably and conrollably of sochasc dfferenal equaons have been well suded hese years [4]-[7], n whch dfferenal dynamcal sysems wh Markovan swchng have receved los of research neress [8]-[2]. In hese papers, he sably of lnear, sem-lnear and nonlnear equaons wh Markovan swchng were suded and some suffcen crera were esablshed based on Lyapunov funcons and lnear marx nequales. Hence, n hs paper, we nvesgae he pnnng conrol of neworks wh Markovan swchng opologes. However, for a nework of moble agens, s dffcul o mplemen a pnnng conrol sraegy because he seleced conrollers are movng. [22]-[24] nvesgaed he flockng conrol Preprn submed o Elsever June 2, 28
va selecng some fxed nodes o be pnned pror. To avod hs, [25] nroduced he concep of spaal pnnng conrol for nework va applyng conrollers only on nodes (agens) whch ener a gven area, called conrol regon. In s seup, agens move followng random walkng n a planar space and nerac accordng o a me-varyng r-dsk proxmy graph. In he hs paper, we consdered a more general case, he movng moon of each agen follows a Markov process. Inspred by hese works, we nvesgae he pnnng conrol of a complex nework wh Markovan swchng couplngs o an arbrary rajecory of he uncoupled node sysem by Markovan seleced conroller-node se. We derve analycal condons for he sably of he sysem a he homogeneous rajecory. Based on he swchng speed of he couplngs and conrollernode ses, wo scenaros are consdered here. Frsly, f each subsysem n he swchng sysem wh fxed couplngs can be sablzed by fxed pnnng nodes and he Markovan swchng s suffcenly slow, he sysem can be sablzed. Secondly, f he sysem wh average couplng marx and pnnng gans can be sablzed and he Markovan swchng s suffcenly fas, he sysem can be sablzed. As an applcaon, we also sudy he spaal pnnng conrol problem of nework wh moble agens. Ths paper s organzed as follows. Secon 2 presens some defnons and some noaons requred n hs paper. Secon 3 nvesgaes he pnnng conrol problem of nework wh Markovan swchng couplng. Secon 4 nvesgaes he fas swchng neworks and as an applcaon, he spaal pnnng conrol of nework of moble agens s consdered. Smulaons are gven n secon 5 o verfy he heorecal resuls. Fnally, conclusons are drawn n secon 6. 2. Prelmnares where x () = [x (),,x n()] R n s he sae varable of he h node, [,+ ) s he connuous me, f: R n R + R n s he dynamcs of he uncoupled nodes, κ s he couplng srengh, l j () denoes he couplng coeffcen from agen j o agen a me, Γ = [γ kl ] n k,l= Rn n denoes he nner connecon marx whγ kl f wo agens are conneced by her kh and lh sae componen respecvely. For j, le l () = n j=,j l j(), hen he couplng marx L() = [l j ()] s a Mezler marx wh zero row sums a me. Supposeσ s a homogeneous connuous Markov chan wh a fne sae space S = {,2,,N} and s generaor Q = [q j ] N N s gven by P{σ + = j σ = } = { qj +o( ), j, +q +o( ), = j, where >, lm (o( )/ ) =, p j = qj q > s he ranson probably from o j f j, whle q = N j=,j q j. Denoe P = [p j ] he ranson marx of hs Markov process. Le k,k =,, be he successve sojourn me beween jumps. The sojourn me n sae s exponenally dsrbued wh parameerq. Denoe π(k) = [π (k),,π N (k)] he sae dsrbuon of he process a he k h swchng. From he Chapman- Kolmogorov equaon [29], he k h me dsrbuon can be expressed n erms of he nal sae dsrbuon and he ranson marx, ha sπ(k) = π()p k. Suppose he Markov chan σ s ergodc, hen from [3], we have hap s a prmve marx and here exss a sae dsrbuon π = [ π,, π N ] wh posve enres sasfes π = πp. From [34], we oban ha here exss posve numbers M and ζ < such ha π j (k) π j < Mζ k. (2) A frs, we nroduce some noaons needed hroughou hs paper. For a marx A, denoe a j he elemens of A on he h row and jh column. A denoes he ranspose of A. A s = (A + A )/2 denoes he symmery par of a square marx A. Denoe by A > ( ) ha A s a posve(semposve) defne and so s wh < and. I m denoes he deny marx wh dmenson m. For a symmerc square marx A, denoe λ M (A) and λ m (A) he larges and smalles egenvalues ofarespecvely,λ (A) he -h larges egenvalue of A. z denoes a vecor norm of a vecor z, A denoes he marx norm of A nduced by he vecor norm and denoe A = max,j a j. In parcular, whou specal noes, z = z 2 = z 2, he 2-norm. The symbol s he Kronecker produc. Lnearly coupled ordnary dfferenal equaons (LCODEs) are used o descrbe couplng dynamcal sysems, whch can be descrbed as follows: ẋ = f(x,)+κ m j=,j l j ()Γ[x j () x ()], =,,m. () 2 Pck π j = πj/qj N = π/q,j =,,N and π = [π,,π N ]. Then, we have πq =. We call π he nvaran dsrbuon of Markov processσ. Throughou he paper, we assumef(x,) belongs o he followng funcon class QUAD(G, αγ, β). Defnon. Funcon class QUAD (G, αγ, β): le G be an n n posve defne marx and Γ be an n n marx. QUAD(G, αγ, β) denoes a class of connuous funcons f(ξ,) : R n [,+ ) R n sasfyng (ξ ζ) G[f(ξ,) f(ζ,) αγ(ξ ζ)] β(ξ ζ) (ξ ζ), holds for some β > and all ξ,ζ R n. We say f(,) s globally Lpschz f f(ξ,) f(ζ,) Lf ξ ζ holds for somelf > and all ξ,ζ R n. QUAD condon defnes a class of funcons arsng n sably by quadrac ype of Lyapunov funcon and s also known as V -decreasng n some conexs [8]. I has a srong connecon o oher funcon classes, such as Lpschz condon and conracon. As menoned n [9], QUAD condon s
weaker han Lpschz condon. snce any globally Lpschz connuous funcon can be QUAD for suffcenly large α and G = Γ = I n. In hs paper, we consder he pnnng conrolled nework as follows: ẋ () = f(x (),)+κ m j= l j(σ )Γx j () +κǫc (σ )Γ(s() x ()), =,,m. (3) where ǫ > s he feedback conrol gan, c (τ) s a varable ha akes values,, σ s a homogeneous Markov chan proposed n secon 2, s() sasfyng ṡ() = f(s(),) s he arge rajecory of node dynamcs. Here, s() may be an equlbrum pon, a perodc orb, or even a chaoc orb. The nal value x() = x s chosen randomly and ndependen of he oher random varables. Denoe L(σ ) = [l j (σ )] and C(σ ) = dag{c (σ ),,c m (σ )}. We defne he pnnng conrol problem as a synchronzng all he saes of he nodes n he dynamcal nework o an arbrary rajecory s() of he uncoupled dynamcal sysem. Therefore, n he followng, we sudy he sably ofs() n sysem (3). Defnon 2. Sysem (3) s sad o be exponenally sable a s() n mean square sense, f here exss consans δ > and M >, such ha ] E [ x () s() 2 Me δ (4) holds for all > and any =,,m. Defnon 3. The sysem (3) s sable almos surely f [ ] P lm + x () s() = = (5) holds for all =,,m. 3. Pnnng me-varyng neworks In hs secon, we supposeσ s wh a fne sae spaces = {,,N}. Theorem. Suppose f(x,) QUAD(G,αΓ,β) and here exs dagonal posve defne marces P, =,,N such ha {P [αi m +κl() κǫc()] GΓ} s m + q j P j G, forall S, (6) j= hen he sysem (3) s exponenally sable a he homogeneous rajecory n mean square sense. Proof. Le x = [x,,x m ],ŝ = [s,,s ], y = x ŝ, F(x) = [f(x ),,f(x m ) ], C(σ ) = dag{c (σ ),,c m (σ )} and P σ = P σ G, hen we defne V(y,,σ ) = 2 y P σ y. The jon process{(y(),σ ) : > } 3 s a srong Markov process and he nfnesmal generaor of he process s: L = Q+dag{y P () y,,y P (m) y } Then, we have LV(y,,) = Le < δ we have j= Ee δ V(y,,σ ) q j V(y,,j)+( V(y,,) ) ẏ, (7) y 2β mn,j(pj) max {λ M(P )}. From he Dynkn Formula [2], =V(y,,σ )+δe +E V(y,,σ )+δe mn (P j) E,j +E GΓ+ e δτ LV(y,τ,σ τ )dτ e δτ V(y,τ,σ τ )dτ e δτ V(y,τ,σ τ )dτ e δτ βy ydτ e δτ y {P στ [αi m +κl(σ τ ) κǫc(σ τ )] m q στjp j G} s ydτ j= V(y,,σ )+δe mn,j (P j) E V(y,,σ )+E e δτ V(y,τ,σ τ )dτ e δτ βy ydτ + 2 δmax {λ M ( P )}]y ydτ V(y,,σ ) e δτ [ mn,j (P j) β The frs nequaly s because of (7), f(x, ) QU AD(G, αγ, β) and he second nequaly s due o he assumpon (6). Snce for each j S, we have So, mnλ m ( P )y y y Pj y maxλ M ( P )y y Thus, Ee δ x j () s() 2 mn λ m ( P ) Eeδ V(x,,σ ) mn λ m ( P ) V(x,,σ ) E x j () s() 2 V(y,,σ )e δ. The proof s compleed. As an applcaon, we gve he followng heorem. Denoe q = q.
Theorem 2. Suppose Γ = I m, f(x,) QUAD(G,αΓ,β) and every L() s srongly conneced, hen here exss dagonal posve defne marcesp, couplng srenghκand scaleǫ >, such ha{p [αi m +κl() κǫc()]} s are negave defne. If q λ M{P [αi m +κl() κǫc()]} s max j λ M (P j ) hen he sysem (3) s exponenally sable a he homogeneous rajecory n mean square sense. Proof. Le[p,,p m ] be he lef egenvecor of marxl() correspondng o egenvalue. [34] has proved ha f L() s srongly conneced, all p j >, =,,N,j =,,m. Denoe P = dag{p,,p m }. In [5], he auhors proved ha {P [κl() κǫc()]} s, =,,N are negave defne. Therefore, we can fnd suable κ >,ǫ > such ha {P [αi m + κl() κǫc()]} s, =,,N are negave defne. In addon, from he assumpons ofσ, we know q = q < and j q j = q j p j = q. Hence, f q sasfes condon (8), we have {P [αi m +κl() κǫc()]} s + q j P j j= λ M {P [αi m +κl() κǫc()]} s +q maxλ M (P j ) j, =,,N. The res s o apply heorem. The proof s compleed. Remark. Ths heorem ndcaes ha f each subsysem n he swchng sysem can be sablzed by he fxed pnnng node se and he Markovan swchng s suffcenly slow, hen he sysem s sable. Remark 2. In fac, f {P [αi m +κl() κǫc()]} s < does no hold for some ndex, wh properly pcked P j, j, for example, P > P j, suffcenly large q,.e, a small sojourn me a, properly pckedq j he condon (6) s possble o hold for. Hence, Theorem s more general han Theorem 2 and he swchng sysem among sable and unsable subsysems may be sable f boh he sojourn me n hese unsable subsysems and ranson probables from sable subsysems o hem are suffcenly small. 4. Pnnng fas swchng neworks In hs secon, we wll demonsrae ha f he Markov chan σ has nvaran dsrbuon, s correspondng generaorq and nvaran dsrbuon π play key roles n he sably analyss. The dagonal elemens of generaor reflec he swchng speed. The nvaran dsrbuon s used o consruc a nework called average nework. For he Markov chanσ wh a unque nvaran dsrbuon π = [π,,π N ], denoe L = N = π L() he average marx ofl(σ ) and C = N = π C() he average marx ofc(σ ). For he fas swchng case, we ge he pnnng conrollable crera of (3) from he average sysem. Before gvng he resuls, we resae he well-known Borel- Canell lemma n he form presened n [32]. (8) 4 Lemma. For a sochasc process X k R n wh k Z and a nonnegave funcong : R n R, f E[g(X k )] <, k= heng(x k ) converges o zero almos surely. Theorem 3. Suppose f(x,) s a Lpschz funcon wh Lpschz consanlf,f(x,) QUAD(G,αΓ,β) and here exs a dagonal posve defne marx P, consans κ > and ǫ > such ha {P(αI m +κ L κǫ C)} s s negave semdefne. Ifmn q > r for somer N and here > sasfes where (K K 3 )λ m ( P) ( e ρ ) ρλ M ( P) + K 4λ M ( P) (e ρ ) < (9) ρλ m ( P) P = P G, K = βmn(p ), K 2 = max λ j ({P(αI m +κl() κǫc()) GΓ} s ),,j K 3 = λ M ({P(αI m +κ L κǫ C) GΓ} s ), K 4 = mn[max A() (+Lf 2 ) +max A() s (κl(j) κǫc(j) Γ) ],,j ρ = 2K 2 λ m ( P) + 2K λ M ( P) >, A(σ ) = {P[κL(σ ) κ L κǫc(σ )+κǫ C] GΓ} s hen he sysem (3) s sablzed almos surely. Proof. Le x = [x,,x m ], F(x) = [f(x ),,f(x m ) ], y = x ŝ and defne V() = 2 y Py. Then he dervaon ofv along sysem (3) sasfes: V() y P[F(x) F(s) α(im Γ)y] Denoeρ = 2K2 Denoe + y { P[αI m +κl(σ τ ) κǫc(σ τ )] Γ} s y [ K2 2 λ m ( P) + K ] V() λ M ( P) + 2K λ m( P) λ M( P). Thus, for anyτ >, V()e ρ(τ ) V(τ) V()e ρ(τ ) () Φ(,+ ) = + [y(τ) A(σ τ )y(τ)dτ y() A(σ τ )y()]dτ
Hence, Φ(,+ ) = = 2 +2 + τ + τ + τ d dθ [y(θ) A(σ τ )y(θ)]dθdτ y(θ) A(σ τ )[F(x) F(s)]dθdτ y(θ) {A(σ τ )[kl(σ θ ) kǫc(σ θ )] Γ} s y(θ)dθdτ I s known ha for any marx B = [b j ] m n and any vecors x R m,y R n, x By max(m,n) 2 holds. Therefore, max b j (x x+y y),j y(θ) A(σ τ )[F(x) F(s)] mn 2 max A() [y(θ) y(θ)+(f(x) F(s)) (F(x) F(s))] mn 2 max A() [+Lf 2 ]y(θ) y(θ) and y(θ) {A(σ τ )[kl(σ θ ) kǫc(σ θ )] Γ} s y(θ) mn 2 max A() s (κl(j) κǫc(j) Γ) y(θ) y(θ).,j Then, we have Φ(,+ ) 2K 4 λ m ( P) 2K 4 λ m ( P) + + τ V(θ)dθ. Based on he above nequales, we have V(+ ) V() = = + + + 2K λ M ( P) + + + + + V(τ)dτ V(θ)dθdτ y P[F(x) F(s) α(im Γ)y]dτ y { P[αI m +κl(σ τ ) κǫc(σ τ )] Γ} s ydτ + 2K 2K 3 λ M ( P) + + V(τ)dτ +Φ(,+ ) y(τ) {P[αI m +κ L κǫ C] GΓ} s y(τ)dτ y() A(σ τ )y()dτ + y() A(σ τ )y()dτ V(τ)dτ + 2K 4 λ m ( P) + V(θ)dθ 5 Noe ha he condonal expecaon = E[ + k +n k k=k + j= = n k N j= (L(σ τ ) L)dτ y()] L(j)π j (k)e( k j) L L(j)π j q j L +R () = R () wherek s he swchng mes before me, n k = N j= πj q j s he expeced swchng mes beween nerval[,+ ], k j s he sojourn me n sae L(j) andr () s defned by: Then, R () = k +n k k=k + R () j=l(j)(π j (k) π j ) q j k +n k k=k + j= L(j) π j (k) π j q j N n max L() Mζ k k M ζ k q j= j where for any k N + and j =,,N, M = N /q M max L() j j= N. Smlarly, we can oban j= πj/qj E[ + (C(σ τ ) C)dτ y()] = R 2 () wh R 2 () M 2 ζ k wh somem 2 >. Hence, E[V(+ ) y()] V() () [ 2(K K 3 ) ( e ρ )+ 2K 4 ρλ M ( P) ρλ m ( P) (eρ )]V() +y() {P(κR ()+κǫr 2 ()) GΓ} s y() he nequaly s derved from (). For any gven andk 5 >, we can fnd neger k( ) such ha mnκ P GΓ ζ k( ) (M +ǫm 2 ) < K 5 (2) A reasonable requremen s ha he average sojourn me N j= π j/q j should be fne. We suppose here s an neger r > such ha j= π j max q j j q j < r, whch meansq needs o sasfy: mn q > r. Therefore, here mus exs a fne me k( ) such ha σ has swched k( ) mes before k( ). Hence, for any > k( ), y() {P(κR ()+κǫr 2 ()) GΓ} s y() mnκ P GΓ (M +ǫm 2 ) ζ k( ) y() y() < K 5 y() y()
holds. Noce ha sasfes condon (9), hence, when K 5 s suffcenly small, we can fnd a posve consanγ such ha (K K 3 )λ m ( P) ( e ρ ) ρλ M ( P) + K 4 λ M ( P) (e ρ )+K 5 γ. (3) ρλ m ( P) Take expecaons of (), we oban for any > k( ), E[V(+ )] E[V()] (K K 3 )λ m ( P) ( e ρ )E[y() y()] ρλ M ( P) + K 4λ M ( P) (e ρ )E[y() y()] ρλ m ( P) +K 5 E[y() y()] γe[y() y()] (4) Ierang (4), we oban for any neger p, E[V(+p )] E[V()] p γ E[y(+ ) y(+ )]. (5) = Thus, (5) means p = E[y( + ) y( + )] s bounded for any > k( ) and any negerp. Apply lemma o g(y) = y y, we oban ha y() converges o zero almos surely. Remark 3. We have menoned f he average couplng marx L s srongly conneced, hen here exs posve consans α,κ,ǫ and a posve dagonal marx P such ha {P(αI m + κ L κǫ C)} s s negave semdefne. Condon (9) can be guaraneed f q s suffcenly large. Hence, hs heorem ndcaes ha f he sysem wh he average couplng marx and average pnnng gans can be sablzed and he swchng s suffcenly fas, he me-varyng sysem s sablzed. As an applcaon, we consder spaal pnnng conrol of nework wh moble agens. Inspred by [25], we consder m agens movng n he planar spaceλ R 2 accordng o he random waypon model [33]. Denoey () = (y (),y 2 ()) Λ as he poson of agen a me. The moon of each agen s sochascally ndependen of he oher ones bu follows a dencal dsrbuon. The agen moves owards a randomly seleced arge wh a randomly velocy. Afer approachng he arge, he agen was for a random me lengh and hen connues he process. Accordng o he posons of agens n he gven areaλ, a undreced graph can be srucured. Two agens are consdered o be lnked a me f he dsance beween hem s less han a gven neracon radus r >. Therefore, he couplng marx s assgned by he spaal dsrbuon of he agens a each me. In deal, f y () y j () r, agens and j are coupled wh adjacen coeffcen, oherwse, hey are uncoupled. Hence, he couplng marx s a fne dmensonal symmerc marx wh elemens equal o or. Denoe S = {L(),,L(N )} all possble opologes of he m agens and L(σ ) he couplng marx of he nework a me, here σ : R + {,,N }. We can consder L(σ ) as a homogeneous connuous-me Markov chan wh fne sae spaces. The pnnng conrol regon Λ c s a fxed regon n Λ such ha once agen eners he conrol regon,.e., y () Λ c, hen a conrol npu s appled o agen, ha s, agen s pnned. For a pnned subse E of {,,m}, we defne a pnnng conrol marx C n such a way: f E, hen C =, oherwse C = and C j = for j. Denoe C = {C(),,C(N 2 )} all possble pnnng conrol marces and C(η ) he pnnng conrol marx a me, here η : R + {,,N 2 }. Smlarly, C(η ) s also a homogeneous connuous Markov chan wh a fne sae space C. Ths effec s due o he moon of agens follow ndependen Markov processes and he relaon beween he couplng marx and he poson of agens. For he random waypon, here are wo saes: one s he movng sae n whch he agen s movng owards a preseleced arge and he oher s he wang sae n whch he agen s wang for he nex movemen. Thus, leng V be he se of agens, we can consder he locaon and sae of he agens n he area as a sochasc process χ = [(α,β ),v,w,ξ,(η,ϑ )] V, where(α,β ) denoe he coordnaes of agen a me;v s he velocy of hs movemen and s zero f he agen s wang; w s he curren wang me perod f agen s wang and zero f s movng; ξ s he me cos of he curren wa f agen s wang, and - f s movng; and (η,ϑ ) are he coordnaes of he arge of he movemen of agen and equal o a fxed poson whch s ou of he regon f s wang. Thus, χ s a homogeneous Markov chan. Hence {σ,η } s a hgher dmensonal homogeneous Markov chan. For convenence, we suppose σ = η n he followng. The node dsrbuon of he RWP model was suded by Beseer e.al. (23). Ther resul mples ha he node dsrbuon of RWP s ergodc and s saonary pdf s always posve everywhere n he permed regon. Each par of agens has a posve probably o be lnked. Noe ha he moon of each agen s ndependen wh each oher and follows a same dsrbuon, whch mples ha he expeced couplng marx L s complee and all of s non-dagonal elemens are equal and he dagonal elemens of he expeced pnnng marx C are all posve and equal. On he oher hand, s easy o see ha he swchng of Markovan processes L(σ ) wll be fas f he moble agens move suffcenly fas and he wang me perod s suffcenly shor. Denoe d he maxmum dsance of each par of plos n area Λ and p he probably ha he dsance beween he arges of any wo agen s more han r >. Denoe v = mn v he mnmum movng velocy and w = max w he maxmum wang me. Apparenly, he movng me of an agen s less han m = d v. Follow he mark menoned above, (α,β ) and (θ,ϑ ) denoe he coordnaes of and s arge respecvely. Suppose agen coss more me o acheve s arge han agen j. If he mnmum wang me s larger han m 6
.8.6.4.2.2.4.6.8.5.5.5 Fgure : Chaoc rajecory of sysem (6). and he dsance beween he arges of agens, j s larger han r, hen afer me (α,β ) (θ,ϑ ) < v m, he dsance beween agenandj s more hanr. For wo agens,j whch are coupled currenly, denoew j he expeced me of agenescapng from agen j s r dsc,.e. o whose dsance s less han r. I can be esmaed: w j < p( p) n ((n+) m +n w ) n= < p m + ( p) w p.5 = d pv + ( p) w. p Smlarly, we can esmae he average escape me e of agen o ge ou of he pnnng regon: e < d pv + ( p) w p, where p s he probably ha he coordnae of he arge of agen s ou of he pnnng regon and d s he maxmum dsance of Λ c Denoe /q he expeced sojournng me perod of L(σ ) = L(). Apparenly, hey sasfy: max q < max(max,j w j,max e ). Hence, he assumpon ofmax(max,j w j,max e ) < r can dervemn q > r. Denoe L = l( ) mli m, here l s he probably ha wo agens are coupled. Denoe C = ci m, here c s he probably ha an agen eners no pnnng regon Λ c. Hence, he egenvalues of{αi m +κ L κǫ C} s areα κǫc and α κml κǫc. Then, for any α, we can fnd κ,ǫ > such ha α κǫ <, whch mples ha {αi m + κ L + κǫ C} s s negave sem-defne. Apply heorem 3 o he above nework, he followng corollary s obaned. Corollary. Pck κ,ǫ > such ha α κǫc <, here c s he probably ha an agen eners no pnnng regon Λ c. If d pv + ( p) w p < r and d pv + ( p) w p < r hold and here r N, > sasfes condon (9), he moble agen sysem (3) s sablzed almos surely. 5. Numercal smulaons 7 In hs secon, we gve some numercal examples o llusrae he heorecal resuls. In hese examples, we consder hreedmensonal neural nework as he uncoupled node dynamcs [27]: dx = Dx+Tg(x) (6) d whx = (x,x 2,x 3 ) R 3, T =.25 3.2 3.2 3.2. 4.4 3.2 4.4. D = I 3 and g(x) = (g(x ),g(x 2 ),g(x 3 )) where g(s) = ( s+ s )/2. Ths sysem has a double-scrollng chaoc aracor shown n Fg. wh nal condonx () = x 2 () = x 3 () =.. In he followng, we suppose sysem (6) s he uncoupled dynamcal sysem of each agens and he nner couplng marx Γ = I n. We can fnd ha any α >.5 can sasfy he decreasng condon wh G = I n. We use he followng quany o measure he varance for verces and arge rajecory: ς() = max x () s() here for a vecor z = [z,,z n ] R n, denoe z ˆ=max z. 5.. Slow swchng among sable sub-sysems Ths smulaon s for he pnnng conrolled nework (3) under assumpon n heorem 2 whm = 5. The ranson marx T of he Markov chanσ s T =.65.35.7.3..9.4.6.3.7. Pck he couplng marces 3 2 L() = 3 2 2 2 L(2) = 2 2 3 L(3) = 2 4 2 2 L(4) = 3 2 2
3 2.5 9 8 2 7 6 ζ().5 ζ() 5 4 3.5 2 2 3 4 5 6 7 8 9 5 5 Fgure 2: The dynamcal behavor of ς(). Fgure 3: The dynamcal behavor of ς(). L(5) = and he pnnng conrol marces 2 3 4 3 3 C() = dag{,,,,} C(2) = dag{,,,,} C(3) = dag{,,,,} C(4) = dag{,,,,} C(5) = dag{,,,,} Pck P = I m,α =,β =.5, k = and ǫ =, hen {αi m + kl() kǫc()} s are negave defne and {αi m + kl() kǫc()} s.75i m. In case max q <.75, he condon n Theorem s sasfed. Choose q randomly n (,.75). The nal value x() and s() are also chosen randomly. The ordnary dfferen equaons (3) are solved by he Runge-Kua fourh-order formula wh a sep lengh of.. Fg.2 ndcaes ha he pnnng conrol of (3) s sable. 5.2. Locally pnnng a sysem of moble agens In hs smulaon, we ake he random waypon mobly model [28] wh agens. Suppose random waypon area s square Λ = {(y,y 2 ) R 2 : y, y 2 }, and he agens are randomly locaed n Λ, he conrol regon Λ c = {(y,y 2 ) R 2 : y 5, y 2 5}. The nal locaon of each agen s randomly chosen nλ. If an agen acheves s arge, wll say n hs locaon durng a randomly chosen me nerval a. If he dsance beween locaons of wo agens s less han, hen hese wo agens are coupled. If he 8 locaon of an agen s n Λ c a me, hen hs agen s pnned a me. Here, we pck α β =.5,P = I m. In hs smulaon, we can calculae he expeced marces L = [ l j ] wh lj = π2.34 for j, C = 2.25Im. Pck κǫ >.5 can guaranee α.25κǫ. I can be calculaed ha K = β,k 2 α,k 3 = α.25κǫ. The Lpschz consan of funcon Dx+Tg(x) slf = 4.68. Pckκ =.5,ǫ = 2, we can esmae ha K K 3 =,K 4 = 25,ρ = 33. If we ake =.4, he condon (9) s guaraneed. Pck r = 75. Hence, he mnmum movng velocy v and maxmum wang me w should sasfy d pv + ( p) w < r and d pv + ( p) w p < r, here he probables can be esmaed: p > πr2 >.99 and p = 3 2 4. Then, we oban hav > 5 and w <.33. On he oher hand, he maxmum movng me s m = d v <.29 and we assume he wang me larger han.29. The ordnary dfferen equaons (3) are solved by he Runge-Kua fourh-order formula wh a sep lengh of.. Fg.3 ndcaes ha he pnnng conrol of (3) s sable. 6. Concluson In hs paper, we nvesgae he pnnng conrol problem of coupled dynamcal sysems wh Markovan swchng couplngs and Markovan swchng conroller-se. We derve analycal condons for he sably a he homogeneous rajecory of he uncoupled sysem. Frs, f each subsysem n he swchng sysem wh fxed pnnng nodes can be sablzed and he Markovan swchng s suffcenly slow, he sysem van be sablzed. Second, he swchng sysem can be sablzed f he sysem wh average couplng marx and pnnng gans can be sablzed and he Markovan swchng s suffcenly fas. As an applcaon, we also sudy he spaal pnnng conrol problem of nework wh moble agens. The effecveness of he p
proposed heorecal resuls are demonsraed by wo numercal examples. References [] D. J. Was, S. H. Srogaz, Collecve Dynamcs of Small World Neworks, Naure, 393(998):44-442. [2] A. L. Barabas, R. Alber, Emergence of Scalng n Random Neworks, Scence, 286(999): 59-52. [3] X. F. Wang, G. Chen, Pnnng conrol of scale-free dynamcal nework, Physcal A, 3(22), 52-53. [4] X. L, X. F. Wang, G. Chen, Pnnng a complex dynamcal nework o s equlbrum, IEEE Transacons on Crcus and Sysems-I: regular paper, 5()(24), 274-287. [5] T. P. Chen, X. W. Lu, W. L. Lu, Pnnng complex neworks by a sngle conroller. IEEE Transacons on Crcus and Sysems-I: regular papers, 54(6)(27):37-326. [6] M. Porfr, M. d Bernardo, Crera for global pnnng-conrollably of complex nework, Auomaca, 44(28), 3-36. [7] W. W. Yu, G. Chen, J. H. Lü, On pnnng synchronzaon of complex dynamcal neworks, Auomaca, 45(29), 429-435. [8] W. L. Lu, X. L, Z. H. Rong, Global synchronzaon of complex neworks wh dgraph opologes va a local pnnng algorhm, Auomaca 46(2), 6-2. [9] W. L. Lu, B. Lu, T. P. Chen, Cluser synchronzaon n neworks of coupled nondencal dynamcal sysems, Chaos, 2(2), 32. [] W. Ren, Mul-vehcle consensus wh a me-varyng reference sae, Sysems Conrol Le. 56 (27) 474-483. [] Q. Song, J. D. Cao and W. W. Yu, Second-order leader-followng consensus of nonlnear mul-agen sysems va pnnng conrol, Sysems Conrol Le. 59 (2) 553-562. [2] H. Y. Lu, G. M. Xe, L. Wang, Conanmen of lnear mul-agen sysems under general neracon opologes, Sysems Conrol Leers, 6 (22) 528-534. [3] G. H. Wen, W. W. Yu, Y. Zhao, J. D. Cao, Pnnng synchronzaon n fxed and swchng dreced neworks of Lorenz-ype nodes, IET Conrol Theory and Applcaons, 23. [4] L. Arnold, Sochasc dfferenal equaons: Theory and applcaons, John wley sons, 972. [5] A. Fredman, Sochasc dfferenal equaons and her applcaons, vol. 2, Academc press, 976. [6] R. Z. Has mnsk, Sochasc sably of dfferenal equaons, Sjhoff and Noorrdhoff, 98. [7] V. B. Kolmanovsk, A. Myshks, Appled heory of funconal dfferenal equaons, Kluwer Academc Publshers, 992. [8] Y. J, H. J. Chzeck, Conrollably, sablzably and connuous-me Markovan jump lnear quadrac conrol, IEEE Trans. Auoma. Conrol 35(99), 777-788. [9] G. K. Basak, A. Bs, M. K. Ghosh, Sably of a random dffuson wh lnear drf, J. Mah. Anal. Appl. 22(996), 64-622. [2] X.R. Mao and C.G. Yuan, Sochasc dfferenal equaons wh Markovan swchng, Imperal College Press, 26. [2] C. G. Yuan, X. R. Mao, Robus sably and conrollably of sochasc dfferenal delay equaons wh Markovan swchng, Auomaca 4(24), 343-354. [22] X. F. Wang, X. L, J. Lü, Conrol and flockng of neworked sysems va pnnng, IEEE Crcus and Sysems, (2), 83-9. [23] H. Su, X.F. Wang, G. Chen, Flockng of mul-agens wh a vrual leader, IEEE Transacons on Auomac Conrol, 54 (29), 293-37. [24] W. W. Yu, G. Chen, M. Cao, Dsrbued leader-follower flockng conrol for mul-agen dynamcal sysems wh me-varyng veloces, Sysems Conrol Leers, 59 (2) 543-552. [25] M. Frasca, A. Buscarno, A. Rzzo, and L. Foruna, Spaal Pnnng Conrol, Physcal Revew Leers, 22. [26] G. L. Jones, On he Markov chan cenral lm heorem, Probably surveys, (24), 299-32. [27] F. Zou, J.A. Nosse, Bfurcaon, and chaos n cellular neural neworks, IEEE Trans. CAS- 4 (3) (993) 66C73. [28] C. Beseer, H. Harensen, and X. Perez-Cosa, Sochasc properes of he random waypon mobly model, ACM/Kluwer Wreless Neworks, o appear 24. 9 [29] P. Bremaud, Markov Chans, Gbbs Felds, Mone Carlo Smulaon, and Queues, 999. [3] P. Bllngsley, Probably and Measure, Wley, New York, 986. [3] N. wan de Wouw, and A. Pavlov, Trackng and synchronzaon for a class of PWA sysems, Auomaca, 44()(28): 299-295. [32] H. Kushner, Inroducon o Sochasc Conrol, Hol, Rnehar and Wnson, Inc., New York, NY, 97. [33] D. B. Johnson, D. A. Malz. Dynamc source roung n ad hoc wreless neworks. In Moble compung, eded by T. Imelnsk and H. Korh, chaper 5, pp. 53-8,Kluwer Academc Publshers, 996. [34] R. A. Horn and C. R. Johnson. Marx analyss, Cambrdge Unversy Press, 985. [35] A. Berman, R. J. Plemmons, Nonnegave marces n he mahemacal scences, SIAM, Phladelpha, PA, 994.