arxiv: v1 [cs.sy] 27 Apr 2014

Transcription

1 Pnnng dynamc sysems of neworks wh Markovan swchng couplngs and conroller-node se Yujuan Han a, Wenlan Lu a,b,c,, Zhe L a, Tanpng Chen a,d a School of Mahemacal Scences, Fudan Unversy, Shangha 2433, Chna b Cenre for Compuaonal Sysems Bology, Fudan Unversy, Shangha 2433, Chna c Deparmen of Compuer Scence, The Unversy of Warwck, Covenry CV4 7AL, Uned Kngdom d School of Compuer Scence, Fudan Unversy, Shangha 2433, Chna arxv: v [cs.sy] 27 Apr 24 Absrac In hs paper, we sudy pnnng conrol problem of coupled dynamcal sysems wh sochascally swchng couplngs and sochascally seleced conroller-node se. Here, he couplng marces and he conroller-node ses change wh me, nduced by a connuous-me Markovan chan. By consrucng Lyapunov funcons, we esablsh racable suffcen condons for exponenally sably of he coupled sysem. Two scenaros are consdered here. Frs, we prove ha f each subsysem n he swchng sysem,.e. wh he fxed couplng, can be sablzed by he fxed pnnng conroller-node se, and n addon, he Markovan swchng s suffcenly slow, hen he me-varyng dynamcal sysem s sablzed. Second, n parcular, for he problem of spaal pnnng conrol of nework wh moble agens, we conclude ha f he sysem wh he average couplng and pnnng gans can be sablzed and he swchng s suffcenly fas, he me-varyng sysem s sablzed. Two numercal examples are provded o demonsrae he valdy of hese heorecal resuls, ncludng a swchng dynamcal sysem beween several sable sub-sysems, and a dynamcal sysem wh moble nodes and spaal pnnng conrol owards he nodes when hese nodes are beng n a predesgned regon. Keywords: pnnng conrol; coupled dynamcal sysem; Markovan swchng; spaal pnnng conrol. Inroducon Conrol and synchronzaon of large-scale dynamcal sysems have araced wde neress over he pas decades snce he new dscoveres of small-world and scale-free feaures [, 2]. When he nework canno be sablzed by self, many conrol sraeges are aken no accoun o force he nework o be sable. Among hese conrol sraeges, pnnng conrol s brllan because s easly realzable by conrollng a paral of he nodes nsead of all nodes n he nework. The general dea behnd pnnng conrol s o apply some local feedback conrollers only o a fracon of nodes and he res of nodes can be propagaed hrough he couplng among nodes. In mos exsng papers, auhors consdered wo dfferen pnnng sraeges: randomly pnnng and selecve pnnng based on he connecvy degrees. [3, 4] concluded ha pnnng of he mos hghly conneced nodes performance beer Correspondng auhor. Emal addresses: 92839@fudan.edu.cn (Yujuan Han), wenlan@fudan.edu.cn (Wenlan Lu), 2826@fudan.edu.cn (Zhe L),chen@fuan.edu.cn (Tanpng Chen) Ths work s jonly suppored by he Naonal Key Basc Research and Developmen Program (No. 2CB7343), he Naonal Naural Scences Foundaon of Chna under Gran Nos , 69745, and , he Mare Cure Inernaonal Incomng Fellowshp from he European Commsson (FP7-PEOPLE-2-IIF-3242), and also he Laboraory of Mahemacs for Nonlnear Scence, Fudan Unversy. sablzably han he randomly pnnng scheme. [5]-[7] used Lyapunov funcons, maser sably funcons and algebrac properes of he couplng marx o sudy pnnng conrol of complex nework. [8]-[2] gave condons based on he graph opology of he nework guaraneeng sably. In hese papers, neworks wh me-nvaran lnks were consdered. [3] suded he global pnnng synchronzaon of Lorenz-ype dynamcal neworks wh boh fxed and swchng opologes. I was proved ha f each possble nework opology conans a dreced spannng ree and he dwell me of swchng s larger han a posve hreshold, global pnnng synchronsaon n swchng neworks wh a suable couplng srengh can be guaraneed. However, pnnng dynamc sysems of neworks wh sochascally swchng opologes s absen. Nong ha sably and conrollably of sochasc dfferenal equaons have been well suded hese years [4]-[7], n whch dfferenal dynamcal sysems wh Markovan swchng have receved los of research neress [8]-[2]. In hese papers, he sably of lnear, sem-lnear and nonlnear equaons wh Markovan swchng were suded and some suffcen crera were esablshed based on Lyapunov funcons and lnear marx nequales. Hence, n hs paper, we nvesgae he pnnng conrol of neworks wh Markovan swchng opologes. However, for a nework of moble agens, s dffcul o mplemen a pnnng conrol sraegy because he seleced conrollers are movng. [22]-[24] nvesgaed he flockng conrol Preprn submed o Elsever June 2, 28

2 va selecng some fxed nodes o be pnned pror. To avod hs, [25] nroduced he concep of spaal pnnng conrol for nework va applyng conrollers only on nodes (agens) whch ener a gven area, called conrol regon. In s seup, agens move followng random walkng n a planar space and nerac accordng o a me-varyng r-dsk proxmy graph. In he hs paper, we consdered a more general case, he movng moon of each agen follows a Markov process. Inspred by hese works, we nvesgae he pnnng conrol of a complex nework wh Markovan swchng couplngs o an arbrary rajecory of he uncoupled node sysem by Markovan seleced conroller-node se. We derve analycal condons for he sably of he sysem a he homogeneous rajecory. Based on he swchng speed of he couplngs and conrollernode ses, wo scenaros are consdered here. Frsly, f each subsysem n he swchng sysem wh fxed couplngs can be sablzed by fxed pnnng nodes and he Markovan swchng s suffcenly slow, he sysem can be sablzed. Secondly, f he sysem wh average couplng marx and pnnng gans can be sablzed and he Markovan swchng s suffcenly fas, he sysem can be sablzed. As an applcaon, we also sudy he spaal pnnng conrol problem of nework wh moble agens. Ths paper s organzed as follows. Secon 2 presens some defnons and some noaons requred n hs paper. Secon 3 nvesgaes he pnnng conrol problem of nework wh Markovan swchng couplng. Secon 4 nvesgaes he fas swchng neworks and as an applcaon, he spaal pnnng conrol of nework of moble agens s consdered. Smulaons are gven n secon 5 o verfy he heorecal resuls. Fnally, conclusons are drawn n secon Prelmnares where x () = [x (),,x n()] R n s he sae varable of he h node, [,+ ) s he connuous me, f: R n R + R n s he dynamcs of he uncoupled nodes, κ s he couplng srengh, l j () denoes he couplng coeffcen from agen j o agen a me, Γ = [γ kl ] n k,l= Rn n denoes he nner connecon marx whγ kl f wo agens are conneced by her kh and lh sae componen respecvely. For j, le l () = n j=,j l j(), hen he couplng marx L() = [l j ()] s a Mezler marx wh zero row sums a me. Supposeσ s a homogeneous connuous Markov chan wh a fne sae space S = {,2,,N} and s generaor Q = [q j ] N N s gven by P{σ + = j σ = } = { qj +o( ), j, +q +o( ), = j, where >, lm (o( )/ ) =, p j = qj q > s he ranson probably from o j f j, whle q = N j=,j q j. Denoe P = [p j ] he ranson marx of hs Markov process. Le k,k =,, be he successve sojourn me beween jumps. The sojourn me n sae s exponenally dsrbued wh parameerq. Denoe π(k) = [π (k),,π N (k)] he sae dsrbuon of he process a he k h swchng. From he Chapman- Kolmogorov equaon [29], he k h me dsrbuon can be expressed n erms of he nal sae dsrbuon and he ranson marx, ha sπ(k) = π()p k. Suppose he Markov chan σ s ergodc, hen from [3], we have hap s a prmve marx and here exss a sae dsrbuon π = [ π,, π N ] wh posve enres sasfes π = πp. From [34], we oban ha here exss posve numbers M and ζ < such ha π j (k) π j < Mζ k. (2) A frs, we nroduce some noaons needed hroughou hs paper. For a marx A, denoe a j he elemens of A on he h row and jh column. A denoes he ranspose of A. A s = (A + A )/2 denoes he symmery par of a square marx A. Denoe by A > ( ) ha A s a posve(semposve) defne and so s wh < and. I m denoes he deny marx wh dmenson m. For a symmerc square marx A, denoe λ M (A) and λ m (A) he larges and smalles egenvalues ofarespecvely,λ (A) he -h larges egenvalue of A. z denoes a vecor norm of a vecor z, A denoes he marx norm of A nduced by he vecor norm and denoe A = max,j a j. In parcular, whou specal noes, z = z 2 = z 2, he 2-norm. The symbol s he Kronecker produc. Lnearly coupled ordnary dfferenal equaons (LCODEs) are used o descrbe couplng dynamcal sysems, whch can be descrbed as follows: ẋ = f(x,)+κ m j=,j l j ()Γ[x j () x ()], =,,m. () 2 Pck π j = πj/qj N = π/q,j =,,N and π = [π,,π N ]. Then, we have πq =. We call π he nvaran dsrbuon of Markov processσ. Throughou he paper, we assumef(x,) belongs o he followng funcon class QUAD(G, αγ, β). Defnon. Funcon class QUAD (G, αγ, β): le G be an n n posve defne marx and Γ be an n n marx. QUAD(G, αγ, β) denoes a class of connuous funcons f(ξ,) : R n [,+ ) R n sasfyng (ξ ζ) G[f(ξ,) f(ζ,) αγ(ξ ζ)] β(ξ ζ) (ξ ζ), holds for some β > and all ξ,ζ R n. We say f(,) s globally Lpschz f f(ξ,) f(ζ,) Lf ξ ζ holds for somelf > and all ξ,ζ R n. QUAD condon defnes a class of funcons arsng n sably by quadrac ype of Lyapunov funcon and s also known as V -decreasng n some conexs [8]. I has a srong connecon o oher funcon classes, such as Lpschz condon and conracon. As menoned n [9], QUAD condon s

3 weaker han Lpschz condon. snce any globally Lpschz connuous funcon can be QUAD for suffcenly large α and G = Γ = I n. In hs paper, we consder he pnnng conrolled nework as follows: ẋ () = f(x (),)+κ m j= l j(σ )Γx j () +κǫc (σ )Γ(s() x ()), =,,m. (3) where ǫ > s he feedback conrol gan, c (τ) s a varable ha akes values,, σ s a homogeneous Markov chan proposed n secon 2, s() sasfyng ṡ() = f(s(),) s he arge rajecory of node dynamcs. Here, s() may be an equlbrum pon, a perodc orb, or even a chaoc orb. The nal value x() = x s chosen randomly and ndependen of he oher random varables. Denoe L(σ ) = [l j (σ )] and C(σ ) = dag{c (σ ),,c m (σ )}. We defne he pnnng conrol problem as a synchronzng all he saes of he nodes n he dynamcal nework o an arbrary rajecory s() of he uncoupled dynamcal sysem. Therefore, n he followng, we sudy he sably ofs() n sysem (3). Defnon 2. Sysem (3) s sad o be exponenally sable a s() n mean square sense, f here exss consans δ > and M >, such ha ] E [ x () s() 2 Me δ (4) holds for all > and any =,,m. Defnon 3. The sysem (3) s sable almos surely f [ ] P lm + x () s() = = (5) holds for all =,,m. 3. Pnnng me-varyng neworks In hs secon, we supposeσ s wh a fne sae spaces = {,,N}. Theorem. Suppose f(x,) QUAD(G,αΓ,β) and here exs dagonal posve defne marces P, =,,N such ha {P [αi m +κl() κǫc()] GΓ} s m + q j P j G, forall S, (6) j= hen he sysem (3) s exponenally sable a he homogeneous rajecory n mean square sense. Proof. Le x = [x,,x m ],ŝ = [s,,s ], y = x ŝ, F(x) = [f(x ),,f(x m ) ], C(σ ) = dag{c (σ ),,c m (σ )} and P σ = P σ G, hen we defne V(y,,σ ) = 2 y P σ y. The jon process{(y(),σ ) : > } 3 s a srong Markov process and he nfnesmal generaor of he process s: L = Q+dag{y P () y,,y P (m) y } Then, we have LV(y,,) = Le < δ we have j= Ee δ V(y,,σ ) q j V(y,,j)+( V(y,,) ) ẏ, (7) y 2β mn,j(pj) max {λ M(P )}. From he Dynkn Formula [2], =V(y,,σ )+δe +E V(y,,σ )+δe mn (P j) E,j +E GΓ+ e δτ LV(y,τ,σ τ )dτ e δτ V(y,τ,σ τ )dτ e δτ V(y,τ,σ τ )dτ e δτ βy ydτ e δτ y {P στ [αi m +κl(σ τ ) κǫc(σ τ )] m q στjp j G} s ydτ j= V(y,,σ )+δe mn,j (P j) E V(y,,σ )+E e δτ V(y,τ,σ τ )dτ e δτ βy ydτ + 2 δmax {λ M ( P )}]y ydτ V(y,,σ ) e δτ [ mn,j (P j) β The frs nequaly s because of (7), f(x, ) QU AD(G, αγ, β) and he second nequaly s due o he assumpon (6). Snce for each j S, we have So, mnλ m ( P )y y y Pj y maxλ M ( P )y y Thus, Ee δ x j () s() 2 mn λ m ( P ) Eeδ V(x,,σ ) mn λ m ( P ) V(x,,σ ) E x j () s() 2 V(y,,σ )e δ. The proof s compleed. As an applcaon, we gve he followng heorem. Denoe q = q.

4 Theorem 2. Suppose Γ = I m, f(x,) QUAD(G,αΓ,β) and every L() s srongly conneced, hen here exss dagonal posve defne marcesp, couplng srenghκand scaleǫ >, such ha{p [αi m +κl() κǫc()]} s are negave defne. If q λ M{P [αi m +κl() κǫc()]} s max j λ M (P j ) hen he sysem (3) s exponenally sable a he homogeneous rajecory n mean square sense. Proof. Le[p,,p m ] be he lef egenvecor of marxl() correspondng o egenvalue. [34] has proved ha f L() s srongly conneced, all p j >, =,,N,j =,,m. Denoe P = dag{p,,p m }. In [5], he auhors proved ha {P [κl() κǫc()]} s, =,,N are negave defne. Therefore, we can fnd suable κ >,ǫ > such ha {P [αi m + κl() κǫc()]} s, =,,N are negave defne. In addon, from he assumpons ofσ, we know q = q < and j q j = q j p j = q. Hence, f q sasfes condon (8), we have {P [αi m +κl() κǫc()]} s + q j P j j= λ M {P [αi m +κl() κǫc()]} s +q maxλ M (P j ) j, =,,N. The res s o apply heorem. The proof s compleed. Remark. Ths heorem ndcaes ha f each subsysem n he swchng sysem can be sablzed by he fxed pnnng node se and he Markovan swchng s suffcenly slow, hen he sysem s sable. Remark 2. In fac, f {P [αi m +κl() κǫc()]} s < does no hold for some ndex, wh properly pcked P j, j, for example, P > P j, suffcenly large q,.e, a small sojourn me a, properly pckedq j he condon (6) s possble o hold for. Hence, Theorem s more general han Theorem 2 and he swchng sysem among sable and unsable subsysems may be sable f boh he sojourn me n hese unsable subsysems and ranson probables from sable subsysems o hem are suffcenly small. 4. Pnnng fas swchng neworks In hs secon, we wll demonsrae ha f he Markov chan σ has nvaran dsrbuon, s correspondng generaorq and nvaran dsrbuon π play key roles n he sably analyss. The dagonal elemens of generaor reflec he swchng speed. The nvaran dsrbuon s used o consruc a nework called average nework. For he Markov chanσ wh a unque nvaran dsrbuon π = [π,,π N ], denoe L = N = π L() he average marx ofl(σ ) and C = N = π C() he average marx ofc(σ ). For he fas swchng case, we ge he pnnng conrollable crera of (3) from he average sysem. Before gvng he resuls, we resae he well-known Borel- Canell lemma n he form presened n [32]. (8) 4 Lemma. For a sochasc process X k R n wh k Z and a nonnegave funcong : R n R, f E[g(X k )] <, k= heng(x k ) converges o zero almos surely. Theorem 3. Suppose f(x,) s a Lpschz funcon wh Lpschz consanlf,f(x,) QUAD(G,αΓ,β) and here exs a dagonal posve defne marx P, consans κ > and ǫ > such ha {P(αI m +κ L κǫ C)} s s negave semdefne. Ifmn q > r for somer N and here > sasfes where (K K 3 )λ m ( P) ( e ρ ) ρλ M ( P) + K 4λ M ( P) (e ρ ) < (9) ρλ m ( P) P = P G, K = βmn(p ), K 2 = max λ j ({P(αI m +κl() κǫc()) GΓ} s ),,j K 3 = λ M ({P(αI m +κ L κǫ C) GΓ} s ), K 4 = mn[max A() (+Lf 2 ) +max A() s (κl(j) κǫc(j) Γ) ],,j ρ = 2K 2 λ m ( P) + 2K λ M ( P) >, A(σ ) = {P[κL(σ ) κ L κǫc(σ )+κǫ C] GΓ} s hen he sysem (3) s sablzed almos surely. Proof. Le x = [x,,x m ], F(x) = [f(x ),,f(x m ) ], y = x ŝ and defne V() = 2 y Py. Then he dervaon ofv along sysem (3) sasfes: V() y P[F(x) F(s) α(im Γ)y] Denoeρ = 2K2 Denoe + y { P[αI m +κl(σ τ ) κǫc(σ τ )] Γ} s y [ K2 2 λ m ( P) + K ] V() λ M ( P) + 2K λ m( P) λ M( P). Thus, for anyτ >, V()e ρ(τ ) V(τ) V()e ρ(τ ) () Φ(,+ ) = + [y(τ) A(σ τ )y(τ)dτ y() A(σ τ )y()]dτ

5 Hence, Φ(,+ ) = = τ + τ + τ d dθ [y(θ) A(σ τ )y(θ)]dθdτ y(θ) A(σ τ )[F(x) F(s)]dθdτ y(θ) {A(σ τ )[kl(σ θ ) kǫc(σ θ )] Γ} s y(θ)dθdτ I s known ha for any marx B = [b j ] m n and any vecors x R m,y R n, x By max(m,n) 2 holds. Therefore, max b j (x x+y y),j y(θ) A(σ τ )[F(x) F(s)] mn 2 max A() [y(θ) y(θ)+(f(x) F(s)) (F(x) F(s))] mn 2 max A() [+Lf 2 ]y(θ) y(θ) and y(θ) {A(σ τ )[kl(σ θ ) kǫc(σ θ )] Γ} s y(θ) mn 2 max A() s (κl(j) κǫc(j) Γ) y(θ) y(θ).,j Then, we have Φ(,+ ) 2K 4 λ m ( P) 2K 4 λ m ( P) + + τ V(θ)dθ. Based on he above nequales, we have V(+ ) V() = = K λ M ( P) V(τ)dτ V(θ)dθdτ y P[F(x) F(s) α(im Γ)y]dτ y { P[αI m +κl(σ τ ) κǫc(σ τ )] Γ} s ydτ + 2K 2K 3 λ M ( P) + + V(τ)dτ +Φ(,+ ) y(τ) {P[αI m +κ L κǫ C] GΓ} s y(τ)dτ y() A(σ τ )y()dτ + y() A(σ τ )y()dτ V(τ)dτ + 2K 4 λ m ( P) + V(θ)dθ 5 Noe ha he condonal expecaon = E[ + k +n k k=k + j= = n k N j= (L(σ τ ) L)dτ y()] L(j)π j (k)e( k j) L L(j)π j q j L +R () = R () wherek s he swchng mes before me, n k = N j= πj q j s he expeced swchng mes beween nerval[,+ ], k j s he sojourn me n sae L(j) andr () s defned by: Then, R () = k +n k k=k + R () j=l(j)(π j (k) π j ) q j k +n k k=k + j= L(j) π j (k) π j q j N n max L() Mζ k k M ζ k q j= j where for any k N + and j =,,N, M = N /q M max L() j j= N. Smlarly, we can oban j= πj/qj E[ + (C(σ τ ) C)dτ y()] = R 2 () wh R 2 () M 2 ζ k wh somem 2 >. Hence, E[V(+ ) y()] V() () [ 2(K K 3 ) ( e ρ )+ 2K 4 ρλ M ( P) ρλ m ( P) (eρ )]V() +y() {P(κR ()+κǫr 2 ()) GΓ} s y() he nequaly s derved from (). For any gven andk 5 >, we can fnd neger k( ) such ha mnκ P GΓ ζ k( ) (M +ǫm 2 ) < K 5 (2) A reasonable requremen s ha he average sojourn me N j= π j/q j should be fne. We suppose here s an neger r > such ha j= π j max q j j q j < r, whch meansq needs o sasfy: mn q > r. Therefore, here mus exs a fne me k( ) such ha σ has swched k( ) mes before k( ). Hence, for any > k( ), y() {P(κR ()+κǫr 2 ()) GΓ} s y() mnκ P GΓ (M +ǫm 2 ) ζ k( ) y() y() < K 5 y() y()

6 holds. Noce ha sasfes condon (9), hence, when K 5 s suffcenly small, we can fnd a posve consanγ such ha (K K 3 )λ m ( P) ( e ρ ) ρλ M ( P) + K 4 λ M ( P) (e ρ )+K 5 γ. (3) ρλ m ( P) Take expecaons of (), we oban for any > k( ), E[V(+ )] E[V()] (K K 3 )λ m ( P) ( e ρ )E[y() y()] ρλ M ( P) + K 4λ M ( P) (e ρ )E[y() y()] ρλ m ( P) +K 5 E[y() y()] γe[y() y()] (4) Ierang (4), we oban for any neger p, E[V(+p )] E[V()] p γ E[y(+ ) y(+ )]. (5) = Thus, (5) means p = E[y( + ) y( + )] s bounded for any > k( ) and any negerp. Apply lemma o g(y) = y y, we oban ha y() converges o zero almos surely. Remark 3. We have menoned f he average couplng marx L s srongly conneced, hen here exs posve consans α,κ,ǫ and a posve dagonal marx P such ha {P(αI m + κ L κǫ C)} s s negave semdefne. Condon (9) can be guaraneed f q s suffcenly large. Hence, hs heorem ndcaes ha f he sysem wh he average couplng marx and average pnnng gans can be sablzed and he swchng s suffcenly fas, he me-varyng sysem s sablzed. As an applcaon, we consder spaal pnnng conrol of nework wh moble agens. Inspred by [25], we consder m agens movng n he planar spaceλ R 2 accordng o he random waypon model [33]. Denoey () = (y (),y 2 ()) Λ as he poson of agen a me. The moon of each agen s sochascally ndependen of he oher ones bu follows a dencal dsrbuon. The agen moves owards a randomly seleced arge wh a randomly velocy. Afer approachng he arge, he agen was for a random me lengh and hen connues he process. Accordng o he posons of agens n he gven areaλ, a undreced graph can be srucured. Two agens are consdered o be lnked a me f he dsance beween hem s less han a gven neracon radus r >. Therefore, he couplng marx s assgned by he spaal dsrbuon of he agens a each me. In deal, f y () y j () r, agens and j are coupled wh adjacen coeffcen, oherwse, hey are uncoupled. Hence, he couplng marx s a fne dmensonal symmerc marx wh elemens equal o or. Denoe S = {L(),,L(N )} all possble opologes of he m agens and L(σ ) he couplng marx of he nework a me, here σ : R + {,,N }. We can consder L(σ ) as a homogeneous connuous-me Markov chan wh fne sae spaces. The pnnng conrol regon Λ c s a fxed regon n Λ such ha once agen eners he conrol regon,.e., y () Λ c, hen a conrol npu s appled o agen, ha s, agen s pnned. For a pnned subse E of {,,m}, we defne a pnnng conrol marx C n such a way: f E, hen C =, oherwse C = and C j = for j. Denoe C = {C(),,C(N 2 )} all possble pnnng conrol marces and C(η ) he pnnng conrol marx a me, here η : R + {,,N 2 }. Smlarly, C(η ) s also a homogeneous connuous Markov chan wh a fne sae space C. Ths effec s due o he moon of agens follow ndependen Markov processes and he relaon beween he couplng marx and he poson of agens. For he random waypon, here are wo saes: one s he movng sae n whch he agen s movng owards a preseleced arge and he oher s he wang sae n whch he agen s wang for he nex movemen. Thus, leng V be he se of agens, we can consder he locaon and sae of he agens n he area as a sochasc process χ = [(α,β ),v,w,ξ,(η,ϑ )] V, where(α,β ) denoe he coordnaes of agen a me;v s he velocy of hs movemen and s zero f he agen s wang; w s he curren wang me perod f agen s wang and zero f s movng; ξ s he me cos of he curren wa f agen s wang, and - f s movng; and (η,ϑ ) are he coordnaes of he arge of he movemen of agen and equal o a fxed poson whch s ou of he regon f s wang. Thus, χ s a homogeneous Markov chan. Hence {σ,η } s a hgher dmensonal homogeneous Markov chan. For convenence, we suppose σ = η n he followng. The node dsrbuon of he RWP model was suded by Beseer e.al. (23). Ther resul mples ha he node dsrbuon of RWP s ergodc and s saonary pdf s always posve everywhere n he permed regon. Each par of agens has a posve probably o be lnked. Noe ha he moon of each agen s ndependen wh each oher and follows a same dsrbuon, whch mples ha he expeced couplng marx L s complee and all of s non-dagonal elemens are equal and he dagonal elemens of he expeced pnnng marx C are all posve and equal. On he oher hand, s easy o see ha he swchng of Markovan processes L(σ ) wll be fas f he moble agens move suffcenly fas and he wang me perod s suffcenly shor. Denoe d he maxmum dsance of each par of plos n area Λ and p he probably ha he dsance beween he arges of any wo agen s more han r >. Denoe v = mn v he mnmum movng velocy and w = max w he maxmum wang me. Apparenly, he movng me of an agen s less han m = d v. Follow he mark menoned above, (α,β ) and (θ,ϑ ) denoe he coordnaes of and s arge respecvely. Suppose agen coss more me o acheve s arge han agen j. If he mnmum wang me s larger han m 6

7 Fgure : Chaoc rajecory of sysem (6). and he dsance beween he arges of agens, j s larger han r, hen afer me (α,β ) (θ,ϑ ) < v m, he dsance beween agenandj s more hanr. For wo agens,j whch are coupled currenly, denoew j he expeced me of agenescapng from agen j s r dsc,.e. o whose dsance s less han r. I can be esmaed: w j < p( p) n ((n+) m +n w ) n= < p m + ( p) w p.5 = d pv + ( p) w. p Smlarly, we can esmae he average escape me e of agen o ge ou of he pnnng regon: e < d pv + ( p) w p, where p s he probably ha he coordnae of he arge of agen s ou of he pnnng regon and d s he maxmum dsance of Λ c Denoe /q he expeced sojournng me perod of L(σ ) = L(). Apparenly, hey sasfy: max q < max(max,j w j,max e ). Hence, he assumpon ofmax(max,j w j,max e ) < r can dervemn q > r. Denoe L = l( ) mli m, here l s he probably ha wo agens are coupled. Denoe C = ci m, here c s he probably ha an agen eners no pnnng regon Λ c. Hence, he egenvalues of{αi m +κ L κǫ C} s areα κǫc and α κml κǫc. Then, for any α, we can fnd κ,ǫ > such ha α κǫ <, whch mples ha {αi m + κ L + κǫ C} s s negave sem-defne. Apply heorem 3 o he above nework, he followng corollary s obaned. Corollary. Pck κ,ǫ > such ha α κǫc <, here c s he probably ha an agen eners no pnnng regon Λ c. If d pv + ( p) w p < r and d pv + ( p) w p < r hold and here r N, > sasfes condon (9), he moble agen sysem (3) s sablzed almos surely. 5. Numercal smulaons 7 In hs secon, we gve some numercal examples o llusrae he heorecal resuls. In hese examples, we consder hreedmensonal neural nework as he uncoupled node dynamcs [27]: dx = Dx+Tg(x) (6) d whx = (x,x 2,x 3 ) R 3, T = D = I 3 and g(x) = (g(x ),g(x 2 ),g(x 3 )) where g(s) = ( s+ s )/2. Ths sysem has a double-scrollng chaoc aracor shown n Fg. wh nal condonx () = x 2 () = x 3 () =.. In he followng, we suppose sysem (6) s he uncoupled dynamcal sysem of each agens and he nner couplng marx Γ = I n. We can fnd ha any α >.5 can sasfy he decreasng condon wh G = I n. We use he followng quany o measure he varance for verces and arge rajecory: ς() = max x () s() here for a vecor z = [z,,z n ] R n, denoe z ˆ=max z. 5.. Slow swchng among sable sub-sysems Ths smulaon s for he pnnng conrolled nework (3) under assumpon n heorem 2 whm = 5. The ranson marx T of he Markov chanσ s T = Pck he couplng marces 3 2 L() = L(2) = L(3) = L(4) = 3 2 2

8 ζ().5 ζ() Fgure 2: The dynamcal behavor of ς(). Fgure 3: The dynamcal behavor of ς(). L(5) = and he pnnng conrol marces C() = dag{,,,,} C(2) = dag{,,,,} C(3) = dag{,,,,} C(4) = dag{,,,,} C(5) = dag{,,,,} Pck P = I m,α =,β =.5, k = and ǫ =, hen {αi m + kl() kǫc()} s are negave defne and {αi m + kl() kǫc()} s.75i m. In case max q <.75, he condon n Theorem s sasfed. Choose q randomly n (,.75). The nal value x() and s() are also chosen randomly. The ordnary dfferen equaons (3) are solved by he Runge-Kua fourh-order formula wh a sep lengh of.. Fg.2 ndcaes ha he pnnng conrol of (3) s sable Locally pnnng a sysem of moble agens In hs smulaon, we ake he random waypon mobly model [28] wh agens. Suppose random waypon area s square Λ = {(y,y 2 ) R 2 : y, y 2 }, and he agens are randomly locaed n Λ, he conrol regon Λ c = {(y,y 2 ) R 2 : y 5, y 2 5}. The nal locaon of each agen s randomly chosen nλ. If an agen acheves s arge, wll say n hs locaon durng a randomly chosen me nerval a. If he dsance beween locaons of wo agens s less han, hen hese wo agens are coupled. If he 8 locaon of an agen s n Λ c a me, hen hs agen s pnned a me. Here, we pck α β =.5,P = I m. In hs smulaon, we can calculae he expeced marces L = [ l j ] wh lj = π2.34 for j, C = 2.25Im. Pck κǫ >.5 can guaranee α.25κǫ. I can be calculaed ha K = β,k 2 α,k 3 = α.25κǫ. The Lpschz consan of funcon Dx+Tg(x) slf = Pckκ =.5,ǫ = 2, we can esmae ha K K 3 =,K 4 = 25,ρ = 33. If we ake =.4, he condon (9) s guaraneed. Pck r = 75. Hence, he mnmum movng velocy v and maxmum wang me w should sasfy d pv + ( p) w < r and d pv + ( p) w p < r, here he probables can be esmaed: p > πr2 >.99 and p = Then, we oban hav > 5 and w <.33. On he oher hand, he maxmum movng me s m = d v <.29 and we assume he wang me larger han.29. The ordnary dfferen equaons (3) are solved by he Runge-Kua fourh-order formula wh a sep lengh of.. Fg.3 ndcaes ha he pnnng conrol of (3) s sable. 6. Concluson In hs paper, we nvesgae he pnnng conrol problem of coupled dynamcal sysems wh Markovan swchng couplngs and Markovan swchng conroller-se. We derve analycal condons for he sably a he homogeneous rajecory of he uncoupled sysem. Frs, f each subsysem n he swchng sysem wh fxed pnnng nodes can be sablzed and he Markovan swchng s suffcenly slow, he sysem van be sablzed. Second, he swchng sysem can be sablzed f he sysem wh average couplng marx and pnnng gans can be sablzed and he Markovan swchng s suffcenly fas. As an applcaon, we also sudy he spaal pnnng conrol problem of nework wh moble agens. The effecveness of he p

9 proposed heorecal resuls are demonsraed by wo numercal examples. References [] D. J. Was, S. H. Srogaz, Collecve Dynamcs of Small World Neworks, Naure, 393(998): [2] A. L. Barabas, R. Alber, Emergence of Scalng n Random Neworks, Scence, 286(999): [3] X. F. Wang, G. Chen, Pnnng conrol of scale-free dynamcal nework, Physcal A, 3(22), [4] X. L, X. F. Wang, G. Chen, Pnnng a complex dynamcal nework o s equlbrum, IEEE Transacons on Crcus and Sysems-I: regular paper, 5()(24), [5] T. P. Chen, X. W. Lu, W. L. Lu, Pnnng complex neworks by a sngle conroller. IEEE Transacons on Crcus and Sysems-I: regular papers, 54(6)(27): [6] M. Porfr, M. d Bernardo, Crera for global pnnng-conrollably of complex nework, Auomaca, 44(28), [7] W. W. Yu, G. Chen, J. H. Lü, On pnnng synchronzaon of complex dynamcal neworks, Auomaca, 45(29), [8] W. L. Lu, X. L, Z. H. Rong, Global synchronzaon of complex neworks wh dgraph opologes va a local pnnng algorhm, Auomaca 46(2), 6-2. [9] W. L. Lu, B. Lu, T. P. Chen, Cluser synchronzaon n neworks of coupled nondencal dynamcal sysems, Chaos, 2(2), 32. [] W. Ren, Mul-vehcle consensus wh a me-varyng reference sae, Sysems Conrol Le. 56 (27) [] Q. Song, J. D. Cao and W. W. Yu, Second-order leader-followng consensus of nonlnear mul-agen sysems va pnnng conrol, Sysems Conrol Le. 59 (2) [2] H. Y. Lu, G. M. Xe, L. Wang, Conanmen of lnear mul-agen sysems under general neracon opologes, Sysems Conrol Leers, 6 (22) [3] G. H. Wen, W. W. Yu, Y. Zhao, J. D. Cao, Pnnng synchronzaon n fxed and swchng dreced neworks of Lorenz-ype nodes, IET Conrol Theory and Applcaons, 23. [4] L. Arnold, Sochasc dfferenal equaons: Theory and applcaons, John wley sons, 972. [5] A. Fredman, Sochasc dfferenal equaons and her applcaons, vol. 2, Academc press, 976. [6] R. Z. Has mnsk, Sochasc sably of dfferenal equaons, Sjhoff and Noorrdhoff, 98. [7] V. B. Kolmanovsk, A. Myshks, Appled heory of funconal dfferenal equaons, Kluwer Academc Publshers, 992. [8] Y. J, H. J. Chzeck, Conrollably, sablzably and connuous-me Markovan jump lnear quadrac conrol, IEEE Trans. Auoma. Conrol 35(99), [9] G. K. Basak, A. Bs, M. K. Ghosh, Sably of a random dffuson wh lnear drf, J. Mah. Anal. Appl. 22(996), [2] X.R. Mao and C.G. Yuan, Sochasc dfferenal equaons wh Markovan swchng, Imperal College Press, 26. [2] C. G. Yuan, X. R. Mao, Robus sably and conrollably of sochasc dfferenal delay equaons wh Markovan swchng, Auomaca 4(24), [22] X. F. Wang, X. L, J. Lü, Conrol and flockng of neworked sysems va pnnng, IEEE Crcus and Sysems, (2), [23] H. Su, X.F. Wang, G. Chen, Flockng of mul-agens wh a vrual leader, IEEE Transacons on Auomac Conrol, 54 (29), [24] W. W. Yu, G. Chen, M. Cao, Dsrbued leader-follower flockng conrol for mul-agen dynamcal sysems wh me-varyng veloces, Sysems Conrol Leers, 59 (2) [25] M. Frasca, A. Buscarno, A. Rzzo, and L. Foruna, Spaal Pnnng Conrol, Physcal Revew Leers, 22. [26] G. L. Jones, On he Markov chan cenral lm heorem, Probably surveys, (24), [27] F. Zou, J.A. Nosse, Bfurcaon, and chaos n cellular neural neworks, IEEE Trans. CAS- 4 (3) (993) 66C73. [28] C. Beseer, H. Harensen, and X. Perez-Cosa, Sochasc properes of he random waypon mobly model, ACM/Kluwer Wreless Neworks, o appear [29] P. Bremaud, Markov Chans, Gbbs Felds, Mone Carlo Smulaon, and Queues, 999. [3] P. Bllngsley, Probably and Measure, Wley, New York, 986. [3] N. wan de Wouw, and A. Pavlov, Trackng and synchronzaon for a class of PWA sysems, Auomaca, 44()(28): [32] H. Kushner, Inroducon o Sochasc Conrol, Hol, Rnehar and Wnson, Inc., New York, NY, 97. [33] D. B. Johnson, D. A. Malz. Dynamc source roung n ad hoc wreless neworks. In Moble compung, eded by T. Imelnsk and H. Korh, chaper 5, pp. 53-8,Kluwer Academc Publshers, 996. [34] R. A. Horn and C. R. Johnson. Marx analyss, Cambrdge Unversy Press, 985. [35] A. Berman, R. J. Plemmons, Nonnegave marces n he mahemacal scences, SIAM, Phladelpha, PA, 994.