arxiv: v1 [cs.sy] 31 May 2014

Transcription

1 Cooperative Contro of Linear Muti-Agent Systems via Distributed Output Reguation and Transient Synchronization Georg S. Seyboth, Wei Ren, Fran Agöwer arxiv:46.85v cs.sy 3 May 24 Abstract A wide range of muti-agent coordination probems incuding reference tracing and disturbance rejection requirements can be formuated as a cooperative output reguation probem. The genera framewor captures typica probems such as output synchronization, eader-foower synchronization, and many more. In the present paper, we propose a nove distributed reguator for groups of identica and non-identica inear agents. We consider goba externa signas affecting a agents and oca externa signas affecting ony individua agents in the group. Both signa types may contain references and disturbances. Our main contribution is a nove couping among the agents based on their transient state components or estimates thereof in the output feedbac case. This couping achieves transient synchronization in order to improve the cooperative behavior of the group in transient phases and guarantee a desired decay rate of the synchronization error. This eads to a cooperative reaction of the group on oca disturbances acting on individua agents. The effectiveness of the proposed distributed reguator is iustrated by a vehice patooning exampe and a coordination exampe for a group of four non-identica 3-DoF heicopter modes. Index Terms Cooperative Contro; Distributed contro; Mutiagent systems; Reguator theory; Linear output feedbac; Synchronization. I. INTRODUCTION In a variety of modern man-made systems, it is desirabe to synthesize a cooperative behavior among individua dynamica agents, simiary to bird focs and fish schoos observed in nature. Exampes incude muti-vehice coordination and formation fight probems, robot cooperation in production ines, power baancing in micro-grids, and many more. Of particuar interest are distributed contro aws which require ony oca information exchange between neighboring subsystems and no centraized data coection or processing entity. The main advantages of distributed contro agorithms are scaabiity for arge networs of dynamica systems, fexibiity with respect to addition and remova of subsystems, and robustness with respect to faiure of individua subsystems. The foowing overview of seected pubications on distributed contro methods for muti-agent systems serves as introduction and motivation for the methods deveoped in the present paper. A. Reated Wor A fundamenta cooperative contro probem is the consensus or synchronization probem for groups of inear dynamica Corresponding author. G.S.S and F.A. are with the Institute for Systems Theory and Automatic Contro, University of Stuttgart, Pfaffenwadring 9, 755 Stuttgart, Germany. ({georg.seyboth, agower}@ist.uni-stuttgart.de). W.R. is with the Department of Eectrica Engineering, University of Caifornia Riverside, Riverside, CA 9252, USA. (ren@ee.ucr.edu). The authors G.S.S. and F.A. woud ie to than the German Research Foundation (DFG) for financia support of the project within the Custer of Exceence in Simuation Technoogy (EXC 3/) at the University of Stuttgart and within the Priority Programme 35 Contro Theory of Digitay Networed Dynamica Systems. agents. The consensus probem has been studied extensivey over the past decade, starting from singe-integrator agents, 2, to doube-integrator agents 3, to identica genera inear agents 4 8, and to non-identica genera inear agents 9 2. A these studies focus on consensus and synchronization of the states or outputs of the autonomous agents in the group. Under the distributed contro aw, the cosed-oop system as a whoe is an autonomous system, i.e., it has no externa inputs signas. From a practica point of view, it is desirabe to infuence the behavior of the group via externa reference signas. A soution to this probem is the eader-foower setup 7, 3 5. The idea is to seect a particuar agent as eader for the group or introduce a virtua eader and design the distributed contro aw such that a agents synchronize to this eader. The motion of the group is then controed through the motion of the active eader. Moreover, it is important to consider externa disturbances acting on the muti-agent system, to anayze the performance of the cosed-oop system, and to incorporate disturbance rejection or attenuation requirements in the design procedure. Rejection of constant disturbances is addressed in 6 8. Disturbance attenuation and H performance criteria are addressed in 9 2. Reference tracing and disturbance rejection probems can be formuated in the genera framewor of output reguation which was deveoped in the 97s, 22, 23. The basic setup consists of a so-caed exosystem, an autonomous system that generates a externa signas (references as we as disturbances) acting on the pant, and a description of the pant. The signa generated by the exosystem is referred to as the generaized disturbance. The tracing and reguation requirements are formuated in terms of a reguation error depending on the pant state and the externa signas. The objective is to find a contro aw, aso caed reguator, which ensures interna stabiity of the pant and asymptotic convergence to zero of the reguation error for a initia conditions. For the detais on the output reguation theory, the reader is referred to the boos 24, 25, and 26. It has been proposed in 27, 28 to formuate muti-agent coordination probems with externa reference and disturbance signas as a synchronized output reguation probem. Since then, a cooperative output reguation theory for a arge cass of practicay reevant cooperative contro probems is under deveopment. The probem setup in 27, 28 consists of an autonomous exosystem and a group of identica inear agents, which are affected by the signa generated by the exosystem, and a tracing error for each agent which sha converge to zero. The probem becomes a cooperative contro probem since, by assumption, not a agents have access to the externa

2 signa. In particuar, the group is divided into a group of informed agents which are abe to reconstruct the externa signa, and uninformed agents which are dependent on information exchange with informed agents in order to sove their reguation tas. The proposed distributed reguator consists of oca feedbac aws designed according to the cassica output reguation theory and a distributed estimator for the externa signa. It has been shown in 29 that the cooperative output reguation probem generaizes existing soutions for the eader-foower probem. In 3, agents with non-identica and uncertain dynamics are considered. The main imitation of the proposed soution is that the underying communication graph is assumed to have no oops. This assumption is reaxed in 3. Instead, the foower agents are assumed to have identica nomina dynamics. The papers 32 and 33 extend the resuts of 27, 28 and present a soution to the cooperative output reguation probem with non-identica agents based on state feedbac and output feedbac, respectivey. Each agent is described by a generaized pant in which a matrices may be different for different agents. Cooperation among the agents is again required since the uninformed agents are not abe to reconstruct the externa signa ocay. The soution proposed in 33 consists of three components: oca feedbac aws which are constructed based on the cassica output reguation theory for each agent; oca observers for the state of each agent; and a distributed observer for the generaized disturbance. Further deveopments in this area focus on robust cooperative output reguation for uncertain agent dynamics 34, 35, 36. A studies mentioned above consider a singe autonomous exosystem generating a reference and disturbance signas acting on the group. In 37, each agent has an additiona oca exosystem that generates oca reference signas. However, ony reference signas and no disturbance signas are considered. Mutipe exosystems are aso considered in 38. B. Contribution In the cooperative output reguation framewor, the group objective for the muti-agent system is formuated in terms of a common reference signa for a agents and oca reguation errors for each agent with respect to the common reference. Cooperation among the agents is ony required in order to reconstruct the reference signa at a agents. The reconstruction is achieved through cooperative estimation. Besides that the setup is in fact decentraized in the sense that there are no coupings based on the agent states or outputs. Cooperation is achieved since a agents asymptoticay trac a common reference and disturbance rejection is achieved ocay at each agent. This approach may not ead to a satisfactory behavior of the group in transient phases. In particuar, a state or output synchronization objective is not taen into account expicity. In the present paper, we propose a nove distributed reguator which soves the cooperative output reguation probem and additionay guarantees exponentia stabiity of a suitaby defined synchronization error of the group. This aows to improve the cooperative behavior of the group in transient phases significanty and offers more fexibiity in the contro design. Our contributions are the foowing. First, we introduce one goba exosystem generating signas affecting a agents and a oca exosystem for each agent generating oca references and disturbances. This exosystem structure eads to distributed estimators of ower dimension compared to previous wors, where ony one singe exosystem (of possiby high dimension) is considered which generates a externa signas acting on the group. Second, we formuate the overa cooperative contro probem as a singe centraized overa output reguation probem. The sovabiity conditions for the overa output reguation probem and its particuar structure aow us to derive necessary and sufficient sovabiity conditions for the distributed reguation probem. Third, we present a distributed reguator based on output feedbac which soves the cooperative output reguation probem. Our main contribution is to introduce a nove couping in the distributed reguator based on the transient state components of the agents. We present a design method for these coupings which aows to impose performance specifications such as a minimum decay rate of the synchronization error of the group. The nove distributed reguator ensures a cooperative reaction of the group on externa disturbances. Moreover, a detaied numerica exampe of four 3-DoF heicopters with non-identica mode parameters is presented in order to iustrate the design procedure for groups of nonidentica agents and demonstrate the performance of the nove distributed reguator with transient synchronization. As an auxiiary resut, we present a design method based on LMIs for the couping gain in networs of identica inear agents such that the poes corresponding to the synchronization error are paced within a specified region. This procedure is the ey to incorporate performance specifications such as a minimum decay rate in the cooperative contro design. C. Outine Section II contains mathematica preiminaries. Section III presents the probem setup and some auxiiary resuts. The distributed reguator for genera non-identica inear agents is presented in Section IV. In Section V, an extension of the distributed reguator is derived which guarantees exponentia stabiity of the synchronization error with a desired decay rate. The derivation is based on the assumption that the agents have identica dynamics. A vehice patooning exampe iustrates the resuts. In Section VI, the assumption of identica agent dynamics is reaxed. It is shown how the couping can be designed in case of non-identica agents based on robust contro methods and the procedure is demonstrated in an exampe with four non-identica 3-DoF heicopters. Section VII concudes the paper. II. PRELIMINARIES The sets of rea and compex numbers are denoted by R and C, respectivey. The open eft haf pane, imaginary axis, and open right haf pane of C are denoted by C, C, and C +, respectivey. For z C, z is the compex conjugate, Re(z) is the rea part and Im(z) is the imaginary part. The spectrum of a matrix A C n n is denoted by σ(a) C and A is caed stabe

3 if σ(a) C, i.e., a its eigenvaues have negative rea part. If A is rea and σ(a) C, it is aso caed Hurwitz. diag(m ) and stac(m ) denote a boc diagona matrix and a vertica stac of matrices with bocs M, =,...,N, respectivey. For a set of vectors v R n, =,...,N, v R Nn denotes the stac vector v = v T vt N T. For a vector v R n, diag(v) is a diagona matrix with the entries of v on the diagona. The identity matrix of dimension N is I N and the vector of ones is. For a transfer function matrix G, G denotes its H norm. The symbo denotes the Kronecer product. A. Agent Modes III. PROBLEM SETUP The dynamics of the non-identica agents are described by inear state-space modes. The index set of the agents is defined as N = {,...,N}, where N is the number of agents in the group. The dynamics of the undisturbed agents are described by ẋ = A x + B u () where x (t) R nx is the state and u (t) R nu is the contro input of agent N. The coordination probem is formuated in terms of the generaized pant where y (t) R ny ẋ = A x + B u + B dg dg + B d d y = C x + D u + D dg dg + D d d (2a) (2b) e = C e x + D e u + D edg d g + D ed d (2c) is the measurement output of agent and d g (t) R ndg, d (t) Rnd are externa signas specified next. The reguation error e (t) R ne is defined such that asymptotic tracing and disturbance rejection is equivaent to e (t) as t for a initia conditions. B. Externa Signas We consider two types of externa input signas which affect the group: a goba signa that affects a agents and oca signas that affect individua agents in the group. Each of these signas represents a generaized disturbance which may consist of reference signas and disturbances. Whie the probem formuation captures this genera case, we may thin of the goba signa as a pure reference signa and incude a disturbances into the oca signas. We assume that a signas beong to a nown famiy of signas. The goba signa d g (t) R ndg is a soution of the autonomous inear system d g = S g d g, (3) where σ(s g ) C C +. The oca signa d (t) Rnd acting on agent is a soution of the autonomous inear system where σ(s ) C C + for a N. d = S d, (4) C. Information Structure A agents have communication capabiities. The communication topoogy is described by a directed graph G = (N, E), with node set N = {,...,N} corresponding to the agent index set and edge set E N N. A directed edge ( j,) E corresponds to possibe information fow from agent j N to agent N. We thin of these edges as communication channes. Hence, each agent can transmit oca measurements or controer states. There is no forwarding, in the sense that each agent exchanges information ony with its direct neighbors and not with its two-hop or muti-hop neighbors. The neighbor set of agent is the subset N N from which can receive information, i.e., N = { j N : ( j,) E}. We ca a directed graph G connected if it contains a directed spanning tree (which is sometimes caed quasi strongy connected in the iterature), and strongy connected if there is a directed path from every node to every other node, i.e., every node is the root of a spanning tree. The adjacency matrix A G of G is defined eement-wise by a j = ( j,) E and a j = otherwise. In case G is connected, its Lapacian matrix L G = diag(a G ) A G has exacty one zero eigenvaue λ (L G ) = and a other eigenvaues λ (L G ), N\{}, have positive rea parts Re(λ (L G )) >, cf., 2. In the foowing, the eigenvaues of L G are shorty denoted by λ, N, and the numbering is aways chosen such that λ =. For further detais on graph theory, see 2, 8, 9 and the references therein. D. The Distributed Output Reguation Probem The group objective under consideration consists of two parts: asymptotic tracing of reference signas and asymptotic disturbance rejection. Typicay, we are interested in synchronization probems which can be formuated as tracing probem of a common, goba reference signa. Moreover, our focus wi be on the cooperative behavior of the group in transient phases. The cooperative contro probem is formay stated as foows. Probem. For each N, find a distributed reguator ( ) ż = A c z + B c y + j N A c j z j + B c j y j (5a) u = C c z + D c y + j N ( ) C c j z j + D c j y j (5b) such that the foowing two conditions are satisfied: P) If d g () = and d () =, N, then, for a initia conditions x () = x, and z () = z,, im x (t) = and im z (t) =. t t P2) For a initia conditions d g () = d g, d () = d,, x () = x x, and z () = z,, N, im e (t) =. t Probem for the generaized pants (2) is a very genera probem formuation that captures many particuar practicay reevant probems such as reference tracing and disturbance

4 rejection, cf., 24, 26. Due to the distributed structure of the controer (5), this probem formuation captures distributed cooperative contro probems. E. The Overa Output Reguation Probem Probem is a distributed output reguation probem due to the structure imposed on the reguator (5). In case of a compete graph, i.e., a-to-a communication, (5) becomes a centraized dynamic output feedbac controer of the form ż = A c z + B c y u = C c z + D c y, (6a) (6b) where z, y, u are the stac vectors of z, y, u, N, respectivey. Let x, e be the stac vectors of x, e, N, and d = d gt d T d N T T. Then, the overa cooperative contro probem can be formuated as a singe cassica output reguation probem by combining a agents (2) into one arge generaized pant and one arge exosystem as foows: and ẋ = Ax + Bu + B d d y = Cx + Du + D d d e = C e x + D e u + D ed d (7a) (7b) (7c) d = Sd, (8) with the matrices given by A = diag(a ), B = diag(b ), B d = stac(b dg ) diag(bd ), C = diag(c ), D = diag(d ), D d = stac(d dg ) diag(dd ), C e = diag(c e), D e = diag(d e ), D ed = stac(d edg ) diag(d ed ) and S g S = diag(s ). The distributed output reguation probem can ony be soved if the overa output reguation probem has a centraized soution of the form (6). Hence, we study the necessary conditions for the sovabiity of the overa output reguation probem and expoit the structure in order to derive necessary conditions for the oca output reguation probems. Theorem (26, Theorem.4). Let the pair (A, B) be stabiizabe and the pair ( A Bd, ) C D S d (9) be detectabe and suppose that σ(s) C C +. Then, Probem has a centraized soution (6), if and ony if the reguator equation A B Π Γ C e D e is sovabe with a soution Π, Γ. Π Bd S + = () D ed In case a conditions in Theorem are fufied, a centraized reguator can be constructed as foows. Choose F and L such that A BF and A Bd L C D S d are stabe. Define G = Γ + FΠ where Π, Γ sove (). Then, the controer is given by A Bd B d ˆx ˆ = S d ˆxˆ + u + L(y ŷ) u = F G ˆx, dˆ where ŷ = C ˆx + D d d ˆ+ Du. The contro aw u = Fx + Gd is referred to as the fu information contro aw. Since x and d are not directy accessibe, the observer is constructed to obtain estimates ˆx and d. ˆ This controer is of the form (6) with z = ˆx T dˆ T T. Lemma. The reguator equation () for the overa output reguation probem is sovabe, if and ony if the oca reguator equations and A B C e D e Π g Γ g Π g S g B d g + = () D edg A B Π Π C e D e Γ S + B d = (2) D ed are sovabe with a soution Π g, Γg, Π, and Γ for a N. Proof: We prove the statement by showing that every soution Π, Γ of () yieds a soution Π g, Γg, Π, Γ, N of (), (2), and vice versa. Consider () and partition Π, Γ according to Π g Π Π N Π =... Π g N Π N Π NN Γ g Γ Γ N Γ = Γ g N Γ N Γ NN, (3). (4) The first equation AΠ + BΓ ΠS + B d = of () yieds A Π g A Π A Π N =... A N Π g N A N Π N A N Π NN B Γ g B Γ B Γ N +... B N Γ g N B N Γ N B N Γ NN Π g Sg Π S Π N S N... Π g N Sg Π N S Π NN S N +. B dg B d... B dg B d N (5) Eq. (5) can be decomposed into the set of equations A Π g + B Γ g Πg Sg + B dg = (6)

5 and and for j, A Π + B Γ Π S + Bd = (7) A Π j + B Γ j Π j S j =. (8) The second equation C e Π + D e Γ + D ed = of () yieds C e Πg C eπ C e Π N = CN e Πg N CN e Π N CN e Π NN D e Γg D e Γ D e Γ N +... D e N Γg N D e N Γ N D e N Γ NN + D edg D ed.... D edg N D ed N (9) Eq. (9) can be decomposed into the set of equations and and for j, C e Πg + De Γg + Dedg = (2) C e Π + De Γ + Ded = (2) C e Π j + De Γ j =. (22) ( Ony if :) Suppose that (3), (4) sove (). Then, according to (6), (2) and (7), (2), the reguator equations () and (2) are soved by Π g, Γg and Π = Π, Γ = Γ. ( If :) Suppose that Π g, Γg and Π, Γ sove () and (2). It is easy to see that (8) and (22) can be satisfied by the choice Π j = and Γ j = for, j N with j. Consequenty, (3), (4) with Π j = and Γ j = for, j N, j, sove (). F. List of Assumptions Assumption. The pair (A,B ) is stabiizabe for a N. Assumption 2. The pair ( A B d S is detectabe for a N., C ) D d Assumption 3. Agent has direct access to the signa d g. Assumption 4. The reguator equations and A Π g + B Γ g Πg Sg + B dg = (23a) C e Πg + De Γg + Dedg = (23b) A Π + B Γ Π S + Bd = (24a) C e Π + De Γ + Ded = (24b) have a soution Π g, Γg, Π, Γ for a N. Assumption 5. The communication topoogy is described by a directed connected graph G and node is the root of a spanning tree. In the foowing, we discuss each assumption separatey in order to point out the importance. Assumption is equivaent to stabiizabiity of the pair (A,B) due to the structure of (7). Moreover, it is required for P) since the pant () may be unstabe. Assumption 2 is necessariy satisfied if the pair (9) is detectabe due to the structure of (7), (8). The assumption that (9) is detectabe causes no oss of generaity, as discussed in 24. Note that detectabiity of (9) does not impy detectabiity of a pairs A B dg B d S g S, C D dg D d. (25) The pair (9) is detectabe if (25) is detectabe for at east one agent N. This agent must be the root of a spanning tree in order to sove the distributed reguation probem. The agents have to cooperate in order to obtain an estimate of d g. Assumption 3 aong with Assumption 2 guarantees detectabiity of (9). Foowing 33, we ca agent the informed agent. Note that Assumption 3 can easiy be reaxed to detectabiity of the pair (25) for agent =. We wor with the stricter assumption for ease of presentation. Assumption 4 is necessariy satisfied if there exists a centraized reguator soving Probem. It is we nown that the sovabiity of the reguator equation () is a necessary and sufficient condition for the sovabiity of the output reguation probem, as stated in Theorem. Due to the structure of the overa generaized pant (7) and exosystem (8), the existence of a soution to () is equivaent to the existence of soutions to the oca reguator equations (23), (24), as shown in Lemma. Hence, there is no oss of generaity in this assumption. Assumption 5 is required for the construction of a distributed reguator, cf., 33. G. Synchronization with Poe Pacement Constraints Before we present our soution to Probem in the foowing Section IV, we briefy discuss the state synchronization probem for a group of identica inear agents via static diffusive coupings since we wi encounter two such state synchronization probems in the remainder of this paper. We are interested in a guaranteed performance of such networs in terms of a desired decay rate of the synchronization error. For this purpose, we propose a nove design procedure for suitabe couping gains by poe pacement constraints. Lemma 2 (8). Consider a group of N identica inear agents ẋ = Ax + Bu, where x R n x, A is not Hurwitz, and (A,B) is stabiizabe. There exists a couping gain matrix K such that the interconnected cosed-oop system with static diffusive coupings u = K N j= a j(x j x ), where a j are the entries of A G, satisfies x (t) x j (t) as t for a, j N and a initia conditions, if and ony if the directed graph G describing the communication topoogy is connected.

6 Design procedures for a suitabe couping gain K can be found in 8, 7. These procedures aways ead to a suitabe K if a assumptions of Lemma 2 are satisfied. Here, we present a nove design procedure based on LMIs which taes into account performance specifications in terms of poe pacement constraints. For this purpose, we mae use of the LMI region introduced in 39, which is defined as γ Im Re θ Im γ r Re R = {z C : L + zm + zm T < }, for some fixed rea matrices L = L T and M. The region R is a convex subset of C. Theorem 2. Suppose that a assumptions of Lemma 2 are satisfied and et R C be an LMI region defined by L = L T and M. If there exist rea matrices Y > and Z such that for a N\{}, the LMIs L Y + M (AY λ BZ) + M T (AY λ BZ) T < (26) are satisfied, then the couping gain K = ZY ensures state synchronization. Moreover, the poes of a modes corresponding to the synchronization error x (defined in the proof) are contained in R. Proof: The cosed-oop system consisting of ẋ = Ax + Bu and u = K N j= a j(x j x ) is given by ẋ = (I N A L G BK)x, We appy the state transformation x = (T I n x)x as introduced by 4, where the matrix T is chosen such that i) Λ = T L G T is upper-trianguar, ii) the first coumn of T is the vector of ones, iii) the first row of T is p T, with p T L G = T and p T =. Note that is the right eigenvector and p T is the normaized eft eigenvector of L G corresponding to the zero eigenvaue. This state transformation yieds x = (I N A Λ BK) x. The matrix (I N A Λ BK) is upper boc trianguar with bocs A λ BK on the diagona and λ =. Let x be partitioned into x and x. Then, it foows that A λ 2 BK x = A x, x =... A λ N BK x. Let T be partitioned as T = T. Then, it is easy to see that x = (T I n x) x = ( I n x) x + (T I n x) x. Since is ineary independent of the coumns of T, state synchronization, i.e., x (t) x j (t) as t for a, j N, is equivaent to x (t) as t. Consequenty, the state component x can be seen as the synchronization error of the networ. Due to the boc-trianguar structure of the system matrix, the probem under consideration reduces to a simutaneous stabiization probem for the N systems on the diagona x = (A λ BK) x for = 2,...,N via K and with the poe pacement constraint expressed by the LMI region R. Note that the eigenvaues λ Fig.. (a) Haf pane. Two exempary LMI regions. (b) Region S(γ,r,θ). of L G are in genera compex since G is directed. If there exists a rea symmetric matrix Y > such that L Y + M (A λ BK)Y + M T Y (A λ BK) T <, (27) then a poes of A λ BK are contained in R 39. The change of variabe Z = KY eads to the LMIs (26), which proves the statement. Remar. For rea eigenvaues λ, the existence of a rea matrix Y > such that (27) is satisfied, is necessary and sufficient for a poes of A λ BK to be contained in R 39. The requirement that Y be rea instead of compex Hermitian 4 may cause conservatism in the design procedure in Theorem 2. Moreover, conservatism is caused by the fact that we search for a common Lyapunov function, i.e., a common Y, for a N\{}. Theorem 2 aows to incude performance specifications such as a desired decay rate or damping ratio for the synchronization error into the design of the couping gain. A variety of convex sets such as vertica strips, horizonta strips, diss, conic sectors as we as intersections thereof can be expressed as LMI region, cf., 39. Two practica exampes are iustrated in Fig.. The haf pane in Fig. (a) is expressed by the scaars L = 2γ and M =. For this specia case, the synthesis LMIs in Theorem 2 reduce to those in 8, Theorem 4.. The region S(γ,r,θ) is expressed by L = diag(l,l 2,L 3 ) and M = diag(m,m 2,M 3 ) which describes an intersection of the foowing three regions: Haf pane: L = 2γ, M =. r Disc: L 2 =, M r 2 =. sinθ cosθ Conica sector: L 3 =, M 3 =. cosθ sinθ Poe pacement in the region S(γ,r,θ) guarantees a minimum decay rate γ, minimum damping ratio ζ = cos(θ), and a maximum undamped frequency ω d = r sinθ. IV. THE DISTRIBUTED REGULATOR Theorem 3. Consider a group of agents (2) with exosystems (3), (4). Suppose that Assumptions 5 are satisfied. Then, a distributed reguator that soves Probem can be constructed as foows: For a N, choose F such that A B F is Hurwitz.

7 For a N, find a soution for (23) and (24) and set G g = Γg + F Π g G = Γ + F Π Set ˆ d g = dg, and for a N\{}, (28a) (28b) d ˆ g = Sg dˆ g + K ( dˆ g j dˆ g ), (29) j N where K is chosen such that S g λ K is stabe for the non-zero eigenvaues λ, = 2,...,N, of the Lapacian L G. For a N, choose L such that A B d S L C is Hurwitz and construct the observers ˆx A B d ˆ = d ˆx B B S d ˆ + dg D d u ˆ d g (3) + L (y ŷ ) where ŷ = C ˆx + D dg ˆ d g + ˆ Dd d + D u. Finay, the contro aw for each agent N is given by (3) u = F ˆx + G g ˆ d g + G ˆ d. (32) Proof: Define the observer errors ε x = x ˆx, ε d The observer errors ε x ε x ẋ ˆx = ε d d d ˆ A B = d = = x S A B d S A B d S L C ( A B d S + ( B d g d = d ˆ d, and εd ˆx d ˆ ε x ε d D dg The observer error ε dg ε dg satisfy B B + dg + D d L L D dg = d g ˆ d g = S g ε dg = S g ε dg εdg u d g B B dg B d g ε dg C ) ε dg. x d g d D d = d g ˆ d g. (33) u ˆ d g ˆx d ˆ ˆ g d ) ε x ε d L (y ŷ ) satisfies ε dg = and for N\{}, K ( dˆ g j dˆ g ) j N + K (ε dg j j N ε dg ). By Assumption 5, G contains a spanning tree rooted at. Hence, a suitabe gain matrix K in (29) exists by Lemma 2. A design procedure is given in Theorem 2. Consequenty, for a N, ε dg(t) = dg (t) dˆ g (t) as t. Hence, it foows that for a N, ε x (t) and εd (t) as t since (3) is Hurwitz by construction. Next, we define the error variabe ε = x Π g dg Π d. (34) Note that ε is the transient state component of agent. In particuar, it is the state component in the compement of the subspace V + = {(x,d g,d ) : x = Π g dg + Π d }. As discussed in 24, the equations (23a), (24a) express the fact that the subspace V + is a controed invariant subspace of the system ẋ d g = A B dg B d x S g d g + B u d S d and V + is rendered invariant by u = Γ g dg + Γ d. Moreover, this subspace is annihiated by the reguation error map (2c) due to (23b), (24b). As we wi show next, V + is rendered asymptoticay stabe by the proposed distributed reguator, and e (t) indeed converges to zero for a initia conditions. Using (34), (2a), (3), (4), (32), (33), (23a), (24a), and (28), we can compute ε = ẋ Π g d g Π d = A x + B u + B dg dg + B d d Πg Sg d g Π S d = A x + B ( F ˆx + G g ˆ d g + G ˆ ) d + B dg dg + B d d Πg Sg d g Π S d = A x B F ˆx + B G g ˆ d g + B G ˆ + B dg dg + B d d Πg Sg d g Π S d = A x B F (x ε x ) d + B G g (dg ε dg ) + B G (d εd ) + B dg dg + B d d Πg Sg d g Π S d = (A B F )(ε + Π g dg + Π d ) + B F ε x + B G g dg B G g εdg + B G d B G εd + B dg dg + B d d Πg Sg d g Π S d = (A B F )(ε + Π g dg + Π d ) + B F ε x + B (Γ g + F Π g )dg B G g εdg + B (Γ + F Π )d B G εd + B dg dg + B d d Πg Sg d g Π S d = (A B F )ε + B F ε x B G g εdg B G εd (35) Since the observer errors ε x, εdg, εd vanish asymptoticay and A B F is Hurwitz by construction, we can concude that ε (t) as t for a N. If d g () = and d () = for a N, then x (t) = ε (t) as t, and since the observer errors vanish asymptoticay, aso ˆx (t), dˆ g (t), and ˆ (t) as t. Consequenty, P) is fufied. d

8 It remains to show that the reguation errors e converge to zero for a initia conditions. Using (2c), (32), (33), (23b), (24b), and (28), we can compute 5 r 5 4 r 4 3 r 3 2 r 2 r d g e = C e x + D e u + D edg d g + D ed d = C e (ε + Π g dg + Π d ) + De u + D edg = C e ε + (C e Πg + Dedg d g + D ed d )d g + (C e Π + Ded )d + De u Fig. 2. w 5 w 4 w 3 w 2 w Communication graph and externa signas of the patoon. = C e ε + (C e Πg + Dedg )d g + (C e Π + Ded )d + D e ( F x + G g dg + G d ) D e ( F ε x + Gg εdg + G εd ) = C e ε + (C e Πg + Dedg )d g + (C e Π + Ded )d + D e ( F (ε + Π g dg + Π d ) + Gg dg + G d ) D e ( F ε x + Gg εdg + G εd ) = (C e De F )ε + (C e Πg + De Γg + Dedg )d g + (C e Π + De Γ + Ded )d D e ( F ε x + Gg εdg + G εd ) = (C e De F )ε D e ( F ε x + Gg εdg + G εd ). (36) Both the state component ε and the observer errors ε x, εdg, ε d vanish asymptoticay. Hence, e (t) as t for a N, i.e., P2) is fufied and Probem is soved. Remar 2. Probem can be soved by the distributed reguator proposed in 33, when (8) is regarded as a singe arge exosystem. However, according to the formuation in 33, each agent reconstructs the fu vector d of a reference and disturbance signas acting on the group via a distributed estimation protoco, which eads to dynamic controers of high order and is unnecessary. Our distributed reguator taes the structure of (8) into account: each agent estimates ony the goba generaized disturbance as we as the oca generaized disturbance acting on itsef. The distributed reguator constructed in Theorem 3 soves Probem. The foowing exampe shows that this resut aows to sove a patooning probem and iustrates the distributed reguator. Moreover, this exampes points out a imitation of the contro scheme and motivates the extension of the distributed reguator, which wi be presented in the next section. Exampe. Consider a group of N = 5 vehices in a patoon, each modeed as a doube-integrator system of the form ẋ = x + u + w, }{{}}{{}}{{} A B B w for a N. Moreover, there is a virtua eader generating a reference signa for the group, given by d g = S g d g with S g = A. The state x R 2 consists of the vehice position s and veocity v, i.e., x = s v T. The input w is a oca disturbance acting on vehice, e.g., due to a mass change, gear shift, or other externa infuence. We assume a sinusoida disturbance w 2 for agent 2 and constant disturbances for a other agents. The tas is to find a contro aw u for each vehice such that the foowing requirements are met for a initia conditions: ) The veocities v of a vehices converge to the veocity commanded by the virtua eader: N : im v (t) d g (t) =. t 2) The reative distance of each vehice with respect to the virtua eader converges to a desired constant vaue r : N : im t s (t) d g (t) = r. The externa oca disturbance w and oca reference r are combined into the oca generaized disturbance signas d. For agent 2, we have d 2 = d2, }{{} S2 r2 w 2 = d 2. For a other agents, we have d = r w T and d = d. }{{} S This eads to B d 2 = B w and B d = B w for a other agents. We assume that each vehice can communicate with its foower and predecessor in the patoon as iustrated by the graph in Fig. 2. The patooning probem can be formuated as a distributed output reguation probem with reguation errors defined as e = x + d g + d. }{{}}{{}}{{} C e D edg D ed Note that for = 2, D ed has a third coumn of zeros. We assume that ony agent has access to the goba reference signa d g and a agents have access to their oca reference signa r and to their state x. Loca disturbance estimators as in (3) are used in order to reconstruct w. Simuation resuts for two different choices of the contro gain F and with oca exogenous input signas according to Fig. 3 are shown in Fig. 4. The distributed reguation probem is soved in both cases, i.e., the reference signas are traced and the disturbance signas are rejected asymptoticay. This exampes iustrates an inherent imitation of the contro scheme: The group does not react cooperativey on oca

9 r(t) w(t) (a) Loca reference signas (b) Loca disturbances. Fig. 3. Loca exogenous input signas for Exampe. s(t) s(t) (a) A first choice of the contro gains F (b) A more aggressive choice of the contro gains F. Fig. 4. Simuation resuts for Exampe. disturbances acting on individua agents. The steps in the constant disturbances w 4 and w 3 at t = 5 and t = 45, respectivey, are rejected by the oca controers of these agents. As can be seen in Fig. 4, a more aggressive choice of the contro gains F eads to a faster disturbance rejection. But the other agents in the group have no information about the disturbance and cannot adjust their actions to this situation. A more desirabe and cooperative reaction on the oca disturbances woud be that the other vehices in the patoon sow down or acceerate in order to maintain the desired reative distances during the transient phase. Maintaining the desired intervehice distances is of higher importance than maintaining the desired veocity for a vehice patoon. Such performance requirements cannot be taen into account expicity with the distributed reguator described in Theorem 3. Up to now, the proposed contro strategy is a hierarchica contro strategy. Cooperation happens ony on the networ eve in order to spread the reference signa d g a over the networ. Such a hierarchica approach has many benefits but aso has its drawbacs, cf., 8. In particuar, there is no cooperative reaction on the individua externa disturbances. V. IMPROVING THE TRANSIENT BEHAVIOR: IDENTICAL AGENTS The distributed reguator presented in Section IV soves the distributed output reguation probem and reaizes a cooperative behavior of the group. In this section, we show that the cooperative behavior can be improved significanty by a suitabe extension of the distributed reguator. As motivated in Exampe, it is desirabe to estabish a cooperative reaction on oca disturbances, meaning that the group disagreement or synchronization error is ept sma in transient phases. For this purpose, we present a nove distributed reguator with additiona coupings among the agents which stabiize the synchronization error and guarantee a desired performance. This is our main contribution and improvement of the distributed reguator compared to previous wors 33. In a first step, we consider groups of agents with identica dynamics. In particuar, we impose the foowing assumption. Assumption 6. Assume that for a N, A = A, B = B, C e = Ce, D e = De, F = F. Note that not a matrices in (2) are required to be identica for the individua agents. In particuar, the measurement output maps (2b) are aowed to be non-identica, and the oca exosystems (4) as we as the generaized disturbance input matrices in (2a), (2c), can be non-identica. This eaves great fexibiity in the probem formuation despite Assumption 6. Moreover, Assumption 6 wi be reaxed in Section VI. Our goa is to improve the cooperative behavior of the group in transient phases. The disagreement of the group can be quantified based on the transient state components ε defined in (34). For this purpose, we consider the transient synchronization errors defined by ε s = ε N N j= ε j. (37) From (36), we now that e = (C e D e F)ε under Assumption 6 and without observer errors. Since C e D e F is identica for a N, agreement of ε corresponds to agreement of the reguation errors e. In the foowing, we propose a distributed reguator which soves Probem and, at the same time, exponentiay stabiizes the synchronization errors ε s with a certain desired decay rate γ >. In order to guarantee that this decay rate can be achieved, we refine Assumption as foows. Assumption. The pair (A + γi n x,b ), where γ >, is stabiizabe for a N. We start with the fu information case. This aows to present the main idea in a cear way and wi be instrumenta in the proof of the output feedbac case. Lemma 3 (Fu information reguator). Consider a group of agents (2) with exosystems (3), (4). Suppose that Assumptions, 4, 5 and 6 are satisfied. Then, a distributed fuinformation reguator that soves Probem and additionay achieves exponentia stabiity of synchronization errors ε s with decay rate γ > can be constructed as foows:

10 Choose F such that A BF is Hurwitz. For a N, find a soution for (23) and (24) and set G g = Γg + FΠg G = Γ + FΠ Choose H such that for = 2,...,N, max{re(µ), µ σ(a BF λ BH)} < γ, (38) i.e., the maxima rea part of a eigenvaues of the matrices A BF λ BH is smaer than γ. Finay, the contro aw for each agent N is given by u = Fx + G g dg + G d + H j N (ε j ε ). (39) Proof: Anaogousy to (35), the dynamics of ε can be computed as ε = (A BF)ε + BH j N (ε j ε ). (4) The nove term in the contro aw (39) coupes the transient state components of the agents. Eq. (4) is a diffusivey couped networ of N identica stabe inear systems. The same transformation as in the proof of Theorem 2, i.e., ε = (T I n x)ε, eads to ε = ( I N (A BF) Λ BH ) ε. Let ε be partitioned into ε and ε. Then, ε = (A BF) ε and A BF λ 2 BH ε =... ε. A BF λ N BH By (38) the maxima rea part of the atter matrix is smaer than γ. Note that such a gain H exists due to Assumptions and Lemma 2. Hence, there exists a constant c > such that ε (t) c ε () e γt, for a t, cf., 4. We define the projection matrix P = I N N T and partition T = T. Then, the stac vector of synchronization errors (37) is given by ε s = (P I n x)ε = (PT I n x) ε = (PT I n x) ε since P =. Hence, it foows that there exists a constant c > such that ε s (t) c (P I n x)ε() e γt. Consequenty, the synchronization error is exponentiay stabe with a decay rate of at east γ. The matrix A BF is Hurwitz by the choice of F, which guarantees that ε (t) as t. Therefore, it hods that ε(t) = (T I n x) ε(t) as t. Since e = (C e D e F)ε, this shows that Probem is soved. The nove contro aw (39) soves Probem and additionay enforces synchronization of the reguation errors with a desired decay rate and therefore has the desired effect, that is, a cooperative reaction of the group on disturbances acting on individua agents. The gain matrices F and H aow to tune separatey the oca disturbance rejection of each agent and the synchronization of the group. Theorem 2 serves as a design method for H. The fu information contro aw (39) is impractica since the agents do not have direct access to their state and generaized disturbance signas. The foowing theorem shows that (39) can be impemented based on observers, anaogousy to (32) in Theorem 3. In order to guarantee that the desired decay rate can be achieved, we refine Assumption 2. Assumption 2. The pair ( A B d S + ηi (n x +n d ), C where η >, is detectabe for a N. ) D d, Theorem 4 (Distributed output feedbac reguator). Consider a group of agents (2) with exosystems (3), (4). Suppose that Assumptions, 2, 3, 4, 5 and 6 are satisfied. Construct a distributed reguator as in Theorem 3 and choose L and K such that the corresponding systems are exponentiay stabe with decay rate η > γ >. Choose H as in (38). Then, the contro aw u = F ˆx + G g ˆ d g + G ˆ d + H j N (ˆε j ˆε ), (4) soves Probem and additionay achieves exponentia stabiity of the synchronization errors ε s with decay rate γ >. Proof: The nove term in (4) has no infuence on the dynamics of the observer errors ε x, εd, εdg. They obey the same dynamics as in the proof of Theorem 3. Moreover, by assumption, there exist constants c > such that for a t, ε x(t) ε dg(t) ε d(t) c ε x() ε dg() ε d() e ηt. (42) Note that ˆε = ˆx Π g ˆ d g Π ˆ d = x ε x Πg (dg ε dg ) Π (d εd ) = ε ε x + Πg εdg + Π εd. Anaogousy to the proof of Theorem 3, the dynamics of ε can be computed as ε = (A BF)ε + BH j N (ε j ε ) + δ (t), where δ (t) captures the infuence of the observer errors δ (t) = BFε x BGg εdg ( BH j N BG εd ε x j Π g j εdg j Π jε d j ε x + Πg εdg + Π εd We define the stac vector δ = δ T δ N TT. From (42) it foows that there exists a constant c δ such that for a t, ). δ(t) c δ δ() e ηt. (43) Anaogousy to the proof of Lemma 3, we obtain ε = ( I N (A BF) Λ BH ) ε + (T I n x)δ. With (43) and since η > γ, it foows that ε (t) exponentiay as t with decay rate γ.

11 s(t) s(t) (a) A first choice of the couping gain H (b) A more aggressive design of F and H. Fig. 5. Simuation resuts for Exampe 2. Moreover, we aso have ε (t) as t. Since ε (t) as t for a N, the couping term in (4) vanishes asymptoticay. Consequenty, anaogousy to the proof of Theorem 3, it hods that e (t) as t and Probem is soved. Exampe 2. We consider the same setup as in Exampe. Now, we use the nove distributed reguator as described in Theorem 4. Simuation resuts with oca exogenous input signas according to Fig. 3 are shown in Fig. 5. The effect of the disturbances on the inter-vehice distances is indeed rejected much more efficienty, compared to Exampe. The patoon reacts cooperativey on the oca disturbances and maintains sma synchronization errors. The two different simuations in Fig. 5 with different choices of the contro gains F and H iustrate the fexibiity of the contro design. Depending on the requirements, it is possibe to put more emphasis on the disturbance rejection or on the synchronization. VI. IMPROVING THE TRANSIENT BEHAVIOR: NON-IDENTICAL AGENTS In this section, we aim at reaxing Assumption 6. In case of non-identica agents, an anaogue couping term as in (39) eads to a diffusivey couped networ of non-identica stabe inear systems in (4). In this case, it is hard to find a suitabe couping gain H. In case of non-identica state dimensions n x such coupings cannot be reaized at a. We excude this case and treat the non-identica agents as perturbed versions of a nomina system. We present a design method for H based on this nomina system and use robustness arguments in order to prove exponentia stabiity of the heterogeneous networ. For ease of presentation, we discuss ony the fu information case in the foowing. The output feedbac impementation can be carried out anaogousy to Theorem 4. Suppose that we impement a contro aw ie (4) in a group of non-identica agents, i.e., u = F x + G g dg + G d + H j N (ε j ε ) (44) where F, G g, G are designed as in Theorem 3 and H is a couping gain to be specified in the foowing. Then, anaogousy to (4), the error variabes ε obey the dynamics ε = (A B F )ε + B H j N (ε j ε ), where A B F is Hurwitz. The ey assumption in the foowing is that the systems ε = (A B F )ε + B ν (45) with artificia inputs ν have simiar dynamics. In particuar, we express each system as perturbed version of the same nomina system P with uncertainty according to P : ε = Ãε + Bν + B ω ω (46a) ζ = C ζ ε + D ζ ν (46b) : ω = ζ, (46c) as iustrated in Fig. 6. Note that the reguation error e = (C e FD e )ε can be interpreted as output of the system P. The fact that the systems (45) are simiar is formay expressed in the foowing assumption. Assumption 7. The matrix à is Hurwitz. The uncertainties are proper rea-rationa stabe transfer matrices and satisfy < η, where η >, for a N. The foowing procedure yieds a description of the systems (45) as in (46). We define the nomina system G based on the average matrices à = N N =(A B F ), B = N N = B, i.e., the transfer function matrix from ν to ε is given by G(s) = (si n x Ã) B. Note that we choose ε as output since we want to construct a state feedbac controer for the nomina system ater on. At this point, we have to chec whether à is Hurwitz. If it is not Hurwitz, the description (46) must be constructed in a different way such that à is Hurwitz. If it is Hurwitz, we proceed as foows. We define the individua transfer function matrices G (s) = ( si n x (A B F ) ) B. ν ω Fig. 6. Nomina agent dynamics P with individua perturbation. P ζ e

12 Then, we express G (s) as perturbed version of the nomina system G(s) with dynamica additive uncertainty, i.e., G (s) = G(s) + (s), where is simpy obtained from (s) = G (s) G(s). Since G(s) and G (s) are proper rea-rationa and stabe, is proper rea-rationa and stabe as we. The bound η in Assumption 7 is computed as η = max N. With the matrices B ω = B, C ζ = I n x, and D ζ =, and the uncertainties obtained from the procedure above, the systems (45) are represented as in (46) and Assumption 7 is satisfied. With coupings ν = H j N (ε j ε ), between the systems and the representation (46) for each agent, we obtain T ωζ : ε = (I N à L G BH)ε + (I N B ω )ω (47a) ζ = (I N C ζ L G D ζ H)ε (47b) : ω = diag( )ζ. (47c) This is a diffusivey couped networ of uncertain stabe inear systems, which is iustrated in Fig. 7. The next step is to design H such that the H norm of the networ with input ω and output ζ is minimized. For this purpose, we foow the ideas of 9 and extend the synthesis procedure such that a desired decay rate γ > is achieved for the synchronization error. Note that a ower bound on the achievabe H performance is given by the autonomous system since we consider ony diffusive coupings and λ =. Lemma 4. Let the graph G be undirected and connected. Then, the networ T ωζ is exponentiay stabe and satisfies T ωζ < η for a given η > and achieves state synchronization exponentiay with a decay rate γ >, if and ony if the N systems ω ζ T : ε = (à λ BH) ε + B ω ω ζ = (C ζ λ D ζ H) ε are exponentiay stabe and satisfy T < η for a N, and additionay for = 2,...,N, have a decay rate γ. ω... N T ωζ ω ζ ζ Proof: Since G is undirected and connected there exists an orthogona matrix U such that U T L G U = Λ = diag(λ ) and λ = is the top eft diagona eement of Λ. With the coordinate transformation ε = (U T I N )ε, ω = (U T I N )ω, ζ = (U T I N )ζ, we obtain ε = (I N Ã Λ BH) ε + (I N B ω ) ω ζ = (I N C ζ Λ D ζ H) ε. The atter system is decomposed into the decouped systems ε = (à λ BH) ε + B ω ω ζ = (C ζ λ D ζ H) ε. Hence, exponentia stabiity of T ωζ corresponds to exponentia stabiity of these systems for a N. Anaogousy to the proof of Lemma 3, the state components = 2,...,N correspond to the synchronization error of the networ. Exponentia stabiity with decay rate γ of these systems is equivaent to state synchronization with decay rate γ, as stated in the proof of Lemma 3. Moreover, since U = U T = and the maxima singuar vaue of a boc diagona matrix equas the maximum of the maxima singuar vaues of each boc, it foows that T ωζ ω ζ = max T < η. Theorem 5. Let the graph G be undirected and connected. Suppose that Assumption 7 is satisfied and et η < /η and γ >. Suppose that there exist X >, Y >, Z such that the LMIs à T X + Xà XB ω (C ζ ) T (B ω ) T X ηi < (48) C ζ ηi and, for = 2,...,N, Ξ B ω (C ζ Y λ D ζ Z) T (B ω ) T ηi < (49) C ζ Y λ D ζ Z ηi are satisfied, where Ξ = (ÃY λ BZ) T + (ÃY λ BZ) + 2γY. Then, the networ (47) with H = ZY is exponentiay stabe. Proof: The N subsystems T transformed systems P : ω ζ ε = à ε λ Bν + B ω ω ζ = C ζ ε λ D ζ ν are composed of the and state feedbac aw ν = H ε. The ey idea is to design one singe controer ν = H ε guaranteeing the desired H norm η for a N subsystems P as we as the desired decay rate η for = 2,...,N. According to the Bounded Rea Lemma 42, the cosed oop of P with contro aw ν = H ε is asymptoticay stabe and has H norm ess than or equa η, if and ony if there exists X > such that Θ XB ω (C ζ λ D ζ H) T (B ω ) T X ηi <, C ζ λ D ζ H ηi Fig. 7. Nomina networ with uncertainties. where Θ = (à λ BH) T X + X(à λ BH). Since λ =, the best achievabe H norm is imited by the uncontroed system