Dynamic Systems on Graphs

Similar documents
Changing Topology and Communication Delays

A graph is a pair G= (V,E) with V a nonempty finite set of nodes or vertices V { v1 a set of edges or arcs E V V. We assume ( vi, vi) E,

DO NOT DO HOMEWORK UNTIL IT IS ASSIGNED. THE ASSIGNMENTS MAY CHANGE UNTIL ANNOUNCED.

Multi-agent Consensus and Algebraic Graph Theory

Non-negative Matrices and Distributed Control

Singular Value Decomposition: Theory and Applications

APPENDIX A Some Linear Algebra

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

Random Walks on Digraphs

Google PageRank with Stochastic Matrix

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Introduction. - The Second Lyapunov Method. - The First Lyapunov Method

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

Lecture 12: Discrete Laplacian

6. Stochastic processes (2)

6. Stochastic processes (2)

Statistical Mechanics and Combinatorics : Lecture III

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Linear Algebra and its Applications

Lecture 3. Ax x i a i. i i

CHALMERS, GÖTEBORGS UNIVERSITET. SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS. COURSE CODES: FFR 135, FIM 720 GU, PhD

Chapter 7 Channel Capacity and Coding

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Math1110 (Spring 2009) Prelim 3 - Solutions

3 Riccati Design for Synchronization of Continuous-Time Systems

MATH Homework #2

Lecture 10: May 6, 2013

Ph 219a/CS 219a. Exercises Due: Wednesday 23 October 2013

2.3 Nilpotent endomorphisms

Errors for Linear Systems

This model contains two bonds per unit cell (one along the x-direction and the other along y). So we can rewrite the Hamiltonian as:

Continuous Time Markov Chain

Introduction to Algorithms

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

More metrics on cartesian products

Digital Signal Processing

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The Second Eigenvalue of Planar Graphs

Discrete Mathematics. Laplacian spectral characterization of some graphs obtained by product operation

Adaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays *

THE ARIMOTO-BLAHUT ALGORITHM FOR COMPUTATION OF CHANNEL CAPACITY. William A. Pearlman. References: S. Arimoto - IEEE Trans. Inform. Thy., Jan.

SELECTED SOLUTIONS, SECTION (Weak duality) Prove that the primal and dual values p and d defined by equations (4.3.2) and (4.3.3) satisfy p d.

CSCE 790S Background Results

Spectral Graph Theory and its Applications September 16, Lecture 5

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

Eigenvalues of Random Graphs

Chapter 7 Channel Capacity and Coding

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 17. a ij x (k) b i. a ij x (k+1) (D + L)x (k+1) = b Ux (k)

Introduction to Algorithms

Ph 219a/CS 219a. Exercises Due: Wednesday 12 November 2008

Composite Hypotheses testing

Norm Bounds for a Transformed Activity Level. Vector in Sraffian Systems: A Dual Exercise

Invited by Karl Mathia

PHYS 215C: Quantum Mechanics (Spring 2017) Problem Set 3 Solutions

Robust observed-state feedback design. for discrete-time systems rational in the uncertainties

5 The Rational Canonical Form

MEM633 Lectures 7&8. Chapter 4. Descriptions of MIMO Systems 4-1 Direct Realizations. (i) x u. y x

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

Consistency & Convergence

COOPERATIVE CONTROL OF MULTI-AGENT SYSTEMS STABILITY, OPTIMALITY AND ROBUSTNESS KRISTIAN HENGSTER MOVRIĆ

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS

Lecture 3: Probability Distributions

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

MTH 263 Practice Test #1 Spring 1999

The equation of motion of a dynamical system is given by a set of differential equations. That is (1)

First day August 1, Problems and Solutions

Entropy of Markov Information Sources and Capacity of Discrete Input Constrained Channels (from Immink, Coding Techniques for Digital Recorders)

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD

NP-Completeness : Proofs

Containment Control for First-Order Multi-Agent Systems with Time-Varying Delays and Uncertain Topologies

Tokyo Institute of Technology Periodic Sequencing Control over Multi Communication Channels with Packet Losses

find (x): given element x, return the canonical element of the set containing x;

Problem Set 9 Solutions

Solutions to Problem Set 6

Representation theory and quantum mechanics tutorial Representation theory and quantum conservation laws

LECTURE 9 CANONICAL CORRELATION ANALYSIS

e - c o m p a n i o n

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

1 Matrix representations of canonical matrices

ρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to

Norms, Condition Numbers, Eigenvalues and Eigenvectors

Lecture Notes on Linear Regression

Inexact Newton Methods for Inverse Eigenvalue Problems

Affine transformations and convexity

A property of the elementary symmetric functions

Zeros and Zero Dynamics for Linear, Time-delay System

Continuous Time Markov Chains

Linear Approximation with Regularization and Moving Least Squares

Convexity preserving interpolation by splines of arbitrary degree

Distributed Exponential Formation Control of Multiple Wheeled Mobile Robots

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

Lecture 3: Shannon s Theorem

Estimation: Part 2. Chapter GREG estimation

Transcription:

Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network, or algebrac graph, s G x =(G,x) wth nodes, wth vector x [ x x ] T R and x R a value or state assocated to node v of graph G. A dynamc graph, or dynamc network, s a network whose state evolves accordng to some dynamcs x f ( x, u ).. Control Graphs [Saber and Murray 2004] Gven a graph G=(V,E), we nterpret v, v E to mean that node v can obtan nformaton from node v for feedback control purposes. Let G x =(G,x) be a dynamc graph wth nodes and wth x f( x, u). The control be gven by u k ( x, x,, x ) s sad to be a protocol wth topology G f v v, {, m} 2 m. The protocol s called dstrbuted f m,. The communcaton cost C(G) of dgraph G=(V,E) s defned as the total number of drected edges C E. For a weghted graph one has C sgn( w )., A network desgn problem- for fxed C, select the best weghts w gven some performance measure. Agreement. odes v, v n a network agree f x =x. Synchronzaton Problem. odes are sad to synchronze f lm x ( t) x ( t) 0,,. t Consensus Problem. odes have reached consensus f x x,,. Usually refers to constant steady-state value. Asymptotc Consensus Problem. odes acheve consensus asymptotcally f, for all ntal

condtons x (0), lm x ( t) x ( t) 0,,. t -Consensus problem. Let ( x, x2,, x ): R R. The -Consensus problem s to fnd a way to compute the global quantty ( x(0)) usng a dstrbuted (local) protocol. Asymptotc -Consensus. A protocol asymptotcally solves the -Consensus problem f there * exsts an asymptotcally stable equlbrum x* of the closed-loop system satsfyng x ( x(0)) for all. Average consensus problem. Fnd a dstrbuted protocol to compute ( x(0)) Ave( x(0)) x (0)., Also, max-consensus problem, mn-consensus, etc. 2 Frst Order Consensus 2. Contnuous-Tme Systems Let G be a dynamc graph wth dynamcs x u. Consder the local votng control protocol u a ( x x ). Ths s equvalent to u a ( x x ). The closed-loop system s x ax ax dx ax so that x ( DA) xlx wth L the graph Laplacan and D dag{ d } the dagonal n-degree matrx. ote also that u= -Lx. Lemma. [Saber and Murray 2004]. Let G be a strongly connected dgraph. Let the left egenvector of L for =0 be w [ ]. Then x Lx, wth L the Laplacan, solves the consensus problem gven by ( x(0)) l x(0). Lemma. [c.f. Saber and Murray 2004]. Consder a strongly connected dynamc graph G wth ntegrator dynamcs and control u k a ( x x ), wth k a control gan. Let the left egenvector of L for =0 be w [ ]. Then the control solves the consensus problem gven by l 2

( x(0)) x (0) wth weghtng / k. Thus, a state usng smaller control gans wll end up more heavly weghted n the consensus value. Lemma. [Ren and Beard 2005]. (rough statement)- The gradent-based control law acheves consensus asymptotcally ff the graph has a spannng tree. Lemma. [Saber and Murray 2004]. Let G be a dgraph. Then G s balanced ff a ( x x ) 0. That s, u 0, xr wth u a( x x) the gradent-based, T T T control. (Proof- Balanced ff 0 L Lx u u. Lemma. [Saber and Murray 2004]. A strongly connected dgraph G solves the average consensus problem ff G s balanced. (Proof- then w l = for = 0.) ormalzed votng protocol x u a( x x) d wth d the n-degree of node. Then x D ( DA) xd Lx uses the normalzed Laplacan. u D ( DA) x D Lx 2.2 Dscrete-Tme Systems: Vcsek Type Standard local votng protocol, normalzed x ( k) x ( k) u ( k) u( k) a( x( k) x( k)) d x( k) x( k) a( x( k) x( k)) d ( d ) x( k) a( x( k) x( k)) d x( k) ax( k) d 3

So the global dynamcs can be wrtten x( k) x( k) u( k) uk ( ) ( I D) L( ID) ( D A) x( k) x( k) ( I D) Lx( k) x( k) ( I D) ( I A) x( k) x( k) Fx( k) where the DT system matrx s F I ( I D) L( I D) ( I DL) ( I D) ( I A) F 0 s a stochastc matrx wth postve dagonal elements. 2.3 Dscrete-Tme Systems: Perron Type For a dynamc graph wth dscrete-tme state x( k) x( k) u( k), the local votng control protocol above gves the closed-loop system x ( k) x ( k) w x ( k) x ( k) or x( k) Px( k) wth P I L the Perron matrx, whch s a row stochastc matrx. Lemma. Let the graph be strongly connected so that L has one e-val at s=0 and the rest n the open-rght half s-plane. Then P has one e-val at z= and the rest strctly nsde the unt crcle f 2 Wth the largest e-val of L. Ths s guaranteed n terms of the maxmum n-degree f max d 2.4 Egenvalues Laplacan L has at least one e-val at 0 and the rest n the rght-half s-plane. It has exactly one e- val at 0 ff the graph has a spannng tree, and f the graph s strongly connected. Then L has all e-vals n the open left half s-plane except for one e-val at s=0. Let E have egenvalues at wth egenvectors v. Then:. E I has egenvalues at wth egenvectors v. 2. I E has egenvalues at wth egenvectors v. 4

0 2 ( E) ' 0 0 ' 2 ' 2 2 2 Egenvalue regon of stochastc matrx. Example: E D A Egenvalue regon of normalzed M matrx w/ row sum= and dag. entres =. Example: L I D A Let L be an M matrx wth row sum zero. Then: G I L s a Metzler matrx wth row sum of one. G s an M matrx wth row sum of. Laplacan L=D-A s an M matrx wth row sum zero. Then:. G I L I D A s a Metzler matrx wth row sum of one. G s an M matrx wth row sum of. 2. GI D LD A 0 s a row stochastc matrx wth dagonal elements equal to 0. 3. F I ( I D) L( I D) ( I DL) ( I D) ( I A) s a row stochastc matrx wth dagonal elements equal to. A matrx wth off-dagonal elements nonnegatve s called a Metzler matrx. * 0 Metzler 0 * Let Z denote the set of matrces whose off-dagonal elements are nonpostve. * 0 Z 0 * Metzler matrx = -(Z matrx) A Z matrx s called an (sngular) M matrx f all ts prncpal mnors are nonnegatve. It s a nonsngular M matrx f all the prncpal mnors are postve. 0 M 0 A matrx E 0 s row stochastc f all ts row sums equal to..e. f E M () A matrx E 0 s doubly stochastc f all ts row sums and column sums equal to. 5

The maxmum egenvalue of a stochastc matrx s. The DT system matrx F has at least one e-val at n the z-plane and all the rest nsde the unt crcle. It has exactly one e-val equal to ff the graph has a spannng tree, and f the graph s strongly connected. Then F has all e-vals strctly nsde the unt crcle except for one e-val at z=. 6