Average Consensus and Gossip Algorithms in Networks with Stochastic Asymmetric Communications

Size: px
Start display at page:

Download "Average Consensus and Gossip Algorithms in Networks with Stochastic Asymmetric Communications"

Transcription

1 Average Consensus and Gossip Algoriths in Networks with Stochastic Asyetric Counications Duarte Antunes, Daniel Silvestre, Carlos Silvestre Abstract We consider that a set of distributed agents desire to reach consensus on the average of their initial state values, while counicating with neighboring agents through a shared ediu. This counication ediu allows only one agent to transit unidirectionally at a given tie, which is true, e.g., in wireless networks. We address scenarios where the choice of agents that transit and receive essages at each transission tie follows a stochastic characterization, and we odel the topology of allowable transissions with asyetric graphs. In particular, we consider: (i) randoized gossip algoriths in wireless networks, where each agent becoes active at randoly chosen ties, transitting its data to a single neighbor; (ii) broadcast wireless networks, where each agent transits to all the other agents, and access to the network occurs with the sae probability for every node. We propose a solution in ters of a linear distributed algorith based on a state augentation technique, and prove that this solution achieves average consensus in a stochastic sense, for the special cases (i) and (ii). Expressions for absolute tie convergence rates at which average consensus is achieved are also given. I. INTRODUCTION The average consensus proble is a distributed control proble in which a set of agents ais to agree on the average of their initial state values by exchanging essages dictated by a given counication topology. Several ultidisciplinary applications of average consensus algoriths have been reported in the literature. These include distributed optiization [], []; otion coordination tasks, such as flocking, leader following [3], and rendezvous probles [4]; and resource allocation in coputer networks [5]. An elegant theory is now available in the literature to solve consensus probles using linear distributed algoriths, in which each agent coputes a weighted average between its state value and the state values of the agents to which it can counicate (see, e.g, [6], [7]). Many variations of this proble have been addressed in the literature considering, e.g., stochastic packet drops and link failures [8], [9], quantized data transissions [0], and tie-varying counication connectivity [6]. On the other hand, randoized gossip algoriths have been proposed, e.g., in [], as a decentralized solution to the average consensus proble that can deal with several features such as the absence of a centralized entity, and the possibly varying topology of the network caused by agents that join and leave the network. The preise of gossip D. Antunes is with the Departent of Mechanical Engineering, Eindhoven University of Technology, the Netherlands, D.Antunes@tue.nl D. Silvestre, C. Silvestre are with the Dep. of Electrical Eng. and Coputer Science, Instituto Superior Técnico, ISR, Lisboa, Portugal. {dsilvestre,cjs}@isr.ist.utl.pt algoriths is that each agent counicates with no ore than one neighbor at each transission tie. In [], it is assued that at each counication tie, the sender and the receiver set their state to the average of their current values, which subsues that the counication is bidirectional. In the present work, we consider the average consensus proble in scenarios where counication is unidirectional at each tie slot, i.e., at each transission tie a single agent transits data to one or several agents, but does not receive data. Note that at a different tie slot receiver and sender agents ay invert their roles, i.e., the word unidirectional refers only to counication at a given transission tie. For concreteness, we consider the two following scenarios: (i) randoized gossip algoriths in wireless networks, where each agent becoes active at randoly chosen ties, transitting its data to a single neighbor; (ii) broadcast wireless networks, where each agent transits to all the other agents, access to the network occurs with the sae probability for every agent, and the intervals between transissions are independent and identically distributed. As we shall see, the unidirectionality counication constraint precludes in general the existence of a linear distributed algorith where associated to each agent there is a single scalar state, updated based on the state of the other agents, as in related probles where the counication topology of the network is also tie-varying, but satisfies different assuptions (see [6], [7]). We assue a syetric counication topology, eaning that if an agent a can counicate with an agent b then the agent b can counicate with the agent a, although this does not take place at the sae transission tie, i.e., at each transission tie the graphs odeling counications are in general asyetric. Note that this is typically the case in wireless networks, and therefore this assuption is reasonable to assue in both scenarios (i) and (ii). The ain contribution of the present paper, is to propose a linear distributed algorith using a state augentation technique to achieve average consensus when counication constraints ipose tie-varying unidirectional transissions, and to prove convergence in expectation to average consensus for scenarios (i) and (ii). Moreover, the stochasticity of the ties between transissions, in both gossip and broadcast scenarios considered herein, render non-trivial the coputation of the rates of convergence of the linear distributed algoriths to consensus in absolute tie, as opposed to discrete-tie, i.e., in ters of the nuber of transissions. We provide expressions for the absolute tie rates in both scenarios. A recent work [] addresses a siilar proble, consid-

2 ering gossip algoriths also with asynchronous counication between the agents. In [], a ethod is proposed to achieve average consensus, also using a state augentation technique, and this ethod is proved to converge alost surely to consensus. The counication topologies considered in [] encopass general directed graphs. Hence, [] does not need to assue a syetric counication topology, which is crucial to obtain our convergence results. Note, however, that in the ethod proposed in [], the state updates depend in a nonlinear way of the current state, while the algorith that we propose is a linear distributed algorith, proving a solution that parallels existing algoriths for the standard gossip [] and linear distributed algoriths [7]. The reainder of the paper is organized as follows. We provide soe preliinaries and state the average consensus proble in Section II. The proposed solution is given in Section III and our ain results are stated in Section IV. Concluding rearks and directions for future work are given in Section VI. Notation : The transpose and the spectral radius of a atrix A are denoted by A and r σ (A), respectively. For vectors a i, (a,...,a n ) := [a...a n ]. We let n := [...] and 0 n := [0...0] indicate n-diension vector of ones and zeros, and I n denotes the identity atrix of diension n. Diensions are oitted when no confusion arises. The vector e i denotes the canonical vector whose coponents equal zero, except coponent i that equals one. The notation diag([a...a n ]) indicates a block diagonal atrix with blocks A i. The Kronecker product is denoted by. II. PRELIMINARIES AND PROBLEM STATEMENT We consider that a set of agents with scalar state x i (t), i, desire to obtain the average of their initial states, i.e., li t x i(t) =x av := x i (0). () i= We refer to this proble as the average consensus proble. The counication topology is odeled by a directed graph G =(V,E), where V is the set of agents, also denoted by nodes, and E V V is the set of counication links. The node i can send a essage to the node j, if (j, i) E. If there exists at least one i V such that (i, i) E we say that the graph has self-loops. A standing assuption will be that G is strongly connected and aperiodic [7]. We associate to the graph G an adjacency atrix N with entries {, if (i, j) E N ij :=. () 0, otherwise More generally, we can consider al weighted adjacency atrix W associated with G with entries [W ] ij = w ij R, if (i, j) E and [W ] ij =0, otherwise. A. Previous Work A linear distributed algorith is defined by the iteration x(t k+ )=W k x(t k ), (3) where {W k,k 0} is a set of weighted adjacency atrices associated with the graph G, and t k are the ties at which a transission occurs, with t 0 := 0. It is subsued throughout the paper that between transission ties, the state variables do not change their values, i.e., e.g., ẋ(t) = 0,t [t k,t k+ ). If W k = W c is constant for every k 0, where W c is a stochastic atrix (W c = ), and the graph is strongly connected and aperiodic, the linear distributed algorith (3) converges to consensus (cf. [7]), eaning that li k x k = c, for a given constant c. See [7] for conditions under which consensus is achieved in the case where W k are tie-varying. Moreover, if all the atrices {W k,k 0} are doubly stochastic (W k = and W k = ) and (3) converges to consensus then (3) converges to average consensus, i.e., () is achieved. A randoized gossip algorith is a special case of a linear distributed algoriths. In gossip algoriths, each of the nodes has a clock which ticks at a rate Poisson process, i.e., inter-tick ties are rate exponential distributed. It is clear that at a given tick tie, each node has the sae probability of being the node whose clock ticked. Such node, denoted by i, chooses a rando out-neighbor j (corresponding to the non-zero entries of colun i of the adjacency atrix N) according to a given distribution p ij, which denotes the probability that node j N out (i) is chosen, where N out (i) denotes the set of out-neighbors of node i and j N p out(i) ij =. Both nodes update their current state values according to the averages of their values, while the reaining nodes keep their state intact, i.e., if node i ticks at tie t k and chooses node l to counicate with, then x(t k+ )=W k x(t k ), where W k = M il, M il := I (e i e l )(e i e l ) B. Stability and convergence rate As in gossip algoriths, there are several works in the literature (see, e.g., [8], [9], and references therein), where the atrices W k in (3) are assued to be stochastic atrices, i.e., Prob[W k = M j ]=p j, for soe atrices M j, j n M, and probabilities p j, n M i= p j =. This ay be due to several sources of randoness, such as packet drops or link failures. In such cases the definition of achieving average consensus (cf. ()) ust be adapted to a stochastic setting. Definition : We say that a linear distributed algorith taking the for (3), where {W k,k 0} are stochastic atrices: (i) converges alost surely to average consensus if li t x i(t) =x av := alost surely. x i (0), i {,...,} i= We use this forulation, instead of siply considering discrete-tie variables z k = x(t k ) indexed by the transission nuber k, because we are interested in deterining convergence rates to consensus in absolute tie t.

3 (ii) converges in expectation to average consensus if li t E[x i(t)] = x av, i {,...,}. (iii) converges in second oent to average consensus if li E[(x i(t) x av ) ] 0, i {,...,}. t In applications it is typically easier to prove convergence in expectation and in second oent, which are the two stability definitions we shall focus in the present paper. It is clear that convergence in second oent to consensus is stronger than convergence in expectation and also stronger than alost sure convergence. As argued in [] it is soeties possible to prove that convergence in expectation iplies alost sure convergence. However, we ake no such assertion here. Provided that consensus is achieved one ay ask at which rate is it achieved. In the present paper we shall focus on deterining the following rate corresponding to the convergence rate to zero of the second oent of the error between state and average consensus. Definition : Suppose that the following condition holds for soe γ > 0 and c>0 and for every x(0) R, E[(x i (t) x av ) ] ce γt (x i (0) x av ), i {,...,}. (4) Then, the second oent convergence rate is defined as α:=sup{γ : (4) holds for soe c>0 and every x(0) R }. C. Proble Stateent We consider the following counication constraint, inspired by wireless counication constraints: Counication Constraint 3: At each transission tie t k, a single agent i sends data to one or various of its outneighbors, and cannot receive data fro its in-neighbors. For concreteness, we consider the two following scenarios. Gossip algoriths: We adapt the set-up proposed in [] and described in Section II-A to accoodate the counication constraint 3. In other words, we consider that each of the agents has a clock which ticks at a rate Poisson process, randoly choosing one of its out-neighbors according to the distribution p ij associated with node i. Node j can change its state (not necessary a scalar) at this transission tie based on the data received fro node i. However, node i does not receive data at this transission tie. We allow p ii to be different fro zero, eaning that at soe clock ticks, node i can update its state without counicating to any other node. Broadcast wireless networks: At each transission tie an agent sends data to every other agent in the network. We consider that nodes have the sae probability of accessing the networks at each transission tie and assue that the ties between transissions are independent and identically distributed as it is typical to consider in such networks (cf. [3]). The probles we are interested in are the following. (i) In the setup of scenarios ) and ), design a linear distributed algorith that achieves average consensus according to one of the stability notions of Definition. (ii) Copute the second oent convergence rate to average consensus of this linear distributed algorith. Although we shall provide a ethod to obtain average consensus that can be applied to any counication topology described by (), our stability results given for scenarios ) and ) assue that N is syetric, which is reasonable to assue in wireless networks, in which if a node a can counicate to a node b then typically b can counicate with a. The next exaple illustrates why, in general, it is not possible to achieve average consensus by using the standard solution described in Section II-A, where each node updates a scalar state according to the recursion (3). Exaple 4: Suppose [ that ] =and the adjacency atrix is given by N =. When node i {, } transits, node j {, }, j i, updates its inforation based on the received state of x i and its own state x j, and node i can only update its state based on its own state inforation. Thus, a linear distributed algorith using a single scalar state per node, [ is described ] by [(3), where ] W k {Z,Z }, and α α Z = β 0, Z 0 α =, where we assue that 3 β β 3 α 0, and β 0, since otherwise there would be no counication between the nodes. It is clear that W k cannot therefore be doubly stochastic atrices. In the next section, we propose a linear distributed algorith that solves this proble by using a state augentation technique. III. PROPOSED SOLUTION We augent the original state x(t) with an auxiliary vector y(t) R ny, and define z =(x, y). (5) We consider a linear distributed algorith taking the for z(t k+ )=U k z(t k ), (6) where z(0) = (x(0),y(0)),y(0) = 0. Intuitively, the purpose of y it to assure that at each iteration the total state average is kept constant, i.e., that x i(t k+ )+ n y y i(t k+ ) + n y = x i(t k )+ n y y i(t k ) + n y. (7) If we initialize y to zero and guarantee that y(t) goes to zero then average consensus is achieved. More specifically, the proposed algorith can be described as follows. Set n y =. Each coponent y i R is kept in eory and updated by node i along with its state x i. At tie t k,a given node i sends a essage containing x i (t k ) and y i (t k ) to one or ore out-neighbors (corresponding to the non-zero

4 entries of colun i of the adjacency atrix N). The node i does not change its state, i.e., and resets the auxiliary state to zero x i (t k+ )=x i (t k ) (8) y i (t k+ )=0. (9) Let n out (i, k) be the nuber of out-neighbors of node i to which a essage is sent at tie t k. A node j receiving this essage, updates its state x j (t) according to x j (t k+ )=( α)x j (t k )+αx i (t k )+βy j (t k )+γy i (t k ) (0) and updates its variable y j (t k ) according to y j (t k+ )= y i(t k ) n out (i, k) + y j(t k )+x j (t k ) x j (t k+ ) () so that the total state average is kept constant, i.e., (7) holds. The average consensus proble in the two scenarios considered in the present paper, i.e., gossip and broadcast algoriths, can be odeled by a linear distributed algorith taking the for (6). In fact, the following atrices U k can odel the algorith (8)-(), when applied to the counication assuptions for the gossip and broadcast algorith described in Section II-C. Gossip algorith G: The atrices U k are taken fro the set {Q ij, i, j, i j}, where each Q ij corresponds to a transission fro node i to an out-neighbor node j, and these atrices are described as follows. Let Λ i := diag(e i ) and Ω ij := I (Λ i + Λ j ). Then Aij B Q ij = ij () C ij D ij where A ij := I αλ j + αe j e i B ij := βλ j + γe j e i C ij := Λ j (I A ij ) D ij := Ω ij + Λ j (I + e j e i B ij). (3) The atrices defined in () also odel the case where a node i picks itself when there is a clock tick (with probability p ii ), in which case we arbitrate that the state update is described by and x i (t k+ )=x i (t k )+(α + β)y i (t k ) y i (t k+ )=( (α + β))y i (t k ), for which (7) is et. The atrices U k are by construction independent and identically distributed, and satisfy ( Prob[U k = Q ij ]= p ij, is the probability that node i is the one whose clock ticks at t k and p ij the probability that i picks its out-neighbor node j). The ties between transissions t k+ t k are independent and identically distributed with exponential distribution with ean (since nodes can trigger according to a rate Poisson process). Broadcast Algorith B: The atrices U k are taken fro the set {R i, i }, where each R i corresponds to a transission fro node i to every other node. Let Λ i := diag(e i ), Ω i =(I Λ i ). Then Ai B R i = i (4) C i D i A i =( α)i + α e i B i = Ω i (βi + γ e i ) C i = Ω i (I A i ) (5) D i = Ω i (I + e i B i). The atrices U k are independent and identically distributed due to our assuption that nodes access the network with the sae probability, i.e. Prob[U k = R i ]=. The ties between transissions t k+ t k are independent and identically distributed with an arbitrary distribution iposed by the network protocol. Hereafter, we denote by gossip algorith G the linear distributed algorith odeled by (6) and (), and denote by broadcast algorith B the linear distributed algorith odeled by (6) and (4). Note that, by construction, for both gossip and broadcast algoriths the atrices {U k,k 0} are such that Uk =, (6) which eans that the total average is preserved at each iteration, i.e., z(t k+) = z(t k), and U k = (7) 0 0 which eans that if consensus is achieved at iteration k, i.e., if x(t k )=c and y(t k )=0, the state reains unchanged at iteration k +, i.e., x(t k+ )=c and y(t k+ )=0. Exaple 5: In the sae setup of Exaple 4 and for α = /, β = /, and γ = /, the atrices (), for the proposed gossip algorith are given by / / / / Q = / / / / , Q = / / / / / / / / and the atrices (4) for the broadcast algorith are given by R = Q and R = Q. Suppose that node i transits with probability p =/ and node transits with probability p =/. We will show in the next section (cf. Theore 6) that the necessary and sufficient conditions for convergence in expectation and for convergence in variance are r := r σ (p A + p A [ 0 ] ) <, r := r σ (p A A + p A A S) <, [ S := 4 ( ])( [ 0 0 ] [ )] ), respectively, where (A,A ) should be replaced by (Q,Q ) for the gossip algorith G and (R,R ) for the broadcast algorith

5 B. Coputing r and r yields, r =0.5 and r =0.54 and therefore we conclude that consensus is achieved in expectation and second oent (and a fortiori alost surely), which eans that this linear distributed algorith eets the desired requireent of the proble of Exaple 4, i.e., it achieves average consensus. A. Stability IV. MAIN RESULTS We start by presenting a general result for the converge analysis of the stochastic linear distributed algorith (6). Theore 6: Consider a linear distributed algorith (6) where {U k,k 0} are characterized by (6), (7), and are randoly chosen fro a set M := {B i, i n p }, according to n p Prob[U k = B i ]=p i, p i =. (8) i= Then, the linear distributed algorith converges in expectation to average consensus if and only if n p r σ ( p i B i [ 0 )] ) < (9) i= and converges in second oent to average consensus if and only if n p r σ ( p i B i B i S) <, (0) where S := i= [ ( ])( [ 0 0 )] ). () Note that both gossip and broadcast algorith proposed in Section III coply with the fraework of Theore 6, and therefore we can use the conditions (9) and (0) to assert convergence to average consensus of these algoriths. The next Theore establishes that the gossip algorith G converges in expectation to consensus when the counication topology is syetric. The proof is postponed to Subsection IV-C. Theore 7: For a graph with a syetric adjacency atrix N, described by (), there always exists a syetric doubly stochastic weighted adjacency atrix P (possibly containing self-loops). Moreover, if we set p ij = [P ] ij, α = β = γ =/, the gossip algorith G converges in expectation to consensus. Note that the probabilities p ij can be any as long as P : [P ] ij = p ij is a syetric atrix. An interesting direction for future work is to investigate how to choose the p ij for exaple, to optiize the convergence rate to average consensus, in a siilar way to the distributed algorith proposed in []. For broadcast wireless networks, we have the following result: Theore 8: The broadcast algorith G converges in expectation to consensus, when α = β = γ =/. B. Convergence rates The following theore provides the second oent convergence rate according to Definition of the general stochastic iteration (6), (8) when the tie intervals t k+ t k are independent and identically distributed. Theore 9: Consider the stochastic iteration (6), (8) and suppose that the intervals t k+ t k are independent and identically distributed following a distribution ρ. Then, provided that the linear algorith converges in second oent to average consensus, the second oent convergence rate is given by the unique α that satisfies 0 e αt ρ(dt) = r () where r := r σ ( n p i= p ib i B i S). The proof uses siilar arguents to the ones provided for results for a class of syste known as ipulsive renewal systes [3], and is oitted due to space liitations. It is possible to prove that r is the convergence rate at which the discrete variable z k := x(t k ) converges in second oent to consensus, i.e., (zi k x av) r k(z0 i x av) i, for every coponent i of z. Thus, () relates the convergence rate in absolute-tie t with the convergence rate in discretetie k which denotes the nuber of transissions. If we specialize the Theore 9 to the two scenarios that we consider in the present paper, we obtain the following results. Corollary 0: For the gossip algorith G the second oent convergence rate is given by α = +r where r = r σ ( i= j N out(i) p ij Q ij Q ij S). Corollary : For the broadcast algorith B, the second oent convergence rate is given by the unique α > 0 such that 0 e αt µ(dt) = r where r = r σ ( i= R i R i S). C. Proof of Theore 7 Let R := E[U k ] = i= j N p out(i) ijq ij. Since E[z(t k+ )] = RE[z(t k )], we have that x(tk+ ) E[z(t k+ )] = E[ y(t k+ ) and therefore it suffices to prove that li k Rk = ]=R k z(0) = R k [ x(0) 0 0 ] (3)

6 fro which we conclude that li k E[x(t k+ )] = x av, x av = x(0). Fro (),[ (3) we] notice that we can R R partition R into blocks R = where each block is R 3 R 4 a linear cobination of the following three atrices X = p ij Λ j, Y = p ij Λ i, Z = i= j N out(i) i= j N out(i) i= j N out(i) p ij e j e i. (4) It is easy to see that Z = P = P (since we assue that P is syetric) and Y = I. Moreover, X = p ij Λ j = Λ j = I, j= i N in(j) j= where we used the fact that i N in(j) p ij =, due to the key assuption that P : P ij = p ij is a doubly stochastic atrix. Therefore, each R i is a linear cobination of the atrices P and I and we can write R = P I + P P. where for α = β = γ =, P = 3, P = [ ]. (5) We denote an eigenvalue of a atrix A by λ i (A) and the set of eigenvalues by {λ i (A)}. Let P S (δ) := P +δp. Then one can obtain that λ i (P S (δ)) = + δ ± δ, i {, }. (6) Let w Pi be the two eigenvector of P S (δ), and v Pj denote the eigenvectors of P (note that P is syetric and therefore it has eigenvectors). Then R has eigenvectors w Pi v Pj, since one can show that R(w Pi v Pj )=λ l (R)w Pi v Pj where the set of eigenvalues of R is given by {λ l (R), l } = {λ i (P S (η j )) : η j {λ j (P )}, i, j } (7) Since P is syetric and doubly stochastic, and it is a weighted adjacency atrix of a strongly connected and aperiodic graph, the eigenvalues of P are real, P has a siple eigenvalue at, and all the reaining eigenvalues belong to the set (, ). Corresponding to the siple eigenvalue of P, R has two eigenvalues at {λ i (P + P )} = {, /}. Corresponding to the eigenvalues of P that belong to the set (, ), the eigenvalues of R are inside the unit circle. This can be shown by noticing that (6) is a strictly increasing function when < δ < for each i and, using this fact, it is easy to conclude that r σ (P + δp ) < for < δ <. Thus R has a single eigenvalue at, all the reaining eigenvalues are inside the unit disk, and the [ ] vectors v R := and w 0 R := [ ] are left and right eigenvalues of R, respectively, associated with this eigenvalue. This iplies that li k R k = w Rv R v R w R, which is (3). V. CONCLUSIONS AND FUTURE WORK We addressed average consensus and randoized gossip algoriths with the constraint that only one node transits data at a given tie. Our ain result is to provide a linear distributed gossip algorith, that provably converges to consensus in expectation. Directions for future work include: (i) extending the results to the stronger stability notion of convergence in second oent; (ii) considering general digraphs, i.e., not requiring the counication topology to be syetric; (iii) optiizing the probability paraeters of the gossip algoriths with respect to soe quantity of interest as the speed of convergence to consensus. VI. ACKNOWLEDGMENTS The first author is grateful to João Aleida, for valuable coents and discussions. REFERENCES [] J. Tsitsiklis, D. Bertsekas, and M. Athans, Distributed asynchronous deterinistic and stochastic gradient optiization algoriths, Autoatic Control, IEEE Transactions on, vol. 3, no. 9, pp , Sep [] B. Johansson, T. Keviczky, M. Johansson, and K. Johansson, Subgradient ethods and consensus algoriths for solving convex optiization probles, in Decision and Control, 008. CDC th IEEE Conference on, 008, pp [3] A. Jadbabaie, J. Lin, and A. Morse, Coordination of groups of obile autonoous agents using nearest neighbor rules, in Decision and Control, 00, Proceedings of the 4st IEEE Conference on, vol. 3, 00, pp vol.3. [4] J. Cortes, S. Martinez, and F. Bullo, Robust rendezvous for obile autonoous agents via proxiity graphs in arbitrary diensions, Autoatic Control, IEEE Transactions on, vol. 5, no. 8, pp , 006. [5] M. Chiang, S. Low, A. Calderbank, and J. Doyle, Layering as optiization decoposition: A atheatical theory of network architectures, Proceedings of the IEEE, vol. 95, no., pp. 55 3, 007. [6] R. Olfati-Saber and R. Murray, Consensus probles in networks of agents with switching topology and tie-delays, Autoatic Control, IEEE Transactions on, vol. 49, no. 9, pp , 004. [7] F. Bullo, J. Cortés, and S. Martínez, Distributed Control of Robotic Networks, ser. Applied Matheatics Series. Princeton University Press, 009, electronically available at [8] S. Patterson, B. Baieh, and A. El Abbadi, Convergence rates of distributed average consensus with stochastic link failures, Autoatic Control, IEEE Transactions on, vol. 55, no. 4, pp , 00. [9] F. Fagnani and S. Zapieri, Average consensus with packet drop counication, SIAM J. Control Opti, no. 48, pp. 0 33, 009. [0] R. Carli, F. Bullo, and S. Zapieri, Quantized average consensus via dynaic coding/decoding schees, International Journal of Robust and Nonlinear Control, vol. 0, no., pp , 00. [Online]. Available: [] S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, Randoized gossip algoriths, Inforation Theory, IEEE Transactions on, vol. 5, no. 6, pp , 006. [] K. Cai and H. Ishii, Gossip consensus and averaging algoriths with quantization, in 00 Aerican Control Conference, 00, pp [3] D. Antunes, J. P. Hespanha, and C. Silvestre, Volterra integral approach to ipulsive renewal systes: Application to networked control, Nov. 00, subitted to journal publication.

Asynchronous Gossip Algorithms for Stochastic Optimization

Asynchronous Gossip Algorithms for Stochastic Optimization Asynchronous Gossip Algoriths for Stochastic Optiization S. Sundhar Ra ECE Dept. University of Illinois Urbana, IL 680 ssrini@illinois.edu A. Nedić IESE Dept. University of Illinois Urbana, IL 680 angelia@illinois.edu

More information

Multi-Dimensional Hegselmann-Krause Dynamics

Multi-Dimensional Hegselmann-Krause Dynamics Multi-Diensional Hegselann-Krause Dynaics A. Nedić Industrial and Enterprise Systes Engineering Dept. University of Illinois Urbana, IL 680 angelia@illinois.edu B. Touri Coordinated Science Laboratory

More information

Distributed Subgradient Methods for Multi-agent Optimization

Distributed Subgradient Methods for Multi-agent Optimization 1 Distributed Subgradient Methods for Multi-agent Optiization Angelia Nedić and Asuan Ozdaglar October 29, 2007 Abstract We study a distributed coputation odel for optiizing a su of convex objective functions

More information

13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices

13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices CS71 Randoness & Coputation Spring 018 Instructor: Alistair Sinclair Lecture 13: February 7 Disclaier: These notes have not been subjected to the usual scrutiny accorded to foral publications. They ay

More information

Feature Extraction Techniques

Feature Extraction Techniques Feature Extraction Techniques Unsupervised Learning II Feature Extraction Unsupervised ethods can also be used to find features which can be useful for categorization. There are unsupervised ethods that

More information

Constrained Consensus and Optimization in Multi-Agent Networks arxiv: v2 [math.oc] 17 Dec 2008

Constrained Consensus and Optimization in Multi-Agent Networks arxiv: v2 [math.oc] 17 Dec 2008 LIDS Report 2779 1 Constrained Consensus and Optiization in Multi-Agent Networks arxiv:0802.3922v2 [ath.oc] 17 Dec 2008 Angelia Nedić, Asuan Ozdaglar, and Pablo A. Parrilo February 15, 2013 Abstract We

More information

The Transactional Nature of Quantum Information

The Transactional Nature of Quantum Information The Transactional Nature of Quantu Inforation Subhash Kak Departent of Coputer Science Oklahoa State University Stillwater, OK 7478 ABSTRACT Inforation, in its counications sense, is a transactional property.

More information

Chapter 6 1-D Continuous Groups

Chapter 6 1-D Continuous Groups Chapter 6 1-D Continuous Groups Continuous groups consist of group eleents labelled by one or ore continuous variables, say a 1, a 2,, a r, where each variable has a well- defined range. This chapter explores:

More information

Solutions of some selected problems of Homework 4

Solutions of some selected problems of Homework 4 Solutions of soe selected probles of Hoework 4 Sangchul Lee May 7, 2018 Proble 1 Let there be light A professor has two light bulbs in his garage. When both are burned out, they are replaced, and the next

More information

Vulnerability of MRD-Code-Based Universal Secure Error-Correcting Network Codes under Time-Varying Jamming Links

Vulnerability of MRD-Code-Based Universal Secure Error-Correcting Network Codes under Time-Varying Jamming Links Vulnerability of MRD-Code-Based Universal Secure Error-Correcting Network Codes under Tie-Varying Jaing Links Jun Kurihara KDDI R&D Laboratories, Inc 2 5 Ohara, Fujiino, Saitaa, 356 8502 Japan Eail: kurihara@kddilabsjp

More information

Reed-Muller Codes. m r inductive definition. Later, we shall explain how to construct Reed-Muller codes using the Kronecker product.

Reed-Muller Codes. m r inductive definition. Later, we shall explain how to construct Reed-Muller codes using the Kronecker product. Coding Theory Massoud Malek Reed-Muller Codes An iportant class of linear block codes rich in algebraic and geoetric structure is the class of Reed-Muller codes, which includes the Extended Haing code.

More information

Using EM To Estimate A Probablity Density With A Mixture Of Gaussians

Using EM To Estimate A Probablity Density With A Mixture Of Gaussians Using EM To Estiate A Probablity Density With A Mixture Of Gaussians Aaron A. D Souza adsouza@usc.edu Introduction The proble we are trying to address in this note is siple. Given a set of data points

More information

Quantum algorithms (CO 781, Winter 2008) Prof. Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search

Quantum algorithms (CO 781, Winter 2008) Prof. Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search Quantu algoriths (CO 781, Winter 2008) Prof Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search ow we begin to discuss applications of quantu walks to search algoriths

More information

CSE525: Randomized Algorithms and Probabilistic Analysis May 16, Lecture 13

CSE525: Randomized Algorithms and Probabilistic Analysis May 16, Lecture 13 CSE55: Randoied Algoriths and obabilistic Analysis May 6, Lecture Lecturer: Anna Karlin Scribe: Noah Siegel, Jonathan Shi Rando walks and Markov chains This lecture discusses Markov chains, which capture

More information

Support Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization

Support Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization Recent Researches in Coputer Science Support Vector Machine Classification of Uncertain and Ibalanced data using Robust Optiization RAGHAV PAT, THEODORE B. TRAFALIS, KASH BARKER School of Industrial Engineering

More information

OPTIMIZATION in multi-agent networks has attracted

OPTIMIZATION in multi-agent networks has attracted Distributed constrained optiization and consensus in uncertain networks via proxial iniization Kostas Margellos, Alessandro Falsone, Sione Garatti and Maria Prandini arxiv:603.039v3 [ath.oc] 3 May 07 Abstract

More information

Convergence Rate for Consensus with Delays

Convergence Rate for Consensus with Delays Convergence Rate for Consensus with Delays Angelia Nedić and Asuman Ozdaglar October 8, 2007 Abstract We study the problem of reaching a consensus in the values of a distributed system of agents with time-varying

More information

Hybrid System Identification: An SDP Approach

Hybrid System Identification: An SDP Approach 49th IEEE Conference on Decision and Control Deceber 15-17, 2010 Hilton Atlanta Hotel, Atlanta, GA, USA Hybrid Syste Identification: An SDP Approach C Feng, C M Lagoa, N Ozay and M Sznaier Abstract The

More information

Block designs and statistics

Block designs and statistics Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent

More information

On Conditions for Linearity of Optimal Estimation

On Conditions for Linearity of Optimal Estimation On Conditions for Linearity of Optial Estiation Erah Akyol, Kuar Viswanatha and Kenneth Rose {eakyol, kuar, rose}@ece.ucsb.edu Departent of Electrical and Coputer Engineering University of California at

More information

A Low-Complexity Congestion Control and Scheduling Algorithm for Multihop Wireless Networks with Order-Optimal Per-Flow Delay

A Low-Complexity Congestion Control and Scheduling Algorithm for Multihop Wireless Networks with Order-Optimal Per-Flow Delay A Low-Coplexity Congestion Control and Scheduling Algorith for Multihop Wireless Networks with Order-Optial Per-Flow Delay Po-Kai Huang, Xiaojun Lin, and Chih-Chun Wang School of Electrical and Coputer

More information

Optimal Jamming Over Additive Noise: Vector Source-Channel Case

Optimal Jamming Over Additive Noise: Vector Source-Channel Case Fifty-first Annual Allerton Conference Allerton House, UIUC, Illinois, USA October 2-3, 2013 Optial Jaing Over Additive Noise: Vector Source-Channel Case Erah Akyol and Kenneth Rose Abstract This paper

More information

COS 424: Interacting with Data. Written Exercises

COS 424: Interacting with Data. Written Exercises COS 424: Interacting with Data Hoework #4 Spring 2007 Regression Due: Wednesday, April 18 Written Exercises See the course website for iportant inforation about collaboration and late policies, as well

More information

E0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis

E0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis E0 370 tatistical Learning Theory Lecture 6 (Aug 30, 20) Margin Analysis Lecturer: hivani Agarwal cribe: Narasihan R Introduction In the last few lectures we have seen how to obtain high confidence bounds

More information

On Quantized Consensus by Means of Gossip Algorithm Part I: Convergence Proof

On Quantized Consensus by Means of Gossip Algorithm Part I: Convergence Proof Submitted, 9 American Control Conference (ACC) http://www.cds.caltech.edu/~murray/papers/8q_lm9a-acc.html On Quantized Consensus by Means of Gossip Algorithm Part I: Convergence Proof Javad Lavaei and

More information

RECOVERY OF A DENSITY FROM THE EIGENVALUES OF A NONHOMOGENEOUS MEMBRANE

RECOVERY OF A DENSITY FROM THE EIGENVALUES OF A NONHOMOGENEOUS MEMBRANE Proceedings of ICIPE rd International Conference on Inverse Probles in Engineering: Theory and Practice June -8, 999, Port Ludlow, Washington, USA : RECOVERY OF A DENSITY FROM THE EIGENVALUES OF A NONHOMOGENEOUS

More information

Decentralized Adaptive Control of Nonlinear Systems Using Radial Basis Neural Networks

Decentralized Adaptive Control of Nonlinear Systems Using Radial Basis Neural Networks 050 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 44, NO., NOVEMBER 999 Decentralized Adaptive Control of Nonlinear Systes Using Radial Basis Neural Networks Jeffrey T. Spooner and Kevin M. Passino Abstract

More information

Physics 215 Winter The Density Matrix

Physics 215 Winter The Density Matrix Physics 215 Winter 2018 The Density Matrix The quantu space of states is a Hilbert space H. Any state vector ψ H is a pure state. Since any linear cobination of eleents of H are also an eleent of H, it

More information

Non-Parametric Non-Line-of-Sight Identification 1

Non-Parametric Non-Line-of-Sight Identification 1 Non-Paraetric Non-Line-of-Sight Identification Sinan Gezici, Hisashi Kobayashi and H. Vincent Poor Departent of Electrical Engineering School of Engineering and Applied Science Princeton University, Princeton,

More information

Uniform Approximation and Bernstein Polynomials with Coefficients in the Unit Interval

Uniform Approximation and Bernstein Polynomials with Coefficients in the Unit Interval Unifor Approxiation and Bernstein Polynoials with Coefficients in the Unit Interval Weiang Qian and Marc D. Riedel Electrical and Coputer Engineering, University of Minnesota 200 Union St. S.E. Minneapolis,

More information

Modeling Chemical Reactions with Single Reactant Specie

Modeling Chemical Reactions with Single Reactant Specie Modeling Cheical Reactions with Single Reactant Specie Abhyudai Singh and João edro Hespanha Abstract A procedure for constructing approxiate stochastic odels for cheical reactions involving a single reactant

More information

Polygonal Designs: Existence and Construction

Polygonal Designs: Existence and Construction Polygonal Designs: Existence and Construction John Hegean Departent of Matheatics, Stanford University, Stanford, CA 9405 Jeff Langford Departent of Matheatics, Drake University, Des Moines, IA 5011 G

More information

Lecture 21 Nov 18, 2015

Lecture 21 Nov 18, 2015 CS 388R: Randoized Algoriths Fall 05 Prof. Eric Price Lecture Nov 8, 05 Scribe: Chad Voegele, Arun Sai Overview In the last class, we defined the ters cut sparsifier and spectral sparsifier and introduced

More information

On the Communication Complexity of Lipschitzian Optimization for the Coordinated Model of Computation

On the Communication Complexity of Lipschitzian Optimization for the Coordinated Model of Computation journal of coplexity 6, 459473 (2000) doi:0.006jco.2000.0544, available online at http:www.idealibrary.co on On the Counication Coplexity of Lipschitzian Optiization for the Coordinated Model of Coputation

More information

Decentralised minimal-time consensus

Decentralised minimal-time consensus Decentralised inial-tie consensus Y Yuan, G-B Stan, M Barahona, L Shi and J Gonçalves Abstract This study considers the discrete-tie dynaics of a networ of agents that exchange inforation according to

More information

Algorithms for parallel processor scheduling with distinct due windows and unit-time jobs

Algorithms for parallel processor scheduling with distinct due windows and unit-time jobs BULLETIN OF THE POLISH ACADEMY OF SCIENCES TECHNICAL SCIENCES Vol. 57, No. 3, 2009 Algoriths for parallel processor scheduling with distinct due windows and unit-tie obs A. JANIAK 1, W.A. JANIAK 2, and

More information

Cooperative Load Transport Using Multiple Quadrotors

Cooperative Load Transport Using Multiple Quadrotors Cooperative Load Transport Using Multiple Quadrotors Behzad Shirani 1, Majdeddin Najafi #2, Ian Izadi 3 Electrical & Coputer engineering Departent, Isfahan University of Technology, Isfahan, IRAN 1 b.shirani@ec.iut.ac.ir

More information

Supplementary Material for Fast and Provable Algorithms for Spectrally Sparse Signal Reconstruction via Low-Rank Hankel Matrix Completion

Supplementary Material for Fast and Provable Algorithms for Spectrally Sparse Signal Reconstruction via Low-Rank Hankel Matrix Completion Suppleentary Material for Fast and Provable Algoriths for Spectrally Sparse Signal Reconstruction via Low-Ran Hanel Matrix Copletion Jian-Feng Cai Tianing Wang Ke Wei March 1, 017 Abstract We establish

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fitting of Data David Eberly, Geoetric Tools, Redond WA 98052 https://www.geoetrictools.co/ This work is licensed under the Creative Coons Attribution 4.0 International License. To view a

More information

Chaotic Coupled Map Lattices

Chaotic Coupled Map Lattices Chaotic Coupled Map Lattices Author: Dustin Keys Advisors: Dr. Robert Indik, Dr. Kevin Lin 1 Introduction When a syste of chaotic aps is coupled in a way that allows the to share inforation about each

More information

e-companion ONLY AVAILABLE IN ELECTRONIC FORM

e-companion ONLY AVAILABLE IN ELECTRONIC FORM OPERATIONS RESEARCH doi 10.1287/opre.1070.0427ec pp. ec1 ec5 e-copanion ONLY AVAILABLE IN ELECTRONIC FORM infors 07 INFORMS Electronic Copanion A Learning Approach for Interactive Marketing to a Custoer

More information

Distributed Lossy Averaging

Distributed Lossy Averaging Distribute Lossy Averaging Han-I Su Departent of Electrical Engineering Stanfor University Stanfor, CA 94305, USA Eail: hanisu@stanforeu Abbas El Gaal Departent of Electrical Engineering Stanfor University

More information

STABILITY RESULTS FOR CONTINUOUS AND DISCRETE TIME LINEAR PARAMETER VARYING SYSTEMS

STABILITY RESULTS FOR CONTINUOUS AND DISCRETE TIME LINEAR PARAMETER VARYING SYSTEMS STABILITY RESULTS FOR CONTINUOUS AND DISCRETE TIME LINEAR PARAMETER VARYING SYSTEMS Franco Blanchini Stefano Miani Carlo Savorgnan,1 DIMI, Università degli Studi di Udine, Via delle Scienze 208, 33100

More information

CS Lecture 13. More Maximum Likelihood

CS Lecture 13. More Maximum Likelihood CS 6347 Lecture 13 More Maxiu Likelihood Recap Last tie: Introduction to axiu likelihood estiation MLE for Bayesian networks Optial CPTs correspond to epirical counts Today: MLE for CRFs 2 Maxiu Likelihood

More information

Exact tensor completion with sum-of-squares

Exact tensor completion with sum-of-squares Proceedings of Machine Learning Research vol 65:1 54, 2017 30th Annual Conference on Learning Theory Exact tensor copletion with su-of-squares Aaron Potechin Institute for Advanced Study, Princeton David

More information

This model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t.

This model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t. CS 493: Algoriths for Massive Data Sets Feb 2, 2002 Local Models, Bloo Filter Scribe: Qin Lv Local Models In global odels, every inverted file entry is copressed with the sae odel. This work wells when

More information

On Quantized Consensus by Means of Gossip Algorithm Part II: Convergence Time

On Quantized Consensus by Means of Gossip Algorithm Part II: Convergence Time Submitted, 009 American Control Conference (ACC) http://www.cds.caltech.edu/~murray/papers/008q_lm09b-acc.html On Quantized Consensus by Means of Gossip Algorithm Part II: Convergence Time Javad Lavaei

More information

Revisiting the performance of the modular clock algorithm for distributed blind rendezvous in cognitive radio networks

Revisiting the performance of the modular clock algorithm for distributed blind rendezvous in cognitive radio networks Revisiting the perforance of the odular clock algorith for distributed blind rendezvous in cognitive radio networks Michel Barbeau, Gier Cervera, Joaquin Garcia-Alfaro, Evangelos Kranakis To cite this

More information

Asymmetric Randomized Gossip Algorithms for Consensus

Asymmetric Randomized Gossip Algorithms for Consensus Asymmetric Randomized Gossip Algorithms for Consensus F. Fagnani S. Zampieri Dipartimento di Matematica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, 10129 Torino, Italy, (email: fabio.fagnani@polito.it).

More information

A note on the multiplication of sparse matrices

A note on the multiplication of sparse matrices Cent. Eur. J. Cop. Sci. 41) 2014 1-11 DOI: 10.2478/s13537-014-0201-x Central European Journal of Coputer Science A note on the ultiplication of sparse atrices Research Article Keivan Borna 12, Sohrab Aboozarkhani

More information

Qualitative Modelling of Time Series Using Self-Organizing Maps: Application to Animal Science

Qualitative Modelling of Time Series Using Self-Organizing Maps: Application to Animal Science Proceedings of the 6th WSEAS International Conference on Applied Coputer Science, Tenerife, Canary Islands, Spain, Deceber 16-18, 2006 183 Qualitative Modelling of Tie Series Using Self-Organizing Maps:

More information

A Note to Robustness Analysis of the Hybrid Consensus Protocols

A Note to Robustness Analysis of the Hybrid Consensus Protocols American Control Conference on O'Farrell Street, San Francisco, CA, USA June 9 - July, A Note to Robustness Analysis of the Hybrid Consensus Protocols Haopeng Zhang, Sean R Mullen, and Qing Hui Abstract

More information

arxiv: v3 [cs.sy] 29 Dec 2014

arxiv: v3 [cs.sy] 29 Dec 2014 A QUADRATIC LOWER BOUND FOR THE CONVERGENCE RATE IN THE ONE-DIMENSIONAL HEGSELMANN-KRAUSE BOUNDED CONFIDENCE DYNAMICS EDVIN WEDIN AND PETER HEGARTY Abstract. Let f k n) be the axiu nuber of tie steps taken

More information

A new type of lower bound for the largest eigenvalue of a symmetric matrix

A new type of lower bound for the largest eigenvalue of a symmetric matrix Linear Algebra and its Applications 47 7 9 9 www.elsevier.co/locate/laa A new type of lower bound for the largest eigenvalue of a syetric atrix Piet Van Mieghe Delft University of Technology, P.O. Box

More information

In this chapter, we consider several graph-theoretic and probabilistic models

In this chapter, we consider several graph-theoretic and probabilistic models THREE ONE GRAPH-THEORETIC AND STATISTICAL MODELS 3.1 INTRODUCTION In this chapter, we consider several graph-theoretic and probabilistic odels for a social network, which we do under different assuptions

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE227C (Spring 2018): Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee227c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee227c@berkeley.edu October

More information

ON THE TWO-LEVEL PRECONDITIONING IN LEAST SQUARES METHOD

ON THE TWO-LEVEL PRECONDITIONING IN LEAST SQUARES METHOD PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY Physical and Matheatical Sciences 04,, p. 7 5 ON THE TWO-LEVEL PRECONDITIONING IN LEAST SQUARES METHOD M a t h e a t i c s Yu. A. HAKOPIAN, R. Z. HOVHANNISYAN

More information

Data Dependent Convergence For Consensus Stochastic Optimization

Data Dependent Convergence For Consensus Stochastic Optimization Data Dependent Convergence For Consensus Stochastic Optiization Avleen S. Bijral, Anand D. Sarwate, Nathan Srebro Septeber 8, 08 arxiv:603.04379v ath.oc] Sep 06 Abstract We study a distributed consensus-based

More information

Monochromatic images

Monochromatic images CHAPTER 8 Monochroatic iages 1 The Central Sets Theore Lea 11 Let S,+) be a seigroup, e be an idepotent of βs and A e There is a set B A in e such that, for each v B, there is a set C A in e with v+c A

More information

Bipartite subgraphs and the smallest eigenvalue

Bipartite subgraphs and the smallest eigenvalue Bipartite subgraphs and the sallest eigenvalue Noga Alon Benny Sudaov Abstract Two results dealing with the relation between the sallest eigenvalue of a graph and its bipartite subgraphs are obtained.

More information

Estimating Parameters for a Gaussian pdf

Estimating Parameters for a Gaussian pdf Pattern Recognition and achine Learning Jaes L. Crowley ENSIAG 3 IS First Seester 00/0 Lesson 5 7 Noveber 00 Contents Estiating Paraeters for a Gaussian pdf Notation... The Pattern Recognition Proble...3

More information

Mechanics Physics 151

Mechanics Physics 151 Mechanics Physics 5 Lecture Oscillations (Chapter 6) What We Did Last Tie Analyzed the otion of a heavy top Reduced into -diensional proble of θ Qualitative behavior Precession + nutation Initial condition

More information

Generalized AOR Method for Solving System of Linear Equations. Davod Khojasteh Salkuyeh. Department of Mathematics, University of Mohaghegh Ardabili,

Generalized AOR Method for Solving System of Linear Equations. Davod Khojasteh Salkuyeh. Department of Mathematics, University of Mohaghegh Ardabili, Australian Journal of Basic and Applied Sciences, 5(3): 35-358, 20 ISSN 99-878 Generalized AOR Method for Solving Syste of Linear Equations Davod Khojasteh Salkuyeh Departent of Matheatics, University

More information

Physically Based Modeling CS Notes Spring 1997 Particle Collision and Contact

Physically Based Modeling CS Notes Spring 1997 Particle Collision and Contact Physically Based Modeling CS 15-863 Notes Spring 1997 Particle Collision and Contact 1 Collisions with Springs Suppose we wanted to ipleent a particle siulator with a floor : a solid horizontal plane which

More information

Quantized Average Consensus on Gossip Digraphs

Quantized Average Consensus on Gossip Digraphs Quantized Average Consensus on Gossip Digraphs Hideaki Ishii Tokyo Institute of Technology Joint work with Kai Cai Workshop on Uncertain Dynamical Systems Udine, Italy August 25th, 2011 Multi-Agent Consensus

More information

Prediction by random-walk perturbation

Prediction by random-walk perturbation Prediction by rando-walk perturbation Luc Devroye School of Coputer Science McGill University Gábor Lugosi ICREA and Departent of Econoics Universitat Popeu Fabra lucdevroye@gail.co gabor.lugosi@gail.co

More information

Average-Consensus of Multi-Agent Systems with Direct Topology Based on Event-Triggered Control

Average-Consensus of Multi-Agent Systems with Direct Topology Based on Event-Triggered Control Outline Background Preliminaries Consensus Numerical simulations Conclusions Average-Consensus of Multi-Agent Systems with Direct Topology Based on Event-Triggered Control Email: lzhx@nankai.edu.cn, chenzq@nankai.edu.cn

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE7C (Spring 018: Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee7c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee7c@berkeley.edu October 15,

More information

A Simplified Analytical Approach for Efficiency Evaluation of the Weaving Machines with Automatic Filling Repair

A Simplified Analytical Approach for Efficiency Evaluation of the Weaving Machines with Automatic Filling Repair Proceedings of the 6th SEAS International Conference on Siulation, Modelling and Optiization, Lisbon, Portugal, Septeber -4, 006 0 A Siplified Analytical Approach for Efficiency Evaluation of the eaving

More information

Content-Type Coding. arxiv: v2 [cs.it] 3 Jun Linqi Song UCLA

Content-Type Coding. arxiv: v2 [cs.it] 3 Jun Linqi Song UCLA Content-Type Coding Linqi Song UCLA Eail: songlinqi@ucla.edu Christina Fragouli UCLA and EPFL Eail: christina.fragouli@ucla.edu arxiv:1505.03561v [cs.it] 3 Jun 015 Abstract This paper is otivated by the

More information

Research Article On the Isolated Vertices and Connectivity in Random Intersection Graphs

Research Article On the Isolated Vertices and Connectivity in Random Intersection Graphs International Cobinatorics Volue 2011, Article ID 872703, 9 pages doi:10.1155/2011/872703 Research Article On the Isolated Vertices and Connectivity in Rando Intersection Graphs Yilun Shang Institute for

More information

Passive Decomposition Approach to Formation and Maneuver Control of Multiple Rigid Bodies

Passive Decomposition Approach to Formation and Maneuver Control of Multiple Rigid Bodies Dongjun Lee Departent of Mechanical, Aerospace and Bioedical Engineering, University of Tennessee at Knoxville, 502 Dougherty Hall, 1512 Middle Drive, Knoxville, TN 37996 e-ail: djlee@utk.edu Perry Y.

More information

Stabilization on A Class of Networked Control Systems with Random Communication Delay

Stabilization on A Class of Networked Control Systems with Random Communication Delay Milano (Italy) August 8 - Septeber, Stabilization on A Class of Networked Control Systes with Rando Counication Delay Tao Sun, Hongye Su, Zhengguang Wu State Key Laboratory of Industrial Control Technology,

More information

3.8 Three Types of Convergence

3.8 Three Types of Convergence 3.8 Three Types of Convergence 3.8 Three Types of Convergence 93 Suppose that we are given a sequence functions {f k } k N on a set X and another function f on X. What does it ean for f k to converge to

More information

Model Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon

Model Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon Model Fitting CURM Background Material, Fall 014 Dr. Doreen De Leon 1 Introduction Given a set of data points, we often want to fit a selected odel or type to the data (e.g., we suspect an exponential

More information

Distributed Optimization over Networks Gossip-Based Algorithms

Distributed Optimization over Networks Gossip-Based Algorithms Distributed Optimization over Networks Gossip-Based Algorithms Angelia Nedić angelia@illinois.edu ISE Department and Coordinated Science Laboratory University of Illinois at Urbana-Champaign Outline Random

More information

arxiv: v1 [cs.ds] 17 Mar 2016

arxiv: v1 [cs.ds] 17 Mar 2016 Tight Bounds for Single-Pass Streaing Coplexity of the Set Cover Proble Sepehr Assadi Sanjeev Khanna Yang Li Abstract arxiv:1603.05715v1 [cs.ds] 17 Mar 2016 We resolve the space coplexity of single-pass

More information

Complex Laplacians and Applications in Multi-Agent Systems

Complex Laplacians and Applications in Multi-Agent Systems 1 Complex Laplacians and Applications in Multi-Agent Systems Jiu-Gang Dong, and Li Qiu, Fellow, IEEE arxiv:1406.186v [math.oc] 14 Apr 015 Abstract Complex-valued Laplacians have been shown to be powerful

More information

TOWARDS THE GEOMETRIC REDUCTION OF CONTROLLED THREE-DIMENSIONAL BIPEDAL ROBOTIC WALKERS 1

TOWARDS THE GEOMETRIC REDUCTION OF CONTROLLED THREE-DIMENSIONAL BIPEDAL ROBOTIC WALKERS 1 TOWARDS THE GEOMETRIC REDUCTION OF CONTROLLED THREE-DIMENSIONAL BIPEDAL ROBOTIC WALKERS 1 Aaron D. Aes, 2 Robert D. Gregg, Eric D.B. Wendel and Shankar Sastry Departent of Electrical Engineering and Coputer

More information

arxiv: v2 [math.co] 3 Dec 2008

arxiv: v2 [math.co] 3 Dec 2008 arxiv:0805.2814v2 [ath.co] 3 Dec 2008 Connectivity of the Unifor Rando Intersection Graph Sion R. Blacburn and Stefanie Gere Departent of Matheatics Royal Holloway, University of London Egha, Surrey TW20

More information

Interactive Markov Models of Evolutionary Algorithms

Interactive Markov Models of Evolutionary Algorithms Cleveland State University EngagedScholarship@CSU Electrical Engineering & Coputer Science Faculty Publications Electrical Engineering & Coputer Science Departent 2015 Interactive Markov Models of Evolutionary

More information

A NOVEL FOR EXPONENTIAL STABILITY OF LINEAR SYSTEMS WITH MULTIPLE TIME-VARYING DELAYS

A NOVEL FOR EXPONENTIAL STABILITY OF LINEAR SYSTEMS WITH MULTIPLE TIME-VARYING DELAYS International Journal of Pure and Applied Matheatics Volue 96 No. 4 2014, 529-538 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpa.eu doi: http://dx.doi.org/10.12732/ijpa.v96i4.8

More information

Gary J. Balas Aerospace Engineering and Mechanics, University of Minnesota, Minneapolis, MN USA

Gary J. Balas Aerospace Engineering and Mechanics, University of Minnesota, Minneapolis, MN USA μ-synthesis Gary J. Balas Aerospace Engineering and Mechanics, University of Minnesota, Minneapolis, MN 55455 USA Keywords: Robust control, ultivariable control, linear fractional transforation (LFT),

More information

Tight Bounds for Maximal Identifiability of Failure Nodes in Boolean Network Tomography

Tight Bounds for Maximal Identifiability of Failure Nodes in Boolean Network Tomography Tight Bounds for axial Identifiability of Failure Nodes in Boolean Network Toography Nicola Galesi Sapienza Università di Roa nicola.galesi@uniroa1.it Fariba Ranjbar Sapienza Università di Roa fariba.ranjbar@uniroa1.it

More information

Intelligent Systems: Reasoning and Recognition. Artificial Neural Networks

Intelligent Systems: Reasoning and Recognition. Artificial Neural Networks Intelligent Systes: Reasoning and Recognition Jaes L. Crowley MOSIG M1 Winter Seester 2018 Lesson 7 1 March 2018 Outline Artificial Neural Networks Notation...2 Introduction...3 Key Equations... 3 Artificial

More information

Complex Quadratic Optimization and Semidefinite Programming

Complex Quadratic Optimization and Semidefinite Programming Coplex Quadratic Optiization and Seidefinite Prograing Shuzhong Zhang Yongwei Huang August 4 Abstract In this paper we study the approxiation algoriths for a class of discrete quadratic optiization probles

More information

Pattern Recognition and Machine Learning. Artificial Neural networks

Pattern Recognition and Machine Learning. Artificial Neural networks Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2016 Lessons 7 14 Dec 2016 Outline Artificial Neural networks Notation...2 1. Introduction...3... 3 The Artificial

More information

LONG-TERM PREDICTIVE VALUE INTERVAL WITH THE FUZZY TIME SERIES

LONG-TERM PREDICTIVE VALUE INTERVAL WITH THE FUZZY TIME SERIES Journal of Marine Science and Technology, Vol 19, No 5, pp 509-513 (2011) 509 LONG-TERM PREDICTIVE VALUE INTERVAL WITH THE FUZZY TIME SERIES Ming-Tao Chou* Key words: fuzzy tie series, fuzzy forecasting,

More information

Soft Computing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis

Soft Computing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis Soft Coputing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis Beverly Rivera 1,2, Irbis Gallegos 1, and Vladik Kreinovich 2 1 Regional Cyber and Energy Security Center RCES

More information

Study on Markov Alternative Renewal Reward. Process for VLSI Cell Partitioning

Study on Markov Alternative Renewal Reward. Process for VLSI Cell Partitioning Int. Journal of Math. Analysis, Vol. 7, 2013, no. 40, 1949-1960 HIKARI Ltd, www.-hikari.co http://dx.doi.org/10.12988/ia.2013.36142 Study on Markov Alternative Renewal Reward Process for VLSI Cell Partitioning

More information

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION Vol. IX Uncertainty Models For Robustness Analysis - A. Garulli, A. Tesi and A. Vicino

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION Vol. IX Uncertainty Models For Robustness Analysis - A. Garulli, A. Tesi and A. Vicino UNCERTAINTY MODELS FOR ROBUSTNESS ANALYSIS A. Garulli Dipartiento di Ingegneria dell Inforazione, Università di Siena, Italy A. Tesi Dipartiento di Sistei e Inforatica, Università di Firenze, Italy A.

More information

Ch 12: Variations on Backpropagation

Ch 12: Variations on Backpropagation Ch 2: Variations on Backpropagation The basic backpropagation algorith is too slow for ost practical applications. It ay take days or weeks of coputer tie. We deonstrate why the backpropagation algorith

More information

Stochastic Subgradient Methods

Stochastic Subgradient Methods Stochastic Subgradient Methods Lingjie Weng Yutian Chen Bren School of Inforation and Coputer Science University of California, Irvine {wengl, yutianc}@ics.uci.edu Abstract Stochastic subgradient ethods

More information

Page 1 Lab 1 Elementary Matrix and Linear Algebra Spring 2011

Page 1 Lab 1 Elementary Matrix and Linear Algebra Spring 2011 Page Lab Eleentary Matri and Linear Algebra Spring 0 Nae Due /03/0 Score /5 Probles through 4 are each worth 4 points.. Go to the Linear Algebra oolkit site ransforing a atri to reduced row echelon for

More information

An incremental mirror descent subgradient algorithm with random sweeping and proximal step

An incremental mirror descent subgradient algorithm with random sweeping and proximal step An increental irror descent subgradient algorith with rando sweeping and proxial step Radu Ioan Boţ Axel Böh Septeber 7, 07 Abstract We investigate the convergence properties of increental irror descent

More information

c 2010 Society for Industrial and Applied Mathematics

c 2010 Society for Industrial and Applied Mathematics SIAM J MATRIX ANAL APPL Vol 31, No 4, pp 1848 1872 c 21 Society for Industrial and Applied Matheatics STOCHASTIC GALERKIN MATRICES OLIVER G ERNST AND ELISABETH ULLMANN Abstract We investigate the structural,

More information

A note on the realignment criterion

A note on the realignment criterion A note on the realignent criterion Chi-Kwong Li 1, Yiu-Tung Poon and Nung-Sing Sze 3 1 Departent of Matheatics, College of Willia & Mary, Williasburg, VA 3185, USA Departent of Matheatics, Iowa State University,

More information

Lower Bounds for Quantized Matrix Completion

Lower Bounds for Quantized Matrix Completion Lower Bounds for Quantized Matrix Copletion Mary Wootters and Yaniv Plan Departent of Matheatics University of Michigan Ann Arbor, MI Eail: wootters, yplan}@uich.edu Mark A. Davenport School of Elec. &

More information

Graphical Models in Local, Asymmetric Multi-Agent Markov Decision Processes

Graphical Models in Local, Asymmetric Multi-Agent Markov Decision Processes Graphical Models in Local, Asyetric Multi-Agent Markov Decision Processes Ditri Dolgov and Edund Durfee Departent of Electrical Engineering and Coputer Science University of Michigan Ann Arbor, MI 48109

More information

MSEC MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL SOLUTION FOR MAINTENANCE AND PERFORMANCE

MSEC MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL SOLUTION FOR MAINTENANCE AND PERFORMANCE Proceeding of the ASME 9 International Manufacturing Science and Engineering Conference MSEC9 October 4-7, 9, West Lafayette, Indiana, USA MSEC9-8466 MODELING OF DEGRADATION PROCESSES TO OBTAIN AN OPTIMAL

More information