How to Stop Consensus Algorithms, locally?

Size: px
Start display at page:

Download "How to Stop Consensus Algorithms, locally?"

Transcription

1 1 How to Stop Consensus Algorthms, locally? Pe Xe, Keyou You and Cheng Wu arxv: v1 [cs.dc] 15 Mar 2017 Abstract Ths paper studes problems on locally stoppng dstrbuted consensus algorthms over networks where each node updates ts state by nteractng wth ts neghbors and decdes by tself whether certan level of agreement has been acheved among nodes. Snce an ndvdual node s unable to access the states of those beyond ts neghbors, ths problem becomes challengng. In ths work, we frst defne the stoppng problem for generc dstrbuted algorthms. Then, a dstrbuted algorthm s explctly provded for each node to stop consensus updatng by explorng the relatonshp between the so-called local and global consensus. Fnally, we show both n theory and smulaton that ts effectveness depends both on the network sze and the structure. Index Terms dstrbuted algorthms, strongly connected graphs, local stoppng, consensus. I. INTRODUCTION Ths work proposes local stoppng rules for dstrbuted algorthms wth a network of computng nodes, and each node updates ts states by only nteractng wth neghbors. Due to the advantages of cooperaton among nodes, they have been wdely used n many areas, ncludng dstrbuted localzaton [1], cogntve networks [2], cooperatve control of unmanned ar vehcles (UVAs) [3], flockng [4], and socal networks [5]. Snce optmalty of many dstrbuted algorthms s attaned n an asymptotc sense, t s crtcal for each node of the algorthm to decde by tself when to stop updatng, whch to the best of our knowledge, has not be well studed n the lterature. Ths problem s substantally dfferent from that of a centralzed algorthm as t lacks a centralzed coordnator to montor the network. Most of exstng stoppng rules are based on that each node wll stop updatng after an adequately large number of teratons. Clearly, ths dea s very easy to mplement, but also suffers several lmtatons. Frstly, the number of teratons depends on qute a few factors, e.g., the network topology, the ntal network state, and the convergence rate of dstrbuted algorthms, all of whch essentally requre global nformaton of the system. For nstance, the convergence rate of the celebrated consensus algorthm s quantfed by the algebrac connectvty of the nteracton graph and the ntal network state, both of whch are dffcult to evaluate n a dstrbuted way and also requre much more computatonal and communcaton overheads. Secondly, the teraton number s always derved from the worst-case pont of vew, and ts conservatveness s case-by-case dependent, whch s unable to evaluate. The last but not the least, the number of teratons Ths work was supported by the Natonal Natural Scence Foundaton of Chna ( ), and Tsnghua Unversty Intatve Scentfc Research Program. P. Xe, K. You, and C. Wu are wth the Department of Automaton and TNLst, Tsnghua Unversty, , Chna (emals: xep13@mals.tsnghua.edu.cn, {youky, wuc}@tsnghua.edu.cn). s mpossble to obtan n advance for tme-varyng networks, especally for stochastcally tme-varyng networks due to the causalty ssue. In ths work, we formally defne the local stoppng problem of a dstrbuted algorthm over networks under the followng constrants: () each node s only able to access nformaton from ts neghbors. Ths enables the rule scalable wth the network sze. () To save storage capacty, t s not allowed for nodes to store large data, e.g., the hstorcal state nformaton. () the rule can be easly checked by an ndvdual node, and (v) the communcaton overhead to support the rule s as small as possble. Then, we propose a fully dstrbuted stoppng scheme for general dstrbuted algorthms by allowng each ndvdual node n the network to mantan a vector, whch s updated teratvely by usng nformaton from ts n-neghbors to gradually learn the network. Each node wll stop updatng based on ths auxlary vector. For dstrbuted consensus algorthms, the earlest concern about ths topc has been addressed n [6], whch requres the nodes to smultaneously run mnmum and maxmum protocols along wth the consensus protocol, and both the maxmum and mnmum protocols are re-ntalzed per D- teratons where D s the dameter of the graph. The drawback of the method s that t requres to communcate three dfferent states of the same dmenson at each tme slot. Ths ncreases the communcaton burden, especally when the state of a node s a mult-dmensonal vector. Moreover, the synchronzaton problem n re-ntalzng the mnmum and maxmum protocols remans dffcult n practce. To overcome these ssues, an adaptve stoppng-recallng mechansm s desgned n [7] to stop the push-sum consensus algorthm n fnte tme. The method permts the nactve nodes to recover transmttng agan, but the problem s that a node never know whether t wll reactvate or not even though the whole network has reached consensus, and has to awat orders all the tme. In fact, ths paper combnes the advantages of the above two methods. We adopt the dea of mnmum-consensus [8] to check the unformly local consensus to verfy the global consensus. Dfferent from that n [6], our method needs not to reset mnmum-consensus protocol, and the state of the mnmum consensus s a dscrete-valued scalar even f each node mantans a vector state. To evaluate the performance of our method, we characterze the extra tme that the nodes spend to locally detect the global consensus. An outlne of ths paper s as follows. In Secton II, we propose the local stoppng problem n dstrbuted algorthms. In Secton III, a partcular local stoppng rule for the consensus algorthm s desgned. In Secton IV, we analyze the senstvty of the method. Fnally, some concludng remarks are drawn n Secton V.

2 2 Notaton: Consder a drected graph (dgraph) G = (V, E), where V s the set of nodes and E s the set of drected edges (, j) wth, j V. For node V, ts n-neghbors and out-neghbors are respectvely defned by N := {j V (, j) E} and N + := {j V (j, ) E}. For two nodes 1, j V, the drected path from j to 1 s defned by {( 1, 2 ),..., ( j 1, j )} wth ( k, k+1 ) E for k [1, j 1]. We denote d j as the dstance from j to,.e., the length of the shortest path from j to. The dgraph s sad to contan a spannng tree f t has a root node that s connected to any other node n the graph va a drected path, and s strongly connected f each node s connected to every other node n the graph va a drected path. The dameter of the strongly connected dgraph G s defned by D = max,j V d j. Fnally, we denote x A {x A}. II. LOCAL STOPPING SCHEME FOR NETWORKED DISTRIBUTED ALGORITHMS A. Dstrbuted Algorthms Let x (k) be the state of node at tme slot k n a fxed graph 1 G = {V, E}. We are concerned wth dstrbuted algorthms of the followng form x (k + 1) = h (x N {}(k), k), (1) where h (, k) s a functon of x (k) and x N (k), both of whch are drectly known to node at tme slot k. In dfferent applcatons, h (, k) may take dfferent forms. Clearly, the update law n (1) s very generc, and contans a lot of mportant algorthms. Here we present three nterestng applcatons for an llustraton. Example 1 (Consensus algorthm). In dscrete consensus algorthms [9], h (, k) s smply a convex combnaton of x and x N,.e., x (k + 1) = α j x j (k), (2) j N {} where α j > 0 f and only f j N {}, and zero, otherwse. Moreover, j N {} α j = 1. Then, the network state asymptotcally converges to consensus (.e., lm k x (k) x j (k) = 0) f and only f G contans a spannng tree [10]. Example 2 (Opnon dynamcs). In Fredkn-Johnsen model of opnons evoluton [11], the state of node s updated as x (k + 1) = ω α j x j (k) + (1 ω )x (0), (3) j N {} where 0 ω 1 represents the couplng condton and x (0) s referred to as the node prejudce. Under certan condtons, the network state asymptotcally converges [11]. Example 3 (Dstrbuted gradent descend). The am of the dstrbuted gradent descend (DGD) s to solve the followng optmzaton problem mn V 1 It can be easly extended to tme-varyng graphs. f (x), (4) where f ( ) s a convex functon only known by node. In the DGD algorthm, h ( ) s gven as follows x (k + 1) = α j x j (k) ζ(k) d (k), (5) j N {} where ζ(k) s a sequence of approprately selected stepszes, d (k) s a (sub)-gradent of f at x (k) and α j s gven as n (2). By [12], t follows that f G s balanced and strongly connected, the state of each node asymptotcally converges to some common optmal pont of the optmzaton problem (4). In the above mportant applcatons, the convergence of the network state s shown n the asymptotc sense. Then, a natural queston s when to stop updatng (1) for an ndvdual node to acheve a desred level of optmalty? If there were a central authorty to montor the network state, the problem s obvously trval. However, n dstrbuted algorthms over networks, an ndvdual node s unable to drectly observe the whole network state, whch s qute dfferent from the centralzed algorthms, and the local stoppng problem requres further nvestgaton. A nave dea s that the node can smply stop updatng (1) after a suffcently large number of teratons. Indeed, ths s very easy to mplement. However, to ensure a desred qualty of the node state, the number of teratons usually depends on qute a few factors, most of whch are global nformaton of the system. Take the consensus algorthm n (2) as an example. Let d(k) = max,j V { x (k) x j (k) }, t follows from [9] that d(k) cρ k d(0) where c > 0 s postve and ndependent of network. The decayng rate ρ s the second largest egenvalue for a symmetrc stochastc matrx A = (α j ), and strctly less than one f the undrected graph G s connected. To ensure d(k) ɛ, the number of teratons s usually set to satsfy that k log ɛ/(cd(0)). (6) log ρ Clearly, d(0) and ρ n the lower bound respectvely depend on the ntal network state and the network structure, both of whch are unavalable to any ndvdual node. One may argue that d(0) can be obtaned by usng dstrbuted maxmumand mnmum-consensus algorthms. However, dstrbutedly estmatng ρ s nontrval [13] and agan requres an addtonal local stoppng rule. More mportantly, the lower bound s only obtanable for fxed graphs, and there does not exst such a ρ for tme-varyng graphs. Another dea s to use fast communcatons between the tme slots k and k + 1 to dstrbutedly evaluate d(k). Although ths s possble wth a fnte number of communcatons, t certanly ncreases the communcaton overhead, and even offset the beneft of dstrbuted algorthms. Overall, the problem of desgnng effectve rules to locally stop dstrbuted algorthms n (1) largely remans open, whch s the focus of ths work. B. Local Stoppng Scheme We are nterested n desgnng local stoppng rules of the followng form s (k + 1) = Q (x N {}(k), s N {}(k)), (7)

3 3 where s (k) s embeded n node to montor teratons of dstrbuted algorthms of (1). If a gven performance of (1) s acheved,.e., there exsts a performance dependent functon J ( ) such that J (s (k)) 0, (8) then node stops updatng and wll no longer broadcast any nformaton to ts out-neghbors. Clearly, s (k) can be dstrbutedly mplemented as n (1), and synchronze wth the orgnal dstrbuted algorthm, see Fg. 1 for an llustraton of mplementng a local stoppng rule n node h8.9! h8.9!! " ($)! " ($ + 1)! " ($ + 2) Observer Observer Judger Fg. 1. Local stoppng rule n node.! 0 ($), 1 0 ($)! 0 ($ + 1), 1 0 ($ + 1) Judger )(! " ) 0,!-./ )(! " ) 0,!-./ Snce s (k) needs to be broadcast, the extra communcaton overhead s now decded by s (k). The number of bts to represent s (k) should be as small as possble. Whle to ensure fast detecton, t s hghly desrable to easly compute both Q ( ) and J ( ). Usually, the more nformaton we obtan from the network topology, the smper form of these two functons are. Moreover, the stoppng rule of (7) and (8) needs to be senstve, meanng that t s able to quckly detect the attanablty of the performance qualty of dstrbuted algorthms. In the sequel, we desgn a local stoppng rule of the form (7) and (8) for the dstrbuted consensus algorthm n (2). The case of generc dstrbuted algorthms wll be studed n the full verson of ths work. III. LOCAL STOPPING RULES FOR CONSENSUS A. Notons of ɛ-consensus ALGORITHMS Obvously, the consensus algorthm n (2) can be wrtten n the followng matrx form x(k + 1) = Ax(k), (9) where A = (α j ) R N N s row stochastc. It follows from Gershgorn s dsc theorem [14] that A k 1 N v T wth 1 T N v = 1 f one s the smple egenvalue of A, whch mples that x(k) 1 N v T x(0),.e., x (k) x j (k) 0 and consensus s asymptotcally acheved. By [10], one s the smple egenvalue of A f and only f G assocated wth A contans a spannng tree. To examne the asymptotc behavor of (9), we ntroduce the concept of global ɛ-consensus. Defnton 1 (global ɛ-consensus). Gven ɛ > 0, the state vector x = [x 1,..., x N ] of the network s sad to reach global ɛ-consensus f x x j < ɛ for any, j V. The man objectve of ths paper s to provde a local stoppng rule of the form (7) and (8) to ensure that the global ɛ-consensus s acheved. However, an ndvdual node cannot drectly check ts attanablty. Instead, by drectly usng states of ts n-neghbors and wthout nducng extra communcaton, each node can easly check local ɛ-consensus below. Defnton 2 (local ɛ-consensus). Gven ɛ > 0, f the state of node satsfes max j N x x j < ɛ, node s sad to acheve local ɛ-consensus. A strkng dstncton between local ɛ-consensus and global ɛ-consensus les n that the later one s attractve, meanng that once the network attans global ɛ-consensus, t wll stay n ths state afterwards. To elaborate t, let x u (k) = max {x (k)}, and x l (k) = mn {x (k)}. It follows from (2) that x u (k) x (k +1) and x j (k +1) x l (k) for all, j V. Then x (k + 1) x j (k + 1) x u (k) x l (k) = max,j x (k) x j (k). That s, once global ɛ-consensus s acheved at tme slot k, t wll contnue to hold at next tme slot. Whle global ɛ-consensus mples local ɛ-consensus, the converse does not hold. To brdge the gap of the above two notons of ɛ-consensus, we further ntroduce unformly local ɛ-consensus. Defnton 3 (unformly local ɛ-consensus). Gven ɛ > 0, f all the nodes acheve local ɛ-consensus, the network acheves unform ɛ-consensus. Agan, global ɛ-consensus mples unformly local ɛ- consensus. On the other sde, we obtan the followng result. Lemma 1. Suppose that G s strongly connected. If the state of the network s unformly local ɛ-consensus, t s also n the state of global (ɛd)-consensus, where D s the dameter of the network. Proof. Gven two arbtrary nodes, j V, then there exsts a drected path wth edges (, 1 ) E, ( 1, 2 ) E,..., ( m, j) E and m + 1 D. For convenence, denote 0 = and m+1 = j. Snce the network s n unformly local ɛ-consensus, then x k x k+1 < ɛ holds for k = 0,..., m. Therefore, x x j = m k=0 (x k x k+1 ) m k=0 x k x xk+1 < (m + 1)ɛ ɛd, whch ndcates that the network s n (ɛd)- consensus. If G s strongly connected, the above shows that unformly local ɛ-consensus s essentally equvalent to global ɛ-consensus. Then, the remanng problem s how to locally check the attanablty of unformly local ɛ-consensus. One may consder a straghtforward dea by usng a certan number of consecutvely attanng local ɛ-consensus. However, ths number cannot be settled as a pror and n fact depends on the ntal network state, whch s llustrated n the followng example. Example 4. Consder a strongly connected rng network wth 3 nodes. The assocated weghtng matrx A and ntal

4 4 network state are gven by A = , and x(0) = Once can readly verfy that x(3) = [0.1, , ] T and node 1 attans local 0.5-consensus at any tme slot. However, ether unformly local 0.5-consensus or global 0.5- consensus s not acheved before tme slot k 3. It s easy to observe that the attanablty of unformly local ɛ-consensus depends on the ntal state vector, and cannot be smply checked va a fxed number of consecutvely attanng local ɛ-consensus. In the sequel, we shall make the followng assumpton. Assumpton 1. The graph G s strongly connected. In fact, Assumpton 1 s necessary. If G s not strongly connected, there exsts a node that s not reachable from node j. Then, node s unable to receve nformaton from node j, whch renders node genercally unable to locally decde the stoppng tme. B. Desgn of Local Stoppng Methods To resolve the above mentoned ssue for unformly local ɛ-consensus, our dea s to adopt a mnmum-consensus algorthm n the form (7) so that each node can track the mnmum number of consecutve attanng local ɛ-consensus. To ths purpose, each node uses y ɛ (k) to record the latest number of consecutvely attanng local ɛ-consensus n the tme slot k,.e., y ɛ (0) = 0, (10) { y y ɛ ɛ (k + 1) = (k) + 1, max j N x (k) x j (k) < ɛ, 0, otherwse. Clearly, f y ɛ (k) s postve, node attans local ɛ-consensus at tme slot k 1. If node s further able to locally check the postveness of mn V {y ɛ (k)}, the problem s solved as mn V {y ɛ (k)} > 0 mples that unformly local ɛ-consensus s acheved! To ths end, each node may use fast communcatons between tme slot k and k + 1 to send one-bt data for D tmes to ts out-neghbors, and adopts the mnmumconsensus algorthm,.e., s (k, 0) = sgn(y ɛ (k)), and s (k, m+1) = mn s j (k, m), j N {} (11) where sgn(x) = 1 f x > 0, and zero, otherwse. Specfcally, node only needs to broadcast one-bt data to ts out-neghbors. If G s strongly connected, t s clear that s (k, D) = mn V {s (k, 0)}. That s, the mnmumconsensus s acheved after D rounds of communcatons. If s (k, D) > 0, then node stops updatng (2) at tme slot k, and reports that the network attans unformly local ɛ- consensus. However, ths approach s not applcable to tmevaryng graphs. For example, f G(k) s not strongly connected, the mnmum consensus s not achevable by usng (11). Inspred also motvated by ts lmtaton, we ntroduce another varable z ɛ n node, whch plays a smlar role of s (k, m) of (11). Let z ɛ (0) = 0, and z ɛ (k + 1) = mn {zj(k), ɛ yj(k)} ɛ + 1. (12) j N {} Clearly, both the auxlary varables y ɛ n (11) and z ɛ n (12) can be computed n a dstrbuted way. Next, we show how to use z ɛ to check the attanablty of unformly local ɛ-consensus. The followng result s straghtforward, and ts proof s omtted. Lemma 2. Consder the dstrbuted algorthms gven by (11) and (12), the followng statements hold. (a) For any k 1 k 2 0, then y ɛ(k 1) y ɛ(k 2) + k 1 k 2 and z ɛ(k 1) z ɛ(k 2) + k 1 k 2. (b) If (, j) E, then yj ɛ(k) zɛ (k + 1) 1. (c) The network s unformly local ɛ-consensus at tme slot k f and only f y ɛ (k + 1) 1 for all V. Theorem 1. Consder the dstrbuted algorthms gven by (11) and (12) under Assumpton 1. If there exsts V such that z ɛ (k) D + 1, the network attans global (ɛd)-consensus at tme slot k from any ntal network state. Proof. For any j V, t follows from Assumpton 1 that there exsts a drected path (, 1 ), ( 1, 2 ),..., ( m, j) from node j to wth m D 1. Snce z (k) D+1 and 1 N, t follows from Lemma 2(a) and (b) that z ɛ 1 (k 1) D, and y ɛ 1 (k 1) D. Smlarly, t follows that z ɛ 2 (k 2) D 1 and y ɛ 2 (k 2) D 1. Repeat the same steps, we obtan that (k m 1) D m. Note that m+1 D, t follows from y ɛ j Lemma 2(a) that yj ɛ(k D) yɛ j (k m 1)+m+1 D 1. As j s arbtrary, t follows from Lemma 2(c) that the system s n unformly local ɛ-consensus at tme k D 1. By Lemma 1, the system has already attaned global (ɛd)-consensus at tme slot k D 1. Snce the state of global (ɛd)-consensus s attractve, t s obvous that the network attans global (ɛd)- consensus at tme slot k. If the dameter D of the network s unknown, we may replace t by usng the network sze N 1 and obtan the followng result. Corollary 1. Consder the dstrbuted algorthms gven by (11) and (12) under Assumpton 1. If there exsts V such that z ɛ (k) N, then the network attans global (ɛ(n 1))- consensus at tme slot k from any ntal network state. Clearly, t s almost mpossble for all nodes n the network to smultaneously detect the attanablty of global ɛ- consensus. In practce, once the node locally determnes the attanablty of global ɛ-consensus, t stops updatng. In addton, ths node wll nform ts out-neghbors to stop updatng and there s no longer need to broadcast ts state. Thus, t maxmally takes an addtonal D tme slots for other nodes to detect the attanablty of global ɛ-consensus. Overall, the local stoppng method for node s detaled n Algorthm 1.

5 5 Algorthm 1 Local stoppng method for unformly local ɛ- consensus Intalzaton: For each node V, let y ɛ 0, zɛ 0. whle true do Local nformaton exchange: Every node broadcasts ts state x, and mn{y ɛ, zɛ } to ts out-neghbors. Local varables update: Each node receves x j and mn{yj ɛ, zɛ j } from ts n-neghbors,.e., j N, and let z ɛ mn j N {}{yɛ j, zɛ j } + 1. f z ɛ D + 1 then node reports unformly local ɛ-consensus and stops updatng. break end f f max j N y ɛ yɛ + 1. else y ɛ 0. end f end whle x x j < ɛ then Remark 1. Gven any δ > 0, let ɛ = δ/d n Algorthm 1. Then, we are able to obtan global δ-consensus by usng the stoppng method n Algorthm 1. IV. SENSITIVITY ANALYSIS Theorem 1 confrms feasblty of Algorthm 1 for locally detectng both unformly local and global consensus. If the network attans unformly local or global ɛ-consensus, a node usually s unable to locally detect t mmedately due to the lack of the whole network state. However, the detecton task can be completed by every node under Algorthm 1 after a fnte number of extra tme slots, whch s defned as response tme n ths work. Clearly, a short response tme s desrable n applcatons, and s zero f the node s able to montor the whole network state smultaneously. In ths secton, we are nterested n evaluatng the response tme of Algorthm 1. To ths purpose, we use adopt the concept of ergodc coeffcent. Defnton 4 (Ergodc coeffcent). Gven a nonnegatve matrx A = [a j ] R N N, ts ergodcty coeffcent s defned as τ(a) = mn j N mn{a k, a jk }. (13) k=1 For a row-stochastc matrx A, t clearly hods that 0 τ(a) 1, and ergodc coeffcent s mportant to quantfy the convergence rate of consensus algorthm n (9). Snce x(k + j) = A j x(k) for any k, j N, t follows from [4] that d(k + j) (1 τ(a j ))d(k), where d(k) = max,j { x (k) x j (k) }. By [4], we obtan the followng lemma. Lemma 3. Under Assumpton 1, there exsts a mnmum h N such that 0 < τ(a h ) < 1 and h D. Theorem 2. Under Assumpton 1, consder the local stoppng method n Algorthm 1. Gven any δ > 0, the response tme T r for achevng global δ-consensus s upper bounded by log D T r h log (1 τ(a h + D + 1, (14) )) where h s gven n Lemma 3. Proof. Under Assumpton 1, t s obvous that the network state dctated n (9) wll asymptotcally reach consensus. Then, there exsts a fnte tme slot k 0 > 0 such that the network wll frstly reach global δ-consensus. Clearly, k 0 depends on both the network structure n the form of A and the ntal network state. Thus, t s genercally unavalable to an ndvdual node. If the network state attans the unformly local (δ/d)- consensus, each node s able to locally detect t before tme slot D + 1 by usng Algorthm 1. In vew of Lemma 1, the network certanly reaches global δ-consensus. Snce x(k 0 + lh) = A h x(k 0 + (l 1)h), t follows from Lemma 3 that d(k 0 + lh) (1 τ(a h ))d(k 0 + (l 1)h) (1 τ(a h )) l δ. Let l be selected such that (1 τ(a h )) l δ δ/d,.e, log D l = log (1 τ(a h )), the network reaches unformly local (δ/d)-consensus at tme slot tme k 0 + lh. Fnally, we obtan that T r lh + D + 1, whch s explctly gven by log D T r h log (1 τ(a h )) + D + 1. That s, the proof s completed. Remark 2. In (14), the frst quantty n the rght hand sde (RHS) s appled to overcome the conservatveness between global δ-consensus and unformly local δ/d-consensus. The addtonal D+1 tme slots are for an ndvdual node to detect the attanablty of unformly local δ/d-consensus. The followng example llustrates the senstvty of the stoppng method va the response tme. Example 5. Consder the consensus algorthm (9) wth A = , and x(0) = In ths example, the goal s to acheve global 0.5-consensus. The smulaton result n Fg. 2 shows that the frst tme when stoppng condton satsfes n some node s k = 24, whle the global ɛ-consensus actually arrves at k = 18. The result clearly llustrates the effectveness of Algorthm 1 snce each node stops, locally. The response tme for dfferent levels of global consensus are lsted n Table.1. Va calculaton, we obtan h = 2, D = 3, and τ(a h ) = It follows from Theorem 2 that T r 40. As shown n Table.1, the largest response tme s 10, whch s smaller than 40 and verfes the correctness of Theorem 2.

6 6 x <0.5 Dstrbuted Stoppng Rule for Global 0.5-consensus k=18, reach global 0.5-consensus k=24, dstrbutedly stop k Fg. 2. Smulaton result of Example 1 as ɛ = 0.5. Table 1: Response tme for dfferent levels of global consensus Level of consensus Consensus tme Stoppng tme Response tme V. CONCLUSION In ths paper, we formally defned the local stoppng problem for dstrbuted algorthms. Focusng on the consensus algorthm, a dstrbuted stoppng method was desgned for each nodes to locally check consensus, and ts senstvty s quantfed. The method can be extended to tme-varyng network and s robust to communcaton delays, whch wll be presented n the journal verson. [7] N. E. Mantara and C. N. Hadjcosts, Dstrbuted stoppng for average consensus n drected graphs va a randomzed event-trggered strategy, n 6th Internatonal Symposum on Communcatons, Control and Sgnal Processng. IEEE, 2014, pp [8] J. Cortés, Dstrbuted algorthms for reachng consensus on general functons, Automatca, vol. 44, no. 3, pp , [9] R. Olfat-Saber and R. M. Murray, Consensus problems n networks of agents wth swtchng topology and tmedelays, IEEE Transactons on automatc control, vol. 49, no. 9, pp , [10] W. Ren and R. W. Beard, Consensus seekng n multagent systems under dynamcally changng nteracton topologes, IEEE Transactons on automatc control, vol. 50, no. 5, pp , [11] S. E. Parsegov, A. V. Proskurnkov, R. Tempo, and N. E. Fredkn, Novel multdmensonal models of opnon dynamcs n socal networks, IEEE Transactons on Automatc Control, [12] A. Nedć and A. Ozdaglar, Dstrbuted subgradent methods for mult-agent optmzaton, IEEE Transactons on Automatc Control, vol. 54, no. 1, pp , [13] P. D Lorenzo and S. Barbarossa, Dstrbuted estmaton and control of algebrac connectvty over random graphs, IEEE Transactons on Sgnal Processng, vol. 62, no. 21, pp , [14] R. A. Horn and C. R. Johnson, Matrx analyss. Cambrdge Unversty Press, REFERENCES [1] J.-P. Sheu, P.-C. Chen, and C.-S. Hsu, A dstrbuted localzaton scheme for wreless sensor networks wth mproved grd-scan and vector-based refnement, IEEE transactons on moble computng, vol. 7, no. 9, pp , [2] J. A. Bazerque and G. B. Gannaks, Dstrbuted spectrum sensng for cogntve rado networks by explotng sparsty, IEEE Transactons on Sgnal Processng, vol. 58, no. 3, pp , [3] A. Rchards, J. Bellngham, M. Tllerson, and J. How, Coordnaton and control of multple uavs, n AIAA gudance, navgaton, and control conference, Monterey, CA, [4] J.-G. Dong and L. Qu, Flockng of the cucker-smale model on general dgraphs, IEEE Transactons on Automatc Control, [5] D. Acemoglu and A. Ozdaglar, Opnon dynamcs and learnng n socal networks, Dynamc Games and Applcatons, vol. 1, no. 1, pp. 3 49, [6] V. Yadav and M. V. Salapaka, Dstrbuted protocol for determnng when averagng consensus s reached, n 45th Annual Allerton Conference, 2007, pp

Dynamic Systems on Graphs

Dynamic Systems on Graphs Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Changing Topology and Communication Delays

Changing Topology and Communication Delays Prepared by F.L. Lews Updated: Saturday, February 3, 00 Changng Topology and Communcaton Delays Changng Topology The graph connectvty or topology may change over tme. Let G { G, G,, G M } wth M fnte be

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Adaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays *

Adaptive Consensus Control of Multi-Agent Systems with Large Uncertainty and Time Delays * Journal of Robotcs, etworkng and Artfcal Lfe, Vol., o. (September 04), 5-9 Adaptve Consensus Control of Mult-Agent Systems wth Large Uncertanty and me Delays * L Lu School of Mechancal Engneerng Unversty

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Lecture 10: May 6, 2013

Lecture 10: May 6, 2013 TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Distributed Exponential Formation Control of Multiple Wheeled Mobile Robots

Distributed Exponential Formation Control of Multiple Wheeled Mobile Robots Proceedngs of the Internatonal Conference of Control, Dynamc Systems, and Robotcs Ottawa, Ontaro, Canada, May 15-16 214 Paper No. 46 Dstrbuted Exponental Formaton Control of Multple Wheeled Moble Robots

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Asynchronous Periodic Event-Triggered Coordination of Multi-Agent Systems

Asynchronous Periodic Event-Triggered Coordination of Multi-Agent Systems 017 IEEE 56th Annual Conference on Decson and Control (CDC) December 1-15, 017, Melbourne, Australa Asynchronous Perodc Event-Trggered Coordnaton of Mult-Agent Systems Yaohua Lu Cameron Nowzar Zh Tan Qng

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Random Walks on Digraphs

Random Walks on Digraphs Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

This article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and

This article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and Ths artcle appeared n a ournal publshed by Elsever The attached copy s furnshed to the author for nternal non-commercal research and educaton use, ncludng for nstructon at the authors nsttuton and sharng

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Lecture 20: November 7

Lecture 20: November 7 0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +

More information

The L(2, 1)-Labeling on -Product of Graphs

The L(2, 1)-Labeling on -Product of Graphs Annals of Pure and Appled Mathematcs Vol 0, No, 05, 9-39 ISSN: 79-087X (P, 79-0888(onlne Publshed on 7 Aprl 05 wwwresearchmathscorg Annals of The L(, -Labelng on -Product of Graphs P Pradhan and Kamesh

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

DO NOT DO HOMEWORK UNTIL IT IS ASSIGNED. THE ASSIGNMENTS MAY CHANGE UNTIL ANNOUNCED.

DO NOT DO HOMEWORK UNTIL IT IS ASSIGNED. THE ASSIGNMENTS MAY CHANGE UNTIL ANNOUNCED. EE 539 Homeworks Sprng 08 Updated: Tuesday, Aprl 7, 08 DO NOT DO HOMEWORK UNTIL IT IS ASSIGNED. THE ASSIGNMENTS MAY CHANGE UNTIL ANNOUNCED. For full credt, show all work. Some problems requre hand calculatons.

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Approximate Smallest Enclosing Balls

Approximate Smallest Enclosing Balls Chapter 5 Approxmate Smallest Enclosng Balls 5. Boundng Volumes A boundng volume for a set S R d s a superset of S wth a smple shape, for example a box, a ball, or an ellpsod. Fgure 5.: Boundng boxes Q(P

More information

find (x): given element x, return the canonical element of the set containing x;

find (x): given element x, return the canonical element of the set containing x; COS 43 Sprng, 009 Dsjont Set Unon Problem: Mantan a collecton of dsjont sets. Two operatons: fnd the set contanng a gven element; unte two sets nto one (destructvely). Approach: Canoncal element method:

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

Lecture Space-Bounded Derandomization

Lecture Space-Bounded Derandomization Notes on Complexty Theory Last updated: October, 2008 Jonathan Katz Lecture Space-Bounded Derandomzaton 1 Space-Bounded Derandomzaton We now dscuss derandomzaton of space-bounded algorthms. Here non-trval

More information

arxiv: v1 [math.co] 1 Mar 2014

arxiv: v1 [math.co] 1 Mar 2014 Unon-ntersectng set systems Gyula O.H. Katona and Dánel T. Nagy March 4, 014 arxv:1403.0088v1 [math.co] 1 Mar 014 Abstract Three ntersecton theorems are proved. Frst, we determne the sze of the largest

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Two Methods to Release a New Real-time Task

Two Methods to Release a New Real-time Task Two Methods to Release a New Real-tme Task Abstract Guangmng Qan 1, Xanghua Chen 2 College of Mathematcs and Computer Scence Hunan Normal Unversty Changsha, 410081, Chna qqyy@hunnu.edu.cn Gang Yao 3 Sebel

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

Distributed Non-Autonomous Power Control through Distributed Convex Optimization

Distributed Non-Autonomous Power Control through Distributed Convex Optimization Dstrbuted Non-Autonomous Power Control through Dstrbuted Convex Optmzaton S. Sundhar Ram and V. V. Veeravall ECE Department and Coordnated Scence Lab Unversty of Illnos at Urbana-Champagn Emal: {ssrnv5,vvv}@llnos.edu

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

General viscosity iterative method for a sequence of quasi-nonexpansive mappings Avalable onlne at www.tjnsa.com J. Nonlnear Sc. Appl. 9 (2016), 5672 5682 Research Artcle General vscosty teratve method for a sequence of quas-nonexpansve mappngs Cuje Zhang, Ynan Wang College of Scence,

More information

Supplement to Clustering with Statistical Error Control

Supplement to Clustering with Statistical Error Control Supplement to Clusterng wth Statstcal Error Control Mchael Vogt Unversty of Bonn Matthas Schmd Unversty of Bonn In ths supplement, we provde the proofs that are omtted n the paper. In partcular, we derve

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Counterexamples to the Connectivity Conjecture of the Mixed Cells

Counterexamples to the Connectivity Conjecture of the Mixed Cells Dscrete Comput Geom 2:55 52 998 Dscrete & Computatonal Geometry 998 Sprnger-Verlag New York Inc. Counterexamples to the Connectvty Conjecture of the Mxed Cells T. Y. L and X. Wang 2 Department of Mathematcs

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information

The equation of motion of a dynamical system is given by a set of differential equations. That is (1)

The equation of motion of a dynamical system is given by a set of differential equations. That is (1) Dynamcal Systems Many engneerng and natural systems are dynamcal systems. For example a pendulum s a dynamcal system. State l The state of the dynamcal system specfes t condtons. For a pendulum n the absence

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Communication-efficient Distributed Solutions to a System of Linear Equations with Laplacian Sparse Structure

Communication-efficient Distributed Solutions to a System of Linear Equations with Laplacian Sparse Structure Communcaton-effcent Dstrbuted Solutons to a System of Lnear Equatons wth Laplacan Sparse Structure Peng Wang, Yuanq Gao, Nanpeng Yu, We Ren, Janmng Lan, and D Wu Abstract Two communcaton-effcent dstrbuted

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Société de Calcul Mathématique SA

Société de Calcul Mathématique SA Socété de Calcul Mathématque SA Outls d'ade à la décson Tools for decson help Probablstc Studes: Normalzng the Hstograms Bernard Beauzamy December, 202 I. General constructon of the hstogram Any probablstc

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

A class of event-triggered coordination algorithms for multi-agent systems on weight-balanced digraphs

A class of event-triggered coordination algorithms for multi-agent systems on weight-balanced digraphs 2018 Annual Amercan Control Conference (ACC) June 27 29, 2018. Wsconsn Center, Mlwaukee, USA A class of event-trggered coordnaton algorthms for mult-agent systems on weght-balanced dgraphs Png Xu Cameron

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Randić Energy and Randić Estrada Index of a Graph

Randić Energy and Randić Estrada Index of a Graph EUROPEAN JOURNAL OF PURE AND APPLIED MATHEMATICS Vol. 5, No., 202, 88-96 ISSN 307-5543 www.ejpam.com SPECIAL ISSUE FOR THE INTERNATIONAL CONFERENCE ON APPLIED ANALYSIS AND ALGEBRA 29 JUNE -02JULY 20, ISTANBUL

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

Lecture 21: Numerical methods for pricing American type derivatives

Lecture 21: Numerical methods for pricing American type derivatives Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)

More information

18.1 Introduction and Recap

18.1 Introduction and Recap CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng

More information

Cooperative Output Regulation of Linear Multi-agent Systems with Communication Constraints

Cooperative Output Regulation of Linear Multi-agent Systems with Communication Constraints 2016 IEEE 55th Conference on Decson and Control (CDC) ARIA Resort & Casno December 12-14, 2016, Las Vegas, USA Cooperatve Output Regulaton of Lnear Mult-agent Systems wth Communcaton Constrants Abdelkader

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information