arxiv: v1 [cs.gt] 28 Mar 2017

Transcription

1 A Dstrbuted Nash qubrum Seekng n Networked Graphca Games Farzad Saehsadaghan, and Lacra Pave arxv: v csgt 8 Mar 07 Abstract Ths paper consders a dstrbuted gossp approach for fndng a Nash equbrum n networked games on graphs In such games a payer s cost functon may be affected by the actons of any subset of payers An nterference graph s empoyed to ustrate the partay-couped cost functons and the asymmetrc nformaton requrements For a gven nterference graph, network communcaton between payers s consdered to be mted A generazed communcaton graph s desgned so that payers exchange ony ther requred nformaton An agorthm s desgned whereby payers, wth possby partay-couped cost functons, make decsons based on the estmates of other payers actons obtaned from oca neghbors It s shown that ths choce of communcaton graph guarantees that a payers nformaton s exchanged after suffcenty many teratons Usng a set of standard assumptons on the cost functons, the nterference and the communcaton graphs, amost sure convergence to a Nash equbrum s proved for dmnshng step szes Moreover, the case when the cost functons are not known by the payers s nvestgated and a convergence proof s presented for dmnshng step szes The effect of the second argest egenvaue of the expected communcaton matrx on the convergence rate s quantfed The trade-off between parameters assocated wth the communcaton graph and the ones assocated wth the nterference graph s ustrated Numerca resuts are presented for a argescae networked game I INTRODUCTION Dstrbuted seekng of Nash equbra n networked games has receved consderabe attenton n recent years - A networked game can be represented by a graphca mode where the cost functon of each payer can be ndexed as a functon of payer s own actons and those of hs neghbors n the graph There are many rea-word appcatons that motvate us to generaze the Nash seekng probem to a graphca game setup, For nstance, the coecton of transmtters and recevers n a wreess data network can be descrbed by a graphca mode Interferences among the transmtters and recevers affect the payers sgna-tonterference rato SIR 5 Another reevant appcaton that can be modeed as a graphca game s optca network The channes are assumed to be the payers and nterferences, whch affect the optca sgna-to-nose rato OSNR of each channe, can be modeed by graph edges, 6 In ths work a ocay dstrbuted agorthm s desgned towards Nash equbrum seekng n a graphca game In such a game, the payers cost functons may depend on the actons of any subset of payers Payers exchange the The authors are wth the Department of ectrca and Computer ngneerng, Unversty of Toronto, Toronto, ON M5S G, Canada emas: farzadsaehsadaghan@mautorontoca, pave@eceutorontoca requred nformaton ocay accordng to a communcaton graph and update ther actons to optmze ther cost functons Wth the mted nformaton avaabe from oca neghbors, each payer mantans an estmate of the other payers actons and update ther estmates over tme Lterature revew A graphca game s a succnct representaton of a mut-payer game whch consders the oca nteractons and the sparsty of the nterferences Such a game can be smpy descrbed by an undrected graph caed nterference graph n whch the payers are marked by the vertces and the nterferences are represented by the edges 7, 8 The dea of a graphca game has been used n varous areas In congeston games, 9 consders a generazaton to graphca games The mode nvoves the spata postonng of the payers whch affects ther performances A confct graph s defned to specfy the payers that cause congeston to each other In a methodoogy s presented for games wth oca cost functons whch are dependent on nformaton from ony a set of oca neghborng agents xtra state space varabes are defned for the game to acheve a desred degree of ocaty In 0, graphca games are consdered n the context of dynamca games, where the dynamc of each payer depends ony on oca neghbor nformaton A stronger defnton of an nteractve Nash equbrum s used to guarantee a unque Nash equbrum Moreover, the nformaton fow s descrbed by a communcaton graph whch s dentca to the nterference graph In an economc settng, draws attenton to the probem of who nteracts wth whom n a network Ths paper states the mportance of communcaton wth neghborng payers n the network The effect of oca peers on ncreasng the usage eve of consumers s addressed n Usng word-ofmouthcommuncaton, payers typcay form ther opnons about the quaty of a product and mprove ther purchasng behavor based on the nformaton otaned from oca peers In the probem of fndng a Nash equbrum s studed for generazed convex games The nterference graph may not necessary be a compete graph, but the communcaton graph s dentca to the nterference graph A connected communcaton graph s consdered n for the cass of aggregatve games In ths game, t s assumed that the nterferences on each payer orgnate from a other payers n the network whch s teray the case wth a compete nterference graph For a arge cass of convex games, 5 proposes an asynchronous gossp-based agorthm over a connected communcaton graph A compete nterference graph specfes the nterferences between the payers The

2 agorthm s based on projected gradent method that uses dmnshng step szes Thereafter, the agorthm s extended n 6 for the case wth constant step szes and t s proved that the agorthm can ocate a sma neghborhood of a Nash equbrum of the game over a compete nterference graph Ths work s aso reated to the terature on dstrbuted optmzaton 7, 8, 9 In a dstrbuted optmzaton probem, agents, who communcate over a connected graph, mnmze an aggregate of the cost functons wth respect to a common optmzaton varabe The method that s used n 0, 7 s to ncrementay update the optmzaton varabe by each agent usng the gradent nformaton correspondng to a snge component functon of that agent Then, the updated varabe s passed to other agents and ths process s repeated unt they reach a consensus whch s an optma pont of ths probem The convergence rate of these agorthms s shown to be tghty dependent on the spectra gap of the underyng communcaton graph Whe the technques we use here are smar, there are technca dffcutes due to the game context Unke the dstrbuted optmzaton case where each agent updates/contros the oca copy of the decson vector, n a game context each payer contros hs acton whch s ony an eement of the decson vector However we crcumvent ths probem by assumng an estmate of the other payers decsons and update them by the receved nformaton from the communcaton Contrbutons In ths work, we propose a gossp-based agoruthm to fnd a Nash equbrum of networked games We generaze the agorthm n 5, 6 to the case when the nterference graph s not a compete graph, e, when the payers cost functons are affected by the actons of any subset of payers Thus, each payer mantans ony an estmate of the payers actons that nterfere wth hs cost functon Communcatons are assumed to be mted and a communcaton graph s consdered to be a subset of the nterference graph Snce, each payer may mantan an estmate of dfferent payers actons based on the nterference graph, the communcaton graph needs to be desgned n a way that a the payers obtan the requred nformaton from the neghbors to update ther estmates We prove that there exsts a ower bound for the communcaton graph under whch the agorthm converges to a Nash equbrum for dmnshng step szes We then dscuss the case when the cost functons modes are not avaabe to the payers but ony the reazed cost vaues at the certan ponts are Usng fnte-dfference technque to approxmate the gradent, we present an amost-sure convergence to a Nash equbrum Ths method has been used n to approxmate the gradent of cost functons eadng toward a gradent-free agorthm to compute a Nash equbrum Ths s referred to as adaptveness property n when the agorthm s abe to compute equbrum pont despte the ack of game components eg, cost functons due to system pocy or the natona securty Lasty, nspred by, we nvestgate the convergence rate of the proposed agorthm show that the convergence tme of an averagng agorthm under gossp constrant s dependent on the second argest egenvaue of a douby stochastc matrx characterzng the agorthm See aso, We prove that the convergence rate dmnshes as the second argest egenvaue of the expected communcaton matrx grows The resuts show a reaton between ths parameter and the ones assocated wth the communcaton and the nterference graphs The trade-off between the parameters assocated wth these two graphs s ustrated The paper s organzed as foows The probem statement and assumptons are provded n Secton II A ocay dstrbuted agorthm s proposed n Secton III The convergence of the agorthm wth dmnshng step szes s dscussed n Secton IV, whe the non-mode based approach s nvestgated n Secton V The convergence rate anayss s then presented n Secton VI Smuaton resuts are demonstrated n Secton VII A Notatons and Notons A vector norms are ucdean The cardnaty of a set A s denoted by A The ucdean projecton of x onto the set K s denoted by T K x We denote by a j,j=,,n an N N matrx wth a j as the entry of the -th row and the j-th coumn We aso denote by a =,,N an N vector wth a as the -th entry The N N dentty matrx s denoted by I N We denote by N an N vector whose entres are a equa to and by 0 N an N vector whose entres are a equa to 0 We use e to denote a unt vector whose -th eement s and the others are 0 The foowng defntons are from, 5 An undrected graph G, or smpy graph, s a par V, wth V as a fnte set of vertces and V V a set of edges such that for, j V, f, j, then j, The degree of vertex, denoted by deg, s the number of edges connected to A path n a graph s a sequence of edges whch connects a sequence of vertces A graph s connected f there s a path between every par of vertces An adjacency matrx A = a j,j V s a matrx wth a j = f, j and a j = 0 otherwse A subgraph H of a graph G s a graph whose vertces and edges are a subset of the vertex and edge set of G, respectvey A supergraph H of G s a graph of whch G s a subgraph A subgraph H s a spannng subgraph of G, f t contans a the vertces of G A trange-free spannng subgraph H of G s a subgraph n whch no three vertces form a trange of edges Moreover, H s a maxma trange-free spannng subgraph of G f addng an edge from G H to H creates ony one trange Note that f G has no trange, the maxma trange-free spannng subgraph H becomes dentca to G II PROBLM STATMNT Consder a mut-payer game n a network wth a set of payers V = {,, N} ach payer V has a rea-vaued cost functon J Payers cost functons are not necessary fuy couped n the sense that they may be affected by the actons of any number of payers To ustrate the partay couped cost functons, we defne an nterference

3 graph, denoted by G I V, I, wth I markng payer pars that nterfere one wth another We denote wth N I, the set of neghbors of payer n G I, e, N I := {j V, j I } We aso defne ÑI := N I {} Assumpton The nterference graph G I s connected and undrected Let Ω j R denote the acton set of payer j We denote by Ω the acton set of a payers, e, Ω = V Ω R N where denotes the Cartesan product For V, J : Ω R s the cost functon of payer where Ω = j ÑI Ω j R ÑI s the acton set of payers nterferng wth the cost functon of payer The game denoted by GV, Ω, J, G I s defned based on the set of payers V, the acton set Ω V, the cost functon J V and G I For V, et x = x, x Ω, wth x Ω and x Ω := j N I Ω j, denote the other payers actons whch nterfere wth the cost functon of payer Let aso x = x, x Ω, wth x Ω and x Ω := j V/{} Ω j, denote a other payers actons except The game defned on G I s payed such that for gven x Ω, each payer ams to mnmze hs own cost functon sefshy to fnd an optma acton, mnmze y J y, x subject to y Ω Note that there are N separate smutaneous optmzaton probems and each of them s run by a partcuar payer We assume that the cost functon J and the acton set Ω are ony avaabe to payer Thus every payer knows whch other payers actons affect hs cost functon A Nash equbrum for the case when G I s not a compete graph s defned as foows Defnton Consder an N-payer game GV, Ω, J, G I, each payer mnmzng the cost functon J : Ω R A vector x = x, x Ω s caed a Nash equbrum of ths game f for every gven x Ω J x, x J x, x x Ω, V Defnton s a restatement of a Nash equbrum defnton so that when G I s not a compete graph, J x, x and J x, x are repaced wth J x, x and J x, x, respectvey We assume that payers exchange some nformaton n order to update ther actons A communcaton graph G C V, C s defned where C V V denotes the set of communcaton nks between the payers, j C f and ony f payers and j communcate together The set of neghbors of payer n G C, denoted by N C, s defned as N C := {j V, j C } In order to reduce the number of communcatons between the payers, we desgn an assumpton on G C n such a way that ony the requred nformaton s obtaned by the payers Partcuary, for each In ths paper, we assume that G I s not a compete graph payer, the requred nformaton that needs to be obtaned s {x j : j N I } Let G m be a maxma trange-free spannng subgraph of G I Then we have the foowng assumpton for G C Assumpton The communcaton graph G C satsfes G m G C G I Remark Note that the maxma trange-free subgraph G m s ony a ower bound for G C n other words, G m s a sparsest possbe G C If G m does not exst, Assumpton coud be repaced by the foowng condton: Check that for every V and j N I, there s a path of ength or between and j n G C Remark G m s not unque n the sense that any seecton of a maxma trange-free subgraph of G I coud be consdered n Assumpton Snce G m s connected and undrected, by Assumpton, G C s connected and undrected A Nash equbrum can be characterzed n terms of a varatona nequaty probem for the pseudo-gradent mappng F : Ω R N, F x := x J x V, as n the foowng emma Proposton 58, page 8 n 6 Lemma x s a Nash equbrum of the game represented by f and ony f x = T Ω x αf x for α > 0, where T Ω : R N Ω s an ucdean projecton We state a few assumptons for the exstence and the unqueness of a Nash equbrum Assumpton For every V, the acton set Ω s a nonempty, compact and convex subset of R J x, x s a contnuousy dfferentabe functon n x, jonty contnuous n x and convex n x for every x The compactness of Ω mpes that V and x Ω, x J x C, for some C > 0 5 Assumpton F : Ω R N s strcty monotone, F x F y T x y > 0 x, y Ω, x y 6 Note that the strct monotoncty of F mpes the unqueness of Nash equbrum Assumpton 5 x J x, u s Lpschtz contnuous n x, for every fxed u Ω and for every V, e, there exsts σ > 0 such that x J x, u x J y, u σ x y x, y Ω 7 Moreover, x J x, u s Lpschtz contnuous n u wth a Lpschtz constant L > 0 for every fxed x Ω, V

4 Remark Assumpton 5 mpes that x J x s a Lpschtz contnuous n x Ω wth a Lpschtz constant ρ = L + σ for every V Moreover, F x s aso Lpschtz contnuous n x Ω wth a Lpschtz constant ρ = V ρ Our objectve s to fnd an agorthm for computng a Nash equbrum of GV, Ω, J, G I wth partay couped cost functons as descrbed by G I V, I usng ony mperfect nformaton over the communcaton graph G C V, C III ASYNCHRONOUS GOSSIP-BASD ALGORITHM We propose a dstrbuted agorthm, usng an asynchronous gossp-based method n 5 We obtan a Nash equbrum of GV, Ω, J, G I by sovng the assocated V I probem by a projected gradent-based approach wth dmnshng step sze The mechansm of the agorthm can be brefy expaned as foows: ach payer buds and mantans an estmate of the actons whch nterfere wth hs cost functon specfed by G I and ocay communcates wth hs neghbors over G C to exchange hs estmates and update hs acton The agorthm s nspred by 5 except that ony the requred nformaton s exchanged accordng to G I Thus, when G I s not compete, the proposed agorthm can offer substanta savngs The convergence proof depends on a generazed weght matrx, whose propertes need to be nvestgated and proved The agorthm s eaborated n the foowng steps: - Intazaton Step: ach payer mantans an nta temporary estmate x 0 Ω for the payers whose actons nterfere wth hs cost functon Let x j 0 Ω j R be payer s nta temporary estmate of payer j s acton, for V, j ÑI Then, x 0 = x j 0 j ÑI - Gosspng Step: At the gosspng step, payer k wakes up at T k unformy at random and seects a communcaton neghbor wth an equa probabty ndexed by j k N C k They exchange ther temporary estmate vectors and construct ther fna estmates Let x j k Ω j R be payer s temporary estmate of payer j s acton at T k Then he constructs hs estmate ˆx k Ω of the payers whose actons nterfere wth hs cost functon Let ˆx j k Ω j R be payer s estmate of payer j s acton, for V, j Ñ I The estmates are computed as n the foowng: ˆx k k = xk k+ x j k k, N I k ÑIj k ˆx j k k = xk k+ x j k k, N I j k ÑI k { ˆx k r k = x k r k, r ÑI k \N I k ÑIj k ˆx j k r k = x j k r k, r ÑIj k \N I j k ÑI k For a other / { k, j k }, 8 ˆx jk = x jk, / { k, j k }, j ÑI 0 Note that x k = x k for a V, snce no estmaton s needed for ts own acton 9 By the foowng emma, we show that to update the temporary estmates and construct the fna estmates, each payer V obtans a necessary nformaton about the payers n N I Lemma Let G I and G C satsfyng Assumptons and Then V, NI ÑIj = N I j N C Proof See Appendx Remark By Lemma, a the nformaton obtaned by payer from j N C, e, j N C NI ÑIj s equa to the necessary nformaton that ths payer needs to update hs estmates Remark 5 We show va a counter exampe that the bound G m s needed, snce otherwse, f payers communcate va a path of ength greater than, they may ose some nformaton Consder a -payer game n a network wth the nterference graph G I and the communcaton graph G C as n Fg In ths exampe G C G m Note that payers Fg : a Interference graph G I b Communcaton graph G C and do not have drect communcaton but through a path of ength va payers and Let payer communcate wth payer Accordng to G I, the cost functons of payer and are J x, x, x and J x, x, x, x, respectvey Snce x does not nterfere wth the cost functon of payer, payer cannot obtan any nformaton about payer from payer - Loca Step At ths moment a the payers update ther actons accordng to a projected gradent-based method Let ˆx = ˆx, ˆx Ω, wth ˆx Ω as payer s estmate of hs acton and ˆx Ω as the estmate of the other payers whose actons nterfere wth payer s cost functon Because of hs mperfect avaabe nformaton, payer uses ˆx k and updates hs acton as foows: f { k, j k }, x k + = T Ω x k α k, x J x k, ˆx k, otherwse, x k + = x k In, T Ω : R Ω s an ucdean projecton and α k, are dmnshng step szes such that αk, <, α k, = V k= k= Note that α k, s nversey dependent on the number of updates ν k that each payer has made unt tme k e, α k, = ν k In, payers not nvoved n communcaton

5 at T k mantan ther actons unchanged At ths moment the updated actons are avaabe for payers to update ther temporary estmates for every V, j ÑI as foows: { x ˆx j jk + = k, f j x k +, f j = In, for j, payer s estmate of payer j s acton remans unchanged at the next teraton However, for j =, payer s temporary estmate s updated by hs acton At ths pont, the payers are ready to begn a new teraton from step In the foowng we wrte the agorthm n a compact form Let B = A + I N R N N, where A = a j,j V s the adjacency matrx assocated wth G I Let aso s j := j B, + δ m r, 5 = r= where δ = {, f 0, f = Let e s j be a unt vector n R m For each par, j V, we assgn a vector j Rm, { j e sj, f V, j = 0 m, f V, j / ÑI 6 The communcaton matrx W k s defned as W k:=i m k j k k j k T, 7 nd k,j k where nd k, j k := {d V : B k, d Bj k, d = } s the ndex set beong to ÑI k ÑIj k for k, j k N C Remark 6 ach payer can ony pass x to hs oca neghbors Snce the dmenson of the nformaton that each payer passes s dfferent and dependent on the sze of N I, we are unabe to use the communcaton weght matrx for the fuy couped case W k = I N e k e jk e k e jk T I N wth e R N as n 6, 7 Remark 7 W k s a m m generazed communcaton matrx, N < m N From 7 t foows that W k s a douby stochastc matrx such that W k T m = W k m = m A xampe Consder a -payer game n a network wth the nterference graph G I and the communcaton graph G C as n Fg Note that for G I n Fg a, a seecton of G m coud be depcted as n Fg c One can verfy that as G m G C G I, Assumpton hods In ths setup m =, m =, m =, m = and m = = m = In the foowng tabes we show the assgnment of each vector j R to each x j Ω j R = e = e = e = e = e 5 = e 6 = e 7 = 0 = e 8 = e 9 = e 0 = e = e = 0 = e = e Fg : a Interference graph G I b Communcaton graph G C c A maxma trange-free subgraph of G I, G m x x x x x x x x x x x x x x Note that e s a unt vector n R and 0 s an vector whose entres are a 0 Assume that payers and communcate at T k, e, k =, j k = The set of ndces n ÑI ÑI s denoted by nd, = {,, } and the communcaton matrx W k s W k=i { e5 e 8 e 5 e 8 T +e 6 e 9 e 6 e 9 T +e 7 e 0 e 7 e 0 T } Let xk be an ntermedary varabe Let aso xk := x T,, x N T T be the stack vector wth the temporary estmates of a payers and Then, xk = W k xk 8 ˆx k = x r k r I, 9 where I := {d : d = s j, j N I } and s j as n 5 The agorthm s as foows: Agorthm : ntazaton x 0 Ω V : for k =,, do : k V and j k N C k communcate : xk = W k xk, 8, ˆx = x rk r I, 9 5: x k+ = T Ω x k α k, x J x k,ˆx k f { k, j k }, x k + = x k, otherwse 6: x k + = ˆx k + x k + ˆx ke, V, 7: end for IV CONVRGNC FOR DIMINISHING STP SIZ In ths secton we prove the convergence of the agorthm for dmnshng step szes The convergence proof has two parts: In Secton IV-A, we prove amost sure convergence of the temporary estmate vector xk to an average consensus whch s shown to be Zk, the average of a temporary estmate vectors In Secton IV-B, we prove amost sure convergence of the payers actons toward the Nash equbrum

6 A Convergence of Temporary stmates to An Average Consensus In ths secton, we defne the average of a temporary estmates and prove that a the temporary estmates converge amost surey towards ths pont Consder a memory M k to denote the sgma-fed generated by the hstory up to tme k wth M 0 = M = { x 0, V }, { } M k = M 0, j ; k, k For payer, et m := deg+ where deg s the degree of vertex V n G I Let aso m := N = m and m := m,, m N T R N Remark 8 Assumpton mpes that m >, V and m > N If the nterference graph G I s a compete graph, e, fuy couped cost functons, then m = N Let xk R m be the stack vector wth temporary estmates of a payers and zk R N be the average of a temporary estmate vectors, zk := H xk where H := dag/mh T R N m, 0 /m :=,, T, m m N N N H :=,, N R m N = = Let aso Zk R m denote the augmented average of a temporary estmates, defned as foows: Zk := Hzk = H H xk R m We am to prove amost sure convergence of xk to Zk Note that H and H are non-square matrces Remark 9 Snce every temporary estmate vector s not a fu vector, the average of temporary estmates s not computed by Zk = N T N I N xk as n 6 Rather, H and H are defned to take eement-wse average of the dfferent number of temporary estmates assocated wth a specfc payer m = deg GI + The convergence proof depends on some key propertes of W and H gven n Lemma -6 Lemma Let Wk and H be defned n 7 and The foowng propertes hod: W T kw k = W k, W kh = H, H T W k = H T 5 Proof See Appendx Lemma Let Qk := W k H HW k Then QkZk = 0 m Proof See Appendx Lemma 5 Let R := I m H H where H, H defned n, 0 Then R =, where the nduced norm of R s defned as R := λ max R T R Proof See Appendx In the foowng, we defne a parameter γ whch s reated to W k and pays an mportant roe n the convergence proof of the payers actons to the Nash equbrum, as we as n the convergence rate of the agorthm Lemma 6 gves a strct upper bound on γ Lemma 6 Let Qk := W k H HW k and γ = λ max Qk T Qk Then γ < Proof See Appendx Remark 0 Note that Lemma n 7 cannot be used nstead because Qk s reated to the matrces H and H whch are not vectors of a ones as n 7 In the convergence proof we use the foowng emma from 7 Lemma, Chapter Lemma 7 Let V k, u k, β k and ζ k be non-negatve random varabes adapted to σ-agebra M k If k=0 u k < as, k=0 β k < as, and V k+ M k +u k V k ζ k +β k as for a k 0, then V k converges as and k=0 ζ k < as Usng Lemma -7, we show n the foowng that xk converges to Zk Theorem Let xk be the stack vector wth temporary estmates of a payers and Zk be ts average as n Let aso α k,max = max V α k, Then under Assumptons -, k=0 α k,max xk Zk < as, k=0 xk Zk < as Proof See Appendx Note that by Theorem, xk Zk s amost surey square summabe whch mpes the amost sure convergence of xk to Zk Theorem yeds the foowng coroary for xk, represented as xk = x,, x N N T Coroary Let zk := H xk R N be the average of a payers temporary estmates Under Assumptons -, the foowng hod for payers actons xk: k=0 α k,max xk zk < as, k=0 xk zk < as Proof The proof foows by takng nto account xk = x k V and Zk = Hzk, and aso usng Theorem By Theorem and Coroary, the stack vector wth temporary estmates of a payers xk converge to Zk and a payers actons xk converge to zk as k Remark Coroary mpes that for any V and any j ÑI, x j converges toward Z sj k where s j s as defned n 5 The next resut shows amost sure convergence of xk toward Zk Lemma 8 Let xk and Zk be as n Theorem Then for xk, 8, the foowng hods under Assumptons -,

7 xk Zk Mk < as 6 k=0 Proof See Appendx B Convergence of Payers Actons to A Nash qubrum In ths secton, we use the resut of Secton IV-A to prove that a the payers actons converge towards a Nash equbrum of the game Let p be the probabty wth whch payer updates hs temporary estmate The foowng theorem shows convergence to a Nash equbrum of G Theorem Let xk and x be a payers actons and the Nash equbrum of G, respectvey Under Assumptons -5, the sequence {xk} generated by the agorthm converges to x, amost surey Proof Procedure: Frst, we fnd an upper bound for xk + p α k, x J x k, x k x J x, x T x k x Let p max = max V p and p mn = mn V p Let aso α k,mn = mn V α k, After a smpfcaton step see the proof of Theorem n 6 and summng over V, for arge enough k, we obtan the foowng usng Assumpton 5, xk + x Mk + p max αk,max + p max k / q p + p maxρ mn k / q p mn xk x + NC p max αmax +p max L ˆx k Z t k t I Mk V +p max L V Z t k t I x k k F xk F x T xk x x Mk and smpfy t to a smar format as n Lemma 7 We then appy Lemma 7 for Then we appy Lemma 7 after verfyng the condtons step by step and show that xk + x converges amost surey to a non-negatve mt pont Fnay, we use V k := xk x, k=0 ζ k < u k := p max αk,max + p max as a resut of Lemma 7 and the strct monotoncty of F to k / q p + p maxρ mn k / q p, mn show that the mt pont s 0 Frsty, usng, and the projecton s non-expansve β k := p max L ˆx Mk k Z t k t I V property, yeds for { k, j k }, x k + x x k x + Z t k t I x k + NC p max αk,max, +αk, x J x k, ˆx k x J x, x V 7 ζ k := T F xk F x xk x T k α k, x J x k, ˆx k x J x, x x k x By, k=0 u k <, and aso by xk = W k xk Addng and subtractng x J x k, Z t k t I and 8, Lemma 8 and Coroary, k=0 β k < as Then x J x k, x k from the nner product term, usng 5 by Lemma 7, V k converges amost surey to some postve and ±a T b a + b, yeds for { k, j k }, mt and aso k=0 ζ k < as, hence x k + x + αk, x k x + C αk, xk x converges amost surey, + x J x k, ˆx k x J x k, Z t k t I T k=0 k F xk F x xk x < as To compete the proof t ony remans to show that xk + x J x k, Z t k t I x J x k, x k x 8 0 as Ths foows by the compactness of Ω Assumpton and the strct monotoncty of F Tx α k, x J x k, x k x J x, x k x, V NON-MODL-BASD APPROACH FOR CONVRGNC where I s as defned n 9 For / { k, j k }, x k+ = TO A NASH QUILIBRIUM x k and x k + x = x k x One can We generaze the agorthm to the case when the payers combne these two cases together notng that for a V, are not aware of ther own cost functons modes but use the payer updates hs acton wth a gven probabty p After measured vaues of ther own reazed costs at certan ponts takng the expected vaue, we obtan for V : We empoy the fnte dfference approxmaton method of the x k + x Mk + p αk, x k x gradent see 7, Chapter Let +C p αk, x + p J x k, ˆx x J x k, x k denote the symmetrc approxmaton of x J x k, x k as the foowng: x J x k, Z t k t I Mk x J x k, x k := k 9 x +p J x k, Z t k t I x J x k, x k J x k + c k,, x k J x k c k,, x k, c k,

8 where c k, > 0 s a scaar perturbaton on x k By Tayor expanson, for a smooth cost functon J, we obtan J x k ± c k,, x k = J x k, x k ± c k, x J x k, x k + c k, x x J x k, x k ± Oc k, Ths mpes that x J x k, x k x J x k, x k = Oc k, However, smoothness of cost functons s a strngent assumpton on ths probem A reaxaton of ths assumpton s provded n the foowng: Assumpton 6 For every V, J x k, s twce dfferentabe functon n x k and x x J x k, satsfes a Lpschtz condton wth constant η > 0 n a c k, -ba around x k As n Lemma n 7, Chapter, one can show that, x J x k, x J x k, η 6 c k, 0 Usng to estmate the nd term n the RHS of and aso addng and subtractng x J x k, ˆx k, x J x k, Z t k t I, x J x k, x k and x J x, x from the nner product term and usng ±a T b a + b, yeds for { k, j k }, where I s as defned n 9 In, we used the compactness of Ω Assumpton whch mpes, x k x max 5 Usng 0, yeds for { k, j k }, x k + x + α k, x k x +H αk, + ηx max α k, c k, 6 + x J x k, ˆx k x J x k, Z t k t I + x J x k, Z t k t I x J x k, x k Tx α k, x J x k, x k x J x, x k x, The rest of the proof s smar to that of Theorem, notng that by ηx max k= α k, c k, <, V VI CONVRGNC RAT Note aso that, by Assumpton for V and x Ω In ths secton we compare the convergence rate of the we agorthm proposed n Secton III denoted as Agorthm have, x J x wth the agorthm n 5 denoted as Agorthm Agorthm s an extenson of Agorthm whch consders H, for some H > 0 Theorem Let xk and x be as n Theorem Let aso partay-couped cost functons va an nterference graph α k, be as n and c k, be a postve scaar such that, G I Agorthm operates as f a cost functons are fuycouped, or the nterference graph s a compete graph G α k, c By Assumpton, any feasbe communcaton graph for k, <, V Agorthm has a ower bound G m, however, the communcaton graph for Agorthm can be any mnmay connected k= Under Assumptons -6, the sequence {xk}, whch s subgraph of G, denoted as G mn Thus, snce G mn G m, generated by the agorthm wth the approxmaton of the gradent we expect more teratons for Agorthm than Agorthm x J, converges to x, amost surey for the correspondng communcaton graphs from the pont of vew of parameters assocated wth G C In TABL I Proof As n 7, we fnd an upperbound for xk + x we summarze the dfferences between the parameters of consderng that the gradent s approxmated by Agorthms and Note that we dstngush between the x J and then we use Lemma 7 to prove the convergence parameters for Agorthms, by usng subscrpts, superscrpts, for G C, N C and j To avod any confuson x k + x x k x note aso that λ denotes the second argest egenvaue and +αk, x J x k, ˆx k x J x, x ts ndex has nothng to do wth the subscrpt assocated wth Agorthm α k, x J x k, ˆx k T We compare Agorthms and reatve to the nterference x J x, x x k x graph G I We can show that for each teraton, Agorthm takes ess tme than Agorthm snce ess nformaton fewer estmates s needed to be exchanged For the sake of comparson, we assume that both agorthms run over the same G C G m Let r be the tme requred to exchange an estmate, and et s be the tme requred to process a fu gradent Note that the processng tme for the gradent x k + x + αk, x k x + H αk, s neary dependent on the data set We gnore the tme +α k, x max x J x k, ˆx k x J x k, ˆx requred to compute the projecton n the oca step Thus k for each teraton, the average tme requred to exchange a + x J x k, ˆx k x J x k, Z t k t I the estmates between payers and to update the actons under Agorthm s + x J x k, Z t k t I x J x k, x k x +α k, x max J x k, x k Tav := x J x k, x N p j N I ÑIj r + m N s, 7 V k j N C Tx where p j s the probabty that payers and j contact each α k, x J x k, x k x J x, x k x, other N I ÑIj r s the tme requred for payer

9 Agorthm Agorthm 5 G C G m G C G I G G mn G C G Deg + N n G I & G Deg + m V m = m V N = N n G I & G B { B := A GI + I N B := A G + I N = N T N j Rm 6, e sj, f V, j j = ÑI 0 m, f V, j / ÑI, j = e N+j,, j V W W k 7 k := I m k, j k, k, j k, T nd k,j k W k := I N e k N+ e jk N+e k N+ e jk N+ T V H H := N =,,, N =, N Rm N H := I N N R N N H 0 H := dag/mh T R N m H := N HT = N I N T N R N N Qk Q k := W k H H W k = W k H dag/mh T Lemma Q k := W k N H H T = W k N I N N T N R Lemma 5 R := I m H H = I m H dag/mh T R := I N N H H T = I N I N N N T N Tabe I to obtan a the necessary estmates of payer j N s s the tme requred to compute x J x, x, notng that s s the processng tme for computng the fu gradent x J x, x In Agorthm the average tme for each teraton s computed by repacng N I ÑIj and m n 7 wth N and N, respectvey Then,we obtan, Tav := N p j N r + s, 8 V j N C Note that N I N I j N and m N whch mpes T av T av Next, we dscuss the convergence tme n number of teratons requred for each agorthm To smpfy the anayss, we assume constant step szes e, α k, = α Note that for constant step szes there exsts a steady-state offset between xk and the Nash equbrum x, see 6 Let ths mnmum vaue of error be denoted by d, e, nf k xk x = d We use a modfed ɛ-averagng tme smar to Defnton n for the convergence tme Defnton For any 0 < ɛ <, the ɛ-averagng tme of an agorthm, N av ɛ, s defned as { xk x d } N av ɛ:=supnf k :Pr ɛ ɛ 9 x0 x0 By Defnton, N av ɛ s the mnmum number of teratons t takes for xk x to approach an ɛ-ba around d wth a hgh probabty, regardess of the nta condton x0 The foowng assumpton guarantees N av ɛ to be we-defned Assumpton 7 We assume a non-zero mnmum vaue, denoted by x mn 0 0, for the norm of the nta acton of payer for V, e, x 0 x mn 0 > 0 m We obtan a ower bound for the ɛ-averagng tme under Agorthms and by appyng Markov s nequaty: for any non-negatve random varabe X and ɛ > 0, the foowng hods: PrX ɛ X 0 ɛ For constant step szes we consder the foowng assumpton rather than Assumpton Assumpton 8 F : Ω R N s strongy monotone on Ω wth a constant µ > 0, e, F x F y T x y µ x y x, y Ω Theorem Let α be constant step szes whch satsfy 0 < φ < where, φ := + + ρ + α max p max α max + ρ + µp mn α mn, wth p max = max V p, p mn = mn V p, α max = max V α, α mn = mn V α, ρ be the Lpschtz constant of F and µ be the postve constant for the strong monotoncty property of F Under Assumptons -, 5, 7, 8, the ɛ- averagng tme N av ɛ has a ower bound as foows: a ɛ b, γ N av ɛ og og where γ = λ max Qk T Qk as n Lemma 6, Qk := W k H HW k, and a, b are postve and ncreasng wth γ Proof Procedure: The proof foows by boundng xk + x usng an upper bound for xk + Zk +

10 Then we use Markov s nequaty 0 to obtan a ower bound for the ɛ-averagng tme N av ɛ Frst, we start to fnd an upper bound for xk + Zk + As n the proof of Theorem quaton 77, one can obtan, xk + Zk + γ xk Zk + x k x j k +α max C In, we upper bound x k xj k By 8,, and 5 we obtan for, j { k, j k }, x k + x j k + x k xj k α x J x k, ˆx k x k x j k + α max C k+ x 0 x j 0 + k x max + k t α max C t=0 k k t α max C C t C, t=0 t=0 where C := max{α max C, x max } Substtutng nto, one can obtan, xk + Zk + γ xk Zk + C +α max C γ k+ x0 Z0 + C +α max C k γ t C γ k+ + C, 5 t=0 where C := Nx max, C := C +α maxc Nxmn γ and we used x Nx max, by 5 Takng nto account, one can upper bound the foowng squared-norm term: xk + Zk + γ xk Zk + x k x j k + αmaxc + γ xk Zk x k x j k + α maxc 6 t=0 where C := max{x max, αmaxc + α max CC } Mutpcaton of and yeds, x k + x j k + xk + Zk + γ x k x j xk k Zk + x k x j k + + α max C x k x j k 8 + γα max C xk Zk +αmaxc C γ k+ + C, where C := γ C + + α max CC + CC α max γ + α max C + Nx γ max and C := Usng 7, 8 and 5 on the RHS of 6, CC α max γ one can obtan, xk + Zk + γ xk Zk + C + αmaxc + γc γ k + C + γα max CC γ k + C C 5 γ k+ + C 5, 9 where C 5 := C+α max C + C +α maxcc γ γ + γnx max and C 5 := C +α maxcc γ We put the ast pece of the puzze n pace by fndng an upper bound for xk + x Usng, for { k, j k } and brngng n Zk t foows that for { k, j k }, x k + x x k x α x J x k, ˆx k x J x, x + αmax x k x + C αmax ˆx k Z t k t I + L x k Z t k t I +L α x J x k, x k x J x, x Tx k x,50 where I s as defned n 9 For / { k, j k }, x k+ = x k Smar to the proof of Theorem, we combne these two cases for V and take condtona expected vaue to obtan, x k + x Mk + p αmax x k x ˆx Mk k Z t k t I +C p α max + L p To smpfy 6, we frst dea wth the second term and then wth the ast term of the RHS By we arrve at, x k + x j k + +L x p k Z t k t I 5 x k x j k 7 Tx p α x J x k, x k x J x, x k x k+ +αmaxc + α max C x k x j k C t C Addng, and subtractng α mn p mn from α p n the ast term,

11 we obtan after some manpuaton, x k + x Mk + p max α max p mn α mn + p αmax x k x +C p αmax + L p ˆx Mk k Z t k t I +L x p k Z t k t I + pmax α max p mn α mn From 56, t foows that, x J x k, x k x J x, x p mn α mn Tx x J x k, x k x J x, x k x Summng the foregong over a V, and usng L = max V L we arrve at, xk + x Mk + p max α max p mn α mn + p max α max xk x +NC p max αmax +L p max ˆx Mk k Z t k t I V +L p max x k Z t k t I V +p max α max p mn α mn F xk F x p mn α mn F xk F x Txk x 5 Usng Remark n the ffth term and Assumpton 8 n the ast term and takng the expected vaue, yeds, xk + x Mk = xk + x φ xk x + NC p max αmax +L p max ˆx k Z t k t I V +L p max V x k Z t k t I, 5 where φ s as n, ρ > 0 and µ > 0 are the Lpschtz and the strong monotoncty constants, respectvey Usng 9 nto 5, yeds the foowng upper bound: xk + x φ xk x +NC p max αmax + L p max C 5 γ k + C 5 φ k+ k C 6 + φ t C 5 L p max γ k φ t=0 C 7 + C 8 γ k, 5 where C 7 := C6 φ, C 8 := L p maxc 5 φ and C 6 := max{nx max, NC p max α max + L p max C 5 } Reca that nf k xk x = d Then, d = nf xk k x m xk k x C 7 55 Snce 0 < φ <, by usng Markov s nequaty 0 and 5 the foowng nequaty foows, xk x d xk x d Pr ɛ = Pr x0 x0 ɛ xk x d ɛ x0 ɛ C 8 γ k + C 7 d x0 56 ɛ x mn C 8 γ k + C 7 d ɛ xk x d Pr ɛ ɛ 57 x0 Usng Defnton and Assumpton 7, one can obtan a ower bound for N av ɛ from 57, a ɛ b N av ɛ og og, 58 γ where a := C 8 x mn and b := C 7 d x mn By Lemma 6, 55 and the condton on φ, 0 < φ <, a and b are postve and ncreasng functons of γ Remark The ower bound for N av ɛ s an ncreasng functon of γ defned n Lemma 6 Therefore, as γ ncreases, more teratons are requred to converge to a Nash equbrum d s not dependent on the topoogy of the nterference and communcaton graphs as ong as Assumptons and are met Thus, d does not change wth γ Remark As 58 shows, snce ɛ b has to be postve we are not abe to fnd a ower bound for the number of teratons for any vaue of ɛ However, for the case when d = C 7, N av ɛ s the mnmum number of teratons t takes for xk x to approach an ɛ-ba around C 7, and N av ɛ og a ɛ Thus as γ ncreases, N og av ɛ ncreases γ for any vaue of ɛ Characterzng γ and ts reaton wth the communcaton and nterference graphs shed ght on the convergence rate of the agorthm The foowng emma characterzes γ Lemma 9 Let W := W k be the expected communcaton matrx Then W s douby stochastc wth λ max W = Let λ W be the second argest egenvaue of W, e, λ W := max λ λ W Then γ as defned n Lemma 6, γ = λ max Qk T Qk, satsfes γ = λ W Proof See Appendx By Lemma 9, γ s the second argest egenvaue of W, hence N av ɛ depends on the structure of the expected communcaton matrx It can be seen n the proof of Lemma 9 that W depends on parameters assocated wth the nterference and the communcaton graphs In genera t s dffcut to see the effect of each parameter on λ of W Note that for an rreducbe douby stochastc W, we can fnd an upper bound for the spectra gap e λ, 8 However, W coud be reducbe whch prevents us from usng such a powerfu too Later on n the smuaton secton, we w compute γ numercay and we w see the effect of γ on

12 55 0 U7 L8 U6 U L9 L7 U8 U5 L0 L5 L L6 U9 U 0 6 L5 L U0 U5 L L6 L L U 9 U 5 5 U L L U U L U User Fow Rate Iteraton x x x 5 x 8 x 5 Instantenous Tota Fow at a Lnk Iteraton Fg : Fow rates of the seected users and tota fow rates at the seected nks by Agorthm 55 0 L L L 8 L L 6 5 x User Fow Rate 5 5 x x 5 x 8 x 5 Instantenous Tota Fow at a Lnk L L L 8 L Fg : a Wreess Ad-Hoc Network b Interference graph G I the bottom eft fgure c Communcaton graph G C the bottom rght fgure the convergence rate Another parameter that N av ɛ 57 s dependent on s φ,, whch s assocated wth the cost functons To sum up, from the perspectve of parameters assocated wth G I, we can concude that each teraton s shorter when the nterference graph s consdered Moreover, the number of teratons s tghty dependent on the second argest egenvaue of the expected communcaton matrx hence on G C VII SIMULATION RSULTS In ths secton we present a numerca exampe and compare Agorthm and Agorthm Consder a Wreess Ad-Hoc Network WANT whch conssts of 6 mobe nodes nterconnected by mut-hop communcaton paths 9 Consder N ah = {,, 6} as the set of wreess nodes and L ah = {L } L as the set of nks connectng the nodes, L = {,, 6} the set of nk ndces Let V = {U,, U 5 } denote the set of users payers who want to use ths wreess network to transfer data Fg a represents the topoogy of the WANT n whch a unque path s assgned to each user to transfer hs data from the source to the destnaton node ach U s characterzed by a set of nks path, R, V The nterferences between users are represented n Fg b Nodes specfy the users and edges show whch users have a common nk n ther paths ach nk L j L ah has a postve capacty C j > 0, j L ach U, U V, sends a non-negatve fow x, 0 x 0, over R, and has a cost functon J defned as J x, x := κ C j χ ogx +, w:l j R w x w j:l j R Iteraton x Iteraton x 0 Fg 5: Fow rates of the seected users and tota fow rates at the seected nks by Agorthm where κ s a postve network-wde known parameter and χ s a postve user-specfc parameter The notaton a : b c transates nto set of a s such that b s contaned n c We run Agorthm over the communcaton graph G C n Fg c, and compare ts convergence rate wth that of Agorthm over the same G C Let χ = 0, V and C j = 0, j L Fg and Fg 5 show convergence of Agorthm and Agorthm for dmnshng step szes The dashed nes represent the Nash equbrum The normazed error x x x 00% s 9% after 6000 teratons for Agorthm, and after 0000 teratons for Agorthm Agorthm needs 5 tmes fewer teratons, and each teraton s 6 tmes shorter Thus, Agorthm s 0 tmes faster than Agorthm n ths exampe In order to verfy the anayss n Secton VI Theorem, we run Agorthms and wth constant step szes α k, = 0 We compute γ for Agorthms, usng Lemma 9: γ = 098, γ = 099 Fg 6 shows how the ower bound on N av ɛ,, vares wth γ, for ɛ = 00 Ths confrms that Agorthm wth greater γ requres more teratons to converge to a Nash equbrum Iteratons Lower bound on N av ε versus γ γ Fg 6: Lower bound on N av ɛ for α k, = 0 and ɛ = 00 versus γ L 6

13 VIII CONCLUSIONS In ths paper we proposed a gossp agorthm to fnd a Nash equbrum n a networked game An nterference graph s used to ustrate the ocaty of the cost functons Payers exchange ony ther requred nformaton over a communcaton graph We proved convergence to a Nash equbrum We aso presented convergence proof for the case when the component functons are not known by the payers Moreover, we showed the effect of the second argest egenvaue of the expected communcaton matrx on the convergence rate APPNDIX Proof of Lemma In the foowng, we prove N I j N C ÑIj for V from whch t s straghtforward to deduce For the case when G C = G I, we obtan, Ñ I j= Ñ I j {j}=n I 59 j N C j N I j N I In 59, we used the fact that {j} ÑIj by the defnton of ÑIj Now assume that G m G C G I To prove, t s suffcent to show that N I j N Ñmj, m where N m s the set of neghbors of payer n G m and Ñm n addton to N m contans {} In other words we need to show that any neghbor of payer n G I any vertex wth a path of ength away from n G I s ether a neghbor or a neghbor of a neghbor of payer n G m a vertex wth a path of ength or away from n G m We prove ths cam by contradcton: Assume that there exsts j N I such that j / N m and j / N m N m Then, there exsts no path of ength or between and j n G m Thus, addng that mssng edge to G m does not form a trange whch voates the maxma trange free property of G m Ths s a contradcton and hence our cam s true Proof of Lemma Part Usng the defnton of W k 7 we obtan, W T kw k = I m + nd k,j k k nd k,j k j k k k j k k j k T j k T = W k, { where we used k j k T k j, f = k = Proof of Part Usng the defntons of H0, and f W k, 7, we expand W kh as N W kh = j k j k N k = = j k T j nd k,j k j V Note that T k j = f = k, j = and T k j = 0 otherwse Smary j T k j = f = j k, j = and j T k j = 0 otherwse Consequenty, N = T k j T k j = 0 for a j V and s mmedatey obtaned Part foows smary Proof of Lemma From n Lemma, and the defnton of H 0, we obtan, QkZk = W k H HW kh H xk = W kh H H HW kh H xk = H H Hdag/mH T W khdag/mh T xk By Lemma Part and, one can verfy that, H T W kh = H T H = dagm 60 Ths yeds, QkZk = H H Hdag/mH T xk = H H H H xk = 0 m Proof of Lemma 5 By the defnton of H T H = dagm 60, one can obtan, H 0 and R T R = I m H H T I m H H = I m Hdag/mH T To fnd the egenvaues of R T R, we sove the foowng characterstc equaton for λ detr T R λi m = 0 det λi m Hdag/mH T = 0 6 We cam that there exsts at east one egenvaue equa to, and a the egenvaues of R T R are ether or 0 We prove the frst cam n the foowng By, we have the foowng for λ = : det λi m Hdag/mH T N = m N N det j T j= j m j = = By crtcay observng N N N j= m j = j = T j, t N foows that ths matrx conssts of the rows m j = T j each repeated m j tmes for j V By Remark 8 m j >, j V, the repetton of each row s at east tmes, thus det N N N j= m j = j = T j = 0 and there exsts at east one λ = Next, we prove the cam that a nonone egenvaues are 0 For now, assume that there exst k egenvaues, k N, k m, equa to for R T R For λ, we have, det λi m Hdag/mH T = 0 λ m k deti m λ Hdag/mHT = 0 Mutpyng and dvdng by detdagm = N = m nonzero by Remark 8, yeds, λ m k detdagm detdagmdeti m λ Hdag/mH T = 0 6 Let A, B and X be m n, n m and m m matrces, respectvey Let aso X be an nvertbe matrx By the generazed Syvester s determnant theorem, the foowng

14 equaty hods: detx + AB = detx deti n + BX A 6 Let X := dagm, A := H T and B := H λ, so that from 6 and 6 we obtan, λ m k N = m detdagm HT H λ = 0 Snce H T H = dagm 60, ths s equvaent to λ m k N = m det λ λ dagm = 0 λm k = 0 Ths verfes that there exst m k egenvaues, 0 m k < m, equa to 0 as we camed Thus, λ max R T R = and R = Proof of Lemma 6 Usng Lemma and 60, we obtan, Qk T Qk = W k H H Snce Qk T Qk s an m m symmetrc matrx, then, γ = x T Qk T Qkx sup x R m, x = We fnd γ for the vector subspace {x R m : x = c m, c R} and moreover, for ts orthogona compement vector subspace {x R m : x T m = 0} Let for now x = c m By the douby stochastc property of W k we obtan, γ = c T mqk T Qk m = c T mw k T W k m c T mh H m = c T m m c T mhdag/mh T m Note that from the defnton of H we obtan T mh = m T Then, γ = c m c m T dag/mm = c m c m = 0 6 Thus, γ = 0 for x = c m Consder now that x beongs to {x R m : x T m = 0} and compute γ = sup x R m, x =, x T m=0 = sup x R m, x =, x T m=0 x T Qk T Qkx = sup x R m, x =, x T m=0 x T Qk T Qkx W kx x T H Hx 65 Note that W kx x = As a resut W kx 66 Note aso that the mnmum egenvaue of H H s 0 and the assocated normazed egenvector v mn satsfes H Hv mn = 0, v T mn m = 0 and v mn = Then we acheve, nf x R m, x =, x T m=0 x T H Hx = vmnh T Hv mn = 0 67 By 66 and 67, t s straghtforward to show usng 65 that γ We now cam that γ < To prove our cam we need to verfy By 7 we obtan, W kv mn = vmn T Im = W kv mn nd k,j k nd k,j k k k j k k j k T v mn j k T v mn We expand the expected vaue consderng that each payer V communcates wth payer j N C wth probabty deg GC W kv mn = N deg V GC j T v mn 68 j N C nd,j By contradcton, we assume that W kv mn = From 68, t foows that j T v mn = 0, for a V, j N C and nd, j Moreover, by Lemma, we smpy have j N C nd, j = ÑI whch shows that the ndces nd, j for every V, j N C span a the eements of v mn Thus, for V, j N C and nd, j, we obtan, j T v mn = 0 v mnz = v mnr, 69 where z, r {t : t = s n, V, n ÑI}, z r where s n s as defned n 5 On the other hand, by 67, we obtan, vmnh T Hv mn = 0 vmn T N N,, N dag/m N j= = N N m j = T N,, N T T vmn = 0 = j = z {t:t=s n, V,n ÑI } = T vmn N = 0 j T vmn = 0, j V = v mnz = 0 70 From 69 and 70 we obtan that v mnz = 0 for z {,, m} whch contradcts v mn = Thus, the assumpton W kv mn = s fase whch mpes W kv mn < Ths concudes that γ < for the vector subspace {x R m : x T m = 0} Moreover, 6 verfes that γ = 0 for the orthogona compement vector subspace {x R m : x = c m, c R} whch competes the proof Proof of Theorem Part Procedure: Frst, we fnd an upper bound for xk + Zk + M k and smpfy t to a smar format as n Lemma 7 Then we verfy the condtons of Lemma 7 step

15 by step and appy t to the acheved upper bound We derve an upper bound for xk + Zk + M k Usng, 5 and 9, we obtan x j k + = ˆx j k = x rk r=sj for V, j N I, j and x k + = x k + for V Then we have, xk + = W k xk + µk +, 7 where µk + := x k + x s ke V Usng, we obtan, xk + Zk + = Qk xk Zk + Rµk + xk + Zk + M k = 7 Qk xk Zk M k + Rµk + M k } {{ } } {{ } Term Term Let γ = λ max Qk T Qk be as n Lemma 6 We obtan an upper bound for Term n 7 as the foowng: Term Qk xk Zk Mk γ xk Zk 7 Note that by Lemma 6, γ < Ths fact w be used as a key to bound Term To bound Term, we use R = and x k + = x k = x s for / { k, j k } Then, Term µk + M k = = V x k + x s k Mk x k + x s k Mk x k x s k + α k, C Mk x k x s k M k + α k,max C75 The second nequaty s obtaned by usng, the nonexpansve property of projecton, Assumpton equaton 5 and a + b a + b We smpfy 76 usng x s k = x k+ xj k for, j { k, j k } whch s deduced mpctey from 8 Then, Term x k x j k + α k,maxc 76 From 7, 7 and 76 t foows that xk + Zk + M k γ xk Zk + x k x j k + α k,maxc 77 Mutpyng the LHS and RHS of 77 by α k+,max and xk + Zk + α k,max, respectvey and sptng γ nto and γ, we = W k xk + µk + H H xk + obtan, = W k xk + µk + H HW k xk H Hµk + α k+,max xk + Zk + M k = Qk xk + Rµk +, 7 }{{} V k+ M k wth Qk and R as n Lemma and Lemma 5, respectvey α k,max xk Zk α k,max γ xk Zk Usng Lemma, we arrve at }{{}}{{} ζ k +u k V k + α k,max x k x j k + α k,maxc 78 }{{} β k We appy Lemma 7 to 78 to show that k=0 α k,max xk Zk < k=0 ζ k < as We aready assgned the parameters n 78 We need to verfy that a the condtons of Lemma 7 are met Ceary V k 0 and u k = 0 Usng γ < Lemma 6 ζ k > 0 To show k=0 β k < as, we use and we need to verfy that k=0 α k,max x k x j k < as for, j { k, j k } Usng,, 8, projecton s non-expansve property and 5, t yeds x k+ x j k+ x k x j k +α k,maxc 79 To obtan the nequaty, we use x j k + = ˆxj k = x j k+ x k for, j { k, j k } Take expected vaue of 79 and mutpy ts LHS and RHS by α k+,max and α k,max, respectvey snce α k+,max < α k,max α k+,max x k + x j k + Mk 80 α k,max x k x j k α k,max x k x j k + α k,maxc, where we spt α k,max nto α k,max and α k,max Appyng Lemma 7 for V k = α k,max x k xj k,u k = 0, β k = αk,max C, ζ k = α k,max x k xj k, and usng aso and 5 t foows that k=0 α k,max x k x j k < as 8 Proof of Part The proof has smar steps as n the proof of Part and t s ommted due to space mtaton