GRAPH EFFECTIVE RESISTANCE AND DISTRIBUTED CONTROL: SPECTRAL PROPERTIES AND APPLICATIONS

Size: px
Start display at page:

Download "GRAPH EFFECTIVE RESISTANCE AND DISTRIBUTED CONTROL: SPECTRAL PROPERTIES AND APPLICATIONS"

Transcription

1 GRAPH EFFECTIVE RESISTANCE AND DISTRIBUTED CONTROL: SPECTRAL PROPERTIES AND APPLICATIONS Prabir Barah Jã P. Hespanha Abstract We intrduce the cncept f matrix-valued effective resistance fr undirected matrix-weighted graphs. Effective resistances are defined t be the square blcks that appear in the diagnal f the inverse f the matrix-weighted Dirichlet graph Laplacian matrix. Hwever, they can als be btained frm a generalized electrical netwrk that is cnstructed frm the graph, and fr which currents, vltages and resistances take matrix values. Effective resistances play an imprtant rle in several prblems related t distributed cntrl and estimatin. They appear in least-squares estimatin prblems in which ne attempts t recnstruct glbal infrmatin frm relative nisy measurements; as well as in mtin cntrl prblems in which agents attempt t cntrl their psitins twards a desired frmatin, based n nisy lcal measurements. We shw that in either f these prblems, the effective resistances have a direct physical interpretatin. We als shw that effective resistances prvide bunds n the spectrum f the graph Laplacian matrix and the Dirichlet graph Laplacian. These bunds can be used t characterize the stability and cnvergence rate f several distributed algrithms that appeared in the literature. I. INTRODUCTION This paper cnsiders undirected graphs with a weight assciated with each ne f its edges. The edge-weights are symmetric psitive definite matrices. Fr such graphs we intrduce the cncept f effective resistances. The effective resistance f a nde is defined t be a square matrix blck that appears in the diagnal f the inverse f the matrix-weighted Dirichlet graph Laplacian matrix (cf. Sectin II). The terminlgy effective resistance is mtivated by the fact that these matrices als define a linear map frm currents t vltages in a generalized electrical netwrk that can be cnstructed frm the undirected matrix-weighted graph. Hwever, the vltages, currents, and resistances in this generalized electrical netwrk take matrix values ]. Effective resistances in regular electrical netwrks, where currents vltages and resistances are scalar valued, have been knwn t have far reaching implicatins in a variety f prblems. Recurrence and transience in randm walks in infinite netwrks 2] and the cverage and cmmute times f randm walks in graphs 3] can be determined by the effective resistance. There is a als a strng cnnectin between effective resistances and estimatin errr variances that arise in the estimatin f scalar-valued variables using This material is based upn wrk supprted by the Institute fr Cllabrative Bitechnlgies thrugh grant DAAD9-03-D-0004 frm the U.S. Army Research Office and by the Natinal Science Fundatin under Grant N. CCR Bth authrs are with the Dept. f Electrical and Cmputer Engineering and the Center fr Cntrl, Dynamical-Systems, and Cmputatin at Univ. f Califrnia, Santa Barbara, CA relative measurements 4]. It was later shwn by Barah and Hespanha 5] that this analgy can be extended t vectr measurements with matrix-valued cvariances, by intrducing generalized electrical netwrks with matrixvalued currents, vltages, and resistances. Crrespndingly, the effective resistance in a generalized electrical netwrk is matrix-valued. Every graph with psitive definite matrix weights can be thught f as a generalized electrical netwrk where the edge weights are the inverse-resistances. The effective resistances f matrix-weighted graphs play an imprtant rle in several prblems related t distributed cntrl and estimatin. We justify this statement in Sectin IV by presenting several such prblems. The first f these prblems is frmulated in Sectin IV-A and cnsists f estimating a certain number f variables, based n nisy relative measurements. The adjective relative refers t the fact that the measurements nly prvide infrmatin abut pairwise differences between the unknwn variables. This prblem was cnsidered in 4 7] and has multiple applicatins t sensr netwrks, including time synchrnizatin and sensr lcalizatin. It turns ut that the cvariance matrices f the estimatin errrs are given by the effective resistances f a graph that describes the measurement mdel. A secnd prblem is frmulated in Sectin IV-B and cnsists f cntrlling a grup f mbile agents twards a frmatin defined by the desired relative psitins between the agents. Each agent has available fr cntrl nisy measurements f its relative psitin with respect t a small set f neighbrs. We cnsider a prprtinal negativefeedback cntrl law that drives each agent t the current best estimate f where it shuld be, based n the current psitins f its neighbrs. Fr this law, the steady-state cvariance matrices f the vehicles psitins are given by the effective resistances f a graph that describes the available measurements. In Sectin IV-C we cnsider the cntrl f a swarm f vehicles based n relative measurements. We cnsider the setup intrduced by Fax and Murray 8] and shw that stability f the grup f vehicles is guaranteed when the Nyquist plt f the pen-lp system des nt encircle any pint in a line segment between the symmetric f the sum f the traces f the effective resistances and the rigin f the cmplex plane. A similar cnditin culd be develped fr the frmatin cntrl prblem in Yadlapalli et al. 9]. The stability cnditin in terms f effective resistances is typically mre cnservative than the ne that appeared in 8], but it is useful because effective resistances

2 have a physical interpretatin that can be used t build intuitin. Mre imprtantly, it is pssible t cnstruct upperand lw-bunds n the effective resistances fr large-scale graphs ]. II. GRAPH EFFECTIVE RESISTANCES An undirected matrix-weighted graph is a triple G = (V, E, W), where V is a set f n vertices; E V V a set f m edges; and W := {W u,v R k k : (u, v) E} a set f symmetric psitive definite matrix-valued weights fr the edges f G. Since we are dealing with undirected graphs, the pairs (u, v) and (v, u) dente the same edge. Fr simplicity f ntatin, we exclude the existence f multiple edges between the same pair f ndes and als edges frm a nde t itself. The matrix-weighted Laplacian f G is a nk nk matrix L with k rws and k clumns per nde such that the k k blck f L crrespnding t the k rws assciated with nde u V and the k clumns assciated with nde v V is equal t W u,v u = v v N u W u,v (u, v) E 0 (u, v) / E. where N u V dentes the set f neighbrs f u, i.e., the set f ndes that have an edge in cmmn with u. The matrix-weighted Dirichlet r Grunded Laplacian is btained frm the Laplacian by remval f rws and clumns. In particular, given a subset V V cnsisting f n n ndes, the matrix-weighted Dirichlet Laplacian fr the bundary V is a (n n )k (n n )k matrix L btained frm the matrix-weighted Laplacian f G by remving all rws and clumns crrespnding t the ndes in V. The usual graph Laplacian is a special case f the matrixweighted Laplacian when k = and all the weights are equal t ne. The submatrix L f L in the special case f k = is called the Dirichlet Laplacian, since it arises in the numerical slutin f PDE s with Dirichlet bundary cnditins 0]. It is als called a Grunded Laplacian since it arises in the cmputatin f nde ptentials in a electrical netwrk. Our terminlgy is derived frm this histry, but as we shall see shrtly, the matrix-weighted Dirichlet Laplacian als arises in several distributed cntrl/estimatin prblems. We say that a graph G is cnnected t V if there is a path frm every nde in the graph t at least ne f the bundary ndes in V. Lemma at the end f this sectin shws that the Dirichlet Laplacian L is invertible if and nly if G is cnnected t V. We nw frmally define effective resistance f a nde in a cnnected graph G: nde u s effective resistance t V, dented by Ru eff(v ), is the k k blck in the main diagnal f L crrespnding t the k rws/clumns assciated with the nde u V. This terminlgy is justified by the fact that these matrices als express a map frm (matrix-valued) currents t (matrix-valued) vltages in an apprpriately defined electrical netwrk (cf. ]). Hwever, fr nw we are mstly interested in the fact that these effective resistances have a direct physical relevance in many distributed cntrl/estimatin prblems. Mrever, they als allw us t deduce prperties f the spectrum f the matrix-weighted Dirichlet Laplacian and even prperties f the spectrum f the riginal matrix-weighted Laplacian. It shuld be nted that these effective resistances are matrixvalued. The previus definitins relied n the nn-singularity f L, which is established by the fllwing lemma. Lemma (Invertibility). The matrices L and L are bth psitive semi-definite. Mrever, the matrix L is psitive definite if and nly if G is cnnected t V. T prceed with the prf f this lemma as well as t build further insight int the structure f the matrices L and L, we nte that the matrix-weighted Laplacian can als be defined cmpactly using the incidence matrix f the graph. T d s, we cnsider a directed graph G btained by assigning arbitrary directins t the edges f G. The incidence matrix f the directed graph G with n ndes and m edges is an n m matrix with ne rw per nde and ne clumn per edge defined by A := a ue ], where a ue is nnzer if and nly if the edge e E is incident n the nde u V. When nnzer, a ue = if the edge e is directed twards u and a ue = therwise. Define W = diag(w,..., W m ). Figure shws a graph G, a pssible crrespnding directed graph G and its assciated incidence matrix. The matrix-weighted Laplacian f the graph G can be expressed as L := AWA T, A = A I k () where dentes the Krnecker prduct and I k is a k k identity matrix. Nte that the matrix-weighted Laplacian des nt depend n the directins f the edges chsen t define the incidence matrix. The Dirichlet Laplacian can als be expressed cmpactly as L := A WA T, A := A I k, (2) where the generalized basis incidence matrix A is a matrix btained by remving all the rws frm the incidence matrix A that crrespnd t ndes in V. Figure als shws a graph G and its assciated matrix-weighted Laplacian L when every edge weight is equal t the identity matrix. Prf f Lemma. The incidence matrix A R n m has a rw rank less than r equal t n, Therem 8.3.], and since W is psitive definite, L is psitive semi-definite. The matrix A is full-rw rank if and nly if G is cnnected t V ], which establishes the cnditin fr L t be psitive definite.

3 PSfrag replacements e e 4 3 e 4 e 2 PSfrag2 replacements 2 e 4 e 5 G 3» A = A = I 2I 0 0 2I 4I I I L = 0 I 2I I I I 2I 7 {z } L e 3 e 4 e 5 3 G e 2 h I I I I 0 i I I 0 0 I 0 I 5, D = " 4I 0 # 0 0 2I I Fig.. A graph G, a directed versin G and its incidence matrix A (rw and clumn indices f A crrespnd t nde and edge indices, respectively). The matrix A is fr the bundary with the single nde V = {}. The matrix-weighted Laplacian is shwn fr the case when all the edge weights are equal t the identity matrix. III. EFFECTIVE RESISTANCE VS. SPECTRAL PROPERTIES The effective resistances f a graph can be uses t study several spectral prperties f a graph. The fllwing result prvides the starting pint t establish these results. Lemma 2 (Spectrum f L and L ). Assume that G is cnnected t V and dente by λ (L) λ 2 (L) λ nk (L) the srted eigenvalues f the L and by λ (L ) λ 2 (L ) λ (n n)k(l ) the srted eigenvalues f L. Fr every i {, 2..., (n n )k} and λ i (L ) trace Reff u (V ) (3) λ i (L) λ i (L ) λ i+kn (L). (4) Prf. The inequality (3) is a cnsequence f the fact that any eigenvalue f the psitive definite matrix L can be upper-bunded by its trace, which can be btained by adding up all the traces f its diagnal blcks Ru eff(v ), u V. This means that every eigenvalue f L satisfies: λ i (L ) trace L = trace Ru eff (V ), frm which (3) fllws since the eigenvalues f L and L are reciprcals f each ther. The inequality (4) is a direct applicatin f the Interlacing Eigenvalues Therem 2, Therem 4.3.5]. By cnstructin, the matrix-weighted Laplacian L has the prperty that L(I k,..., I k ] T ) nk k = 0, where I k dentes the k k identity matrix. This means that L has k eigenvalues equal t zer. The effective resistances can be used t btain a lwer bund n the smallest nn-zer eigenvalue f L. In particular, when n =, we cnclude frm (3) and (4) that λ +k (L) λ (L ) trace Reff u (V ), which prvides a lwer-bund n the smallest strictly psitive eigenvalue f L. The fllwing lemma summarizes the discussin abve: Lemma 3 (Albegraic Cnnectivity). Fr any single-nde bundary set V, fr which G is cnnected, the matrix L has exactly k zer eigenvalues and all remaining eigenvalues satisfy λ i (L) trace Reff u (V ) > 0. When k = and all the edge-weights are equal t ne, the matrix L is the usual graph Laplacian and the smallest nnzer eigenvalue is knwn as the algebraic cnnectivity f the graph. The algebraic cnnectivity is a measure f perfrmance/speed f cnsensus algrithms 3]. The cnvergence f several discrete-time distributed algrithms is determined by the spectrum f the matrix J := I D L, (0, ], where D is a blck diagnal matrix that cntains the k k blcks that appear in the diagnal f the matrix-weighted Dirichlet Laplacian L (see Fig. fr an example). The next lemma establishes the stability f J and prvides a bund n the spectrum f this matrix. Lemma 4 (Discrete-time cnvergence). Assume that G is cnnected t V. Every eigenvalue f J is real and satisfies < λ i (J ) λ max (D ) trace Reff u (V ), (5) where λ max (D ) dentes the largest eigenvalue f D. Mrever, when the weighting matrices W u,v, (u, v) E are all diagnal r all equal (but nt necessarily diagnal), we actually have λ i (J ) λ max (D ) trace Reff u (V ). Prf. Since J = D 2 ( I D 2 L D 2 ) D 2, we cnclude that J can be transfrmed by a similarity transfrmatin int the symmetric matrix I D 2 L D 2 and therefre all eigenvalues f J must be real. Mrever, all eigenvalues f J have abslute value strictly smaller than ne because the discrete-time Lyapunv equatin J P J P = Q has a psitive definite slutin P := D L D > fr Q := (2D L ) + ( )L (2D L ) > 0. T verify that this matrix is psitive definite, we nte that 2D L is very similar t the matrix-weighted Laplacian L, and in fact, 2D L = A W A T, where A is a matrix whse entries are the abslute values f the entries f A. The psitive definiteness f A W A T can be prved in a manner similar t that used in prving the psitive definiteness f L = A WA T (Lemma ).

4 Denting by λ (, ) an eigenvalue f J and by x the crrespnding eigenvectr, we have that (I D L )x = λx L D x = λ x. Therefre λ max (D 0 ) x L D x = λ min (L ) λ x, frm which we cnclude using Lemma 2 that λ λ min(l ) λ max (D 0 ) λ max (D 0 ) trace Reff u (V ), which prves (5). When all the weighting matrices are diagnal, the matrix J is nn-negative fr every. Therefre by Perrn s Therem 2, Therem 8.3.] we knw that its eigenvalue with the largest abslute value must be a psitive number. The last inequality in the Lemma then fllws frm (5). When all weighting matrices are equal t sme W > 0, it fllws frm the definitin (2) that J = J I k, where J := I ( D L ) R (n n) (n n), L is the Dirichlet Laplacian fr scalar weights equal t, and D its main diagnal. Thus, the weights W play n rle. The matrix D L is nnnegative, and we cnclude frm the reasning abve that its eigenvalue with largest abslute value is psitive. Since J = J I k, the distinct eigenvalues f J are just the distinct eigenvalues f J, s we cnclude that the eigenvalue f J with largest nrm is als psitive. The last inequality again fllws frm (5). The cnvergence f several cntinuus-time distributed algrithms is determined by the spectrum f the matrix G := D L, > 0. where D is a blck diagnal matrix that cntains the k k blcks n the diagnal f the matrix-weighted Dirichlet Laplacian L. Lemma 5 (Cntinuus-time cnvergence). Assume that G is cnnected t V. Every eigenvalue f G is real and satisfies λ i (G ) λ max (D ) trace Reff u (V ), (6) where λ max (D ) dentes the largest eigenvalue f D. Prf. Since G = D 2 ( D 2 L D 2 ) D 2, we cnclude that G can be transfrmed by a similarity transfrmatin int the negative definite matrix D 2 L D 2 and therefre all eigenvalues f G must be real and negative. Mrever, defining P := 2 L we cnclude that (αi + G )P + P (αi + G ) = (αl D ). The matrix n the right hand side is then negative definite as lng as λ min (D ) > α λ max (L ) α < λ min(l ) λ max (D ). Frm Lyapunv s Therem, we thus cnclude that αi + G is Hurwitz fr every α < λmin(l) λ max(d ), which implies that the eigenvalue f G must be mre negative than λmin(l) λ. max(d ) The inequality (6) fllws frm this and Lemma 2. IV. APPLICATIONS TO DISTRIBUTED CONTROL AND ESTIMATION We nw describe a few prblems in distributed cntrl and estimatin fr which the matrix-weighted Dirichlet Laplacian and the effective resistances play a key rle. A. Graph estimatin Cnsider the prblem f estimating the values f n nde variables x, x 2,... x n R k, k frm nisy relative measurements f the frm y u,v = x u x v + ɛ u,v, (u, v) E V V, (7) where the ɛ u,v s are uncrrelated zer-mean nise vectrs with assciated cvariance matrices P u,v = Eɛ u,v ɛ u,v ]. This estimatin prblem is relevant fr such wide ranging applicatins such as lcatin estimatin and time synchrnizatin in sensr netwrks 4, 6, 7] This estimatin prblem can be assciated with a matrixweighted graph G = (V, E, W) with n ndes and m edges, with nde set V := {, 2,..., n}, edge set E cnsisting f all the pairs f ndes (u, v) fr which a nisy measurement f the frm (7) is available; and weight set W cnsisting f the inverses f the cvariance matrices W u,v := Pu,v, (u, v) E. Just with relative measurements, determining the x u s is nly pssible up t an additive cnstant. T avid this ambiguity, we assume that at least ne f the ndes is used as a reference and therefre its nde variable can be assumed knwn. In general, several nde variables may be knwn and therefre we may have several references. We dente by V the set f reference ndes. This prblem was intrduced in 5] fr a single reference nde. By stacking tgether all the measurements int a single vectr y R km, all nde variables (knwn and unknwn) int ne vectr X R kn, and all the measurement errrs int a vectr ɛ R km, we can express all the measurement equatins (7) in the fllwing cmpact frm: y = A T X + ɛ, (8) where A is as defined in (). By partitining X int a vectr x cntaining all the unknwn nde variables and anther vectr r cntaining all the knwn reference nde variables, we can re-write (8) as y = A T r r + AT x + ɛ, (9) where A r cntains the rws f A crrespnding t the reference ndes and A cntains the rws f A crrespnding t the unknwn nde variables (see Figure fr an example).

5 The estimatin f the unknwn x based n the linear measurement mdel (9) is a classical estimatin prblem. The Best Linear Unbiased Estimatr (BLUE) f x is given by ˆx := L b, L := A WA T, b := A W(y A T r r), (0) where A is as defined in (2) and W R km km is a blckdiagnal matrix with inverse-cvariances in the diagnal W = diag(p,..., Pm ); Amng all linear estimatrs f x, (0) has the smallest variance fr the estimatin errr x ˆx and the inverse f L prvides the cvariance matrix f the estimatin errr 4]: E(x ˆx)(x ˆx) ] = L. () As we saw befre, the inverse f L exists as lng as the graph G is cnnected t V. Frm (), we als cnclude that the cvariance matrix Σ u f the estimatin errr fr the variable x u appears in the crrespnding k k diagnal blck f L, which is precisely nde u s effective resistance t V defined in Sectin II. Fr large graphs ne is interested in hw the cvariance f the BLU estimate grws as a functin f distance frm the reference nde. This questin is answered in ] by determining hw the matrix-effective resistance scales with distance fr a large class f graphs. A distributed algrithms fr the cmputatin f the estimates have been prpsed in 7]. A similar algrithm is als prpsed in 6]. This algrithm is based n the bservatin that the ptimal estimate ˆx in (0) is a slutin t the fllwing equatin ˆx = J ˆx + D ˆb (2) where J := I D L, (0, ]. Since all eigenvalues f J have abslute value smaller than ne (cf. Lemma 4), the discrete-time system ˆx(t + ) = J ˆx(t) + D ˆb will cnverge precisely t the slutin t (2), which is the ptimal estimate ˆx. It turns ut that the recursin in (2) can be cmputed in a distributed fashin. In practice, each nde nly cmputes the k elements f ˆx(t) that crrespnd t its nde variable. Since the k rws f J that crrespnds t the nde u nly have nnzer k k ff-diagnal blcks in the psitins crrespnding t the neighbrs f u, all that u needs are the current estimates f its -hp neighbrs. The algrithm prpsed in 7] is actually a special case f this ne fr =. Lemma 4 relates the speed f cnvergence f this algrithm with the effective resistances. B. Frmatin cntrl with nisy measurements Cnsider a grup f n mbile agents mving in k- dimensinal space that ne desires t cntrl t a given frmatin defined by their relative psitins. In particular, denting by x u R k, u V := {, 2,..., n} the psitin f the uth agent, the cntrl bjective is t make the psitins cnverge t values fr which x u x v = r u,v, (u, v) V V, (3) where r u,v dentes the desired relative psitin f agent u with respect t agent v. One f the agents V will be called the leader and it will mve independently f the remaining nes. The remaining agents attempt t maintain the frmatin specified by (3). The leader may actually nt be a physical agent. Instead, it may be a reference that is knwn t at least ne f the physical agents. Nt all agents are able t measure their relative psitins with respect t all ther agents and therefre each agent is cnstrained t use nly a few relative psitin measurements t cmpute its cntrl signal. We dente by E V V the set f pairs f agents that can measure their relative psitins. In particular, the existence f a pair (u, v) in E signifies that agent u can measure its psitin with respect t v and similarly, v can measure its psitin with respect t u, althugh bth measurements will be crrupted with nise. Since the nise crrupting the measurement f x u x v available t u will be in general different frm the nise n the measurement f x v x u available t v, we need t distinguish these tw measurements. T this end, we intrduce a directed edge set E cntaining the tw rdered pairs (u, v), (v, u) whenever (u, v) E. We assume that a nisy measurement y u,v f the fllwing frm is available t agent u if (u, v) E: y u,v = x u x v + ɛ u,v (4) where ɛ u,v is a white randm nise prcess with autcrrelatin matrix given by Eɛ u,v (t )ɛ T u,v (t 2)] = δ(t t 2 )R u,v. Nte that by assumptin, if a measurement y u,v is available t u, then the measurement y v,u is available t v. The nise prcesses ver different edges are assumed independent f each ther. In particular, e u,v (t) is independent f e v,u (t) fr all t. In case x is a reference and nt a physical agent, an edge between the nde u and the leader means that the physical agent u is able t measure its psitin with respect t the reference. The prblem abve is nw assciated with a matrixweighted directed graph G = (V, E, W) with nde set V = {, 2,..., n}; directed edge set E cnsisting f all rdered pairs f ndes (u, v) fr which a nisy measurement f the frm (4) is available; and weight set W cnsisting f the inverses f the autcrrelatin matrices W u,v := Ru,v, (u, v) E. We assume that even thugh the measurement errrs n the tw edges (u, v) and (v, u) cnnecting the ndes u and v are uncrrelated, they have the same autcrrelatin matrix; i.e., R u,v = R v,u. We will refer t this assumptin, tgether with the assumptin that the directed edge (u, v) exists iff (v, u) exists, as bidirectinality. Fig. 2 shws an example f a bidirectinal directed graph and its assciated undirected graph. We are interested in cntrl laws fr which each agent uses all its measurements t cnstruct an ptimal estimate f the difference between its currently psitin and what this shuld be, in view f what it knw abut its neighbrs psitins. The measurements available t an arbitrary agent u V are y u,v = x u x v + ɛ u,v, v N u,

6 where N u V dentes set f ndes v such that (u, v) E. If agent u assumes that all its neighbrs are crrectly psitined then, accrding t (3), the desired psitin f u is given by any ne f the fllwing equatins x d u = x v + r u,v, v N u. Cmbining the tw previus sets f equatins, we btain y u,v = x u x d u + r u,v + ɛ u,v, v N u, frm which agents u estimates its psitin errr x u x d u. It is straightfrward t shw that the Best Linear Unbiased estimate ) f x u x d u is given by Du v N u Ru,v( yu,v r u,v, where Du := v N u Ru,v. This mtivates the fllwing negative prprtinal cntrl law fr the agents ẋ u = Du u,v (y u,v r u,v ), u V \ {}, v N u R where dentes sme psitive number. Fr analysis purpses it is cnvenient t describe the system dynamics in term f psitins with respect t the leader. Defining x u = x u x, ne cncludes that x u = D u v N u R u,v( x u x v r u,v + ɛ u,v ) ẋ, fr every u V \ {}. By stacking all the psitins x u, u V \ {} in a clumn vectr x, the abve systems can be written as fllws: x = D L x + D B W (r ɛ) ẋ, (5) where r is a clumn vectr btained by stacking all the r u,v n tp f each ther; ɛ is a clumn vectr btained by stacking all the ɛ u,v ; is a n clumn vectr f all s; W > 0 is a blck-diagnal matrix with k rws/clumns fr each edge in E, with the weights W u,v := Ru,v, (u, v) E in the diagnal; D > 0 is a blck-diagnal matrix with k rws/clumns fr each nde in V \ V, with D u, u V \ V as defined earlier in the diagnal; L = 2 A W A T where A is the generalized incidence matrix fr the directed graph (V, E) with V = {} (cf. sectin II); and B is a matrix with k rws fr each vertex in V\V and k clumns fr each edge in E, cnstructed as fllws: the k clumns crrespnding t edge (u, v) E are all equal t zer except fr the blck crrespnding t the nde u, which is equal t I k. The white nise prcess ɛ has blck diagnal autcrrelatin matrix given by Eɛ(t )ɛ T (t 2 )] = δ(t t 2 )W. Fig. 2 shws an example f the matrices defined abve. L is exactly the matrix-weighted Dirichlet Laplacian fr the matrix-weighted undirected graph (V, E, W) with bundary V := {} and with weight W u,v n every undirected edge (u, v) assigned as the weight n the crrespnding directed edge (u, v) E. Nte that we get the undirected Laplacian in the system dynamic equatins (5) due t the bidirectinality assumptin. Frm Lemma 5, we cnclude that (5) is an asympttically stable system and Lemma 5 actually relates the speed f its slwest ple with the effective resistances. It turns ut that the effective resistances play an even mre interesting A 0 = G G h I 0 I I I 0 I 0 I 0 i 0 I 0 I 0 I I I 0 I 0 B = I 0 0 I I I h I I I i I I I I I Fig. 2. A (bidirectinal) directed graph G and the assciated undirected graph G. The matrices A and B shwn are fr the graph G. rle fr this system. T see this, we further re-write the mdel (5) as x = D L x + w + b, where b := D B W r ẋ and w := D B W ɛ is a white nise randm prcess with autcrrelatin matrix given by Ew(t )w T (t 2 )] = 2 D B W Eɛ(t )ɛ T (t 2 )]W B T D = 2 δ(t t 2 )D B W B T D = 2 δ(t t 2 )D, where we used the fact that B W B T Lyapunv equatin = D. Since the D L Σ Σ L D + 2 D = 0 has a psitive definite slutin Σ = 2 L, it is straightfrward t shw that the cvariance matrix f x cnverges t Σ. In particular, the steady-state cvariance matrix f the relative psitin x u := x u x is given by k k diagnal blck f Σ, which is given by /2 times nde u s effective resistance Ru, eff t V := {} defined in Sectin II. The scaling f matrix-valued effective resistance Ru, eff as a functin f distance d u, f u frm the leader (addressed in ]) determine hw the structure f the graph G affect the grwth f the effective resistance, and therefre tracking errr cvariance. C. Stability f multi-vehicle swarms Cnsider a grup f n single-input/single-utput vehicles all with the same transfer functin P (s) frm their cntrl inputs u i, i V := {, 2,..., n} t their psitins x i. Each vehicle is able t determine its relative psitin with respect t a few ther vehicles. We dente by E V V the set f pairs f vehicles that can measure each ther relative psitins. In particular, the existence f a pair (i, j) in E signifies that the measurement y i,j := x i x j, (i, j) E is available t bth vehicles i and j. The cntrl bjective is fr all vehicles t rendezvus at a pint. T this effect each vehicle cmputes a weighted average e i := w i,j (x i x j ), i V j N i

7 f the relative psitins that it can measure and uses it fr feedback accrding t U i (s) = K(s)E i (s), where U i (s) and E i (s) dente the Laplace transfrms f u i and e i, respectively; and K(s) is a suitably selected cntrller transfer functin used by every vehicle. The errr equatin can be assciated with an undirected scalar-weighted graph G = (V, E, W), with weights W := {w i,j R : (i, j) E}. It was shwn by Fax and Murray 8] that the resulting clsed-lp system is stable if and nly if fr every nnzer eigenvalue λ i (L) f the scalar-weighted Laplacian matrix L f G there is n net encirclements f /λ i (L) by the Nyquist plt f K(s)P (s). We cnclude frm (3) that /λ i (L) trace Reff u (V ). Mrever, it can be easily seen that 2D L = A W A T 0 (see the prf f the discrete time cnvergence Lemma 4), s λ i (L) < 2λ max (D). We cnclude that fr all nnzer λ i (L), /λ i (L) lies in the range λ 2 (L), λ max (L) ] trace R eff u (V ), 2λ max (D) We therefre cnclude that the clsed-lp system is stable, as lng as the the Nyquist plt f K(s)P (s) des nt encircle any pint in the line segment frm trace Reff u (V ) t /2λ max (D). Large effective resistances will generally lead t lnger line segments and therefre mre stringent stability cnditins. Similar cnclusins can be drawn fr the type f frmatins cnsidered in 9] and 5], where every vehicle tries t maintain a cnstant separatin between itself and its neighbrs, and there is a leader whse cntrl actin des nt depend n the ther vehicles. In this case the quantities f interest are the eigenvalues f the Dirichlet Laplacian, λ i (L ). In particular, the frmatin will be stable if and nly if fr every eigenvalue λ i (L ) f the scalarweighted Dirichlet Laplacian matrix L f G there is n net encirclements f /λ i (L ) by the Nyquist plt f K(s)P (s). We can derive in a manner similar t that abve that all /λ i (L ) lies in the range λ min (L ), λ max (L ) ] trace Ru eff (V ), V. CONCLUSION ]. ]. 2λ max (D ) We intrduced the cncept f matrix-valued effective resistance fr undirected matrix-weighted graphs and shwed that effective resistances have a direct physical interpretatin in several prblems related t distributed cntrl and estimatin. We als shwed that the effective resistances can be used t cnstruct bunds n the spectrum f the Laplacian, Dirichlet Laplacian and ther matrices that arise in distributed cntrl and estimatin. We examined a few nvel and existing algrithms fr such prblems and shwed that their fundamental perfrmance limits, including stability and speed f cnvergence, can be determined by examining the effective resistances in the underlying netwrk. Our cverage f prblems fr which effective resistances are relevant was nt exhaustive and we encurage the readers t lk fr ther prblems where this tl can be f use. ACKNOWLEDGMENT The authrs wuld like t thank Prf. Richard Murray fr his cmments that led t a tightening f the eigenvalue range in sectin IV-C. REFERENCES ] P. Barah and J. P. Hespanha. Optimal estimatin frm relative measurements: Electrical analgy and errr bunds. Tech. rep., Center fr Cntrl, Dyn.- Systems and Cmp., Univ. f Califrnia, Santa Barbara, ] P. G. Dyle and J. L. Snell. Randm Walks and Electric Netwrks. Math. Assc. f America, ] A. K. Chandra, P. Raghavan, W. L. Ruzz, R. Smlensky, et al.. The electrical resistance f a graph captures its cmmute and cver times. In Prc. f the Twenty First 2st Annual ACM Sympsium n Thery f Cmputing, pp ] R. Karp, J. Elsn, D. Estrin and S. Shenker. Optimal and glbal time synchrnizatin in sensrnets. Tech. rep., Center fr Embedded Netwrked Sensing, Univ. f Califrnia, Ls Angeles, ] P. Barah and J. P. Hespanha. Estimatin frm relative measurements: Errr bunds frm electrical analgy. In Prc. f the 2nd Int. Cnf. n Intelligent Sensing and Infrmatin Prcessing ] A. Giridhar and P. R. Kumar. Distributed time synchrnizatin in wireless netwrks: Algrithms and analysis (I). In 45th IEEE Cnference n Decisn and Cntrl ] P. Barah and J. P. Hespanha. Distributed estimatin frm relative measurements in sensr netwrks. In Prc. f the 3nd Int. Cnf. n Intelligent Sensing and Infrmatin Prcessing ] A. J. Fax and R. M. Murray. Infrmatin flw and cperative cntrl f vehicle frmatins. IEEE Trans. n Autmat. Cntr., vl. 49, n. 9: , ] S. K. Yadlapalli, S. Darbha and K. R. Rajagpal. Infrmatin flw and its relatin t the stability f the mtin f vehicles in a rigid frmatin. In Prc. f the 2005 Amer. Cntr. Cnf., pp ] F. R. K. Chung. Spectral Graph Thery. N. 92 in Reginal Cnference Series in Mathematics. American Mathematical Sciety, Prvidence, R.I., 997. ] C. Gdsil and G. Ryle. Algebraic Graph Thery. Graduate Texts in Mathematics. Springer, ] R. A. Hrn and C. R. Jhnsn. Matrix Analysis. Cambridge University Press., Cambridge, ] R. Olfati-Saber, A. J. Fax and R. M. Murray. Cnsensus and cperatin in netwrked multi-agent systems. Prc. f IEEE, Submitted fr publicatin. 4] J. M. Mendel. Lessns in Digital Estimatin Thery. Prentice Hall, New Jersey, ] P. Barah and J. P. Hespanha. Errr amplicatin and disturbance prpagatin in vehicle strings with decentralized linear cntrl. In Prc. f the 44th Cnf. n Decisin and Cntr

Admissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs

Admissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs Admissibility Cnditins and Asympttic Behavir f Strngly Regular Graphs VASCO MOÇO MANO Department f Mathematics University f Prt Oprt PORTUGAL vascmcman@gmailcm LUÍS ANTÓNIO DE ALMEIDA VIEIRA Department

More information

Homology groups of disks with holes

Homology groups of disks with holes Hmlgy grups f disks with hles THEOREM. Let p 1,, p k } be a sequence f distinct pints in the interir unit disk D n where n 2, and suppse that fr all j the sets E j Int D n are clsed, pairwise disjint subdisks.

More information

V. Balakrishnan and S. Boyd. (To Appear in Systems and Control Letters, 1992) Abstract

V. Balakrishnan and S. Boyd. (To Appear in Systems and Control Letters, 1992) Abstract On Cmputing the WrstCase Peak Gain f Linear Systems V Balakrishnan and S Byd (T Appear in Systems and Cntrl Letters, 99) Abstract Based n the bunds due t Dyle and Byd, we present simple upper and lwer

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins

More information

Lyapunov Stability Stability of Equilibrium Points

Lyapunov Stability Stability of Equilibrium Points Lyapunv Stability Stability f Equilibrium Pints 1. Stability f Equilibrium Pints - Definitins In this sectin we cnsider n-th rder nnlinear time varying cntinuus time (C) systems f the frm x = f ( t, x),

More information

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) > Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);

More information

A Matrix Representation of Panel Data

A Matrix Representation of Panel Data web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins

More information

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,

More information

The blessing of dimensionality for kernel methods

The blessing of dimensionality for kernel methods fr kernel methds Building classifiers in high dimensinal space Pierre Dupnt Pierre.Dupnt@ucluvain.be Classifiers define decisin surfaces in sme feature space where the data is either initially represented

More information

Differentiation Applications 1: Related Rates

Differentiation Applications 1: Related Rates Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm

More information

Chapter 3: Cluster Analysis

Chapter 3: Cluster Analysis Chapter 3: Cluster Analysis } 3.1 Basic Cncepts f Clustering 3.1.1 Cluster Analysis 3.1. Clustering Categries } 3. Partitining Methds 3..1 The principle 3.. K-Means Methd 3..3 K-Medids Methd 3..4 CLARA

More information

A Simple Set of Test Matrices for Eigenvalue Programs*

A Simple Set of Test Matrices for Eigenvalue Programs* Simple Set f Test Matrices fr Eigenvalue Prgrams* By C. W. Gear** bstract. Sets f simple matrices f rder N are given, tgether with all f their eigenvalues and right eigenvectrs, and simple rules fr generating

More information

Pattern Recognition 2014 Support Vector Machines

Pattern Recognition 2014 Support Vector Machines Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft

More information

Determining the Accuracy of Modal Parameter Estimation Methods

Determining the Accuracy of Modal Parameter Estimation Methods Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system

More information

Support-Vector Machines

Support-Vector Machines Supprt-Vectr Machines Intrductin Supprt vectr machine is a linear machine with sme very nice prperties. Haykin chapter 6. See Alpaydin chapter 13 fr similar cntent. Nte: Part f this lecture drew material

More information

Chapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms

Chapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms Chapter 5 1 Chapter Summary Mathematical Inductin Strng Inductin Recursive Definitins Structural Inductin Recursive Algrithms Sectin 5.1 3 Sectin Summary Mathematical Inductin Examples f Prf by Mathematical

More information

Least Squares Optimal Filtering with Multirate Observations

Least Squares Optimal Filtering with Multirate Observations Prc. 36th Asilmar Cnf. n Signals, Systems, and Cmputers, Pacific Grve, CA, Nvember 2002 Least Squares Optimal Filtering with Multirate Observatins Charles W. herrien and Anthny H. Hawes Department f Electrical

More information

IN a recent article, Geary [1972] discussed the merit of taking first differences

IN a recent article, Geary [1972] discussed the merit of taking first differences The Efficiency f Taking First Differences in Regressin Analysis: A Nte J. A. TILLMAN IN a recent article, Geary [1972] discussed the merit f taking first differences t deal with the prblems that trends

More information

Module 4: General Formulation of Electric Circuit Theory

Module 4: General Formulation of Electric Circuit Theory Mdule 4: General Frmulatin f Electric Circuit Thery 4. General Frmulatin f Electric Circuit Thery All electrmagnetic phenmena are described at a fundamental level by Maxwell's equatins and the assciated

More information

Dataflow Analysis and Abstract Interpretation

Dataflow Analysis and Abstract Interpretation Dataflw Analysis and Abstract Interpretatin Cmputer Science and Artificial Intelligence Labratry MIT Nvember 9, 2015 Recap Last time we develped frm first principles an algrithm t derive invariants. Key

More information

Fall 2013 Physics 172 Recitation 3 Momentum and Springs

Fall 2013 Physics 172 Recitation 3 Momentum and Springs Fall 03 Physics 7 Recitatin 3 Mmentum and Springs Purpse: The purpse f this recitatin is t give yu experience wrking with mmentum and the mmentum update frmula. Readings: Chapter.3-.5 Learning Objectives:.3.

More information

Distributions, spatial statistics and a Bayesian perspective

Distributions, spatial statistics and a Bayesian perspective Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics

More information

, which yields. where z1. and z2

, which yields. where z1. and z2 The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin

More information

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9. Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.

More information

Section 6-2: Simplex Method: Maximization with Problem Constraints of the Form ~

Section 6-2: Simplex Method: Maximization with Problem Constraints of the Form ~ Sectin 6-2: Simplex Methd: Maximizatin with Prblem Cnstraints f the Frm ~ Nte: This methd was develped by Gerge B. Dantzig in 1947 while n assignment t the U.S. Department f the Air Frce. Definitin: Standard

More information

initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur

initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur Cdewrd Distributin fr Frequency Sensitive Cmpetitive Learning with One Dimensinal Input Data Aristides S. Galanpuls and Stanley C. Ahalt Department f Electrical Engineering The Ohi State University Abstract

More information

1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp

1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp THE POWER AND LIMIT OF NEURAL NETWORKS T. Y. Lin Department f Mathematics and Cmputer Science San Jse State University San Jse, Califrnia 959-003 tylin@cs.ssu.edu and Bereley Initiative in Sft Cmputing*

More information

Lecture 10, Principal Component Analysis

Lecture 10, Principal Component Analysis Principal Cmpnent Analysis Lecture 10, Principal Cmpnent Analysis Ha Helen Zhang Fall 2017 Ha Helen Zhang Lecture 10, Principal Cmpnent Analysis 1 / 16 Principal Cmpnent Analysis Lecture 10, Principal

More information

We can see from the graph above that the intersection is, i.e., [ ).

We can see from the graph above that the intersection is, i.e., [ ). MTH 111 Cllege Algebra Lecture Ntes July 2, 2014 Functin Arithmetic: With nt t much difficulty, we ntice that inputs f functins are numbers, and utputs f functins are numbers. S whatever we can d with

More information

Building to Transformations on Coordinate Axis Grade 5: Geometry Graph points on the coordinate plane to solve real-world and mathematical problems.

Building to Transformations on Coordinate Axis Grade 5: Geometry Graph points on the coordinate plane to solve real-world and mathematical problems. Building t Transfrmatins n Crdinate Axis Grade 5: Gemetry Graph pints n the crdinate plane t slve real-wrld and mathematical prblems. 5.G.1. Use a pair f perpendicular number lines, called axes, t define

More information

Department of Economics, University of California, Davis Ecn 200C Micro Theory Professor Giacomo Bonanno. Insurance Markets

Department of Economics, University of California, Davis Ecn 200C Micro Theory Professor Giacomo Bonanno. Insurance Markets Department f Ecnmics, University f alifrnia, Davis Ecn 200 Micr Thery Prfessr Giacm Bnann Insurance Markets nsider an individual wh has an initial wealth f. ith sme prbability p he faces a lss f x (0

More information

Lecture 02 CSE 40547/60547 Computing at the Nanoscale

Lecture 02 CSE 40547/60547 Computing at the Nanoscale PN Junctin Ntes: Lecture 02 CSE 40547/60547 Cmputing at the Nanscale Letʼs start with a (very) shrt review f semi-cnducting materials: - N-type material: Obtained by adding impurity with 5 valence elements

More information

ENSC Discrete Time Systems. Project Outline. Semester

ENSC Discrete Time Systems. Project Outline. Semester ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding

More information

CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS

CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS 1 Influential bservatins are bservatins whse presence in the data can have a distrting effect n the parameter estimates and pssibly the entire analysis,

More information

OF SIMPLY SUPPORTED PLYWOOD PLATES UNDER COMBINED EDGEWISE BENDING AND COMPRESSION

OF SIMPLY SUPPORTED PLYWOOD PLATES UNDER COMBINED EDGEWISE BENDING AND COMPRESSION U. S. FOREST SERVICE RESEARCH PAPER FPL 50 DECEMBER U. S. DEPARTMENT OF AGRICULTURE FOREST SERVICE FOREST PRODUCTS LABORATORY OF SIMPLY SUPPORTED PLYWOOD PLATES UNDER COMBINED EDGEWISE BENDING AND COMPRESSION

More information

SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 4. Function spaces

SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 4. Function spaces SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 4 Fall 2014 IV. Functin spaces IV.1 : General prperties Additinal exercises 1. The mapping q is 1 1 because q(f) = q(g) implies that fr all x we have f(x)

More information

Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Key Wrds: Autregressive, Mving Average, Runs Tests, Shewhart Cntrl Chart

Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Key Wrds: Autregressive, Mving Average, Runs Tests, Shewhart Cntrl Chart Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Sandy D. Balkin Dennis K. J. Lin y Pennsylvania State University, University Park, PA 16802 Sandy Balkin is a graduate student

More information

(1.1) V which contains charges. If a charge density ρ, is defined as the limit of the ratio of the charge contained. 0, and if a force density f

(1.1) V which contains charges. If a charge density ρ, is defined as the limit of the ratio of the charge contained. 0, and if a force density f 1.0 Review f Electrmagnetic Field Thery Selected aspects f electrmagnetic thery are reviewed in this sectin, with emphasis n cncepts which are useful in understanding magnet design. Detailed, rigrus treatments

More information

COMP 551 Applied Machine Learning Lecture 11: Support Vector Machines

COMP 551 Applied Machine Learning Lecture 11: Support Vector Machines COMP 551 Applied Machine Learning Lecture 11: Supprt Vectr Machines Instructr: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted fr this curse

More information

MODULE 1. e x + c. [You can t separate a demominator, but you can divide a single denominator into each numerator term] a + b a(a + b)+1 = a + b

MODULE 1. e x + c. [You can t separate a demominator, but you can divide a single denominator into each numerator term] a + b a(a + b)+1 = a + b . REVIEW OF SOME BASIC ALGEBRA MODULE () Slving Equatins Yu shuld be able t slve fr x: a + b = c a d + e x + c and get x = e(ba +) b(c a) d(ba +) c Cmmn mistakes and strategies:. a b + c a b + a c, but

More information

CAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank

CAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal

More information

CS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007

CS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007 CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is

More information

A New Approach to Increase Parallelism for Dependent Loops

A New Approach to Increase Parallelism for Dependent Loops A New Apprach t Increase Parallelism fr Dependent Lps Yeng-Sheng Chen, Department f Electrical Engineering, Natinal Taiwan University, Taipei 06, Taiwan, Tsang-Ming Jiang, Arctic Regin Supercmputing Center,

More information

Lead/Lag Compensator Frequency Domain Properties and Design Methods

Lead/Lag Compensator Frequency Domain Properties and Design Methods Lectures 6 and 7 Lead/Lag Cmpensatr Frequency Dmain Prperties and Design Methds Definitin Cnsider the cmpensatr (ie cntrller Fr, it is called a lag cmpensatr s K Fr s, it is called a lead cmpensatr Ntatin

More information

On Topological Structures and. Fuzzy Sets

On Topological Structures and. Fuzzy Sets L - ZHR UNIVERSIT - GZ DENSHIP OF GRDUTE STUDIES & SCIENTIFIC RESERCH On Tplgical Structures and Fuzzy Sets y Nashaat hmed Saleem Raab Supervised by Dr. Mhammed Jamal Iqelan Thesis Submitted in Partial

More information

Revisiting the Socrates Example

Revisiting the Socrates Example Sectin 1.6 Sectin Summary Valid Arguments Inference Rules fr Prpsitinal Lgic Using Rules f Inference t Build Arguments Rules f Inference fr Quantified Statements Building Arguments fr Quantified Statements

More information

Interference is when two (or more) sets of waves meet and combine to produce a new pattern.

Interference is when two (or more) sets of waves meet and combine to produce a new pattern. Interference Interference is when tw (r mre) sets f waves meet and cmbine t prduce a new pattern. This pattern can vary depending n the riginal wave directin, wavelength, amplitude, etc. The tw mst extreme

More information

CHAPTER 3 INEQUALITIES. Copyright -The Institute of Chartered Accountants of India

CHAPTER 3 INEQUALITIES. Copyright -The Institute of Chartered Accountants of India CHAPTER 3 INEQUALITIES Cpyright -The Institute f Chartered Accuntants f India INEQUALITIES LEARNING OBJECTIVES One f the widely used decisin making prblems, nwadays, is t decide n the ptimal mix f scarce

More information

Revision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax

Revision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax .7.4: Direct frequency dmain circuit analysis Revisin: August 9, 00 5 E Main Suite D Pullman, WA 9963 (509) 334 6306 ice and Fax Overview n chapter.7., we determined the steadystate respnse f electrical

More information

Surface and Contact Stress

Surface and Contact Stress Surface and Cntact Stress The cncept f the frce is fundamental t mechanics and many imprtant prblems can be cast in terms f frces nly, fr example the prblems cnsidered in Chapter. Hwever, mre sphisticated

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical

More information

Lecture 17: Free Energy of Multi-phase Solutions at Equilibrium

Lecture 17: Free Energy of Multi-phase Solutions at Equilibrium Lecture 17: 11.07.05 Free Energy f Multi-phase Slutins at Equilibrium Tday: LAST TIME...2 FREE ENERGY DIAGRAMS OF MULTI-PHASE SOLUTIONS 1...3 The cmmn tangent cnstructin and the lever rule...3 Practical

More information

Kinematic transformation of mechanical behavior Neville Hogan

Kinematic transformation of mechanical behavior Neville Hogan inematic transfrmatin f mechanical behavir Neville Hgan Generalized crdinates are fundamental If we assume that a linkage may accurately be described as a cllectin f linked rigid bdies, their generalized

More information

Chapter 3 Kinematics in Two Dimensions; Vectors

Chapter 3 Kinematics in Two Dimensions; Vectors Chapter 3 Kinematics in Tw Dimensins; Vectrs Vectrs and Scalars Additin f Vectrs Graphical Methds (One and Tw- Dimensin) Multiplicatin f a Vectr b a Scalar Subtractin f Vectrs Graphical Methds Adding Vectrs

More information

Kinetic Model Completeness

Kinetic Model Completeness 5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins

More information

Pressure And Entropy Variations Across The Weak Shock Wave Due To Viscosity Effects

Pressure And Entropy Variations Across The Weak Shock Wave Due To Viscosity Effects Pressure And Entrpy Variatins Acrss The Weak Shck Wave Due T Viscsity Effects OSTAFA A. A. AHOUD Department f athematics Faculty f Science Benha University 13518 Benha EGYPT Abstract:-The nnlinear differential

More information

MATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank

MATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank MATCHING TECHNIQUES Technical Track Sessin VI Emanuela Galass The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Emanuela Galass fr the purpse f this wrkshp When can we use

More information

You need to be able to define the following terms and answer basic questions about them:

You need to be able to define the following terms and answer basic questions about them: CS440/ECE448 Sectin Q Fall 2017 Midterm Review Yu need t be able t define the fllwing terms and answer basic questins abut them: Intr t AI, agents and envirnments Pssible definitins f AI, prs and cns f

More information

A new Type of Fuzzy Functions in Fuzzy Topological Spaces

A new Type of Fuzzy Functions in Fuzzy Topological Spaces IOSR Jurnal f Mathematics (IOSR-JM e-issn: 78-578, p-issn: 39-765X Vlume, Issue 5 Ver I (Sep - Oct06, PP 8-4 wwwisrjurnalsrg A new Type f Fuzzy Functins in Fuzzy Tplgical Spaces Assist Prf Dr Munir Abdul

More information

A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM. Department of Mathematics, Penn State University University Park, PA16802, USA.

A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM. Department of Mathematics, Penn State University University Park, PA16802, USA. A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM MIN CHEN Department f Mathematics, Penn State University University Park, PA68, USA. Abstract. This paper studies traveling-wave slutins f the

More information

Math 302 Learning Objectives

Math 302 Learning Objectives Multivariable Calculus (Part I) 13.1 Vectrs in Three-Dimensinal Space Math 302 Learning Objectives Plt pints in three-dimensinal space. Find the distance between tw pints in three-dimensinal space. Write

More information

AP Statistics Notes Unit Two: The Normal Distributions

AP Statistics Notes Unit Two: The Normal Distributions AP Statistics Ntes Unit Tw: The Nrmal Distributins Syllabus Objectives: 1.5 The student will summarize distributins f data measuring the psitin using quartiles, percentiles, and standardized scres (z-scres).

More information

COMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification

COMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551

More information

Time, Synchronization, and Wireless Sensor Networks

Time, Synchronization, and Wireless Sensor Networks Time, Synchrnizatin, and Wireless Sensr Netwrks Part II Ted Herman University f Iwa Ted Herman/March 2005 1 Presentatin: Part II metrics and techniques single-hp beacns reginal time znes ruting-structure

More information

4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression

4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression 4th Indian Institute f Astrphysics - PennState Astrstatistics Schl July, 2013 Vainu Bappu Observatry, Kavalur Crrelatin and Regressin Rahul Ry Indian Statistical Institute, Delhi. Crrelatin Cnsider a tw

More information

Thermodynamics Partial Outline of Topics

Thermodynamics Partial Outline of Topics Thermdynamics Partial Outline f Tpics I. The secnd law f thermdynamics addresses the issue f spntaneity and invlves a functin called entrpy (S): If a prcess is spntaneus, then Suniverse > 0 (2 nd Law!)

More information

NOTE ON APPELL POLYNOMIALS

NOTE ON APPELL POLYNOMIALS NOTE ON APPELL POLYNOMIALS I. M. SHEFFER An interesting characterizatin f Appell plynmials by means f a Stieltjes integral has recently been given by Thrne. 1 We prpse t give a secnd such representatin,

More information

Particle Size Distributions from SANS Data Using the Maximum Entropy Method. By J. A. POTTON, G. J. DANIELL AND B. D. RAINFORD

Particle Size Distributions from SANS Data Using the Maximum Entropy Method. By J. A. POTTON, G. J. DANIELL AND B. D. RAINFORD 3 J. Appl. Cryst. (1988). 21,3-8 Particle Size Distributins frm SANS Data Using the Maximum Entrpy Methd By J. A. PTTN, G. J. DANIELL AND B. D. RAINFRD Physics Department, The University, Suthamptn S9

More information

the results to larger systems due to prop'erties of the projection algorithm. First, the number of hidden nodes must

the results to larger systems due to prop'erties of the projection algorithm. First, the number of hidden nodes must M.E. Aggune, M.J. Dambrg, M.A. El-Sharkawi, R.J. Marks II and L.E. Atlas, "Dynamic and static security assessment f pwer systems using artificial neural netwrks", Prceedings f the NSF Wrkshp n Applicatins

More information

BASD HIGH SCHOOL FORMAL LAB REPORT

BASD HIGH SCHOOL FORMAL LAB REPORT BASD HIGH SCHOOL FORMAL LAB REPORT *WARNING: After an explanatin f what t include in each sectin, there is an example f hw the sectin might lk using a sample experiment Keep in mind, the sample lab used

More information

MAKING DOUGHNUTS OF COHEN REALS

MAKING DOUGHNUTS OF COHEN REALS MAKING DUGHNUTS F CHEN REALS Lrenz Halbeisen Department f Pure Mathematics Queen s University Belfast Belfast BT7 1NN, Nrthern Ireland Email: halbeis@qub.ac.uk Abstract Fr a b ω with b \ a infinite, the

More information

2.161 Signal Processing: Continuous and Discrete Fall 2008

2.161 Signal Processing: Continuous and Discrete Fall 2008 MIT OpenCurseWare http://cw.mit.edu 2.161 Signal Prcessing: Cntinuus and Discrete Fall 2008 Fr infrmatin abut citing these materials r ur Terms f Use, visit: http://cw.mit.edu/terms. Massachusetts Institute

More information

ENGI 4430 Parametric Vector Functions Page 2-01

ENGI 4430 Parametric Vector Functions Page 2-01 ENGI 4430 Parametric Vectr Functins Page -01. Parametric Vectr Functins (cntinued) Any nn-zer vectr r can be decmpsed int its magnitude r and its directin: r rrˆ, where r r 0 Tangent Vectr: dx dy dz dr

More information

Preparation work for A2 Mathematics [2017]

Preparation work for A2 Mathematics [2017] Preparatin wrk fr A2 Mathematics [2017] The wrk studied in Y12 after the return frm study leave is frm the Cre 3 mdule f the A2 Mathematics curse. This wrk will nly be reviewed during Year 13, it will

More information

SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 4. Function spaces

SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 4. Function spaces SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 4 Fall 2008 IV. Functin spaces IV.1 : General prperties (Munkres, 45 47) Additinal exercises 1. Suppse that X and Y are metric spaces such that X is cmpact.

More information

Floating Point Method for Solving Transportation. Problems with Additional Constraints

Floating Point Method for Solving Transportation. Problems with Additional Constraints Internatinal Mathematical Frum, Vl. 6, 20, n. 40, 983-992 Flating Pint Methd fr Slving Transprtatin Prblems with Additinal Cnstraints P. Pandian and D. Anuradha Department f Mathematics, Schl f Advanced

More information

What is Statistical Learning?

What is Statistical Learning? What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,

More information

Figure 1a. A planar mechanism.

Figure 1a. A planar mechanism. ME 5 - Machine Design I Fall Semester 0 Name f Student Lab Sectin Number EXAM. OPEN BOOK AND CLOSED NOTES. Mnday, September rd, 0 Write n ne side nly f the paper prvided fr yur slutins. Where necessary,

More information

Tree Structured Classifier

Tree Structured Classifier Tree Structured Classifier Reference: Classificatin and Regressin Trees by L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stne, Chapman & Hall, 98. A Medical Eample (CART): Predict high risk patients

More information

GAUSS' LAW E. A. surface

GAUSS' LAW E. A. surface Prf. Dr. I. M. A. Nasser GAUSS' LAW 08.11.017 GAUSS' LAW Intrductin: The electric field f a given charge distributin can in principle be calculated using Culmb's law. The examples discussed in electric

More information

Matter Content from State Frameworks and Other State Documents

Matter Content from State Frameworks and Other State Documents Atms and Mlecules Mlecules are made f smaller entities (atms) which are bnded tgether. Therefre mlecules are divisible. Miscnceptin: Element and atm are synnyms. Prper cnceptin: Elements are atms with

More information

An Introduction to Complex Numbers - A Complex Solution to a Simple Problem ( If i didn t exist, it would be necessary invent me.

An Introduction to Complex Numbers - A Complex Solution to a Simple Problem ( If i didn t exist, it would be necessary invent me. An Intrductin t Cmple Numbers - A Cmple Slutin t a Simple Prblem ( If i didn t eist, it wuld be necessary invent me. ) Our Prblem. The rules fr multiplying real numbers tell us that the prduct f tw negative

More information

REPRESENTATIONS OF sp(2n; C ) SVATOPLUK KR YSL. Abstract. In this paper we have shown how a tensor product of an innite dimensional

REPRESENTATIONS OF sp(2n; C ) SVATOPLUK KR YSL. Abstract. In this paper we have shown how a tensor product of an innite dimensional ON A DISTINGUISHED CLASS OF INFINITE DIMENSIONAL REPRESENTATIONS OF sp(2n; C ) SVATOPLUK KR YSL Abstract. In this paper we have shwn hw a tensr prduct f an innite dimensinal representatin within a certain

More information

Chapter 9 Vector Differential Calculus, Grad, Div, Curl

Chapter 9 Vector Differential Calculus, Grad, Div, Curl Chapter 9 Vectr Differential Calculus, Grad, Div, Curl 9.1 Vectrs in 2-Space and 3-Space 9.2 Inner Prduct (Dt Prduct) 9.3 Vectr Prduct (Crss Prduct, Outer Prduct) 9.4 Vectr and Scalar Functins and Fields

More information

Math Foundations 20 Work Plan

Math Foundations 20 Work Plan Math Fundatins 20 Wrk Plan Units / Tpics 20.8 Demnstrate understanding f systems f linear inequalities in tw variables. Time Frame December 1-3 weeks 6-10 Majr Learning Indicatrs Identify situatins relevant

More information

Sequential Allocation with Minimal Switching

Sequential Allocation with Minimal Switching In Cmputing Science and Statistics 28 (1996), pp. 567 572 Sequential Allcatin with Minimal Switching Quentin F. Stut 1 Janis Hardwick 1 EECS Dept., University f Michigan Statistics Dept., Purdue University

More information

making triangle (ie same reference angle) ). This is a standard form that will allow us all to have the X= y=

making triangle (ie same reference angle) ). This is a standard form that will allow us all to have the X= y= Intrductin t Vectrs I 21 Intrductin t Vectrs I 22 I. Determine the hrizntal and vertical cmpnents f the resultant vectr by cunting n the grid. X= y= J. Draw a mangle with hrizntal and vertical cmpnents

More information

Dead-beat controller design

Dead-beat controller design J. Hetthéssy, A. Barta, R. Bars: Dead beat cntrller design Nvember, 4 Dead-beat cntrller design In sampled data cntrl systems the cntrller is realised by an intelligent device, typically by a PLC (Prgrammable

More information

Activity Guide Loops and Random Numbers

Activity Guide Loops and Random Numbers Unit 3 Lessn 7 Name(s) Perid Date Activity Guide Lps and Randm Numbers CS Cntent Lps are a relatively straightfrward idea in prgramming - yu want a certain chunk f cde t run repeatedly - but it takes a

More information

Chapter 2 GAUSS LAW Recommended Problems:

Chapter 2 GAUSS LAW Recommended Problems: Chapter GAUSS LAW Recmmended Prblems: 1,4,5,6,7,9,11,13,15,18,19,1,7,9,31,35,37,39,41,43,45,47,49,51,55,57,61,6,69. LCTRIC FLUX lectric flux is a measure f the number f electric filed lines penetrating

More information

Methods for Determination of Mean Speckle Size in Simulated Speckle Pattern

Methods for Determination of Mean Speckle Size in Simulated Speckle Pattern 0.478/msr-04-004 MEASUREMENT SCENCE REVEW, Vlume 4, N. 3, 04 Methds fr Determinatin f Mean Speckle Size in Simulated Speckle Pattern. Hamarvá, P. Šmíd, P. Hrváth, M. Hrabvský nstitute f Physics f the Academy

More information

Lim f (x) e. Find the largest possible domain and its discontinuity points. Why is it discontinuous at those points (if any)?

Lim f (x) e. Find the largest possible domain and its discontinuity points. Why is it discontinuous at those points (if any)? THESE ARE SAMPLE QUESTIONS FOR EACH OF THE STUDENT LEARNING OUTCOMES (SLO) SET FOR THIS COURSE. SLO 1: Understand and use the cncept f the limit f a functin i. Use prperties f limits and ther techniques,

More information

Zeros of Sections of the Zeta Function. I

Zeros of Sections of the Zeta Function. I Zers f Sectins f the Zeta Functin. I By Rbert Spira 1. Intrductin. The sectins f the title are the Dirichlet plynmials: (1) U(s) = n"5 n = l We write s = a -f- it, and take M ^ 3. Turan [1], [2] shwed

More information

On Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION

On Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION Malaysian Jurnal f Mathematical Sciences 4(): 7-4 () On Huntsberger Type Shrinkage Estimatr fr the Mean f Nrmal Distributin Department f Mathematical and Physical Sciences, University f Nizwa, Sultanate

More information

3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression

3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression 3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets

More information

MODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards:

MODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards: MODULE FOUR This mdule addresses functins SC Academic Standards: EA-3.1 Classify a relatinship as being either a functin r nt a functin when given data as a table, set f rdered pairs, r graph. EA-3.2 Use

More information

COMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d)

COMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d) COMP 551 Applied Machine Learning Lecture 9: Supprt Vectr Machines (cnt d) Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Class web page: www.cs.mcgill.ca/~hvanh2/cmp551 Unless therwise

More information

[COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t o m a k e s u r e y o u a r e r e a d y )

[COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t o m a k e s u r e y o u a r e r e a d y ) (Abut the final) [COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t m a k e s u r e y u a r e r e a d y ) The department writes the final exam s I dn't really knw what's n it and I can't very well

More information

Smoothing, penalized least squares and splines

Smoothing, penalized least squares and splines Smthing, penalized least squares and splines Duglas Nychka, www.image.ucar.edu/~nychka Lcally weighted averages Penalized least squares smthers Prperties f smthers Splines and Reprducing Kernels The interplatin

More information

22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion

22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion .54 Neutrn Interactins and Applicatins (Spring 004) Chapter (3//04) Neutrn Diffusin References -- J. R. Lamarsh, Intrductin t Nuclear Reactr Thery (Addisn-Wesley, Reading, 966) T study neutrn diffusin

More information