arxiv: v3 [physics.soc-ph] 25 Oct 2010

Transcription

1 arxiv:5.2652v3 [physics.soc-ph] 25 Oct 2 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity Xue-Qi Cheng,2, Fu-Xin Ren, Hua-Wei Shen, Zi-Ke Zhang 3, Tao Zhou 2,4 Institute o Computing Technology, Chinese Academy o Sciences, Beijing 9, People s Republic o China 2 Web Sciences Center, University o Electronic Science and Technology o China, Chengdu 654, People s Republic o China 3 Department o Physics, University o Fribourg, Chemin du Musée 3, CH-7 Fribourg, Switzerland 4 Department o Modern Physics, University o Science and Technology o China, Heei 2326, People s Republic o China cxq@ict.ac.cn, renuxin@sotware.ict.ac.cn, shenhuawei@sotware.ict.ac.cn, zhangzike@gmail.com, zhutou@ustc.edu Abstract. Edges in a network can be divided into two kinds according to their dierent roles: some enhance the locality like the ones inside a cluster while others contribute to the global connectivity like the ones connecting two clusters. A recent study by Onnela et al uncovered the weak ties eects in mobile communication. In this article, we provide complementary results on document networks, that is, the edges connecting less similar nodes in content are more signiicant in maintaining the global connectivity. We propose an index named bridgeness to quantiy the edge signiicance in maintaining connectivity, which only depends on local inormation o network topology. We compare the bridgeness with content similarity and some other structural indices according to an edge percolation process. Experimental results on document networks show that the bridgeness outperorms content similarity in characterizing the edge signiicance. Furthermore, extensive numerical results on disparate networks indicate that the bridgeness is also better than some well-known indices on edge signiicance, including the Jaccard coeicient, degree product and betweenness centrality. PACS numbers: Fb, Hc, 5..-a, 89.2.Hh Author to whom any correspondence should be addressed.

2 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity 2. Introduction Recently, the study o complex networks became a common ocus in many branches o science [, 2, 3, 4]. Many measurements are used to characterize the role o a node in network structure and unction, ranging rom simple indices like degree and closeness [5] to complicated centralities like betweenness [6], PageRank score [7] and some random-walk-based indices [8]. In comparison, the study o edge s role is less extensive. Actually, an edge may play an important role in enhancing the locality or be signiicant in maintaining the global connectivity. How to dierentiate these two roles is an interesting and unsolved problem. A related issue is the amous weak ties theory [9], which tells us that the job opportunities and new ideas usually come rom people with weak connections. Further more, the weak ties can enhance the spreading o rumor [] and knowledge [], keep the stability o biological unctions [2] and improve the accuracy o network structure prediction [3]. Moreover, experimental and theoretical analysis on a large-scale mobile communication network showed that the weak ties play the leading role in maintaining the global connectivity [4], and they are important in the process o the emergence o social communities [5], which is a common topological characteristics o networks and has been extensively studied in the literature o network theory [6, 7, 8]. In [4], the strength o a tie is quantiied by the time spent on communication, while in this article we consider a similar problem on document networks where the tie strength is characterized by content similarity. Analogous to the observation o the social communication network, we ind that the ties connecting less similar documents are more signiicant in maintaining global connectivity. Generally speaking, the strength inormation, such as the communication time and content similarity, is not easy to be obtained. Thereore, to quantiy the edge signiicance only making use o the inormation o observed topology is very valuable in practice. For this purpose, we propose the index bridgeness. To our surprise, this index can better characterize the edge signiicance in maintaining the global connectivity than the content similarity in document networks. Furthermore, extensive numerical results on disparate networks indicate that the bridgeness is also better than some well-known structural indices on edge signiicance, including the Jaccard coeicient [9], degree product [2, 2, 22, 23] and edge betweenness [6]. 2. Weak Ties Phenomenon in Document Networks Social networks usually exhibit two important phenomena, being respectively the homophily [24, 25] and weak ties eects [9]. Homophily tells us that connections are more likely to be ormed between individuals with close interests, similar social statuses, common characteristics or shared activities. The well-known transitivity or triadic closure phenomenon [26] can be taken as a relection or homophily. Homophily contributes to the ormation o most connections in social networks. In contrast, some connections are ormed between less similar individuals, which usually have weaker

3 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity 3 Table. Basic statistics o the our networks: the PNAS citation network, social network extracted rom del.icio.us, political blog network and scientiic collaboration network rom astrophysicists. N and L denote the number o nodes and edges in the original network, while N CG and L CG are the number o nodes and edges in the giant component. Networks/Measures N L N GC L GC PNAS 28,828 4,393 2,32 38,723 Delicious 64,65 7,4 64,65 7,4 Political Blog 49 6, ,74 Astro Collaboration 6,76 2,25 4,845 9,652 strength. Weak ties phenomenon reers to the act that these connections may play crucial roles in maintaining the global connectivity and holding key unctions, such as the low o new inormation and knowledge. Compared with social networks, the homophily and weak ties phenomenon are less studied or document networks. In document networks, each node corresponds to a document with textual contents. Typical examples are the World Wide Web and scientiic citation networks. Two documents are more likely to be connected i they are relevant, e.g., webpages presenting the same topic and articles belonging to the same research area. The probability that two documents are connected increases with their content similarity[27] and the probability that three documents orm a triangle increases with their trilateral content similarity [28, 29]. These indicate that the content similarity in document networks plays the similar role as the tie strength in social networks. Inspired by Onnela et al [4], we quantiy the weak ties phenomenon according to an edge percolation process. Generally speaking, i the weak ties phenomenon exists in terms o content similarity, the network will disintegrate much aster when we remove edges successively in ascending order o content similarity than in descending order. Two quantities are used to describe the percolation process. The irst one is the raction o nodes contained in the giant component, denoted by. A sudden decline o will be observed i the network disintegrates ater the deletion o a certain raction o edges. Another quantity is the so-called normalized susceptibility, deined as = N, () s<s max n s s2 wheren s isthenumber ocomponentswithsizes, N isthesizeothewholenetwork, and the sum runs over all components but the largest one. Considering as a unction o the raction o removed edges, usually, an obvious peak can be observed that corresponds to the precise point at which the network disintegrates [3, 3]. We use the PNAS citation network to illustrate the weak ties phenomenon, where each node represents a paper published in the Proceedings o the National Academy o

4 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity 4.75 min max.75 min max a.25 c 2 b d Figure. Edge percolation results on PNAS citation network. Plots (a) and (b) are or the content similarity, while (c) and (d) are or the bridgeness. In (a) and (b), the min-(max-)lines represent the processes that the edges are removed rom the least(most) similar to the most(least) similar ones. In (c) and (d), the min-(max-)lines represent the processes that the edges with smaller(larger) bridgeness are earlier to be removed. Sciences o the United States o America (PNAS, and undirected edgesrepresentthecitations. Thedatasetcontainsallthepapersrom998to27,and the basic statistics o this network is shown in Table. We collect keywords presented in titles and abstracts o papers and construct a keyword vector space according to the standard procedures in inormation retrieval [32]. Here keywords reer to those words which are not stop words such as a, the, o, etc. The content o a paper is then represented as a keyword vector, X, which gives the requency o each keyword. The content similarity R between two papers, i and j, is thus deined as: R ij = R ji = X i X j X i X j. (2) Figure. shows the edge percolation results on the PNAS citation network. As shown in Fig. a, decays much aster when we irstly remove the less similar edges. Correspondingly, in Fig. b, a sharp peak appears in the edge removing process rom the weakest to the strongest ones, indicating a percolation phase transition. While i we irstly remove stronger edges, no clear peak can be observed. Analogous to the report on mobile communication network [4], this result strongly supports the weak ties phenomenon in the document network. 3. Bridgeness vs. Tie Strength As mentioned above, tie strength is a good indicator or edge s role o maintaining global connectivity. However, the strength inormation is usually hard to be obtained. In social

5 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity 5 C x E E z E y C2 Figure 2. Illustration o the bridgeness. C and C 2 are two cliques o size 5 and 4, and the edge E connects them is o bridgeness.49. networks it requires the personal inormation or historical activities, while in document networks it has to crawl the content and calculate the textual similarity. The processes are probably complicated, time consuming, or even ineasible. Thereore, an index depending only on topological inormation is o great advantage in practice. As we have mentioned, in social and document networks similar or relevant nodes are apt to connect to others and orm local clusters. Clique is the simplest structure to describe the locality in a network [29]. A clique o size k is a ully connected subgraph with k nodes [33], and the clique size o a node x or an edge E is deined as the size o maximum clique that contains this node or this edge [34, 35]. We ound that in social and document networks we observed, the clique structures o dierent sizes are prevalent. Recently, González et al [36] have reported the presence o k-clique communities in school riendship networks rom the Add Health database and the topology o c-network ormed by communities. In his work nodes shared by dierent communities are critical in connecting the c-network. Here we ocus on the roles o edges, i.e., edges in cliques mainly contribute to locality while those between cliques are important in connecting the network. Accordingly, we deine the bridgeness o an edge as Sx S y B E =, (3) S E where x and y are the two endpoints o the edge E. For example, in Fig. 2, the clique sizes o x, y and z are S x = 5, S y = 4 and S z = 3, and the clique sizes o E, E and E are S E = S E = S E = 3. An interesting and surprising result can be observed rom Fig. 3 that there is a negative correlation between bridgeness and content similarity, namely the weaker content similarity between two papers is, the stronger its bridgeness will be. Combined with the conclusion in the previous section, we iner that edges with strong bridgeness will play a more important role in maintaining the global connectivity. Fig. c shows that i the edges with larger bridgeness are removed irst (corresponding to the curve labeled by max), the network quickly splits into many pieces, while i we start removing

6 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity <B> similarity Figure 3. The relation between bridgeness and content similarity in the PNAS citation network. B is the average bridgeness value o edges with the same content similarity. the edges with smaller bridgeness (corresponding to the curve labeled by min), the network gradually shrinks. As shown in Fig. d, a sharp peak is observed in the ormer case. In addition, the critical point (corresponding to the peak in ()) in Fig. d is remarkably smaller than the one in Fig, b, indicating that the bridgeness can even better characterize the edge s signiicance in maintaining the global connectivity than the content similarity. 4. Bridgeness vs. Other Indices In this section we compare the bridgeness with some other indices or edge signiicance, which are also dependent only on the topological structure. Three representative indices used or comparison are introduced as ollows (or more inormation about how to quantiy the edge signiicance, please see Res. [37, 38, 39]). Jaccard coeicient [9]. Jaccard coeicient is deined as J E = U x U y U x U y, (4) where x and y are the two endpoints o the edge E and U x is the set o x s neighboring nodes. degree product. Degree product is deined as D E = k x k y, (5) where k x is the degree o node x. An extended orm, (k x k y ) α has been recently applied in the studies o biased percolation [2, 22, 23]. Notice that we only care

7 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity 7 about the order o the edges, so the values o α (i α > ) play no role on the results and we there choose α =, the same as in [2]. edge betweenness centrality [6]. Edge betweenness centrality counts or the number o shortest paths between pairs o nodes passing through the edge, as C E = s t σ st (E) σ st, (6) where σ st is the number o shortest paths rom node s to node t, and σ st (E) is the number o shortest paths rom s to t that pass through edge E. Notice that this index is a global index whose computing complexity is remarkably higher than the three local indices bridgeness, Jaccard coeicient and degree product. Empirical comparison is carried out on our networks. Besides the PNAS citation network, the three others are the social network o del.icio.us, political blog network and astrophysics collaboration network. Delicious data was crawled in October 29 rom the amous online social bookmarking service del.icio.us, where a user i is considered to be a an o another user j i i has seen some bookmarks collected by j, and two users are connected i they are ans o each other. The political blog network is ormed by weblogs on US politics and hyperlinks between them[4]. The astrophysics collaboration network is comprised o the coauthorships between scientists posting preprints on the Astrophysics E-Print Archive rom Jan, 995 to December 3, 999 [4]. The basic statistics o these networks is shown in Table. As shown in Fig. 4, or the PNAS citation network, edge betweenness centrality and bridgeness perorm best; or the social network in del.icio.us, degree product and bridgeness perorm best; or the political blog network and the scientiic collaboration network, bridgeness perorms best. Thereore, one can conclude that bridgeness is remarkably better than the other three indices in characterizing the edge signiicance in maintaining the global connectivity. As a local index with light computational load, bridgeness is expected to be applied in practice. 5. Conclusion and Discussion In this article, we investigate the weak ties phenomenon in document networks. Empirical analysis indicates that the weak ties, namely the edges connecting less similar nodes in content, play more signiicant role in maintaining the global connectivity. Inspired by the strong correlation between the existence o an edge and the strength o that edge [27, 29], we believe the edge signiicance in maintaining the global connectivity can be well characterized by some indices depending solely on the topological structure. Accordingly, we propose a local structural index, called bridgeness. Compared with both the content similarity and three well-known topological indices, bridgeness always leads an earlier network disintegration in the edge percolation process, indicating that bridgeness perorms best in characterizing the edge signiicance. This will help us in

8 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity J D C B J D C B.2 a.2 c b d e J D C B g h J D C B Figure 4. Edge percolation results on our real networks. Plots (a) and (b) are or the PNAS citation network, (c) and (d) or the social network o del.icio.us, (e) and () or the political blog network, and (g) and (h) or the astrophysics collaboration network. In each plot, our curves are corresponding to the our structural indices, J ( ), D( ), C( ), andb( ). ForthecaseoJaccardcoeicient,theedgesareremovedinascending order; while or the other three cases, they are removed in descending order.

9 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity 9 some real-lie applications such as controlling the spreading o diseases or rumor and withstanding the targeted attacks on network inrastructures. The percolation process is carried out on real-world networks and the results illustrate that the networks are ragile when removing edges with larger bridgeness. These networks are monopartite, i.e., nodes in these networks are o no distinction. It will be necessary to generalize the deinition o bridgeness when acing other network conigurations such as bipartite networks, as Lind et al did in [42]. Moreover, empirical analysis in more large-scale networks will also be a part o our uture work. Acknowledgements This work was partially supported by the National Natural Science Foundation o China under grant numbers and Z.-K.Z. acknowledges the Swiss National Science Foundation under grant number T.Z. acknowledges the National Natural Science Foundation o China under grant numbers 6354 and Reerences [] Albert R and Barabási A-L 22 Rev. Mod. Phys [2] Newman M E J 23 SIAM Rev [3] Boccaletti S, Latora V, Moreno Y, Chavez M and Huang D-U 26 Phys. Rep [4] Newman M E J, Barabási A-L and Watts D J 26 The Structure and Dynamics o Networks (Princeton, NJ: Princeton University Press) [5] Sabidussi G 966 Psychometrika 3 58 [6] Freeman L C 977 Sociometry 4 35 [7] Brin S and Page L 998 Comput. Netw. ISDN Syst. 3 7 [8] Liu W and Lü L 2 Europhys. Lett [9] Granovetter M 973 Am. J. Sociology [] Lai G and Wong O 22 Soc. Netw [] Levin D Z and Cross R 24 Manag. Sci [2] Csermely P 24 Trends Biochem. Sci [3] Lü L and Zhou T 2 Europhys. Lett [4] Onnela J-P, Saramäki J, Hyvönen J, Szabó G, Lazer D, Kaski K, Kertész J and Barabási A-L 27 Proc. Natl Acad. Sci. USA [5] Kumpula J M, Onnela J-P, Saramäki J, Kaski K and Kertész J 27 Phys. Rev. Lett [6] Girvan M and Newman M E J 22 Proc. Natl Acad. Sci. USA [7] Cheng X-Q and Shen H-W 2 J. Stat. Mech. P424 [8] Shen H-W, Cheng X-Q and Fang B-X 2 Phys. Rev. E [9] Jaccard P 9 Bulletin de la Société Vaudoise des Sciences Naturelles [2] Holme P, Kim B J, Yoon C N, and Han S K 22 Phys. Rev. E [2] Giuraniuc C V, Hatchett J P L, Indekeu J O, Leone M, Pérez Castillo I, Van Schaeybroeck B and Vanderzande C 25 Phys. Rev. Lett [22] Moreira A A, Andrade J S, Herrmann H J and Indekeu J O 29 Phys. Rev. Lett [23] Hooyberghs H, Van Schaeybroeck B, Moreira A A, Andrade J S Jr, Herrmann H J and Indekeu J O 2 Phys. Rev. E 8 2 [24] Lazarseld P and Merton R K 954 Freedom and Control in Modern Society (New York: Van Nostrand) p 8-66 [25] McPherson J M, Smith-Lovin L and Cook J 2 Ann. Rev. Sociol

10 Bridgeness: A Local Index on Edge Signiicance in Maintaining Global Connectivity [26] Rapoport A 953 Bull. Math. Biophys [27] Menczer F 24 Proc. Natl Acad. Sci. USA 526 [28] Cheng X-Q, Ren F-X, Cao X-B and Ma J 27 Proc. IEEE/WIC/ACM Intl. Con. Web Intell. (Washington D. C.: IEEE Press) p 8-84 [29] Cheng X-Q, Ren F-X, Zhou S and Hu M-B 29 New J. Phys. 339 [3] Stauer D and Aharony A 994 Introduction to Percolation Theory, 2nd (London: CRC Press) [3] Bunde A and Havlin S 996 Fractals and Disordered Systems, 2nd (New York: Springer) p 5 [32] Salton G 989 Automatic text processing: the transormation, analysis, and retrieval o inormation by computer (Reading, MA: Addison-Wesley) [33] Xiao W-K, Ren J, Qi F, Song Z-W, Zhu M-X, Yang H-F, Jin H-J, Wang B-H and Zhou T 27 Phys. Rev. E [34] Shen H-W, Cheng X-Q, Cai K and Hu M-B 29 Physica A [35] Shen H-W, Cheng X-Q and Guo J-F 29 J. Stat. Mech. P742 [36] González M C, Herrmann H J, Kertész J and Vicsek T 27 Physica A [37] Liben-Nowell D and Kleinberg J 27 J. Am. Soc. Inorm. Sci. Technol [38] Fouss F, Pirotte A, Renders J-M and Saerens M 27 IEEE Trans. Knowl. Data Eng [39] Zhou T, Lü L and Zhang Y-C 29 Eur. Phys. J. B [4] Adamic L A and Glance N 25 Proc. WWW 25 Workshop on the Weblogging Ecosystem (New York: ACM Press) p 43 [4] Newman M E J 2 Proc. Natl Acad. Sci. USA [42] Lind P G, González M C and Herrmann H J 25 Phys. Rev. E