arxiv: v1 [physics.soc-ph] 2 Sep 2008

Transcription

1 The first-mover advantage in scientific publication M. E. J. Newman Department of Physics and Center for the Study of Complex Systems, University of Michigan, Ann Arbor, MI 489 arxiv:89.522v [physics.soc-ph] 2 Sep 28 Mathematical models of the scientific citation process predict a strong first-mover effect under which the first papers in a field will, essentially regardless of content, receive citations at a rate enormously higher than papers published later. Moreover papers are expected to retain this advantage in perpetuity they should receive more citations indefinitely, no matter how many other papers are published after them. We test this conjecture against data from a selection of fields and in several cases find a first-mover effect of a magnitude similar to that predicted by the theory. Were we wearing our cynical hat today, we might say that the scientist who wants to become famous is better off by a wide margin writing a modest paper in next year s hottest field than an outstanding paper in this year s. On the other hand, there are some papers, albeit only a small fraction, that buck the trend and attract significantly more citations than theory predicts despite having relatively late publication dates. We suggest that papers of this kind, though they often receive comparatively few citations overall, are probably worthy of our attention. In an influential paper published in 965, the physicistturned-historian-of-science Derek de Solla Price presented one of the first quantitative studies perhaps the first of patterns of citations between learned papers []. His article, entitled Networks of scientific papers, depicted papers as the nodes of a network of information, linked together by the citations between them. He noted a number of striking features of this network, chief among them the skewed distribution of citation frequency under which most papers received only a small number of citations but there was a long tail consisting of a few papers cited very many times. More specifically he showed that the fraction p k of papers within his sample that were cited exactly k times diminished with increasing k according to a Pareto distribution or power law p k k α with α a constant, a result that has since been confirmed in other larger studies [2, 3]. In the jargon of modern network analysis, the citations between papers form a scale-free network [4]. In a follow-up paper published a few years later, Price [5] proposed a remarkably simple explanation for this observation. He suggested that citation was subject to what he called a cumulative advantage process [6], whereby papers that had been cited many times in the past were more likely to be cited again, resulting in a compound interest effect under which the best cited papers became ever better cited, leaving their less popular counterparts behind. Price proposed a mathematical model of this process and solved it to show that indeed it gives rise to a power-law distribution of citation frequencies. Inspired, among other things, by the distribution of links between pages on the world wide web, which also appears to follow a power law, a similar process now with the new name of preferential attachment was independently proposed by Barabási and Albert in 999 [4] and elaborated upon extensively by a number of authors [8, 9, ]. As a result of this and subsequent work, the mathematics of preferential attachment and the power-law distributions it produces is now quite well understood. The preferential attachment mechanism is qualitatively plausible in citation networks one can certainly imagine that papers cited many times in the past are more likely to be read and cited again. There is also good empirical evidence in its favor [], although deviations from its predictions have been observed in some data sets [2, 3, 4], especially those that span large periods of time. Overall, however, the preferential attachment mechanism is widely considered to be a reasonable, if simplistic, explanation for the long tail in citation networks. What is less widely appreciated, perhaps, is that preferential attachment, if correct, would also imply a variety of other distinctive features in citation networks that could, at least in principle, be observed empirically. In particular, as we discuss here, it should produce a strong first-mover advantage, under which the first papers published on a topic should enjoy far higher rates of citation, in perpetuity, than those that come after them. That preferential attachment should imply some kind of first-mover advantage has been pointed out by Adamic and Huberman [5], who looked for such effects in web data but found no evidence that they existed. In scientific citation, by contrast, it is almost axiomatic that the first papers in a field are important and should be highly cited [4], although it s unclear how large the effect should be. In this paper we calculate the size of the first-mover effect within the preferential attachment model and compare the results with citation data from a number of fields. We find not only that scientific citation shows a substantial first-mover effect, but that the size and duration of the effect often agree closely with the theoretical predictions. The first-mover advantage In the model of citation proposed by Price [5], it is assumed that on average each paper published cites m

2 2 previous papers, which are chosen in proportion to the number k of citations they already have plus a positive constant r. The constant is necessary to ensure that papers with no previous citations which is all papers upon first appearance can still receive citations. Price himself studied only the case r =, but the generalization to other cases is trivial. The model also includes the widely studied model of Barabási and Albert [4] as a special case when r = m. The model can be solved exactly for the citation distribution in the limit of a large number of papers using a master-equation method introduced by Simon [5, 6, 7]. The solution shows that the fraction p k of papers with exactly k citations in the model network is where p k = B(k + r, α) B(r, α ), () B(a, b) = Γ(a)Γ(b) Γ(a + b) (2) is the Euler beta function, Γ(a) is the standard gamma function, and α = 2 + r m. (3) For large values of its first argument, the beta function has the asymptotic form B(a, b) a b, and hence the tail of the citation distribution has a power-law form p k k α, just as in the empirical data. There is much more that can be done with the model, however, than just calculating total numbers of citations. In particular, one can calculate the full distribution of citations a paper should receive as a function of its date of publication. Suppose n papers in all have been published and let p k (i, n) be the probability that the i th paper has exactly k citations. Then, as shown for the case m = by Krapivsky and Redner [7] and more generally by Dorogovtsev and Mendes [9], p k (i, n) satisfies the master equation (n + )p k (i, n + ) = np k (i, n) + m [ (k + r)pk (i, n) (k + r)p k (i, n) ]. m + r (4) The only exception to this equation is for the case k =, where instead we get (n+)p (i, n+) = np (i, n)+δ in mr m + r p (i, n). (5) Notice the Kronecker delta, which adds a single paper with k = if i = n, but none otherwise. In [9, 7] these equations are solved using a continuoustime method in which the discrete difference equation is approximated by a differential equation. Here we take a slightly different approach that leads to the same conclusions but avoids the approximation. Let us define a time variable t such that the i th paper published has t = i/n. (Technically t need have nothing to do with actual time it measures only the sequence of publications so the model can be used even if the rate of appearance of publications is not constant over time, a common situation.) At the same time let us also change from p k (i, n) to a density function π k (t, n) such that π k (t, n) dt is the expected fraction of papers that have been cited k times and fall in the interval from t to t + dt. Substituting for these quantities in Eqs. (4) and (5), taking the limit of large n, and introducing the shorthand notation π k (t) for the limiting distribution π k (t, ), we find that (k + r)π k (t) (α )t dπ k dt = (k + r)π k (t), (6) with the convention that π (t) = for all t, α defined as in (3), and boundary conditions π k () = δ k,. It is straightforward to verify that these equations have the solution π k (t) = Γ(k + r) Γ(k + )Γ(r) tr/(α )( t /(α )) k, (7) which is equivalent to the solution given in [9], and from this one can calculate the average number γ(t) of citations a paper receives as a function of its time of publication: γ(t) = kπ k (t) = r ( t /(α ) ). (8) k= The first thing to notice about this expression is that it becomes arbitrarily large as t, meaning that, if the assumptions of the model are correct, papers published early on should expect to receive far more citations than those published later, even after allowing for the fact that later papers have less time to accrue citations. This is the first-mover advantage. In effect, as argued in [5], the model predicts not only that there will be a long tail to the citation distribution, but that the tail will be composed principally of the earliest papers published. The common-sense reasoning behind this observation is that papers published early in a field receive citations essentially regardless of content because they are the only game in town. Authors feel the need to cite something and if there is only a small number of relevant publications then inevitably those publications get cited. This gives the earliest publications a head start that is subsequently amplified by the preferential attachment process and they continue to receive citations indefinitely at a higher rate than later papers because they have more citations to begin with. There may be some truth to this. It is not uncommon to hear a scientist grumble about a paper that, in their opinion, receives citations only because everybody cites that paper. More to the point, citing a paper because it

3 3 Cumulative distribution function Probability density (a) (b) Citations k 3 (c) (d) (e) 2 Average citations γ (t) FIG. : Statistics of citations to papers about the theory of networks. Empirical measurements are in brown; theoretical predictions are in black. (a) Cumulative distribution of number of citations received by a paper. The best fit to the theory is achieved for α = 2.28, r = (b) Mean number of citations received by papers as a function of time from beginning (t = ) to end (t = ) of the period covered. (c), (d) and (e): Probability that a paper with a given number of citations is published at time t for papers with (c) or 2 citations, (d) 3 to 5 citations, and (e) 6 to citations. was the first in an area is in most cases entirely appropriate: the first researcher to bring an issue to the attention of the scientific community surely deserves credit for it, regardless of whether the other details of their paper turn out later to be important. On the other hand, it is clear that the detailed contents of a paper usually do play a role in determining the attention it receives [4, 8] and thus the preferential attachment model cannot be a complete representation of the citation process. Nonetheless, as we now show, it turns out in some cases to describe the statistical features of real citation networks with surprising accuracy. Comparison with citation data Testing the preferential attachment model against citation data poses some challenges. It is clear, for a start, that the model cannot be considered seriously as a representation of the entire citation network, the network of all papers ever published, since the literature is divided into many fields with most citations falling between papers in the same field. In the best of worlds, therefore, the model could only reasonably be considered to describe citations within a single field. Moreover, given that a large part of our interest here focuses on the qualities of the earliest papers published, we need to find data that describe a field from its earliest foundation and such data can be hard to come by. Figure shows one relatively clean example, a citation network of papers on network theory the topic of this very paper. Within the hard sciences this is a field of relatively recent provenance, attracting an impressive volume of research since the late 99s but almost none before that. (Its history in the social sciences is much longer, as Price s work attests, but cross-citation between the areas is rare enough as to be negligible a lucky feature for our analysis, although an unfortunate one for the progress of science.) Our citation network for this example consists of five early and well cited papers in the field [4, 8, 9,, 9] along with all papers that cite them, but excluding review articles, which tend to have distinctively different citation patterns, and restricted to papers in physics and related areas. The resulting data set contains 247 papers in all spanning a ten-year period from June 998 to June 28. Figure a shows the complete distribution of numbers of citations to these papers, along with the best fit to the form (). As we can see, this two-parameter fit is remarkably good, and allows us to extract accurate values for r and α from the data. In Fig. b, we show the average number of citations received by papers

4 4 as a function of time, where time is measured, as in the model, in terms not of publication date but of publication order. We also show the predicted value of the same quantity from Eq. (8), and this is now, effectively, a zero-parameter fit, since the two parameters appearing in the formula have already been fixed. Nonetheless, the agreement between data and theory is again good, and in particular the data show a clear first-mover effect of a magnitude and duration very similar to that predicted by the model. As we mentioned above, the effect is sizable: the first % of papers in this example received an average of citations each, while the second % published only a little later received just 26. The most recent % of papers in the data set received a miserable.8 citations each, meaning that most of them have never been cited at all. Highly cited papers We can take our analysis further. Figure c e shows a detailed comparison of the actual distribution of citations at different times against the theoretical predictions. Again the fit is quite good, although there are some interesting differences between data and model now visible. In particular, there are noticeably more papers published at early times in each degree range than predicted by the theory and correspondingly fewer around the peak value, meaning that not all papers in the early period are benefiting from the first-mover advantage; we hope this is a positive sign that citation rates are reflecting on paper content at least to some extent. More interestingly perhaps, there are also a scattering of papers that are cited substantially more than expected. These are few enough in number that they have little visible effect on the figure, but the number of citations they receive puts them well outside the expected range. And this leads us to an interesting possibility. It is common to assess the importance of papers according to the number of citations they receive, but the results presented here suggest that a large part of the variation in citation numbers is a result of publication date rather than paper content. If, however, we measure a paper s citation count relative to the average in its field for the given publication date, then this effect is factored out and perhaps the true stars of the citation galaxy will emerge. We have done this for our network theory data set, calculating a z-score for each paper that measures the number of standard deviations by which its citation count surpasses the appropriate mean [2]. The bestcited papers by this measure turn out to be roughly evenly distributed over the ten-year period covered by the data set, as shown in Fig. 2, a sign that perhaps the technique is indeed factoring out effects of timing. Some early seminal works such as Ref. [9], which at 2623 citations is the most cited paper in the data set, score highly (7.σ above the mean for its publication date), z-score Cumulative distribution function 5... Citations k All data Last 9% Last 75% Last 5% FIG. 2: Top: citations to papers in network theory measured in terms of number of standard deviations, or z-score, above the mean for papers published around the same date. For clarity, only papers with z-score greater than 2 standard deviations (dotted line) are shown. Bottom: cumulative distribution function for subsets of papers in the data set. The top curve represents the full data set, as in Fig. a, while the other three represent the most recent 9%, 75%, and 5% of papers, respectively. Points represent observed values and solid lines represent the theoretical prediction, Eq. (). but so do some later papers such as Ref. [2] (6.5σ above the mean with 233 citations). And Ref. [22] beats out both of these at 7.2 standard deviations above the mean even though its relatively recent 26 publication date means it has received only 63 citations so far. On the basis of these observations one might tentatively predict that this paper (and others like it) will turn out to be influential. The appearance of well cited papers relatively late in the development of a field is an encouraging sign that true citation patterns don t just mindlessly follow the preferential attachment rule. To quantify this phenomenon further, we consider the overall distribution of numbers of citations for papers in the latter part of our citation time series. Suppose we are interested in papers published after some time t. Their distribution within the preferential attachment model, which we ll denote p k (t ),

5 5 can be calculated by integrating Eq. (7) thus: p k (t ) = t = ( t ) π k (t) dt t Γ(k + r) t r/(α ) ( t /(α ) ) k dt. Γ(k + )Γ(r) t (9) With the substitution u = t /(α ), the integral can be performed and the complete result written in the form where p k (t ) = I u (k +, α + r ) t p k (), () I x (a, b) = B(a, b) x u a ( u) b du () is the regularized incomplete beta function and u = t /(α ). Note that p k () is simply the distribution for the complete network given in Eq. (), so that the incomplete beta gives us the factor by which the distribution for the later papers differs from the complete distribution. For large a and fixed b, as here, I x (a, b) has the asymptotic form I x (a, b) a b x a [27] and hence I u (k +, α + r ) k α+r 2( t /(α ) ) k. (2) Thus the citation distribution becomes exponentially truncated with a typical scale k = ln ( t /(α ) ), (3) which for small values of t is well approximated by k t /(α ). Put in simple terms, when we consider the citation distribution for just the later papers in a field and exclude the earlier ones, we tend to throw out the papers with the highest numbers of citations. Thus one expects to find a distribution in which few papers are highly cited. When we look at the data, however, we find poor quantitative agreement with the formulas above in the tail of the distribution. The lower panel in Fig. 2 shows the appropriate plot for our network science example. As the figure shows, the tail of the distribution is diminished when we exclude the earliest papers in the data set, but by not as much as the theory predicts. Overall the tail still appears relatively long. It no longer follows the power-law form, but neither is it well described by the predicted exponential. Within the preferential attachment model it is almost impossible for later papers in a network to get very many citations because there are only a fixed number of citations to go around and most of them are going to the earliest papers. In Fig. 2, on the other hand, it is clear that a substantial number of later papers are receiving large numbers of citations, a hopeful sign that we as scientists do pay at least some attention to good papers that come along later. Other examples These analyses are for just one example field, which provides a particularly clear instance of the first-mover effect. The same methods can be applied to other fields, though the results aren t often as clean. There are a variety of issues that can complicate the analysis. Some are straightforward data problems: it may be difficult to restrict the set of papers analyzed to those that truly fall in just one area, or to be sure that you have captured all the relevant papers, or both. It may even be unclear when a field started at all (when did research on apple trees begin?), or it may have started so long ago that modern concepts of citation don t apply. However, there are also some cases where differences between observation and theory reveal behaviors of real scientific interest. Two examples are shown in Fig. 3. Panel (a) shows the curve of average citation number for the subfield of particle physics concerned with theories of strange matter [23, 24] a topic that has at the time of writing been receiving some attention with the startup of the Large Hadron Collider. As the figure shows, there is again good general agreement between observed citation counts and the model, and a strong first-mover advantage similar in size to that predicted by the theory, an interesting finding given that this data set spans an interval of 24 years far longer than that of Fig.. However, there is now also an additional bump in citation intensity in the latter half of the time period, corresponding to papers published around and denoted roughly by the dotted line in the figure. This bump, we assume, is a result of true scientific developments in the field, though we leave the experts in the area to suggest what developments those might be. More substantial deviations from the theory arise when a branch of the literature assumed to represent a new field turns out in fact to be merely a subset of a larger, alreadyestablished field. In this case, we would not expect to see a first-mover effect at all. The first papers published in such a branch will be cited at a level typical of their position in the middle of the larger subject area, and not as they would if they were the only game in town. We give an example of behavior of this type in Fig. 3b, which shows citations to papers about adult neural stem cells. The discovery that neural stem cells exist not only during development but in adult animals as well [25, 26] has resulted in a healthy quantity of subsequent research, but it has not, at least according to our analysis, created a new field. As Fig. 3b shows, the fit between the observed citation record and the theory is poor in this case and in particular the data show no discernible firstmover effect. Earlier papers in the data set do have more citations, but citation numbers appear to increase only linearly with paper age, suggesting that on average papers are being cited at roughly the same rate regardless of when they were published. A qualitative inspection of the data set indicates that in fact the adult neural stem cell literature forms just a part of a larger community

6 6 8 Average citations γ (t) (a) (b) FIG. 3: Mean number of citations received as a function of time for papers on (a) strangelets and strange matter and (b) adult neural stem cells, along with theoretical predictions. The foundational papers used to construct the two networks were [23, 24] and [25, 26], respectively. of citation on neural stem cells in general and hence we indeed expect no first-mover effect in this case. Analyses of the type described here could thus, in principle, provide an independent test of claims, frequent in some areas, that a particular publication or discovery has created a new field of science. We repeat our caution, however, that the data are not always as clean as we would like and it is not always possible to make a firm statement one way or the other. Conclusions In conclusion, the strong first-mover advantage predicted by theories of the scientific citation process seems to be quantitatively substantiated by empirical citation data, at least in some areas. The cynical observer would, it appears, have some justification in concluding that if you want to be well cited you are better off writing the first paper in such an area than writing the best. Other areas, by contrast, show no first-mover effect, which may be an indication that those areas do not constitute selfcontained research fields as assumed by the theory. And even in cases where the first-mover effect is strong, a small number of later papers do seem buck the trend and attract significant attention in defiance of predictions. We tentatively suggest that the reader looking for true breakthroughs could do worse than keep an eye out for papers such as these. Acknowledgments The author thanks Carrie Ferrario, Loet Leydesdorff, Robert Messing, Aaron Pierce, and Sidney Redner for useful suggestions. This work was funded in part by the National Science Foundation under grant DMS and by the James S. McDonnell Foundation. [] D. J. de S. Price, Networks of scientific papers. Science 49, 5 55 (965). [2] P. O. Seglen, The skewness of science. J. Amer. Soc. Inform. Sci. 43, (992). [3] S. Redner, How popular is your paper? An empirical study of the citation distribution. Eur. Phys. J. B 4, 3 34 (998). [4] A.-L. Barabási and R. Albert, Emergence of scaling in random networks. Science 286, (999). [5] D. J. de S. Price, A general theory of bibliometric and other cumulative advantage processes. J. Amer. Soc. Inform. Sci. 27, (976). [6] A related phenomenon, the Matthew effect, was previously discussed by Merton [7], who observed that the simultaneous discovery of an important result by two different scientists is more likely to be credited to the more famous of the two, so that fame begets more fame. [7] R. K. Merton, The Matthew effect in science. Science 59, (968). [8] R. Albert and A.-L. Barabási, Statistical mechanics of complex networks. Rev. Mod. Phys. 74, (22). [9] S. N. Dorogovtsev and J. F. F. Mendes, Evolution of networks. Advances in Physics 5, (22). [] M. E. J. Newman, The structure and function of complex networks. SIAM Review 45, (23). [] H. Jeong, Z. Néda, and A.-L. Barabási, Measuring preferential attachment in evolving networks. Europhys. Lett. 6, (23). [2] K. Börner, J. T. Maru, and R. L. Goldstone, The simultaneous evolution of author and paper networks. Proc. Natl. Acad. Sci. USA, (24). [3] S. Lehmann and A. D. Jackson, Life, death, and preferential attachment. Europhys. Lett. 69, (25). [4] S. Redner, Citation statistics from years of Physical Review. Physics Today 58, (25). [5] L. A. Adamic and B. A. Huberman, Power-law distribu-

7 7 tion of the world wide web. Science 287, 25 (2). [6] H. A. Simon, On a class of skew distribution functions. Biometrika 42, (955). [7] P. L. Krapivsky and S. Redner, Organization of growing random networks. Phys. Rev. E 63, 6623 (2). [8] O. Amsterdamska and L. Leydesdorff, Citations: Indicators of significance? Scientometrics 5, (989). [9] D. J. Watts and S. H. Strogatz, Collective dynamics of small-world networks. Nature 393, (998). [2] Mean and standard deviation are calculated as averages over papers in a Gaussian-weighted window of width papers around the paper of interest. [2] A. Barrat, M. Barthelemy, R. Pastor-Satorras, and A. Vespignani, The architecture of complex weighted networks. Proc. Natl. Acad. Sci. USA, (24). [22] H. Ohtsuki, C. Hauert, E. Lieberman, and M. A. Nowak, A simple rule for the evolution of cooperation on graphs and networks. Nature 44, (26). [23] E. Witten, Cosmic separation of phases. Phys. Rev. D 3, (984). [24] E. Farhi and R. L. Jaffe, Strange matter. Phys. Rev. D 3, (984). [25] B. A. Reynolds and S. Weiss, Generation of neurons and astrocytes from isolated cells of the adult mammalian central-nervous-system. Science 255, 77 7 (992). [26] B. A. Reynolds, W. Tetzlaff, and S. Weiss, A multipotent EGF-responsive striatal embryonic progenitor-cell produces neurons and astrocytes. J. Neurosci. 2, (992). [27] W. Gautschi, Computational aspects of three-term recurrence relations. SIAM Review 8, (967).