Neversdorf, September 2010 Visualisation of knowledge domains in interdisciplinary research organizations Ismael Rafols 1,2 1 SPRU -- Science and Technology Policy Research University of Sussex, Brighton, England 2 School of Public Policy, Georgia Institute of Technology, Atlanta Work with Loet Leydesdorff (U. Amsterdam), Alan Porter (Georgia Tech) and Andy Stirling (SPRU)
1. Practical problems of interdisciplinary research Paradoxical incentives in science system: Narrow performance indicators Addressing societal issues narrowing broadening Compensation narrow performance with measures of interdisciplinarity Ex ante and ex-post evaluation Science and Technology Indicators 2010 request to SRI Nat l Acad Keck Found Init, NIH/NCI Tabacco research programme HEFCE (wants to show that IDR IS not discriminated against) NESTA (wants to show that IDR IS not properly rewarded in citations) Policy makers want a measure of IDR
IDR as Integration basis for indicators Interdisciplinary research (IDR) is a mode of research by teams or individuals that integrates information, data, techniques, tools, perspectives, concepts, and/or theories from two or more disciplines or bodies of specialized knowledge to advance fundamental understanding or to solve problems whose solutions are beyond the scope of a single discipline or area of research practice. National Academy of Sciences, 2004. INTEGRATION Most bibliometric indicators of interdisciplinarity implicitly rely on this idea: Diversity of disciplines Integrated in the reference list 3
Heuristics of diversity (Stirling, 1998; 2007) Diversity: attribute of a system whose elements may be apportioned into categories Characteristics: Variety: Number of distinctive categories Balance: Evenness of the distribution Disparity: Degree to which the categories are different. Variety Balance Disparity 4
Global Science Map 2007 Infectious Diseases Agri Sci Ecol Sci Geosciences Env Sci & Tech Clinical Med Chemistry Matls Sci Cognitive Sci. Biomed Sci Engineering Psychology Health & Social Issues Physics Business & MGT Computer Sci Social Studies CD-ROM version of the JCR of SCI and SSCI of 2007. Econ Polit. & Geography Matrix of cross-citations between journals (8,000 x 8000) Collapse to ISI Subject Category matrix (221 x 221) Create similarity matrix using Salton s cosine Make Factor Analysis ISI Subject Categories Cos. Similarity Citing > 0.15 Factor Analysis (18) Kamada-Kawai Layout Pajek
Global maps have a similar core structure: torus-like Two large poles : Biomed Sci. Physics-Eng Lone constellation Social Sci. Four linking areas: Chemistry Geo-, Env-, Agr- Comp. Sci. Cognitive-Psych. 2006 Map
Overlay maps of science tools to open up discussion Infectious Diseases Agri Sci Ecol Sci Geosciences EnvSci& Tech Biomed Sci Chemistry Clinical Med Matls Sci Cognitive Sci. Engineering Psychology Health & Social Issues Computer Sci Physics Business & MGT Social Studies Freeze the positions of SC Overlay the desired characteristic (# pubs, growth) Econ Polit. & Geography Georgia Tech 2000-2009
Public Research Organisations U. Amsterdam Georgia Tech EMBL LSE
Funding agencies NIH NSF BBSRC EPSRC
Heuristics of diversity (Stirling, 1998; 2007) Diversity: attribute of a system whose elements may be apportioned into categories Characteristics: Variety: Number of distinctive categories Balance: Evenness of the distribution Disparity: Degree to which the categories are different. Stand. Meas. do not include distance Variety Shannon (Entropy): p i i ln p i Herfindahl (concentration): i p i 2 Dissimilarity: i d i Balance Disparity Generalised Diversity (Stirling) ij(i j) (p i p j ) α (d ij ) β 10
How can we capture knowledge integration? Diversity: number, balance and disparity of bodies of knowledge (disciplines) Rao-Stirling Diversity= Σ p(i)p(j)d(i,j) Expected distance between elements in ensemble Coherence: the extent that the elements of a system (disciplines) become articulated (related). Actual distance = Σ p(i, j)d(i,j) Metrics of Integration: Coherence/Diversity Average distance between elements in ensemble
Disciplines of SPRU publications 134 publications by current SPRU researchers in 2006-2010 (Feb.) 12
Expected citations, given disciplines of publication Threshold>10 citations. Size of Nodes is Number of Cited References in SC. Oceanography Meteorology & Atmospheric Sciences Veterinary Sciences Immunology Water Resources Ecology Environmental Sciences Nutrition & Dietetics Engineering, Civil Genetics & Heredity Biotechnology & Applied Microbiology Energy & Fuels Multidisciplinary Sciences History & Philosophy Of Science Pharmacology & Pharmacy Medicine, General & Internal Engineering, Multidisciplinary Computer Science, Interdisciplinary Applications Public, Environmental & Occupational Statistics Health & Probability Psychology, Multidisciplinary Computer Science, Information Systems Engineering, Industrial Operations Research & Management Science Education & Educational Research Social Issues Social Sciences, Interdisciplinary Social Sciences, Mathematical Methods Mathematics Communication Sociology Management Planning & Development Economics History Of Social Sciences Public Administration Business Information Science & Library Science Environmental Studies Political Science Law Anthropology Geography 13 Pajek
Actual citations between disciplines in SPRU publications Threshold>10 citations. Size of Nodes is Number of Cited References in SC. Oceanography Meteorology & Atmospheric Sciences Veterinary Sciences Immunology Ecology Water Resources Environmental Sciences Nutrition & Dietetics Engineering, Civil Genetics & Heredity Biotechnology & Applied Microbiology Energy & Fuels History & Philosophy Of Science Multidisciplinary Sciences Pharmacology & Pharmacy Medicine, General & Internal Engineering, Multidisciplinary Computer Science, Interdisciplinary Applications Public, Environmental & Occupational Statistics Health & Probability Psychology, Multidisciplinary Computer Science, Information Systems Engineering, Industrial Operations Research & Management Science Education & Educational Research Communication Sociology Social Issues Social Sciences, Interdisciplinary Management Business Planning & Development Economics Social Sciences, Mathematical Methods History Of Social Sciences Public Administration Information Science & Library Science Political Science Environmental Studies Mathematics Law Anthropology Geography 14 Pajek
SPRU related journals Security Env. Ecol. Studies Geography Energy Environ. Sci. Mngmt & Org. Devel. Economics Multidiscip Nat.Sci. Risk & Policy Human Resources Mngmt & Innov STS Health Scientometrics 15
Journals CITED by SPRU researchers 16
Expected Cross-citations given SPRU journals of publications At least 4 citations between journals 17
Actual cross-citations between Journals At least 4 citations between journals 18
2. What can PHIL contribute to an understanding of IDR? Even narrow definition of IDR (diversity in refs) requires crucial conceptual choices: What are the disciplines? What is to be counted as IDR? Variety / Disparity / Disparity Which level of aggregation? Use maps and metrics to open up discussion rather than close it down. Maps, metrics (and rankings) will not go. We need: Rigorous and engaged critique De-construction and re-conceptualisation of tools and their usage