ASSESSING THE QUALITY OF SCHOLARLY PUBLISHING U N I V E R S I T A S N E G E R I S E M A R A N G J U L Y, 2 017 S U H A R T O @ M A I L. U N N E S. A C. I D E D I T O R D O A J
INDEXING SERVICES for quality control DOAJ Directory of Open Access Journals O P E N A C C E S S J O U R N A L S O N L Y, n o r a n k i n g SCOPUS O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S, r a n k i n g WEB OF SCIENCE O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S, r a n k i n g NATIONAL LIST/SINTA O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S r a n k i n g g r o u p
NATIONAL LIST/SINTA
Assessing the Quality of a Journal QUALITY OF PUBLISHING QUALITY OF THE SCIENCE
What is the DOAJ? FREE to register and FREE to use The only global index of trusted, high quality, peerreviewed, open access journals, from all academic disciplines, curated by the community https://doaj.org/
Recognition of the DOAJ?
Use of DOAJ Data EBSCO ROAD NATIONAL LISTS MANY OTHER ORGANIZATIONS ROAD contains DOAJ journals + hybrids + repository material + blogs +
DOAJ STRUCTURE
CERTIFICATE
WHAT IS QUALITY OPEN ACCESS? The BOAI Definition Open Access is: a publishing system where all content is freely available without charge to the user or his/her institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles, or use them for any other lawful purpose, without asking prior permission from the publisher or the author.
Essential criteria Copyrights Clearly described on web site* Recommend: author retains copyright Recommend: no exclusive publishing rights Recommend: no transfer of commercial rights https://doajournals.wordpress.com/2015/06/02/copyright-and-licensing-part-2/
Essential criteria Content Licensing Clearly described on web site* Recommend: licensing terms on all articles, all versions (html, pdf, xml etc.) embedded in article level metadata Creative Commons licensing
COPYRIGHT AND LICENCING What is a license? Licensing means to grant a third party (anyone else except the right holder) the right to use a copyright-protected work A license is a permission to use a work in specific ways Licenses can only be granted by copyright holder Copyright holder can be author or publisher
Global open access map http://www.openaccessmap.org
DOAJ JOURNALS global distribution
Open Access policy in EU 100 % Open Access in 2020 scholarly communication open access open data open science
Open Access Government policies Netherlands gold open access by 2024 DOAJ list recognized Nordic countries list of accredited journals for government funded research DOAJ list for open access journals government funding DOAJ Algeria government website for journal hosting required listing in DOAJ required open access (no set date) Indonesia Permenristekdikti No 20 in 2017? Minister speech:http://www.dikti.go.id/menristekdikti-dorong-dosen-tingkatkan-publikasi-ilmiah/
Cost of Open AccessPublishing Situation is not transparant What does a publication cost? (< 2000) Open APC (info on basis of Freedom of Information Act) https://treemaps.intact-project.org/
Assessing Quality of Research o T H E B A S I C S : o PEER-REVIEW o CITATION ANALYSIS
Citations & Quality of Research T H E S C I E N T I F I C Q U A L I T Y O F A N A R T I C L E C A N N O T B E A S S E S S E D B Y C I T A T I O N S A L O N E o T H E S C I E N T I F I C Q U A L I T Y O F A J O U R N A L C A N N O T B E A S S E S S E D A T A L L B Y T H E A V E R A G E C I T A T I O N S C O R E S O F A R T I C L E S ( T H E J O U R N A L I M P A C T F A C T O R J I F )
Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers highly skewed distribution of citations Journal elife 8.3 71.2% EMBO J. 9.6 66.9% J. Informetrics 2.4 68.4% Nature 38.1 74.8% Nature Comm. 11.3 74.1% PLOS Biol. 8.7 66.8% PLOS Genet. 6.7 65.3% PLOS ONE 3.1 72.2% Proc. R. Soc. B 4.8 65.7% Science 34.7 75.5% Sci. Rep. 5.2 73.2% JIF % citable items Table 2: Percentage of papers published in 2013-2014 with number of citations below the value of the 2015 JIF. below JIF 0 10 20 30 40 50 60 70 80 90 100+ Larivière et al. (2016) 90 80 70 60 50 40 30 20 10 0 80 70 60 50 40 30 20 10 0 200 180 160 140 120 100 80 60 40 20 0 70 60 50 40 30 20 10 0 elife 0 10 20 30 40 50 60 70 80 90 100+ Number of citations Nature 0 10 20 30 40 50 60 70 80 90 100+ Number of citations PLOS Genet. 0 10 20 30 40 50 60 70 80 90 100+ Number of citations Science Number of citations 45 40 35 30 25 20 15 10 5 0 400 350 300 250 200 150 100 50 0 14,000 12,000 10,000 8,000 6,000 4,000 2,000 0 1,200 1,000 800 600 400 200 0 EMBO J. 0 10 20 30 40 50 60 70 80 90 100+ Number of citations Nature Comm. 0 10 20 30 40 50 60 70 80 90 100+ Number of citations PLOS ONE 0 10 20 30 40 50 60 70 80 90 100+ Number of citations Sci. Rep. 0 10 20 30 40 50 60 70 80 90 100+ Number of citations 60 50 40 30 20 10 0 45 40 35 30 25 20 15 10 5 0 200 180 160 140 120 100 80 60 40 20 0 J. Informetrics 0 10 20 30 40 50 60 70 80 90 100+ Number of citations PLOS Biol. 0 10 20 30 40 50 60 70 80 90 100+ Number of citations Proc. R. Soc. B 0 10 20 30 40 50 60 70 80 90 100+ Number of citations doi: http://dx.doi.org/10.1101/ 062109
New Citation Based Metrics for Journals: Journal CiteScore only deals with discipline citing bias
San Francisco Declaration on Research Impact It doesn t matter where you publish or how much you publish, research assessment should not be based on journal citation analysis like JIF or number of articles published http://www.ascb.org/dora/
What can we do with Citations? T R A C E T H E S O U R C E O F D A T A M A K E R E S E A R C H C O N N E C T I O N S / N E T W O R K S V I S I B L E F I N D K E Y P A P E R S F O R S P E C I F I C T O P I C S ( O P E N C I T A T I O N S C O R P U S, P A R T O F I S 4 O A ) B U T : N O C O N C L U S I O N S O N I M P A C T F R O M A V E R A G E C I T A T I O N S C O R E S N O C O N C L U S I O N S O N Q U A L I T Y F R O M N U M B E R O F C I T A T I O N S Blog.plos.org/biologue 1104029017
Initiative for Open Citations I4OC
Another kind of Quality Article Level Impact Assessment not quite the same as Quality rather relevance ALTMETRICS T A K I N G I N T O A C C O U N T T O T A L E X P O S U R E, D I S S E M I N A T I O N, C I T A T I O N S, S O C I A L M E D I A, C O N V E N T I O N A L M E D I A ( N E W S P A P E R S, T V, V I D E O ) Springer/nature Elsevier Wiley
DOAJ Future Plans I N T E G R A T I O N O F A L T M E T R I C S C O R E S I N T E G R A T I O N O F O R C I D S E M I - A U T O M A T I C I N D E X U P D A T E S A N D S C R E E N I N G S E M A N T I C L I N K I N G O F S P E C I F I C C O N T E N T I M P R O V E D S E A R C H P O S S I B I L I T I E S W O R L D W I D E A M B A S S A D O R PROGRAMMES
The problem of questionable journals Is it a problem?? How DOAJ detects questionable journals Low publishing quality Journal name, website, fees, peer review*, publisher, ownership, volume of articles, advertisements, prominent soliciting for editors Low scientific quality focus, format, self-citations, plagiarism* Malpractice false claims, hidden costs, spamming authors, wrong information * most often encountered problems
Questionable Publishing Global Perspective NOT ONLY IN OPEN ACCESS JOURNALS Not AS HIGH AS OFTEN REPORTED * http://walt.lishost.org/2015/11/ppppredatory-articlecounts-an-investigation-part-1/ **Shen and Björk. BMC Medicine201513:230 according to a study* by Walt Crawford the number questionable publishers in 2014 was about 3275 publishing about 121,000 articles and not 420,000 (Shen and Björk ** reported 8000 journals and 420,000 articles!!)
Questionable Publishing in Perspective Proportion of low quality journals is comparable between open access and subscription publishing but it looks worse because Open Access journals are more visible FACTS Not all subscription journals are in Scopus or WoS: only 20-30,000 of 100,000 (data Ulrich s Web) Not all open access journals are in DOAJ : only 8-10,000 of 30,000 *** *** Walt Crawford http://citesandinsights.info/civ17i1.pdf CONCLUSION Percentage of Quality Journals is comparable
Handling Questionable Publishers Q U E S T I O N A B L E P U B L I S H I N G I S A P R O B L E M I T I S N O T A P R O B L E M U N I Q U E T O O P E N A C C E S S I T I S M O R E E X P O S E D I N O P E N A C C E S S S O L U T I O N F O R T H E P R O B L E M B E T T E R Q U A L I T Y B Y P U B L I S H I N G O P E N A C C E S S S T A N D A R D I Z E D Q U A L I T Y C O N T R O L I N D E X I N G O F Q U A L I T Y J O U R N A L S T R A N S P A R E N C Y O N C R I T E R I A U S E D R A I S I N G A W A R E N E S S W I T H A U T H O R S ( T H I N K C H E C K S U B M I T )
COMMON SENSE
Thanks to : Our ambassadors in various parts of the world, all the Library Consortia, Universities and Publishers and our Sponsors for the financial support to DOAJ!
NATIONAL LIST/SINTA