U N I V E R S I T A S N E G E R I S E M A R A N G J U L Y, S U H A R T M A I L. U N N E S. A C. I D E D I T O R D O A J

Transcription

1 ASSESSING THE QUALITY OF SCHOLARLY PUBLISHING U N I V E R S I T A S N E G E R I S E M A R A N G J U L Y, S U H A R T M A I L. U N N E S. A C. I D E D I T O R D O A J

2 INDEXING SERVICES for quality control DOAJ Directory of Open Access Journals O P E N A C C E S S J O U R N A L S O N L Y, n o r a n k i n g SCOPUS O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S, r a n k i n g WEB OF SCIENCE O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S, r a n k i n g NATIONAL LIST/SINTA O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S r a n k i n g g r o u p

3 NATIONAL LIST/SINTA

4 Assessing the Quality of a Journal QUALITY OF PUBLISHING QUALITY OF THE SCIENCE

5 What is the DOAJ? FREE to register and FREE to use The only global index of trusted, high quality, peerreviewed, open access journals, from all academic disciplines, curated by the community

6 Recognition of the DOAJ?

7 Use of DOAJ Data EBSCO ROAD NATIONAL LISTS MANY OTHER ORGANIZATIONS ROAD contains DOAJ journals + hybrids + repository material + blogs +

8 DOAJ STRUCTURE

9 CERTIFICATE

10 WHAT IS QUALITY OPEN ACCESS? The BOAI Definition Open Access is: a publishing system where all content is freely available without charge to the user or his/her institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles, or use them for any other lawful purpose, without asking prior permission from the publisher or the author.

11 Essential criteria Copyrights Clearly described on web site* Recommend: author retains copyright Recommend: no exclusive publishing rights Recommend: no transfer of commercial rights

12 Essential criteria Content Licensing Clearly described on web site* Recommend: licensing terms on all articles, all versions (html, pdf, xml etc.) embedded in article level metadata Creative Commons licensing

13 COPYRIGHT AND LICENCING What is a license? Licensing means to grant a third party (anyone else except the right holder) the right to use a copyright-protected work A license is a permission to use a work in specific ways Licenses can only be granted by copyright holder Copyright holder can be author or publisher

14 Global open access map

15 DOAJ JOURNALS global distribution

16 Open Access policy in EU 100 % Open Access in 2020 scholarly communication open access open data open science

17 Open Access Government policies Netherlands gold open access by 2024 DOAJ list recognized Nordic countries list of accredited journals for government funded research DOAJ list for open access journals government funding DOAJ Algeria government website for journal hosting required listing in DOAJ required open access (no set date) Indonesia Permenristekdikti No 20 in 2017? Minister speech:

18 Cost of Open AccessPublishing Situation is not transparant What does a publication cost? (< 2000) Open APC (info on basis of Freedom of Information Act)

19 Assessing Quality of Research o T H E B A S I C S : o PEER-REVIEW o CITATION ANALYSIS

20 Citations & Quality of Research T H E S C I E N T I F I C Q U A L I T Y O F A N A R T I C L E C A N N O T B E A S S E S S E D B Y C I T A T I O N S A L O N E o T H E S C I E N T I F I C Q U A L I T Y O F A J O U R N A L C A N N O T B E A S S E S S E D A T A L L B Y T H E A V E R A G E C I T A T I O N S C O R E S O F A R T I C L E S ( T H E J O U R N A L I M P A C T F A C T O R J I F )

21 Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers Number of papers highly skewed distribution of citations Journal elife % EMBO J % J. Informetrics % Nature % Nature Comm % PLOS Biol % PLOS Genet % PLOS ONE % Proc. R. Soc. B % Science % Sci. Rep % JIF % citable items Table 2: Percentage of papers published in with number of citations below the value of the 2015 JIF. below JIF Larivière et al. (2016) elife Number of citations Nature Number of citations PLOS Genet Number of citations Science Number of citations ,000 12,000 10,000 8,000 6,000 4,000 2, ,200 1, EMBO J Number of citations Nature Comm Number of citations PLOS ONE Number of citations Sci. Rep Number of citations J. Informetrics Number of citations PLOS Biol Number of citations Proc. R. Soc. B Number of citations doi:

22 New Citation Based Metrics for Journals: Journal CiteScore only deals with discipline citing bias

23 San Francisco Declaration on Research Impact It doesn t matter where you publish or how much you publish, research assessment should not be based on journal citation analysis like JIF or number of articles published

24 What can we do with Citations? T R A C E T H E S O U R C E O F D A T A M A K E R E S E A R C H C O N N E C T I O N S / N E T W O R K S V I S I B L E F I N D K E Y P A P E R S F O R S P E C I F I C T O P I C S ( O P E N C I T A T I O N S C O R P U S, P A R T O F I S 4 O A ) B U T : N O C O N C L U S I O N S O N I M P A C T F R O M A V E R A G E C I T A T I O N S C O R E S N O C O N C L U S I O N S O N Q U A L I T Y F R O M N U M B E R O F C I T A T I O N S Blog.plos.org/biologue

25 Initiative for Open Citations I4OC

26 Another kind of Quality Article Level Impact Assessment not quite the same as Quality rather relevance ALTMETRICS T A K I N G I N T O A C C O U N T T O T A L E X P O S U R E, D I S S E M I N A T I O N, C I T A T I O N S, S O C I A L M E D I A, C O N V E N T I O N A L M E D I A ( N E W S P A P E R S, T V, V I D E O ) Springer/nature Elsevier Wiley

27 DOAJ Future Plans I N T E G R A T I O N O F A L T M E T R I C S C O R E S I N T E G R A T I O N O F O R C I D S E M I - A U T O M A T I C I N D E X U P D A T E S A N D S C R E E N I N G S E M A N T I C L I N K I N G O F S P E C I F I C C O N T E N T I M P R O V E D S E A R C H P O S S I B I L I T I E S W O R L D W I D E A M B A S S A D O R PROGRAMMES

28 The problem of questionable journals Is it a problem?? How DOAJ detects questionable journals Low publishing quality Journal name, website, fees, peer review*, publisher, ownership, volume of articles, advertisements, prominent soliciting for editors Low scientific quality focus, format, self-citations, plagiarism* Malpractice false claims, hidden costs, spamming authors, wrong information * most often encountered problems

29 Questionable Publishing Global Perspective NOT ONLY IN OPEN ACCESS JOURNALS Not AS HIGH AS OFTEN REPORTED * **Shen and Björk. BMC Medicine201513:230 according to a study* by Walt Crawford the number questionable publishers in 2014 was about 3275 publishing about 121,000 articles and not 420,000 (Shen and Björk ** reported 8000 journals and 420,000 articles!!)

30 Questionable Publishing in Perspective Proportion of low quality journals is comparable between open access and subscription publishing but it looks worse because Open Access journals are more visible FACTS Not all subscription journals are in Scopus or WoS: only 20-30,000 of 100,000 (data Ulrich s Web) Not all open access journals are in DOAJ : only 8-10,000 of 30,000 *** *** Walt Crawford CONCLUSION Percentage of Quality Journals is comparable

31 Handling Questionable Publishers Q U E S T I O N A B L E P U B L I S H I N G I S A P R O B L E M I T I S N O T A P R O B L E M U N I Q U E T O O P E N A C C E S S I T I S M O R E E X P O S E D I N O P E N A C C E S S S O L U T I O N F O R T H E P R O B L E M B E T T E R Q U A L I T Y B Y P U B L I S H I N G O P E N A C C E S S S T A N D A R D I Z E D Q U A L I T Y C O N T R O L I N D E X I N G O F Q U A L I T Y J O U R N A L S T R A N S P A R E N C Y O N C R I T E R I A U S E D R A I S I N G A W A R E N E S S W I T H A U T H O R S ( T H I N K C H E C K S U B M I T )

32 COMMON SENSE

33 Thanks to : Our ambassadors in various parts of the world, all the Library Consortia, Universities and Publishers and our Sponsors for the financial support to DOAJ!

34 NATIONAL LIST/SINTA