ASSESSING THE QUALITY OF OPEN ACCESS JOURNALS

Transcription

1 ASSESSING THE QUALITY OF OPEN ACCESS JOURNALS 审核开放获取期刊的质量 S E M I N A R A T C H I N A O P E N A C C E S S W E E K O C T O B E R 1 9, , B E I J I N G T O D O A J. O R G E D I T O R - I N - C H I E F D O A J

2 You are free to: Copy, share, adapt, or re-mix; Blog, live-blog, or post video of; This presentation. Provided that: You attribute the work to its author and respect the rights and licenses associated with its components. Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only cczero. Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;

3 Are Open Access Journals of Low Quality? 开放获取期刊的质量差吗? PROOF? 证据 MISBELIEFS 误解 THE REALITY OF OPEN ACCESS 真正的开放获取

4 Open Access versus Toll Access 开放获取 vs. 订购访问 S U P P O S E S C O P U S A S M E A S U R E F O R T O L L A C C E S S Q U A L I T Y J O U R N A L S D O A J A S M E A S U R E F O R O P E N A C C E S S Q U A L I T Y J O U R N A L S F A C T S N O T A L L S U B S C R I P T I O N J O U R N A L S A R E I N S C O P U S O N L Y , O F N O T A L L O P E N A C C E S S J O U R N A L S A R E I N D O A J O N L Y 8-1 0, O F 3 5, C O N C L U S I O N P E R C E N T A G E Q U A L I T Y J O U R N A L S I S A B O U T T H E S A M E

5 The Reality of Open Access 真正的开放获取 OPEN ACCESS... A R T I C L E S R E C E I V E M O R E C I T A T I O N S R E A C H E S A B I G G E R A U D I E N C E L E A D S T O B E T T E R E D U C A T I O N A V O I D S D U P L I C A T E S T U D I E S A R T I C L E S C A N B E M O R E E A S I L Y C H E C K E D D A T A L E S S P R O N E T O M A N I P U L A T I O N I S B E T T E R F O R A D V A N C I N G S C I E N C E L E A D S T O M O R E I N N O V A T I O N

6 Assessing the Quality of a Journal 审核期刊的质量 QUALITY OF PUBLISHING( 出版的质量 ) QUALITY OF THE SCIENCE ( 科学的质量 )

7 Quality of Publishing ( 出版的质量 ) CRITERIA FOR PUBLISHING Principles of transparency and Best Practice in Scholarly Publishing DOAJ criteria for Quality Open Access Publishing

8 What is the DOAJ? DOAJ 是什么? D i r e c t o r y o f O p e n A c c e s s J o u r n a l s L a u n c h e d i n M a y , L u n d U n i v e r s i t y, S w e d e n l i s t o f t i t l e s C e n t r a l l y, p u b l i c l y a n d i n t e r n a t i o n a l l y a v a i l a b l e c o m m u n i t y - c u r a t e d l i s t o f h i g h q u a l i t y o p e n a c c e s s j o u r n a l t i t l e s a c r o s s a l l d i s c i p l i n e s A i m : t o b e t h e s t a r t i n g p o i n t f o r a l l i n f o r m a t i o n s e a r c h e s f o r q u a l i t y, p e e r - r e v i e w e d o p e n a c c e s s m a t e r i a l

9 The Principles ( 原则 ) 1. Peer review process 2. Governing Body 3. Editorial team/contact 4. Author fees 5. Copyright 6. Identification of and dealing with allegations of research misconduct 7. Ownership and management 8. Website 9. Name of journal 10. Conflicts of interest 11. Access 12. Revenue sources 13. Advertising 14. Publishing schedule 15. Archiving 16. Direct marketing

10 Required information for inclusion in the DOAJ 收录 DOAJ 所需的信息 *Basic requirement (* 为基本要求 )

11 Journal Web Site (1)* 期刊网站 Dedicated web site per journal journal specific web address* All journal content centrally available not spread over various pages Do not mimic other journal web sites Web site clear, concise, easy to navigate, transparent, up to date and correct content high ethical and professional standards Language & grammar usage correct, spell check

12 Journal Web Site (2)* 期刊网站 Visible links to business information Avoid distracting, offensive, irrelevant, moving, blinking advertisements Unique identifier (web address) *: Journal level Article metadata level (also DOI) Full text article level (pdf, html, xml, epub) ISSN (International Standard Serial Number) * Print ISSN and/or Online ISSN

13 Journal Content 期刊内容 Clear journal structure for easier navigation, indexing, discoverability Publication date for each article Publication year per volume/issue Volumes & issues; 5 articles per year Start & end page number Authors, affiliations, countries, ORCIDs Articles arranged in Table of Contents Search/Browse option Links to Current, Archive/Past Issues

14 Impact Factors 影响因子 Thomson Reuters IF against ethics and principles of OA DOAJ is IF agnostic Display of IF information on journal web page discouraged

15 Ownership & Management 归属权 & 管理 Journal title unique not confusing/misleading Avoid using misleading information Each journal unique, journal specific policies All business information about journal available from central web site for journal* - not generic web site for publisher

16 Business Information* 商业信息 About Aims and Scope Editorial Board Instructions for Authors Quality control system Open Access system Plagiarism policy Licensing terms Contact info

17

18 Editorial Office & Editorial Team 编辑部 & 编辑团队 Editor*/Editor-in-Chief/Associate Editor/Co-Editor Full names, Affiliations, Countries, s* Postal address of office Contact information: /telephone

19

20 Governing Body 主管部门 Editorial Board*/Editorial Advisory Board Arts & Humanities allowed editorial review, 2 editors, no editorial board Members to be experts in field/journal scope Full names, Affiliations, Countries, s*

21

22 Aims & Scope 期刊的内容和范围

23 Author Fees 作者费用 Article Processing Charges (APCs) Article Submission Charges (APCs) Manuscript Handling Fees Galley Fees, page charges, colour charges, etc. Per article (incl. any taxes if applicable) not per page Waiver policy Clearly visible for prospective authors also if no charges apply*

24

25 Peer Review Process* 同行评议 Advice on individual manuscripts from reviewers/ experts in the field who are not part of the journal's editorial staff Quality control rigorous Process & policies clearly described on journal's web site Editorial/Peer - Blind/Double blind/open*

26

27 Instructions for Authors* 投稿须知 Detailed style guide Description of quality control process (review) Copyright information Licensing information Plagiarism policy Instructions on how to submit an article Contact address

28

29 Access & Usage 获取 & 使用 Full text of all content available as Open Access, no delay/embargo* How accessible is journal to the rest of the world, harvesters Open Access or Subscription Access or Pay per view Journal specific OA statement/policy* Differentiate between OA statement Copyright - Licensing

30

31

32 Rights 权利 Recommend: author retains copyright Recommend: no exclusive publishing rights Recommend: no transfer of commercial rights

33

34 Content Licensing 内容许可 Clearly described on web site Licensing terms on all articles, all versions (html, pdf, xml etc.) Embedded in article level metadata

35

36 1 2

37 3 4

38 5 6

39 Depositing Policy 存储政策

40

41 Ethics & Malpractice 伦理 & 不端行为 Indicate steps to identify & prevent papers where research misconduct occurred Unethical Plagiarism (statement & similarity check tool) Citation manipulation Data falsification/fabrication See COPE Guidelines in dealing with allegations

42

43 Conflict of Interest 利益冲突 Policy on handling potential conflict of interest - editors, authors, reviewers

44 Financial Sustainability 财务可持续 Revenue sources (eg author fees, subscriptions, advertising, reprints, institutional support, organizational support) Advertising policy, types of ads, decision making on ads, ads linked to content or reader behavior/displayed at random Marketing: appropriate, well targeted, unobtrusive

45 Publishing Schedule 刊发计划 Clearly indicate periodicity No interruptions Annually, bi-annually, monthly, bi-monthly, continuos, etc. Number of volumes, issues

46

47 Accessibility & Availability 可访问性 & 可用性

48

49 Digital Archiving & Preservation 电子存储 & 保存 Electronic backup Cloud, disk, server, tapes, etc Preservation Keepers Registry & PubMed Central Portico Open Journal Systems (OJS) PKP Private LOCKSS network deposited in CLOCKSS

50

51 DOAJ Seal 印章

52 Assessing Quality of the Science 审核科学的质量 J O U R N A L L E V E L P E E R - R E V I E W, E D I T O R I A L B O A R D, P R O O F - R E A D I N G ( D O A J C R I T E R I A ) T H O M S O N R E U T E R S - J I F ( T H O M S O N - R E U T E R ) J O U R N A L C I T A T I O N D I S T R I B U T I O N S R E P L A C I N G T H E J I F ( P U B L I S H E R S ) A R T I C L E L E V E L A R T I C L E L E V E L M E T R I C S ( A L T M E T R I C, I M P A C T S T O R Y ) R E L A T I V E C I T A T I O N I N D I C E S ( I C I T E T O O L )

53 Assessing Quality of the Science 审核科学的质量 o T H E S C I E N T I F I C Q U A L I T Y O F A J O U R N A L C A N N O T B E A S S E S S E D B Y T H E A V E R A G E C I T A T I O N S C O R E S O F A R T I C L E S o T H E S C I E N T I F I C Q U A L I T Y O F A R T I C L E S C A N N O T B E A S S E S S E D B Y W H E R E T H E Y A R E P U B L I S H E D o S C I E N T I F I C Q U A L I T Y C A N O N L Y B E A S S E S S E D O N A R T I C L E L E V E L

54 What is wrong with the JIF? H E A D L I N E S I N, S C I E N C E, N A T U R E, T H E S C I E N T I S T, P L O S T H I S Y E A R 期刊影响因子有错吗?

55 What is wrong with the JIF? 期刊影响因子有错吗? W E A K R E L A T I O N W I T H J O U R N A L Q U A L I T Y N O R E L A T I O N W I T H I N D I V I D U A L A R T I C L E Q U A L I T Y I N A G I V E N J O U R N A L N O R E L A T I O N W I T H S C I E N T I S T Q U A L I T Y I N A P P R O P R I A T E U S E O F J I F F O R A L L T H E A B O V E! I N A D D I T I O N T H E J I F I S H I G H L Y B I A S E D T O W A R D S E N G L I S H L A N G U A G E S T M J O U R N A L S

56 What is wrong with the JIF? 期刊影响因子有错吗? THE JIF I S C A L C U L A T E D I N A P P R O P R I A T E L Y A S T H E A R I T H M E T I C M E A N O F A H I G H L Y S K E W E D D I S T R I B U T I O N O F C I T A T I O N S IT CONTAINS NO MEASURE OF THE SPREAD OF THE DISTRIBUTION; IT OBSCURES THE HIGH DEGREE OF OVERLAP BETWEEN THE CITATION DISTRIBUTIONS OF MOST JOURNALS IT IS NOT REPRODUCIBLE AND THE DATA THAT SUPPORT IT ARE NOT PUBLICLY AVAILABLE Source :doi:

57 highly skewed distribution of citations 高度不平衡的文献引用分布 Table 2: Percentage of papers published in with number of citations below the value of the 2015 JIF. Larivière et al. (2016) doi:

58 Too much is wrong with the JIF 期刊影响因子有太多的错误 FOR PUBLISHERS: D O N O T U S E I F F O R T H E P R O M O T I O N O F Y O U R J O U R N A L FOR AUTHORS: I T I S N O T I M P O R T A N T W H E R E Y O U P U B L I S H B U T W H A T Y O U P U B L I S H FOR FUNDERS: D O N O T J U D G E S C I E N T I S T S O N W H E R E T H E Y P U B L I S H O R H O W M U C H T H E Y P U B L I S H

59 Replacing the Impact Factor 取代影响因子 this analysis helps to expose the exaggerated value attributed to the JIF and strengthens the contention that it is an inappropriate indicator for the evaluation of research or researchers," the team concludes in a preprint paper posted to biorxiv. doi:

60 Article Level Impact Assessment 基于文献的影响力评估 ALTMETRICS T A K I N G I N T O A C C O U N T C I T A T I O N S, S O C I A L M E D I A, C O N V E N T I A L M E D I A ( N E W S P A P E R S, T V, V I D E O ) RELATIVE CITATION SCORES C I T A T I O N I N D I C E S A D J U S T E D F O R S C I E N T I F I C F I E L D LEIDEN MANIFESTO doi: 01/ DORA The San Francisco Declaration on Research Assessment doi: /dmm

61 San Francisco Declaration on Research Impact 关于科研影响力的旧金山声明

62 Leiden Manifesto for Research Metrics 关于科研指标的莱顿宣言 TEN PRINCIPLES Among which 6. Account for variation by field in publication and citation practices 8. the journal impact factor is published to three decimal places to avoid ties. it makes no sense to distinguish between journals on the basis of very small impact factor differences. Avoid false precision

63 Relative Citation Ratios 相对引用率

64 Relative Citation Ratios 相对引用率

65 Journals must have: 必须有 Quality Open Access Journals 高质量的开放获取期刊 The must haves! An Open Access statement Comply with the BOAI definition A peer-review process, and describe the kind of process An editor/editorial board with clearly identifiable members Licensing and copyright information Aims and scope Published a least 5 articles per year to qualify (DOAJ criteria) Impact Factor (any) IRRELEVANT

66 Journals are strongly recommended to have Unrestricted copyright for the author No exclusive publishing rights No transfer of commercial rights Clear licensing conditions Preferably use of Creative commons licensing Embedded licensing information with articles Link to underlying data Quality Open Access Journals 高质量的开放获取期刊 Recommendations 推荐 No mention of IF, instead use journal citation distribution plots

67 Thank you for your attention! 谢谢你们的关注! lars

68 Thanks to all the Library Consortia, Universities and Publishers and our Sponsors for the financial support to DOAJ! 感谢我们所有的图书馆联盟, 大学, 出版商和赞助商对 DOAJ 的财政支持! We have vacancies here!