South African Research Data Infrastructure. Roadmap Biodiversity Data

Transcription

1 South African Research Data Infrastructure Roadmap Biodiversity Data

2 Context

3 Emerging E&EO Research Data Infrastructure

4 Governance: Stakeholder Groupings DRDLR SASDI Custodians DST Research Ins4tu4ons SARIR Programme(s) DST SA- GEO SAEOSS GEO- BON/ GEOSS CommuniHes of PracHce Shared PlaDorm Stakeholders ICSU World Data System African Networks NEDICC DIRISA ASSAf NRF, HEIs and NaHonal FaciliHes DoE (REDIS) DEA (NSIF, SANBI, CC M&E)

5 Consolidated Roadmap

6 Six Architectures SpecificaHons and Standards SpecificaHons and Standards Hardware and Networks SoRware and Systems Business and Governance Guidance, Capacity, and SoR Skills AccreditaHon

7 Generalised ScienHfic Data Infrastructure Use Case Curate Mediate Cite Data/ Services Bind Access/ Download Analise/ Visualise Publish Process Metadata Find Discover Assess/ Rate Predictable Assembly from Reliable Components

8 OpHons for ParHcipaHon Meta- Data Management Discovery Data HosHng, VisualisaHon and Download ReporHng Portal Portal Portal Portal No Infrastructure Embedding* Embedding Embedding Embedding Shared Infrastructure Adapters and Harvesters CS/W Adapter REST Services REST Services Own Development REST Services Mostly Own Infrastructure

9 Biodiversity Data Management

10 Elements of Interoperability Syntax Describes service protocols, parameters Schema Describes structure of content Temporal easy SemanHc Describes the meaning of content SpaHal easy Topic - difficult

11 EssenHal Biodiversity Variables GeneHc composihon Co- ancestry, Allelic diversity, PopulaHon genehc differenhahon, Breed and variety diversity Species populahons Species distribuhon, PopulaHon abundance, PopulaHon structure by age/size class Species traits Phenology, Body mass, Natal dispersion distance, Migratory behavior, Demographic traits, Physiological traits Community composihon Taxonomic diversity, Species interachons Ecosystem funchon Net primary produchvity, Secondary produchvity, Nutrient retenhon, Disturbance regime Ecosystem structure Habitat structure, Ecosystem extent and fragmentahon, Ecosystem composihon by funchonal type Not all tradihonal spahal data! Not all remotely sensed!

12 Simple or Core InformaHon Model Genes and Alleles Species and Taxons Sampling Event SpaHal and Temporal Coverage Life Stages, Traits and Characters Physical Phenomena

13 Example: Taxon Abundance, Presence and Absence Genes and Alleles RelaHonship Species and Taxons Sampling Event SpaHal and Temporal Coverage Life Stages, Traits and Characters Physical Phenomena

14 Example: PhylogeneHc Data Genes and Alleles RelaHonship Species and Taxons Sampling Event SpaHal and Temporal Coverage Life Stages, Traits and Characters Physical Phenomena

15 Example: Morphology Genes and Alleles RelaHonship Species and Taxons Sampling Event SpaHal and Temporal Coverage Life Stages, Traits and Characters Physical Phenomena

16 Example: Biome DefiniHon, Ecosystem Services Genes and Alleles RelaHonship Species and Taxons Sampling Event SpaHal and Temporal Coverage Life Stages, Traits and Characters Physical Phenomena

17 Generic Dimensions of Data SpaHal Coverage XYZ Temporal Coverage: T Topic or SemanHc/ Ontological Coverage P: Phenomenon mostly physical, chemical, or other contextual data B: Biological Tx: Species and Taxonomy (with some extensions) Al: Allele/ Genome/ PhylogeneHc Ch: CharacterisHcs, Traits, and, and Life Stages ConHnuous or Near- ConHnuous: Uppercase Discrete or dispersed: Lowercase Each unique combinahon of these, supported by a vocabularies/ ontology is a generic data family

18 Some Generic Data Families and Crosswalk Requirements Typical Dimensions/ Content Typical Infrastructure Typical Syntax/ Schema Multi-dimensional XYZ, t, P Cube Data OPeNDAP Traditional Spatial XY, t, P S-DB WxS Signals XYZ, t, P/ B O&M SOS General Ecosystem XYZ, t, P/ B MetaCat CSV Occurrence XYZ, T, Tx GBIF Index DwC Genetic XYZ, T, Al GenBank FTP/ ASN.1 SHll Thinking About: HDF- 5 for Everything Directed Graphs/ RDF for Everything

19 Typical Guidance For Each EBV hfp://bit.ly/1w8ypxx Work started within GEO BON WG 8

20 Vocabulary and Name Services Important to Limit Diversity of Interfaces Mappings of Vocabularies to Schema RDA has started thinking about this

21 Systems Overview and Context

22 Main Use Cases: #1 - Deposit Manual Meta- Data Provision Automated Meta- Data Processes OpHonal Data Upload Online Capture File Upload REST Services Push Standard HarvesHng Protocols Web Folders and FTP Earth and Environ- mental Sciences Applied Sciences, Built Env., Engineering Repositories of Last Resort Social Sciences and HumaniHes NaHonal Aggregate Business Science, Law, Economics Health and Bio- InformaHcs Physics, Chemistry, Astronomy OpHonal DOI RegistraHon Semi- Automated Meta- Data Processes DMPs, RIMS Online Resource URLs and Pointers InsHtuHonal or Domain Repositories

23 Main Use Cases: #2 - Discovery DOI Resolvers Repositories of Last Resort Search and Discovery OpHons CitaHons Portal Interfaces Standardised Search Interfaces (Machines) REST Services Indexed Meta- Data Earth and Environ- mental Sciences Applied Sciences, Built Env., Engineering Social Sciences and HumaniHes NaHonal Aggregate Business Science, Law, Economics Health and Bio- InformaHcs Physics, Chemistry, Astronomy GEOSS Broker, ICSU WDS, Standard HarvesHng End Points InsHtuHonal or Domain Repositories

24 Main Use Cases: #3 - ApplicaHon CitaHon Repositories of Last Resort ApplicaHon Google AnalyHcs Request Previews Indexed Meta- Data ApplicaHon OpHons Chain into Web Processes Download Event Logs and User Feedback Brokers and Mediators InsHtuHonal or Domain Repositories

25 Main Use Cases: #4 - ReporHng RIMS (Grant Administra Hon) Indexed Meta- Data Google AnalyHcs Event Logs and User Feedback CrossRef/ DataCite ReporHng OpHons Portal- Based Depositor Summaries REST- Based StaHsHcs Depositor Summaries ApplicaHon StaHsHcs Page Views and User Behaviour User RaHng and Comments, Data Quality Grant Policy Compliance ReporHng Scope Meta- Data Status/ Search History CitaHons and MenHons Context and Knowledge Network

26 Minimum Scope of EvaluaHon Access and Licensing Security and ICT Management Conference and PublicaHon Record Communicaton and Outreach External ExperHse Networking and Sharing Policies ICSU- WDS Quality Assurance Products and Services Ingest and PublicaHon Depositor AuthenHcity Hardware Infrastructure Infrastructure Data Seal of Approval TRAC PreservaHon PracHce Legal Compliance Interoper- ability SoRware Infrastructure Host OrganisaHon Sustainability Funding Mechanisms Business ConHnuity Planning

27 AccreditaHon OpHons Op4on Nature of Accredita4on Process Local (NRF) Context Notes and Comments ISO 16363:2012 On- Site Audit Exceeds Requirement Expensive but a medium- term goal NESTOR/ DIN Remote Audit Exceeds Requirement Not applicable locally, mainly used in Europe/ Germany ICS- WDS (World Data System) Remote confirmahon with peer review Meets Requirement TradiHonally Earth and Environmental Science. Allows Network Members DSA (Data Seal of Approval) Remote confirmahon with peer review Meets Requirement TradiHonally Social Science and HumaniHes TRAC Self- EvaluaHon Meets Requirement, but needs subsequent formalisahon (NRF?) Not Recommended

28 The Future

29 Concrete Steps Community of PracHce and Guidance DocumentaHon

30

31