Practical experience in the management, analysis and visualisation of marine data and information

Transcription

1 Practical experience in the management, analysis and visualisation of marine data and information Dr. Ned Dwyer Coastal and Marine Research Centre, Cork, Ireland

2 Introduction Chapter 1 Marine Irish Digital Atlas Chapter 2 The European Context Chapter 3 The Global Context Chapter 4 Smart visualisation Conclusion

3 Coastal and Marine Research Centre-CMRC UCC CMRC Cork 100 km

4 Five Thematic Focus Areas Marine Geomatics Applied Remote Sensing and GIS Coastal Processes and Seabed Mapping Marine Ecology Coastal Governance

5 Multi-disciplinary research approach April projects; 40 researchers Disciplines represented Computer Science Marine Geography Geomorphology Hydrography Env. Science GIS & Remote Sensing Marine Biology Engineering Numerical Modelling Zoology Marine Geology Funding Spread National 37 % International 41 % Consultancy 22 %

6 Chapter 1

7 MIDA Vision The Marine Irish Digital Atlas (MIDA) should become a key on-line resource for all who are interested in coastal and marine information and data for Ireland

8 Coastal and Marine Information Access The situation in 2003

9 The MIDA Solution MIDA

10 The MIDA Structure MIDA Web GIS Information Data Archive General Specialised Spatial Searchable Data Metadata

11 Layers Interactive Map Information

12 Technology: Software Used Open Source Solution Version 1.0 Linux Apache Server Minnesota Map Server PostgreSQL Database

13 Technology: System Overview

14 Technology: System Upgrade 2012 PostGreSQL GeoNetwork Mapserver + Php Mapserver + php + GeoExt + ExtJS Server side Client side Part funded by:

15 Technology: Database Driven Metadata stored in database Optimises data management Permits efficient searching Facilitates catalogue sharing Data files are not in a database

16 Technology Lessons Open source allows flexibility Requires programming capability Metadata management system vital Use standards

17 Metadata in MIDA Discovery Core database 55 elements Subset / Profile of ISO ISO XML tags Abstract Initial metadata access Taken from Discovery DB Full As data owner supplies it

18 Choosing a Metadata System Some Selection Criteria Easy to create and edit metadata Metadata management Metadata storage Metadata standards compliance Desktop or internet based tools Automatic metadata generation, metadata harvesting and synchronisation Access to distributed data Reuse source code

19 FGDC Review of ISO MD editing tools Federal Geographic Data Committee (FGDC) review:

20 CMRC Review of MD editing tools Proprietary ESRI ArcCatalog Intergraph s GeoMedia Catalog Opensource/freeware CatMDedit GeoNetwork opensource ISI Metadata Editor (INTA) M3Cat (Intelec geomativs) Metalite (USGS) Metavist tkme xtme

21 Geonetwork Chosen Meets the selection criteria For example: supports a number of standards ISO 19115/19139/19119 FGDC Dublin Core OGC Catalog Service for Web (CSW) Multilingual (English, French, Spanish)

22 GeoNetwork

23 MIDA Metadata Lessons Poor metadata availability Creation time consuming Presentation should be user friendly Appreciated by users ISO 19115/19139 facilitates catalogue sharing

24 Beyond Metadata: Vocabularies Vocabulary [MMI]: set of terms (words, codes, etc.) used in a specific community provide a mechanism of communication as the meaning of the terms are known and agreed upon by community members Used to define theme, place keywords, instrument names, codes, etc.

25 Vocabularies- problems Different terms have the same definition but different meanings and uses: altitude, height and depth (vertical distance) The same term has different meanings depending on the community or the context: e.g. an ROV may use altitude for distance above ocean floor Different terms have the same meaning: synonyms, abbreviations, languages, etc.: e.g. seabed, seafloor, fondo do mar

26 Controlled Vocabularies Controlled Vocabulary [MMI]: list of terms that are: Accepted: adhere to community practices Defined: rigorous definition Managed: periodic review, addition, modification of terms Ensures common understanding

27 Controlled Vocabularies: types and categories Authority File: Terms Gazetteer: Location, coordinates Flat Code List: code + definitions Glossary: terms + definitions Vocabularies Multi-level Relational Dictionary: Terms + definitions + additional information Taxonomy: terms classified into subject-specific categories Subject heading: terms classified into broad categories Thesaurus: terms with relationships Semantic Network: terms with relationships (includes additional types of relationships) Ontology: terms in categories, with relationships and rules/axioms

28 Vocabularies: More Information Good introduction to controlled vocabularies Where to find marine vocabularies Marine Metadata Interoperability Project Seadatanet vocabulary web service NERC vocabulary server Gemet thesaurus NASA global change master directory

29 MIDA Atlas Functionality Map tools Data search Information

30 Map Tools

31 New Interface with GeoExt Tools Interactive Map Layers Information

32 Some Benefits of GeoExt Based on OpenLayers platform De facto standard for mapping systems Built-in suite of mapping functions Easily extensible with ExtJS library Faster- based on AJAX (e.g. dynamic update) Faster supports automatic tiling

33 Data Layers Search special

34 Data Layers Search

35 Information

36 Information

37 Data and Information Status > 125 data layers 37 organisations update and addition of layers ongoing 25 of 84 topics written

38 Funded by: ( ) ( )

39 Chapter 2 The European Context

40 Options for Coastal Information Systems Context Part of a European process looking at how to follow-up on the Integrated Coastal Zone Management (ICZM) Recommendations (2002) a study carried out by Thetis spa, Italy

41 Expert workshop held Objectives: to identify development requirements for coastal information systems assess impact of these requirements on ICZM policy Ranked and analysed 17 requirements in relation to 11 potential impacts

42 Options for Coastal Information Systems Practical Example Requirement: Improve the use of protocols facilitating geo-spatial data sharing: Impact Level of impact Integrated Knowledge on Coastal System ++ Cooperation between different institutions ++ Costs related to maintenance and updating of CIS + Supports an ICZM adaptive process 0

43 Top 5 ranked requirements Ensure data and metadata availability Establish strict link and cooperation between the structure responsible for the CIS management and operation and the structure responsible for the implementation of the ICZM process Address different user expectations and needs Improve economic and in particular social and governance information within CIS Include end-users in the system design

44 Read the full details 40 European Coastal Information Systems profiled 12 analysed in-depth 4 USA and 1 Australian CIS profiled Full report available:

45 Chapter 3 The Global Context

46 2003:Emergence of coastal web atlases Marine Irish Digital Atlas mida.ucc.ie Oregon Coastal Atlas

47 Transatlantic Workshops Shared experiences Shared know-how Networking Workshop reports Idea to establish ICAN

48 International Coastal Atlas Network

49 Goals of ICAN Ensure network has wide representation (developers/users) Develop technical & policy guidelines for atlas developers Highlight benefits of interoperability & standards based systems

50 Goals of ICAN Develop collaborative projects for sharing know-how, atlas implementation and demonstration Align atlas efforts to facilitate interoperability Engage with other relevant projects and developments

51 Wide representation now over 50 members

52 Guidelines for Developers Principles of atlas design Case Studies around the world CWA Management and Governance issues

53 Addressing Interoperability Connect individual coastal atlases to an integrated global atlas Global atlas Local atlases

54 Internet Resources - ICAN Objectives - Members - Workshop reports - Publications - Handbook - Working Groups - Interoperability prototype - News - También en español

55 Training Events Ocean Data and Information Networks - Africa African Marine Atlas Workshops - Latin America Carribean Marine Atlas workshops SPINCAM Southeast Pacific CoastGIS United States West Coast Coastal Atlas workshop Great lakes Workshop 2010

56 Member Workshops Cork 2006 Corvallis Copenhagen Trieste Ostend Victoria Meetings section of ICAN web site

57 ICAN Governance Currently being established as a UNESCO IOC IODE (International Oceanographic Data and Information Exchange) project Steering Group composed of existing members

58 What s in ICAN for you? - Guidance and advice for your own local CWA development - Potential to exchange and reuse software and technical solutions developed using Open Source solutions - Your CWA can be part of and interoperable with a larger universe of resources

59 What s in ICAN for you? - Great publicity for your individual CWA via the outreach efforts of ICAN - Participate in teaching and learning activities organised by ICAN or other organisations in the CWA domain - Possibility to leverage funding for collaborative projects among ICAN participants

60 Keep up to date

61 Chapter 4 Smart visualisation

62 Foundation of a web enabled visualisation system Client server distributed architecture

63 Components of a visualisation pipeline Example Thick Client Medium Client Thin Client

64 GDAL colour relief command: gdaldem color-relief inputfile colourramp outputfile

65 Use case: dynamic re-scaling

66 Zoom in dynamic rescale

67 Zoom in dynamic rescale

68 GDAL hillshade command: gdaldem hillshade -s az 45 -alt 45 inputfile outputfile

69

70 Work Flow for dynamic scaling Web Map Service Web-GIS WMS WCS wrapper (include GDAL processing) Web Coverage Service WCS Client-side Server-side Data

71 Visualisation Architecture Design - Use Service Oriented Architecture (SOA) principles - Open Geospatial Consortium (OGC) standards particularly important - Other standards to be used: -Internet Engineering Task Force (IETF), -World Wide Web Consortium (W3C), -Organization for the Advancement of Structured Information Standards (OASIS), -International Organization for Standardization/Technical Committee 211 (ISO/TC 211)

72 Conclusion

73 Five Top Tips -Be clear who audience is and involve from beginning - Good quality metadata is the backbone of your information system - Adopt international data management standards and protocols - Plan for the long-term sustainability of systems from the beginning - Prioritise institutional issues - greatest challenge

74 Acknowledgements - Declan Dunne Yassine Lassoued Trung Pham Ali al Othman Mehdi Essid..and other CMRC colleagues..and ICAN Dawn Wright Thetis spa, Italy