Implementing Inspire Download Services using Open Source and FME Software at Geological Survey of Norway Bjørn Ove Grøtan - NGU FMEDagarna 11-12th October 2010 Geologi for samfunnet
About Geological survey of Norway NGU is the national institution for knowledge on bedrock, mineral resources, surficial deposits and groundwater NGU s main tasks are to collect, process and distribute knowledge of the physical, chemical and mineralogical properties of the country s bedrock, surficial deposits and groundwater. In its work, NGU shall emphasise users need for: The construction, operation and maintenance of national databases and map series for geological properties and processes. Geological mapping of Norway s onshore and offshore areas. Applied research and method development. Consultancy and information. As a government agency NGU applies Etical Guidelines for the Public Service in every aspect of our work. NGU has 225 employees, of which approximately 65% are scientific personnel.
GIS and IT at NGU 12 online maps and database-views. 80 services (WMS and WFS) 14 GIS-staff 9 IT-staff (servers, network, workstations etc)
Agenda Introduction to the project Alternatives for implementing Workflow Integration and architecture Experience so far
Project: Online geology download on demand INSPIRE Download Service Requirements from Norway Digital-agreement Web-based downloadservice Export-format: SOSI (norwegian format) Software available for SOSI-export Geology on demand! How fresh can you get it?
Inspire Draft Download Services Technical Guidelines 1. Predefined datasets or predefined parts of datasets 2. Direct Access Download Service (WFS) Get Spatial Objects ( WFS: GetFeature) Describe Spacial Object Types (WFS: DescribeFeatureType) Link to dataset or part of dataset (file) stored in Inspire DiscoveryService Link to dataset in metadata whereby the dataset or part of dataset can be downloaded using simple HTTP-request.
Alternatives for implementing SOSI 4.0 delivery according to Norway Digital GeoSOSI Professional developed as plugin to FME. INSPIRE DownloadService recommends file-based download or WFS-enabled services. Options a) Inhouse dev. (FMEObjects +FMEDesktop/GeoSOSI) b) FME for ArcGIS Server Edition c) FME Server Our thoughts: Self service (It obviosly belongs on the web) Java-platform (language of choice inhouse) Geology on-demand geology as fresh as bread Human resources vs off-the-shelve -solutions
FME Server - architecture Java Enables services Datadownload Datastreaming WMS WFS KML 1 lisence pr Engine PRE_COMMAND and POST_COMMAND E-mail (zip & ship)
Dataformats Generic Writer Pros and cons: Generic writer (on-the-fly conversion. Nice!) SOSI 4.0 (GeoSOSI, not supported by Generic Writer) KML (supported from FME 2010) Dataformats 250 different formats. ESRI Shape File geodatabase Personal geodatabase KML? SOSI 4.0
Boxology
FME Desktop - models
Publish to FME Server
Other means of publishing models FME Server Console API (Java,C#,VB.net) SOAP FME Desktop FMEServer servlets
FME Server and integration Webinterface (downloadservice/jobsubmitter) WMS / WFS Python (FMEObjects, f.eks. fra modell) WebService (SOAP, c++ client) Batch using FME Server Console FME Desktop (publish/run) API (Java, C#,.NET, REST!)
Back office solution Customized models for powerusers Using FME Server inhouse Simplified and fast delivery to customer/users. Self service as well as individual orders by email or phone/fax
Quality and simplify Quality assurance Automated use of input-parameters (workbench) Using FME Server Java API for valid workbench parameters and arguments
Challenges Off of the box It s not a given that all models will run in both FME Desktop as well as FME Server (at least for previous versions) Need for multiple models/workspaces per dataset due to SOSI-plugin not supported by Generic Writer Continious testing of new software versions and APIchanges between major versions FME Server 2008, 2009 and 2010 GeoSOSI (6 versions on FME 2010 alone)
Out of the box Requires Java servlet-container (JVM 1.5, JSP 2.0, IE7/Firefox 2.0) Simple and intuitive webinterfaces JSP-templates for web-pages and plaintext-templates for emails (zip & ship) Point n click installation Ready-to-go applications and sample workspaces/models. Enabled to run in a distributed environment from the beginning Our setup: Virtual server (Windows 2008) Floating lisence for each FME Server and FME Desktop Apache (2.2.x) webserver og Tomcat (6.0.x), mod_jk Email using existing infrastructure (Exchange) Using servicenames (DNS) vs physical servernames Using OpenLayers with national SDI basemaps
API Matrix JAVA REST Get Repositories YES NO Get Workspaces YES NO Get Workspace arguments + parameters YES NO Submit job YES YES Order Download (zip & ship w/email) NO YES Wish list: consolidated APIs
Tips and experience Sdeviews for data delivery Easy deployment Deploy to FME Server from FME Desktop Use clip-method suitable for the dataset (Clipper vs Spatial filter) Let Workspace verify input parameters and data. Quality assurance! FMEPedia for examples and codesamples
Thank you for listening! Bjorn.Ove.Grotan@ngu.no Norges geologiske undersøkelse - Geologi for samfunnet