Transfer of Statistical Data from the German Federal and State Governments to the European INSPIRE Network Mark Döring & Sören Dupke 1
INSPIRE Data harmonization projects IT.NRW
Project Summary Project Partner > IT.NRW (Representative for the statistics authorities of the federal states) > con terra GmbH Prototype > Transformating statistics data of the federal states from the GENESIS DB into INSPIRE Annex III (SU, PD) Documentation of the approach > Aggreement on how to continue with the statistics data from the federal states 3
Spatial ETL Extract Transform Load Get the right data to the right system, in the right schema, at the right time Translate Datenconversion > 300 formats and Datasourc Transform Schema mappingand transformation Integrate Merging of Information and loading inot information systems Distribute Distribution of Data in specific formats and schemas 4
Data Harmonization with Spatial ETL Extraction of statistics data from Geodata > Attribute information and spatial reference > Migration into standard Applications Excel, Access, Oracle, MS SharePoint, Informatica Migration of statistics data into SDIs > INSPIRE (Statistical Units, Population Distribution) > Migration into standard GIS Applications ArcSDE, Geodatabase, Shape Files,... 5
Output-Model 6 Defining the Transformation process with FME Workbench Schema-Mapping Input-Model
General Approach INSPIRE Solution Pack for FME ArcGIS for INSPIRE INSPIRE Consumer ETL European SDI Internal Information Resources and Databases INSPIRE Datapecifications& Services 7 con terra GmbH
Initial situation of INSPIRE schema mapping INSPIRE expert knowledge and domain expertise are required High complexity of the source data and the INSPIRE destination model It has to be accounted for local characteristics (quality, history, contents) - Internal data models - Meta data - Data history - Data quality - Expertise (Domain) INSPIRE Solution Pack for - INSPIRE data models - INSPIRE specifications - INSPIRE legislation - INSPIRE requirements - Expertise (Annex 1) 8 con terra GmbH
ETL-Process supported by INSPIRE Solution Pack for FME Template Workspaces for all Annex I-Themes 9 con terra GmbH
ETL-Process supported by INSPIRE Solution Pack for FME INSPIRE relevant source data requires individual mapping Individual Mapping Pre-defined Mapping 10 con terra GmbH
Challenge Complex Source data > IT.NRW has the semantic knowledge > Knowledge about INSPIRE Data specifications and data structure at con terra GmbH Complex Targetmodel (AU, SU, PD) > Beta Status of the tools (ISP, AfI) > Specifications not final (Draft Version, SU, PD) 11
Source Data Gemeinsamen Neuen Statistischen Informations-System (GENESIS) Available Formats / Protocols > SOAP Service > XML Web-Service > CSV-Files (preprocessed) 12
Sourcedata GENESIS Export 13
Source Data IT.NRW Gemeinde (municipality) Geometries Daten Shape Datasets ca. 12.000 Features Gemeindeschlüssel (ID) 14
Population Distribution 15 con terra GmbH
INSPIRE Population Distribution (class diagramm) 16 con terra GmbH
Semantic Mapping 17 con terra GmbH
Mapping Process (GENESIS to INSPIRE) 18 con terra GmbH
Project results Project report INSPIRE Data Download Service (Prototype) 19 con terra GmbH
Conclusion Good knowledge of source data and source schema neccessary > Content and structure > Complex target schema Communication neccessary > Close cooperation between Geo- und Statistics Department Fuzzy use of source schemamake the mapping difficult > Spatial ETL to harmonize the sourcedata Schema mapping usually possible during a time frame between 5 and 10 days 20 con terra GmbH
Nutzung von INSPIRE Diensten ArcGIS Online INSPIRE GML Dienste European SDI FME Desktop MXD-Dokument ArcGIS Online ArcGIS Server Dienst ArcGIS Server ArcGIS Desktop Java Script Client 21 ETL Prozess Datenhaltung GDB
22
23
Thank you for your attention! Hamburg con terra Gesellschaft für Angewandte Informationstechnologie Münster Hannover Leipzig Martin-Luther-King-Weg 24 48155 Münster Telefon +49 251 747 45 0 Telefax +49 251 747 45 2111 Bonn Wiesbaden Kranzberg Mark Döring E-Mail: m.doering@conterra.de Nyon Burgdorf Zürich Sören Dupke E-Mail: s.dupke@conterra.de 24