The EOC Geoservice: Standardized Access to Earth Observation Data Sets and Value Added Products

Transcription

1 The EOC Geoservice: Standardized Access to Earth Observation Data Sets and Value Added Products Klaus Dengler, Torsten Heinen, Albert Huber, Katrin Molch, Eberhard Mikusch DLR German Remote Sensing Data Center DFD Information Technology PV 2013 ESA/ESRIN, Frascati November 4-7, 2013

2 DLR.de Slide 2 Content Motivation Data Access Overview System Design EOC Geoservice Available Datasets Data Access, Request Examples and Services Examples using EOC Geoservice Summary and Outlook

3 DLR.de Slide 3 Motivation German Satellite Data Archive (D-SDA) currently maintains more than 2.9 PB Earth Observation data supplied by national, European and international missions D-SDA contains raw data and value added products (L0~4) Long-Term Data Preservation (LTDP) major task of D-SDA Traditional order based data access provided (DIMS/EOWEB ) No direct data access (download) is provided EOWEB Extension needed for fast, easy-to-use, and direct data access

4 DLR.de Slide 4 Data Access Traditional access to archived data (e.g. order and download) through DIMS / EOWEB HMA compliant for EO Community Direct data access through GDAS / Geoservice OGC compliant for Geodata Community Earth Observation Community Remote Sensing / Processing CEOS Acquisition tasking, data, discovery, ordering, download EOC Service Portals e.g. EOWEB GeoPortal Geodata Community GIS / Analysis GEO, INSPIRE, GDI-DE Direct data access EOC Service Portals for data access through both interfaces Catalog Interface EO Data Interface EO DIMS / EOWEB HMA-compliant data interfaces Catalogue Interface GEO Data Interface GEO GDAS / Geoservice OGC-compliant geodata services Harmonization of data access focus of Group on Earth Observations Archive Catalog Storage

5 DLR.de Slide 5 Data Access - System Design Overview EO Community Traditional Access (HMA) Geodata Community Direct Access (OGC) CSW-EO ORD-EO EOWEB Data Server CSW WMS WCS EOC Geoservice D I M S EOWEB Product Library Metadata & User G D A S GDAS Server Registered Product Data DIMS Product Upload Service GDAS Upload Service Harvest Trigger Long Term Archive Product Library Metadata & Primary Trigger DIMS Publisher Service NRT Processor Data Repository Product Data (L2, L3) FTP External processors External Data Sources Data

6 DLR.de Slide 6 System Deployment Concept of virtualization: geoservice.dlr.de tiles.geoservice.dlr.de Creation of Virtual Machines (VM) on physical hosts Sharing of host recourses Reduces amount of physical hosts needed Faster deployment, easier administration, more efficient resource management Blade Center Comp. 1 Comp. 1 GDAS-proxy Blade 1 Virtual Machine 1. Virtual Machine n. Comp. n Comp. n Comp. 1 Comp. 1 GDAS-tilecache Blade n Virtual Machine 1. Virtual Machine 1. Comp. n Comp. n Hardware details: Blades: SUN, ~12-16 Core/24-36 Threads RAM GB XEN hypervisor for virtualization Storage: SGI IS5500-SP storage trays Currently 35 TB (net, RAID 6) Shared file system (NFS) Data Repository Storage Tray 1 Volume 1 Volume n Storage Tray n Volume 1 Volume n

7 DLR.de Slide 7 EOC Geoservice Available Datasets Datasets Products Coverage Example Products of the Shuttle Radar Topography Mission (SRTM X-SAR) Digital Elevation Model (DEM) Shaded relief Elevation error map Global Date: 2000 Products of the EUMETSAT Ozone Satellite Application Facility (O3M-SAF) Daily: O 3, NO 2, BrO, HCHO, H 2 O, CF, COT, CTP NRT: As above + SO 2 Global Date: since 1995 MODIS-DE Mosaic Date: 30 Sept. to 03 Oct Mosaic of TERRA and AQUA MODIS products Germany Next: NOAA AVHRR Products Date: since 1980s 30 years timeline of thematic products, e.g. SST, LST, NDVI, snow cover Europe

8 DLR.de Slide 8 Data Access Using EOC Geoservice Users requesting geodata HTTP Request Data supply Discovery CSW-ISO Viewing WMS Download WFS/WCS Processing WPS EOC Geoservice / GDAS Earth Observation Datasets Geospatial Core Datasets Data Repository containing value added products

9 DLR.de Slide 9 HTTP Request Examples WMS (Viewing) o SRTM X-SAR Mosaic: o MODIS-DE Deutschlandmosaik_RGB_UTM84&bbox=0.6,44,18,58&width=2482&height=2600&srs=EPSG:4326&format=image/ png WMS (GetFeatureInfo, only vector data) o METOP-A: O 3 Munich area 27 Oct ,48,12,49&width=256&height=256&query_layers=METOP-A_GOME-2_L2_O3_DAILY&time= &x=128&y=128&Iinfo_format=text/html&format=text/xml WCS (Download) o METOP-A O 3 Latest METOP-A_GOME-2_L2_O3_LATEST&bbox=-170,- 70,170,89&width=300&height=300&CRS=EPSG:4326&format=GeoTIFF

10 DLR.de Slide 10 Available Services

11 DLR.de Slide 11 Using EOC Geoservice Google Earth Geoservice: Mobile Clients: EOWEB GeoPortal:

12 DLR.de Slide 12 Summary and Outlook Summary The EOC Geoservice extends the traditional order based data access of EOWEB It provides direct data access through OGC-compliant services (discovery, visualization, download) Focus on higher level products (L2 and up) The Geoservice Management Handbook & Operations Concept defines procedures for EOC Geoservice (ISO-9001) EOWEB GeoPortal (EGP) is the client interface for traditional HMA-based data ordering (EOWEB) and OGC-compliant direct data access (EOC Geoservice) Outlook In future L3 products of various missions & projects will be included (NOAA TIMELINE, Sentinel 5P, EnMAP) Improve system deployment and infrastructure to handle future challenges (data volume, traffic, performance)

13 DLR.de Slide 13 Thank you for your attention! Questions? Klaus Dengler DLR German Remote Sensing Data Center DFD Information Technology

14 DLR.de Slide 14 Data Access GDAS System Design CSW WMS WCS Squid AwStats Statistics Rules (authorize) GDAS-Proxy ( Data Repository Product Data (L2, L3) Harvest GDAS- Upload CSW Tomcat WMS WCS GeoNetwork GeoServer Metadata GDAS-Server Rules (authorize) Long Term Archive Product Library Metadata & Primary External Data Sources Data Coverage Indices ISO Metadata GDAS-Database (PostgreSQL / PostGIS)