Bureau of Meteorology use of open spatial standards

Transcription

1 Bureau of Meteorology use of open spatial standards Robert Wilson Bruce Bannerman ISO TC211 8 Dec 2010 V

2 Overview Current - Bob Bureau Web Services Enterprise Architecture Bruce Climate and Water - Bruce Prototype projects

3 Spatial Interoperability Demonstration project Supported by OGC, AusIndustry and ASIBA (Australian Spatial Information Business Association). The Bureau was awarded the Research and Innovation Award in This project provided the basis for the Bureau s current OGC web service infrastructure, which is a central part of the Bureau s GIS2Web project.

4 GIS2Web A brief history A trial web mapping service build on MapServer and PostgreSQL ran from 2005 to This service was popular with a range of Registered User clients. In 2007 the service was made more robust and secure, and Catalogue Driven. The experimental service provides agile development for non-operational services. In 2008 a comprehensive project implementation plan was completed with internal and external stakeholder input. In April 2009 operational web services were launched and release two earlier this year. In 2011 the GIS2Web project plan will be reviewed and updated. This will include the physical and software architecture, services, stakeholder requirements and to include Bureau developments.

5 GIS2Web Described GIS2Web is a layered system to deliver Bureau data to clients who require spatial formats. The service combined OGC Web Mapping and Web Feature services with OPeNDAP services and FTP services. Presentation is consistent with web products. These are based on WMO Guidelines. The web is another channel for the information dissemination. Important for Emergency Management Users.

6 Operational WMS (1.1.1) Services Radar rainfall intensity (updated every 6-10 minutes for 60 radar sites) Mean Sea Level Pressure from ACCESS model (updated 4 times a day and include forecasts from analysis time to 72 hours in hourly time steps) 10 m Wind Analysis from ACCESS model (updated 4 times a day and include forecasts from analysis time to 72 hours in hourly time steps) Sea Surface Temperature (updated daily) Satellite IR Black and White and Colour (updated hourly) Surface Weather Observations (updated every 15 minutes) Smoke Dispersion Models (updated twice daily and include forecasts from 00Z to 48 hours from fixed sourced locations) Victoria only Tropical Cyclone Track Maps (updated as needed during Tropical Cyclone season) Bureau boundaries and location data (Radar Locations, Radar Optimum Extent Areas, Coastal Waters, High Seas, Public Weather Forecast Districts, Rainfall Districts and Tropical Cyclone Service Areas) Radar Thunderstorm Tracking (updated every 6-10 minutes for 11 radars)

7 Operational WFS Services (Version 1.0) Surface Weather Observations (updated every 15 minutes) -Current Surface Weather Observations (updated every 15 minutes) for last 24 hours Tropical Cyclone Track Maps (updated as needed during Tropical Cyclone season) More information is available at:

8 WMS Example: Radar Converted from RLE ASCII polar files to point based shapefiles and directly served. Previously served via PostGIS. Grouped by State to increase useability. Updated every 10 minutes (6 minutes for Melbourne, Sydney, Brisbane) Planned radar upgrades include Hobart (TAS), Mt Isa (QLD) and Croker Island/Maningrida (NT)

9 WMS Example: Radar / Nodata Outages include routine maintenance and unscheduled outages. Radius is now set 250km and has No Data Text

10 WMS Example - Surface Weather Observations Converted from AXF (ASCII) format Any new updates published every 15 minutes Data is accessed from PostGIS. Station ID and Name YMMB Time (UTC) 0130 QNH (Pressure) Rainfall since 9 am 0.0 last 10 minutes 0.0 Relative Humidity 35 Dewpoint Temperature 10.5 Dry bulb Temperature 30.0 Wind barbs and Maximum Gust last 10 minutes - 30 Cloud cover, visibility, weather conditions

11 WMS Example -Tropical Cyclones Track Maps developed in application called TC Module Data saved as GML Data translated to GML simple features and shapefiles

12 WMS - Tropical Cyclones - GIS View Fix Points Track Lines Wind Areas Forecast of Track Areas Warning Areas Watch Areas

13 WMS Example - AODN Oceans Portal

14 Future Services - Rainfall Estimates Melbourne, Sydney, Brisbane, Adelaide since 9 AM, daily accumulations blended with rain gauges and updated every 30 min 10 min accumulations radar only and updated every 6 or 10 minutes

15 Future Services- Rainfall Forecasts 60 min accumulation Probability of rain > 50 mm Forecast time series at a point with uncertainty shown 0-90 Minute Capital city forecasts, 1 km & 6 min resolution, 250 km domain Regional forecasts, 2 km & 10 min resolution, 500 km domain 30 member ensemble updated every 6,10 minutes 30, 60, 90 min accumulations of ensemble mean (expected rain) Probability that rain accumulation will exceed 1,2,5,10,20,50 mm in next 60 minutes 1-6 Hour Forecasts Other areas of future development include, forecast products, more NWP gridded data, aviation products, extension of plume modelling, quantitative rainfall, water data and climate data.

16 GIS2Web Applications Stack ArcGIS Spatial Data Admin Analysis/Generation Data Clients Web Browsers OpenLayers Tile Cache MapInfo ArcGIS Explorer UDiG OpenJump ESRI Geo-portal Google Earth Web Portals FTP MapServer IDL GeoServer OPeNDAP Apache/Tomcat Data and Mapping Services ArcCatalog SIMS Catalogue Proj4 Catalogue GeoNetwork ISO Metadata FOSWIKI Catalogues / Documentation Apache/Tomcat ESRI SDE PostGIS OGR/GDAL ShapeLib OPeNDAP FileServer IDL Direct Access Spatial Enablers Oracle Data Sources PostgreSQL File Data KML, GML, ESRI Shapefiles, MapInfo, CSV, GeoTiff/Tiff, HDF, NetCDF, Grib,Bufr etc.

17 GIS2Web Structures and Data Flows User Communities - EM, CT, CI, Marine, Hydrological, Meteorological, Research, GIS etc BoM Web OpenLayers External Clients Spatial Web Services Internal Clients Catalogues ISO Metadata SIMS Catalogue Bureau Symbology/ Standard WMS WFS T-WFS DAP HTTP FTP WCS KML FTP Services OGC Web Services Non-OGC Services ArcCatalog Proj4 Spatially Enabled Data for Web Mapping Services and Staging Databases Spatial Enablement libraries OPeNDAP NCML GDAL ORG Shapelib IDL Primary Data Stores CMSS Geospatial and non-spatial RTDB ADAM NEONS SitesDB AIFS DB A to X Hydro FDB SAM ADFD MARS File Storage Middleware OPeNDAP File Storage Spatial SDE Spatial DB Source Data and Data Processing Sensor Output Numeric Model Output Spatial Model Output GTS AWS Marine Satellite Radar Spatial Data

18 GIS2Web Outcomes Users can integrate Bureau data with their data, using their preferred desktop or internet mapping/gis package Less data management (no data translation, storage, maintenance) Better integration of systems and shorter development time. Point of truth dataset ie data from the authoritative data source Up-to-date data crucial for emergency management Standard symbology Eliminates the barriers of data sharing between organisations Not dependent on proprietary software More time for analysis Saves time and money 24/7 Operational Provides a multi channel approach for data dissemination. Able to service a broad range of Stakeholders and clients.

19 GIS2Web Standards GIS2Web is made possible through the implementation of spatial interoperability standards including: OGC Web Map Service (WMS) OGC Web Feature Service (WFS) OGC Web Coverage Service (WCS) OGC Geographic Mark-up Language (GML) Styled Layer Descriptor (SLD) WMO Symbology / AFAC All Hazards Symbology The ISO series Other standards include: NetCDF and HDF, DAP and THREDDS, FTP RFC submitted to the Internet Engineering Task Force (IEFT) in 1998 The operational services will need to adopt international standards to ensure international interoperability.

20 Enterprise Architecture

21 Climate and Water Open Spatial Standards activities Climate architectural framework Open Layers based web mapping tools - data sourced via Bureau WMS prototype open spatial standards services Spatial Technologies Demonstration Prototype International Collaboration - Climate Water, together with CSIRO Application Schema (WDTF, WaterML 2.0) Model driven Architecture International Collaboration - Hydrology

22 Open Spatial Standards Seen as critical to future investments and for opening up data Looking at initially: WMS, WFS, WCS, WPS CSW using ISO Considerable effort in Water Domain currently (others following): Observations and Measurements Anticipated: SWE services

23 Bureau WMS, Climate and Water WFS QGIS

24 Prototype Water Storage WFS

25 Prototype Climate Extremes WFS filter by attributes

26 Prototype Climate Extremes WFS filter by attributes selected features tabular view

27 Prototype Climate Extremes WFS filter by attributes selected features - spatial view

28 Prototype Climate Extremes WFS classify by attributes

29 Services with udig

30 Climate Extremes WFS - gvsig

31 Climate Extremes WFS gvsig filter

32 Climate Extremes WFS ArcGIS Classification

33 Climate Extremes WFS ArcGIS Classification

34 Bureau WMS it sometimes doesn t work - clients

35 Climate Extremes - WFS Open Layers

36 Auscope Portal

37 Climate Extremes - WFS Dynamic access in Google Earth

38 Water Storage - WFS Dynamic access in Google Earth

39 One set of services many clients it works! Sort of

40 Simple services no context no (data) interoperability

41 Where to from here? Great leadership from TC/211, OGC and CSIRO Setting direction years from now Considerable functionality and potential coming Community agreed Application Schema are required Based on Observations and Measurements Global agreement e.g. Climate is Global Issue Much work and collaboration required

42 Where to from here? OGC and TC/211 need to work closer together: OGC have great processes Communities of Practice - Domain Working Groups Vendor Support & implementable - Interoperability tests Very steep learning curve Just get started

43 Questions?