Bureau of Meteorology use of open spatial standards Robert Wilson Bruce Bannerman ISO TC211 8 Dec 2010 V0.4 061208
Overview Current - Bob Bureau Web Services Enterprise Architecture Bruce Climate and Water - Bruce Prototype projects
Spatial Interoperability Demonstration project Supported by OGC, AusIndustry and ASIBA (Australian Spatial Information Business Association). The Bureau was awarded the Research and Innovation Award in 2005. This project provided the basis for the Bureau s current OGC web service infrastructure, which is a central part of the Bureau s GIS2Web project.
GIS2Web A brief history A trial web mapping service build on MapServer and PostgreSQL ran from 2005 to 2006. This service was popular with a range of Registered User clients. In 2007 the service was made more robust and secure, and Catalogue Driven. The experimental service provides agile development for non-operational services. In 2008 a comprehensive project implementation plan was completed with internal and external stakeholder input. In April 2009 operational web services were launched and release two earlier this year. In 2011 the GIS2Web project plan will be reviewed and updated. This will include the physical and software architecture, services, stakeholder requirements and to include Bureau developments.
GIS2Web Described GIS2Web is a layered system to deliver Bureau data to clients who require spatial formats. The service combined OGC Web Mapping and Web Feature services with OPeNDAP services and FTP services. Presentation is consistent with web products. These are based on WMO Guidelines. The web is another channel for the information dissemination. Important for Emergency Management Users.
Operational WMS (1.1.1) Services Radar rainfall intensity (updated every 6-10 minutes for 60 radar sites) Mean Sea Level Pressure from ACCESS model (updated 4 times a day and include forecasts from analysis time to 72 hours in hourly time steps) 10 m Wind Analysis from ACCESS model (updated 4 times a day and include forecasts from analysis time to 72 hours in hourly time steps) Sea Surface Temperature (updated daily) Satellite IR Black and White and Colour (updated hourly) Surface Weather Observations (updated every 15 minutes) Smoke Dispersion Models (updated twice daily and include forecasts from 00Z to 48 hours from fixed sourced locations) Victoria only Tropical Cyclone Track Maps (updated as needed during Tropical Cyclone season) Bureau boundaries and location data (Radar Locations, Radar Optimum Extent Areas, Coastal Waters, High Seas, Public Weather Forecast Districts, Rainfall Districts and Tropical Cyclone Service Areas) Radar Thunderstorm Tracking (updated every 6-10 minutes for 11 radars)
Operational WFS Services (Version 1.0) Surface Weather Observations (updated every 15 minutes) -Current Surface Weather Observations (updated every 15 minutes) for last 24 hours Tropical Cyclone Track Maps (updated as needed during Tropical Cyclone season) More information is available at: http://www.bom.gov.au/faq/gis2web_operational_release_2_faq.pdf
WMS Example: Radar Converted from RLE ASCII polar files to point based shapefiles and directly served. Previously served via PostGIS. Grouped by State to increase useability. Updated every 10 minutes (6 minutes for Melbourne, Sydney, Brisbane) Planned radar upgrades include Hobart (TAS), Mt Isa (QLD) and Croker Island/Maningrida (NT)
WMS Example: Radar / Nodata Outages include routine maintenance and unscheduled outages. Radius is now set 250km and has No Data Text
WMS Example - Surface Weather Observations Converted from AXF (ASCII) format Any new updates published every 15 minutes Data is accessed from PostGIS. Station ID and Name YMMB Time (UTC) 0130 QNH (Pressure) 1017.1 Rainfall since 9 am 0.0 last 10 minutes 0.0 Relative Humidity 35 Dewpoint Temperature 10.5 Dry bulb Temperature 30.0 Wind barbs and Maximum Gust last 10 minutes - 30 Cloud cover, visibility, weather conditions
WMS Example -Tropical Cyclones Track Maps developed in application called TC Module Data saved as GML Data translated to GML simple features and shapefiles
WMS - Tropical Cyclones - GIS View Fix Points Track Lines Wind Areas Forecast of Track Areas Warning Areas Watch Areas
WMS Example - AODN Oceans Portal
Future Services - Rainfall Estimates Melbourne, Sydney, Brisbane, Adelaide since 9 AM, daily accumulations blended with rain gauges and updated every 30 min 10 min accumulations radar only and updated every 6 or 10 minutes
Future Services- Rainfall Forecasts 60 min accumulation Probability of rain > 50 mm Forecast time series at a point with uncertainty shown 0-90 Minute Capital city forecasts, 1 km & 6 min resolution, 250 km domain Regional forecasts, 2 km & 10 min resolution, 500 km domain 30 member ensemble updated every 6,10 minutes 30, 60, 90 min accumulations of ensemble mean (expected rain) Probability that rain accumulation will exceed 1,2,5,10,20,50 mm in next 60 minutes 1-6 Hour Forecasts Other areas of future development include, forecast products, more NWP gridded data, aviation products, extension of plume modelling, quantitative rainfall, water data and climate data.
GIS2Web Applications Stack ArcGIS Spatial Data Admin Analysis/Generation Data Clients Web Browsers OpenLayers Tile Cache MapInfo ArcGIS Explorer UDiG OpenJump ESRI Geo-portal Google Earth Web Portals FTP MapServer IDL GeoServer OPeNDAP Apache/Tomcat Data and Mapping Services ArcCatalog SIMS Catalogue Proj4 Catalogue GeoNetwork ISO Metadata FOSWIKI Catalogues / Documentation Apache/Tomcat ESRI SDE PostGIS OGR/GDAL ShapeLib OPeNDAP FileServer IDL Direct Access Spatial Enablers Oracle Data Sources PostgreSQL File Data KML, GML, ESRI Shapefiles, MapInfo, CSV, GeoTiff/Tiff, HDF, NetCDF, Grib,Bufr etc.
GIS2Web Structures and Data Flows User Communities - EM, CT, CI, Marine, Hydrological, Meteorological, Research, GIS etc BoM Web OpenLayers External Clients Spatial Web Services Internal Clients Catalogues ISO Metadata SIMS Catalogue Bureau Symbology/ Standard WMS WFS T-WFS DAP HTTP FTP WCS KML FTP Services OGC Web Services Non-OGC Services ArcCatalog Proj4 Spatially Enabled Data for Web Mapping Services and Staging Databases Spatial Enablement libraries OPeNDAP NCML GDAL ORG Shapelib IDL Primary Data Stores CMSS Geospatial and non-spatial RTDB ADAM NEONS SitesDB AIFS DB A to X Hydro FDB SAM ADFD MARS File Storage Middleware OPeNDAP File Storage Spatial SDE Spatial DB Source Data and Data Processing Sensor Output Numeric Model Output Spatial Model Output GTS AWS Marine Satellite Radar Spatial Data
GIS2Web Outcomes Users can integrate Bureau data with their data, using their preferred desktop or internet mapping/gis package Less data management (no data translation, storage, maintenance) Better integration of systems and shorter development time. Point of truth dataset ie data from the authoritative data source Up-to-date data crucial for emergency management Standard symbology Eliminates the barriers of data sharing between organisations Not dependent on proprietary software More time for analysis Saves time and money 24/7 Operational Provides a multi channel approach for data dissemination. Able to service a broad range of Stakeholders and clients.
GIS2Web Standards GIS2Web is made possible through the implementation of spatial interoperability standards including: OGC Web Map Service (WMS) OGC Web Feature Service (WFS) OGC Web Coverage Service (WCS) OGC Geographic Mark-up Language (GML) Styled Layer Descriptor (SLD) WMO Symbology / AFAC All Hazards Symbology The ISO 19000 series Other standards include: NetCDF and HDF, DAP and THREDDS, FTP RFC 2428 - submitted to the Internet Engineering Task Force (IEFT) in 1998 The operational services will need to adopt international standards to ensure international interoperability.
Enterprise Architecture
Climate and Water Open Spatial Standards activities Climate architectural framework Open Layers based web mapping tools - data sourced via Bureau WMS prototype open spatial standards services Spatial Technologies Demonstration Prototype International Collaboration - Climate Water, together with CSIRO Application Schema (WDTF, WaterML 2.0) Model driven Architecture International Collaboration - Hydrology
Open Spatial Standards Seen as critical to future investments and for opening up data Looking at initially: WMS, WFS, WCS, WPS CSW using ISO 19115 Considerable effort in Water Domain currently (others following): Observations and Measurements Anticipated: SWE services
Bureau WMS, Climate and Water WFS QGIS
Prototype Water Storage WFS
Prototype Climate Extremes WFS filter by attributes
Prototype Climate Extremes WFS filter by attributes selected features tabular view
Prototype Climate Extremes WFS filter by attributes selected features - spatial view
Prototype Climate Extremes WFS classify by attributes
Services with udig
Climate Extremes WFS - gvsig
Climate Extremes WFS gvsig filter
Climate Extremes WFS ArcGIS Classification
Climate Extremes WFS ArcGIS Classification
Bureau WMS it sometimes doesn t work - clients
Climate Extremes - WFS Open Layers
Auscope Portal
Climate Extremes - WFS Dynamic access in Google Earth
Water Storage - WFS Dynamic access in Google Earth
One set of services many clients it works! Sort of
Simple services no context no (data) interoperability
Where to from here? Great leadership from TC/211, OGC and CSIRO Setting direction 10 15 years from now Considerable functionality and potential coming Community agreed Application Schema are required Based on Observations and Measurements Global agreement e.g. Climate is Global Issue Much work and collaboration required
Where to from here? OGC and TC/211 need to work closer together: OGC have great processes Communities of Practice - Domain Working Groups Vendor Support & implementable - Interoperability tests Very steep learning curve Just get started
Questions?