The CUAHSI Hydrologic Information System

Transcription

1 The CUAHSI Hydrologic Information System Presented by Dr. Tim Whiteaker The University of Texas at Austin 18 November, 2010 Session T1B

2 About the Speaker PhD 2004 Research Associate

3 What You Will Learn What is the CUAHSI Hydrologic Information System (HIS) History Why people use it How to access data in HIS How to publish your data with HIS

4 Outline The HIS Story HIS components Putting the pieces together

5 Outline The HIS Story HIS components Putting the pieces together

6 HIS Connects People with Data The CUAHSI* Hydrologic Information System (HIS) provides web services, tools, standards and procedures that enhance access to more and better data for hydrologic analysis. his.cuahsi.org *Consortium of Universities for the Advancement of Hydrologic Science, Inc.

7 Niagara Peninsula Decision Support

8

9

10

11 What is CUAHSI Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001 Develops infrastructure and services to advance hydrologic science in US universities Earth Sciences Atmospheric Sciences Ocean Sciences CUAHSI HIS National Science Foundation Geosciences Directorate

12 CUAHSI Member Institutions 112 North American universities, and 16 international affiliates

13 CUAHSI Hydrologic Information Systems Project David R. Maidment The University of Texas at Austin (HIS Project Leader)

14 CUAHSI HIS Development 2000 CUAHSI Regional Meetings HIS Pilot Project HIS Development Project

15 too much water dirty water too little water water environment

16 Please rank these four HIS service categories for helping you. Conclusion: Data services are the highest priority

17 Which of the following data analysis difficulties are most important for HIS to address? Priorities are: Data formats Metadata

18 Data Integration Hydrologic Observations GIS Data Digital Watershed Weather and Climate Remote Sensing Currently, the focus is on data from monitoring sites at point locations.

19 The Result WaterML language for describing water data WaterML Standards National catalog of water data sources Metadata Catalog Services Free software for data access Software

20 Metadata Catalog, October public services 18,000+ variables million sites 23.3 million series Referencing 5.1 billion data values Map integrating NWIS, STORET, & Climatic Sites

21 Streamflow 2 services 7 variables 4,363 sites 11,484 series 9,493,968 records

22 Salinity 5 services 7 variables 6,613 sites 7,912 series 346,813 records

23 Water Temperature 6 services 11 variables 11,158 sites 22,953 series 1,546,841 records

24 Dissolved Oxygen 5 services 18 variables 10,823 sites 21,655 series 930,571 records

25 Bacteria 1 service 21 variables 4,801 sites 15,483 series 297,849 records

26 Nutrients 1 service 25 variables 5,635 sites 52,396 series 856,194 records

27 3 services 7 variables 6,228 sites 16,576 series 785,650 records

28 For more on the HIS Story his.cuahsi.org

29 Outline The HIS Story HIS components Putting the pieces together

30 Web Paradigm Catalog (Google) Catalog harvest Search Web Server (CNN.com) Access Browser (Firefox)

31 Services Oriented Architecture for Water Data HIS Central Service registration Catalog harvest Search HydroServer Data access HydroDesktop

32 HIS System Overview USGS Dat a University Web Service Data Registration HIS Central HIS Central Metadata Catalog Hydrologic Ontology Dat a HydroServers Data Access Data Discovery Users (HydroDesktop)

33 Water quantity and quality Water Data Soil water Rainfall & Snow Remote sensing Meteorology Modeling

34 Point Observations Time Series A point location in space A series of values in time

35 Sources of Observations Data

36 Getting Water Data (the old way) Different Query Pages Different Query Responses

37 WaterML as a Standard Format Streamflow data in WaterML language Discharge of the San Marcos River at Luling, June 28 July 18, 2002

38 WaterML includes location, variables, and time series location variable time series

39 Web Pages and Web Services Uses Hypertext Markup Language (HTML) Uses WaterML (a Markup Language for water data)

40 Point Observations Information Model Utah State Univ Data Source Little Bear River Network WaterOneFlow Service Little Bear River at Mendon Rd Sites GetSites GetSiteInfo Dissolved Oxygen Variables 9.78 mg/l, 1 October 2007, 5PM Values {Value, Time, Metadata} A data source operates an observation network A network is a set of observation sites A site is a point location where one or more variables are measured A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time Metadata provide additional information about the value GetVariableInfo GetValues

41 WaterOneFlow Set of query functions Returns data in WaterML

42 WaterML and WaterOneFlow Locations Variables Date Ranges Client LOAD GetSites GetSiteInfo GetVariableInfo GetValues WaterML WaterOneFlow Web Service TRANSFORM USGS Data Data EPA UT Data Data Repositories EXTRACT WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML

43 HIS System HydroServer USGS Dat a University Web Service Data Registration HIS Central HIS Central Metadata Catalog Hydrologic Ontology Dat a HydroServers Data Access Data Discovery And Access Users

44 HydroServer Goals A platform for publishing space time hydrologic datasets that: Provides local control of data Makes data universally available Is open source (hydroserver.codeplex.com)

45 Ongoing Data Collection Point Observations Data Internet Applications Historical Data Files ODM Database GIS Data GetSites GetSiteInfo GetVariableInfo GetValues WaterML WaterOneFlow Web Service HydroServer Data presentation, visualization, and analysis through Internet enabled applications

46 ICEWATER A Regional HIS ICEWATER INRA Constellation of Experimental WATERsheds Coalition of 8 universities Point Observations Stream gages Water quality sampling Weather stations Soil moisture Snow monitoring Groundwater level/quality Spatially Distributed Data Land use/cover Terrain Hydrography AK WA OR CA NV I D UT AZ MT W Y CO NM

47 Operational HydroServers

48 HydroServer Alternatives KISTERS External Client Application HydroGET,. CUAHSI WMS/WFS SOS OpenMI APIs WISKI / Hydstra CUAHSI SOS APIs internal CUAHSI KISTERS Telemetry XHydro Vendor driver Import/Export Framework http (s)ftp DB DB DB Files KISTERS AG KISTERS group 48 24/11/2010

49 Why Publish Data with HIS Recognition Collaboration Public service Cost savings

50 What Have We Covered USGS Dat a University Web Service Data Registration HIS Central HIS Central Metadata Catalog Hydrologic Ontology Dat a HydroServers Data Access Data Discovery And Access HIS Overview HydroServer ODM WaterML Users

51 HIS System HIS Central USGS Dat a University Web Service Data Registration HIS Central HIS Central Metadata Catalog Hydrologic Ontology Dat a HydroServers Data Access Data Discovery And Access Users

52 HIS Central Publishers Register a data service Users Find a data service Supported by Metadata Catalog Hydrologic Ontology

53 Data Series Metadata description End Date Time, t 2 Time There are C measurements of Variable V i at Site S j from time t 1 to time t 2 Count, C Begin Date Time, t 1 Site, S j Space Variable, V i Variables

54 Metadata Catalog, October public services 18,000+ variables million sites 23.3 million series Referencing 5.1 billion data values Map integrating NWIS, STORET, & Climatic Sites

55 Streamflow Nutrients Water Temperature

56 Conceptual Framework Chemical descriptions from EPA/USGS Substance Registry System Physical descriptions from CF Conventions NetCDF Climate & Forecast; 137 variables pcmdi.llnl.gov/ Biological descriptions from Integrated Taxonomic Information System

57 Thematic Concepts Core Concept Property Branch Leaf Variables

58 HydroTagger Each Variable in your data is connected to a corresponding Concept

59 Water Temperature 6 services 11 variables 11,158 sites 22,953 series 1,546,841 records

60 HIS Central Web Page

61 HIS Central Web Service Programmatic methods to query the national metadata catalog Search by: Location Variable (concept) Date Range Data source (WaterOneFlow service)

62 HIS System HIS Desktop USGS Dat a University Web Service Data Registration HIS Central HIS Central Metadata Catalog Hydrologic Ontology Dat a HydroServers Data Access Data Discovery And Access Users (HydroDesktop)

63 HIS in Familiar Software

64 HydroExcel

65 Choosing a Service Tell HydroExcel which web service to use

66 Choosing a Site Google Earth opens, showing our sites Find sites and variables available from the web service GetSites GetSiteInfo GetVariableInfo GetValues WaterML WaterOneFlow Web Service Let s use this site

67 Downloading Time Series Input our site and a desired variable, e.g., net radiation, and tell HydroExcel to get the time series for March, 2007

68 Exploring the Time Series Explore time series using analytical capabilities of Excel

69 HydroExcel Limitations Can t hold much data No dates before year 1900 Not truly geospatially enabled Not free How can I use HIS in software built to work with HIS from the ground up?

70 HydroDesktop Free, open source solution for HIS data access

71 GIS fully integrated with HIS Metadata catalog Ontology keywords WaterOneFlow/WaterML Discovery Access Analysis

72 Built in Analysis Tables Graphs Editing Export

73 Customizable with Plug ins Community development Build on the HydroDesktop framework HydroModeler

74 Outline The HIS Story HIS components Putting the pieces together

75 Services Oriented Architecture for Water Data Catalog HIS Central HydroServer Service registration Data PublisherCatalog harvest WaterML Data access Search HydroDesktop User

76 The Road Ahead WaterML 2.0 Broader collaboration World Meteorological Organization Open Geospatial Consortium (OGC) Hydrology Domain Working Group Towards an OGC standard IEs groundwater, surface water RFC targeted for December, 2010 HydroServer Data access control HydroDesktop Refinement

77 The Road Further Ahead Using OGC Standards HydroCatalog (register) CSW HydroServer WFS SOS (WaterML 2) HydroDesktop

78 Put Your Dots on the Map

79 Start Using HIS HIS Website his.cuahsi.org User Support Specialist Yoori Choi