GIS at UCAR The evolution of NCAR s GIS Initiative Olga Wilhelmi ESIG-NCAR Unidata Workshop 24 June, 2003
Why GIS? z z z z More questions about various climatological, meteorological, hydrological and environmental issues, that require crossdiscipline data or knowledge. Need for quantitative methodologies and tools to access, extract, analyze, and disseminate the required data and information. GIS makes it possible to combine data and procedures for visualization, integration, spatial analysis, storage, and sharing of information. GIS is widely accepted in the geo-sciences but their extra value for meteorological applications is still under-used.
Why GIS at NCAR? NCAR as an integrator a center for the broad geosciences community that brings together the ideas, the people, and the tools to address scientific questions of critical importance to society. Interdisciplinary research Spatial data and analysis Knowledge sharing and education Connection to universities New generation of scientists Systematic methods for organizing, sharing, and integrating geospatial information are essential to advancing earth system science and other aspects of the geosciences.
The meaning of GIS Geographic information science multidisciplinary field concerned with developing a theoretical basis for GIS Cognitive science Geography Cartography Information science Computer science Research for spatial cognition, data collection, representation in digital data models, spatial analysis, visualization
The meaning of GIS Broad range of spatial information systems Geographic information systems a system of hardware, software, data, people, organizations, and institutional arrangements for collecting, storing, analyzing and disseminating information about areas of the earth. Dueker and Kjerne (1989)
GIS in atmospheric community Custom-developed expert systems
Expert systems Well-suited for atmospheric applications Limited integration of atmospheric science data and research with data and research from other geo-and social sciences
GIS in geo- and social community Non-expert systems Commercial GIS packages
Commercial GIS Widely used in geo- and social sciences Represent only a limited range of concepts and models for representing geographic space
GIS Strategic Initiative Goal of the initiative is to promote and support the use of GIS as both an analysis and an infrastructure tool in atmospheric research and To address broader issues of data management and geoinformatics within the geo-sciences
Objectives Not a radical introduction of GIS into an atmospheric community Rather, reevaluation of existing GIS technologies in light of recent GIS advances.
Integration and user-friendly data exchange Interoperability between expert and non-expert applications More end-users
First Steps (2001-2002) Assessment of users, technology and potential applications Seminar series Workshop on GIS in Weather, Climate and Impacts State-of-the-art technology, Research applications Data, visualization, interoperability
Phase II (2003-2005) Developing an integrated GIS Program across UCAR Education, training and user support Research enabled by GIS Data and web services Research in GIS technology
Some Guiding Principles GIS education and software training are critical factors in ease of technology adoption. Demonstration projects are the most effective means to uncovering issues, testing solutions, and highlighting successes. Seek to address interoperability through a Web services approach for managing data and publishing content. Our legacy systems are important resources that must be considered in all interoperability requirements.
Education, training and user support
GIS education and support Seminars educational lecture series Workshops on GIS in Atmospheric Science August 2002 - GIS in Weather, Climate and Impacts Summer 2004 - TBD GIS services center GIS training program Establish a GIS users group GIS expertise and technical support
Research Enabled by GIS
GIS Demonstration Project - IHOP Focus - to examine both commercial and open source approaches to data interoperability in GIS environments Open GIS Consortium defines middleware architecture for geospatial information. A consortium of government, academic and technical members that guide the development and adoption of OpenGIS specifications Web Mapping Server, Web Feature Server NCAR legacy data stores Environmental Systems Research Institute, Inc. (ESRI) ArcGIS, ArcIMS, ArcSDE Relational database management tools
IHOP domain Over 250 researchers, 6 aircrafts, large number of sensors (> 60) Widely varying needs for spatial data display, analysis and dissemination Opportunity to explore GIS interoperability
Data Types of data collected during IHOP included aircraft, mesonet, land surface, model outputs, wind profilers, radars, satellite, soundings, wind profilers.. Data selection criteria Level of dataset demand (e.g., soundings) Applicability to scientific collaborators involved in this GIS demonstration (e.g., land surface atmosphere interactions research questions) Availability of associated geo-referenced meta-data Availability of existing data format decoders Based on selection criteria, the demonstration project is focusing on upper air soundings, surface mesonet, aircraft flux measurements, land surface satellite, and radar.
Project s framework
OGC Track In order to employ an OGC approach, NCAR/UCAR are participating in the OGC conformance and interoperability test and evaluation (CITE) initiative as a beta release site for OGCsanctioned, open source implementation of OpenGIS services. The reference servers are now installed and running. The next step is to extend the OGC servers with a connector to the IHOP subset database.
OGC Web Mapping Server
Preliminary observations Benefits Open GIS Consortium Promoted heavily within national and international standards efforts, e.g., Geospatial One-Stop, GSDI Defines only the interface not the backend, thus the implementations can be tailored to the organizational needs Removes reliance on a single vendor solution
Preliminary observations Limitations Open GIS Consortium Early development of specifications results in software development aimed at a moving target Few examples are available for reference Lack of how-to documentation, training, or educational material Currently limited to simple features (WFS) and images (WMS)
ESRI Track File-based conversions Currently ESRI software does not support common atmospheric data formats (e.g., netcdf). Data decoders were developed and used to bring selected observational data into ArcGIS
Observational Data Model Prototype geodatabase IHOP Observational Data Model was developed using the common Universal Modeling language (UML) for object oriented design. The data model encapsulates geospatial quantitative, time varying data (features) as well as qualitative field experiment information.
ESRI Internet Mapping Server
Preliminary observations Benefits A broad user base ESRI A de facto standard for spatial information exchange Many compatible datasets available, through both direct connections to servers as well as indirect file sharing Direct access to data on the Internet via g.net Strong educational and training products available Good user interfaces to ArcGIS products Excellent digital cartographic tools Very large API for application development and customization (ArcObjects)
Preliminary observations Limitations ESRI Windows oriented (for Linux and Unix users) Limited ability for managing time varying, large, complex n- dimensional datasets Direct dependence on RDBMS technology necessitates new mappings of atmospheric data to relational database model
Preliminary conclusions Both OGC and ESRI approaches are beneficial to GIS interoperability Collaborative partnerships are important To promote deeper understanding of the technology Help to advance GIS technology with respect to atmospheric science
Partnerships: NCAR-OGC The goal of this cooperation is to work together to accelerate the development of OpenGIS technology within the atmospheric sciences and to extend OpenGIS specifications to include the geospatial processing needs of the atmospheric community.
Partnerships: NCAR-ESRI Advancing GIS technical methods and technologies. Exploring the development of atmospheric information and models within GIS domains. Working jointly and fulfilling research and application projects. Supporting education and developing educational materials for a variety of audiences associated with GIS and atmospheric science.
Research enabled by GIS
Data and Web Services to make data and information services uniformly available with easy access to scientific data independent of how and where they are collected and stored. - Data Management Working Group (DMWG) -
Data and Web Services In collaborations with DMWG identify and promote technologies that support a coherent and federated approach to managing and publishing UCAR s data Clearinghouse of GIS-friendly translators for common atmospheric data formats Internet Servers
Internet Mapping - Data Portal - GIS Data access over the internet
Integration of Efforts Within UCAR: GIS Advisory Group (GAG) Data Management Working Group (DMWG) Knowledge Environment for the Geosciences (KEG) Community Data Portal (CDP)
Research in GIS Technology
Research in GIS Technology Establishing metrics for evaluating the practical limits of GIS and RBDMS. Advances in the area of 4-D and real-time data management in a GIS framework Data models for atmospheric science
GIS Program Development Conduct demonstration projects Establish university relationships: projects, joint proposals, visiting program for students and faculty Build strong collaborative partnerships Establish GIS in Atmospheric Science consortium
2002 workshop recommendations Need for effective communication and collaboration among researchers, GIS developers, practitioners Need for developing organization-wide GIS infrastructure Staff and resources Interoperability between GIS and atmospheric models Training and education of atmospheric scientists in GIS
Where we are now? Much of a year went on gathering resources, building partnerships, training in GIS, coming up to speed on GIS interoperability technologies, and evaluating architectural tradeoffs for systems integration. GIS Program, NCAR GIS Coordinator, UCAR-wide ESRI site license, educational and training program, escalating number of new proposals, joint projects, growing interest in GIS. Interoperability demonstration project is underway. Strategic partnerships with ESRI and OGC. Formation of Atmospheric SIG at ESRI user conference.
Challenges the application of GIS is limited only by the imagination of those who use it J. Dangermond Organizational Change Leading by example Slow visible productivity in the beginning Education Data exchange formats User-friendly data and information exchange Technology challenges 4D real time data
Other efforts Session on GIS in meteorology at AMS annual meeting Geospatial One-Stop ESRI and OGC tracks WMO work on metadata and standards NOAA and NWS - Internet Mapping Servers Europe Sessions on GIS in meteorology and climatology since 2000 COST-719: to broaden and enhance the potential of GIS in the fields of climatology and meteorology by developing applications in those fields, with emphasis on the procedures and capabilities for integrating and adding value to data from various sources and on quality control and presentation of climate and other related data
Benefits of using GIS Better access to scientific information Increased number of users of atmospheric science data and products New research areas enabled by GIS Expanding modeling of reality Coupling of weather data to the surface activities Collaboration with private sector, government agencies Increased educational opportunities (K-12 to policy)
http://www.gis.ucar.edu Olga Wilhelmi Terri Betancourt Jennifer Boehnert Thanks!