NASA Earth Science Data Systems Program Martha Maiden Program Executive, Earth Science Data Systems Earth Science Subcommittee November 28, 2012
NASA s Earth Observing System Data and Information System Manages data from several types of sources satellite missions, aircraft investigations, PI-led dataset generation efforts Initiated in 1990 In operation since 1994 with mature metadata for heritage datasets In operation since 1997 supporting EOS instrument datasets starting with the Tropical Rainfall Measuring Mission A petabyte-scale archive of environmental data that supports global climate change research Designed to receive, process, distribute and archive several terabytes of science data per day Provides a distributed information framework supporting a broad user community Open Data Policy Data are openly available to all and free of charge except where governed by international agreements Consistent with Circular A-130 By having open application layers to the EOSDIS framework, we allow many other value-added services to access NASA s vast Earth Science Collection Interoperates with data archives of other agencies and countries 2
National Aeronautics and Space Administration Earth Science Measurements Acrimsat 12/99 Solar Output ACRIM Energy Budget CERES Albedo, Aerosols, Vegetation MISR Terra 12/99 Lower Atmospheric Chemistry MOPITT Surface Imaging MODIS, ASTER Aqua 5/02 Energy Atmospheric Surface Budget Sounders Imaging CERES AMSR-E MODIS AIRS/AMSU/ HSB SORCE 1/03 Solar Irradiance TIM, SIM, XPS Solstice Aura 7/04 Trace\ Atmospheric Gases Composition TES HIRDLS, MLS, OMI MESOSPHERE TRMM 11/97 Rainfall CERES, TMI VIRS, PR, LIS Rain Jason 12/01 Ocean Altimetry Poseidon 2/ JMR/DORIS GRACE 3/02 Gravity Field GPS, KBR CloudSat 4/06 Cloud Properties CPR CALIPSO 4/06 Cloud, Aerosol Properties CALIOP Rain OSTM 6/08 Ocean Altimetry Poseidon 3/ AMR/DORIS STRATOSPHERE O 3, CIO, BrO, OH, Trace Gases, Aerosols Ice Bridge 10/09 Ice Topography and Altimetry ATM Temperature Moisture Sea Surface Winds Ecosystem Dynamics TROPOSPHERE O 3, Precursor Gases, Aerosols Volcanology Ocean Biology Sea Ice Land Biology Fire Occurrence Ocean Surface Topography Evaporation H 2 O Ocean Circulation Land Ice and Snow Cover www.nasa.gov
Earth Science Measurements Applied
Discipline-oriented Data Centers ASF SDC SAR Products, Sea Ice, Polar Processes, Geophysics PO.DAAC Gravity, Sea Surface Temperature, Ocean Winds, Topography, Circulation & Currents NSIDC DAAC Snow and Ice, Cryosphere, Climate Interactions, Sea Ice LP DAAC Surface Reflectance, Land Cover, Vegetation Indices SEDAC Human Interactions, Land Use, Environmental Sustainability, Geospatial Data GES DISC Global Precipitation, Solar Irradiance, Atmospheric Composition and Dynamics, Global Modeling CDDIS Space Geodesy, Solid Earth OBPG Ocean Biology, Sea Surface Temperature GHRC DAAC Hydrologic Cycle, Severe Weather Interactions, Lightning, Atmospheric Convection LaRC ASDC Radiation Budget, Clouds, Aerosols, Tropospheric Chemistry ORNL DAAC Biogeochemical Dynamics, Ecological Data, Environmental Processes MODAPS/ LAADS MODIS Level-1 and Atmosphere Data Products
6 ECHO Architecture ECHO is NASA s middleware layer between Earth science data and users via a service-oriented architecture. Designed to improve the discovery and access of NASA data. Developed as a part of NASA s core data systems but fully adaptable to the needs/requirem ents of science communities. Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their data holdings and other Earth science-related data holdings. User-defined specialized clients can be easily developed to give science data users of their community access to data and services using ECHO s open APIs.
EOSDIS Key Metrics Millions 700 650 600 550 500 450 Preliminary EOSDIS FY2012 Metrics Unique Data Products 6,986 Distinct Users of EOSDIS Data and Services Web Site Visits of 1 Minute or more Average Daily Archive Growth Total Archive Volume End User Distribution Products End User Average Daily Distribution Volume EOSDIS Products Delivered (Millions) ~635,000,000 products in 2012 >120X increase over 2000 1.49 M 1.97 M 5.3 TB/day 6.4 PB 635 M 14.8 TB/day ESDIS Project Supports Science System Elements Interfaces Partnerships Missions Data Centers 12 SIPS 14 Interface Control Documents 22 US 10 International 6 Science Data Processing 10 Archiving and Distribution 37 Instruments Supported 87 400 350 300 250 200 150 More information: EOSDIS: http://earthdata.nasa.gov 100 50 0 FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 to date Sep 7
Evolution of EOSDIS Elements and Continuous Evolution EOSDIS underwent a concerted process for Evolution in the 2005-2008 timeframe. Led by EOSDIS Project Manager Esfandiari, OES Program Executive Martha Maiden Recommendations by External Advisory Panel, led by Moshe Pniel Effort under Terms of Reference signed by Ghassem Asrar, with Implementation Plan concurred by Mary Cleave Resultant system reduced costs 30%, Information Technology currency, closer to science needs, with capability to continuously evolve. Continuous evolution investments about 10% of Multi-Mission Ops budget, and include system and data product/quality investments. ESS reviewed the EOSDIS System at their January 2008 meeting, reserving one hour on the agenda. ESS letter February 6, 2008 was complimentary (from NASA website). We were impressed by the success and clear sense of direction of that program. We are a long way from the EOSDIS problems of less than a decade ago! 8
2015 Vision Goals Addressed Vision Tenet Archive Management EOS Data Interoperability Future Data Access and Processing Data Pedigree Cost Control User Community Support IT Currency Vision 2015 Goals NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit. Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other relevant data and systems. Processing and data are mobile. Data access latency is no longer an impediment. Physical location of data storage is transparent. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed. Mechanisms to collect and preserve the pedigree of derived data products are readily available. Data systems evolve into components that allow a fine-grained control over cost drivers. Expert knowledge is readily accessible to enable researchers to understand and use the data. Community feedback directly to those responsible for a given system element. Access to all EOS data through services at least as rich as any contemporary science information system. EEE Feb 3, 2005
2015 Vision Goals Addressed Vision Tenet Archive Management EOS Data Interoperability Future Data Access and Processing Data Pedigree Cost Control User Community Support IT Currency Vision 2015 Goals NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit. + Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other relevant data and systems. Processing and data are mobile. + + Data access latency is no longer an impediment. Physical location of data storage is transparent. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed. Mechanisms to collect and preserve the pedigree of derived data products are readily available. Data systems evolve into components that allow a fine-grained control over cost drivers. Expert knowledge is readily accessible to enable researchers to understand and use the data. Community feedback directly to those responsible for a given system element. Access to all EOS data through services at least as rich as any contemporary science information system. EEE As of 2012 + In Progress