Sustained Coordinated Processing of Environmental Satellite Data for Climate Monitoring Sustained, Co-Ordinated Processing of Environmental Satellite Data for Climate Monitoring (SCOPE-CM) Joerg Schulz, Marie Doutriaux-Boucher
SCOPE-CM Background The aim of the Sustained, Co-Ordinated Processing of Environmental Satellite Data for Climate Monitoring (SCOPE-CM) is to enable a network of facilities ensuring continuous and sustained provision of high-quality data records for climate monitoring. The foundation of SCOPE-CM is the network of relevant space agencies and other organisations (including GSICS) with the aim to develop, extend and preserve the capabilities and skills of generating and re-generating Climate Data Records.
End-to-end System View for the Exploitation of Satellite Observations for Climate Monitoring GSCIS and SCOPE-CM activities are part of the CGMS High-Level Priority Plan on Advancing the architecture for space based monitoring enabling the use of satellite data produced by WIGOS. CDR is defined as a time series of measurements of sufficient length, consistency, and continuity to determine climate variability and change. FCDR = a homogeneous long-term dataset of radiances or BT encompassing different sensors and platform with spatial and temporal overlaps. TCDR = geophysical variables derived from the FCDR that can be understood as a satellite product associated with an ECV
WMO s SCOPE-CM initiative Coordinated international network to produce CDRs from multi-agency mission data in operational environment addressing GCOS requirements Current Participants of the SCOPE-CM Network Operational Satellite operators: NOAA, JMA, CMA, EUMETSAT Stakeholder: WMO Space Programme, GCOS, CEOS, GEO, CGMS/GSICS, WCRP/GEWEX, ESA (observer)
Phase 2: Sustained Production of Climate Data Records Objectives: http://www.scope-cm.org Establish a systematic approach to increase the sustainability (maturity) of CDR generation capabilities; Establish structures for sustainable generation of Fundamental and Thematic CDRs. Mechanisms: Projects generate SCOPE-CM CDR products; Increased coverage of products in terms of ECVs, time and spatial dimension; Extension of the network to additional partners. Benefits for space agencies (and associated institutes): Ensures their role in the field of climate data stewardship; Improves their capacity to deliver data services for Global and Regional Climate Services; Improves their capacity to serve the scientific community.
SCOPE-CM Phase-2 Projects and Partnerships ID Title Leader SCOPE-CM Partners Other Partners SCM-01 UTH L. Shi NOAA, EUMETSAT Kiruna Univ. NCAR, (CM SAF) Univ. of Miami SCM-02 Albedo from polar T. Manninen EUMETSAT (CM SAF Univ. Massachusetts and CF) NOAA SCM-03 Albedo from GEO A. Lattanzio EUMETSAT (CF), - NOAA, JMA SCM-04 AMVs Monsoons and S. Goyal [EUMETSAT] Indian Meterological Cyclones Departement SCM-05 AVHRR FCDR K-G Karlsson EUMETSAT (CM SAF) SCOPE-CM phase-2 projects partners ESA CCI NOAA SCM-06 IOGEO R. Roebeling EUMETSAT (CF and - CM SAF), NOAA, JMA, CMA SCM-07 L-RWP in GPM era R. Bennartz NOAA (CIRA) CIMSS, University of EUMETSAT(CM-SAF) Wisconsin SCM-08 RO-CLIM A. von Engeln EUMETSAT (CF and GFZ, NASA JPL, Moog, ROM SAF) UCAR, Univ. of Graz SCM-09 ISCCP K. Knapp NOAA, JMA, CMA, EUMETSAT SCM-10 AMV/CSR for LEO and Y. Tahara JMA, EUMETSAT (CF), GEO NOAA (NCDC, CIRA) INPE, NY City College CIMSS, JMA (reanalysis), ECMWF
SCOPE-CM CDR Life cycle based on the maturity matrix The CDR life cycle is iterative, with improved understanding and utility as maturity increases SCOPE-CM Project: Elevating a CDR generation capability to a higher maturity
Maturity Matrix Concept Is the software robust and maintainable? Are the data and methods well documented? Has the uncertainty of the data been systematically assessed? Are data well used and user feedbacks taken care of? Software readiness Metadata User documentation Uncertainty Characterisation Public Access, Feedback and Update Usage Are the codes compliant with standards, stable, portable and reproducible? Do the metadata meet international standards, and allow provenance tracking? Are the formal documents and peer-reviewed papers up-to-date and public? Are the uncertainties assessed systematically in a standard manner? Are the data, source code, and documents publicly available and regularly updated? Are the data widely used in the scientific, and decision and policy making communities?
Maturing Takes Time In SCOPE-CM the SMMs will be applied to monitor progress within the projects. TCDR ESA-CCI SST (~5 years) MATURITY MATURITY 1 SOFTWARE READINESS SOFTWARE READINESS METADATA METADATA USER DOCUMENTATION USER DOCUMENTATION UNCERTAINTY CHARATERISATION UNCERTAINTY CHARATERISATION PUBLIC ACCESS, FEEDBACK, UPDATE PUBLIC ACCESS, FEEDBACK, UPDATE USAGE USAGE 1 2 2 3 3 4 TCDR CM-SAF Clouds (~12 years) 4 5 5 6 6
Global Data Records from Geostationary Orbit GEO satellite data that will be used in CDR production within SCOPE-CM (radiance records, land surface albedo, AMVs, CSR, FTH,...). SCM-03
Status DWD: FTH geo-ring (example)
SCM-05 project on AVHRR FCDR 12 1. Achieved TCDR results indicate trends and discontinuities which are likely due to a mix of method differences and inherent remaining calibration and/or sampling weaknesses (example for global cloud cover below). Results from SCOPE-CM Phase 1 Pilot project 1 on AVHRR TCDRs 2. Visible calibration corrections partly suffer from using a non-stable MODIS reference (TERRA MODIS) in MODIS Coll. 5 3. Inconsistencies found for AVHRR infrared onboard calibration methodolody (Mittaz et al., 2011, JAOT) 4. Basic navigation of AVHRR imagery shows remaining problems for some of the early NOAA satellites A revised AVHRR FCDR is essential for assuring climate quality of derived TCDRs!
Summary of the 9 th SCOPE-CM executive panel The 9 th SCOPE-CM executive panel meeting took place on the 3 rd of March 2014 at EUMETSAT headquarter; Participating projects presented their plans and activities; In particular the SEP recommended: - to all phase-2 projects the application of the CORE-CLIMAX Maturity Matrix to monitor progress; - to all phase 2 projects to contribute to the CEOS-CGMS WG Climate ECV inventory; - to the SCOPE-CM Secretariat to create a diagram showing interactions among SCOPE- CM projects and dependencies on other international projects such as GSICS, and - to foster the interaction between the SEP and the CEOS-CGMS WG Climate as elements of the WG Climate work plan are related to SCOPE-CM. http://www.scope-cm.org
Project Interactions SCM-01 UTH SCM-02 Albedo from polar orbiting GSICS SCM-03 Land surface albedo from GEO SCM-04 Monsoon SCM-05 AVHRR FCDR SCM-06 Inter-calibration of GEO imagers SCM-07 LWP and RWP in GPM era SCM-08 Radio occultation SCM-09 ISCCP SCM-10 AMV/CSR/ASR
Conclusions SCOPE-CM has successfully started Phase 2 with 10 new projects; New projects see much more participation from research organisations and users; Best practices, e.g. on algorithm implementation at different operational processing centres for climate are continued and extended within the projects; Project plans are realistic under the boundary condition of no extra funding, and demonstrate added value through SCOPE-CM coordination; Relations to GSICS evolve in much stronger way by adopting responsibility for FCDRs in SCOPE-CM; The use of the updated Maturity Matrix approach is used to monitor progress in the sustainment of the CDR production systems and communicates this to users; SCOPE-CM welcomes additional participation during Phase 2 in any existing or new project to further support and sustain global production of CDRs.
Sustained Coordinated Processing of Environmental Satellite Data for Climate Monitoring Thank You