Global Space based Inter calibration System (GSICS) GSICS Data Management Working Group (GDWG) GSICS Research Working Group (GRWG) Joint Meeting

Transcription

1 Global Space based Inter calibration System (GSICS) GSICS Data Management Working Group (GDWG) GSICS Research Working Group (GRWG) Joint Meeting March 2011 Daejeon, Republic of Korea Final Report Page 1 of 46

2 GDWG GRWG Joint Meeting 2011 GSICS Research Working Group and Data Management Working Group Joint Meeting hosted by KMA/NMSC in Daejeon, Republic of Korea, on March 2011 Page 2 of 46

3 GDWG GRWG Joint Meeting 2011 CONTENTS Part I: Report of the Joint Sessions Part II: Report of the GDWG Breakout Sessions Part III: Report of the GRWG Breakout Sessions Appendix: List of Participants Page 3 of 46

4 Part I: Report of the Joint Sessions Part I: Report of the Joint Sessions I.1 Joint Session Tuesday, 22 March 2011 Agenda Topic Welcome Welcome Group Photo Meeting Practicalities Agree agenda and minute taking Exec Panel Report GRWG Report GDWG Report Status of GSICS Collaboration Servers Report on Users Workshop KMA GPRC Report NOAA GPRC Report JMA GPRC Report EUMETSAT GPRC Report CMA GPRC Report GSICS Products for discussion GSICS Procedure for Product Acceptance GPPA DIMITRI Database for Imaging Multi Spectral Instruments and Tools for Radiometric Comparison Presenter / Discussion Lead Jérôme Lafeuille, WMO Ae Sok Suh, KMA Jun Park, KMA Jérôme Lafeuille and WG Chairs Jérôme Lafeuille, WMO Tim Hewison, EUMETSAT (GRWG Chair) Aleksandar Jelenak, NOOA (GDWG Chair) Peter Miu, EUMETSAT Bob Iacovazzi, NOAA Dohyeong Kim, KMA Xiangqian Fred Wu, NOAA Hiromi Owada, JMA Tim Hewison, EUMETSAT Xiuqing Scott Hu Tim Hewison, EUMETSAT Bob Iacovazzi, NOAA Marc Bouvet, ESA, via Skype The GSICS Joint Research and Data Working Group Meeting was opened by J. Lafeuille (WMO). The meeting is the 5 th gathering of the Data Working Group (GDWG 05) and the 6 th gathering of the Research Working Group (GRWG 06). J. Lafeuille welcomed all participants on behalf of WMO and thanked KMA for hosting the meeting, which coincided with the completion of COMS 1 commissioning phase. He welcomed the new representative of USGS, Gyanesh Chander. A.S. Suh (KMA) then welcomed the group on behalf of KMA. Page 4 of 46

5 Part I: Report of the Joint Sessions J. Lafeuille, T. Hewison (EUMETSAT) and A. Jelenak (NOAA) presented the proposed agenda. It was agreed that M. König (EUMETSAT) would take the minutes for the Joint Session and the GRWG Breakout, P. Miu (EUMETSAT) would be the GDWG minute taker. J. Lafeuille reported on the Exec Panel meetings (EP 8, April and EP 9, 12 November 2010). Highlights here are new GSICS memberships (India represented through ISRO and IMD, JAXA, USGS, ROSHYDROMET, ESA as observer, i.e. GSICS now involves all satellite operators), and the review of individual actions. The Exec Panel has endorsed the GSICS Procedure for Product Acceptance (GPPA). The performed work on IR intercalibration was welcomed, GPRCs are encouraged to complete acceptance. GRWG is encouraged to pursue its current approach for solar channel inter calibration and to work toward joint procedures with GPM X CAL. The Exec Panel positively noted the GSICS Users Workshop and requests to take appropriate actions on users feedback. Also the wish was re iterated to have some kind of user registration. EP 10 will take place 6 8 June in Geneva. The GRWG report was delivered by T. Hewison, where a review of actions and web meetings was provided. A still open action was identified GRWGIII 10: Recommend a single flag file to be adopted by all AIRS users. New actionee is now X. Wu: No. Title ee(s) Due Date JOINT06_01 Recommend a single AIRS flag file to be adopted by all AIRS users X. Wu End of 2011 The GDWG report was delivered by A. Jelenak. The respective action review can be found in the GDWG minutes. P. Miu gave a short update on the status of the GSICS Collaboration Server. The server is in operations. Source data and demonstration products are available on the server. The important operational aspects of the server were presented as well as the rules (??) which need to be observed by users and developers. New areas of development were identified; it must be noted that the developments on the server are driven by the needs of GRWG. B. Iacovazzi presented an update on the GCC activities: The GEO LEO IR baseline algorithm has been applied to MSG, FY 2 and MTSAT, as well as to GOES. This activity acts as a platform of comparison with the results from the operational algorithm of each of the associated GPRCs EUMETSAT, CMA, and JMA. Many similarities, but some differences, are found to exist between the NOAA and the GPRC results for each satellite. It was clarified during the discussion that the results of the baseline algorithms are the NOAA GPRC (GOES vs. IASI) algorithm applied to other geostationary data: The results are not available to outside users, so this activity can be seen as a general sanity check of the GPRC results. The previous GSICS Central Web Site hosted by NOAA has been successfully segregated into a GCC and NOAA GPRC web sites. Four issues of the GSICS Quarterly newsletter were created and distributed in A draft revision of the GSICS Implementation Plan has been performed by the GCC and is awaiting review by WMO. The GSICS Operations Plan has been updated before the Joint GRWG VI and GDWG V meeting. The GCC has supported many the Joint GRWG GDWG meeting, Second Users Page 5 of 46

6 Part I: Report of the Joint Sessions Workshop, and several Centra web meetings held by EUMETSAT. The GCC has also supported the GPM X Cal Meeting and NOAA CDR Workshop. The discussion on these issues led to the following recommendations: No. Recommendation JOINT06_01 Recommendation JOINT06_02 Title GSICS Quarterly should have a more prominent location on the GCC web site The GCC web site should provide a portal to the operationally available GSICS products of all GPRCs B. Iacovazzi continued and reported on the GSICS Users Workshop held in September 2011 during the EUMETSAT Conference in Cordoba, Spain. The GSCIS Second Users Workshop was successful, and yielded input from the beta testers regarding the impact of using GSICS Calibration Products on their Products. The meeting also provided GSICS with information from which to help guide future activities. The Joint Session continued with a series of reports from the individual GPRCs: D. Kim provided the KMA report. The Korean satellite COMS was launched on 26 June After the launch, COMS started test mode on 10 July in its final geostationary position. The first MI visible image was acquired in 12 July and first IR images in 11 August. In orbit tests were done in order to assess the performance of the satellite system and payloads. The present steps for MI radiometric calibrations are generalized IR calibration, midnight effect correction, and slope averaging. And the step for MI INR (image navigation and registration) is the configuration parameter tuning and performance evaluation will be followed. COMS MI data service is expected to be started in early In 2011, KMA is preparing for the software system of GEO LEO IR inter calibration (using AIRS/IASI), calibration monitoring through MODIS, VIS vicarious calibration with Australian Simpson desert target, and the development of the calibration monitoring web page. During the commissioning period, the degradation of COMS VIS channel using the moon target showed a mean degradation of 2.9% per month. The preliminary results of IR channel comparison between COMS and AIRS shows the negative bias for all IR channels from January to March The difference between COMS TB and AIRS TB shows the positive biases in the cold scene while negative biases in the warm scenes for all IR channels. The direct comparison between COMS and MTSAT 2 over clear sky area shows another way of inter comparison although additional extensive analysis is needed. X. Wu provided the NOAA report. NOAA GPRC has maintained the operations for GOES 11/12/13, METEOSAT 7/9, MTSAT 1R/2, and FY 2C/2D up to date, as well as all AVHRR solar bands and MSU/AMSU. Products are disseminated via NOAA GPRC web. Backprocessing has completed for GOES 10; in months all GEO AIRS since Jan 2003 and GEO IASI since Jul 2007 will be inter calibrated. Differences due to baseline and agencyspecific algorithms were noted, but have not been fully analyzed. New products and capabilities are being developed, including Sounder and GEO GEO inter calibration. GSICS products, including those by back processing, made several significant impacts on GOES anomaly investigations. Page 6 of 46

7 Part I: Report of the Joint Sessions H. Owada provided the JMA report. JMA s inter calibration homepage was renewed in July 2010, which led to the development of a prototype web page for all GPRCs. This prototype was reviewed at a web meeting in response to EP 8.2. Visible calibration monitoring for MTSAT 2 was operationally started in September The MTSAT Clear Sky Radiance (CSR) product was retrieved using the GSICS correction (September 2010), and a corresponding OSE was performed for a very short period in January Global composite synthetic images and Himawari 8 simulations were generated from NWP outputs by using the CRTM2.02 radiative transfer model. The global composite synthetic image well shows the response function differences. T. Hewison provided the EUMETSAT GPRC report. The MSG IASI GSICS correction has reached demonstration status, for both the near real time and the reanalysis products. EUMETSAT also acted as a beta tester of these corrections, and the results of the tests were briefly shown. The GSICS pages of the EUMETSAT web site were updated, included a summary of the GSICS product status for easier navigation, which is suggested to be provided by other GPRCs (and the GCC) as well. T. Hewison also shortly showed the EUMETSAT fact sheet on GSICS, noting that it needs to incorporate the corrections provided by WMO and the GSICS EP Chair in October The discussion led to the following recommendation and action: No. Recommendation JOINT06_03 Title GPRCs and the GCC should consider to follow the tabulated GSICS product overview and access, as provided on the EUMETSAT web page, for their products No. Title ee(s) Due Date JOINT06_02 Revise the GSICS fact sheet EUMETSAT June 2011 X. Hu then presented the CMA report. The GEO LEO IR GSICS correction has entered routine operations in September 2009, providing the near real time results between FengYun 2C/2D/2E versus IASI and AIRS. The GISCS correction was also applied to historical data (FY 2C back to June 2005, FY 2D back to May 2007 and FY 2E back to December 2009). Independent results for day and night time conditions are available. X. Hu also showed the GCMA GSICS web site. The polar orbiter FY 3A instrument MERSI is compared to AIRS and IASI, and first results were shown. CMA plans to soon finalise the necessary documentation (ATBDs etc.) and update their GSICS web site. Work on inter calibrating solar bands has started. T. Hewison summarized a number of GSICS product topics that would need to be addressed during this meeting: Common Reference Channels (see presentation on 24 March), Reprocessing and GSICS Versions. Concerning reprocessing, T. Hewison informed the group of EUMETSAT s activities concerning the reprocessing of the entire Meteosat archive, which will ultimately lead to a new Level 1.5 product, where the present GSICS correction will not be applicable. The discussion made it clear that this reprocessing is an activity which is Page 7 of 46

8 Part I: Report of the Joint Sessions unique to EUMETSAT, i.e. the versioning of GSICS products will have to be solved by EUMETSAT. B. Iacovazzi provided an overview over the GSICS Procedure for Product Acceptance (GPPA). The following products are in demonstration phase: GL GSICS Correction for EUMETSAT SEVIRI IR Channels based on IASI GL GSICS Correction for MTSAT Imager IR Channels based on AIRS and IASI GL GSICS Correction for GOES Imager IR Channels based on AIRS and IASI LL Patmos X AVHRR solar reflective channel corrections based on MODIS He reminded the participants that the road to the next phase (pre operational) would need the necessary user feedback and the complete set of documentations. A major milestone would be the decision by the Exec Panel; whether or not to continue the product acceptance process (May 2011). An outline of the following steps to get full operational acceptance was provided. In the following discussion, the meeting participants agreed that a GSICS correction is also of value for a well calibrated instrument, i.e. where the GSICS correction would have no impact on products. New Potential Product Submissions in the next year might include: GSICS Correction for CMA VISSR IR channels based on IASI GSICS Correction for EUMETSAT SEVIRI, MTSAT Imager and GOES Imager solar reflective channels based on MODIS GSICS Correction for MSU/AMSU A data based on SNO At the end of the first Joint Session, M. Bouvet from ESA gave his presentation on DIMITRI remotely via Skype. DIMITRI is a database of remote sensing data and tools for radiometric inter comparison and data analysis. It is one of the tools used by ESA to investigate the radiometric stability and radiometric performance of MERIS and AATSR, and to intercompare them to other sensors. The database is currently being further populated to include data from AATSR 2, AATSR, MERIS, A MODIS, POLDER 3 and VEGETATION over 8 terrestrial sites for the period 2002 to A first delivery is expected in summer I. 2 Joint Session Thursday, 24 March 2011 Topic Instrument Event Log Agenda Presenter / Discussion Lead Bob Iacovazzi, NOAA To provide an instrument event log has been a long standing action from the Exec Panel on all GPRCs. A web meeting on 17 February 2011 started the discussion of such a log, but the definition of key parameters still needs to be done. It is a general understanding that users should not be overwhelmed by information that is not understandable (acronyms etc.). Such an event log should be hosted by each GPRC. It was agreed that the event log should contain the basic information, while more details like daily notifications could be linked. The discussion resulted in the action, with a deadline of 31 May 2011: Page 8 of 46

9 Part I: Report of the Joint Sessions No. Title ee(s) Due Date JOINT06_03 Provision of a draft template for the instrument event log B. Iacovazzi May/June 2011 I.3 Joint Session Friday, 25 March 2011, morning Agenda Topic Cross calibration of Landsat 7 ETM+ and Terra MODIS Presenter / Discussion Lead Gyanesh Chander, STG/USGS G. Chander gave a presentation on the cross calibration of Landsat 7 and Terra MODIS to the Joint Session. The study focused on using near simultaneous observations from ETM+ and MODIS sensors in the reflective solar band spectral domain. Cross calibration of top of atmosphere reflectances ranged from 2% to 15% (without taking account of SRF differences). Spectral issues with this approach were investigated: The SRF adjusted ETM+ top of atmosphere reflectances were found to agree with MODIS reflectances to within 6% or better for all bands using Hyperion derived spectral band adjustment factors (SBAF). These differences were reduced to less than 1% for all visible/near infrared bands (except Band 2) by using SCIAMACHY derived SBAFs. The reason for this difference between SCIAMACHY and Hyperion is not clear. Collaboration activities were identified in the following areas: Coordinate, maintain and enhance world wide CAL/VAL sites Review and implement QA4EO processes Investigate absolute calibration and long term radiometric stability of the Hyperion/SCIAMACHY sensors Effects of different solar models, BRDF, and atmospheric effects on cross calibration should be investigated During the discussion it was suggested that the GRWG solar calibration work should be summarised in a special journal issue of the Canadian Journal of Remote Sensing. Following a question concerning the uncertainty of the underlying MODIS BRDF model, G. Chander offered a separate presentation on this. The following actions were agreed: No. Title ee(s) Due Date JOINT06_04 JOINT06_05 Coordinate a special journal issue on solar calibration with the co editor of the Canadian Journal of Remote Sensing (G. Chander) Update GRWG on the performed work regarding uncertainty analysis in the crosscalibration of LANDSAT and MODIS T. Hewison End of 2011 G. Chander End of 2011 Page 9 of 46

10 Part I: Report of the Joint Sessions I.4 Joint Session Friday, 25 March 2011, afternoon Agenda Topic Review Outcome of GDWG Review Outcome of GRWG Date and Place of Next Meeting Presenter / Discussion Lead Aleksandar Jelenak, NOAA (GDWG Chair) Tim Hewison, EUMETSAT (GRWG Chair) Jérôme Lafeuille, WMO The GDWG and GRWG Chairs presented the outcome of the respective Breakout Sessions, and the respective actions were reviewed. GDWG05_35 is also taken up as a GRWG action: No. Title ee(s) Due Date GRWG06_33 GRWG to support the validation of the metadata and unit definition before GDWG re submit them to the CF committee. See: Development/StandardVariableNames T. Hewison 30 April 2011 T. Hewison thanked the group for the successful meeting. The length of four days was generally seen as very beneficial, although the GDWG sessions could be shortened. The next GSICS meeting should take place around March 2012, and the group recommended that CMA would host the meeting. No. Title ee(s) Due Date JOINT06_06 GSCIS06_07 Contact CMA on the possibility to host the 2012 GSICS meeting Support bi monthly web meetings of the Exec Panel through Centra J. Lafeuille 30 June 2011 EUMETSAT n/a Page 10 of 46

11 Part II: GDWG Breakout Sessions Part II: GSICS Working Group on Data Management Breakout Sessions Participants: Aleksandar Jelenak (NOAA) Chairman Hiromi Owada, (JMA) Vice Chairman Peter Miu (EUMETSAT) Minutes Taker Xiuqing Hu (CMA) part time Jerome Lafeuille (WMO) part time Robert Iacovazzi Jr. (NOAA) part time Page 11 of 46

12 Part II: GDWG Breakout Sessions 1 Purpose of the meeting The purpose of the GDWG breakout meeting was to review specific data management issues. Furthermore it is intended to identify the work plan for the GDWG in Agenda Day 3: Wednesday 23 rd March 2011 GDWG Session 1 GDWG Breakout 08:30 Aleksandar Introduction 00:10 08:40 Aleksandar Outcome of the 2010 Items 00:30 09:10 All Review of the GCC and GPRC web sites 00:30 09:40 All Collecting and Organizing Instrument Information 00:15 09:55 Aleksandar Readiness to Change to netcdf 4 File Format 00:15 10:10 Coffee break 00:20 10:30 Aleksandar Review of the GSICS netcdf File Content 01:00 11:30 All Improving netcdf Content Description: Standard Variable 01:00 Names, New Metadata Conventions 12:45 Lunch 01:15 14:00 Peter Miu Future Developments of the GSICS Data Servers 01:00 15:00 Aleksandar Additions and Modifications to the netcdf and File Naming Conventions 01:00 16:00 Coffee break 00:20 16:20 Development of templates for GSICS netcdf Files 01:00 17:20 All (with GRWG) Work plan: Develop prototype products 00:30 17:50 End Day 4: Thursday 24 th March 2011 GDWG Session 2 GDWG Breakout 08:30 Combined with GRWG Instrument Event Logs Requirements 00:40 09:10 Hiromi/Peter GSICS Bias Monitoring Web Page Template Based on the JMA's Prototype 1:20:00 10:30 Coffee break 00:20 10:50 Aleksandar/All Development of the Metadata for GSICS Products Based 01:30 on the WMO Core Metadata Profile 12:20 Aleksandar System Requirements for GSICS Data User Registration 00:30 12:50 Aleksandar Tools for Effective Communication with Registered GSICS 00:15 Data Users 13:05 Lunch 01:30 14:35 Peter/All Helpdesk Functionality and PAP Automation Requirements 01:30 16:05 Travel to NMSC Page 12 of 46

13 Part II: GDWG Breakout Sessions 2. Summary of the GDWG Discussions 2.1 Introduction by the Chairman The chairman welcomes everyone and especially thanks the JMA s representative, Ms. Hiromi Owada, for her attendance given the recent devastating earthquake in Japan. The chairman then outlined the Working Group s agenda for the next two and a half days and talked briefly about discussion guidelines. 2.2 Outcome of the GDWG04 (Year 2010) Items by the Chairman See Appendix for the GDWG03 (Year 2009) action items list and their status. New s from the review of the 2009 action items: GDWG05_01 GDWG05_02 GDWG05_03 GDWG05_04 Pending the 3 rd GSICS user conference, the IPET DRC: Inter program Expert Team on Data Representation and Codes (Chaired by Simon Elliott/EUMETSAT) will be informed on the outcome with a view to endorse the proposed GSICS international data sub categories into the WMO GTS (continues the GDWG04_03 action item). Each GPRC are requested to inform the GCC what instrument information is available. GCC to provide links to this information on its website. Related to agenda item 2.12: Bob s presentation and action for information needed. For instrument information, open discussion with CGMS on what they want and to what level of detail. All GPRC are requested to check the storing of GSICS processing history in ISO metadata. See URL: cessinghistoryinisometadata Provide feedback at the latest to GDWG chair by next GSICS meeting (reference: GDWG04_15). Aleksandar Jelenak Support from Peter Miu if needed. Due October All GPRCs Due next GRWG/GDWG Joint Meeting Aleksandar Jelenak Due next GRWG/GDWG Joint Meeting All GPRCs Due next GRWG/GDWG Joint Meeting Page 13 of 46

14 Part II: GDWG Breakout Sessions 2.3 Review of the GCC and GPRC Websites (All) Review of the WMO GSICS Portal: Webmaster: All the participants acknowledged the fresh new look of the portal and commended all those involved in the redesign. GDWG05_05 GDWG05_06 GDWG05_07 Update the GSICS Wiki link to point to the correct location. Create a generic webmaster address to receive feedback on the website. Add existing GSICS collaboration servers to the right hand navigation bar: WMO Due next GRWG/GDWG Joint Meeting WMO Due next GRWG/GDWG Joint Meeting WMO Due next GRWG/GDWG Joint Meeting Page 14 of 46

15 Part II: GDWG Breakout Sessions Review of the GCC website: The GCC site is now separated from the NOAA GPRC. GDWG05_08 GDWG05_09 GDWG05_10 GDWG05_11 GDWG05_12 GDWG05_13 GDWG05_14 GDWG05_15 GDWG05_16 GDWG05_17 All GSICS Quarterlies should be available, not just the latest edition. GSICS meetings page need update to point to the new Wiki domain name. Link to the official Executive Panel minutes from the WMO website and not using a local version. Create a generic webmaster address to receive feedback on the website. GSICS PPA page need update to point to the new Wiki domain name. GSICS Baseline Satellite Instrument Inter Calibration Analyses needs to be updated. Add an instrument information status page under the Instrument Info Kiosk. Add WMO GSICS Portal link above GCC Home link to go back to the portal. Move Partner GSIC Sites into Links and expand this to show them. Add GSICS collaboration servers to the partner navigation links. Bob Iacovazzi Due September 2011 Bob Iacovazzi Due September 2011 Bob Iacovazzi Due September 2011 Bob Iacovazzi Due September 2011 Bob Iacovazzi Due September 2011 Bob Iacovazzi Due next GRWG/ GDWG Joint Meeting Bob Iacovazzi Due next GRWG/ GDWG Joint Meeting Bob Iacovazzi Due next GRWG/ GDWG Joint Meeting Bob Iacovazzi Due next GRWG/ GDWG Joint Meeting Bob Iacovazzi Due next GRWG/ GDWG Joint Meeting Page 15 of 46

16 Part II: GDWG Breakout Sessions Review of the GPRC website: GDWG05_18 Please replace old GSICS logo with the new one. CMA Due September 2011 GDWG05_19 Create a generic webmaster address to receive feedback on the website. CMA Due September 2011 Page 16 of 46

17 Part II: GDWG Breakout Sessions GDWG05_20 Fix the above broken link. CMA Due September 2011 Page 17 of 46

18 Part II: GDWG Breakout Sessions Review of the NOAA GPRC website: Webmaster: GDWG05_21 GDWG05_22 Improve location of the GSICS logo in the banner: move it more to the left so that it can be seen in the browser window. All GSICS wiki links need to update to the new domain name. Fred Wu Due September 2011 Fred Wu Due September 2011 GDWG05_23 Fix Organisation broken link. Fred Wu Due September 2011 GDWG05_24 GDWG05_25 GDWG05_26 GDWG05_27 Create a generic webmaster address to receive feedback on the website. In the Contact us page, there are 2 different contact addresses. Have only the correct one. Satellite vs. In situ does not work (remove or update). Update the EUMETSAT GPRC website to be the same as the page pointed to by the WMO website. Fred Wu Due September 2011 Fred Wu Due September 2011 Fred Wu Due September 2011 Fred Wu Due September 2011 Page 18 of 46

19 Part II: GDWG Breakout Sessions Review of the EUMETSAT GPRC website: calibration/index.htm Webmaster: GDWG05_28 No links to other GPRC websites. Peter Miu Due September 2011 GDWG05_29 All GPRC should have a GSICS product status table. See GSICS Product Status Summary on the Calibration/Inter calibration/index.htm page. All GPRCs Due next GRWG/GDWG Joint Meeting Page 19 of 46

20 Part II: GDWG Breakout Sessions Review of the JMA GPRC website: Page 20 of 46

21 Part II: GDWG Breakout Sessions GDWG05_30 GDWG05_31 Add Navigation and to the title of the page to be consistent with the tags. Create a generic webmaster address to receive feedback on the website. JMA Due September 2011 JMA Due September 2011 Review of the KMA GPRC website GDWG05_32 Follow up the status of the KMA GPRC website. Aleksandar Jelenak Due next GRWG/GDWG Joint Meeting Page 21 of 46

22 Part II: GDWG Breakout Sessions 2.4 Collecting and Organising Instrument Event Information (All) The discussion addressed the action GDWG05_02. All participants acknowledged the importance of such information for both GSICS inter calibration work and any other application of satellite data. However, this kind of information sometimes is not allowed to be public. The Group agreed that the best way forward is for each organization to collect all publicly available Web resources on instruments for display on a GCC web page. Once this is achieved, the Group will look into issues such as: common content and formatting of such data, unified access and search capabilities, etc. 2.5 Readiness to Change to netcdf 4 File Format (Aleksandar) GSICS data and products are in the netcdf 3 Classic format. There are currently two netcdf 4 models: Classic and Enhanced. The Group proposes using the netcdf 4 Classic format. The advantage of using this format is: Specific data type for strings On the fly compression of variable data On the fly offsetting and scaling of variable data Changing to a netcdf 4 format would require all current data producers and their users to be able to read/write netcdf 4. Some applications being used now are (the list is not exhaustive due to lack of feedback): rscript (does not support netcdf 4) IDL v8.0 (supports netcdf 4) Unidata tools (support netcdf 4) Recommendation is for GPRCs to move to netcdf 4 Classic model if possible. This is more applicable for GSICS source and intermediate data sets as netcdf 3 version of these files can be quite large due to the lack of variable data compression. Page 22 of 46

23 Part II: GDWG Breakout Sessions 2.6 Review of the GSICS netcdf File Content (Aleksandar) The Group examined the content of currently available GSICS netcdf files to see what can be improved. The following recommendations are made: Remove excess quality information from the file. Focus on quality information meaningful to the user not the data producer. Tailor the content to support the THREDDS nciso service to generate WIScompatible metadata in ISO This service should be fully integrated in THREDDS v4.3. For EUMETSAT Source Data Sets the following action GDWG05_33 Fixed the history string (to be same as the JMA) Add processing_level. MFG15 Add source to global metadata and not source_formats Add Filename to global metadata and not wmo_filename MSG15 Add source to global metadata and not source_formats Add Filename to global metadata and not wmo_filename Add coordinates: "lon lat" to the channel variables. IASI Add source to global metadata and not source_formats Add Filename to global metadata and not wmo_filename Coordinate axis type for time variable needs to be added: _CoordinateAxisType: "Time" time should have dimension along_track?? Should time be defined in this data set. spectral_radiance: Array of 16 bit Integers [along_track = ][across_track = ][spectral = ] standard_name: "spectral_radiance_per_wavenumber" : _CoordinateAxes: time lat lon long_name: "Spectral radiance" comment: "Spectral radiance per wave number indices are spectral_radiance_per_wavenumber (along_track, across_track, number_of_spectral_measurements )" Peter Miu Due: For source/intermediate files: September 2011 For products: preoperational phase Page 23 of 46

24 Part II: GDWG Breakout Sessions JMA Data Sets GDWG05_34 processing_level global attribute needs to be updated to the correct format. rscript automatically generates a coordinate variable when a dimension is defined. Need to find a solution to fix this. JMA Due at Pre Operational phase 2.7 Improving netcdf Content (All) The chairman informed the Group that he had submitted 13 new standard names for official acceptance into the CF convention. These new names are listed at The CF committee responses requested further modifications and the chairman needs support on this activity. The Group discussed the way forward which resulted in the following actions: GDWG05_35 GDWG05_36 GDWG05_37 GRWG to examine the 13 proposed new standard names, especially their definitions, before GDWG re submit them to the CF committee. See: Check with CF committee if there is any progress on the standard names submission. NetCDF subset service, able to extract information from files to build a new netcdf file. This works only for discrete sampling geometries. It would be good for this to be available for GSICS data. Contact Unidata to see if this service can be adapted to the GSICS products. Tim Hewison By April 2011 Aleksandar Jelenak By April 2011 Peter Miu Due next GRWG/GDWG Joint Meeting 2.8 Future Developments of the GSICS Data Servers (Peter) The discussion on this agenda item was opened with a presentation by Peter Miu (EUMETSAT) with suggestions for future enhancements. He also addressed the current configuration differences between the NOAA and EUMETSAT GSICS data servers. CMA reported that they have procured a server for GSICS data. The Group welcomed this news noting that this will establish a GSICS data server on a third continent, Asia. To aid in its development and configuration EUMETSAT generously offered to actively provide support to CMA in this activity. It was agreed amongst the Group that the mirroring of source and intermediate data sets is not necessary. The data servers will configure THREDDS to remotely access each other s Page 24 of 46

25 Part II: GDWG Breakout Sessions catalogues of these data to seamlessly display contents from all the servers. Only the GSICS products should be mirrored on all operational servers. GDWG05_38 GDWG05_39 GDWG05_40 GDWG05_41 GDWG05_42 GDWG05_43 GDWG05_44 GDWG05_45 The GRWG is required to inform the GDWG on what GSICS products are required to be archived. It is expected that NRTC products are not archived but are available on a rolling repository basis. The RAC product should be archived. The NOAA THREDDS server should be updated to follow the agreed URL path directory structure. EUMETSAT server needs update to the URL path from msg2 mviri metopa iasi demo rac to racmsg2 mviri metopa iasi demo (also check the RAC URL path duplicates as reported by the Unidata s ToolsUI). NOAA s THREDDS server is required to hide the path and show something similar to rac msg2 mvirimetopa iasi demo in the URL path for a product. The GRWG is asked to confirm that the source and intermediate data sets are not required as a prerequisite for product validation using different ATBDs. The server specification is required to be updated to reflect the new remote access of GPRC catalogues in THREDDS and also estimate the potential down time of a GISCS collaboration server. Server upgrade should be proposed for the next GSICS meeting. A THREDDS template to configure remote catalogue access and metadata pages is to be created and shared amongst GPRCs. GRWG Chair: Tim Hewison Due December 2011 Aleksandar Jelenak Due December 2011 Peter Miu Due December 2011 Aleksandar Jelenak Due December 2011 GRWG Chair: Tim Hewison Due December 2011 Peter Miu Due next GRWG/ GDWG Joint Meeting Peter Miu Due next GRWG/ GDWG Joint Meeting Peter Miu Due September 2011 Page 25 of 46

26 Part II: GDWG Breakout Sessions 2.9 Additions and Modifications to the netcdf and File Naming Conventions (Aleksandar) No new filename convention additions/modifications have been identified. GDWG05_45 GDWG05_46 Change CF metadata convention version from 1.4 to 1.5. Metadata convention updates: date_create to be mandatory standard_name_vocabulary: CF 1.5 to be mandatory monitor_instrument and reference_instrument should be mandatory for GSICS products. Change the values from satellite/instrument names as strings to numbers from the WMO Manual on Codes Tables C 5 and C 8. A variable s standard name must be used if appropriate one exists. Aleksandar Jelenak Due April 2011 Aleksandar Jelenak Due April Development of templates for GSICS netcdf Files The Group is proposing the development of netcdf content templates for GSICS products. This effort should yield better standardization on file content and its metadata across all current GSICS products. GDWG05_47 A proposal for these templates will be prototyped onto the Wiki for further discussion. Aleksandar Jelenak End of April Instrument Event Log Requirements (Combined with GRWG: Bob) Bob Iacovazzi (NOAA) reported on a discussion from a recent web meeting with CGMS on collecting and organizing instrument event information: What instruments will be monitored? What kind of information gathered? Periodicity of reporting? Data users needs: Informed what and when anomalies occur. How to resolve them if possible. What kind of impact various instrument events have on the data they use? Page 26 of 46

27 Part II: GDWG Breakout Sessions Group discussion points: Start small/basic for an event log, e.g. latitude/longitude, contamination, eclipse, etc. More information can be presented if later. Point of contact (e.g. helpdesk) needed to resolve instrument anomaly queries. GPRC should record these on their own websites; the WMO/GCC websites should reference these. It was proposed by NOAA (Bob) to create a GEO and LEO templates on the information needed to be stored for an instrument. Once these templates have been created, CGMS should be consulted for endorsement so that GPRCs can be instructed to allocate resources to this activity. GPRCs should create pages holding the information defined in these templates. GDWG could examine at a later stage how best to store this information for ease of access using free tools (e.g. searchable database) GSICS Bias Monitoring Web Page (Hiromi/Peter) Hiromi Owada (JMA) presented her bias monitoring web page template, given also at a recent GSICS teleconference. Static images (a total of 7200) are generated to account for all possible combinations of plotted data. These plots require a lot of processing (a few hours) to generate and the Group agreed that was sub optimal. GDWG05_48 GRWG is required to specify what type of data are to be displayed, the terminologies for labelling need to be clarified and agreed. Please also confirm the plotting is for time series data only. GRWG Chair: Tim Hewison Due May 2011 From a software development point of view, the front end (web page look) of the JMA s template has been accepted as suitable for all GPRCs. Upon completion of the GDWG05_48 action item the back end processing can be better specified, which will be a task for future meetings. The Group has noted that currently many technologies exist for dynamic plot generation based on user request. Such an approach would avoid the need of creating large number of plots in advance Development of the Metadata for GSICS Products based on the WMO Core Metadata Profile The purpose of creating this metadata for GSICS products is to make them discoverable by the WMO Information System (WIS). NOAA NGDC ( has created the nciso plug in for THREDDS to generate ISO metadata on the fly from netcdf files and their THREDDS catalogues. This plug in is expected to be fully Page 27 of 46

28 Part II: GDWG Breakout Sessions integrated in THREDDS v4.3. Metadata generated from this plug in should be ingestible into the WIS making GSICS products discoverable by WIS users. GDWG05_49 There are some concerns in the metadata generated by the plug in for the current GSICS products. These need clarification from NOAA NGDC. Once clarified (and probably file contents updated), these metadata files will be sent to a WIS metadata expert. Based on this, the GDWG can determine what developments/updates are required to be performed. Aleksandar Jelenak Due next GRWG/GDWG Joint Meeting 2.14 System Requirements for GSICS Data User Registration (Aleksandar) The Executive Panel wants to have a way of accounting for GSICS data users. This can be done by implementing compulsory user registration and making GSICS data available only to those with user names and passwords. Given that the GSICS data servers are distributed across different national agencies the administration of this approach is deemed technically extremely challenging and thus not practical. Therefore the Panel s request is adjusted to institute voluntary GSICS user registration instead. The registration form should be located on the GCC website as this is the central point for GSICS users. Voluntary information to be collected from a user is: User s first and last name Organisation Contact address (the key for accessing their information again) Organisation home page if applicable The registration web page should offer two features: registration of new users, and changing contact information for already registered users. User s is to be used to access previously supplied registration information. Users should be able to opt out from being contacted for potential beta testing or providing any kind of feedback. It is mandatory for registered users addresses to be entered into an announcement mailing list (this should be clearly stated on the registration page). Other ing groups can be added to the registration page when needed to address new user needs (e.g. specific products forum discussions, etc.). GDWG05_50 Implement this voluntary registration system on the GCC website. Bob Iacovazzi Due August 2011 Page 28 of 46

29 Part II: GDWG Breakout Sessions 2.15 Tools for Effective Communication with Registered GSICS Data Users (Aleksandar) Registered users addresses could be placed into a Google Group called GSICS Announcements to receive operational messages on GSICS products, services, and servers. Further groups could be defined to address future users needs. GDWG05_51 GDWG Chairman to propose to the Executive Panel creation of a GSICS announcements Google group as a tool for communicating operational information to GSICS users. Aleksandar Jelenak Due June Helpdesk Functionality and GPPA Automation Requirements (Peter/All) The use of freely available tools is proposed to achieve this. For example Google offer many tools that seamlessly integrate together to build a website in a very short development cycle. The risk of using freely available tool is that the supplier can decide to terminate support to these tools. GDWG05_52 To discuss with the Executive Panel where the helpdesk should be created; GCC or GPRC helpdesks. Resources or budget available, etc. Aleksandar Jelenak support from Peter Miu if needed. Due June 2011 Similarly, the GPPA can be automated using the Google tools. Requirements need to be defined by the GCC on what is required for this automation. GDWG05_53 Ask the GCC if GPPA automation is required and what would the functionality be. Bob Iacovazzi Due November AOB GDWG05_54 The GDWG requires representatives from all member organisations to attend to be effective. New members need to be identified and to attend future GDWG meetings. Please contact GDWG chair on your nomination. Aleksandar Jelenak Due next GRWG/GDWG Joint Meeting The representative from JMA, Ms Hiromi Owada, informed the Group that she will leave GSICS at the end of March. The Group expressed their deepest gratitude to Ms Owada for her contribution and noted that she was contributing equally to the GRWG activities as well. Her departure also leaves the position of the GDWG vice chairman vacant. Ms Owada informed the chairman that JMA does not wish to assume the vice chairmanship role again. Page 29 of 46

30 Part II: GDWG Breakout Sessions Appendix : List of open actions from the previous GDWG meeting For completeness the open actions from the previous meetings are included in these minutes as well: Ref. No. ees & due dates GDWG04_01 GDWG to define the work flow diagram and request GRWG to define the documentation needed to move between the modes. NOAA to define the workflow (1 month) and for discussion by GDWG/GRWG (1 month), Aleksandar Jelenak Closed submit draft version to the executive panel (schedule meeting is ). Result is an agreed workflow for the product acceptance procedure. GDWG04_02 EUMETSAT to place in the GSICS user workshop agenda, a request for user feedback on which version of netcdf is being used. Tim Hewison Volker Gärtner GDWG04_03 GDWG04_04 GSICS sub categories are to be collected and proposed by GDWG with support from GRWG for used in the GSICS. Accepted proposals are to be submitted to WMO CBS for endorsement. Deadline July 31 (next CBS meeting is in Nov. 2010) Submitted to Simon Elliott at EUMETSAT to propose to be included into the WMO GTS convention. The sub categories have been submitted and agreed for validation at the WMO and once used in operation, then they will be deem to be operational. GDWG05_01: pending the 3 rd GSICS user conference, the IPET DRC: Inter program Expert Team for Data Representation of Codes (Chaired by Simon Elliott) will be informed on the outcome. Chair/support from EUMETSAT CMA (BAWX??) to confirm originator codes on the Wiki are ok. Closed Aleksandar Jelenak Peter Miu Closed, waiting for operational use. Xiuqing Hu Closed GDWG04_05 KMA to confirm originator codes on the Wiki are ok. Young Hooi Hwang GDWG04_06 GDWG04_07 Update the directory structure document to take into account the new requirements. Submit the documentation for review by GDWG. Once reviewed, submit to the executive panel for endorsement. EUMETSAT look at the improvements needed to address the observations on the current website structure. This includes how the readability of the GSICS logo can be improved (organise with all GPRCs on how this can be Closed Peter Miu Closed Peter Miu Closed Page 30 of 46

31 Part II: GDWG Breakout Sessions GDWG04_08 GDWG04_09 GDWG04_10 GDWG04_11 GDWG04_12 GDWG04_13 done). GDWG to review improvements and once approved, submit updates to the executive panel for endorsement and then to the WMO for upload. EUMETSAT to discuss with the GDWG on what common information shall be shown on the GPRC home pages. Support to action GDWG04_07, Due date: Aug NOAA to write the mission statement and the goal of the GCC and put this on the GCC home page. The GCC website shall be updated with more up to date information. Each GPRC shall provide a home page describing what they do (see JMA website as the example). They shall ensure the page is easily identified as a GSICS web page e.g. apply GSICS standard logo, and look and feel. Compose common text informing the reader the information on the GPRC (Contribution to GSICS as a GPRC, regularly providing comparable data sets etc. : all GPRCs via ). NOAA and EUMETSAT to create a matrix for documentation and action tracking functionality and tools that satisfy them to evaluate what tool to use and report back in the next GSICS joint meeting. Attention should also be paid on defining how these project items can be identified and referenced NOAA and EUMETSAT to create a matrix for help desk functionality and tools that satisfy them to evaluate what tool to use and report back in the next GSICS joint meeting. The GRWG/GPRCs are requested to find out what instrument information is available for their instruments and make this available to the working groups. This information can be used to prepare a paper for submission to CGMS so a directive can be made to request members on what relevant instrument information is needed to support GSICS activities. This is related to GDWG03_05 and CGMS 36 NOAA WP 14. GDWG05_02:: Each GPRC can provide to GSICS to what instrument information is available and past this to the GCC to display it. GDWG05_03: Open discuss with CGMS on what they want and to what level of detail. Peter Miu Closed, contain the same/similar information but website will be reviewed in the agenda item 2.3. Robert Iacovazzi Aleksandar Jelenak Closed All GPRCs Closed (new s described in section 2.3) Aleksandar Jelenak Peter Miu Closed (new s GDWG05_52, GDWG05_53) Aleksandar Jelenak Peter Miu Closed (new s GDWG05_52, GDWG05_53) GRWG/GPRCs need to identify who!!! Closed (new s GDWG05_2) Page 31 of 46

32 Part II: GDWG Breakout Sessions GDWG04_14 GDWG04_15 NOAA was requested to review the Quality Indicators following the CEOS Cal/Val WG guidelines. NOAA to investigate the feasibility of applying the ISO19115 metadata standard to GSICS. If applicable, then propose its use in the Wiki pages. Robert Iacovazzi Closed Aleksandar Jelenak Closed ( GDWG05_04) Page 32 of 46

33 Part III: GRWG Breakout Sessions Part III: GSICS Working Group on Research Breakout Sessions III. 1 GRWG Breakout Session Wednesday, 23 March 2011 Topic Agenda Potential of Sun glint Observations from 3.9 µm to Calibrate 0.65 µm Reflectances Deep Convective Clouds Liquid Water Clouds Multi sites Calibration Tracking for FY 3A/MERSI Solar Bands Moon and Star Calibration Ray Matching MODIS as Reference Uncertainty Evaluation of SEVIRI Solar Calibration Assessment of the Calibration Performance of Satellite Visible Channels Using Cloud Targets: Application to Meteosat 8/9 and MTSAT 1R Desert Sites Use of Hyperion Data to Assess Calibration Uncertainty over Deserts Work Plan Discussion Presenter / Discussion Lead Andy Heidinger, NOAA, via Skype Dave Doelling, NASA Arata Okuyama, JMA Ling Sun, CMA Xiangqian Fred Wu, NOAA Dave Doelling, NASA Xiaoxiong Jack Xiong, NASA Sébastien Wagner, EUMETSAT B.J. Sohn, SNU Patrice Henry, CNES, via Skype Patrice Henry, CNES, via Skype Tim Hewison, EUMETSAT The GRWG breakout session covered a number of science presentations on different solar calibration techniques. Below are given short summaries of the presentations; actions and Page 33 of 46

34 Part III: GRWG Breakout Sessions recommendations that were agreed during the discussion are provided at the end of this section. Andy Heidinger, NOAA: Potential of Sun glint Observations from 3.9 µm to Calibrate 0.65 µm Reflectances The 3.9 µm channels on geostationary imagers are well calibrated and solar reflection is a significant contribution to the signal. Sun glint regions offer a common and radiometricallystable phenomenon that allows for the calibration of the 0.65 µm (or any shortwave window) channel. Because MODIS provides all relevant channels and is well calibrated, it can serve to provide the reference relationship between the two channels that can then be used to calibrate the geostationary sensors. This technique was applied to the GOES 11 (135W) from 2006 to 2010 and derived calibration slopes that were within 5% relative of the NESDIS operational values. It is planned to extend this to the GOES 13 (75W) sensor and test the geographic robustness of this technique. Furthermore, it is also planned to run some oceanic reflectance models to verify and understand the reference MODIS relationships. Any collaboration in this activity is welcomed. A. Heidinger specifically pointed out that the sun glint method would be applicable to all geostationary satellites in their current position. Dave Doelling, NASA: Deep Convective Clouds Aqua MODIS based DCC radiances were found to be stable over 8 years, for the 0.47 to 1.24µm channels with a standard error of 2%. The channels had very consistent BRDF. The Aqua MODIS nadir DCC radiances were found to have spatial variation of 5%. The lowest were found over the TWP and the greatest over Africa and the Amazon. Based on 8 years of MODIS cloud retrievals the optical depth, cloud temperature, and height were found to be consistent spatially, however ice particle size was found to be smaller over land. The seasonal and inter annual variation of DCC nadir radiances was found to be less than 1% over most regions for channels less than 1µm. A simple spatial model would seem sufficient to account for these differences. A 5% DCC nadir radiance difference based on the IR temperature threshold was observed. There is a trade off between IR temperature threshold and the number of DCC identified pixels. BRDFs based on IR temperature should take this into account. DCC absolute calibration will use Aqua MODIS as a reference and SCIAMACHY to take into account the SRF difference and is predicted to be less than 1%. DCC calibration method was applied to MET 4 and GMS 3 ISCCP B1U imagers and found to be robust enough and the derived degradation matched with desert. Arata Okuyama, JMA: Liquid Water Clouds The error budget for the liquid cloud target is estimated. Terra MODIS based calibration coefficients seem to show some bias. It is important to estimate systematic error amount. A vicarious calibration approach is applied to GOES and METEOSAT. The approach works well. The calibration monitoring web site is available at Page 34 of 46