Lessons learnt from EPS Cal/Val F. Montagner & H. Bonekamp EUMETSAT
Introduction EUMETSAT Scientific Products Validation Team Commissioning of EPS system including Cal/val of Metop-A satellite products in 2006-2007, ready for Cal/val of Metop-B to be launched on 23/05/2012 Scope and focus of Metop Cal/val Infrastructure at EUMETSAT Lessons learnt Slide: 2
Product Quality in Operational Missions SAFs Operational chains Scientists Validation chains Product experts Cal/Val Experts Users Off-line Test Processors Prototypes
Quality feed-back EUMETSAT Central Facility SAFs Direct contact User Help Desk Conferences Delegate Bodies SAFs (as L1 users) Validation Users NWP SAF Product Validation Boards Users
Product Life Cycle Model (drawing) Bea and Ken s diagram
Cal/Val Focus Comparing operational with prototype results Monitoring internal consistency On-board calibration measurements Monitoring consistency with external reference Sustained in situ measurements e.g buoys, radiosondes Operational models e.g ECMWF forecast Comparing products with measurements Other satellite measurements e.g. cross-calibration SEVIRI-IASI Campaign measurements Slide: 6
Cal/Val infrastructures at EUMETSAT Mission specific : MSG: separate facilities for Image (L1) and Products (L2) EPS Cal/Val Facility (CVF) Sentinel-3 Mission Performance Monitoring Facilities (MPMF) Multi-mission facilities : Off-line environment Technical computing environment Satellite Application Facilities (SAFs) Slide: 7
EPS CVF in Near-Real-Time processing chain Slide: 8
EPS CVF Context Slide: 9
EPS CVF Architecture IDL-based Scalable storage, SNA-based 30 days of mission data and products Accessible within CVF network Interactive & batch Template-driven Plug-in interface Interactive & Batch (datadriven, time-driven) Interactive & Batch Template-driven Uses DAM visualisations Data dictionary Data-driven ingestion Slide: 10
Off-line Environment for Monitoring Satellite Data Data Processing HKTM Science Data Product Processing Shared short term storage Preprocessing and extraction Data Warehouse Reports Analysis and reporting Messages High Level Products Dissemination Prototypes Cal/Val Tools Slide: 11
Example short term monitoring (1) ASCAT Sigma-0 product coverage quick-look, FORE beam 26/02/2012 Slide: 12
Example short term monitoring (2) IASI radiance monitoring : comparison of observed spectra with simulated ones based on NWP forecast See IASI daily reports on http://oiswww.eumetsat.org/epsreports/html/index.php?instrument=iasi Slide: 13
Example long term monitoring GOME-2 Long term throughput evolution on Solar Mean Reference spectrum, January 2007 (=1) to August 2009 See GOME daily reports on http://oiswww.eumetsat.org/epsreports/html/index.php?instrument=gome Slide: 14
EPS Cal/Val : What went well Good understanding /coordination between SIOV and Cal/Val Early release of products for evaluation and feed-back Demonstrational to restricted community of users, pre-operational to all users with limitations, operational to all users (in months from launch L) AMSU, MHS, HIRS, AVHRR L1 (L+1..., L+6) ASCAT L1 (L+3.5, L+12, L+17.5) GOME L1 (L+4, L+12, L+17) IASI L1 (L+4, L+6, L+8.5) Well targeted and timed cal/val campaigns JAIVEX campaign with airborne IR hyperspectral sounders (04/2007) helped confirm IASI spectral calibration Sounding campaign (07-08/2007) helped start IASI L2 service in 02/2008 Slide: 15
EPS Cal/Val : What caused delays Readiness of Infrastructures at launch time Operational product processing GRAS L1 IASI L2 Cal/val ASCAT transponders Slide: 16
Lessons learnt from EUMETSAT operational missions Rapid access to data and products is key to the success of cal/val activities for cal/val partners in a decentralised system for experts in house Scalability of Cal/val infrastructure is essential storage in hi-rel, shared file systems and data warehouses workstations for interactive product analysis processing power for systematic assessment and for re-processing with updated algorithms Focus on long term monitoring from the start is essential Slide: 17 requirements included in Cal/Val plans appropriate infrastructure