MONTHLY OPERATIONS REPORT

Transcription

1 MONTHLY OPERATIONS REPORT MOR#027 Reporting period from 16-Feb-2016 to 15-Mar-2016 Reference: PROBA-V_D5_MOR-027_ _v1.0 Author(s): Dennis Clarijs, Sindy Sterckx, Alex Geboers, Erwin Wolters Version: 1.0 Date: 18/03/2016

2 DOCUMENT CONTROL Signatures Author(s) Dennis Clarijs, Sindy Sterckx, Alex Geboers, Erwin Wolters Reviewer(s) Dennis Clarijs Approver(s) Dennis Clarijs Issuing authority Change record Release Date Pages Description Editor(s)/Reviewer(s) /03/2016 All Initial version PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 2 of 18

3 TABLE OF CONTENT 1. Summary System Infrastructure Image Processing Services Ingested and archived products Generated and archived products Backup and archiving service Dissemination service End-user activity Image Calibration services Radiometric Calibration Geometric Calibration Anomalies System related issues Image processing issues Scheduled activities for the next period(s) Operational remarks PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 3 of 18

4 1. Summary In the past month, three synthesis products show a large gap, two a medium gap; all other synthesis products have minor gaps. All products contained data gaps at higher latitudes. In this region, the 4th component of the quaternions (cos(theta/2) was crossing zero causing all other quaternions elements to suddenly change sign as well. This change in quaternions signs was not properly handled by the attitude check modules in the processing facility causing a gap in the images. A fix for this is in test and will be installed as soon as possible. All data starting from February 10, 2016 will be reprocessed in order to fix the gaps due to this bug. Due to the platform being in Bdot mode after a failed autonomous recovery on 24 th and 25 th of February, 6 TFFs were missing. Also, after the satellite has been commanded back into geodetic mode, a large amount of data was discarded due to the sensor being out of temperature range on the 25 th of February. One TFF was missing due to a configuration issue of the baseband unit at the ground station on 2 nd of March. On Sunday February 21 st, due to a short regional power interruption, a problem with the cooling systems of one server room occurred. This caused an interruption in the daily processing and outage of the product distribution platform. All services were restored the same day and most products were delivered also on the same day. There were no major issues with the image quality during this reporting period, both for radiometric as geometric quality. 2. System Infrastructure (*) Category % Up Time % Down Time (*) Switches Database Servers Mid Term File Servers Short Term File Servers Master Servers Worker Nodes PDF Table 1: System Infrastructure availability for this reporting period Due to a regional power failure on Sunday 21/02 at 5am, a problem with the cooling systems of one server room occurred. As a consequence, several servers in the 100 m production chain and PDF cluster shut down due to an overheat alert. After the cooling issue was resolved, all systems were systematically put back online. At 15:00 all production systems were back up-and running. All products were still delivered on the same day except for the 100 m S5 products, which took longer to process. No systems were damaged and no data was lost. PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 4 of 18

5 3. Image Processing Services 3.1. Ingested and archived products Product Type Total Received Missing data, Archived ingested by VITO METEO TFF Table 2: Ingested and archived products for this reporting period - 7 x TFF missing: (TFF 8961, 8962, 8963, 8964, 8965, 8966, 9017, 9025) 3.2. Generated and archived products Product Type Total Processed Error Archived PROBAV_L1A - Calibration PROBAV_L1A - Nominal PROBAV_L1C PROBAV_L3_S1_TOA_100M PROBAV_L3_S1_TOC_100M PROBAV_L3_S1_TOC_NDVI_100M PROBAV_L3_S5_TOA_100M PROBAV_L3_S5_TOC_100M PROBAV_L3_S5_TOC_NDVI_100M PROBAV_L3_S1_TOA_300M PROBAV_L3_S1_TOC_300M PROBAV_L3_S10_TOC_300M PROBAV_L3_S10_TOC_NDVI_300M PROBAV_L3_S1_TOA_1KM PROBAV_L3_S1_TOC_1KM PROBAV_L3_S10_TOC_1KM PROBAV_L3_S10_TOC_NDVI_1KM Table 3: Generated and archived products for this reporting period - 20 x L1A error: Error-RadiometricProcessing - 5 x L1A error: Error-GeometricProcessing PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 5 of 18

6 3.3. Backup and archiving service Product type Total Files Total File Size (GB) TFF L1A Database transaction logs Database incremental back-up Database full back-up Table 4: Back-up data volumes for this reporting period Product type Total Files Total File Size (GB) PROBAV_TRANSFERFRAMES PROBAV_L1A PROBAV_L1C PROBAV_L3_S1_TOA_100M PROBAV_L3_S1_TOC_100M PROBAV_L3_S1_TOC_NDVI_100M PROBAV_L3_S5_TOA_100M PROBAV_L3_S5_TOC_100M PROBAV_L3_S5_TOC_NDVI_100M PROBAV_L3_S1_TOA_300M PROBAV_L3_S1_TOC_300M PROBAV_L3_S10_TOC_300M PROBAV_L3_S10_TOC_NDVI_300M PROBAV_L3_S1_TOA_1KM PROBAV_L3_S1_TOC_1KM PROBAV_L3_S10_TOC_1KM PROBAV_L3_S10_TOC_NDVI_1KM ICP_GEOMETRIC_CENTRE ICP_ GEOMETRIC _LEFT ICP_ GEOMETRIC _RIGHT ICP_RADIOMETRIC_CENTRE ICP_RADIOMETRIC_LEFT ICP_RADIOMETRIC_RIGHT METEO_ECMWF METEO_METEOSERVICES POLARMOTION Table 5: Archived data volumes for this reporting period PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 6 of 18

7 3.4. Dissemination service Product type Added to catalogue Ordered Delivered PROBAV_L1C PROBAV_L3_S1_TOA_100M PROBAV_L3_S1_TOC_100M PROBAV_L3_S1_TOC_NDVI_100M PROBAV_L3_S5_TOA_100M PROBAV_L3_S5_TOC_100M PROBAV_L3_S5_TOC_NDVI_100M PROBAV_L3_S1_TOA_300M PROBAV_L3_S1_TOC_300M PROBAV_L3_S10_TOC_300M PROBAV_L3_S10_TOC_NDVI_300M PROBAV_L3_S1_TOA_1KM PROBAV_L3_S1_TOC_1KM PROBAV_L3_S10_TOC_1KM PROBAV_L3_S10_TOC_NDVI_1KM Table 6: Ordered and delivered products for this reporting period 3.5. End-user activity 32 new user(s) were registered in this reporting period. The total number of users registered for PROBA-V data and that have ordered data is 750 with 94 different nationalities representing 586 different companies/universities. Product type Africa Asia Europe N-America Oceania S-America PROBAV_L1C PROBAV_L3_S1_TOA_100M PROBAV_L3_S1_TOC_100M PROBAV_L3_S1_TOC_NDVI_100M PROBAV_L3_S5_TOA_100M PROBAV_L3_S5_TOC_100M PROBAV_L3_S5_TOC_NDVI_100M PROBAV_L3_S1_TOA_300M PROBAV_L3_S1_TOC_300M PROBAV_L3_S10_TOC_300M PROBAV_L3_S10_TOC_NDVI_300M PROBAV_L3_S1_TOA_1KM PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 7 of 18

8 PROBAV_L3_S1_TOC_1KM PROBAV_L3_S10_TOC_1KM PROBAV_L3_S10_TOC_NDVI_1KM Table 7: Data download (GB) in total per Origin of the User for the reporting period Product Type Global L1C PROBAV_L3_S1_TOA_100M PROBAV_L3_S1_TOC_100M PROBAV_L3_S1_TOC_NDVI_100M 3.87 PROBAV_L3_S5_TOA_100M 3.96 PROBAV_L3_S5_TOC_100M PROBAV_L3_S5_TOC_NDVI_100M PROBAV_L3_S1_TOA_300M PROBAV_L3_S1_TOC_300M PROBAV_L3_S10_TOC_300M PROBAV_L3_S10_TOC_NDVI_300M PROBAV_L3_S1_TOA_1KM PROBAV_L3_S1_TOC_1KM PROBAV_L3_S10_TOC_1KM PROBAV_L3_S10_TOC_NDVI_1KM Table 8: Data download (GB) in total for the reporting period Company # Downloads VITO 1000 UNIVERSITÄT GÖTTINGEN 558 R&D 465 LEGOS 421 GEOSYS 310 UNIVERSITY OF REPUBLIC 285 UNIVERSITÉ PARIS DIDEROT 268 ENVEO IT 265 UMD 222 SRI LANKA 219 Table 9: Top 10 user companies for the reporting period PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 8 of 18

9 List of issues raised by users: Country # Users BELGIUM 75 CHINA 62 ITALY 43 FRANCE 33 BRAZIL 32 UNITED KINGDOM 30 UNITED STATES 29 NETHERLANDS 24 GERMANY 24 INDIA 22 Table 10: Top 10 countries with most registered users ProbaV: - Subscription Notification - Question about PROBAV products - PROBAV 300 m data for ESA project - How to georeference L1C data? - Access to full res image of Krugerpark IOTW - Cloud correction and filtering software and Proba satellite image data question - 100m PROBA data for Burnt Area - layers in PROBA S10 TOC - Subscription to free PROBA-V Images - Why the images of PROBA-V is not overlap? - Three 100m images over Alps PDF portal: - username/password - Subscription Notification - Access denied when downloading product PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 9 of 18

10 4. Image Calibration services 4.1. Radiometric Calibration Calibration request type Total Processed Not received Error CLOUDS DARK CURRENT MOON RAYLEIGH SNOW SUN_GLINT Table 11: Calibration Image requests for this reporting period Calibration image type Total Valid Invalid (*) PROBA_V_L1A_CALIBRATION PROBA-V_L1B_CALIBRATION PROBA-V_L1B_INTERSECTION PROBA-V_L1B_OVERLAPREGION Table 12: Processed calibration images for this reporting period (*) Due to insufficient overlap with the calibration region of interest, not enough pixels (e.g. clouds contamination), site not sufficiently uniform (illumination), etc. Long-term monthly Libya-4 mean plots for different cameras are given in Figure 1, Figure 2 and Figure 3. Deep convective clouds interband calibration results are given in Figure 4. Please note that the effect of the update of the absolute calibration coefficients of the SWIR strips performed on February 6 is not yet visible in all the Libya-4 results of the different strips; this is due to the lack of cloud-free observations for these SWIR strips made since the update. For the VNIR strips calibration results from the Libya4, Rayleigh and DCC methods remain relatively stable. No clear and/or consistent trend can be seen in the different results. Similarly as in previous months, the dark current of a few SWIR pixels has suddenly increased in the last month, which might cause the presence of a few stripes. An update of the SWIR dark current values is required to correct for this. For one pixel, i.e. Left SWIR3 pixel 90, the increase in dark current is extremely high and unstable, therefore this pixel will be assigned the status BAD. PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 10 of 18

11 Radiometric ICP file ICP dark values will be updated in the coming days and one bad pixel, i.e. Left SWIR3 pixel 90, will be added. The current ICP files are PROBAV_ICP_RADIOMETRIC#LEFT_ _V01 PROBAV_ICP_RADIOMETRIC#CENTER_ _V01 PROBAV_ICP_RADIOMETRIC#RIGHT_ _V01 Figure 1. Libya-4 desert calibration results: LEFT monthly averaged results PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 11 of 18

12 Figure 2. Libya-4 desert calibration results: CENTER monthly averaged results PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 12 of 18

13 Meas/Model Meas/Model Meas/Model Meas/Model Meas/Model Meas/Model Monthly Operations Report BLUE RIGHT june aug oct dec feb apr june aug oct dec feb apr jun aug oct dec feb MONTH SWIR1 RIGHT june aug oct dec feb apr june aug oct dec feb apr jun aug oct dec feb MONTH RED RIGHT june aug oct dec feb apr june aug oct dec feb apr jun aug oct dec MONTH SWIR2 RIGHT june aug oct dec feb apr june aug oct dec feb apr jun aug oct dec feb MONTH NIR RIGHT june aug oct dec feb apr june aug oct dec feb apr jun aug oct dec feb MONTH SWIR3 RIGHT june aug oct dec feb apr june aug oct dec feb apr jun aug oct dec feb MONTH Figure 3. Libya-4 desert calibration results: RIGHT monthly averaged results PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 13 of 18

14 Figure 4. DCC inter-band calibration results: LEFT, CENTER and RIGHT camera PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 14 of 18

15 4.2. Geometric Calibration Calibration image type Total Processed Error PROBA-V_L1C_INTERSECTION Table13: Processed calibration images for this reporting period Geometric ICP file During previous month, the average ALE was 102 m (σ < 101 m). Daily values started off at m and increased to peak values of m at 20/01, followed by a gradual decline to ~110 m thereafter. At this point a new set of ICP files were implemented and applied. A second increase followed from 06/02 to 14/02, in which values eventually peaked at m. On 16/02, again a new set of ICP were generated and applied. The daily ALE evolution can be seen in Figure 5. The geometric accuracy was within the requirement of < 300 m, with an average compliance of 97.6%. Daily compliance values decreased to below 97% for the VNIR channels between 20/01 and 25/01, but increased rapidly to > 99%. A second decrease in daily compliance values to below 97% for the VNIR channels was noticed from06/02 to 14/02. The geometric accuracy was within the requirement of < 300 m, with an average compliance of > 99.4%. Daily values started stable and well above 99%, but decreased from 29/9 onwards, reaching a minimum value of 97.7% for the BLUE channel at 5/10. After the ICP update, daily values increased again to > 99% for all channels. PROBAV_ICP_GEOMETRIC#LEFT_ _V01 PROBAV_ICP_GEOMETRIC#CENTER_ _V01 PROBAV_ICP_GEOMETRIC#RIGHT_ _V01 PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 15 of 18

16 Figure 5. Daily ALE evolution this reporting period 5. Anomalies 5.1. System related issues A detailed description of each issue is available in the issue tracking system Key Summary Status Created Component/s PROBAVUS-7 Very small images fail to process Resolved 10/01/2014 General PROBAVUS-60 LTDA Restore fails when product Open 22/01/2016 Software destination already exists on disk PROBAVUS-61 Inaccurate longitude/latitude coordinates Resolved 24/02/2016 Software PROBAVUS-62 Incorrect handling of quaternions Resolved 10/03/2016 Software 0 new issues were logged during this reporting period 0 issue(s) was resolved and closed during this reporting period 0 issues are resolved but remain to be closed formally 0 issues are resolved but remain in the list logging purposes 0 issue(s) is open and remain to be solved PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 16 of 18

17 5.2. Image processing issues A detailed description of each issue is available in the Weekly Report and the image processing tracking system The below table gives an overview of the S1 s of this reporting period: # S1 Dates Major Gaps (> km² (missing TFF)) 3 25/02, 15/03, 02/03 Large Gaps (< km²) 0 Medium Gaps (< km²) 2 19/02, 24/02 Minor Gaps (< 3600 km²) 0 Negligible Gaps (< 1000 km²) 24 18/02, 28/02, 23/02, 09/03, 04/03, 14/03, 10/03, 05/03, 29/02, 20/02, 06/03, 01/03, 11/03, 21/02, 26/02, 07/03, 16/02, 12/03, 22/02, 27/02, 08/03, 03/03, 13/03, 17/02 Complete synthesis (no gaps) 0 Table14: Overview of S1 for this reporting period PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 17 of 18

18 6. Scheduled activities for the next period(s) Software upgrades: o No software upgrades planned Hardware: o An assessment is ongoing to identify older critical hardware in the processing chain for future replacement. Development: o A new cloud detection algorithm is under investigation. o Impact of doubling the download bandwidth for end-users is under investigation Other: o On Tuesday 5 th of April, the platform will be switched to the redundant computer to further investigate the decompression errors. This means that the data will be stored in the redundant MMM instead of the primary MMM. This will provide better insight in whether the problem is only present on the primary or present on both systems. This test will however have an impact on the nominal acquisitions in the sense that we will miss a minimum of one orbit. A communication to the end-users will be done by VITO. 7. Operational remarks On 17/03/2016, the Processing Facility component was upgraded to v2.8.0 in order to fix the gaps that occurred recently at higher latitudes. In this region, the 4th component of the quaternions (cos(theta/2) was crossing zero causing all other quaternions elements to suddenly change sign as well. This change in quaternions signs was not properly handled by the attitude check modules causing a gap in the images. All data starting from February 10, 2016 will be reprocessed in order to fix the gaps due to this bug. PROBA-V_D5_MOR-027_ _v1.0 Monthly Operations Report Page 18 of 18