Observations Programme Management EUCOS Quality Monitoring

Transcription

1 Observations Programme Management EUCOS Quality Monitoring 1 st Monitoring Workshop Reading, 3 rd 4 th July 2013 OBS Programme Management Team: Stefan Klink, Sabine Hafner, Tanja Kleinert

2 Content EUCOS Performance Standards EUCOS Quality Monitoring Fault Reporting Reporting on QM

3 EUCOS Performance Standards First established in 2002 Last revision in June 2009 by PB-OBS19 (Version 5.2) Describes Performance Standards, Monitoring and Change Control Procedures for all EUCOS networks besides E-GVAP and OPERA Defining targets on Percentage of observations received from Network Percentage received by Threshold target. Percentage received by Breakthrough target. Accuracy targets of particular parameters (e.g. temperature, wind speed and direction, pressure, humidity)

4 EUCOS Performance Standards - example

5 New table on EUCOS Performance Standards Data availability target: scientific target A financial constraint target might be added Current status New requirements Network component Terrestrial segment Operational Service Observations Programme Data availability Station type EUCOS ECMWF SRNWP/F PM Surface stations Target: 98% Radiosonde stations TEMP AB in Target: 75% EUCOS CD TEMP AB in Timeliness ECMWF CD HH+10 TEMP AB in Target: 75% SRNWP/F PM HH+20 CD Aeronautical segment E-AMDAR AMDAR aircraft Annual target: 11 Mio. obs Annual target: 11 Mio. obs HH+10 HH+20 Oceanic segment Remote sensing segment E-ASAP Mode-S EHS? ASAP units Annual target: 4100 obs E-SURFMAR Moored buoys E-GVAP Drifting buoys Target: 88% Automated VOS ships Conventional VOS ships GNSS sites Daily avg target: 1,000 obs Daily avg target: 250 obs E-PROFILE Wind profiler Target: 85% OPERA Weather radars No target defined* No target defined* Incoming radar data TEMP AB in Target: 75% HH+60 Target: 85% HH+60 Target: 85% ICD HH+08 CD HH+90 ICD HH+10 TEMP AB in CD HH+10 HH+10 HH+10 Target: 85% HH+10 Target: 85% ICD HH+05 HH+30 HH+60 HH+60 HH+60 ICD HH+08 Composite products Volume products Reflectivity Volume products Radial wind Composites HH+15 Composites HH+20 Composites HH+10 HH+10 HH+10 Composites HH+15 HH+15 HH+15

6 EUMETNET Quality Monitoring Website In near future the EUCOS QMP will be accessible via a EUMETNET Observations Quality Monitoring welcome page Link to EUCOS QMP, RA VI QMP, E-AMDAR Portal and probably further tools in future

7 EUCOS QMP ( ) Monitoring of all EUCOS networks on Data availability and timeliness (radiosonde stations additionally burst heights) daily and monthly statistics basing on DWD database Daily average NWP comparison results OBS-MOD first guess fields of ECMWF model since October 2012 (before DWDs COSMO-EU)

8 Information provided in EUCOS QMP (I) Example radiosonde land station network: General overview on data availability and timeliness in station map Green: timeliness TEMP AB <50 min Yellow: timeliness TEMP AB <100 min Orange: timeliness TEMP AB >100 min Red: no data available in the last 24 hours Display of TEMP diagram when selecting a particular station

9 Information provided in EUCOS QMP (II) Data availability: Total number of TEMP parts AB/CD Percentage of target achieved (2 ascents per day) Timeliness: Average timeliness of TEMP parts AB/CD Percentage of target achieved (/) Achieving burst height: Total number of ascents achieving 100 and 50 hpa Percentage of target achieved

10 Information provided in EUCOS QMP (III) Accuracy statistics: Daily/monthly averages of ECMWF biases/ RMSE of temp., MVD, specific humidity and O-B GPH displayed per site Figures exceeding EUCOS targets are color-coded Display of 60-days time series when selecting a particular station

11 E-AMDAR Portal ( Monitoring of AMDAR observations and profile generation Coverage maps and 24h raw data Profile data (per airport, list of all profiles per day/month) Observation totals (E-ADAS, DWD) Daily average NWP comparison results OBS-MOD of AMDAR observations (ECMWF model provided by QEvC)

12 Fault reporting procedure Defined in the EUCOS Performance Standards Currently manual fault reporting process basing on monitoring statistics provided in the EUCOS QMP OBS PMT considers the implementation of an automated fault reporting procedure in this phase Definitions when automated fault reports shall be distributed have to be agreed (e.g. no data since x days) Work has been started to define a fault correction escalation process escalation to Heads of Obs, STAC

13 Quarterly and annual QM reporting Quarterly and annual quality monitoring reports provide information on the EUCOS network performances compared to the EUCOS Performance Standards Summary on main targets per network Data availability, Timeliness, Burst heights (RS), Accuracy Performance summary per network and per country highlighting issues at particular sites/stations Network Performance Q Describe status of BUFR migration Germany Netw orks of Member: Timeliness Timeliness Achieving Achieving P RMSE/ Obs. totals Data availability T RMSE WIND RMSVD HUM dq/q* Germany 100 hpa 50 hpa O-B gph Availability BUFR data Territorial netw ork Surface netw ork 32, % 100.0% 100.0% 2.1K 2.4m/s 11.7% 0.4hPa BUFR available Radiosonde netw ork 2, % 99.0% 99.4% 98.4% 92.6% 1.0K 3.4m/s 8.4% - HR BUFR E-ASAP fleet % 93.8% 93.8% 79.2% 72.6% 1.0K 3.7m/s 8.9% - HR BUFR E-PROFILE HH+60 Wind profilers 29, % 99.9% 2.8m/s BUFR available Weather radars WRWP 317, % Currently no OBS-NWP data available BUFR available E-SURFMAR Automated VOS 26, % 99.6% 1.2K 2.6m/s 6.9% 1.7hPa no BUFR data Conventional VOS 7, % 93.5% 1.7K 4.3m/s 11.1% 1.2hPa no BUFR data Moored buoys OPERA HH+08 HH+10 Weather radar ICD 345, % 100.0% 100.0% Weather radar PPD 100, %

14 Network performance table E-GVAP Q Network Territorial networks Surface stations Radiosonde stations (incl. new sites of UANR) E-AMDAR AMDAR aircraft E-ASAP ASAP units at least one ZTD timely Super sites All sites/acs E-PROFILE Data availability 94.4% 99.3% 99.8% Target: 75% Target: 97% 82.7% 72.5% 93.4% 97.6% 91.2% Annual target: 11 Mio. obs 96.3% 98.5% 3.52 Mio. obs Target: 718 (equals 32%) 831 Annual target: Wind profilers (WP) Target: 85% Target: 85% Total WP network 86.2% 97.4% 21 operational WP 94.5% 99.8% 11 non-operational WP 68.2% 90.6% Weather radars (WRWP) No target defined** Target: 85% Total WRWP network 78.8% 99.9% 56 operational WRWP 81.5% 99.8% 49 non-operational WRWP 75.6% 100.0% E-SURFMAR Target: 75% Target: 75% 4,700 obs 85.6% 93.9% 81.5% 75.3% 1,061 obs (equals 23%) Timeliness (R adiosondes: TEM P A B ) Timeliness HH+90 Work is in progress to incorporate E-GVAP quality monitoring. Timeliness HH+60 Timeliness (R adiosondes: TEM P C D ) Achieving 100 hpa Achieving 50 hpa Individual targets subprogrammes Visited 3h airports Target: daily airports Target: Profile distribution daily profiles ---

15 Questions and comments?

16 Contact Details Tanja Kleinert EUMETNET Observations QM and Operations Manager GIE/EIG EUMETNET EUMETNET Observations Programme Management Deutscher Wetterdienst Frankfurter Str Offenbach, Germany Tel: Fax: tanja.kleinert@dwd.de Web: GIE EUMETNET Secretariat c/o L Institut Royal Météorologique de Belgique Avenue Circulaire Bruxelles, Belgique Tel: +32 (0) Fax: +32 (0) info@eumetnet.eu Web: