The Mediterranean Data portal

Transcription

1 The Mediterranean Data portal EMODNET ADRIATIC meeting, Split, 3-4 December 2013 Leonidas Perivoliotis Hellenic Center for Marine Research, Greece

2 Background on the data collection, processing and distribution in the Mediterranean: Platform-oriented data centers XBT VOS high resolution system (12 nm along track and full profile transmission, few hours delay) 20 ARGO floats deployed from VOS (few hours delay) ENVISAT JASON ERS GFO Multiparametric buoys in: Ligurian Sea, Adriatic Sea and Cretan Sea (few hours delay) Daily satellite SST interpolated in RT on model grid (one day delay) T/ P JASON-1, GFO, ENVISAT, T/P Sea Level Anomalies (few days delay) Scatterometer DAILY winds analysis, 1/2x1/2 (one week delay) Open ocean monitoring by gliders (few hours delay)

3 Collects and process data from Insitu platforms in the Mediterranean Sea The regional node for the Insitu component of Marine Core Service (MCS) Single point access for data provision to Med Marine Forecasting Center (MFC) Distributes added value (quality controlled) data in a unique format Built through MyOcean I&II, but it supports the Mediterranean observing component of major EU projects in Operational Oceanography (Jerico, Perseus, FixO3). Continuous expansion in terms of capacity in order to become the Regional Insitu MONGOOS Data Center.

4 Insitu Thematic Assembly Centers (TACs): A regional organization North West Shelves: BSH/Germany Temp & Salinity : BSH/Germany Current: SMHI/Sweden Sea Level: DMI/Denmark Arctic: IMR / Norway all data Baltic Sea: SMHI/Sweden Temp & Salinity : BSH/Germany Current: SMHI/Sweden Sea Level: DMI/Denmark Bio : FMI-Syke/Finland Black Sea IOBAS/Bulgaria all data Global Ocean : Coriolis/France Link with international network s: Coriolis/France ARGO: Coriolis,BODC,BSH European Vessels: NIVA/Norway 16 Partners/ 11 countries Ensure the link with : International networks EuroGOOS ROOSes SeaDataNet Process data in a common but distributed manner for MyO & ROOSes needs South West Shelves: Puertos Del Estado/Spain Mooring : PdE Underway data: Coriolis/France Infrastructure built on EuroGOOS strategy and supported through MyOcean I&II projects Mediterranean Sea : HCMR/Greece Mooring : HCMR/Greece XBT/CTD: ENEA/Italy Drifter & Argo: OGS/Italy Glider and Argo: Coriolis/France

5 The core tasks for the Insitu TACs Define common distribution means: vocabularies, formats, organization, monitoring tools, Build a reliable distributed architecture for in-situ data delivery to Marine Forecasting Centers (MFCs) and MyOcean users Converge on common quality control procedures and flag conventions Enhance the T&S basin scale consistency methods for global ocean and adapt them to regional scales, if possible Develop methods for Quality Control of biogeochemical data both in real time and delayed mode and provide recommendations for acquisition of biogeochemical data from various platforms Turn into operation enhanced calibration/validation methods

6 The Role of Mediterranean Number of parameters: Insitu TAC Physical: T&S, current, sea level Biogeochemical: Chlorophyll/Fluorescence, Oxygen, Nutrients Atmospheric: Air Temperature, Wind, Air Pressure Sea State: Waves (Significant Height, Direction, Period) Any additional parameters that may be available (radiation, sound data, etc.) Integrate in-situ data in product accessible through global and regional portals Common format Common NRT QC Common Quality flags Common distribution tools Single access point Ensure a minimum level of quality on the data delivered In Near real time ( 24h to a week) In delayed mode Assessment of the products at basin scale Required by MyOcean

7 The Insitu TAC relies on close collaboration with: EuroGOOS Coordination of the observing networks in European scale JCOMM - Coordination of the international observing networks SeaDataNet which consolidates the NODC network and provides delayed mode products

8 Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October Total number of stations Temperature & Salinity data

9 Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October Meteo parameters Waves data

10 Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October Current recordings Sea level

11 Data acquistion: Data are collected through direct links with the Production Units Data are converted in a unique format (Oceansites netcdf v1.1 compatible) Extended guidance for new partners in order to provide all the necessary information Quality control: Apply automatic quality control procedures on each parameter, elaborated in coherence with international agreement (in particular SeaDataNet). Procedures applied after agreement with the data originators in order to avoid conflicts and effort duplications. Validation/Assessment : Assess the consistency of the data over a period of time in an area. The aim is to detect possible incoherencies with nearby data that could not be detected by automatic QC. Distribution: Main functions Disseminates the data through MyOcean/EMODET to the external users

12 Data acquisition Main steps: Direct connection is established (usually through ftp protocol) between the Med portal and the data provider Information is provided about the required metadata that should be supplied together with data (ex. station position, date, frequency of measurement, platform name, depth of each sensor, contact person, PI, etc.) Guidance is also provided on how the required daily and monthly files should be created. Information exchanged about the QC procedures Data are provided in the originator s native format, no need for conversion to NetCDF. This procedure is performed by the IT staff of Med portal.

13 Sample of data global attributes NIB Vida buoy Data carry complete information about the originator and the assembly center(s)

14 Real Time QC Function : Quality Control procedures are applied in: Temperature and Salinity Sea Level Current from drifters or Current from moorings Bio-geochemical (Still under development) Implementation automated procedure that should avoid flagging good data applied through an agreement with the primary Production Unit In most cases minor corrections are applied to the flags that have already been assigned by the Production Unit

15 Automatic QC for Argo, gliders, CTDs and XBTs Real-time quality control on temperature and salinity data Meta data-implementation and/or verification: Position, Date, Method, Specification, PI, Processing, Comments Automatic QC for time series QC Flag Scale Visual QC Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Pressure Increasing Test Test 9: Spike Test Test 10: Top and Bottom Spike Test Test 11: Gradient Test Test 12: Digit Rollover Test Test 13: Stuck Value Test Test 14: Density Inversion Test 15: Grey List (Argo, Glider) Test 16: Gross salinity or temperature sensor drift (Argo, Glider) Test 18: Frozen Profile Test Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Spike Test Test 9: Climatology Test 11: Instrument range Test 12: Rate of change in time Test 13: Stationary Test code Meaning 0 no QC was performed 1 good data 2 probably good data 3 bad data, but correctable 4 bad data 5 value changed 6 below detection limit 7 in excess of quoted value 8 interpolated value 9 missing value A Incomplete information mandatory for automated QC display Meta data display the profiles T/S diagrams time/depth plots scatter plots maps displaying location control of spikes and other irregularities control of density profile if extended QC is included, visual QC can be reduced to be only applied on alerted profiles Extended QC: Comparison to a climatology and the surrounding measurements: objective mapping or local interpolation method. Other comparisons.

16 RT FILES Mooring Data Validation of Temperature and Salinity data DM FILES HCMR Data Base Vessel Data Glider Data VALIDATION Cross-Validation of T, S ftp Serv. HCMR Data Base Float Data In-Situ Product Validation procedure: Cross-validation of the physical variables (T, S) as derived from VOS, moorings, floats and gliders. The estimated differences will be analyzed as a function of the spatial and temporal distances between the measurements

17 The portal structure is in compliance with MyOcean standards

18 Production line HCMR Moorings (M3A, Poseidon network) Daily files GDAC The Med portal contains data beyond the MyOcean portfolio by hosting all the available data from the different platforms (meteo & wave data, additional marine parameters) ENEA CTDs/XBTs OGS Drifters ARGO DM IFREMER Gliders ARGO RT GTS PdE Mooring + tide gauges Additional Providers (CNR, OC-UCY, ISPRA, NIB, OGS, ) T S B i o c h e m I c a l Real Time QC ftp Serv. MFC s HCMR MONGOOS Regional DU Mediterranean In Situ TAC EMODNET PP External Users (RIU, EIA) -Public, -Standard, -Specific -Privileged (Downstream)

19 Monitoring performance Daily recording of several indicators regarding data capacity, quality of information and timely update of the portal from the data originators

20 Data availability on 27th of November 2013 (1990-now) 126 profilers 42 active 27 Gliders 3 active 95 moorings 66 active 1298 drifters 6 active 134 XBTs 3 active 2168 unique platforms 72 CTDs 82 Thermosalinographs 6 active total files

21 Building historical data sets Historical datasets have been created for the time period since 1990 (depends on each platform s availability) Data sets were produced merging the monthly files Validation/Assessment procedures have been applied The historical dataset building was not possible in some cases due to metadata inconsistency Platform type Number of different platform codes Number of historical netcdf created Drifter Profiler-Glider Vessel Mooring etc 35 35

22 Data aggregation from SeaDataNet 1600 cruises ( ) from SeaDataNet : T&S casts Assessment of historical data set

23 EMED is clearly Under Sampling (at least in NRT) Data availability (active stations) on 27/11/13

24 View on the data - Gliders: Levantine Sea, April 2012 Start End Start End Start End Temperature and Salinity data collected through a glider mission in Levantine Sea during April The presence of the newly formed Levantine Intermediate Water (LIW) with salinity values higher than 39.1 psu is clearly identified between m. Moreover, as the glider is moving northwards, enters in a area of anticyclonic movement, as it can be seen by the deepening of the temperature and salinity contour lines.

25 View on the data - Moorings: Long time series data, Pylos, Ionian Sea Three years T&S data between 0-500m from the POSEIDON buoy in Pylos. The LIW signal, between m, is clearly stronger in 2010 with higher values both in salinity (>39 spu) and temperature.

26 View on the data - Drifters: Ligurian and Balearic Seas, April 2012 Start End The well known westwards surface flow along the Italian and French coasts towards the Gibraltar straits has been verified by the drifters trajectories released in the area during April Surface waters are 2-3 o C warmer in the Ligurian Sea compared with those observed around the Gulf of Lions. None of the drifters released in the Ligurian Sea entered the Gulf of Lions. It seems that the presence of an anticyclonic movement inside the gulf does not allow the entrance of the drifters and push them more westwards. The trajectory of the only drifter released inside the gulf verifies the existence of this anticyclone.

27 Expansion the data capacity Engage more partners Data Aggregation through Jerico Project CNR - ISMAR Expecting 7 mooring stations Currently receiving data from 5 moorings NADR-SNG, Data from: 01/01/2013 Parameters: DRYT, WSPD, WDIR, TEMP, PRES Molo-Bandiera, Data from: 05/07/2013 Parameters: DRYT, WSPD, GSPD, WDIR, TEMP Molo-Sartorio, Data from: 05/07/2013 Parameters: SLEV ISMAR-Head-Office, Data from: 05/07/2013 Parameters: ATMS, PRRT PALOMA, Data from: 05/07/2013 Parameters: TEMP, DRYT OGS Expecting 9 mooring stations Currently receiving data from 2 moorings ADN-MAMBO1 Parameters: WSPD, WDIR, RELH, ATMS ADN-MAMBO4 Parameters: WSPD, WDIR, RELH, ATMS Currently only latest data available. Expecting monthly files along with the other moorings ISPRA Expecting 15 mooring stations Data from 12 moorings available in monthly directory. Daily transmission from 9 moorings. ANCONA Starting date of data: 01/06/2013 CATANIA Starting date of data: 01/06/2013 CETRARO Starting date of data: 01/06/2013 CIVITAVECCHIA Starting date of data: 01/06/2013 CROTONE Starting date of data: 01/06/2013 LASPEZIA Starting date of data: 01/06/2013 MONOPOLI Starting date of data: 01/06/2013 PALERMO Starting date of data: 01/06/2013 PONZA Starting date of data: 01/06/2013 VANEZIA Starting date of data: 01/06/2013 CAGLIARI Starting date of data: 12/08/2013 MAZARA Starting date of data: 29/08/2013 Parameters: RELH, TEMP, VDIR, VSMC, VTDH, VTPK, WDIR, WSPD NIB-MBSS 1 mooring station VIDA Parameters: EWCT, NSCT, WSPD, WDIR, DRYT, RELH, TEMP, PSAL Data from: 17/06/2013 Further expansion expected through PERSEUS project

28 A closer look in the Central Mediterranean Green Stations: Already in the MED portal Brown Stations: Agreement reached for their dissemination Not yet available (remaining ISPRA stations) Red Stations: Known to operate Not in the Med portal Stations positions according to MONGOOS inventory, updated on October 2013

29 Focus on the Adriatic Sea Acquired stations Gulf of Trieste : OGS and CNR- ISMAR coastal facilities have been aggregated through JERICO project ISPRA stations have been acquired through EMODNET NIB MBS - Vida station (Slovenia) has been provided to support the expansion of the MED data portal

30 Focus on the Adriatic Sea Missing stations CNR ISMAR offshore stations : PTF Acqua Alta, Meda Gargano, BB, DD Discussions on dissemination agreement OGS : E2M3A Station Agreement has been reached Croatian stations (HHI, IZOR ) are missing

31 Data from Adriatic Stations T & S

32 Data from Adriatic Stations - Sea level

33 Known gaps in spatial coverage Adriatic Sea (already presented) Corsica/Sicily Data from offshore platforms operated by CNR-ISMAR is missing Malta Coastal stations are missing (T&S, sea level) Cyprus Missing coastal stations (T&S, sea level) Data from glider missions is included Turkey Data from Mediterranean platforms is missing Israel Coastal stations (T&S, sea level) are missing Northern African coast No data is available Limited knowledge about capacity

34 Future plans under EMODENT support Data capacity Engage more partners to contribute their data in the portal Filling the known gaps. EMODENT Adriatic meeting is the first coordinated action to gather and disseminate the missing data to the marine community. Building stronger connections with Northern African countries. Development Complete support for the data conversion from any kind of input to OceanSites NetCDF format. Data base support for the whole extend of the data Enhance QC system Plans for development a regional data visualization and downloading system

35 Summarizing The building of Mediterranean Data portal has been funded by MyOcean I & II projects in order to become the regional node for the insitu component of the Marine Core Service (MCS). It s the integrated forward step from the platform-oriented data centers that exist in the Med. It is established in compliance with EuroGOOS regional implementation policy, enhancing the expected MyOcean capacity by engaging new partners and hosting additional parameters. It supports all the major Operational Oceanography projects in the Mediterranean (Jerico, FixO3, Perseus) through the assembly and process of the relevant data. The participation of Med portal in these projects increases the data interoperability and prevents the unnecessary duplication of efforts.

36 Summarizing It is one of the main components of the EMODNET The majority of the data coming from insitu platforms in the Mediterranean is already available, but significant known gaps in spatial coverage exist, especially in the Eastern part of the basin Collecting the missing data will complete the real-time marine information of the Mediterranean enhancing also the forecasting products that are delivered through various centers along the basin Supporting a Sustainable Ocean Observing System

37 Contact details Leonidas Perivoliotis Institute of Oceanography Hellenic Center for Marine Research Telephone: Thank you for your attention