Open Meteorological Data with OGC and INSPIRE

Transcription

1 Open Meterlgical Data with OGC and INSPIRE INSPIRE 2014 Aalbrg Finnish Meterlgical Institute Rpe Terv, Mikk Visa, Mikk Rauhala, Tarja Riihisaari

2 FMI Open Data Finnish Meterlgical Institute pened its data in Basically everything FMI wns was pened. Data is prvided in freely in machine readable frmat Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 2

3 FMI Open Data Prtal FMI Open Data Prtal fllws INSPIRE requirements. Meta data Services Data Mdels The very same data prtal wrks as Open Data and INSPIRE prtal Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 3

4 Example f Data Sets Data set Descriptin Time Interval Weather Observatins Sun Radiatin Marine Observatins Weather Radars Lightning Temperature, Wind, Humidity, Grund Temperature UV, Shrt and Lng Term Radiatin Waves, Sea Temperature, Sea Level Estimated publish date 10 min Open, lder data t be added 1 min Open 1 h Open Precipitatin Rate, 5 min Open, Precipitatin Amunt lder data t be added Thunder Strikes in Finland 5 min Open Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 4

5 Example f Data Sets Data set Descriptin Time Interval Estimated publish date Real Time Observatins Climatlgical Observatins Climatlgical Observatins Climatlgical Reference Real Time Observatins frm specific lcatin(s) Dayly and mnthly temperature mean and extreme values frm weather statins Mnthly temperature and precipitatin rate mean values interplated t grid Climatlgical Reference. Temperature, humidity, pressure, precipitatin amunt and snw depth. AWS 2010 Sundings 1959 Flashes 1998 Sea Level 1971 Waves Open Open Reference seasns: Open lder data will be added Open Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 5

6 Example f Data Sets Data set Descriptin Time Interval Estimated publish date Weather frecast mdel HIRLAM RCR Sea frecast mdels Envirnmental Mnitring Facilities Aviatin Observatins Grund & mast bservatins Pint frecasts and grid data Sea level pint frecasts, Wave (WAM) and current (HBM) as grid data Weather bservatin statins, radars Latest mdel run (4 times a day) 0 54 h Latest mdel run (4 times a day) h Open Open 2014 METAR 30 min 2014 Special bservatins frm grund and masts Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 6

7 Example f Data Sets Data set Descriptin Time Interval Estimated publish date Air Quality Observatins Silam Mdel Air Quality Observatins 1h Dispersin Mdel fr Air Quality, Frest Fire and Pllen Latest mdel run (nce a day) 0 96h HELMI Ice Mdel Ice frecast mdel Latest mdel run (4 times a day) h Sundings Temperature, Humidity, Pressure, Wind frm grund t 25 km height 2 times a day Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 7

8 View Service (WMS) Based n GeServer Only the mst cmmn layers published Catalg Service (CSW) Based n GeNetwrk Open Meterlgical Data with OGC and INSPIRE / Rpe Terv

9 Dwnlad Service (WFS 2.0) Web Feature Service (WFS) 2.0 Simple Prfile Based n stred queries Predefined data sets with pssibility fr additinal parameters (i.e. time and area) In-huse prductin Open Meterlgical Data with OGC and INSPIRE / Rpe Terv

10 Data Mdels Observatins and pint frecasts as GML The same data is published in tw different frmats. Gridded data is prvided in apprpriate binary frmat (grib, NetCDF, HDF ) WFS members cntains the metadata envelpe with a link t a actual data Open Meterlgical Data with OGC and INSPIRE / Rpe Terv

11 Data Mdels gmlcv:multipintcverage gml:rangeset gml:dubleornilreasntuplelist gml:dmainset gmlcv:simplemultipint The cverage is defined as a list f pints in 4 dimensinal grid (lat, ln, height, time). The data is listed fr every pint defined in dmain set. gmlcv:rangetype The parameters listed in range set are defined in separate element Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 11

12 Data Mdels gmlcv:multipintcverage Prs + Cmpact + Efficient + Small file size + Wrks fr many data types Cns - Nt intuitive - N natural structure f XML XSLT and Xpath dn t wrk Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 12

13 Data Mdels wml2:measurementtimeseries wml2:measurementtimeseries One member cntains time series frm ne parameter and ne lcatin Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 13

14 Data Mdels wml2:measurementtime series Prs + Intuitive + Easy t use + XSLT & XPath wrks Cns - Lts f repetitin - Large file size - Heavy fr DOMbased parsers - Dn t wrk i.e. fr thunder strikes Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 14

15 Data Mdels File size Cmparisn Dcument Size [MB] Cmpressed DcumentSize [MB] Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 15

16 Data Mdels Ppularity Cmparisn Dwnlads[%] Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 16

17 Data Mdels Ppularity Cmparisn Dwnlads[%] Frecast Weather Observatins Radar Images Based n ne mnth data (04/2014) All data sets cmbined Nte that sme data is updated mre ften than thers Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 17

18 MetLib Open surce JavaScript library prduced by Finnish Meterlgical Institute Helps users t lad and use the data Easy requests Cache Parse the data t as JSON Supprts multi pint cverage data frmat Pythn versin is n the list Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 18

19 Registratin Registratin is required t use View and Dwnlad Services Wrking address is the nly mandatry infrmatin After registratin the user gets an API key which have t be added int all requests POST field fmi-apikey= GET parameter fmi-apikey= & Header fmi-apikey; Part f url /wms? One can create several API keys with ne Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 19

20 Usage Limits With ne API key it s allwed t d at mst requests per day t Dwnlad Service d at mst requests per day t View Service d at mst 600 requests per 5 minutes t bth services If all bservatins frm ne time step is calculated t as ne, little ver new data sets are published daily S, with ne API key it s allwed lad everything nce View service can be used fr testing but can nt be used as a back end fr ppular clients Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 20

21 Sme Experiences At the mment a little ver 5000 registered users And a little ver data dwnlads per day (1,2 req/s) Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 21

22 Sme Experiences There s a gap between prvided data mdel and clients capabilities Practically n client supprts cmplex features Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 22

23 Sme Experiences FMI is ging t pen the same data as simple features t supprt clients GeServer is mdified t supprt stred queries in WFS 2.0 (will be integrated int the standard package) Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 23

24 Sme Experiences Amateur and freelancer cders wuld prefer simple JSON API Industry is happy t use standardized services Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 24

25 Sme Experiences Quite many expected a user interface t lad data t i.e. t Excel instead f machine readable interface S far maybe even mre prfessinal interest than private Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 25

26 Sme Experiences Pint frecasts, bservatins and radar images are the mst interesting data types Fr nw, very few have been interested in frecast mdels as a grid data Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 26

27 Sme Experiences The Open Data prject has been a great bst fr urselves bth technically and fr wrking culture Finally we have all the data behind ne access pint behind standard interfaces and in harmnized frmats Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 27

28