Open Meterlgical Data with OGC and INSPIRE INSPIRE 2014 Aalbrg Finnish Meterlgical Institute Rpe Terv, Mikk Visa, Mikk Rauhala, Tarja Riihisaari
FMI Open Data Finnish Meterlgical Institute pened its data in 2013. Basically everything FMI wns was pened. Data is prvided in freely in machine readable frmat. https://en.ilmatieteenlaits.fi/pen-data 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 2
FMI Open Data Prtal FMI Open Data Prtal fllws INSPIRE requirements. Meta data Services Data Mdels The very same data prtal wrks as Open Data and INSPIRE prtal. 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 3
Example f Data Sets Data set Descriptin Time Interval Weather Observatins Sun Radiatin Marine Observatins Weather Radars Lightning Temperature, Wind, Humidity, Grund Temperature UV, Shrt and Lng Term Radiatin Waves, Sea Temperature, Sea Level Estimated publish date 10 min Open, lder data t be added 1 min Open 1 h Open Precipitatin Rate, 5 min Open, Precipitatin Amunt lder data t be added Thunder Strikes in Finland 5 min Open 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 4
Example f Data Sets Data set Descriptin Time Interval Estimated publish date Real Time Observatins Climatlgical Observatins Climatlgical Observatins Climatlgical Reference Real Time Observatins frm specific lcatin(s) Dayly and mnthly temperature mean and extreme values frm weather statins Mnthly temperature and precipitatin rate mean values interplated t grid Climatlgical Reference. Temperature, humidity, pressure, precipitatin amunt and snw depth. AWS 2010 Sundings 1959 Flashes 1998 Sea Level 1971 Waves 2005 1959 - Open 1961 - Open Reference seasns: 1971-2000 1981-2010 Open lder data will be added Open 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 5
Example f Data Sets Data set Descriptin Time Interval Estimated publish date Weather frecast mdel HIRLAM RCR Sea frecast mdels Envirnmental Mnitring Facilities Aviatin Observatins Grund & mast bservatins Pint frecasts and grid data Sea level pint frecasts, Wave (WAM) and current (HBM) as grid data Weather bservatin statins, radars Latest mdel run (4 times a day) 0 54 h Latest mdel run (4 times a day) 0...54 h Open Open 2014 METAR 30 min 2014 Special bservatins frm grund and masts 2014 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 6
Example f Data Sets Data set Descriptin Time Interval Estimated publish date Air Quality Observatins Silam Mdel Air Quality Observatins 1h 2015-2016 Dispersin Mdel fr Air Quality, Frest Fire and Pllen Latest mdel run (nce a day) 0 96h HELMI Ice Mdel Ice frecast mdel Latest mdel run (4 times a day) 0...54 h 2014-2015 2014 Sundings Temperature, Humidity, Pressure, Wind frm grund t 25 km height 2 times a day 2014 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 7
View Service (WMS) Based n GeServer Only the mst cmmn layers published Catalg Service (CSW) Based n GeNetwrk 23.6.2014 8 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv
Dwnlad Service (WFS 2.0) Web Feature Service (WFS) 2.0 Simple Prfile Based n stred queries Predefined data sets with pssibility fr additinal parameters (i.e. time and area) In-huse prductin 23.6.2014 9 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv
Data Mdels Observatins and pint frecasts as GML The same data is published in tw different frmats. Gridded data is prvided in apprpriate binary frmat (grib, NetCDF, HDF ) WFS members cntains the metadata envelpe with a link t a actual data 23.6.2014 10 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv
Data Mdels gmlcv:multipintcverage gml:rangeset gml:dubleornilreasntuplelist gml:dmainset gmlcv:simplemultipint The cverage is defined as a list f pints in 4 dimensinal grid (lat, ln, height, time). The data is listed fr every pint defined in dmain set. gmlcv:rangetype The parameters listed in range set are defined in separate element. 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 11
Data Mdels gmlcv:multipintcverage Prs + Cmpact + Efficient + Small file size + Wrks fr many data types Cns - Nt intuitive - N natural structure f XML XSLT and Xpath dn t wrk 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 12
Data Mdels wml2:measurementtimeseries wml2:measurementtimeseries One member cntains time series frm ne parameter and ne lcatin 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 13
Data Mdels wml2:measurementtime series Prs + Intuitive + Easy t use + XSLT & XPath wrks Cns - Lts f repetitin - Large file size - Heavy fr DOMbased parsers - Dn t wrk i.e. fr thunder strikes 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 14
Data Mdels File size Cmparisn 90 80 70 60 50 40 30 20 10 0 81.7 52.9 Dcument Size [MB] Cmpressed DcumentSize [MB] 1.3 1.2 1.8 0.2 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 15
Data Mdels Ppularity Cmparisn 90 80 70 60 50 40 30 20 10 0 80 19.8 Dwnlads[%] 0.2 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 16
Data Mdels Ppularity Cmparisn 60 54 50 40 30 37 Dwnlads[%] 20 10 9 0 Frecast Weather Observatins Radar Images Based n ne mnth data (04/2014) All data sets cmbined Nte that sme data is updated mre ften than thers 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 17
MetLib Open surce JavaScript library prduced by Finnish Meterlgical Institute Helps users t lad and use the data Easy requests Cache Parse the data t as JSON Supprts multi pint cverage data frmat Pythn versin is n the list 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 18
Registratin Registratin is required t use View and Dwnlad Services Wrking email address is the nly mandatry infrmatin After registratin the user gets an API key which have t be added int all requests POST field fmi-apikey= GET parameter fmi-apikey= & Header fmi-apikey; Part f url http://wms.fmi.fi/fmi-apikey/ /wms? One can create several API keys with ne email 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 19
Usage Limits With ne API key it s allwed t d at mst 20 000 requests per day t Dwnlad Service d at mst 10 000 requests per day t View Service d at mst 600 requests per 5 minutes t bth services If all bservatins frm ne time step is calculated t as ne, little ver 17 000 new data sets are published daily S, with ne API key it s allwed lad everything nce View service can be used fr testing but can nt be used as a back end fr ppular clients 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 20
Sme Experiences At the mment a little ver 5000 registered users And a little ver 100 000 data dwnlads per day (1,2 req/s) 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 21
Sme Experiences There s a gap between prvided data mdel and clients capabilities Practically n client supprts cmplex features 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 22
Sme Experiences FMI is ging t pen the same data as simple features t supprt clients GeServer is mdified t supprt stred queries in WFS 2.0 (will be integrated int the standard package) 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 23
Sme Experiences Amateur and freelancer cders wuld prefer simple JSON API Industry is happy t use standardized services 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 24
Sme Experiences Quite many expected a user interface t lad data t i.e. t Excel instead f machine readable interface S far maybe even mre prfessinal interest than private 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 25
Sme Experiences Pint frecasts, bservatins and radar images are the mst interesting data types Fr nw, very few have been interested in frecast mdels as a grid data 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 26
Sme Experiences The Open Data prject has been a great bst fr urselves bth technically and fr wrking culture Finally we have all the data behind ne access pint behind standard interfaces and in harmnized frmats 23.6.2014 Open Meterlgical Data with OGC and INSPIRE / Rpe Terv 27
www.fmi.fi