Rescue, management, and evaluation of marine climate data

Transcription

1 Rescue, management, and evaluation of marine climate data Scott Woodruff 1 and Catherine Marzin 2 1) NOAA Earth System Research Laboratory, USA and Chair, JCOMM Expert Team on Marine Climatology 2) NOAA Office of the National Marine Sanctuaries, USA International Workshop on Climate and Oceanic Fisheries Rarotonga,, Cook Islands, October 2011

2 Topics In situ marine climate data: Modern JCOMM marine meteorological observing system August 2011 (1) Rescue (2) Management (3) Evaluation RECLAIM

3 Evolution of the Marine Climate Data System By platform mixture TOTAL By variable

4 Marine Climate Data near Rarotonga Grey=ships, dark blue=moored buoys, green=drifting buoys, light blue=oceanographic February 1980 February 2000

5 Overview: International Comprehensive Ocean Atmosphere Data Set Domain specific archive for marine met. data like World Ocean Database (WOD) for subsurface OHCA curves (Lyman et al. 2010) Release 2.5 (R2.5) spanning Major delayed mode update completed 2009 Plus Preliminary near real time updates Data, metadata, and product access: Woodruff, S.D., S.J. Worley, S.J. Lubker, Z. Ji, J.E. Freeman, D.I. Berry, P. Brohan, E.C. Kent, R.W. Reynolds, S.R. Smith, and C. Wilkinson, 2011: ICOADS Release 2.5: Extensions and Enhancements to the Surface Marine Meteorological Archive. Int. J. Climatol., 31,

6 IMMA: A Robust and Extensible Observational Data Format core icoads immt meta model suppl... Key requirement: attm of original data forms: experience demonstrates format translations frequently contain errors or omissions Advantage: exact copy of original permits re translation and cross checks at any time

7 Historical data mixture: dominated by national ship data collections Thompson et al. (2008) Nature, described a discontinuity in global mean surface temperature associated with abrupt WW2 data mixture changes US Maury Collection ( ); original microfilm records also utilized by Tim Smith et al. for whaling information

8 Recent marine platform mixture Voluntary Observing Ships (VOS) Drifting and moored buoys, and other marine platform types Plus VOS metadata (with help from UK NOCS) WMO Pub. 47 VOS metadata The official Release 2.5 period ( ) is now extended monthly with preliminary real time data and products based on GTS data problematic

9 Examples of data obtained from fishing vessels: deck (source) numbers; numbers of marine reports 187 Japanese Whaling (punched cards obtained from JMA c. 1960s): ; 10K 761 Japanese Whaling forms (obtained in 1997 via M.I.T).: ; 20K 188 Norwegian Antarctic Whaling Factory Ships: ; 2K 667 Inter American Tropical Tuna Commission: ; 1.1M Semi independent observations by fishermen + NOAA/NMFS observers 899 South African Whaling: ; 64K These digital sources only incl. marine met. data; no biological/catch data

10 Data Rescue: Status and Plans Major (past) contributions from NOAA/CDMP RECovery of Logbooks And A International Marine Data (RECLAIM) Project Atmospheric Circulation Reconstructions over the Earth (ACRE) Green =digitized Yellow =partially Red =undigitized Note: all require translation Arctic Drift Stations: Extended WWI UK Royal Navy (RN) Ship's Logs: US Lightship Collections: US Fish Commission Fisheries vessel survey logs: c Greenwich Mean Noon (GMN)/Simultaneous Obs.: c Arctic Norwegian Logbook Data: ; 125K Finnish Lightvessel Data: , ; 250K Swedish Lightvessel Data: , ; 198K DWD Historical Archive: ; ~11.2M German Maury Collection: ; 544K KNMI Extract Journals: ; 650K (daily) UK Hull Merchant/Whaling Logbooks: English East India Co.: ; ~273K Printed Met. Data digit. by ACRE: ~ RECLAIM R2.5 R2.4

11 Data Rescue Steps and Best Practices RECLAIM All these steps are important, but Crowdsourcing is a new more affordable (b) option IMMA translation (c) has generally been under resourced but serves as a critical foundation for applications Concurrent processing ( pipelining ) through steps (a) (c) can facilitate data evaluation and access (a) Imaging (b) Digitizing (keying) (c) IMMA translation Wilkinson, C., S.D. Woodruff, P. Brohan, S. Claesson, E. Freeman, F. Koek, S.J. Lubker, C. Marzin, and D. Wheeler, 2011: RECovery of Logbooks And International Marine Data: The RECLAIM Project. Int. J. Climatol., 31,

12 UK Royal Navy WW1 Era Ship s Logs (imaged, under digitization and translation) Via Crowdsourcing ( Citizen Science ) 669K pages and 171 ships already been digitized: ~88% of collection Short video at end of presentation if time permits courtesy of UK National Maritime Museum

13 US Fish Commission Scientific Survey Logbooks (imaged,, proposed to be digitized) Date Position Atmospheric and Oceanographic Data Depth Nature of Bottom Air Temperatur e Sea Surface Temperatur e Bottom Temperatur e Salinity Barometer Cloud Cover Wind Obtained; Sea Urchins, 1. Starfish, Rock Crabs, Hermit Crabs, and shells. A few skates and flounders a number of Pectens (scallops) Dredging Instrument Ecological Data Species Richness

14 US Fish Commission, predecessor to NOAA/NMFS, was created in 1872 to understand why fish populations were declining Expeditions of the RV Albatross Alaska Salmon Investigation Jun. to Aug Biological Survey of San Francisco Jan. to Apr California Coast Expedition Mar. Sep Eastern Pacific Expedition Oct to Feb Hawaiian Explorations Mar. to Aug Lower California Cruise Mar to Apr Northwestern Pacific Expedition Jun. to Oct Philippines Expedition Oct to Jan o Other

15 German Maury Collection: ; 544K Spatial/temporal QC is requiring large resources, but will ultimately augment global C19th spatial coverage (digitized, under QC and translation)

16 English East India Co. Logs ~ (imaged and digitized, under translation) Originals held at British Library imaged for preservation, and to broaden access Logbooks (1.1K) selected to capture early daily instrumental weather data The Indiaman Thomas Coutts by James Miller Huggins, c By courtesy of National Maritime Museum, London

17 Potential new Best Practices for Marine Climate Data Management Appropriate stewardship and archival of data and metadata: both original and derived records Seeking data continuity (as feasible) in the observing system, in the processing of observations, and in the generation of products Ensuring convenient, free, and unrestricted availability of observations and products for research Ref. GCOS Climate Monitoring Principle 4: The quality and homogeneity of data should be regularly assessed as a part of routine operations

18 ICOADS Value Added Database Project aim: Address our current inability to trace value added improvements back to individual ICOADS observations through: establishment of DBMS to support development of value added records and facilitate user access; implementation of supporting modifications to IMMA format scientifically demonstrate the impact of value added records on air sea flux estimates & common climate indicators Limited funding for FY obtained from NOAA Climate Program Office NOAA (ESRL and NCDC), FSU/COAPS, and NCAR

19 Release Plans Data ingest cutoff: ~April 2012 Available historical inputs in IMMA format A variety of data corrections Will incorporate near surface data from the updated WOD09 IMMA format improvements in conjunction with IVAD Other proposed new attachments: Physical Oceanography (Ocn) near surface only, w/ SSS Automated high resolution instrumentation (Auto) Reanalysis feedbacks to be developed later w/ reanalysis projects Platform tracking (Track)

20 MARCDAT III Third International Workshop on Advances in the Use of Historical Marine Climate Data (MARCDAT III), 2 6 May 2011, Frascati, Italy Aim: to showcase and build recent advances in marine climatology: Evaluation, utilization and improvement of the over 300 year record of ICOADS (e.g. using satellite data) Development of multi decadal, homogeneous gridded datasets Characterization of uncertainty and bias in marine obs. and products Global mean sea level (IPCC, 2007) HadISST, April 2010 (Rayner et al. 2003)

21 International Data Management Issues JCOMM Marine Climate Data System (MCDS) Workshop 28 November 2 December 2011, Hamburg Germany

22 Conclusions (i) Historical records do not necessarily have a clean disciplinary fit (e.g. ecology, meteorology, oceanography) Most cost effective (if possible) to mine records for their full environmental potential How to quantify data rescue benefits (e.g. reanalyses, sea surface temperature, ecology) remains a challenge Assessing the impact of climatic change on natural resources need to begin making the historical linkages Operationally, can WMO (and JCOMM) enhance interdisciplinary observations and data management? E.g. encourage met/ocean obs from fishing fleets?

23 Conclusions (ii) Regular MARCDAT/CLIMAR workshops (~every 2 yr) Data focus; help drive progress & develop shared ownership Overall CLIMAR initiative Recommending a 10 year action plan for improved integration and accessibility of climatological observations Involvement with satellite projects and new surface temperature (land) initiative offers an important new avenue for closer linkages between communities E.g. interoperable tracking of data provenance (UID)

24 Thank You noaa.gov Joe Hoyt/NOAA, Thunder Bay NMS