The Community Satellite Processing Package (CSPP) for real- :me data received by direct broadcast from Suomi NPP, POES, Metop, and EOS.

Transcription

1 The Community Satellite Processing Package (CSPP) for real- :me data received by direct broadcast from Suomi NPP, POES, Metop, and EOS. VIIRS Day/Night Band, Hurricane Isaac, 2012/08/29 Liam E. Gumley Space Science and Engineering Center University of Wisconsin- Madison WMO Vlab, April 9, 2014

2 Execu:ve Summary 1. A constella:on of polar orbi:ng satellites provides freely available medium- resolu:on data in visible, near- infrared, thermal, and microwave channels in real Hme. 2. Moderate cost antenna systems can receive the data in L- band or X- band; several hundred are in opera:on worldwide. 3. CSPP is a soxware solu:on for conver:ng raw satellite data to calibrated sensor observa:ons (e.g., reflectances) and geophysical products (e.g., cloud mask).

3 Polar Orbi:ng Satellite Fleet Suomi NPP (JPSS) Terra/Aqua (NASA) NOAA 15/16/18/19 (NOAA) Metop- A, B (EUMETSAT) FY- 3A/B/C (CMA) Meteor- M1 (Roshydromet)

4 Polar Orbit

5 About Suomi NPP Launched into a polar orbit on October 28, Developed by NASA, NOAA, and industry; operated by NOAA. Named axer Verner Suomi: Professor of Meteorology at University of Wisconsin- Madison; Founder of Space Science and Engineering Center.

6 Suomi NPP at Ball Aerospace July 2010

7 Suomi NPP Sensor Suite VIIRS Medium Resolu:on Visible & Infra- red Imager CrIS Fourier Transform Spectrometer for IR Temperature and Moisture sounding ATMS Microwave sounding radiometer OMPS Total Ozone Mapping and Ozone Profile measurements CERES - Earth Radia:on Budget VIIRS CrIS ATMS OMPS CERES

8 Real- Time Applica:ons Numerical Weather Predic:on: Infrared and Microwave Sounder Data Wildfire Detec:on for Disaster Management: Thermal Infrared Imager Data (e.g, GA Sen:nel) Sea Ice Detec:on for Ship Naviga:on: Day/Night Band Imager Data Volcanic Ash Detec:on: Thermal Infrared Imager Timeliness of the Data is Key

9 NWP Forecast Error Reduc:on Infrared and Microwave Sounder data from polar orbi:ng satellites have the largest impact on improving NWP forecast skill Forecast error reduction contribution (%) 17

10 Wildfire Detec:on Sen:nel Hotspot Detec:ons Derived from MODIS Infrared Imagery

11 Sea Ice Mapping for Naviga:on Russia Chukchi Sea VIIRS Day/Night Band as seen by NWS Anchorage Ice Desk

12 Volcanic Ash Alert System MODIS and VIIRS Infrared Imagery are used to Detect Volcanic Ash

13 Receiving Real- Time Data Hardware Required: Tracking antenna with meter reflector LNA, Downconverter, Demodulator 2.4- m X/L- band Antenna NWS Honolulu X- band: SNPP, Terra, Aqua, FY- 3 L- band: POES, Metop, Meteor- M Output product is raw bitstream from demodulator.

14 Worldwide X- band Sites

15 Direct Broadcast SoXware from SSEC InternaHonal ATOVS Processing Package (IAPP) heritage goes back to IAPP supports NOAA InternaHonal MODIS/AIRS Processing Package (IMAPP) has been available since 2000 (funded by NASA). IMAPP supports Terra and Aqua. Community Satellite Processing Package (CSPP) first released in 2012 (funded by JPSS). IMAPP MODIS TPW

16 What is CSPP? CSPP (Community Satellite Processing Package) is a collec:on of soxware systems for processing direct broadcast data from polar orbi:ng meteorological satellites, including: Suomi NPP, POES, Metop, Terra, Aqua. Funded by NOAA via JPSS Project (thanks to Mitch Goldberg). Developed and supported by CIMSS/SSEC, UW- Madison. The first CSPP release occurred on March 14, 2012.

17 Supported Satellites and Sensors CSPP includes support for Suomi NPP and JPSS, POES, Metop, Terra, Aqua, and eventually FY- 3. For Suomi NPP, supported sensors include VIIRS, CrIS, ATMS (SDRs and a subset of EDRs) For POES and Metop, supported sensors include AVHRR, IASI, AMSU- A, MHS (Level 2 products only; Level 1 processing provided by AAPP). For Aqua and Terra, supported sensors include MODIS and AIRS.

18 CSPP SoXware Philosophy CSPP soxware must: Create useful products for the DB community, Include up- to- date algorithms, Be pre- compiled for 64- bit Linux, Be easy to install and operate, Include test data for verifica:on, Have prompt user support, Run efficiently on modest hardware.

19 CSPP Products for Suomi NPP VIIRS, CrIS, and ATMS sensor observa:ons and geoloca:on VIIRS Cloud Mask, Ac:ve Fires, Aerosol Op:cal Thickness, Sea Surface Temperature, NDVI CrIS Temperature and Moisture profiles VIIRS imagery (AWIPS, GeoTIFF, True Color) Distribu:on format is executable code and data (ready to run); source code is available from SSEC. Supported planorm is CentOS 6 (64- bit) for Intel/AMD. All algorithms are based on ADL versions; the same code that runs in NESDIS opera:ons.

20 CSPP value added for Suomi NPP Mul:- core accelera:on is available. Op:onal HDF5 internal compression, Granule aggrega:on, and Mapped Quicklook images. Ancillary data are ingested and processed automa:cally. Compiler flags are selected to provide op:mized execu:on speed. Details of run- :me configura:on (e.g., XML files) are transparent. Command line scripts require the name of the directory containing the input files, and nothing else. Independent algorithms, e.g., CrIS Dual Regression Retrievals.

21 CSPP Users EUMETSAT for EARS- NPP EUMETCast distribu7on UK Met Office Météo- France CSIR South Africa Swedish Met Service DWD German Met Service Australia Bureau of Meteorology Taiwan Central Weather Bureau Belarus Na7onal Academy of Science Indonesia Government Space Agency (LAPAN) German Aerospace Center CONABIO Mexico EURAC Remote Sensing Ins7tute Italy China Na7onal Satellite Meteorological Center Brazil INPE Danish Meteorological Ins7tute Japanese Meteorological Agency Norwegian Meteorological Ins7tute Swedish Met Ins7tute Kazakhstan Space Inves7ga7on Ins7tute UK Plymouth Marine Lab Naval Research Lab Vendors SeaSpace, ScanEx, SpaceTec and others. In addi7on, CSPP DB products are being used in the US NWS in HI, Alaska and CONUS

22 CSPP Quicklook Images CrIS VIIRS ATMS

23 CSPP Product: VIIRS DNB and IR

24 CSPP Product: VIIRS SST

25 CSPP Product: VIIRS True Color

26 CSPP Product: VIIRS Ac:ve Fires 2012/12/10

27 Current CSPP SoXware (2014/03) 1. Suomi NPP CrIS, VIIRS and ATMS SDR (geoloca:on and calibra:on) 2. Suomi NPP VIIRS EDR (cloud mask, ac:ve fires, surface reflectance, NDVI, SST, aerosol op:cal thickness) 3. CrIS, IASI, and AIRS Dual Regression Retrieval 4. VIIRS SDR GeoTIFF and AWIPS Reprojected Imagery 5. Microwave Integrated Retrieval System (MIRS) 6. HYDRA2 Mul:spectral Data Analysis Toolkit 7. Suomi NPP Imagery EDR (projected imagery for AWIPS)

28 CSPP Release History (2014/03) March 21, 2014 (CSPP Suomi NPP Imagery EDR SoXware Versions 1.1) March 20, 2014 (CSPP Microwave Integrated Retrieval System (MIRS) SoXware Version 1.0) March 19, 2014 (CSPP Suomi NPP HYDRA2 Mul:spectral Data Analysis Toolkit Version 1.0) February 14, 2014 (CSPP Suomi NPP VIIRS EDR SoXware Version 1.2.1) December 18, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR SoXware Version 1.5) December 18, 2013 (CSPP Suomi NPP VIIRS EDR SoXware Version 1.2) October 18, 2013 (CSPP VIIRS SDR GeoTIFF and AWIPS Reprojec:on SoXware Version 1.1) September 24, 2013 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval SoXware Version 1.2) July 8, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR SoXware Version 1.4) July 8, 2013 (CSPP Suomi NPP VIIRS EDR SoXware Version 1.1) April 29, 2013 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval SoXware Version 1.1) February 22, 2013 (CSPP VIIRS SDR GeoTIFF and AWIPS Reprojec:on SoXware Version 1.0) February 8, 2013 (CSPP Suomi NPP VIIRS Cloud Mask and Ac:ve Fires EDR SoXware Version 1.0) February 8, 2013 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR SoXware Version 1.3) November 26, 2012 (CSPP CrIS, AIRS and IASI Dual Regression Retrieval SoXware Version 1.0) October 4, 2012 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR SoXware Version 1.2) May 4, 2012 (CSPP CrIS UW Retrieval SoXware Version 1.0) May 2, 2012 (CSPP Suomi NPP CrIS, VIIRS and ATMS SDR SoXware Version 1.1) March 14, 2012 (CSPP Suomi NPP VIIRS and ATMS SDR SoXware Version 1.0)

29 CSPP Website hqp://cimss.ssec.wisc.edu/cspp/

30 CSPP/IMAPP Users Group Held May 21-23, 2013 in Madison, WI, USA. Presenta:ons from NOAA, NASA, Met Office, Meteo France, Landgate, SMHI, EUMETSAT, CONABIO, DWD, GINA, and SSEC. More than 40 aqendees; 29 oral presenta:ons. Next one in 2015? Perhaps in Europe?

31 1. SNPP VIIRS, CrIS, and ATMS SDR Converts RDR files (CCSDS packets) to SDR files (geoloca:on and calibrated radiances and reflectances) Based on opera:onal algorithms and lookup tables (IDPS version Mx7.2) CSPP version added features include mul:- core processing, automated LUT updates, granule aggrega:on, HDF5 compression. Supports CrIS full spectral resolu:on data.

32 2. SNPP VIIRS EDR Creates geophysical products from VIIRS radiances and reflectances. Based on opera:onal algorithms and lookup tables (IDPS version Mx7.2). Products include cloud mask, ac:ve fires, surface reflectance, NDVI, SST, AOT. CSPP version added features include selectable products, mul:- core processing, automated ancillary data download, granule aggrega:on, HDF5 internal compression.

33 CSPP Products from Direct Broadcast VIIRS SDR CrIS SDR ATMS SDR VIIRS Cloud Mask VIIRS NDVI VIIRS AOT

34 3. CrIS/IASI/AIRS Retrievals Computes profiles of atmospheric temperature, moisture, and ozone. Computes cloud top products (height, pressure, emissivity) surface parameters. Common fast regression algorithm for CrIS/IASI/AIRS by Smith/Weisz/Smith. Products are created for every FOV, clear and cloudy.

35 Retrievals from IASI and AIRS 22 May 2011, Joplin Tornado Case Dual- Regression Retrieval Algorithm for Real- Time Processing of Satellite Ultraspectral Radiances William L. Smith et al, 2012, J. Appl. Meteor. Climatol., 51,

36 4. VIIRS SDR Projected Imagery Creates VIIRS imagery on a user- defined grid and projec:on. Reads mul:- granule VIIRS SDRs as input (M- band, I- band, and DNB). Saves images in GeoTIFF and AWIPS formats. Used opera:onally at SSEC and GINA to create products for Na:onal Weather Service Forecast Offices.

37 Low Cloud/ Fog Seen by VIIRS DNB at Night AREA FORECAST DISCUSSION NATIONAL WEATHER SERVICE SAN FRANCISCO BAY AREA 443 AM PDT FRI MAR DISCUSSION...AS OF 4:10 AM PDT FRIDAY...THE DRY TAIL END OF A WEATHER SYSTEM MOVING IN TO THE PACIFIC NORTHWEST IS APPROACHING OUR DISTRICT...AND RESULTING IN ENHANCEMENT OF THE MARINE LAYER AND A RETURN OF THE MARINE STRATUS. LATEST GOES FOG PRODUCT IMAGERY...AND IN RATHER SPECTACULAR DETAIL JUST REC'D SUOMI VIIRS NIGHTTIME HIGH RES VISUAL IMAGE...SHOW COVERAGE ALONG MUCH OF THE COAST FROM PT REYES SOUTH TO THE VICINITY OF THE MONTEREY PENINSULA...AND A BROAD SWATH EXTENDING INLAND ACROSS SAN FRANCISCO AND THROUGH THE GOLDEN GATE TO THE EAST BAY. LATEST BODEGA BAY AND FT ORD PROFILER DATA INDICATE A MARINE LAYER DEPTH OF ABOUT 1300 FT. SOME THIN HIGH CLOUDS ARE ALSO PASSING THROUGH ABOVE.

38 5. Microwave Integrated Retrieval System Retrieves atmospheric profile and surface parameters from ATMS, AMSU- A, and MHS sensor SDR and Level 1B data. Development is led by Sid Boukabara at the NOAA NESDIS Center for Satellite Applica:ons and Research (STAR). Supports ATMS SDR from CSPP or CLASS, and Metop/NOAA AMSU- A and MHS from AAPP v7.

39 MIRS Product List Official Validated Products: Temperature profile over open water ocean Humidity profile over open water ocean Humidity Profile over non- coastal Land Total Precipitable Water (TPW) over open water ocean Total Precipitable Water over non- coastal land Land surface temperature Surface Emissivity over land and snow Surface Type Classifica:on Snow Water Equivalent (SWE) Sea Ice Concentra:on (SIC) Snow Cover Extent (SCE) Ver:cally- Integrated Non- precipita:ng Cloud Liquid Water (CLW) over open water ocean Ver:cally- Integrated Graupel Water Path (IWP) Ver:cally- Integrated Rain Water Path (RWP) Rainfall Rate (RR) over open water ocean and non- coastal, non- snow- covered land surface types Experimental Products (not fully validated): Cloud Liquid Water Profile (CLWP) over ocean Surface Temperature (skin) extended to snow- covered land surface type Surface Temperature (skin) extended to open ocean water Effec:ve grain size of snow (over snow- covered land surface) Mul:- Year (MY) Type Sea Ice Concentra:on First- Year (FY) Type Sea Ice Concentra:on

40 MIRS Products from ATMS DB Surface Temperature with Rain Mass Profile Total Precipitable Water with contours of Cloud Liquid Water SNPP/ATMS :19Z

41 6. Hydra2 Mul:spectral Data Toolkit Allows interac:ve display of Level 1B and Level 2 products from mul:spectral imagers (VIIRS, MODIS), high spectral resolu:on sounders (CrIS, IASI, AIRS), and microwave sounders (ATMS, AMSU). Designed to be easy to learn and use, especially for students. Supported on Windows, OS X, and Linux.

42 Hydra2 Screenshots Hydra 2 display of collocated VIIRS and ATMS Hydra 2 display of CrIS

43 7. VIIRS Imagery EDR Creates projected VIIRS image data on a Ground Track Mercator grid. Product can be directly ingested into NWS AWIPS2. Supports I- band resolu:on (375 meters). Provides VIIRS Near Constant Contrast (NCC) product for Day/Night Band.

44 VIIRS Imagery EDR: Band I- 1

45 VIIRS Imagery EDR: Band I- 3

46 Coming Soon #1: CLAVR- X Computes cloud parameters (cloud top height, pressure, phase, ) and surface parameters from mul:spectral imager data. Development led by Andy Heidinger. Supports VIIRS, MODIS, and AVHRR. VIIRS SDRs from CSPP or IDPS/CLASS MODIS Level 1B from SeaDAS or MODAPS AVHRR Level 1B from AAPP v7 NOAA plans to make CLAVR- X the opera:onal cloud algorithm for SNPP and JPSS.

47 CLAVR- X products from VIIRS DB VIIRS SVM07 Cloud Mask Cloud Phase Cloud Top Pressure

48 CLAVR- X AVHRR Cloud Top Temperature NOAA- 19, 2013/07/25

49 Coming Soon #2: NUCAPS Creates profiles of temperature, moisture, ozone, and other trace gases; cloud and surface products; and other products all from cloud cleared radiances. Development led by Chris Barnet. Also supports IASI/AMSU/MHS and AIRS/AMSU. NOAA plans to make NUCAPS the opera:onal sounding algorithm for SNPP and JPSS.

50 Coming Soon #3: CSPP GEO NOAA GOES- R Project is funding the development of a DB package for GEO satellites. Will create cloud and surface products from DB data (e.g., GRB from GOES- R). Supported satellites/sensors will include GOES- R ABI, GOES- N Imager, and Himawari- 8. Algorithms will be based on GOES- R versions; implemented in GEOCAT.

51 Coming Soon #4: Flood Detec:on JPSS is funding the transi:on of the GMU Flood Detec:on algorithm to CSPP. The algorithm uses reflected solar spectral tests to infer the presence of non- normal standing water (day:me only). Both VIIRS and MODIS products are supported.

52 52

53 Flood Detec:on: Amur River Google Earth Base Imagery 53

54 MODIS False Color 2013/09/08 54

55 Flood Detec:on Mask 2013/09/08 55

56 SNPP VIIRS True Color Imagery in KML

57 Credits CSPP team at UW/SSEC/CIMSS. Algorithm Developers. JPSS Project. DB User Community!