SPIRE FTS Pipelines and Data Products Trevor Fulton

Transcription

1 SPIRE FTS Pipelines and Data Products Trevor Fulton Blue Sky Spectroscopy Lethbridge, Alberta, Canada

2 SPIRE FTS Pipelines and Data Products Data Products Observation Context Levels 0-2 Data Processing Steps Modify Timelines Create Interferograms Modify Interferograms Create Spectra Modify Spectra Point Source Conversion/Spectral Cube Creation For more info see: SPIRE Data Reduction Guide SPIRE Spectrometer Pipeline Description Document SPIRE FTS Pipelines and Data Products Trevor Fulton 2

3 What to expect when running the pipeline on SPIRE Spectrometer data... When you get the data, you download to a "pool" on your local machine containing one "Observation Context" per observation The Observation Context contains all the data that you need: Auxiliary (pointing) data Calibration data Level 0 (raw) data Level 0.5 (engineering) data Level 1 and Level 2 data Standard pipeline products, ready to analyze! SPIRE FTS Pipelines and Data Products Trevor Fulton 3

4 Pools and Storage The storage location on the local disk Each pool contains a collection of contexts and products contained inside the "Observation Context" the Onion SPIRE FTS Pipelines and Data Products Trevor Fulton 4

5 Common Engineering Conversion ADU Volts SPIRE FTS Pipelines and Data Products NHSC February 2011 Reminder: Data Product Levels Level 0 products Raw instrument timelines in ADU Modify Timelines Create Interferogram Level 0.5 products Converted timelines in engineering units Modify Interferogram Fourier Transform Modify Spectra Volts Jy Level 1 products The interferogram in units of Volts vs. Optical Path Difference for each detector in each band Average and Point source conversion W/m 2 /Hz/sr Jy Spectral Mapping Level 2 products The spectrum in units of Jy vs Wavenumber for the central pair of detectors Regularly gridded spectral cube with axes longitude, latitude and Wavenumber and flux unit W/m 2 /Hz/sr The spectrum in units of W/m 2 /Hz/sr vs. Wavenumber for each detector in each band SPIRE FTS Pipelines and Data Products Trevor Fulton 5

6 Reminder of Observing Modes Pointing Single Raster Move telescope Spatial Resolution Spectral Resolution Sparse Intermediate Full Low Medium High Move BSM (1, 4 or 16 positions) Scan the mechanism different distances Mechanism Scan Repetitions = number of scan pairs (forward+reverse) Minimum of 2 pairs SPIRE FTS Pipelines and Data Products Trevor Fulton 6

7 SMEC Position SPIRE FTS Pipelines and Data Products NHSC February 2011 SPIRE FTS Observations Observations are divided into Building Blocks: Init Calib. Move BSM FTS scans Move BSM FTS scans End Initialisation of instrument Calibrator flashes to track detector responsivity Mechanism scanned Reconfigure instrument, SMEC back to HOME etc. Time SPIRE FTS Pipelines and Data Products Trevor Fulton 7

8 Level 0.5 Data: Building Blocks Init Calib. Move BSM FTS scans Move BSM FTS scans End Initialisation of instrument Calibrator flashes to track detector responsivity Mechanism scanned Reconfigure instrument, SMEC back to HOME etc. Each basic instrument operation is contained in a separate building block The Level 0.5 data that you get are also divided per building block. SPIRE FTS Pipelines and Data Products Trevor Fulton 8

9 Engineering Conversion & Bolometer Processing FTS Pipeline Steps Apply these steps to All Building Blocks Modify Timelines x(t) n(t) P(t) Create Interferograms V(x) Modify Interferograms V(x) Transform Interferograms V(σ) Modify Spectra I(σ) Create Level-2 Products Repeat the steps in this section for each FTS Scan Building Block Merge the results from the FTS Scan Building Blocks SPIRE FTS Pipelines and Data Products Trevor Fulton 9

10 Engineering Conversion & Bolometer Processing Modify Timelines FTS Pipeline Outputs Level 0.5 Products Create Interferograms Modify Interferograms Level 1 Interferogram Products Transform Interferograms Modify Spectra Create Level-2 Product Level 1 Spectral Products Level 2 Product SPIRE FTS Pipelines and Data Products Trevor Fulton 10

11 Your Level 0.5 Data The data you get reflect the observation structure: Observation Context Level-0.5 Context Building Block Context Detector timeline: SDT (~80 Hz) Housekeeping timeline: NHKT (1 Hz) SMEC position timeline: SMECT (~240 Hz) Building Block Context Converted timelines, grouped per Building Block Detector data timeline: SDT (~80 Hz) Housekeeping timeline: NHKT (1 Hz) SMEC position timeline: SMECT (~240 Hz) SPIRE FTS Pipelines and Data Products Trevor Fulton 11

12 Modify Timelines Level 0.5 Timelines First Level Deglitching Non-linearity Correction Bath Temperature Correction Clipping Correction Time-domain Phase Correction Modified Level 0.5 Timelines The steps in this section of the pipeline are best applied to the measured detector signals in the time domain SPIRE FTS Pipelines and Data Products Trevor Fulton 12

13 Modify Timelines Level 0.5 Timelines First Level Deglitching Non-linearity Correction Bath Temperature Correction Clipping Correction Time-domain Phase Correction Modified Level 0.5 Timelines The steps in this section of the pipeline are best applied to the measured detector signals in the time domain SPIRE FTS Pipelines and Data Products Trevor Fulton 13

14 Clipping Correction Level 0.5 Timelines First Level Deglitching Non-linearity Correction Bath Temperature Correction Clipping Correction Time-domain Phase Correction Modified Level 0.5 Timelines K-factors Conversion Factors Time Constants SPIRE FTS Pipelines and Data Products Trevor Fulton 14

15 Clipping Correction Level 0.5 Timelines First Level Deglitching Crosstalk Matrix Non-linearity Correction Bath Temperature Correction Clipping Correction Time-domain Phase Correction Modified Level 0.5 Timelines K-factors Conversion Factors Time Constants SPIRE FTS Pipelines and Data Products Trevor Fulton 15

16 Clipping Correction Level 0.5 Timelines First Level Deglitching Crosstalk Matrix Non-linearity Correction Bath Temperature Correction Clipping Correction Time-domain Phase Correction Modified Level 0.5 Timelines K-factors Conversion Factors Time Constants SPIRE FTS Pipelines and Data Products Trevor Fulton 16

17 Level 0.5 Timelines SPIRE FTS Pipelines and Data Products NHSC February 2011 Create Interferograms SMEC Positions x(t') Pointing P(t'') Create Interferograms Level 1 Interferograms V(x) Once time domain processing is complete, the detector signals and SMEC positions can be merged to create interferograms. SPIRE FTS Pipelines and Data Products Trevor Fulton 17

18 Level 0.5 Timelines SPIRE FTS Pipelines and Data Products NHSC February 2011 Create Interferograms -- Calibration Files SMEC Positions x(t') Pointing P(t'') Create Interferograms Zpd(channel) Obliquity(channel) Level 1 Interferograms V(x) V( x) V ( x) V ( x) V ( x) Source Telescope Instrument SPIRE FTS Pipelines and Data Products Trevor Fulton 18

19 Level 0.5 Timelines SPIRE FTS Pipelines and Data Products NHSC February 2011 Create Interferograms -- Calibration Files SMEC Positions x(t') Pointing P(t'') Create Interferograms Zpd(channel) Obliquity(channel) Level 1 Interferograms V(x) V( x) V ( x) V ( x) V ( x) Source Telescope Instrument SPIRE FTS Pipelines and Data Products Trevor Fulton 19

20 Modify Interferograms Level 1 Interferograms V(x) Baseline Correction V(x) 2nd Level Deglitching V(x) Phase Correction V(x) Interferogram Products The steps in this section of the pipeline take advantage of the positional redundancy of the interferograms from each mechanism scan. SPIRE FTS Pipelines and Data Products Trevor Fulton 20

21 Modify Interferograms Calibration Files Level 1 Interferograms V(x) Baseline Correction V(x) 2nd Level Deglitching V(x) Phase Correction V(x) Non-linear Phase Interferogram Products SPIRE FTS Pipelines and Data Products Trevor Fulton 21

22 Deglitching Level 1 Interferograms V(x) Baseline Correction V(x) 2nd Level Deglitching V(x) Phase Correction V(x) Non-linear Phase Interferogram Products SPIRE FTS Pipelines and Data Products Trevor Fulton 22

23 Deglitching Level 1 Interferograms V(x) Baseline Correction V(x) 2nd Level Deglitching V(x) Phase Correction V(x) Non-linear Phase Interferogram Products SPIRE FTS Pipelines and Data Products Trevor Fulton 23

24 Transform Interferograms Modified Interferograms V(x) Fourier Transform Apply the Fourier Transform to each interferogram to create a set of spectra for each spectrometer detector. V Spectra V(σ) Measured V Source V Telescope V Instrument SPIRE FTS Pipelines and Data Products Trevor Fulton 24

25 Modify Spectra Spectra Instrument Correction Telescope Correction The steps in this section of the pipeline are best applied in the spectral domain. Flux Conversion Level 1 Spectrum Products SPIRE FTS Pipelines and Data Products Trevor Fulton 25

26 Instrument Correction Spectra Instrument Correction Inst. RSRF Telescope Correction Telescope RSRF Flux Conversion Level 1 Spectrum Products SPIRE FTS Pipelines and Data Products Trevor Fulton 26

27 Instrument Correction Spectra Instrument Correction Inst. RSRF Telescope Correction Telescope RSRF Flux Conversion Level 1 Spectrum Products V Measured V Source V Telescope V Instrument SPIRE FTS Pipelines and Data Products Trevor Fulton 27

28 Instrument Correction Spectra V Correction mostly affect longest wavelengths. Diff V Instrument Correction V Telescope Correction Source Telescope Inst. RSRF Telescope RSRF Flux Conversion Level 1 Spectrum Products V Measured V Source V Telescope V Instrument SPIRE FTS Pipelines and Data Products Trevor Fulton 28

29 Telescope Correction Spectra Instrument Correction Telescope Model Telescope Correction Telescope RSRF Flux Conversion Level 1 Spectrum Products SPIRE FTS Pipelines and Data Products Trevor Fulton 29

30 Telescope Correction V Measured V Spectra Source V Telescope Instrument Correction Telescope Model Telescope Correction Telescope RSRF Flux Conversion V Level 1 Spectrum Products Telescope B (T, ) RSRF Telescope Telescope Telescope SPIRE FTS Pipelines and Data Products Trevor Fulton 30

31 Telescope Correction Spectra V Source (σ) Instrument Correction Telescope Model Telescope Correction Telescope RSRF Flux Conversion Level 1 Spectrum Products V Diff V Source I Source RSRF f SPIRE FTS Pipelines and Data Products Trevor Fulton 31

32 Modify Spectra Spectra Instrument Correction Telescope Correction Flux Conversion Extended RSRF Level 1 Spectrum Products This is actually the same as the Telescope RSRF. SPIRE FTS Pipelines and Data Products Trevor Fulton 32

33 Level 1 SLW Spectra: autoscale I Source Extended V Measured RSRF Extended SPIRE FTS Pipelines and Data Products Trevor Fulton 33

34 Level 1 SSW Spectra: autoscale I Source Extended V Measured RSRF Extended SPIRE FTS Pipelines and Data Products Trevor Fulton 34

35 Level 1 SLW Spectra: scale to central I Source Extended V Measured RSRF Extended SPIRE FTS Pipelines and Data Products Trevor Fulton 35

36 Level 1 SSW Spectra: scale to central I I Source Extended Measured ( V) I RSRF Measured Source Extended Extended SPIRE FTS Pipelines and Data Products Trevor Fulton 36

37 Create Level 2 Products Sparse, Single pointing Mode Level 1 Spectra I(σ) All Other Modes Average and Point Source Conversion Spectra for Central Detectors I(σ) Spectral Cube Creation Spectral Cubes I(σ) SPIRE FTS Pipelines and Data Products Trevor Fulton 37

38 Sparse, Single Pointing Mode I VMeasured( ) RSRF Source Point Point SPIRE FTS Pipelines and Data Products Trevor Fulton 38

39 Sparse, Single Pointing Mode Point-source Flux Converted Spectrum

40 Mapping Modes Level 1 Spectra I(σ) Naïve Projection (same as Photometer) Spectral Cubes I(σ) Mapping modes include Raster, Intermediate and Full Spatial Sampling, and combinations thereof SPIRE FTS Pipelines and Data Products Trevor Fulton 40

41 NGC7023 2x2 Raster, Intermediate Spatial Sampling Medium Spectral Resolution 41

42 42

43 43

44 44

45 45

46 46

47 47

48 48

49 49

50 50

51 51

52 52

53 53

54 54

55 55

56 56

57 Mapping Modes Extended-source Flux Converted Spectra. Equidistant sampling in all three dimensions (2 spatial, 1 spectral)