THE US NATIONAL VIRTUAL OBSERVATORY Mining multi-wavelength data in large area surveys with VO tools Yogesh Wadadekar STScI This work is partly supported by a NVO Research Initiative award. Collaborator: Stefano Casertano 1 Characterizing the Gigahertz radio sky Recent wide area radio surveys contain hundreds of thousands of sources whose physical nature is poorly understood. eg. The VLA B- array FIRST survey (Becker et al. 1995) covers >8000 sq. degrees of sky to a 5 sigma flux limit of 1 mjy at 1.4 GHz. The source catalog contains > 800000 sources Area of sky covered by the VLA FIRST survey in galactic coordinates. The sky coverage was chosen to coincide with the Sloan Digital Sky survey coverage. NVO Coverage Maps service 2 1
Optical counterparts of FIRST survey radio sources 30% that are identified optically, of these a majority are starburst systems at z ~ 0.2 and the rest are mostly AGN at z ~ 0.5-1.0 (Ivezic et al. 2002) ~70% of VLA B-array FIRST survey radio sources have no detectable optical counterparts in Sloan Survey imaging. Could the missing sources be: obscured AGN/starbursts? high redshift radio loud QSO's? or resolved components of extended radio sources. 3 Mid IR counterparts of FIRST sources mid-ir observations are less susceptible to dust absorption and immune to the Lyman break dropout phenomenon to very high redshifts. The FIRST survey has ~100 sources per square degree. So, a large area and reasonably deep IR survey is essential to identify a statistically significant sample of radio sources. 4 2
Spitzer SWIRE Legacy Project Observations obtained in the ELAIS N2 region and the Lockman Hole as part of the Spitzer SWIRE survey (Lonsdale et al. 2003) provide an ideal dataset for our purposes. Reduced imaging data and bandmerged catalogs are available for 3.6, 4.5, 5.8 and 8.0 microns (IRAC) and 24 microns (MIPS) channels. The two fields also fall entirely within the FIRST and SDSS footprints. The 3.5/4.5 micron observations reach 5 sigma limits of <10 micro Jansky. The 5.8/8.0 channels reach about 40 micro Jansky. 5 Cross matching procedure Identify all FIRST radio sources that lie in intersection area of the three datasets the master radio sample. Match FIRST radio source to the SDSS using OpenSkyQuery DEMO Match the master sample separately to the SWIRE catalog locally. This matching can also be done by building an Openskyquery skynode. Build a database to store outputs from the FIRST-SWIRE and FIRST-SDSS matches. Obtain ancillary imaging data: cutouts for SWIRE, FIRST and SDSS NVO SIAP Services available. DEMO Analyse the results! 6 3
OpenSkyQuery: NVO catalog query service Complex SQL queries supported Most common large catalogs from X-Ray through radio included easy to use SQL query builder available. 7 Script to download cutouts from the SDSS - SIAP service import sys,os, MySQLdb # Establish connection to the server, handle exceptions gracefully try: conn = MySQLdb.connect (host = "localhost", user = username" passwd = "", db = "swire") except MySQLdb.Error, e: print "Error %d: %s" % (e.args[0], e.args[1]) sys.exit (1) cursor = conn.cursor() # cursor object for processing queries # firsten2 is a table with your master FIRST sample cursor.execute("select distinct radeg,decdeg FROM firsten2") rows = cursor.fetchall () 8 4
Python cutout script for row in rows: # download image from SDSS HTTP GET based service os.system('wget "http://casjobs.sdss.org/imgcutoutdr4/getjpeg.aspx?ra='+str(ro w[0])+'&dec='+str(row[1])+'&scale=0.2&width=150&height=150& opt=pst"'+' -O '+str(row[0])+'_'+str(row[1])+'.jpg') cursor.close() # Close cursor handle conn.close() # Close connection to server print 'Query over' 9 SDSS image cutouts 10 5
Limitations: hardware and software Cannot upload multiple user tables limitation on size of user tables 5000 row limit on returned results Parallel implementation for full catalog to catalog matches is being worked upon * No SDSS FITS cutout server Work in progress at JHU 11 Limitations: Data and techniques Different random uncertainties in source positions in different catalogs. systematic offsets in astrometry. Needs to be tested for each catalog. Use the NVO tool WCSFixer. Turns out that FIRST, SDSS positions are very good. SWIRE is slightly off, but version 2 catalogs are much better than the version 1. Source deblending errors in catalogs. NVO HyperAtlas concept is under development. 12 6
Galaxy mid-ir continuum Mid IR continuum from galaxies has 3 main sources Emission from small dust grains in H-II regions. PAH emission from photodissociative regions. Strong 3-10 micron continuum from the AGN. 13 MIR color color diagram Lacy et al. (2004) 14 7
Getting more data: Datascope 15 To try things for yourself. NVO: www.us-vo.org WCSFixer: nvo.noao.edu/wcsfixer Coverage maps: irsa.ipac.caltech.edu/applications/quickstats/ Openskyquery: www.openskyquery.net Datascope: heasarc.nasa.gov/vo 16 8