Source Detection in the Image Domain

Similar documents
Wide-Field Radio Astronomy and the Dynamic Universe

SKA Continuum Deep Field Surveys

Quantifying and mitigating correlated noise between formed beams on the ASKAP Phased Array Feeds

ASKAP-EMU: Overcoming the challenges of wide deep continuum surveys

OBSERVING GALAXY CLUSTERS WITH NEXT GENERATION RADIO TELESCOPES. Melanie Johnston-Hollitt Victoria University of Wellington

Future radio galaxy surveys

The Canadian Initiative for Radio Astronomy Data Analysis

PoS(PRA2009)015. Exploring the HI Universe with ASKAP. Martin Meyer. The DINGO team

Radio infrared correlation for galaxies: from today's instruments to SKA

Very Large Array Sky Survey

and the University of Wisconsin Milwaukee

HI Surveys and the xntd Antenna Configuration

Reverse Ray-Tracing in Urchin

Future Radio Interferometers

New calibration sources for very long baseline interferometry in the 1.4-GHz band

The VLA Sky Survey. Claire Chandler (on behalf of the VLASS Project Office and the Survey Science Group)

FARADAY ROTATION MEASURE SYNTHESIS OF UGC 10288, NGC 4845, NGC 3044

Cosmological Galaxy Surveys: Future Directions at cm/m Wavelengths

Imaging with the SKA: Comparison to other future major instruments

CSIRO astronomy and space science (CASS) Ray Norris, CSIRO Astronomy & Space Science

Inferring source polarisation properties from SKA observations. Joern Geisbuesch

Imaging Capability of the LWA Phase II

PoS(11th EVN Symposium)084

1. INTRODUCTION 2. SOURCE SELECTION

An Introduction to ASKAP Bringing Radio Interferometers Into the Multi-pixel Era

Strong gravitational lensing

International Project Update

Unveiling the Radio Sky with the JVLA and VLASS. Julie Hlavacek-Larrondo Canada Research Chair, Université de Montréal

LSST, Euclid, and WFIRST

The micro- and nano-jy sky

A Somewhat Lower Frequency View of the Chandra Deep Field South

Machine Learning Applications in Astronomy

Radio Interferometry and Aperture Synthesis

arxiv: v1 [astro-ph.ga] 16 Oct 2018

MULTIPLE EXPOSURES IN LARGE SURVEYS

Determining the Specification of an Aperture Array for Cosmological Surveys

THE GAS MASS AND STAR FORMATION RATE

ESO Phase 3 Data Release Description. Data Collection ATLASGAL Release Number 1 Data Provider

Measuring star formation in galaxies and its evolution. Andrew Hopkins Australian Astronomical Observatory

Astronomical Imaging with Maximum Entropy. Retrospective and Outlook. Andy Strong MPE

Sequence Obs ID Instrument Exposure uf Exposure f Date Observed Aimpoint (J2000) (ks) (ks) (α, δ)

Deconvolving Primary Beam Patterns from SKA Images

IMPROVING THE DECONVOLUTION METHOD FOR ASTEROID IMAGES: OBSERVING 511 DAVIDA, 52 EUROPA, AND 12 VICTORIA

Detecting the next Galactic supernova

Detecting the cold neutral gas in young radio galaxies. James Allison Triggering Mechanisms for AGN

J. Astrophys. Astr. (0000) 00,

Radio Transient Surveys with The Allen Telescope Array & the SKA. Geoffrey C Bower (UC Berkeley)

Mario Santos (on behalf of the Cosmology SWG) Stockholm, August 24, 2015

Principles of Interferometry. Hans-Rainer Klöckner IMPRS Black Board Lectures 2014

The shapes of faint galaxies: A window unto mass in the universe

Selection of Wavelength Calibration Features for Automatic Format Recovery in Astronomical Spectrographs

Next Generation VLA Memo. 41 Initial Imaging Tests of the Spiral Configuration. C.L. Carilli, A. Erickson March 21, 2018

Data Challenges for Next-generation Radio Telescopes

9. High-level processing (astronomical data analysis)

The WFIRST High La/tude Survey. Christopher Hirata, for the SDT November 18, 2014

Continuum Surveys with LOFAR, SKA and its Pathfinders. Chiara Ferra!

E-MERLIN and EVN/e-VLBI Capabilities, Issues & Requirements

Testing the MCS Deconvolution Algorithm on Infrared Data. Michael P. Egan National Geospatial-Intelligence Agency Basic and Applied Research Office

A deep search for High-Redshift Radio Galaxies (HzRGs) with GMRT

Optimal resolutions for optical and NIR spectroscopy S. Villanueva Jr.* a, D.L. DePoy a, J. L. Marshall a

Outline. 1. Basics of gravitational wave transient signal searches. 2. Reconstruction of signal properties

Monte Carlo Quality Assessment (MC-QA)

The Square Kilometre Array and the radio/gamma-ray connection toward the SKA era

What do we want from mul0- wavelength all- sky datasets to support radio surveys?

CO(1-0) in High-Redshift Radio Galaxies using the ATCA

Non-Imaging Data Analysis

SKA Precursors and Pathfinders. Steve Torchinsky

ASKAP Array Configurations: Options and Recommendations. Ilana Feain, Simon Johnston & Neeraj Gupta Australia Telescope National Facility, CSIRO

PRACTICAL ANALYTICS 7/19/2012. Tamás Budavári / The Johns Hopkins University

TECHNICAL REPORT NO. 86 fewer points to average out the noise. The Keck interferometry uses a single snapshot" mode of operation. This presents a furt

Detection ASTR ASTR509 Jasper Wall Fall term. William Sealey Gosset

Automated Search for Lyman Alpha Emitters in the DEEP3 Galaxy Redshift Survey

HUBBLE SOURCE CATALOG. Steve Lubow Space Telescope Science Institute June 6, 2012

SZ Effect with ALMA. Kaustuv moni Basu (MPIfR / Universität Bonn)

arxiv: v1 [astro-ph.ga] 31 Mar 2014

Catalog Information and Recommendations

A Library of the X-ray Universe: Generating the XMM-Newton Source Catalogues

Hughes et al., 1998 ApJ, 505, 732 : ASCA. Westerlund, 1990 A&ARv, 2, 29 : Distance to LMC 1 ) ) (ergs s F X L X. 2 s 1. ) (ergs cm

Ivan Valtchanov Herschel Science Centre European Space Astronomy Centre (ESAC) ESA. ESAC,20-21 Sep 2007 Ivan Valtchanov, Herschel Science Centre

Solar Systems Near and Far - ALMA View

The Square Kilometre Array Epoch of Reionisation and Cosmic Dawn Experiment

PLANCK SZ CLUSTERS. M. Douspis 1, 2

The complex gravitational lens system B

ASKAP Commissioning Update #7 April-July Latest results from the BETA test array

The star-formation history of mass-selected galaxies in the VIDEO survey

Reduced data products in the ESO Phase 3 archive (Status: 02 August 2017)

ALMA Development Program

The Future of Radio Astronomy. Karen O Neil

The Karl G. Jansky Very Large Array Sky Survey (VLASS)

THE LAST SURVEY OF THE OLD WSRT: TOOLS AND RESULTS FOR THE FUTURE HI ABSORPTION SURVEYS

The Cosmic Evolution of Neutral Atomic Hydrogen Gas Philip Lah

Detection theory 101 ELEC-E5410 Signal Processing for Communications

A prelude to SKA. High-resolution mapping of the ujy radio population. Ian Smail ICC, Durham University Tom Muxlow, JBCA, University of Manchester

Information Field Theory. Torsten Enßlin MPI for Astrophysics Ludwig Maximilian University Munich

Extraction of Point Source Spectra from STIS Long Slit Data

WALLABY. Jeremy Mould WALLABY Science Meeting December 2, 2010

1 Lecture, 2 September 1999

ACIS ( , ) Total e e e e-10 4.

The Cosmic Evolution of Neutral Atomic Hydrogen Gas. Philip Lah. Macquarie University Colloquium 27th March 2015

Deep fields around bright stars ( Galaxies around Stars )

Transcription:

Source Detection in the Image Domain Astro 6525, Fall 2015 Shami Chatterjee Oct 2015

Source Identification Identify a source in the presence of noise. Localize it as best as possible given instrumental resolution.

Source Identification Identify a source in the presence of noise. Localize it as best as possible given instrumental resolution. How well can we do? Depends on beam size, of course.

Source Identification Identify a source in the presence of noise. Localize it as best as possible given instrumental resolution. But it also depends on the detection signal-to-noise ratio...

Source Identification Identify a source in the presence of noise. Localize it as best as possible given instrumental resolution. In fact, we can do better than the beam size as long as we have enough signal-to-noise ratio.

Source Identification Identify a source in the presence of noise. Localize it as best as possible given instrumental resolution. Resolution Beam Size / Signal-to-Noise ratio (Of course, we re talking about localization precision, not localization accuracy.)

Source Detection Algorithms Identify real sources in the presence of noise in an image. Many different approaches to the problem, optimized for different image domains and properties of interest.

Source Detection Algorithms Identify real sources in the presence of noise in an image. Many different approaches to the problem, optimized for different image domains and properties of interest. e.g., Optical, Radio, X-ray images? (Blurring from diffraction and seeing vs. Fourier transformed visibilities + CLEANing vs. Photon events (Poisson statistics) and sparse detector arrays) Do we care about extended sources or want compact components?

Source Detection Algorithms Identify real sources in the presence of noise in an image. Many different approaches to the problem, optimized for different image domains and properties of interest. e.g., Optical, Radio, X-ray images? (Blurring from diffraction and seeing vs. Fourier transformed visibilities + CLEANing vs. Photon events (Poisson statistics) and sparse detector arrays) Do we care about extended sources or want compact components? Differrent trade-offs between speed and complexity, false positives and completeness. Examples: SFind, IMSAD, SExtractor, Aegean, BlobCat, etc. etc. etc.

Receiver Operating Characteristic (ROC) curves ROC curve determines trade-off between false positive rate and completeness. Given ROC curve, choice of detection threshold determines completeness achieved and rate of false positives. This is up to the user to decide! Better to miss real signals, or to have fake detections? Very different answers depending on circumstances.

Algorithms (Masias et al. 2012)

Source Identification: Flood Fill A B C 4 6 7 6 4 2 4 6 7 6 4 2 4 6 7 6 4 2 5 7 8 7 5 3 5 7 8 7 5 3 5 7 8 7 5 3 4 6 7 6 4 3 4 6 7 6 4 3 4 6 7 6 4 3 3 4 5 4 3 2 3 4 5 4 3 2 3 4 5 4 3 2 2 2 3 2 2 2 2 2 3 2 2 2 2 2 3 2 2 2 1 1 1 1 1 2 1 1 1 1 1 2 1 1 1 1 1 2 D E F 4 6 7 6 4 2 4 6 7 6 4 2 4 6 7 6 4 2 5 7 8 7 5 3 5 7 8 7 5 3 5 7 8 7 5 3 4 6 7 6 4 3 4 6 7 6 4 3 4 6 7 6 4 3 3 4 5 4 3 2 3 4 5 4 3 2 3 4 5 4 3 2 2 2 3 2 2 2 2 2 3 2 2 2 2 2 3 2 2 2 1 1 1 1 1 2 1 1 1 1 1 2 1 1 1 1 1 2 Unprocessed pixels Pixels being considered Pixels in the island Background pixels

Source detection with Aegean Aegean: Part of Paul Hancock s thesis work with Murphy, Gaensler, et al. (Hancock et al. 2012, MNRAS, 422, 1812)

Source detection with Aegean Aegean: Part of Paul Hancock s thesis work with Murphy, Gaensler, et al. (Hancock et al. 2012, MNRAS, 422, 1812)

Source detection with Aegean Aegean: Part of Paul Hancock s thesis work with Murphy, Gaensler, et al. (Hancock et al. 2012, MNRAS, 422, 1812)

Source detection with Aegean Aegean: Part of Paul Hancock s thesis work with Murphy, Gaensler, et al. (Hancock et al. 2012, MNRAS, 422, 1812)

Source detection with Aegean: Performance Comparisons

Source Finding: Real World Performance Source finders compared on real VLA observations (Mooley et al. 2013, arxiv:1303.6282) Comparison of source finder performance vs DR2 catalog for Top: a blended source, Mid: a source with sidelobes, Bottom: a wide field area.

Reliability Completeness Number of sources Source Finding: Real World Performance For sources in each S/N ratio bin (top), Mooley et al. compare completeness (middle) and reliability (bottom) of source finders. (Highly blended sources cause dip at SNR 70) 100 10 1 0.9 0.8 0.9 0.8 sfind SExtra IMSAD SAD Aegean 10 1 10 2 Source Detection SNR Oct 2015

Source Finding: Simulated Performance The ASKAP/EMU Source Finding Data Challenge Hopkins et al. 2015; arxiv:1509.03931 The Evolutionary Map of the Universe (EMU) is a proposed radio continuum survey of the Southern Hemisphere up to declination +30, with the Australian Square Kilometre Array Pathfinder (ASKAP). EMU will use an automated source identification and measurement approach that is demonstrably optimal, to maximise the reliability, utility and robustness of the resulting radio source catalogues. As part of the process of achieving this aim, a Data Challenge has been conducted, providing international teams the opportunity to test a variety of source finders on a set of simulated images. The aim is to quantify the accuracy of existing automated source finding and measurement approaches, and to identify potential limitations. The Challenge attracted nine independent teams, who tested eleven different source finding tools. [...] Most finders demonstrate completeness levels close to 100% at 10σ dropping to levels around 10% by 5σ. The reliability is typically close to 100% at 10σ, with performance to lower sensitivities varying greatly between finders. All finders demonstrate the usual trade-off between completeness and reliability, whereby maintaining a high completeness at low signal-to-noise comes at the expense of reduced reliability, and vice-versa. [...]

Source Finding: Simulated Performance A subsection of the third Data Challenge image (left), and the input source distribution to this image (right). 20% of the sources are assigned a non-negligible physical extent. The extended sources are modelled as two-dimensional elliptical Gaussians.

Completeness Reliability Source Finding: Simulated Performance 0.5 0.0 Aegean Apex Blobcat 0.5 0.0 Aegean Apex Blobcat 0.5 0.0 CuTEx Duchamp (atrous) Duchamp (basic) 0.5 0.0 CuTEx Duchamp (atrous) Duchamp (basic) 0.5 0.0 0.5 0.0 0.5 0.0 Duchamp (smooth) IFCA (BAF) IFCA (MF) PyBDSM (Gaussians) PyBDSM (sources) PySE (D5A3) SAD Selavy (atrous) Selavy (basic) 0.5 0.0 0.5 0.0 0.5 0.0 Duchamp (smooth) IFCA (BAF) IFCA (MF) PyBDSM (Gaussians) PyBDSM (sources) PySE (D5A3) SAD Selavy (atrous) Selavy (basic) 0.5 0.0 Selavy (box) Selavy (smooth) Selavy (weight) 0.5 0.0 Selavy (box) Selavy (smooth) Selavy (weight) 0.5 0.0 10 1 10 2 10 3 SExtractor (10 beam) SExtractor (30 beam) SOURCE_FIND 0.5 0.0 10 1 10 2 10 3 SExtractor (10 beam) SExtractor (30 beam) SOURCE_FIND S 1.4 (mjy) S 1.4 (mjy) The completeness and reliability fractions (left and right respectively) as a function of input source flux density (completeness) or measured source flux density (reliability) for each of the tested finders for Challenge 3. The grey lines show the distribution for all finders in each panel, to aid comparison for any given finder.

Bottom line for Source Detection Algorithms Source finders are typically optimized for different domains. Trade-off between completeness and reliability (false positives). All source finders are pretty good. No source finder is perfect. If you re using one, understand its strengths and weaknesses first. There s room to do better!

But what is a source? Radio synthesis imaging: usually groups of CLEAN components. A physical source might span multiple such groups. Multiwavelength cross-match may not even overlap detected source. Problematic if you want to do science with your source catalog.

Band Merging Even at nearby wavelengths, change in telescope resolution λ/d: different apparent morphology. Merging information across different wavelength bands ( band merging ) is tricky when operating on large scale surveys.

Band Merging Even at nearby wavelengths, change in telescope resolution λ/d: different apparent morphology. Merging information across different wavelength bands ( band merging ) is tricky when operating on large scale surveys. How to proceed? Use prior information...

Bayesian Source Identification The Astrophysical Journal, 679:301Y309, 2008 May 20 # 2008. The American Astronomical Society. All rights reserved. Printed in U.S.A. PROBABILISTIC CROSS-IDENTIFICATION OF ASTRONOMICAL SOURCES Tamás Budavári and Alexander S. Szalay Department of Physics and Astronomy, The Johns Hopkins University, 3400 North Charles Street, Baltimore, MD 21218; and Max-Planck-Institute für Astrophysik, Karl-Schwarzschild-Strasse 1, 85748 Garching, Germany Received 2007 July 11; accepted 2008 February 9 ABSTRACT We present a general probabilistic formalism for cross-identifying astronomical point sources in multiple observations. Our Bayesian approach, symmetric in all observations, is the foundation of a unified framework for object matching, where not only spatial information, but also physical properties, such as colors, redshift, and luminosity, can be considered in a natural way. We provide a practical recipe to implement an efficient recursive algorithm to evaluate the Bayes factor over a set of catalogs with known circular errors in positions. This new methodology is crucial for studies leveraging the synergy of today s multiwavelength observations and to enter the time domain science of the upcoming survey telescopes. Subject headinggs: astrometry catalogs galaxies: statistics methods: statistical

Bayesian Source Identification Mechanical Systems and Signal Processing 66-67 (2016) 120 136 Contents lists available at ScienceDirect Mechanical Systems and Signal Processing journal homepage: www.elsevier.com/locate/ymssp Bayesian source identification using local priors M. Aucejo n, O. De Smet Structural Mechanics and Coupled Systems Laboratory, Conservatoire National des Arts et Métiers, 2 Rue Conté, 75003 Paris, France a r t i c l e i n f o Article history: Received 4 July 2014 Received in revised form 16 January 2015 Accepted 1 May 2015 Available online 23 May 2015 Keywords: Inverse problem Force identification Group generalized Tikhonov regularization Local priors a b s t r a c t This paper is concerned with the development of a general methodology for identifying mechanical sources from prior local information on both their nature and location over the studied structure. For this purpose, the formulation of the identification problem is derived from the Bayesian statistics, that provides a flexible way to account for local a priori on the distribution of sources. Practically, the resulting optimization problem can be seen as a group generalized Tikhonov regularization, that is solved in an iterative manner. The main features of the proposed identification method are illustrated with both numerical and experimental examples. In particular, it is shown that properly exploiting the local spatial information drastically improves the quality of the source identification. & 2015 Elsevier Ltd. All rights reserved.

The VLA Sky Survey Source finding and matching: particular concern for large sky surveys. LSST will image all optical sky in the time domain. SKA pathfinders like ASKAP: designed to maximize survey speed metric.

The VLA Sky Survey Source finding and matching: particular concern for large sky surveys. LSST will image all optical sky in the time domain. SKA pathfinders like ASKAP: designed to maximize survey speed metric. VLA Sky Survey: EVLA upgrade 10 spectral coverage, sensitivity, versatility. Need radio atlas successor to NVSS, FIRST. All-sky survey: δ > 40 ; 33,885 sq deg. B-array; 2 4 GHz; 2.4 resolution. On-the-fly mapping; sensitivity 70 µjy. Three epochs: transients, polarization science, etc. Now being planned - see, e.g., https://science.nrao.edu/science/surveys/vlass