A Unified Theory of Photometric Redshifts. Tamás Budavári The Johns Hopkins University

Similar documents
The SDSS is Two Surveys

Measuring star formation in galaxies and its evolution. Andrew Hopkins Australian Astronomical Observatory

Big Data Inference. Combining Hierarchical Bayes and Machine Learning to Improve Photometric Redshifts. Josh Speagle 1,

Bayesian Modeling for Type Ia Supernova Data, Dust, and Distances

Advanced Statistical Methods. Lecture 6

Sparse Composite Models of Galaxy Spectra (or Anything) using L1 Norm Regularization. Benjamin Weiner Steward Observatory University of Arizona

Three data analysis problems

Introduction to Computer Vision

9. Evolution with redshift - z > 1.5. Selection in the rest-frame UV

Inference of Galaxy Population Statistics Using Photometric Redshift Probability Distribution Functions

Chapter 15. Probability Rules! Copyright 2012, 2008, 2005 Pearson Education, Inc.

Choosing among models

SED- dependent Galactic Extinction Prescription for Euclid and Future Cosmological Surveys

CS173 Strong Induction and Functions. Tandy Warnow

SNAP Photometric Redshifts and Simulations

The star formation history of Virgo spiral galaxies

MULTIPLE EXPOSURES IN LARGE SURVEYS

Classifying Galaxy Morphology using Machine Learning

Photometric Redshifts for the NSLS

Statistical Searches in Astrophysics and Cosmology

The Redshift Evolution of Bulges and Disks of Spiral Galaxies in COSMOS

Astr 5465 Feb. 13, 2018 Distribution & Classification of Galaxies Distribution of Galaxies

2D Image Processing (Extended) Kalman and particle filter

IRS Spectroscopy of z~2 Galaxies

Galaxy Zoo: the independence of morphology and colour

Some Statistical Aspects of Photometric Redshift Estimation

A Bayesian Method for Guessing the Extreme Values in a Data Set

arxiv: v2 [astro-ph] 21 Aug 2007

Photometric redshifts of galaxies from SDSS and 2MASS

arxiv: v1 [astro-ph.im] 9 May 2013

Bayesian Analysis for Natural Language Processing Lecture 2

arxiv:astro-ph/ v1 17 Oct 2002

A8824: Statistics Notes David Weinberg, Astronomy 8824: Statistics Notes 6 Estimating Errors From Data

Delicious Diameters of Dwarfs (in particular, the juicy red ones)

Physics 509: Propagating Systematic Uncertainties. Scott Oser Lecture #12

COMPUTATIONAL STATISTICS IN ASTRONOMY: NOW AND SOON

Multimodal Nested Sampling

HST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007

COLOR SEPARATION OF GALAXY TYPES IN THE SLOAN DIGITAL SKY SURVEY IMAGING DATA

Why Bayesian? Rigorous approach to address statistical estimation problems. The Bayesian philosophy is mature and powerful.

Lab 2 Cosmology 2 (Hubble's Law)

Solving. Andrey Kravtsov The University of Chicago Department of Astronomy & Astrophysics Kavli Institute for Cosmological Physics

Review of Basic Probability

Astr 323: Extragalactic Astronomy and Cosmology. Spring Quarter 2014, University of Washington, Željko Ivezić. Lecture 1:

Photometric Redshifts with DAME

OVERVIEW OF A 3C279 s FLARE and SIMULATION OF AGNs

The The largest assembly ESO high-redshift. Lidia Tasca & VUDS collaboration

Nonlinear Data Transformation with Diffusion Map

Data-driven models of stars

Recent Developments of the Real-Time Capabilities of IceCube

Neural Networks for Protein Structure Prediction Brown, JMB CS 466 Saurabh Sinha

A New Method for Characterizing Unresolved Point Sources: applications to Fermi Gamma-Ray Data

Science with large imaging surveys

Improved Astronomical Inferences via Nonparametric Density Estimation

Computational Cognitive Science

LePhare Download Install Syntax Examples Acknowledgement Le Phare

Probabilistic photometric redshifts in the era of Petascale Astronomy

The Cosmic History of Star Formation. James Dunlop Institute for Astronomy, University of Edinburgh

arxiv: v1 [astro-ph.co] 2 Dec 2016

Atoms and Spectra October 8th, 2013

The relation between cold dust and star formation in nearby galaxies

Coresets for Bayesian Logistic Regression

Automatic Unsupervised Spectral Classification of all SDSS/DR7 Galaxies

Source Detection in the Image Domain

An English translation of Laplace s Théorie Analytique des Probabilités is available online at the departmental website of Richard Pulskamp (Math

Data-Intensive Statistical Challenges in Astrophysics

Probability and Information Theory. Sargur N. Srihari

Natural Evolution Strategies for Direct Search

Challenges of low and intermediate redshift supernova surveys

Precision cosmology with Type Ia Supernovae?

Rick Ebert & Joseph Mazzarella For the NED Team. Big Data Task Force NASA, Ames Research Center 2016 September 28-30

What Supernovas Tell Us about Cosmology. Jon Thaler

Astronomical imagers. ASTR320 Monday February 18, 2019

COMP61011 : Machine Learning. Probabilis*c Models + Bayes Theorem

The star-formation history of mass-selected galaxies in the VIDEO survey

Mattia Di Mauro Eric Charles, Matthew Wood

Stellar Mass Estimates of Galaxies in Superclusters at z~1

Bayesian Inference. Introduction

The ALMA z=4 Survey (AR4S)

SEMI-EMPIRICAL LIBRARY OF GALAXY SPECTRA FROM SDSS

Quasars, Mergers, and the Formation of Elliptical Galaxies

STA Module 4 Probability Concepts. Rev.F08 1

Durham Lightcones: Synthetic galaxy survey catalogues from GALFORM. Jo Woodward, Alex Merson, Peder Norberg, Carlton Baugh, John Helly

Statistics in Astronomy (II) applications. Shen, Shiyin

DS-GA 1003: Machine Learning and Computational Statistics Homework 7: Bayesian Modeling

Where are We Going! How to Calculate Your Own Star!

Uncertainty in burned area (BA) products. J Brennan (UCL/NCEO) J Gómez-Dans (UCL/NCEO) P Lewis (UCL/NCEO)

An introduction to Bayesian reasoning in particle physics

A. Chen (INAF-IASF Milano) On behalf of the Fermi collaboration

An improved technique for increasing the accuracy of photometrically determined redshifts for blended galaxies

Data-Intensive Statistical Challenges in Astrophysics

Kavli IPMU-Berkeley Symposium "Statistics, Physics and Astronomy" January , 2018 Lecture Hall, Kavli IPMU

Evidence of multiple stellar components in high-z elliptical galaxies from spectral indices and high resolution images

Conceptual Themes for the 2017 Sagan Summer Workshop

Fitting a Straight Line to Data

Big Bang, Black Holes, No Math

From theory to observations

Hypothesis testing:power, test statistic CMS:

Statistics. Lent Term 2015 Prof. Mark Thomson. 2: The Gaussian Limit

Bayesian Inference. STA 121: Regression Analysis Artin Armagan

Transcription:

A Unified Theory of Photometric Redshifts Tamás Budavári The Johns Hopkins University

Haunting Questions Two classes of methods: empirical and template fitting Why are they so different? Anything fundamental? Empirical techniques don t work beyond the training set Why not signal if query point is away from the training points? Why can we only use the same observables for the estimation? Why don t they ever use the photometric errors? Template fitting has modest success Why just use discrete sets and not continuous manifolds? Why should we trust their estimates beyond our test set? People only estimate photometric redshifts Why subsequent analyses to estimate other dependent properties? 11/19/2008 Tamás Budavári (JHU) 2

Photometric Properties The Photometric Inversion problem Constrain various properties consistently Propagate their uncertainties and correlations Estimates are secondary Should provide probability density functions instead Scientific analyses should be using the full PDFs u g r i z L type z etc. Make best use of observations Next generation surveys are photometric only 11/19/2008 Tamás Budavári (JHU) 3

Courtesy of D. Madigan (Rutgers) 11/19/2008 Tamás Budavári (JHU) 4

Basic Concepts Training and Query sets with different observables Model yields observables for given model parameter Prediction via and has prior Also folds in the photometric accuracy We are after 11/19/2008 Tamás Budavári (JHU) 5

Mapping Observables The model provides the transformation rule with Think empirical conversion formulae but better For example, from UJFN to ugriz with errors 11/19/2008 Tamás Budavári (JHU) 6

Relation of Properties Usually just assume a function Wrong! We know there are degeneracies There is a more general relation Usual restriction is Correct estimation Straightforward to do via KDE or Voronoi I didn t say cheap or easy ;-) 11/19/2008 Tamás Budavári (JHU) 7

Properties of Interest The final density of interest is Recommended Mantra: It is not a function. It is not a func If the result is uni-modal (not likely), and you insist 11/19/2008 Tamás Budavári (JHU) 8

Boundary Effects Measure of reliability is the prob of q making the cuts Include observables used in the selection criteria Cannot use just colors, if there was a magnitude cut Cannot use just fluxes, if cut on morphology 11/19/2008 Tamás Budavári (JHU) 9

Models in the Classical Limit Empirical method Normal distributions, same quantities: and With simple prior, the mapping is analytic, e.g., for flat Template fitting Generate training set from SEDs If no errors cf. maximum likelihood 11/19/2008 Tamás Budavári (JHU) 10

It works! 11/19/2008 Tamás Budavári (JHU) 11

Red Galaxies 11/19/2008 Tamás Budavári (JHU) 12

Blue Galaxies 11/19/2008 Tamás Budavári (JHU) 13

Advanced Methods Mapping observables via templates Arbitrary but complete basis on wavelength range Can be non-physical because the physics is in the prior Empirical relation of properties Your favorite fitting function or Preferably the more generic relation Imagine empirical fitting with templates! It s easy if you can ;-) 11/19/2008 Tamás Budavári (JHU) 14

Summary Unified theory from first principles Aims to be as general as possible Solve the photometric inversion problem Provide no estimates but probability densities Traditional methods in the classical limits But already go beyond the usual techniques More advanced algorithms coming soon! Rev. Thomas Bayes Submitted to ApJ, preprint is at ArXiv/0811.2600 11/19/2008 Tamás Budavári (JHU) 15