Pan-STARRS1 Photometric Classifica7on of Supernovae using Ensemble Decision Tree Methods

Size: px
Start display at page:

Download "Pan-STARRS1 Photometric Classifica7on of Supernovae using Ensemble Decision Tree Methods"

Transcription

1 Pan-STARRS1 Photometric Classifica7on of Supernovae using Ensemble Decision Tree Methods George Miller, Edo Berger Harvard-Smithsonian Center for Astrophysics

2 PS1 Medium Deep Survey 1.8m f/4.4 telescope with 3.2 degree FOV and 1.6 Gpix camera PS1 Sky Surveys: May 2010 March 2014 Medium Deep 10 fields of 7 sq. deg. with a 3-day staggered cadence and grizy filters Currently the best precursor and source of training data for LSST classifica7on tools Similar cadence (~3 days) and sensi7vity Similar grizy band-passes (+u for LSST) Wide variety of science drivers and a large distributed collabora7on

3 PS1/MDS Spectroscopic Sample Sample of 514 events with spectroscopic follow up (~150 nights on MMT, Magellan, Gemini by the Harvard PS1 team) 69% Ia 22% IIP/n 4% Ib/c 4% ULSN, TDE, etc. 1% Unclassified

4 Goals To develop a machine learning algorithm capable of: 1. Classifying all types of supernovae subtypes, including rare or exo7c events. 2. Classifying quickly in real 7me

5 Model Fikng F (t) = 8 A+ (t t 0 ) >< + c if t<t 1+e (t t 0 )/ rise 1 >: (A+ (t 1 t 0 )) e (t t 1 )/ fall 1+e (t t 0 )/ rise + c if t t 1 Adapted from the non-ia lightcurve model (Bazin+ 2009) Required a func7onal form sufficiently generic to fit a wide array of possible SN lightcurves Added second 7me parameter and linear decay func7on to allow for plateau effect near and ajer maximum light

6 Non-Ia Model (Bazin+ 2009) Double Peak Model (Karpenka+ 2013) Linear Decline Model (This work)

7 Individual fits using PyMC MH Confirmed Type IIP F F F F Flu[ 1000 Flu[ 3000 Flu[ 1000 Flu[ JD [+55500] JD [+55500] JD [+55500] JD [+55500] Confirmed Type Ia F F F F Flu[ Flu[ Flu[ Flu[ JD [+55500] JD [+55500] JD [+55500] JD [+55500]

8

9

10

11 F (t) = 8 A+ (t t 0 ) >< + c if t<t 1+e (t t 0 )/ rise 1 >: (A+ (t 1 t 0 )) e (t t 1 )/ fall 1+e (t t 0 )/ rise + c if t t 1 Careful Considera;ons: A degeneracy exists between a fast exponen7al decline and a steep linear decline. Fix: Set priors to favor exponen7al declines. We set the slope (β) as a normal centered at low values We set the lag 7me (t 1 -t 0 ) as a double-normal composed of a narrow, low-valued and a broad, high-valued Gaussian

12 F (t) = 8 A+ (t t 0 ) >< + c if t<t 1+e (t t 0 )/ rise 1 >: (A+ (t 1 t 0 )) e (t t 1 )/ fall 1+e (t t 0 )/ rise + c if t t 1 Careful Considera;ons: A degeneracy exists between a fast exponen7al decline and a steep linear decline. Fix: Set priors to favor exponen7al declines. We set the slope (β) as a normal centered at low values We set the lag 7me (t 1 -t 0 ) as a double-normal composed of a narrow, low-valued and a broad, high-valued Gaussian The parameters A and lag (t 1 -t 0 ) don t actually represent the maximum amplitude and linear decline dura7on respec7vely. Fix: Use post-processing to fit the maximum amplitude of the posterior model and define lag as t max t 0

13 Imbalanced Classes Type Ia supernovae will consist of the majority class for any survey. 70% Type Ia for PS1 MD On a superficial level, this affects our performance measure. Cannot simply state overall accuracy. On a deeper level, imbalanced class distribu7on will affect the machine learning algorithm. If the algorithm tries to adap7vely maximize the overall predic7ve accuracy of the sample, it tends to ignore minority classes if this hurts the accuracy of the major class. If we wish to iden;fy unique/exo;c transients, we must rec;fy the inherently imbalanced supernovae class rates

14 SMOTE Synthe7c Minority Over-sampling Technique (SMOTE) proposed by Chawla et. al SMOTE creates synthe7c samples in the feature space by randomly sampling anywhere along the line segments joining the k minority class nearest neighbors Also allows us to more freely explore a broader poten7al feature space of the minority class

15 Boos7ng t fall,i > 40 t rise,g >20 lag r > 10 M i > -18 SN Ia SN IIn SN IIp SN Ia SN Ib/c Freund & Schapire 1995

16 Boos7ng Advantages of Boos7ng Decision Trees can incorporate features from a wide array of sources. They do not need to be numerically related, and can even use mul7- class labeling features (is the host galaxy a spiral or ellip7cal, etc.) The combina7on of mul7ple weak learners, as opposed to a deeper decision tree, reduces overfikng the data and does not rely upon axisaligned par77oning of the features Boos7ng can be efficiently applied to large datasets with many variables, resul7ng in faster computa7onal 7mes

17

18

19 Sub-type classifica7on results Overall Accuracy of 88.4% Must account for 70% type Ia

20

21

22

23

24 Future Plans Don t rely on spectroscopic redshijs Use photo-z, or create a redshij independent model Incorporate colors into model fikng Genera7ve: Use a K-correc7on model Discrimina7ve: Add a Bayesian Hyperprior Incorporate external informa7on as features Host galaxy type, host galaxy offset, etc. Real 7me classifica7on Need to be more sensi7ve to rise phase

25 Discussion Ques7ons 1. How can we dis7nguish new/rare/exo7c transient events? 2. How can we incorporate fikng errors into our machine learning algorithms?

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16 Logis@cs CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Sign

More information

Connec&ng Bayesian Networks and Seman&cs (as a step towards complete classifica&on)

Connec&ng Bayesian Networks and Seman&cs (as a step towards complete classifica&on) Connec&ng Bayesian Networks and Seman&cs (as a step towards complete classifica&on), Caltech aam at astro.caltech.edu AstroInforma8cs 2012, MSR, Redmond With Alex Ball, George Djorgovski, Ciro Donalek,

More information

Mul$variate clustering & classifica$on with R

Mul$variate clustering & classifica$on with R Mul$variate clustering & classifica$on with R Eric Feigelson Penn State Cosmology on the Beach, 2014 Astronomical context Astronomers have constructed classifica@ons of celes@al objects for centuries:

More information

The Large Synoptic Survey Telescope

The Large Synoptic Survey Telescope The Large Synoptic Survey Telescope Philip A. Pinto Steward Observatory University of Arizona for the LSST Collaboration 17 May, 2006 NRAO, Socorro Large Synoptic Survey Telescope The need for a facility

More information

Boos$ng Can we make dumb learners smart?

Boos$ng Can we make dumb learners smart? Boos$ng Can we make dumb learners smart? Aarti Singh Machine Learning 10-601 Nov 29, 2011 Slides Courtesy: Carlos Guestrin, Freund & Schapire 1 Why boost weak learners? Goal: Automa'cally categorize type

More information

Large Synoptic Survey Telescope

Large Synoptic Survey Telescope Large Synoptic Survey Telescope Željko Ivezić University of Washington Santa Barbara, March 14, 2006 1 Outline 1. LSST baseline design Monolithic 8.4 m aperture, 10 deg 2 FOV, 3.2 Gpix camera 2. LSST science

More information

Supernovae photometric classification of SNLS data with supervised learning

Supernovae photometric classification of SNLS data with supervised learning Supernovae photometric classification of SNLS data with supervised learning Anais Möller CAASTRO & Australian National University A. Möller,V. Ruhlmann-Kleider, C. Leloup,J. Neveu, N. Palanque-Delabrouille,J.

More information

Founda'ons of Large- Scale Mul'media Informa'on Management and Retrieval. Lecture #3 Machine Learning. Edward Chang

Founda'ons of Large- Scale Mul'media Informa'on Management and Retrieval. Lecture #3 Machine Learning. Edward Chang Founda'ons of Large- Scale Mul'media Informa'on Management and Retrieval Lecture #3 Machine Learning Edward Y. Chang Edward Chang Founda'ons of LSMM 1 Edward Chang Foundations of LSMM 2 Machine Learning

More information

CS 6140: Machine Learning Spring 2016

CS 6140: Machine Learning Spring 2016 CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa?on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Logis?cs Assignment

More information

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model Logis@cs CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Assignment

More information

Computer Vision. Pa0ern Recogni4on Concepts Part I. Luis F. Teixeira MAP- i 2012/13

Computer Vision. Pa0ern Recogni4on Concepts Part I. Luis F. Teixeira MAP- i 2012/13 Computer Vision Pa0ern Recogni4on Concepts Part I Luis F. Teixeira MAP- i 2012/13 What is it? Pa0ern Recogni4on Many defini4ons in the literature The assignment of a physical object or event to one of

More information

THE DARK ENERGY SURVEY: 3 YEARS OF SUPERNOVA

THE DARK ENERGY SURVEY: 3 YEARS OF SUPERNOVA THE DARK ENERGY SURVEY: 3 YEARS OF SUPERNOVA IN

More information

Bayesian Modeling for Type Ia Supernova Data, Dust, and Distances

Bayesian Modeling for Type Ia Supernova Data, Dust, and Distances Bayesian Modeling for Type Ia Supernova Data, Dust, and Distances Kaisey Mandel Supernova Group Harvard-Smithsonian Center for Astrophysics ichasc Astrostatistics Seminar 17 Sept 213 1 Outline Brief Introduction

More information

Supernovae with Euclid

Supernovae with Euclid Supernovae with Euclid Isobel Hook University of Oxford and INAF (Obs. Roma) Thanks to R. Nichol, M. Della Valle, F. Mannucci, A. Goobar, P. Astier, B. Leibundgut, A. Ealet Euclid Conference 17 18 Nov

More information

Strong gravitational lenses in the 2020s

Strong gravitational lenses in the 2020s Strong gravitational lenses in the 2020s Masamune Oguri University of Tokyo 2014/7/18 TMT science forum @ Tucson Strong gravitational lenses are rare wide-field surveys find strong gravitational lenses

More information

Constraining Dark Energy: First Results from the SDSS-II Supernova Survey

Constraining Dark Energy: First Results from the SDSS-II Supernova Survey Constraining Dark Energy: First Results from the SDSS-II Supernova Survey J. Craig Wheeler Department of Astronomy University of Texas at Austin (adapted from presentation by Josh Frieman) Texas Cosmology

More information

From the Big Bang to Big Data. Ofer Lahav (UCL)

From the Big Bang to Big Data. Ofer Lahav (UCL) From the Big Bang to Big Data Ofer Lahav (UCL) 1 Outline What is Big Data? What does it mean to computer scientists vs physicists? The Alan Turing Institute Machine learning examples from Astronomy The

More information

An Introduction to the Dark Energy Survey

An Introduction to the Dark Energy Survey An Introduction to the Dark Energy Survey A study of the dark energy using four independent and complementary techniques Blanco 4m on Cerro Tololo Galaxy cluster surveys Weak lensing Galaxy angular power

More information

Present and Future Large Optical Transient Surveys. Supernovae Rates and Expectations

Present and Future Large Optical Transient Surveys. Supernovae Rates and Expectations Present and Future Large Optical Transient Surveys Supernovae Rates and Expectations Phil Marshall, Lars Bildsten, Mansi Kasliwal Transients Seminar Weds 12th December 2007 Many surveys designed to find

More information

SNLS supernovae photometric classification with machine learning

SNLS supernovae photometric classification with machine learning SNLS supernovae photometric classification with machine learning Courtesy of D. Campbell-Wilson Anais Möller CAASTRO, Australian National University Statistical Challenges in Astronomy, Carnegie Mellon

More information

Reverberation Mapping in the Era of MOS and Time-Domain Surveys: from SDSS to MSE

Reverberation Mapping in the Era of MOS and Time-Domain Surveys: from SDSS to MSE Reverberation Mapping in the Era of MOS and Time-Domain Surveys: from SDSS to MSE Yue Shen Carnegie Obs -> University of Illinois at Urbana-Champaign MSE Science Team Meeting, July 29-31 2015, Big Island

More information

Cosmology of Photometrically- Classified Type Ia Supernovae

Cosmology of Photometrically- Classified Type Ia Supernovae Cosmology of Photometrically- Classified Type Ia Supernovae Campbell et al. 2013 arxiv:1211.4480 Heather Campbell Collaborators: Bob Nichol, Chris D'Andrea, Mat Smith, Masao Sako and all the SDSS-II SN

More information

Hierarchical Probabilis.c Inference of Cosmic Shear

Hierarchical Probabilis.c Inference of Cosmic Shear Hierarchical Probabilis.c Inference of Cosmic Shear Sta$s$cal Challenges in Modern Astronomy VI June 9, 2016 Michael D. Schneider with Will Dawson, Josh Meyers Collaborators: D. Bard, D. Hogg, D. Lang,

More information

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 23 Birthday problem comments Construc

More information

CORE-COLLAPSE SUPERNOVAE

CORE-COLLAPSE SUPERNOVAE CORE-COLLAPSE SUPERNOVAE Ryan Chornock (Ohio University) J. Hester & A. Loll/NASA/ESA WHY CC SUPERNOVAE ARE IMPORTANT Final deaths of massive (M > 8 M ) stars Formation of compact objects (i.e., NS/BH)

More information

Decision Trees Lecture 12

Decision Trees Lecture 12 Decision Trees Lecture 12 David Sontag New York University Slides adapted from Luke Zettlemoyer, Carlos Guestrin, and Andrew Moore Machine Learning in the ER Physician documentation Triage Information

More information

Outline. What is Machine Learning? Why Machine Learning? 9/29/08. Machine Learning Approaches to Biological Research: Bioimage Informa>cs and Beyond

Outline. What is Machine Learning? Why Machine Learning? 9/29/08. Machine Learning Approaches to Biological Research: Bioimage Informa>cs and Beyond Outline Machine Learning Approaches to Biological Research: Bioimage Informa>cs and Beyond Robert F. Murphy External Senior Fellow, Freiburg Ins>tute for Advanced Studies Ray and Stephanie Lane Professor

More information

Holdout and Cross-Validation Methods Overfitting Avoidance

Holdout and Cross-Validation Methods Overfitting Avoidance Holdout and Cross-Validation Methods Overfitting Avoidance Decision Trees Reduce error pruning Cost-complexity pruning Neural Networks Early stopping Adjusting Regularizers via Cross-Validation Nearest

More information

Supernovae photometric classification of SNLS data with supervised learning

Supernovae photometric classification of SNLS data with supervised learning Supernovae photometric classification of SNLS data with supervised learning Anais Möller CAASTRO, Australian National University A. Möller,V. Ruhlmann-Kleider, C. Leloup,J. Neveu, N. Palanque-Delabrouille,J.

More information

BBM406 - Introduc0on to ML. Spring Ensemble Methods. Aykut Erdem Dept. of Computer Engineering HaceDepe University

BBM406 - Introduc0on to ML. Spring Ensemble Methods. Aykut Erdem Dept. of Computer Engineering HaceDepe University BBM406 - Introduc0on to ML Spring 2014 Ensemble Methods Aykut Erdem Dept. of Computer Engineering HaceDepe University 2 Slides adopted from David Sontag, Mehryar Mohri, Ziv- Bar Joseph, Arvind Rao, Greg

More information

Computer Vision. Pa0ern Recogni4on Concepts. Luis F. Teixeira MAP- i 2014/15

Computer Vision. Pa0ern Recogni4on Concepts. Luis F. Teixeira MAP- i 2014/15 Computer Vision Pa0ern Recogni4on Concepts Luis F. Teixeira MAP- i 2014/15 Outline General pa0ern recogni4on concepts Classifica4on Classifiers Decision Trees Instance- Based Learning Bayesian Learning

More information

Machine Learning Ensemble Learning I Hamid R. Rabiee Jafar Muhammadi, Alireza Ghasemi Spring /

Machine Learning Ensemble Learning I Hamid R. Rabiee Jafar Muhammadi, Alireza Ghasemi Spring / Machine Learning Ensemble Learning I Hamid R. Rabiee Jafar Muhammadi, Alireza Ghasemi Spring 2015 http://ce.sharif.edu/courses/93-94/2/ce717-1 / Agenda Combining Classifiers Empirical view Theoretical

More information

Constraining Fundamental Physics with Weak Lensing and Galaxy Clustering. Roland de Pu+er JPL/Caltech COSMO- 14

Constraining Fundamental Physics with Weak Lensing and Galaxy Clustering. Roland de Pu+er JPL/Caltech COSMO- 14 Constraining Fundamental Physics with Weak Lensing and Galaxy Clustering Roland de Pu+er JPL/Caltech COSMO- 14 Galaxy Clustering: - 3D maps of galaxies - > 3D power spectrum P(k,mu) - BOSS: V = 4.4 (h-

More information

Photometric classification of SNe Ia in the SuperNova Legacy Survey with supervised learning

Photometric classification of SNe Ia in the SuperNova Legacy Survey with supervised learning Photometric classification of SNe Ia in the SuperNova Legacy Survey with supervised learning Courtesy of D. Campbell-Wilson CAASTRO Postdoc at the Australian National University (ANU) Photometric Classification

More information

Building a Photometric Hubble Diagram from DES-SN Data

Building a Photometric Hubble Diagram from DES-SN Data Building a Photometric Hubble Diagram from DES-SN Data R. Kessler University of Chicago SN ClassificaCon Workshop April 28 26 The Dark Energy Survey Survey project using 4 complementary techniques: I.

More information

Dark Energy. Cluster counts, weak lensing & Supernovae Ia all in one survey. Survey (DES)

Dark Energy. Cluster counts, weak lensing & Supernovae Ia all in one survey. Survey (DES) Dark Energy Cluster counts, weak lensing & Supernovae Ia all in one survey Survey (DES) What is it? The DES Collaboration will build and use a wide field optical imager (DECam) to perform a wide area,

More information

Logis&c Regression. Robot Image Credit: Viktoriya Sukhanova 123RF.com

Logis&c Regression. Robot Image Credit: Viktoriya Sukhanova 123RF.com Logis&c Regression These slides were assembled by Eric Eaton, with grateful acknowledgement of the many others who made their course materials freely available online. Feel free to reuse or adapt these

More information

A new method to search for Supernova Progenitors in the PTF Archive. Frank Masci & the PTF Collaboration

A new method to search for Supernova Progenitors in the PTF Archive. Frank Masci & the PTF Collaboration A new method to search for Supernova Progenitors in the PTF Archive Frank Masci & the PTF Collaboration 1 The Palomar Transient Factory (PTF) Fully automated wide-field time-domain survey in optical Carried

More information

Outline Challenges of Massive Data Combining approaches Application: Event Detection for Astronomical Data Conclusion. Abstract

Outline Challenges of Massive Data Combining approaches Application: Event Detection for Astronomical Data Conclusion. Abstract Abstract The analysis of extremely large, complex datasets is becoming an increasingly important task in the analysis of scientific data. This trend is especially prevalent in astronomy, as large-scale

More information

Examining Dark Energy With Dark Matter Lenses: The Large Synoptic Survey Telescope. Andrew R. Zentner University of Pittsburgh

Examining Dark Energy With Dark Matter Lenses: The Large Synoptic Survey Telescope. Andrew R. Zentner University of Pittsburgh Examining Dark Energy With Dark Matter Lenses: The Large Synoptic Survey Telescope Andrew R. Zentner University of Pittsburgh 1 Overview The contents of the Universe The accelerating Universe and Dark

More information

Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function.

Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Bayesian learning: Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Let y be the true label and y be the predicted

More information

Challenges of low and intermediate redshift supernova surveys

Challenges of low and intermediate redshift supernova surveys Challenges of low and intermediate redshift supernova surveys Ribamar R. R. Reis Image credit: ESO / M. Kornmesser Introduction Type Ia supernovae (SNeIa) are thermonuclear explosions of CO white dwarfs

More information

How to classify spectra of exploding stars (?)

How to classify spectra of exploding stars (?) How to classify spectra of exploding stars (?) Stéphane Blondin Harvard-Smithsonian Center for Astrophysics Astrostatistics Seminar (03/13/2007) SN 1994D (Credit: P. Challis) Layout 1. Introduction What

More information

SKA Continuum Deep Field Surveys

SKA Continuum Deep Field Surveys SKA Continuum Deep Field Surveys Amit Vishwas April 7, 2010 The Square Kilometer Array The Next Generation Radio Telescope Spread over a long baseline ~1000 kms Large Effective Area: but only a fraction

More information

Time-Series Photometric Surveys: Some Musings

Time-Series Photometric Surveys: Some Musings Steve B. Howell NASA Ames Research Center 1 Introduction Time-Series surveys are designed to detect variable, transient, rare, and new astronomical sources. They aim at discovery with a goal to provide

More information

1 A photometric probe for Pan-STARRS

1 A photometric probe for Pan-STARRS The Pan-STARRS Imaging Sky Probe B.R. Granett, K.C. Chambers, E.A. Magnier, K. Fletcher and the Pan-STARRS Project Team University of Hawai i Institute for Astronomy Abstract Photometric performance is

More information

From DES to LSST. Transient Processing Goes from Hours to Seconds. Eric Morganson, NCSA LSST Time Domain Meeting Tucson, AZ May 22, 2017

From DES to LSST. Transient Processing Goes from Hours to Seconds. Eric Morganson, NCSA LSST Time Domain Meeting Tucson, AZ May 22, 2017 From DES to LSST Transient Processing Goes from Hours to Seconds Eric Morganson, NCSA LSST Time Domain Meeting Tucson, AZ May 22, 2017 Hi, I m Eric Dr. Eric Morganson, Research Scientist, Nation Center

More information

Final Exam, Fall 2002

Final Exam, Fall 2002 15-781 Final Exam, Fall 22 1. Write your name and your andrew email address below. Name: Andrew ID: 2. There should be 17 pages in this exam (excluding this cover sheet). 3. If you need more room to work

More information

Some ML and AI challenges in current and future optical and near infra imaging datasets

Some ML and AI challenges in current and future optical and near infra imaging datasets Some ML and AI challenges in current and future optical and near infra imaging datasets Richard McMahon (Institute of Astronomy, University of Cambridge) and Cameron Lemon, Estelle Pons, Fernanda Ostrovski,

More information

STUDY OF ORPHAN (OFF-AXIS) AND PARENT (ON-AXIS) GAMMA-RAY BURSTS WITH LSST (A SMALL DROP IN THE TRANSIENT SKY)

STUDY OF ORPHAN (OFF-AXIS) AND PARENT (ON-AXIS) GAMMA-RAY BURSTS WITH LSST (A SMALL DROP IN THE TRANSIENT SKY) SERGIO CAMPANA GIANCARLO GHIRLANDA PAOLO D AVANZO ANDREA MELANDRI GIANPIERO TAGLIAFERRI GABRIELE GHISELLINI STUDY OF ORPHAN (OFF-AXIS) AND PARENT (ON-AXIS) GAMMA-RAY BURSTS WITH LSST (A SMALL DROP IN THE

More information

TMT and Space-Based Survey Missions

TMT and Space-Based Survey Missions TMT and Space-Based Survey Missions Daniel Stern Jet Propulsion Laboratory/ California Institute of Technology 2014 California Institute of Technology TMT Science Forum 2014 July 17 Outline Summary of

More information

Slides modified from: PATTERN RECOGNITION AND MACHINE LEARNING CHRISTOPHER M. BISHOP

Slides modified from: PATTERN RECOGNITION AND MACHINE LEARNING CHRISTOPHER M. BISHOP Slides modified from: PATTERN RECOGNITION AND MACHINE LEARNING CHRISTOPHER M. BISHOP Predic?ve Distribu?on (1) Predict t for new values of x by integra?ng over w: where The Evidence Approxima?on (1) The

More information

Evolution of galaxy clustering in the ALHAMBRA Survey

Evolution of galaxy clustering in the ALHAMBRA Survey Evolution of galaxy clustering in the ALHAMBRA Survey Pablo Arnalte-Mur (Observatori Astronòmic - Univ. de València) with L. Hurtado-Gil (OAUV/IFCA), V.J. Martínez (OAUV), A. Fernández-Soto (IFCA) & The

More information

Homework on Properties of Galaxies in the Hubble Deep Field Name: Due: Friday, April 8 30 points Prof. Rieke & TA Melissa Halford

Homework on Properties of Galaxies in the Hubble Deep Field Name: Due: Friday, April 8 30 points Prof. Rieke & TA Melissa Halford Homework on Properties of Galaxies in the Hubble Deep Field Name: Due: Friday, April 8 30 points Prof. Rieke & TA Melissa Halford You are going to work with some famous astronomical data in this homework.

More information

CS7267 MACHINE LEARNING

CS7267 MACHINE LEARNING CS7267 MACHINE LEARNING ENSEMBLE LEARNING Ref: Dr. Ricardo Gutierrez-Osuna at TAMU, and Aarti Singh at CMU Mingon Kang, Ph.D. Computer Science, Kennesaw State University Definition of Ensemble Learning

More information

Machine Learning Applications in Astronomy

Machine Learning Applications in Astronomy Machine Learning Applications in Astronomy Umaa Rebbapragada, Ph.D. Machine Learning and Instrument Autonomy Group Big Data Task Force November 1, 2017 Research described in this presentation was carried

More information

Boosting. CAP5610: Machine Learning Instructor: Guo-Jun Qi

Boosting. CAP5610: Machine Learning Instructor: Guo-Jun Qi Boosting CAP5610: Machine Learning Instructor: Guo-Jun Qi Weak classifiers Weak classifiers Decision stump one layer decision tree Naive Bayes A classifier without feature correlations Linear classifier

More information

Our astronomical filters have been supplied or installed in the followings.

Our astronomical filters have been supplied or installed in the followings. Astronomical Filters Asahi Spectra has supplied astronomical filters with science-grade to world famous observatories, institutes or universities for over 15 years. Unlike cheap astronomical filters for

More information

Homework #7: Properties of Galaxies in the Hubble Deep Field Name: Due: Friday, October points Profs. Rieke

Homework #7: Properties of Galaxies in the Hubble Deep Field Name: Due: Friday, October points Profs. Rieke Homework #7: Properties of Galaxies in the Hubble Deep Field Name: Due: Friday, October 31 30 points Profs. Rieke You are going to work with some famous astronomical data in this homework. The image data

More information

Natural Language Processing with Deep Learning. CS224N/Ling284

Natural Language Processing with Deep Learning. CS224N/Ling284 Natural Language Processing with Deep Learning CS224N/Ling284 Lecture 4: Word Window Classification and Neural Networks Christopher Manning and Richard Socher Classifica6on setup and nota6on Generally

More information

Aspects of large-scale structure. John Peacock UniverseNet Mytilene Sept 2007

Aspects of large-scale structure. John Peacock UniverseNet Mytilene Sept 2007 Aspects of large-scale structure John Peacock UniverseNet Mytilene Sept 2007 WMAP 2003 2dFGRS cone diagram: 4-degree wedge 220,000 redshifts 1997-2003 Simulating structure formation The Virgo consortium

More information

Photometric Redshifts, DES, and DESpec

Photometric Redshifts, DES, and DESpec Photometric Redshifts, DES, and DESpec Huan Lin, Photo-z s, DES, and DESpec, DESPec Workshop, KICP, Chicago, 30 May 2012 Outline DES photo-z calibrations: spectroscopic training set fields DES photo-z

More information

Bias/variance tradeoff, Model assessment and selec+on

Bias/variance tradeoff, Model assessment and selec+on Applied induc+ve learning Bias/variance tradeoff, Model assessment and selec+on Pierre Geurts Department of Electrical Engineering and Computer Science University of Liège October 29, 2012 1 Supervised

More information

Classifica(on and predic(on omics style. Dr Nicola Armstrong Mathema(cs and Sta(s(cs Murdoch University

Classifica(on and predic(on omics style. Dr Nicola Armstrong Mathema(cs and Sta(s(cs Murdoch University Classifica(on and predic(on omics style Dr Nicola Armstrong Mathema(cs and Sta(s(cs Murdoch University Classifica(on Learning Set Data with known classes Prediction Classification rule Data with unknown

More information

Algorithm-Independent Learning Issues

Algorithm-Independent Learning Issues Algorithm-Independent Learning Issues Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Spring 2007 c 2007, Selim Aksoy Introduction We have seen many learning

More information

Cosmic acceleration. Questions: What is causing cosmic acceleration? Vacuum energy (Λ) or something else? Dark Energy (DE) or Modification of GR (MG)?

Cosmic acceleration. Questions: What is causing cosmic acceleration? Vacuum energy (Λ) or something else? Dark Energy (DE) or Modification of GR (MG)? Cosmic acceleration 1998 Discovery 2000-2010: confirmation (CMB, LSS, SNe) more precise constraints w = -1 ± 0.2 (with assumptions) Questions: What is causing cosmic acceleration? Vacuum energy (Λ) or

More information

Photometric and Spectroscopic Observations of Type Ib Supernova SN 2012au by Kanata-Telescope

Photometric and Spectroscopic Observations of Type Ib Supernova SN 2012au by Kanata-Telescope 1 2012 December 14th Supernova meeting @ IPMU, Tokyo University Photometric and Spectroscopic Observations of Type Ib Supernova SN 2012au by Kanata-Telescope Katsutoshi Takaki (Hiroshima University) Coauthors

More information

Interstellar Dust and Gas

Interstellar Dust and Gas Interstellar Dust and Gas In 1783 William Herschel began a survey of the heavens using an 18 ¾ inch reflector of his own construction. His goal was to discover new star clusters, nebulae, and double stars.

More information

FINAL: CS 6375 (Machine Learning) Fall 2014

FINAL: CS 6375 (Machine Learning) Fall 2014 FINAL: CS 6375 (Machine Learning) Fall 2014 The exam is closed book. You are allowed a one-page cheat sheet. Answer the questions in the spaces provided on the question sheets. If you run out of room for

More information

A SALT Spectropolarimetric Survey of Supernovae ( S 4 ) K. Nordsieck Univ of Wisconsin

A SALT Spectropolarimetric Survey of Supernovae ( S 4 ) K. Nordsieck Univ of Wisconsin A SALT Spectropolarimetric Survey of Supernovae ( S 4 ) K. Nordsieck Univ of Wisconsin Supernova taxonomy Polarization of Supernovae Survey Structure Why SALT? Astrophysical questions SNIa Core Collapse

More information

UVA CS / Introduc8on to Machine Learning and Data Mining

UVA CS / Introduc8on to Machine Learning and Data Mining UVA CS 4501-001 / 6501 007 Introduc8on to Machine Learning and Data Mining Lecture 13: Probability and Sta3s3cs Review (cont.) + Naïve Bayes Classifier Yanjun Qi / Jane, PhD University of Virginia Department

More information

Data Mining Classification: Basic Concepts and Techniques. Lecture Notes for Chapter 3. Introduction to Data Mining, 2nd Edition

Data Mining Classification: Basic Concepts and Techniques. Lecture Notes for Chapter 3. Introduction to Data Mining, 2nd Edition Data Mining Classification: Basic Concepts and Techniques Lecture Notes for Chapter 3 by Tan, Steinbach, Karpatne, Kumar 1 Classification: Definition Given a collection of records (training set ) Each

More information

CSE546: SVMs, Dual Formula5on, and Kernels Winter 2012

CSE546: SVMs, Dual Formula5on, and Kernels Winter 2012 CSE546: SVMs, Dual Formula5on, and Kernels Winter 2012 Luke ZeClemoyer Slides adapted from Carlos Guestrin Linear classifiers Which line is becer? w. = j w (j) x (j) Data Example i Pick the one with the

More information

Generative Model (Naïve Bayes, LDA)

Generative Model (Naïve Bayes, LDA) Generative Model (Naïve Bayes, LDA) IST557 Data Mining: Techniques and Applications Jessie Li, Penn State University Materials from Prof. Jia Li, sta3s3cal learning book (Has3e et al.), and machine learning

More information

Learning with multiple models. Boosting.

Learning with multiple models. Boosting. CS 2750 Machine Learning Lecture 21 Learning with multiple models. Boosting. Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Learning with multiple models: Approach 2 Approach 2: use multiple models

More information

CS 6140: Machine Learning Spring 2017

CS 6140: Machine Learning Spring 2017 CS 6140: Machine Learning Spring 2017 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Logis@cs Assignment

More information

LSST, Euclid, and WFIRST

LSST, Euclid, and WFIRST LSST, Euclid, and WFIRST Steven M. Kahn Kavli Institute for Particle Astrophysics and Cosmology SLAC National Accelerator Laboratory Stanford University SMK Perspective I believe I bring three potentially

More information

Liverpool Telescope 2

Liverpool Telescope 2 Liverpool Telescope 2 Chris Copperwheat Liverpool Telescope group: Robert Barnsley, Stuart Bates, Neil Clay, Chris Davis, Jon Marchant, Chris Mottram, Robert Smith, Iain Steele Liverpool Telescope 2 The

More information

Be able to define the following terms and answer basic questions about them:

Be able to define the following terms and answer basic questions about them: CS440/ECE448 Section Q Fall 2017 Final Review Be able to define the following terms and answer basic questions about them: Probability o Random variables, axioms of probability o Joint, marginal, conditional

More information

1 Handling of Continuous Attributes in C4.5. Algorithm

1 Handling of Continuous Attributes in C4.5. Algorithm .. Spring 2009 CSC 466: Knowledge Discovery from Data Alexander Dekhtyar.. Data Mining: Classification/Supervised Learning Potpourri Contents 1. C4.5. and continuous attributes: incorporating continuous

More information

Midterm: CS 6375 Spring 2018

Midterm: CS 6375 Spring 2018 Midterm: CS 6375 Spring 2018 The exam is closed book (1 cheat sheet allowed). Answer the questions in the spaces provided on the question sheets. If you run out of room for an answer, use an additional

More information

Interstellar Dust and Gas

Interstellar Dust and Gas Interstellar Dust and Gas In 1783 William Herschel began a survey of the heavens using an 18 ¾ inch reflector of his own construction. His goal was to discover new star clusters, nebulae, and double stars.

More information

Bayes Classifiers. CAP5610 Machine Learning Instructor: Guo-Jun QI

Bayes Classifiers. CAP5610 Machine Learning Instructor: Guo-Jun QI Bayes Classifiers CAP5610 Machine Learning Instructor: Guo-Jun QI Recap: Joint distributions Joint distribution over Input vector X = (X 1, X 2 ) X 1 =B or B (drinking beer or not) X 2 = H or H (headache

More information

LSST Science. Željko Ivezić, LSST Project Scientist University of Washington

LSST Science. Željko Ivezić, LSST Project Scientist University of Washington LSST Science Željko Ivezić, LSST Project Scientist University of Washington LSST@Europe, Cambridge, UK, Sep 9-12, 2013 OUTLINE Brief overview of LSST science drivers LSST science-driven design Examples

More information

Review for Exam 1. Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA

Review for Exam 1. Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA Review for Exam Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 0003 March 26, 204 Abstract Here are some things you need to know for the in-class

More information

The PRIsm MUlti-object Survey (PRIMUS)

The PRIsm MUlti-object Survey (PRIMUS) The PRIsm MUlti-object Survey (PRIMUS) Alison Coil University of Arizona Steward Observatory March 2008 Overview: Galaxy evolution to z ~ 1 is still cosmic variance limited: DEEP2, VVDS, COMBO-17, COSMOS

More information

An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology. Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University

An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology. Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University Why Do We Care? Necessity in today s labs Principled approach:

More information

Cosmic Ray Electrons with CTA. R.D. Parsons

Cosmic Ray Electrons with CTA. R.D. Parsons Cosmic Ray Electrons with CTA R.D. Parsons Cosmic Ray Electrons In addi:on to the well known hadronic component of cosmic rays there is a more poorly understood electronic component Has a lower flux than

More information

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012 Parametric Models Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics Maximum Likelihood Estimation Bayesian Density Estimation Today s Topics Maximum Likelihood

More information

Big Data Inference. Combining Hierarchical Bayes and Machine Learning to Improve Photometric Redshifts. Josh Speagle 1,

Big Data Inference. Combining Hierarchical Bayes and Machine Learning to Improve Photometric Redshifts. Josh Speagle 1, ICHASC, Apr. 25 2017 Big Data Inference Combining Hierarchical Bayes and Machine Learning to Improve Photometric Redshifts Josh Speagle 1, jspeagle@cfa.harvard.edu In collaboration with: Boris Leistedt

More information

Cosmological constraints from the 3rd year SNLS dataset

Cosmological constraints from the 3rd year SNLS dataset IAS Workshop on Dark Energy November 2008 Cosmological constraints from the 3rd year SNLS dataset preliminary results with focus on systematics Julien Guy LPNHE IN2P3/CNRS Univ. Paris VI & VII Systematic

More information

LSST. Pierre Antilogus LPNHE-IN2P3, Paris. ESO in the 2020s January 19-22, LSST ESO in the 2020 s 1

LSST. Pierre Antilogus LPNHE-IN2P3, Paris. ESO in the 2020s January 19-22, LSST ESO in the 2020 s 1 LSST Pierre Antilogus LPNHE-IN2P3, Paris ESO in the 2020s January 19-22, 2015 LSST ESO in the 2020 s 1 LSST in a Nutshell The LSST is an integrated survey system designed to conduct a decadelong, deep,

More information

The WFIRST High La/tude Survey. Christopher Hirata, for the SDT November 18, 2014

The WFIRST High La/tude Survey. Christopher Hirata, for the SDT November 18, 2014 The WFIRST High La/tude Survey Christopher Hirata, for the SDT November 18, 2014 1 Outline Recap of HLS parameters Examples of currently open trades & issues 2 High La/tude Survey Overview 3 Summary ü

More information

HST RAISINS: Doing WFIRST Science TODAY!

HST RAISINS: Doing WFIRST Science TODAY! HST RAISINS: Doing WFIRST Science TODAY! Robert Kirshner Harvard University & Gordon and Betty Moore Foundation Better knowledge of dark energy through infrared observations RAISIN1: 24 Targets from Pan-STARRS

More information

The Impact of Positional Uncertainty on Gamma-Ray Burst Environment Studies

The Impact of Positional Uncertainty on Gamma-Ray Burst Environment Studies The Impact of Positional Uncertainty on Gamma-Ray Burst Environment Studies Peter Blanchard Harvard University In collaboration with Edo Berger and Wen-fai Fong arxiv:1509.07866 Topics in AstroStatistics

More information

What makes good ensemble? CS789: Machine Learning and Neural Network. Introduction. More on diversity

What makes good ensemble? CS789: Machine Learning and Neural Network. Introduction. More on diversity What makes good ensemble? CS789: Machine Learning and Neural Network Ensemble methods Jakramate Bootkrajang Department of Computer Science Chiang Mai University 1. A member of the ensemble is accurate.

More information

Pan-Planets. A Search for Transiting Planets Around Cool stars. J. Koppenhoefer, Th. Henning and the Pan-PlanetS Team

Pan-Planets. A Search for Transiting Planets Around Cool stars. J. Koppenhoefer, Th. Henning and the Pan-PlanetS Team Pan-Planets A Search for Transiting Planets Around Cool stars J. Koppenhoefer, Th. Henning and the Pan-PlanetS Team Pan-STARRS 1: 1.8m prototype telescope operated on Haleakala/Hawaii consortium of few

More information

PAC-learning, VC Dimension and Margin-based Bounds

PAC-learning, VC Dimension and Margin-based Bounds More details: General: http://www.learning-with-kernels.org/ Example of more complex bounds: http://www.research.ibm.com/people/t/tzhang/papers/jmlr02_cover.ps.gz PAC-learning, VC Dimension and Margin-based

More information

High Redshift Universe

High Redshift Universe High Redshift Universe Finding high z galaxies Lyman break galaxies (LBGs) Photometric redshifts Deep fields Starburst galaxies Extremely red objects (EROs) Sub-mm galaxies Lyman α systems Finding high

More information

arxiv: v1 [astro-ph.im] 9 May 2013

arxiv: v1 [astro-ph.im] 9 May 2013 Astron. Nachr. / AN Volume, No. Issue, 1 4 (212) / DOI DOI Photo-Met: a non-parametric method for estimating stellar metallicity from photometric observations Gyöngyi Kerekes 1, István Csabai 1, László

More information