IACHEC 13, Apr , La Tenuta dei Ciclamini. CalStat WG Report. Vinay Kashyap (CXC/CfA)
|
|
- Tyler Harvey
- 5 years ago
- Views:
Transcription
1 IACHEC 13, Apr , La Tenuta dei Ciclamini CalStat WG Report Vinay Kashyap (CXC/CfA)
2 CalStats Working Group A forum for the discussion of statistical, methodological, and algorithmic issues that affect the calibration of astronomical instruments and how they are used in data analysis and interpretation of analysis results.
3 CalStats Working III WG Session 1, Tutorial on Gaussian Processes, David Jones VII (plenary) Updates to Concordance, Herman Marshall IX (plenary) Optimal binning and fit statistics for X-ray spectra, Jelle Kaastra XI WG Session 2, Binning and cstat (contd.)
4 CalStats Working III WG Session 1, Tutorial on Gaussian Processes, David Jones VII (plenary) Updates to Concordance, Herman Marshall IX (plenary) Optimal binning and fit statistics for X-ray spectra, Jelle Kaastra XI WG Session 2, Binning and cstat (contd.) If you are not on the CalStat WG mailing list
5 CalStats Working III WG Session 1, Tutorial on Gaussian Processes, David Jones VII (plenary) Updates to Concordance, Herman Marshall IX (plenary) Optimal binning and fit statistics for X-ray spectra, Jelle Kaastra XI WG Session 2, Binning and cstat (contd.) If you are not on the CalStat WG mailing list and would like to be,
6 CalStats Working III WG Session 1, Tutorial on Gaussian Processes, David Jones VII (plenary) Updates to Concordance, Herman Marshall IX (plenary) Optimal binning and fit statistics for X-ray spectra, Jelle Kaastra XI WG Session 2, Binning and cstat (contd.) If you are not on the CalStat WG mailing list and would like to be, send me an .
7 I would have definitely attended your session but I was too busy having fun.
8 I. Tutorial on Gaussian Process New methodologies are coming up rapidly in astronomical analysis: Hierarchical Bayes, Nested Sampling, Deep Learning, Gaussian Processes, etc. Gaussian Process is probably the most immediately useful technique for calibration problems, as it allows a semiparametric, data-driven accounting of fudge factors that are impossible to get away from in real world calibration A tutorial was conducted on Apr 9 by statistician David Jones (Duke/SAMSI and TAMU)
9 David Jones Mention of Gaussian Process'' in SAO/NASA ADS Abstract /82 12/86 01/87 12/91 01/92 12/96 01/97 12/01 01/02 12/06 01/07 12/11 01/12 12/16 I
10 David Jones 2 y = f(x) x
11 ~y ~y David Jones 2 ~y ~y N ~ ~ =,! ~y ~y N ~y, y = f(x) x
12 x David Jones 2 y 0 2
13 x I y,...,y m x,...,x m ~y N ~, + t I m David Jones 2 I ij = R (x i,x j ) ~y N ~f,t Im ~ f N ~, y 0 ~ f =(f (x ),...,f (xm )) T 2
14 I. Tutorial on Gaussian Process Some resources for further learning Gaussian Processes for Machine Learning, Rasmussen and Williams 2006, MIT Press The Kernel Cookbook, David Duvenaud Beyond Chi-Squared: An Introduction to Correlated Noise, Ben Montet Fitting Gaussian Process Models in Python, Chris Fonnesbeck Contact David Jones if you want assistance with a project
15 II. Update on Concordance On Apr 10, Herman Marshall (MIT) discussed the status of the Concordance project and discussed the process from an IACHEC perspective A paper describing the full statistical foundation of the method has been submitted to a statistics journal and is on the verge of resubmission after dealing with the referees reports Calibration Concordance for Astronomical Instruments via Multiplicative Shrinkage, Chen, Meng, Wang, van Dyk, Marshall, & Kashyap 2018, submitted to Journal of Applied Statistical Methods A trial run describing astronomically relevant analysis procedures will be presented at SPIE 2018 (Astronomical Instrumentation and Operations), with follow-on submission to JATIS An astronomy oriented paper which includes variable prior uncertainty factors and applications to other datasets (e.g., strong lines from Capella in Chandra gratings) is in preparation (Marshall et al. 201X)
16 II. Update on Concordance To complete analysis, we need: τ a measure of the prior uncertainty for detectors over different energy bands DONE datasets compilations of homogeneously estimated fluxes for simultaneously (or in some cases contemporaneously) observed sources. Perhaps easier to send Herman spectra and corresponding ARFs and RMFs (via Heritage WG).
17
18 III. A Practical Guide On Apr 11, Jelle Kaastra (SRON) gave a plenary talk on recent advances he has made 1.on optimal binning of RMFs a prescription for how to determine the most informative binning scheme given instrumental features (LSF, effective area) and counts in the spectrum, see Kaastra & Bleeker 2016 (A&A 587, A151) 2.on computing goodness of fit measures when using the cstat fit statistic calculating the expected contribution of a nominal model intensity in a bin to cstat (and its variance), averaged over all possible counts, and presenting it as a lookup table for ease of computation, see Kaastra 2017 (A&A 605, A51) and followed it up with a detailed discussion during the afternoon WG session. Keith Arnaud (GSFC) reports from afar: the optimal binning scheme is implemented in the new tool ftgrouppha (there s a bug for square RMFs) and an unreleased tool that bins the RMF along the energy-axis.
19 Monte Carlo results Jelle Kaastra (Data binning) Order 2 Order 1 Order 0 ( SPEX recommended ) ( classical approach)
20 Jelle Kaastra
21 Jelle Kaastra
22 Jelle Kaastra
23 Jelle Kaastra
24 Jelle Kaastra
25 Jelle Kaastra Estimating the contribution to cstat from each bin, given the expected model intensity in the bin; tabulated as a look-up table and interpolated therefrom 41
26 III. A Practical Guide A recommendation was made to write a practical guide to best practices in X-ray analysis [I will set up an overleaf document and ask CalStat WG members to contribute sections.] Wstat is an alternative statistic in XSPEC that computes maximum likelihood source and background intensities assuming Poisson regime and using observed counts in source and background. This can lead to bad fits when background counts fluctuate and/or model intensities are unstable. Jelle recommends that spectral fitting always be done by simultaneous fitting of background and source models, or computing a smooth background and adding it to the source. Apropos to that, would be a good idea for all missions to describe how to set up a model background spectrum Asked of Jelle that power of cstat parameterization be computed (how often is a bad fit accepted as good?); Monte Carlo uncertainties for cstat goodness-of-fit be calculated to show fluctuations in the asymptotic limits are as expected; simulations be carried out to see how a continuumdominated vs line-dominated spectrum affect goodness of fit estimates. Some questions require consultation with statisticians. E.g., what effect does determining binning from the data have on the process of the fit? Can we compute χ² and determine goodness from that? How robust is the K-S test (or equivalent) to measure goodness?
27 Next year s theme High resolution spectra
MONTE CARLO METHODS FOR TREATING AND UNDERSTANDING HIGHLY-CORRELATED INSTRUMENT CALIBRATION UNCERTAINTIES
JEREMY DRAKE, PETE RATZLAFF, VINAY KASHYAP AND THE MC CALIBRATION UNCERTAINTIES TEAM MONTE CARLO METHODS FOR TREATING AND UNDERSTANDING HIGHLY-CORRELATED INSTRUMENT CALIBRATION UNCERTAINTIES Harvard Astrostatistics
More information1 Statistics Aneta Siemiginowska a chapter for X-ray Astronomy Handbook October 2008
1 Statistics Aneta Siemiginowska a chapter for X-ray Astronomy Handbook October 2008 1.1 Introduction Why do we need statistic? Wall and Jenkins (2003) give a good description of the scientific analysis
More informationJEREMY DRAKE, PETE RATZLAFF, VINAY KASHYAP AND THE MC CALIBRATION UNCERTAINTIES TEAM MONTE CARLO CONSTRAINTS ON INSTRUMENT CALIBRATION
JEREMY DRAKE, PETE RATZLAFF, VINAY KASHYAP AND THE MC CALIBRATION UNCERTAINTIES TEAM MONTE CARLO CONSTRAINTS ON INSTRUMENT CALIBRATION 11th IACHEC Meeting, Pune March 2016 JEREMY DRAKE, PETE RATZLAFF,
More informationAnalysis Challenges. Lynx Data: From Chandra to Lynx : 2017 Aug 8-10, Cambridge MA
From Chandra to Lynx : 2017 Aug 8-10, Cambridge MA Lynx Data: Analysis Challenges Vinay Kashyap (CHASC/CXC/CfA) Pat Broos (Penn State), Peter Freeman (CMU), Andrew Ptak (GSFC), Aneta Siemiginowska (CfA),
More informationAccounting for Calibration Uncertainty in Spectral Analysis. David A. van Dyk
Accounting for in Spectral Analysis David A van Dyk Statistics Section, Imperial College London Joint work with Vinay Kashyap, Jin Xu, Alanna Connors, and Aneta Siegminowska IACHEC March 2013 David A van
More informationStatistical Applications in the Astronomy Literature II Jogesh Babu. Center for Astrostatistics PennState University, USA
Statistical Applications in the Astronomy Literature II Jogesh Babu Center for Astrostatistics PennState University, USA 1 The likelihood ratio test (LRT) and the related F-test Protassov et al. (2002,
More informationpyblocxs Bayesian Low-Counts X-ray Spectral Analysis in Sherpa
pyblocxs Bayesian Low-Counts X-ray Spectral Analysis in Sherpa Aneta Siemiginowska Harvard-Smithsonian Center for Astrophysics Vinay Kashyap (CfA), David Van Dyk (UCI), Alanna Connors (Eureka), T.Park(Korea)+CHASC
More informationAccounting for Calibration Uncertainty in Spectral Analysis. David A. van Dyk
Bayesian Analysis of Accounting for in Spectral Analysis David A van Dyk Statistics Section, Imperial College London Joint work with Vinay Kashyap, Jin Xu, Alanna Connors, and Aneta Siegminowska ISIS May
More informationSpectral Analysis of High Resolution X-ray Binary Data
Spectral Analysis of High Resolution X-ray Binary Data Michael Nowak, mnowak@space.mit.edu X-ray Astronomy School; Aug. 1-5, 2011 Introduction This exercise takes a look at X-ray binary observations using
More information10 th IACHEC meeting: concluding remarks and agreements. Matteo Guainazzi (ASTRO-H ESAC SOC & JAXA SOT)
10 th IACHEC meeting: concluding remarks and agreements Matteo Guainazzi (ASTRO-H ESAC SOC & JAXA SOT) ASTRO-H NICER Polar 2015 2017 HXMT erosita Astrosat Concluding remarks, Black Holes and their Friends,
More informationContamination WG Summary
Contamination WG Summary Eric D. Miller (MIT) Membership Eric Miller (chair, Suzaku, Hitomi) Andy Beardmore (Swift) Akos Bogdan (Chandra) Dave Burrows (Swift) Vadim Burwitz (erosita) Sunil Chandra (Astrosat)
More informationThe High Energy Transmission Grating Spectrometer
HETGS Update Herman Marshall The High Energy Transmission Grating Spectrometer [HETGS, 1] is essentially unchanged since launch. The grating efficiencies were updated in 011 to bring the high and medium
More informationAccounting for Calibration Uncertainty
: High Energy Astrophysics and the PCG Sampler 1 Vinay Kashyap 2 Taeyoung Park 3 Jin Xu 4 Imperial-California-Harvard AstroStatistics Collaboration 1 Statistics Section, Imperial College London 2 Smithsonian
More informationXMM-Newton Chandra Blazar Flux Comparison. M.J.S. Smith (ESAC) & H. Marshall (MIT) 7 th IACHEC, Napa, March 2012
XMM-Newton Chandra Blazar Flux Comparison M.J.S. Smith (ESAC) & H. Marshall (MIT) 7 th IACHEC, Napa, March 2012 Blazar Sample Objective: Comparison of XMM-Newton Chandra fluxes in various bands. Using
More informationNeutron inverse kinetics via Gaussian Processes
Neutron inverse kinetics via Gaussian Processes P. Picca Politecnico di Torino, Torino, Italy R. Furfaro University of Arizona, Tucson, Arizona Outline Introduction Review of inverse kinetics techniques
More informationIntroduction to Bayesian Learning. Machine Learning Fall 2018
Introduction to Bayesian Learning Machine Learning Fall 2018 1 What we have seen so far What does it mean to learn? Mistake-driven learning Learning by counting (and bounding) number of mistakes PAC learnability
More informationChallenges and Methods for Massive Astronomical Data
Challenges and Methods for Massive Astronomical Data mini-workshop on Computational AstroStatistics The workshop is sponsored by CHASC/C-BAS, NSF grants DMS 09-07185 (HU) and DMS 09-07522 (UCI), and the
More informationWorking Group. Vadim Burwitz. for High Energy Calibration Apr , Frascati, Italy
Update on the White Dwarf (+ ins) Working Group Vadim Burwitz I t ti l A t i l C ti International Astronomical Consortium for High Energy Calibration Apr. 10-14 2011, Frascati, Italy WG Members White Dwarfs
More informationX-ray spectral Analysis
X-ray spectral Analysis xamples Problems Algorithm Model types Statistic Fitting procedure Practical problems with Chandra CCD data Disk N(N) Disk N(S) Nucleus Plume Based partly on the lecture given by
More informationOverlapping Astronomical Sources: Utilizing Spectral Information
Overlapping Astronomical Sources: Utilizing Spectral Information David Jones Advisor: Xiao-Li Meng Collaborators: Vinay Kashyap (CfA) and David van Dyk (Imperial College) CHASC Astrostatistics Group April
More informationBrandon C. Kelly (Harvard Smithsonian Center for Astrophysics)
Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Probability quantifies randomness and uncertainty How do I estimate the normalization and logarithmic slope of a X ray continuum, assuming
More informationFully Bayesian Analysis of Calibration Uncertainty In High Energy Spectral Analysis
In High Energy Spectral Analysis Department of Statistics, UCI February 26, 2013 Model Building Principle Component Analysis Three Inferencial Models Simulation Quasar Analysis Doubly-intractable Distribution
More informationHigh Energy Astrophysics:
High Energy Astrophysics: What do Statistical Methods Have to Offer? David van Dyk Department of Statistics University of California, Irvine Joint work with The California-Harvard Astrostatistics Collaboration
More informationMachine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function.
Bayesian learning: Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Let y be the true label and y be the predicted
More informationFitting Narrow Emission Lines in X-ray Spectra
Outline Fitting Narrow Emission Lines in X-ray Spectra Taeyoung Park Department of Statistics, University of Pittsburgh October 11, 2007 Outline of Presentation Outline This talk has three components:
More informationNew Results of Fully Bayesian
UCI April 3, 2012 Calibration Samples Principle Component Analysis Model Building Three source parameter sampling schemes Simulation Quasar data sets Speed Up Pragmatic Bayesian Method Frequency Analysis
More informationStatistical Tools and Techniques for Solar Astronomers
Statistical Tools and Techniques for Solar Astronomers Alexander W Blocker Nathan Stein SolarStat 2012 Outline Outline 1 Introduction & Objectives 2 Statistical issues with astronomical data 3 Example:
More informationCHAPTER 4 PROBABILITY AND COUNTING RULES UC DENVER
page 1 / 6 page 2 / 6 chapter 4 probability and pdf Chapter 2- Statistics, Probability and Noise 13 Sample number 0 64 128 192 256 320 384 448 512-4-2 0 2 4 6 8 511 a. Mean = 0.5, F = 1 Sample number 0
More informationPoS(ICRC2017)765. Towards a 3D analysis in Cherenkov γ-ray astronomy
Towards a 3D analysis in Cherenkov γ-ray astronomy Jouvin L. 1, Deil C. 2, Donath A. 2, Kerszberg D. 3, Khelifi B. 1, Lemière A. 1, Terrier R. 1,. E-mail: lea.jouvin@apc.in2p3.fr 1 APC (UMR 7164, CNRS,
More informationPILCO: A Model-Based and Data-Efficient Approach to Policy Search
PILCO: A Model-Based and Data-Efficient Approach to Policy Search (M.P. Deisenroth and C.E. Rasmussen) CSC2541 November 4, 2016 PILCO Graphical Model PILCO Probabilistic Inference for Learning COntrol
More informationChandra Analysis of a Possible Cooling Core Galaxy Cluster at z = 1.03
Chandra Analysis of a Possible Cooling Core Galaxy Cluster at z = 1.03 Kyle Dolan Institute for Astronomy, University of Hawaii at Manoa (Dated: 12 August 2005) We present an analysis of Chandra observations
More informationLegacy IACHEC Working Group: the first steps
Legacy IACHEC Working Group: the first steps Matteo Guainazzi 1 & Andy Pollock 2 1 Astro-H & MM-Newton ESA-SOC, ESAC, Spain 2 GAIA and multi-mission Archive Scientist, ESA-SOC, ESA, Spain Scope Provide
More informationGaussian processes. Chuong B. Do (updated by Honglak Lee) November 22, 2008
Gaussian processes Chuong B Do (updated by Honglak Lee) November 22, 2008 Many of the classical machine learning algorithms that we talked about during the first half of this course fit the following pattern:
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is
More informationDeep learning with differential Gaussian process flows
Deep learning with differential Gaussian process flows Pashupati Hegde Markus Heinonen Harri Lähdesmäki Samuel Kaski Helsinki Institute for Information Technology HIIT Department of Computer Science, Aalto
More informationData Analysis I. Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK. 10 lectures, beginning October 2006
Astronomical p( y x, I) p( x, I) p ( x y, I) = p( y, I) Data Analysis I Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK 10 lectures, beginning October 2006 4. Monte Carlo Methods
More informationFully Bayesian Analysis of Low-Count Astronomical Images
Fully Bayesian Analysis of Low-Count Astronomical Images 1 Alanna Connors 2 1 Department of Statistics University of California, Irvine 2 Eurika Scientific Thanks to James Chiang, Adam Roy, and The California
More informationStatistics and Data Analysis
Statistics and Data Analysis The Crash Course Physics 226, Fall 2013 "There are three kinds of lies: lies, damned lies, and statistics. Mark Twain, allegedly after Benjamin Disraeli Statistics and Data
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy If your experiment needs statistics, you ought to have done a better experiment. -Ernest Rutherford Lecture 1 Lecture 2 Why do we need statistics? Definitions Statistical
More informationCan you predict the future..?
Can you predict the future..? Gaussian Process Modelling for Forward Prediction Anna Scaife 1 1 Jodrell Bank Centre for Astrophysics University of Manchester @radastrat September 7, 2017 Anna Scaife University
More informationStatistical techniques for data analysis in Cosmology
Statistical techniques for data analysis in Cosmology arxiv:0712.3028; arxiv:0911.3105 Numerical recipes (the bible ) Licia Verde ICREA & ICC UB-IEEC http://icc.ub.edu/~liciaverde outline Lecture 1: Introduction
More informationXSPEC. Keith Arnaud. Center for Research Excellence in Space Science and Technology
XSPEC Keith Arnaud Center for Research Excellence in Space Science and Technology University of Maryland College Park and NASA s Goddard Space Flight Center 9,525 refereed papers containing the word xspec
More informationHierarchical Bayesian Modeling
Hierarchical Bayesian Modeling Making scientific inferences about a population based on many individuals Angie Wolfgang NSF Postdoctoral Fellow, Penn State Astronomical Populations Once we discover an
More informationError Reporting Recommendations: A Report of the Standards and Criteria Committee
Error Reporting Recommendations: A Report of the Standards and Criteria Committee Adopted by the IXS Standards and Criteria Committee July 26, 2000 1. Introduction The development of the field of x-ray
More informationHypothesis testing:power, test statistic CMS:
Hypothesis testing:power, test statistic The more sensitive the test, the better it can discriminate between the null and the alternative hypothesis, quantitatively, maximal power In order to achieve this
More informationEmpirical Bayes Moderation of Asymptotically Linear Parameters
Empirical Bayes Moderation of Asymptotically Linear Parameters Nima Hejazi Division of Biostatistics University of California, Berkeley stat.berkeley.edu/~nhejazi nimahejazi.org twitter/@nshejazi github/nhejazi
More informationPractical Statistics
Practical Statistics Lecture 1 (Nov. 9): - Correlation - Hypothesis Testing Lecture 2 (Nov. 16): - Error Estimation - Bayesian Analysis - Rejecting Outliers Lecture 3 (Nov. 18) - Monte Carlo Modeling -
More informationEVIDENCE OF INTERMEDIATE-SCALE ENERGY SPECTRUM ANISOTROPY IN THE NORTHERN HEMISPHERE FROM TELESCOPE ARRAY
EVIDENCE OF INTERMEDIATE-SCALE ENERGY SPECTRUM ANISOTROPY IN THE NORTHERN HEMISPHERE FROM TELESCOPE ARRAY Jon Paul Lundquist for the Telescope Array Collaboration ABSTRACT Evidence of an energy dependent
More informationEffective Areas. Herman L. Marshall Nov. 17, 2014
Effective Areas Herman L. Marshall Nov. 17, 2014 1 Effective Area Overview Geometric Area (entrance annuli - strut area = Ag) Two mirror bounces (RIr 2 ) Grating Dispersion Efficiency (TTG) ACIS/HRC Optical
More informationX-ray data analysis. Andrea Marinucci. Università degli Studi Roma Tre
X-ray data analysis Andrea Marinucci Università degli Studi Roma Tre marinucci@fis.uniroma3.it Goal of these lectures X-ray data analysis why? what? how? How? This is intentended to be a general reference
More informationarxiv: v1 [stat.me] 24 May 2010
The role of the nugget term in the Gaussian process method Andrey Pepelyshev arxiv:1005.4385v1 [stat.me] 24 May 2010 Abstract The maximum likelihood estimate of the correlation parameter of a Gaussian
More informationChapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang
Chapter 4 Dynamic Bayesian Networks 2016 Fall Jin Gu, Michael Zhang Reviews: BN Representation Basic steps for BN representations Define variables Define the preliminary relations between variables Check
More informationOrganization. I MCMC discussion. I project talks. I Lecture.
Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems
More informationNuSTAR observation of the Arches cluster: X-ray spectrum extraction from a 2D image
NuSTAR observation of the Arches cluster: X-ray spectrum extraction from a 2D image Space Research Institute (IKI), Moscow, Russia E-mail: krivonos@iki.rssi.ru The NuSTAR mission performed a long (200
More informationImproving the Relative Accuracy of the HETGS Effective Area
October 14, 2005 Improving the Relative Accuracy of the HETGS Effective Area Herman L. Marshall (MIT Kavli Institute) hermanm@space.mit.edu ABSTRACT I present updates to the HETGS grating efficiencies.
More informationCOMP 551 Applied Machine Learning Lecture 20: Gaussian processes
COMP 55 Applied Machine Learning Lecture 2: Gaussian processes Instructor: Ryan Lowe (ryan.lowe@cs.mcgill.ca) Slides mostly by: (herke.vanhoof@mcgill.ca) Class web page: www.cs.mcgill.ca/~hvanho2/comp55
More informationParameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1
Parameter Estimation William H. Jefferys University of Texas at Austin bill@bayesrules.net Parameter Estimation 7/26/05 1 Elements of Inference Inference problems contain two indispensable elements: Data
More informationA short introduction to INLA and R-INLA
A short introduction to INLA and R-INLA Integrated Nested Laplace Approximation Thomas Opitz, BioSP, INRA Avignon Workshop: Theory and practice of INLA and SPDE November 7, 2018 2/21 Plan for this talk
More informationContents. Part I: Fundamentals of Bayesian Inference 1
Contents Preface xiii Part I: Fundamentals of Bayesian Inference 1 1 Probability and inference 3 1.1 The three steps of Bayesian data analysis 3 1.2 General notation for statistical inference 4 1.3 Bayesian
More informationPattern Recognition and Machine Learning. Bishop Chapter 2: Probability Distributions
Pattern Recognition and Machine Learning Chapter 2: Probability Distributions Cécile Amblard Alex Kläser Jakob Verbeek October 11, 27 Probability Distributions: General Density Estimation: given a finite
More informationNonparametric Bayesian Methods (Gaussian Processes)
[70240413 Statistical Machine Learning, Spring, 2015] Nonparametric Bayesian Methods (Gaussian Processes) Jun Zhu dcszj@mail.tsinghua.edu.cn http://bigml.cs.tsinghua.edu.cn/~jun State Key Lab of Intelligent
More informationDD Advanced Machine Learning
Modelling Carl Henrik {chek}@csc.kth.se Royal Institute of Technology November 4, 2015 Who do I think you are? Mathematically competent linear algebra multivariate calculus Ok programmers Able to extend
More informationXMM-Newton Calibration
XMM-Newton Calibration Michael Smith, on behalf of XMM-SOC and Instrument Teams 18 th XMM-Newton Users Group Meeting, ESAC, 11 May 2017 ESA UNCLASSIFIED - For Official Use Outline 1. Status of calibration
More informationHierarchical Bayesian Modeling
Hierarchical Bayesian Modeling Making scientific inferences about a population based on many individuals Angie Wolfgang NSF Postdoctoral Fellow, Penn State Astronomical Populations Once we discover an
More informationStatistics. Lecture 2 August 7, 2000 Frank Porter Caltech. The Fundamentals; Point Estimation. Maximum Likelihood, Least Squares and All That
Statistics Lecture 2 August 7, 2000 Frank Porter Caltech The plan for these lectures: The Fundamentals; Point Estimation Maximum Likelihood, Least Squares and All That What is a Confidence Interval? Interval
More informationBig Data Inference. Combining Hierarchical Bayes and Machine Learning to Improve Photometric Redshifts. Josh Speagle 1,
ICHASC, Apr. 25 2017 Big Data Inference Combining Hierarchical Bayes and Machine Learning to Improve Photometric Redshifts Josh Speagle 1, jspeagle@cfa.harvard.edu In collaboration with: Boris Leistedt
More informationConnections between score matching, contrastive divergence, and pseudolikelihood for continuous-valued variables. Revised submission to IEEE TNN
Connections between score matching, contrastive divergence, and pseudolikelihood for continuous-valued variables Revised submission to IEEE TNN Aapo Hyvärinen Dept of Computer Science and HIIT University
More informationHierarchical Bayesian Modeling of Planet Populations
Hierarchical Bayesian Modeling of Planet Populations You ve found planets in your data (or not)...... now what?! Angie Wolfgang NSF Postdoctoral Fellow, Penn State Why Astrostats? This week: a sample of
More informationLecture : Probabilistic Machine Learning
Lecture : Probabilistic Machine Learning Riashat Islam Reasoning and Learning Lab McGill University September 11, 2018 ML : Many Methods with Many Links Modelling Views of Machine Learning Machine Learning
More informationEmbedding Astronomical Computer Models into Principled Statistical Analyses. David A. van Dyk
Embedding Astronomical Computer Models into Principled Statistical Analyses Statistics Section, Imperial College London University of New South Wales, January 2012 Outline 1 2 Model for 3 Computer Models
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy Probability (Lecture 1) Statistics (Lecture 2) Why do we need statistics? Useful Statistics Definitions Error Analysis Probability distributions Error Propagation Binomial
More informationADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING. Non-linear regression techniques Part - II
1 Non-linear regression techniques Part - II Regression Algorithms in this Course Support Vector Machine Relevance Vector Machine Support vector regression Boosting random projections Relevance vector
More informationPART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics
Table of Preface page xi PART I INTRODUCTION 1 1 The meaning of probability 3 1.1 Classical definition of probability 3 1.2 Statistical definition of probability 9 1.3 Bayesian understanding of probability
More informationHow to build an automatic statistician
How to build an automatic statistician James Robert Lloyd 1, David Duvenaud 1, Roger Grosse 2, Joshua Tenenbaum 2, Zoubin Ghahramani 1 1: Department of Engineering, University of Cambridge, UK 2: Massachusetts
More informationStatistics 360/601 Modern Bayesian Theory
Statistics 360/601 Modern Bayesian Theory Alexander Volfovsky Lecture 8 - Sept 25, 2018 Monte Carlo 1 2 Monte Carlo approximation Want to compute Z E[ y] = p( y)d without worrying about actual integration...
More informationBayesian Estimation of log N log S
Bayesian Estimation of log N log S Paul D. Baines Department of Statistics University of California, Davis May 10th, 2013 Introduction Project Goals Develop a comprehensive method to infer (properties
More informationCalibration Activities the MOS perspective
Calibration Activities the perspective Changing the Quantum Efficiency Calibration: Motivation and Justification. Flux comparison using a sample (17) of AGN observations: as presented at MPE (May 2006)
More informationRecurrent Latent Variable Networks for Session-Based Recommendation
Recurrent Latent Variable Networks for Session-Based Recommendation Panayiotis Christodoulou Cyprus University of Technology paa.christodoulou@edu.cut.ac.cy 27/8/2017 Panayiotis Christodoulou (C.U.T.)
More informationComputational Challenges from Imaging X-ray Polarimetry. Herman L. Marshall (MIT) and the IXPE Team
Computational Challenges from Imaging X-ray Polarimetry Herman L. Marshall (MIT) and the IXPE Team Outline Introduction to Polarimetry IXPE: the Imaging X-ray Polarization Explorer Computational Challenges
More informationExpectation Propagation for Approximate Bayesian Inference
Expectation Propagation for Approximate Bayesian Inference José Miguel Hernández Lobato Universidad Autónoma de Madrid, Computer Science Department February 5, 2007 1/ 24 Bayesian Inference Inference Given
More informationBERTINORO 2 (JVW) Yet more probability Bayes' Theorem* Monte Carlo! *The Reverend Thomas Bayes
BERTINORO 2 (JVW) Yet more probability Bayes' Theorem* Monte Carlo! *The Reverend Thomas Bayes 1702-61 1 The Power-law (Scale-free) Distribution N(>L) = K L (γ+1) (integral form) dn = (γ+1) K L γ dl (differential
More informationBayesian Deep Learning
Bayesian Deep Learning Mohammad Emtiyaz Khan AIP (RIKEN), Tokyo http://emtiyaz.github.io emtiyaz.khan@riken.jp June 06, 2018 Mohammad Emtiyaz Khan 2018 1 What will you learn? Why is Bayesian inference
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY PHYSICS DEPARTMENT
G. Clark 7oct96 1 MASSACHUSETTS INSTITUTE OF TECHNOLOGY PHYSICS DEPARTMENT 8.13/8.14 Junior Laboratory STATISTICS AND ERROR ESTIMATION The purpose of this note is to explain the application of statistics
More informationBAYESIAN CLASSIFICATION OF HIGH DIMENSIONAL DATA WITH GAUSSIAN PROCESS USING DIFFERENT KERNELS
BAYESIAN CLASSIFICATION OF HIGH DIMENSIONAL DATA WITH GAUSSIAN PROCESS USING DIFFERENT KERNELS Oloyede I. Department of Statistics, University of Ilorin, Ilorin, Nigeria Corresponding Author: Oloyede I.,
More informationGenerative Learning algorithms
CS9 Lecture notes Andrew Ng Part IV Generative Learning algorithms So far, we ve mainly been talking about learning algorithms that model p(y x; θ), the conditional distribution of y given x. For instance,
More informationObservational Astrophysics 2
Observational Astrophysics 2 Introduction to the Course Christoph U. Keller Christoph U. Keller, Utrecht University, C.U.Keller@uu.nl Observational Astrophysics 2: Introduction to the Course 1 Outline
More informationSTAT 518 Intro Student Presentation
STAT 518 Intro Student Presentation Wen Wei Loh April 11, 2013 Title of paper Radford M. Neal [1999] Bayesian Statistics, 6: 475-501, 1999 What the paper is about Regression and Classification Flexible
More informationAdvanced Introduction to Machine Learning CMU-10715
Advanced Introduction to Machine Learning CMU-10715 Gaussian Processes Barnabás Póczos http://www.gaussianprocess.org/ 2 Some of these slides in the intro are taken from D. Lizotte, R. Parr, C. Guesterin
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationIntroduction to Gaussian Processes
Introduction to Gaussian Processes Neil D. Lawrence GPSS 10th June 2013 Book Rasmussen and Williams (2006) Outline The Gaussian Density Covariance from Basis Functions Basis Function Representations Constructing
More informationSTA414/2104 Statistical Methods for Machine Learning II
STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements
More informationGaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012
Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature
More informationXMM-Newton SOC Technical Note
XMM-Newton SOC Technical Note XMM-SOC-CAL-TN-0082 Accuracy of energy reconstruction in EPIC-MOS Timing Mode M. Guainazzi April 6, 2009 History Version Date Editor Note 1.0 April 6, 2009 M.Guainazzi SASv8.0
More informationTarget Tracking and Classification using Collaborative Sensor Networks
Target Tracking and Classification using Collaborative Sensor Networks Xiaodong Wang Department of Electrical Engineering Columbia University p.1/3 Talk Outline Background on distributed wireless sensor
More informationAn introduction to Bayesian statistics and model calibration and a host of related topics
An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the
More informationCalculating K corrections using S Lang and Sherpa
Calculating K corrections using S Lang and Sherpa Sherpa Threads (CIAO 3.4) Calculating K corrections using S Lang and Sherpa 1 Table of Contents Getting Started Setting up the spectral model Evaluate
More information15-388/688 - Practical Data Science: Basic probability. J. Zico Kolter Carnegie Mellon University Spring 2018
15-388/688 - Practical Data Science: Basic probability J. Zico Kolter Carnegie Mellon University Spring 2018 1 Announcements Logistics of next few lectures Final project released, proposals/groups due
More informationLocal Polynomial Modelling and Its Applications
Local Polynomial Modelling and Its Applications J. Fan Department of Statistics University of North Carolina Chapel Hill, USA and I. Gijbels Institute of Statistics Catholic University oflouvain Louvain-la-Neuve,
More informationMidterm: CS 6375 Spring 2015 Solutions
Midterm: CS 6375 Spring 2015 Solutions The exam is closed book. You are allowed a one-page cheat sheet. Answer the questions in the spaces provided on the question sheets. If you run out of room for an
More informationSetting UBVRI Photometric Zero-Points Using Sloan Digital Sky Survey ugriz Magnitudes
University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Martin Gaskell Publications Research Papers in Physics and Astronomy 10-1-2007 Setting UBVRI Photometric Zero-Points Using
More information