A mul&scale autocorrela&on func&on for anisotropy studies

Similar documents
Multiscale Autocorrelation Function: a new approach to anisotropy studies

Data Processing Techniques

Study of Two Metrics for Anisotropy in the Highest Energy Cosmic Rays

Some Review and Hypothesis Tes4ng. Friday, March 15, 13

Extreme value sta-s-cs of smooth Gaussian random fields in cosmology

REGRESSION AND CORRELATION ANALYSIS

The AUGER Experiment. D. Martello Department of Physics University of Salento & INFN Lecce. D. Martello Dep. of Physics Univ. of Salento & INFN LECCE

Linear Regression and Correla/on. Correla/on and Regression Analysis. Three Ques/ons 9/14/14. Chapter 13. Dr. Richard Jerz

Linear Regression and Correla/on

Physics 403. Segev BenZvi. Classical Hypothesis Testing: The Likelihood Ratio Test. Department of Physics and Astronomy University of Rochester

Parallel Tempering Algorithm in Monte Carlo Simula5on

Computer Vision. Pa0ern Recogni4on Concepts Part I. Luis F. Teixeira MAP- i 2012/13

Short introduc,on to the

The Pierre Auger Observatory: on the arrival directions of the most energetic cosmic rays

Structural Equa+on Models: The General Case. STA431: Spring 2013

Kirill Prokofiev (NYU)

Least Squares Parameter Es.ma.on

Summary of Columbia REU Research. ATLAS: Summer 2014

Study of the arrival directions of ultra-high-energy cosmic rays detected by the Pierre Auger Observatory

Applied Time Series Analysis FISH 507. Eric Ward Mark Scheuerell Eli Holmes

Bias/variance tradeoff, Model assessment and selec+on

Search for clustering of ultra high energy cosmic rays from the Pierre Auger Observatory

Two sample Test. Paired Data : Δ = 0. Lecture 3: Comparison of Means. d s d where is the sample average of the differences and is the

Latent Dirichlet Alloca/on

Lecture 12 The Level Set Approach for Turbulent Premixed Combus=on

Mixture Models. Michael Kuhn

Introduc)on to RNA- Seq Data Analysis. Dr. Benilton S Carvalho Department of Medical Gene)cs Faculty of Medical Sciences State University of Campinas

Courtesy of Jes Jørgensen

Sta$s$cs for Genomics ( )

Structural Equa+on Models: The General Case. STA431: Spring 2015

Sta$s$cal Significance Tes$ng In Theory and In Prac$ce

Pilot Evaluation of a UAS Detect-and-Avoid System s Effectiveness in Remaining Well Clear!

SKA machine learning perspec1ves for imaging, processing and analysis

Least Square Es?ma?on, Filtering, and Predic?on: ECE 5/639 Sta?s?cal Signal Processing II: Linear Es?ma?on

Youjun Lu. Na*onal Astronomical Observatory of China Collaborators: Fupeng ZHANG (SYSU) Qingjuan YU (KIAA)

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University. Motivations: Detection & Characterization. Lecture 2.

Introduc)on to the Design and Analysis of Experiments. Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering

Cellular automata, entropy and box- coun4ng dimension

Imaging and monitoring with industrial seismic noise.

Searches for cosmic ray anisotropies at ultra-high energies

The Mysteries of Quantum Mechanics

Molecular Programming Models. Based on notes by Dave Doty

Statistical Models for sequencing data: from Experimental Design to Generalized Linear Models

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model

CS 6140: Machine Learning Spring 2016

Bias in Arc*c Ocean SST Retrieval from Metop- A AVHRR. C J Merchant University of Reading

Lesson1: Peak proving

Learning about Black- Hole Forma5on by Observing Gravita5onal Waves. Michael Kesden (UT Dallas) PPC 2017 Mee5ng Corpus Chris5, TX May 22, 2017

Data Prepara)on. Dino Pedreschi. Anna Monreale. Università di Pisa

Sky Maps of High Resolution Fly s Eye Stereo Data Above ev

3D Textile PMC Damage Evolution: Effects of Material State & Morphology Variation

Announcements. Topics: Work On: - sec0ons 1.2 and 1.3 * Read these sec0ons and study solved examples in your textbook!

Hierarchical Probabilis.c Inference of Cosmic Shear

Overview: In addi:on to considering various summary sta:s:cs, it is also common to consider some visual display of the data Outline:

Reac%on coordinates and LSDMap

CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015

Partitioning the Parameter Space. Topic 18 Composite Hypotheses

Latest results on J/ψ produc6on in pp collisions from the ALICE experiment

Lecture 4: Parameter Es/ma/on and Confidence Intervals. GENOME 560, Spring 2015 Doug Fowler, GS

Announcements. Topics: Homework: - sec0ons 1.2, 1.3, and 2.1 * Read these sec0ons and study solved examples in your textbook!

Arrival directions of the highest-energy cosmic rays detected by the Pierre Auger Observatory

Lecture 17: Face Recogni2on

SERCH FOR LARGE-SCALE

Ensemble of Climate Models

ODEs + Singulari0es + Monodromies + Boundary condi0ons. Kerr BH ScaRering: a systema0c study. Schwarzschild BH ScaRering: Quasi- normal modes

Black Holes and Fireballs at the LHC. MPP Munich, Anastasios Talio7s Vrije Universiteit Brussel. arxiv: ; published in JHEP

A Search for Cosmic-ray Proton Anisotropy with the Fermi Large Area Telescope

Lecture 17: Face Recogni2on

Garvan Ins)tute Biosta)s)cal Workshop 16/6/2015. Tuan V. Nguyen. Garvan Ins)tute of Medical Research Sydney, Australia

Delphine Perrodin INAF-Osservatorio Astronomico di Cagliari (Italy) IPTA Student Week 2017, Sèvres, France

CHAPTER 6 : LITERATURE REVIEW

P E R E N C O - C H R I S T M A S P A R T Y

An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology. Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University

SM and jet measurements at the LHC

Networks. Can (John) Bruce Keck Founda7on Biotechnology Lab Bioinforma7cs Resource

The gamma-ray source-count distribution as a function of energy

Sta$s$cal sequence recogni$on

Applica'on of Mine Burial Expert System (MBES) to Mine Warfare (MW) Doctrine w/ Unmanned Underwater Vehicle Case Study

Cosmology. Introduction Geometry and expansion history (Cosmic Background Radiation) Growth Secondary anisotropies Large Scale Structure

Valida&on of Predic&ve Classifiers

UHECRs sources and the Auger data

Analysis of the modulation in the first harmonic of the right ascension distribution of cosmic rays detected at the Pierre Auger Observatory

Evaluation. Albert Bifet. April 2012

Approximating Riemannian Voronoi Diagrams and Delaunay triangulations.

Competition, Uncertainty, and Productivity Dispersion

Vladimir Zhdankin, JILA/CU-Boulder US-Japan Magne>c Reconnec>on Workshop, 3/7/2016

Streaming - 2. Bloom Filters, Distinct Item counting, Computing moments. credits:

Data Analysis I. Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK. 10 lectures, beginning October 2006

Differen'al Privacy with Bounded Priors: Reconciling U+lity and Privacy in Genome- Wide Associa+on Studies

Garvan Ins)tute Biosta)s)cal Workshop 16/7/2015. Tuan V. Nguyen. Garvan Ins)tute of Medical Research Sydney, Australia

Introduction to Particle Filters for Data Assimilation

High Energy Messenger Workshop KICP, June Foteini Oikonomou

Real- Time Management of Complex Resource Alloca8on Systems: Necessity, Achievements and Further Challenges

Daniele Vivolo INFN Sec/on of Naples

Correla'on. Keegan Korthauer Department of Sta's'cs UW Madison

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University

Finding the missing baryons by their mocon imprint on the Cosmic Microwave Background.

STAD68: Machine Learning

Quan&fying Uncertainty. Sai Ravela Massachuse7s Ins&tute of Technology

Transcription:

A mul&scale autocorrela&on func&on for anisotropy studies Mario Scuderi 1, M. De Domenico, H Lyberis and A. Insolia 1 Department of Physics and Astronomy & INFN Catania University ITALY DAA2011 Erice, 17 Apr 2011. 1

Outline: MAF Mul&scale Anisotropy Func&on Descrip&on of the method A first test Improvement (dynamical coun&ng procedure) MAF: Features and interpreta&on Quan&&es involved in detec&ng anisotropy Recovering the clustering scale Sta&s&cal features Under the null hypothesis Under the alterna&ve hypotesis 2

Take Home Message: MAF Features Method for anisotropy signal detec&on (small dataset) One parameter dependence (clustering scale) High discrimina&on power MAF Sta&s&cs Unbiased against the null hypothesis Penaliza&on analy&cally performed 3

MAF Mul&scale Autocorrela&on Func&on: defini&on Divide the observed sky Σ into N equal area boxes B i. Each box covers the solid angle Ω Σ The number of boxes defines the angular scale Θ by: 4

MAF Mul&scale Autocorrela&on Func&on: defini&on ψ i (Θ) ψ i (Θ) : the density of events falling into the box B i. : expected density of events falling in the box B i from an isotropic distribu&on of n points quan&fies the error in selec&ng the density ψ i (Θ) to approximate the density ψ i (Θ) 5

MAF Mul&scale Autocorrela&on Func&on: defini&on NOTE: s(θ) depends on the angular scale Θ Chance probability of s(θ): If H 0 denotes the null hypothesis of an underlying isotropic distribu&on for the data, the chance probability at the angular scale Θ, properly penalized because of the scan on Θ, is the probability 6

MAF: a first test 5000 isotropic realiza&on 5000 realiza&on :70% isotropic 30% normally distributed from 10 sources (spreading 5 0 ) 7

Dynamical coun&ng procedure New way to count events inside each box (dynamical coun&ng). Each point is extended into 8 weighted points whose distance from the original one is Θ/2 The weight of a single point is spread on the neighbours cells An Example: sta&c coun&ng is not able to recover the differences between the two configura&ons Monte Carlo skies producing the configura&on in Figure (a) are not frequently expected s(θ) should be greater than that one es&mated from the sta&c method lower chance probability in the case (a) 8

Detec&ng Anisotropy of small dataset Some quan&&es involved in detec&ng anisotropies: Anisotropic sky 40% of events are isotropic 60% of events are normally distributed, with dispersion ρ, around 10 random sources ρ = 5 0 ρ = 10 0 ρ = 20 0 1000 events 100 events A"ribute required High Power (1 β) Low significance (α) Clustering scale Power (1 β): the probability to reject H 0 when it is false Significance (α): probability to reject H 0 when it is true (type I error) H 0 = isotropy 9

Interpreta&on of MAF Clustering scale The angular scale Θ where the significance (α) is minimum => clustering scale It is the scale at which occurs a greater accumula&on of points respect to that one occurring by chance 5000 simula&ons of 100 events each (30% anisotropic, 10 sources ) p ~ (Θ ) = argmin Θ ρ = 5 0 ρ = 10 0 ρ = 20 0 isotropic p(θ) 10

Sta&s&cal features under H 0 (isotropy) Under H 0, all p values p ~ (Θ ) = argmin p(θ) Θ corresponding to isotropic skies, should be equally likely. The distribu&on of p ~ (Θ ) regards for the data set size. Unbiased against H 0 is flat, as expected, with no We inves&gate the density of max {s (Θ)}, used for penalizing p values The cumula&ve density of maxima is the generalized Gumbel distribu&on and the corresponding probability density g(x) is the probability to obtain a maximum value of s(θ) (at any Θ), greater or equal than a given value max {s(θ)} is Distribu&on of max {s(θ)} for n = 40, 60, 80, 100 and 500 events. (parameters µ = 1.743 ± 0.002 and σ = 0.470 ± 0.002) Penaliza&on procedure can be analy&cally performed 11

Sta&s&cal features under H 1 (anisotropy) Mock maps of anisotropic sky are generated according to expected highest energy Cosmic Rays arrival direc&on. Ref. arxiv:1001.1666 A sky is labeled as anisotropic if, for a fixed value of the significance α, the penalized chance probability is lesser or equal than α, p ~ (Θ ) = argmin p(θ) α Θ for some angular scale Θ. For n>60 events a power of 90% with significance α=1% 12

Summary and Conclusion MAF Features A new technique to detect anisotropy of a small dataset, namely Mul&scale Anisotropy Func&on is introduced Capable to assign a clustering scale to the distribu&on under inves&ga&on (not depending on the par&cular model used to generate the anisotropic sky) Not depending on par&cular configura&ons of points (e.g. doublets and/or triplets) MAF Sta&s&cs Unbiased against the null hypothesis Penaliza&on procedure can be analy&cally performed High discrimina&on power against the alterna+ve hypothesis of anisotropy (even in presence of small datasets) 13

BAKUP 14

Hypothesis Tes&ng: Sta&s&cal Errors Vede isotropia quando c è Vede anisotropia quando non c è Significanza Vede isotropia quando non c è Vede anisotropia quando c è 15

Differen&al? Expected 10 Detected 10 => Isotropy at 6 0 Expected 5 Detected 9 => Anisotropy at 3 0 Expected 5 Detected 1 => Anisotropy at 3 0 16

17