A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring
|
|
- Phyllis Watson
- 5 years ago
- Views:
Transcription
1 A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring Lecture 4 See web page later tomorrow Searching for Monochromatic Signals in Noise We derived the spectrum of a time series containing a complex exponential and additive noise The shape of the spectral line is a sinc function. For continuous time and frequency this is sinc(x) = sin(πx)/πx For the discrete case it is slightly different The sinc function underlies many of the problems associated with spectral analyis based on the Fourier transform The sinc function is the response of the Fourier transform to a sinusoid. Any function or stochastic process can be represented as a sum of sinusoids à its power spectrum is convolved with the appropriate sinc function. 1
2 sinc(x) sinc(x) sidelobes main lobe Sinc func-on aligned so that its zeros fall on integer values of x. If we plot only the black dots, we get a Kronecker delta func-on Sinc func-on mis- aligned from integer x values. We no longer get a Kronecker delta x So what? Generally a monochroma-c signal will not be in integer mul-ple of the frequency resolu-on δf = 1 / T so power in sinc 2 will leak into nearby (main lobe) and distant (sidelobe) frequencies. The envelope of sidelobe amplitudes ~ 1 / f 2 2
3 Searching for Monochromatic Signals in Noise We derived the spectrum of a time series containing a complex exponential and additive noise In the no-signal limit: The PDF of the spectrum is exponential (one sided) The false-alarm probability is e -η for a threshold for detection of η x spectral mean The spectral mean = spectral rms for an exponential PDF If we find a spectral line that exceeds the threshold, we would say that the line is real at 100e -η % confidence. Relevant PDFs Gaussian or Normal: N(μ, σ 2 ) f X (x) = 1 2πσ e (x µ)2 /2σ 2 Random variable argument Exponential: Chi 2 : X = N j=1 f X (x) = f X (x) =X 1 e x/x H(x) x 2 j with x j = = i.i.d GRV: N(0,1) 1 Γ(N/2)2 N/2 x(n 2)/2 e x/2 3
4 hsp://en.wikipedia.org/wiki/normal_distribu-on hsp://en.wikipedia.org/wiki/exponen-al_distribu-on hsp://en.wikipedia.org/wiki/chi- squared_distribu-on hsp://upload.wikimedia.org/wikipedia/commons/a/a9/empirical_rule.png 4
5 Properi-es of a Gaussian or Normal RV χ 2 5
6 Detection Probability The exponential PDF applies to the no-signal case But for the frequency bin in the spectrum that has a signal the PDF is different: What is the relevant PDF? Need to consider the PDF of phasor + noise From the PDF we can calculate the probability of detection (true positive) and false negatives. 6
7 PDF of Phasor Magnitude s = 0, 3, 5, 10 sigma_n = 1 PDF of Intensity s = 0, 1, 3, 5 sigma_n = 1 Detec-on probability P det (I min )= I min di f I (I) 7
8 ROC Curves Receiver operating characteristic Relative operating characteristic In a so-called detection problem, we try to establish whether a signal of some assumed type is present in data that include noise This is a universal problem that applies to many laboratory and observational contexts. In astronomy, ROC curves apply to finding sources/signals in images, spectra, time series, etc. An ROC curve = P d vs P fa (detection vs falsealarm probability) Binary classifier used in physics, biometrics, machine learning, data mining, hsp://en.wikipedia.org/wiki/receiver_opera-ng_characteris-c 8
9 Accuracy of Ground Hog Day Predictions Meteorological accuracy (from wikipedia): According to Groundhog Day organizers, the rodents' forecasts are accurate 75% to 90% of the time. However, a Canadian study for 13 cities in the past 30 to 40 years found that the weather patterns predicted on Groundhog Day were only 37% accurate over that time period. According to the StormFax Weather Almanac and records kept since 1887, Punxsutawney Phil's weather predictions have been correct 39% of the time. The National Climatic Data Center has described the forecasts as on average, inaccurate and stated that the groundhog has shown no talent for predicting the arrival of spring, especially in recent years. And what about the superbowl predictor for whether the stock market will be up or down? Etc. etc. 9
10 Estimation Error: For any estimation procedure, we are interested in the estimation error, which we quantify with the variance of the estimator: Var{S k } S 2 k S k 2. This requires that we calculate the fourth moment of the DFT: X k 4 = A δ kk0 + Ñk 4 (3) = A 4 δ kk0 + A 2 δ kk0 Ñk + Ñ k 2 (4) + Ñk 4 (5) + 2A 2 δ kk0 Ñk 2 (6) + 2A 3 δ kk0 (N k + N k ) (7) + 2A δ kk0 Ñk 2 (Ñk + Ñ k ). The last two terms vanish because they involve odd order moments. The third term is Ñk 4 = 2 Ñk 2 2 because Ñk is complex Gaussian noise by the Central Limit Theorem. Thus, the first and fourth terms and half of the third terms are just the square of X k 2, so X k 4 = X k Ñk A 2 δ kk0 Ñk 2 8 or Var{ X k 2 } = X k 4 X k 2 2 (8) The fractional error in the spectrum is thus k [Var { X k 2 }] 1/2 X k 2 = Ñk A 2 δ kk0 Ñk 2 (9) = Ñk A2 δ kk0 Ñk 2 = (σ 2 n/n ) A2 N δ kk0 σ 2 n = (1 + 2A2 N δ kk0 /σn) 2 1/2. 1+A 2 N δ kk0 /σn 2 Thus, for frequency bins off the line (k = k 0 ) we have k 1. On the line we have 1 A 2 N/σn 2 0 k = (1 + 2A2 N/σ 2 n) 1/2 1+A 2 N/σ 2 n = A 2 N σ 2 n 2 N σ n 2 A 2 N/σ 2 n 1 A A 2 N/σ 2 n 1 Thus, as the signal-to-noise A/σ n gets very large, the error in the spectral estimate 0, as expected. (10) 9 10
11 Frequentist à Bayesian The approach we have taken is classic frequentism: it appeals to the notion of repeated trials and frequency of occurrence; also to an underlying ensemble. Point estimates are given of e.g. the signal strength and the frequency. The Bayesian alternative: using the one realization of data in hand, what is the PDF of the frequency and amplitude? The relevant PDF is the posterior PDF and it is derived from the product of a prior PDF and a likelihood function. Instead of a power spectrum one gets a PDF. The PDF ends up depending on the periodogram. Basic Probability Tools Random variables, event space: ζ = event à X = random var. PDF, CDF, characteristic function Median, mode, mean Conditional probabilities and PDFs Bayes theorem Comparing PDFs Moments and moment tests Sums of random variables and convolution theorem Central Limit Theorem Changes of variable Functions of random variables Sequences of random variables Stochastic processes = sequences of random variables vs. t, f, etc. Power spectrum, autocorrelation, autocovariance, and structure functions Bispectra Random walks, shot noise, autoregressive, moving average, Markov processes 11
12 I. Ensemble vs. Time Averages Experimentally/observationally we are forced to use sample averages of various types Our goal is often, however, to learn about the parent population or statistical ensemble from which the data are conceptually drawn In some circumstances time averages converge to good estimates of ensemble averages In others, convergence can be very slow or can fail (e.g. red-noise processes) I(t, ζ) 12
13 I(t, ζ) I(t, ζ) As data span length T à time average à ensemble average Ergodic 13
14 2/3/15 Types of Random Processes Goodman Sta$s$cal Op$cs Example: the Universe Measurements of the CMB and large-scale structure are on a single realization The goal of cosmology is to learn about the (notional) ensemble of conditions that lead to what we see Quantitatively these are cast in questions like what was the primordial spectrum of density fluctuations? and that spectrum is usually parameterized as a power law Perhaps the multiverse = the ensemble Are all universes the same (statistically)? Do measurements on our universe typify all universes? (Conventional wisdom says no) 14
15 2/3/15 Basis functions: spherical harmonics TCMB = 2.7 K ΔT/TCMB ~ 10-5 Wilkinson Microwave Anisotropy Probe 15
16 I(t, ζ) Nonstationary Case I(t, ζ) 16
17 I(t, ζ) Random walk in spin phase I(t, ζ) Random walk in spin frequency 17
18 I(t, ζ) Random walk in spin frequency derivative White noise RW 1 RW 2 RW 3 18
19 19
20 Random Walk Examples Spinning objects: Earth, neutron stars Steps in torque or spin rate Observable = spin phase Scattered photon propagation (diffusion) Step = mean-free path Observable = propagation time Cosmic-ray propagation in the Galaxy Step = scattering off of small-scale magnetic field variations Observable = `grammage of interaction based on isotopic content (typically ~ 5 g cm -2 ) Orbital perturbations Asteroid belt objects à Near Earth Objects Motions of planetesimals in protoplanetary disks Galactic orbits of stars from gravitational potential granularity (molecular clouds, spiral arms) à diffusion of stellar populations 20
21 Other Random Walk Examples MCMC: random walk in parameter space Brownian motion of a dust particle Molecular diffusion Diffusion of biological populations Options pricing in financial markets Step = transaction Observable = price Black-Scholes equation = Fokker-Planck equation 21
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2013 Lecture 4 For next week be sure to have read Chapter 5 of
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2013 Lecture 4 For next week be sure to have read Chapter 5 of Gregory (Frequentist Statistical Inference) Today: DFT
More informationA6523 Modeling, Inference, and Mining Jim Cordes, Cornell University. False Positives in Fourier Spectra. For N = DFT length: Lecture 5 Reading
A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 5 Reading Notes on web page Stochas
More informationA6523 Modeling, Inference, and Mining Jim Cordes, Cornell University. Motivations: Detection & Characterization. Lecture 2.
A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 2 Probability basics Fourier transform basics Typical problems Overall mantra: Discovery and cri@cal thinking with data + The
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring
A653 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 15 http://www.astro.cornell.edu/~cordes/a653 Lecture 3 Power spectrum issues Frequentist approach Bayesian approach (some
More informationA523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Lecture 1 Organization:» Syllabus (text, requirements, topics)» Course approach (goals, themes) Book: Gregory, Bayesian
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring
Lecture 8 A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2015 http://www.astro.cornell.edu/~cordes/a6523 Applications: Bayesian inference: overview and examples Introduction
More informationA6523 Modeling, Inference, and Mining Jim Cordes, Cornell University
A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 19 Modeling Topics plan: Modeling (linear/non- linear least squares) Bayesian inference Bayesian approaches to spectral esbmabon;
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Reading Chapter 5 (continued) Lecture 8 Key points in probability CLT CLT examples Prior vs Likelihood Box & Tiao
More informationDetection theory 101 ELEC-E5410 Signal Processing for Communications
Detection theory 101 ELEC-E5410 Signal Processing for Communications Binary hypothesis testing Null hypothesis H 0 : e.g. noise only Alternative hypothesis H 1 : signal + noise p(x;h 0 ) γ p(x;h 1 ) Trade-off
More informationF & B Approaches to a simple model
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 215 http://www.astro.cornell.edu/~cordes/a6523 Lecture 11 Applications: Model comparison Challenges in large-scale surveys
More informationSignal Modeling, Statistical Inference and Data Mining in Astrophysics
ASTRONOMY 6523 Spring 2013 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Course Approach The philosophy of the course reflects that of the instructor, who takes a dualistic view
More informationStatistical techniques for data analysis in Cosmology
Statistical techniques for data analysis in Cosmology arxiv:0712.3028; arxiv:0911.3105 Numerical recipes (the bible ) Licia Verde ICREA & ICC UB-IEEC http://icc.ub.edu/~liciaverde outline Lecture 1: Introduction
More informationProbability, CLT, CLT counterexamples, Bayes. The PDF file of this lecture contains a full reference document on probability and random variables.
Lecture 5 A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2015 http://www.astro.cornell.edu/~cordes/a6523 Probability, CLT, CLT counterexamples, Bayes The PDF file of
More informationGaussian, Markov and stationary processes
Gaussian, Markov and stationary processes Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ November
More informationIntroduction to Probability and Statistics (Continued)
Introduction to Probability and Statistics (Continued) Prof. icholas Zabaras Center for Informatics and Computational Science https://cics.nd.edu/ University of otre Dame otre Dame, Indiana, USA Email:
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Reading: Chapter 10 = linear LSQ with Gaussian errors Chapter 11 = Nonlinear fitting Chapter 12 = Markov Chain Monte
More informationChapter 6: Random Processes 1
Chapter 6: Random Processes 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationProbability Distributions
The ASTRO509-3 dark energy puzzle Probability Distributions I have had my results for a long time: but I do not yet know how I am to arrive at them. Johann Carl Friedrich Gauss 1777-1855 ASTR509 Jasper
More informationAdvanced Statistical Methods. Lecture 6
Advanced Statistical Methods Lecture 6 Convergence distribution of M.-H. MCMC We denote the PDF estimated by the MCMC as. It has the property Convergence distribution After some time, the distribution
More informationApplied Probability and Stochastic Processes
Applied Probability and Stochastic Processes In Engineering and Physical Sciences MICHEL K. OCHI University of Florida A Wiley-Interscience Publication JOHN WILEY & SONS New York - Chichester Brisbane
More informationn=0 l (cos θ) (3) C l a lm 2 (4)
Cosmic Concordance What does the power spectrum of the CMB tell us about the universe? For that matter, what is a power spectrum? In this lecture we will examine the current data and show that we now have
More informationVariable and Periodic Signals in Astronomy
Lecture 14: Variability and Periodicity Outline 1 Variable and Periodic Signals in Astronomy 2 Lomb-Scarle diagrams 3 Phase dispersion minimisation 4 Kolmogorov-Smirnov tests 5 Fourier Analysis Christoph
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Reading Chapter 5 of Gregory (Frequentist Statistical Inference) Lecture 7 Examples of FT applications Simulating
More informationParameter estimation! and! forecasting! Cristiano Porciani! AIfA, Uni-Bonn!
Parameter estimation! and! forecasting! Cristiano Porciani! AIfA, Uni-Bonn! Questions?! C. Porciani! Estimation & forecasting! 2! Cosmological parameters! A branch of modern cosmological research focuses
More information2. A Basic Statistical Toolbox
. A Basic Statistical Toolbo Statistics is a mathematical science pertaining to the collection, analysis, interpretation, and presentation of data. Wikipedia definition Mathematical statistics: concerned
More informationProbability distributions. Probability Distribution Functions. Probability distributions (contd.) Binomial distribution
Probability distributions Probability Distribution Functions G. Jogesh Babu Department of Statistics Penn State University September 27, 2011 http://en.wikipedia.org/wiki/probability_distribution We discuss
More informationFrequentist-Bayesian Model Comparisons: A Simple Example
Frequentist-Bayesian Model Comparisons: A Simple Example Consider data that consist of a signal y with additive noise: Data vector (N elements): D = y + n The additive noise n has zero mean and diagonal
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationAn Introduction to Radio Astronomy
An Introduction to Radio Astronomy Second edition Bernard F. Burke and Francis Graham-Smith CAMBRIDGE UNIVERSITY PRESS Contents Preface to the second edition page x 1 Introduction 1 1.1 The role of radio
More informationSearches for a Stochastic Gravitational-Wave Background
earches for a tochastic Gravitational-Wave Background John T. Whelan chool of Gravitational Waves, Warsaw, 13 July Contents 1 tochastic GW Backgrounds 1 1.1 Exercise........................ 1. patial Distributions.................
More informationDETECTION theory deals primarily with techniques for
ADVANCED SIGNAL PROCESSING SE Optimum Detection of Deterministic and Random Signals Stefan Tertinek Graz University of Technology turtle@sbox.tugraz.at Abstract This paper introduces various methods for
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationVariable and Periodic Signals in Astronomy
Lecture 14: Variability and Periodicity Outline 1 Variable and Periodic Signals in Astronomy 2 Lomb-Scarle diagrams 3 Phase dispersion minimisation 4 Kolmogorov-Smirnov tests 5 Fourier Analysis Christoph
More informationLeast Squares Regression
CIS 50: Machine Learning Spring 08: Lecture 4 Least Squares Regression Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may not cover all the
More informationGalaxies 626. Lecture 3: From the CMBR to the first star
Galaxies 626 Lecture 3: From the CMBR to the first star Galaxies 626 Firstly, some very brief cosmology for background and notation: Summary: Foundations of Cosmology 1. Universe is homogenous and isotropic
More informationChapter 6. Random Processes
Chapter 6 Random Processes Random Process A random process is a time-varying function that assigns the outcome of a random experiment to each time instant: X(t). For a fixed (sample path): a random process
More information(Astronomy for Dummies) remark : apparently I spent more than 1 hr giving this lecture
(Astronomy for Dummies) remark : apparently I spent more than 1 hr giving this lecture A.D. 125? Ptolemy s geocentric model Planets ( ) wander among stars ( ) For more info: http://aeea.nmns.edu.tw/aeea/contents_list/universe_concepts.html
More informationAdditional Keplerian Signals in the HARPS data for Gliese 667C from a Bayesian re-analysis
Additional Keplerian Signals in the HARPS data for Gliese 667C from a Bayesian re-analysis Phil Gregory, Samantha Lawler, Brett Gladman Physics and Astronomy Univ. of British Columbia Abstract A re-analysis
More information1 Random walks and data
Inference, Models and Simulation for Complex Systems CSCI 7-1 Lecture 7 15 September 11 Prof. Aaron Clauset 1 Random walks and data Supposeyou have some time-series data x 1,x,x 3,...,x T and you want
More informationStatistics for scientists and engineers
Statistics for scientists and engineers February 0, 006 Contents Introduction. Motivation - why study statistics?................................... Examples..................................................3
More informationSpace Telescope Science Institute statistics mini-course. October Inference I: Estimation, Confidence Intervals, and Tests of Hypotheses
Space Telescope Science Institute statistics mini-course October 2011 Inference I: Estimation, Confidence Intervals, and Tests of Hypotheses James L Rosenberger Acknowledgements: Donald Richards, William
More informationCosmic Microwave Background
Cosmic Microwave Background Following recombination, photons that were coupled to the matter have had very little subsequent interaction with matter. Now observed as the cosmic microwave background. Arguably
More informationStatistical Applications in the Astronomy Literature II Jogesh Babu. Center for Astrostatistics PennState University, USA
Statistical Applications in the Astronomy Literature II Jogesh Babu Center for Astrostatistics PennState University, USA 1 The likelihood ratio test (LRT) and the related F-test Protassov et al. (2002,
More informationProbability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver
Stochastic Signals Overview Definitions Second order statistics Stationarity and ergodicity Random signal variability Power spectral density Linear systems with stationary inputs Random signal memory Correlation
More informationAn Introduction to Radio Astronomy
An Introduction to Radio Astronomy Bernard F. Burke Massachusetts Institute of Technology and Francis Graham-Smith Jodrell Bank, University of Manchester CAMBRIDGE UNIVERSITY PRESS Contents Preface Acknowledgements
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More informationECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications
ECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications Yongmiao Hong Department of Economics & Department of Statistical Sciences Cornell University Spring 2019 Time and uncertainty
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationHypothesis Testing, Bayes Theorem, & Parameter Estimation
Data Mining In Modern Astronomy Sky Surveys: Hypothesis Testing, Bayes Theorem, & Parameter Estimation Ching-Wa Yip cwyip@pha.jhu.edu; Bloomberg 518 Erratum of Last Lecture The Central Limit Theorem was
More informationParameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn
Parameter estimation and forecasting Cristiano Porciani AIfA, Uni-Bonn Questions? C. Porciani Estimation & forecasting 2 Cosmological parameters A branch of modern cosmological research focuses on measuring
More information(Gaussian) Random Fields
23/01/2017 (Gaussian) Random Fields Echo of the Big Bang: Cosmic Microwave Background Planck (2013) Earliest view of the Universe: 379000 yrs. after Big Bang, 13.8 Gyr ago. 1 CMB Temperature Perturbations
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring
Lecture 9 A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2015 http://www.astro.cornell.edu/~cordes/a6523 Applications: Comparison of Frequentist and Bayesian inference
More informationLeast Squares Regression
E0 70 Machine Learning Lecture 4 Jan 7, 03) Least Squares Regression Lecturer: Shivani Agarwal Disclaimer: These notes are a brief summary of the topics covered in the lecture. They are not a substitute
More informationProbability Models in Electrical and Computer Engineering Mathematical models as tools in analysis and design Deterministic models Probability models
Probability Models in Electrical and Computer Engineering Mathematical models as tools in analysis and design Deterministic models Probability models Statistical regularity Properties of relative frequency
More informationIntroduction to Bayesian Data Analysis
Introduction to Bayesian Data Analysis Phil Gregory University of British Columbia March 2010 Hardback (ISBN-10: 052184150X ISBN-13: 9780521841504) Resources and solutions This title has free Mathematica
More informationCMB Polarization and Cosmology
CMB Polarization and Cosmology Wayne Hu KIPAC, May 2004 Outline Reionization and its Applications Dark Energy The Quadrupole Gravitational Waves Acoustic Polarization and Initial Power Gravitational Lensing
More information3/1/18 LETTER. Instructors: Jim Cordes & Shami Chatterjee. Reading: as indicated in Syllabus on web
Astro 2299 The Search for Life in the Universe Lecture 9 Last time: Star formation Formation of protostars and planetary systems This time A few things about the epoch of reionization and free fall times
More informationAST5220 lecture 2 An introduction to the CMB power spectrum. Hans Kristian Eriksen
AST5220 lecture 2 An introduction to the CMB power spectrum Hans Kristian Eriksen Cosmology in ~five slides The basic ideas of Big Bang: 1) The Big Bang model The universe expands today Therefore it must
More informationBasic Structure of the High-energy Observations. Preparation of the Data for the Analysis. Methods to Examine the Periodic Signal
Timing Analysis of the Fermi Observations Basic Structure of the High-energy Observations Preparation of the Data for the Analysis Methods to Examine the Periodic Signal The related commands to perform
More informationCosmology & CMB. Set5: Data Analysis. Davide Maino
Cosmology & CMB Set5: Data Analysis Davide Maino Gaussian Statistics Statistical isotropy states only two-point correlation function is needed and it is related to power spectrum Θ(ˆn) = lm Θ lm Y lm (ˆn)
More informationThe cosmic background radiation II: The WMAP results. Alexander Schmah
The cosmic background radiation II: The WMAP results Alexander Schmah 27.01.05 General Aspects - WMAP measures temperatue fluctuations of the CMB around 2.726 K - Reason for the temperature fluctuations
More informationPatterns in astronomical impacts on the Earth: Testing the claims
Patterns in astronomical impacts on the Earth: Testing the claims Coryn Bailer-Jones Max Planck Institute for Astronomy, Heidelberg Leiden, 26 January 2012 Outline Geological record: climate, biodiversity,
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationAn example to illustrate frequentist and Bayesian approches
Frequentist_Bayesian_Eample An eample to illustrate frequentist and Bayesian approches This is a trivial eample that illustrates the fundamentally different points of view of the frequentist and Bayesian
More informationContinuous Wave Data Analysis: Fully Coherent Methods
Continuous Wave Data Analysis: Fully Coherent Methods John T. Whelan School of Gravitational Waves, Warsaw, 3 July 5 Contents Signal Model. GWs from rotating neutron star............ Exercise: JKS decomposition............
More informationAST 418/518 Instrumentation and Statistics
AST 418/518 Instrumentation and Statistics Class Website: http://ircamera.as.arizona.edu/astr_518 Class Texts: Practical Statistics for Astronomers, J.V. Wall, and C.R. Jenkins Measuring the Universe,
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More information1/f Fluctuations from the Microscopic Herding Model
1/f Fluctuations from the Microscopic Herding Model Bronislovas Kaulakys with Vygintas Gontis and Julius Ruseckas Institute of Theoretical Physics and Astronomy Vilnius University, Lithuania www.itpa.lt/kaulakys
More informationPower spectrum exercise
Power spectrum exercise In this exercise, we will consider different power spectra and how they relate to observations. The intention is to give you some intuition so that when you look at a microwave
More informationASTR Astrophysics 1 - Stellar and Interstellar. Phil Armitage. office: JILA tower A909
ASTR 3730 Astrophysics 1 - Stellar and Interstellar Phil Armitage office: JILA tower A909 email: pja@jilau1.colorado.edu Part one of a year-long introduction to astrophysics: Aim - develop physical understanding
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationPractical Statistics
Practical Statistics Lecture 1 (Nov. 9): - Correlation - Hypothesis Testing Lecture 2 (Nov. 16): - Error Estimation - Bayesian Analysis - Rejecting Outliers Lecture 3 (Nov. 18) - Monte Carlo Modeling -
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationLecture 03. The Cosmic Microwave Background
The Cosmic Microwave Background 1 Photons and Charge Remember the lectures on particle physics Photons are the bosons that transmit EM force Charged particles interact by exchanging photons But since they
More informationAstronomy 210 Final. Astronomy: The Big Picture. Outline
Astronomy 210 Final This Class (Lecture 40): The Big Bang Next Class: The end HW #11 Due next Weds. Final is May 10 th. Review session: May 6 th or May 9 th? Designed to be 2 hours long 1 st half is just
More informationProbability distribution functions
Probability distribution functions Everything there is to know about random variables Imperial Data Analysis Workshop (2018) Elena Sellentin Sterrewacht Universiteit Leiden, NL Ln(a) Sellentin Universiteit
More informationSolutions for Assignment of Week 06 Introduction to Astroparticle Physics
s for Assignment of Week 06 Introduction to Astroparticle Physics Georg G. Raffelt Max-Planck-Institut für Physik (Werner-Heisenberg-Institut) Föhringer Ring 6, 80805 München Email: raffelt(at)mppmu.mpg.de
More information15-388/688 - Practical Data Science: Basic probability. J. Zico Kolter Carnegie Mellon University Spring 2018
15-388/688 - Practical Data Science: Basic probability J. Zico Kolter Carnegie Mellon University Spring 2018 1 Announcements Logistics of next few lectures Final project released, proposals/groups due
More informationLecture 3: Statistical sampling uncertainty
Lecture 3: Statistical sampling uncertainty c Christopher S. Bretherton Winter 2015 3.1 Central limit theorem (CLT) Let X 1,..., X N be a sequence of N independent identically-distributed (IID) random
More informationLIGO Status and Advanced LIGO Plans. Barry C Barish OSTP 1-Dec-04
LIGO Status and Advanced LIGO Plans Barry C Barish OSTP 1-Dec-04 Science Goals Physics» Direct verification of the most relativistic prediction of general relativity» Detailed tests of properties of gravitational
More informationLecture 2. Spring Quarter Statistical Optics. Lecture 2. Characteristic Functions. Transformation of RVs. Sums of RVs
s of Spring Quarter 2018 ECE244a - Spring 2018 1 Function s of The characteristic function is the Fourier transform of the pdf (note Goodman and Papen have different notation) C x(ω) = e iωx = = f x(x)e
More informationAST5220 lecture 2 An introduction to the CMB power spectrum. Hans Kristian Eriksen
AST5220 lecture 2 An introduction to the CMB power spectrum Hans Kristian Eriksen Cosmology in ~five slides The basic ideas of Big Bang: 1) The Big Bang model The universe expands today Therefore it must
More informationAn introduction to Bayesian statistics and model calibration and a host of related topics
An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the
More informationSTAT 518 Intro Student Presentation
STAT 518 Intro Student Presentation Wen Wei Loh April 11, 2013 Title of paper Radford M. Neal [1999] Bayesian Statistics, 6: 475-501, 1999 What the paper is about Regression and Classification Flexible
More informationStochastic Processes
Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationBayesian Learning (II)
Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen Bayesian Learning (II) Niels Landwehr Overview Probabilities, expected values, variance Basic concepts of Bayesian learning MAP
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy Probability (Lecture 1) Statistics (Lecture 2) Why do we need statistics? Useful Statistics Definitions Error Analysis Probability distributions Error Propagation Binomial
More informationA523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Lecture 6 PDFs for Lecture 1-5 are on the web page Problem set 2 is on the web page Article on web page A Guided
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationTable of Contents [ntc]
Table of Contents [ntc] 1. Introduction: Contents and Maps Table of contents [ntc] Equilibrium thermodynamics overview [nln6] Thermal equilibrium and nonequilibrium [nln1] Levels of description in statistical
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy If your experiment needs statistics, you ought to have done a better experiment. -Ernest Rutherford Lecture 1 Lecture 2 Why do we need statistics? Definitions Statistical
More informationVolatility. Gerald P. Dwyer. February Clemson University
Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use
More informationX-ray observations of neutron stars and black holes in nearby galaxies
X-ray observations of neutron stars and black holes in nearby galaxies Andreas Zezas Harvard-Smithsonian Center for Astrophysics The lives of stars : fighting against gravity Defining parameter : Mass
More informationPART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics
Table of Preface page xi PART I INTRODUCTION 1 1 The meaning of probability 3 1.1 Classical definition of probability 3 1.2 Statistical definition of probability 9 1.3 Bayesian understanding of probability
More informationMajor Option C1 Astrophysics. C1 Astrophysics
C1 Astrophysics Course co-ordinator: Julien Devriendt jeg@astro.ox.ac.uk C1 offers a total of ~40 lectures on five themes covering a broad range of topics in contemporary astrophysics. Each theme takes
More informationKalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein
Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time
More informationChapter 2: Fundamentals of Statistics Lecture 15: Models and statistics
Chapter 2: Fundamentals of Statistics Lecture 15: Models and statistics Data from one or a series of random experiments are collected. Planning experiments and collecting data (not discussed here). Analysis:
More informationThe local dark matter halo density. Riccardo Catena. Institut für Theoretische Physik, Heidelberg
The local dark matter halo density Riccardo Catena Institut für Theoretische Physik, Heidelberg 17.05.2010 R. Catena and P. Ullio, arxiv:0907.0018 [astro-ph.co]. To be published in JCAP Riccardo Catena
More informationA novel determination of the local dark matter density. Riccardo Catena. Institut für Theoretische Physik, Heidelberg
A novel determination of the local dark matter density Riccardo Catena Institut für Theoretische Physik, Heidelberg 28.04.2010 R. Catena and P. Ullio, arxiv:0907.0018 [astro-ph.co]. Riccardo Catena (ITP)
More information