A BAYESIAN METHOD FOR OSCILLATOR CHARACTERIZATION
|
|
- Norah Thornton
- 5 years ago
- Views:
Transcription
1 30th Annual Precise Time and Time Interval (PTTI) Meeting A BAYESIAN METHOD FOR OSCILLATOR CHARACTERIZATION F. Vernotte Observatoire de Besanson 41 bis av. de l'observatoire, BP 1615, F25010 Besanson, France tel $33: fax francoisqobsbesani,on.fr G. Zalamansky Universitd de Metz Campus Bridowr, F57000 Metz, France Abstract The power. spectral density of frequ,ency fluctuation,^ of an oscillator is generally modeled us u surrt of power laws with integer exponent.? (from 2 to +2). However, a power law with a fractional elcponenl: may exist. We propose a method for measurin,g such a noise level and determining the probability density of the exponent. This yields a criterion, for compatibility with, an integer exponent. This method is based upon a Bayesian approach called the reference analysis of BernardoBerger. The application to a sequence of frequency measurement from a quartz oscillator illustrates this puper. INTRODUCTION It is cornrnonly assumed that S,(f). the power spectral density (PSD) of frequency deviation of an oscillator, may be modeled as the surrl of 5 power laws, defining 5 types of noise: +? s',(f) = C h,fa (1) a=2 where h, is the level of the f" rloise. But it may be noticed that models with noninteger exponents are occasionally used. The estimation of the noise levels is mainly achieved by using the Allan variance [ll. which is defined versus the integration tirne T as: = 2 ((&+I q kl2) (a 99
2 I fli I variance versus the integration time r is plotted, the graph exhibits different slopes, each slope corresponding to a type of noise: (r) = &(,(s) = h ~f" and ~=~l, (3) The estirrlation of C',, yields an estirrlation of the noise level h,. However, this curve may exhibit an exponent p which seems to be noninteger. Does this mean that the corresponding PSD is not compatible with the 5 power law model? In this paper, we propose a method for estimating the rnost probable value of this exponent in order to solve this ambiguity. This method is applied to an example of stability measurement. 1 CLASSICAL STABILITY ANALYSIS OF AN OSCILLATOR Sequence of frequency measures 1 Figure 1 shows average frequency measures i& of a 10 MHz quartz oscillator compared to a c.esium clock. The sampling rate is 10 s and the integration time of each frequency I measure is also 10 s (sampling without dead time). In order to obtain dimensionless y, samples, we must subtract the nominal frequency (10 MHz) from the frequency measures and normalize by vo: Variance analysis Figure 2 is a loglog plot of the Allan deviation of the quartz y, samples versus the integration time r. A least squares fit of these variance measures (solid line), weighted by their uncertainties, detects only two types of noise: a white noise and an fp%oise. The corresponding noise level estimations are: ho = (2.2 f 0.4). 1 K5s at IF (68% confidence) h2 = (2.3 f 0.6). l~''s~ at la (68% confidence) (for the assessment of the h, noise levels and their uncertainties, we used the multivariance method described in PI). However, for large T values (corresponding to low frequencies), the variance measures move away from the fitted curve. Two explanations are possible:. instead of an fp2 noise, there is a noise whose noninteger exponent is contained between 2 and 3 ; since the uncertainty domains of the variance measures contain the fitted curve, this apparent divergence may be due to a statistical effect. In order to choose between these two explanations, we decided to estimate the probability density of the exponent with a Bayesian approach.
3 BAYESIAN APPROACH The goal of all measurement is the estimation of an unknown quantity 6' from measures $, i.e. determining p(81$), the density of probability of the quantity B knowing the measures $. The Bayesian theory is based on the following equality [31: ~(40 pt<l0)74@) where p(ei6') is the distrihutiorl of the measures < for a fixed value of the quantity 6' and r(6') is the a priori density of probability of the quantity 0, i.c. before performing any measurement. The determination of this a priori density, called the prior, is generally one of the main difficulties of this approach (particularly in the case of total lack of knowledge! ). In this paper, we use the Jeffrey's prior which ensures properties slich as invariance [31. Spectral density and covariance matrix Let us define the vector y whose components are the N jj,, samples. We assume that y is s Gaussian vector. The probability distribution of y is: where C: is the covariance matrix. Since &(f) is the Fourier transform of R,(T), the autocorrelation function of the frequency deviation. the general term of C: is: Equation (7) reveals the key role played by the spectral density of the noise in the expected fluctuation. We will present a general rr~ethod for estimating the parameters of the model for S,(f). Assumed model for the spectral density We assume that the sequence of frequency measures is composed of a white noise y, whose variance (i.e. the level) is unitary, and of a red noise y, whose level is unknown, multiplied by the real standard deviation of the white noise u,,, (0, is easily estimated from high sampling rate frequency ~aeasurernent): y = (h, + yr)rw. This yields the following model for Sy(f): s,(f) = ho +he.f" with 3<a<1 where h,o = 2.2. lojs, h, and a are the unknown parameters. Let us denote y, the normalized vector: Yn "Yw +YT. 101
4 The corresponding rlorrrlalized PSD S,( f) is: where U, is an amplitude factor whosc meaning will be explained below (see equation (23)). Statistical model The part of the spectral density due to the red noise y, may bc written: We used the BernardoBerger analysis e = (0, H). Construction of the estimat0r.s: 41 for estimating the unknown parameter Let us introduce the orthonormal basis of!xn, {po,...,pj,...,p~~}, defined such as the ith component of pj is: Pi,? = Fj (fi) (13) where ti is the date of the ith frequency measure and &(t) is a polynomial of degree j: satisfying the orthonormality condition 151: C Fj (ti).f.(ti) = djk. It can be shown than the scalar product of a vector pj by the noise vector y is an estirrlate of the noise spectrurn for a given frequency fj [GI. Let us denote Cj such an estimate applied to the normalized noise: Practically, we limited to 16 the number of estimators pj (from degrees 0 to 15) for lim iting the computation and because the high degrees, estimating the high frequencies, are less informative for a red noise. Moreover, in order to ensure convergence for very low frequencies (even if the low cutoff frequency tends towards O), the polynomials must satisfy the moment condition [k 61: the minimum degree jmi, of a polynomial to ensure convergence up to an exponent cr is: a 1 jmin 2 2 ' (16) Since we have assumed a 5 3, the first 2 estimators and must be removed. Thus we have n = 14 estimators {pz,..., yls) and n = 14 estimates {&,...,ti5). Construction of the priors: The covariance matrix defined in relationship (7) is an ensemble average of the different,estimate products over an infinite number of realizations of this process:
5 As for the noise vector y, the estimate vector $ may be split into two terms, according to equations (10) and (15): The covariarlce matrix may also bc split: C'= t = 411, + 5r (19) (<w<:) + ( ETfl) = In th.lln. V(@) where I, is the identity matrix in!rn and the general term of the matrix V(a) is: The high cutoff frequency fh, duration of the sequence. in (21) is the Nyquist frequency and T is the total Let E*(CY) denote the ith eigenvector of V(a) and ;/,(a) its ith eigcnvalue (i E (0,..., n 1)). The averaged quadratic norm of the estimate vector ( is: The factor u, is chosen in such a way that. for H = 1. thc avcraged quadratic norms (~l ~ll~) and (llk2) are eqllal: The direct problem is now solved since < is a vector of Vbith a, probability distribution given the parameter B equal to: Denoting "Tr(M)" the trace of a matrix and X the matrix defined as: the Fisher information matrix I(@) is (see M): The Jeffrey's prior ~(6) is defined as: The parameter B is a twodimensional parameter composed of the exponent parameter cu and of the amplitude parameter H. Since we are rrlostly interested in a, H is called a nuisance parameter. In presence of nuisance parameter, Bernardo and Berger suggested that a should first be fixed and the conditional prior ~(111cw) cornpilted for that value. The full prior is then: T(@) = ~ (Hja). ~ ( L Y ). (28)
6 The conditional prior x(hla) is given by: 4Hla) = m (29) whcrc [1(0)]11, [I(#)llz = [I(#)Jzl and [I(B)]22 are the elements of the Fisher information matrix I(O). The prior for a may be computed as: where c is a normalization coefficient ensuring that J n(a)da = 1 and: This prior is plotted in Figurc 3. Construction of the posteriors: According to the Bayes theorem, the posterior probability distribution is given by: The posterior probability distribution for cr is then given by: RESULTS AND DISCUSSION Compatibility with an integer exponent Figtire 4 shows the posterior probability distribution for the exponent a of the red noise using the BernardoBerger prior. The exponent value obtained for the maximum of likelihood, just as for the maximum of the distribution, is a = 2.2. However, a = 2 is fully compatible with this prior distribution. Thus, we may conclude that the apparent divergence between the variance measures and the fitted curve in Figure 2 is probably due to a statistical bias of the data. The spectral density S,(f) is then compatible with the following model: Noise level estimation Selecting an exponent value a = 2, we obtained the posterior probability distribution plotted in Figure 5. As in the variance analysis, we chose a confidence interval of 68% (16% probability that hvz is smaller than the low bound and 16% probability that hl2 is greater than the high bound): hl2 = ( 2.3 ' dlg ). 1 0l~~' at 1u (68% confidence)
7 The difference between the maximum likelihood value (122 = s1) and the variance analysis value (hpz = lo'%') is only 0.18%. However, the confidence intervals given by these two methods are quiet different. The main difference concerns the symmetry of thc variance analysis interval: i11 this case, we don't take into account the fact that the noise levels are positive, whereas the prior of the Bayesian approach is null for negative values of hpz. Moreover, the variance analysis interval seems to be a bit underestimated. CONCLUSION The variance analysis is an useful tool for a quick estimation of the noise levels in the output signal of an oscillator. However, a negative estimate of a noise level nlay occur. Generally, in this case, this valuc is rejected and the corresponding noise level is assumed to be null. On the other hand. although the Bayesian method is a bit heavier, it takes into account properly the a priori information, and gives a more reliable estimation of these noise levels and especially of their confidence intervals. However, the main advantage of the Bayesian method concerns the verification of the validity of the power law model of spectral density. Each time the model is suspected, such an approach should be used in order to estimate the exponent of the power law. In particular, this method should be very interesting for the study of the fv1 and l ' f noise, whose origin remains mysterious [TI. REFERENCES [l] J. A. Barnes, A. R.. Chi, L. S. Cutler, D. J. Healey, D. B. Leesson, T. E. McCuningal,.J. A. Mullen, W. L. Smith, R. L. Sydnor, R. Vessot, and G. M. R. Winkler, 'cc~~,uraclerization of frequeracy stability, '' IEEE Transactions on Instrumentation and Measurement, IM20, [2] F. Vernotte, E. Lantz, J. Groslambert, and J. Gagnepain, "Oscillator noise analyszs: multiuariance measurement, '' IEEE Trans. on Inst. and Meas., IM42, [3] J. Bernardo and A. Smith, Bayesian theory, Wiley & Son, [4] G. Zalamansky and C. Robert, "Bayesian analysis with application to the timing residuals of a pulsar, " in Proceedings of MaxEnt'98, July 1998, Garching, Germany. [5] J. E. Deeter and P. E. Boynton, "Tcchniqucs for fh,e estimation of red power spectra. I. context and methodology," The Astrophysical Journal, 261, [6] F. Vernotte, G. Zalamansky, M. McHugh, and E. Lantz, "Cht08 frequencies and noise power law model of spectral densifg: adaptation oj the multivariance method for irregularly spaced timing data using thf lowest mode estimator approach.," IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 43, (3)) [7] M. Planat, V. Giordario, G. Marianneau? F. Vernotte, M. Mourey, C. Eckert, and J. Miehe, "Is the frequency noise of an, oscillator of deter.mini.stic origin P,'' IEEE 'I'rans. on U. F. F. C., 43, (2),
8 t I Time (s) Figure 1: Sequence of frequency measures 1 I 1 I I l l fitted variance response 1 f2... white noise...,",i '.., I I I I I 1 I I,, T (seconds) Figure 2: Allan deviation of t,he sequence of frequency measures
9 Figure 3: Reference prior for the power 0 Figure 4: Posterior probabilit,~ density for the power (I Figure 5: Posterior probability density for the noise level h,l2
A BAYESIAN METHOD FOR OSCILLATOR CHARACTERIZATION
30th Annual Precise Time and Time Interval (PTTI) Meeting A BAYESIAN METHOD FOR OSCILLATOR CHARACTERIZATION F. Vernotte Observatoire de Besanson 41 bis av. de l'observatoire, BP 1615, F25010 Besanson,
More informationUncertainties of drift coefficients and extrapolation errors: Application to clock error prediction
Vernotte et al - E 1319 - Final Version - Metrologia - February 1, 21 1 Uncertainties of drift coefficients and extrapolation errors: Application to clock error prediction F Vernotte 1, J Delporte 2, M
More informationVARIANCES BASED ON DATA WITH DEAD TIME BETWEEN THE MEASUREMENTS *
VARIANCES BASED ON DATA WITH DEAD TIME BETWEEN THE MEASUREMENTS * James A. Barnes Austron Incorporated Boulder, Colorado 80301 David W. Allan Time and Frequency Division National Bureau of Standards Boulder,
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationDEGREES OF FREEDOM AND THREE-CORNERED HATS
33rd Annual Precise Time and Time Interval (PTTI) Meeting DEGREES OF FREEDOM AND THREE-CORNERED HATS Christopher R. Ekstrom and Paul A. Koppang U.S. Naval Observatory, Washington, D.C. Abstract The three-cornered
More informationDiscrete Simulation of Power Law Noise
Discrete Simulation of Power Law Noise Neil Ashby 1,2 1 University of Colorado, Boulder, CO 80309-0390 USA 2 National Institute of Standards and Technology, Boulder, CO 80305 USA ashby@boulder.nist.gov
More informationThe Modified Allan Variance as Time-Domain Analysis Tool for Estimating the Hurst Parameter of Long-Range Dependent Traffic
The Modified Allan Variance as Time-Domain Analysis Tool for Estimating the urst Parameter of Long-Range Dependent Traffic Stefano Bregni, Senior Member, IEEE, Luca Primerano Politecnico di Milano, Dept.
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationLee A. Breakiron U.S. Naval Observatory Washington, DC ABSTRACT
A COMPARATIVE STUDY OF CLOCK RATE AND DRIFT ESTIMATION Lee A. Breakiron U.S. Naval Observatory Washington, DC 20392 ABSTRACT Five different methods of drift determination and four different methods of
More informationA6523 Modeling, Inference, and Mining Jim Cordes, Cornell University
A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 19 Modeling Topics plan: Modeling (linear/non- linear least squares) Bayesian inference Bayesian approaches to spectral esbmabon;
More informationALLAN VARIANCE ESTIMATED BY PHASE NOISE MEASUREMENTS
ALLAN VARIANCE ESTIMATED BY PHASE NOISE MEASUREMENTS P. C. Chang, H. M. Peng, and S. Y. Lin National Standard Time & Frequency Lab., TL, Taiwan 1, Lane 551, Min-Tsu Road, Sec. 5, Yang-Mei, Taoyuan, Taiwan
More informationStatistical Data Analysis Stat 3: p-values, parameter estimation
Statistical Data Analysis Stat 3: p-values, parameter estimation London Postgraduate Lectures on Particle Physics; University of London MSci course PH4515 Glen Cowan Physics Department Royal Holloway,
More informationINVESTIGATING THE BIASES IN ALLAN AND HADAMARD VARIANCES AS MEASURES OF M TH ORDER RANDOM STABILITY
43 rd Annual Precise Time and Time Interval (PTTI) Systems and Applications Meeting INVESTIGATING THE BIASES IN ALLAN AND HADAMARD VARIANCES AS MEASURES OF M TH ORDER RANDOM STABILITY Victor R. Reinhardt
More informationTime Series Prediction by Kalman Smoother with Cross-Validated Noise Density
Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Simo Särkkä E-mail: simo.sarkka@hut.fi Aki Vehtari E-mail: aki.vehtari@hut.fi Jouko Lampinen E-mail: jouko.lampinen@hut.fi Abstract
More informationENGR352 Problem Set 02
engr352/engr352p02 September 13, 2018) ENGR352 Problem Set 02 Transfer function of an estimator 1. Using Eq. (1.1.4-27) from the text, find the correct value of r ss (the result given in the text is incorrect).
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationPorosity Bayesian inference from multiple well-log data
Porosity inference from multiple well log data Porosity Bayesian inference from multiple well-log data Luiz Lucchesi Loures ABSTRACT This paper reports on an inversion procedure for porosity estimation
More informationEstimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator
Estimation Theory Estimation theory deals with finding numerical values of interesting parameters from given set of data. We start with formulating a family of models that could describe how the data were
More informationA statistic for describing pulsar and clock stabilities
Astron. Astrophys. 326, 924 928 (1997) ASTRONOMY AND ASTROPHYSICS A statistic for describing pulsar and clock stabilities Demetrios N. Matsakis 1, J. H. Taylor 2, and T. Marshall Eubanks 1 1 U.S. Naval
More informationDEPARTMENT OF INFORMATION AND COMMUNICATION TECHNOLOGY
UNIVERSITY OF TRENTO DEPARTMENT OF INFORMATION AND COMMUNICATION TECHNOLOGY 38050 Povo Trento Italy, Via Sommarive 14 http://www.dit.unitn.it A RISKS ASSESSMENT AND CONFORMANCE TESTING OF ANALOG-TO-DIGITAL
More informationAN ADAPTIVE ALGORITHM TO EVALUATE CLOCK PERFORMANCE IN REAL TIME*
AN ADAPTIVE ALGORITHM TO EVALUATE CLOCK PERFORMANCE IN REAL TIME* Dr. James A. Barnes Austron Boulder, Co. Abstract Kalman filters and ARIMA models provide optimum control and evaluation techniques (in
More informationCURRICULUM VITÆ. Director of the Observatory of Besançon
CURRICULUM VITÆ VERNOTTE François Professor of Astronomy and Astrophysics University of Franche-Comté (France) Born in Dole (Jura, France) on October 21 st, 1961 Three children Professionnal address: Personnal
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationLarge Sample Properties of Estimators in the Classical Linear Regression Model
Large Sample Properties of Estimators in the Classical Linear Regression Model 7 October 004 A. Statement of the classical linear regression model The classical linear regression model can be written in
More informationSpectral Analysis. Jesús Fernández-Villaverde University of Pennsylvania
Spectral Analysis Jesús Fernández-Villaverde University of Pennsylvania 1 Why Spectral Analysis? We want to develop a theory to obtain the business cycle properties of the data. Burns and Mitchell (1946).
More informationBayesian search for other Earths
Bayesian search for other Earths Low-mass planets orbiting nearby M dwarfs Mikko Tuomi University of Hertfordshire, Centre for Astrophysics Research Email: mikko.tuomi@utu.fi Presentation, 19.4.2013 1
More informationUnivariate ARIMA Models
Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.
More informationBasic concepts in estimation
Basic concepts in estimation Random and nonrandom parameters Definitions of estimates ML Maimum Lielihood MAP Maimum A Posteriori LS Least Squares MMS Minimum Mean square rror Measures of quality of estimates
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 11 January 7, 2013 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline How to communicate the statistical uncertainty
More informationGeneralized, Linear, and Mixed Models
Generalized, Linear, and Mixed Models CHARLES E. McCULLOCH SHAYLER.SEARLE Departments of Statistical Science and Biometrics Cornell University A WILEY-INTERSCIENCE PUBLICATION JOHN WILEY & SONS, INC. New
More informationSigmaplot di Systat Software
Sigmaplot di Systat Software SigmaPlot Has Extensive Statistical Analysis Features SigmaPlot is now bundled with SigmaStat as an easy-to-use package for complete graphing and data analysis. The statistical
More information5. Discriminant analysis
5. Discriminant analysis We continue from Bayes s rule presented in Section 3 on p. 85 (5.1) where c i is a class, x isap-dimensional vector (data case) and we use class conditional probability (density
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationFrequentist-Bayesian Model Comparisons: A Simple Example
Frequentist-Bayesian Model Comparisons: A Simple Example Consider data that consist of a signal y with additive noise: Data vector (N elements): D = y + n The additive noise n has zero mean and diagonal
More informationConfidence Estimation Methods for Neural Networks: A Practical Comparison
, 6-8 000, Confidence Estimation Methods for : A Practical Comparison G. Papadopoulos, P.J. Edwards, A.F. Murray Department of Electronics and Electrical Engineering, University of Edinburgh Abstract.
More informationAN ANALYTIC TECHNIQUE FOR STATISTICALLY MODELING RANDOM ATOMIC CLOCK ERRORS IN ESTIMATION
AN ANALYTIC TECHNIQUE FOR STATISTICALLY MODELING RANDOM ATOMIC CLOCK ERRORS IN ESTIMATION Patrick J. Fell Naval Surface Weapons Center, Dahlgren, Virginia ABSTKACT Minimum variance estimation requires
More informationSCUOLA DI SPECIALIZZAZIONE IN FISICA MEDICA. Sistemi di Elaborazione dell Informazione. Regressione. Ruggero Donida Labati
SCUOLA DI SPECIALIZZAZIONE IN FISICA MEDICA Sistemi di Elaborazione dell Informazione Regressione Ruggero Donida Labati Dipartimento di Informatica via Bramante 65, 26013 Crema (CR), Italy http://homes.di.unimi.it/donida
More informationUnobservable Parameter. Observed Random Sample. Calculate Posterior. Choosing Prior. Conjugate prior. population proportion, p prior:
Pi Priors Unobservable Parameter population proportion, p prior: π ( p) Conjugate prior π ( p) ~ Beta( a, b) same PDF family exponential family only Posterior π ( p y) ~ Beta( a + y, b + n y) Observed
More informationSTA 4273H: Sta-s-cal Machine Learning
STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 2 In our
More informationApplied Probability and Stochastic Processes
Applied Probability and Stochastic Processes In Engineering and Physical Sciences MICHEL K. OCHI University of Florida A Wiley-Interscience Publication JOHN WILEY & SONS New York - Chichester Brisbane
More informationF & B Approaches to a simple model
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 215 http://www.astro.cornell.edu/~cordes/a6523 Lecture 11 Applications: Model comparison Challenges in large-scale surveys
More informationBayesian and empirical Bayesian approach to weighted averaging of ECG signal
BULLETIN OF THE POLISH ACADEMY OF SCIENCES TECHNICAL SCIENCES Vol. 55, No. 4, 7 Bayesian and empirical Bayesian approach to weighted averaging of ECG signal A. MOMOT, M. MOMOT, and J. ŁĘSKI,3 Silesian
More informationA Statistical Analysis of Fukunaga Koontz Transform
1 A Statistical Analysis of Fukunaga Koontz Transform Xiaoming Huo Dr. Xiaoming Huo is an assistant professor at the School of Industrial and System Engineering of the Georgia Institute of Technology,
More informationParametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory
Statistical Inference Parametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory IP, José Bioucas Dias, IST, 2007
More informationStatistical and Adaptive Signal Processing
r Statistical and Adaptive Signal Processing Spectral Estimation, Signal Modeling, Adaptive Filtering and Array Processing Dimitris G. Manolakis Massachusetts Institute of Technology Lincoln Laboratory
More informationFundamentals of Noise
Fundamentals of Noise V.Vasudevan, Department of Electrical Engineering, Indian Institute of Technology Madras Noise in resistors Random voltage fluctuations across a resistor Mean square value in a frequency
More informationScienceDirect. Fatigue life from sine-on-random excitations
Available online at www.sciencedirect.com ScienceDirect Procedia Engineering 101 (2015 ) 235 242 3rd International Conference on Material and Component Performance under Variable Amplitude Loading, VAL2015
More information* Tuesday 17 January :30-16:30 (2 hours) Recored on ESSE3 General introduction to the course.
Name of the course Statistical methods and data analysis Audience The course is intended for students of the first or second year of the Graduate School in Materials Engineering. The aim of the course
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 10 December 17, 01 Silvia Masciocchi, GSI Darmstadt Winter Semester 01 / 13 Method of least squares The method of least squares is a standard approach to
More informationCONFIDENCE ON THE THREE-POINT ESTIMATOR OF FREQUENCY DRIFT*
CONFIDENCE ON THE THREE-POINT ESTIMATOR OF FREQUENCY DRIFT* Marc A. Weiss and Christine Hackman Time and Frequency Division National Institute of Standards and Technology 325 Broadway Boulder, CO 80303
More informationMachine Learning Lecture 2
Machine Perceptual Learning and Sensory Summer Augmented 6 Computing Announcements Machine Learning Lecture 2 Course webpage http://www.vision.rwth-aachen.de/teaching/ Slides will be made available on
More informationFitting a Straight Line to Data
Fitting a Straight Line to Data Thanks for your patience. Finally we ll take a shot at real data! The data set in question is baryonic Tully-Fisher data from http://astroweb.cwru.edu/sparc/btfr Lelli2016a.mrt,
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationTHE problem of phase noise and its influence on oscillators
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 54, NO. 5, MAY 2007 435 Phase Diffusion Coefficient for Oscillators Perturbed by Colored Noise Fergal O Doherty and James P. Gleeson Abstract
More informationLeast Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error Distributions
Journal of Modern Applied Statistical Methods Volume 8 Issue 1 Article 13 5-1-2009 Least Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error
More informationStatistical methods and data analysis
Statistical methods and data analysis Teacher Stefano Siboni Aim The aim of the course is to illustrate the basic mathematical tools for the analysis and modelling of experimental data, particularly concerning
More informationStatistical techniques for data analysis in Cosmology
Statistical techniques for data analysis in Cosmology arxiv:0712.3028; arxiv:0911.3105 Numerical recipes (the bible ) Licia Verde ICREA & ICC UB-IEEC http://icc.ub.edu/~liciaverde outline Lecture 1: Introduction
More informationStatistics 910, #5 1. Regression Methods
Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known
More informationWavelet Methods for Time Series Analysis. Part IV: Wavelet-Based Decorrelation of Time Series
Wavelet Methods for Time Series Analysis Part IV: Wavelet-Based Decorrelation of Time Series DWT well-suited for decorrelating certain time series, including ones generated from a fractionally differenced
More informationA KALMAN FILTER FOR ATOMIC CLOCKS AND TIMESCALES
33rdAnnual Precise Time and Time Interval (PTTI) Meeting A KALMAN FILTER FOR ATOMIC CLOCKS AND TIMESCALES Lee A. Breakiron U.S. Naval Observatory Washington, DC 2392542,USA Abstract In a test of whether
More informationApproximating likelihoods for large spatial data sets
Approximating likelihoods for large spatial data sets By Michael Stein, Zhiyi Chi, and Leah Welty Jessi Cisewski April 28, 2009 1 Introduction Given a set of spatial data, often the desire is to estimate
More informationAdvanced Digital Signal Processing -Introduction
Advanced Digital Signal Processing -Introduction LECTURE-2 1 AP9211- ADVANCED DIGITAL SIGNAL PROCESSING UNIT I DISCRETE RANDOM SIGNAL PROCESSING Discrete Random Processes- Ensemble Averages, Stationary
More informationA characterization of consistency of model weights given partial information in normal linear models
Statistics & Probability Letters ( ) A characterization of consistency of model weights given partial information in normal linear models Hubert Wong a;, Bertrand Clare b;1 a Department of Health Care
More informationAdaptive Data Assimilation and Multi-Model Fusion
Adaptive Data Assimilation and Multi-Model Fusion Pierre F.J. Lermusiaux, Oleg G. Logoutov and Patrick J. Haley Jr. Mechanical Engineering and Ocean Science and Engineering, MIT We thank: Allan R. Robinson
More informationDUE to its practical importance in communications, the
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 52, NO. 3, MARCH 2005 149 An Analytical Formulation of Phase Noise of Signals With Gaussian-Distributed Jitter Reza Navid, Student Member,
More informationy(x) = x w + ε(x), (1)
Linear regression We are ready to consider our first machine-learning problem: linear regression. Suppose that e are interested in the values of a function y(x): R d R, here x is a d-dimensional vector-valued
More informationModern Navigation. Thomas Herring
12.215 Modern Navigation Thomas Herring Estimation methods Review of last class Restrict to basically linear estimation problems (also non-linear problems that are nearly linear) Restrict to parametric,
More informationMultivariate Time Series: VAR(p) Processes and Models
Multivariate Time Series: VAR(p) Processes and Models A VAR(p) model, for p > 0 is X t = φ 0 + Φ 1 X t 1 + + Φ p X t p + A t, where X t, φ 0, and X t i are k-vectors, Φ 1,..., Φ p are k k matrices, with
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationEXTENDED GLRT DETECTORS OF CORRELATION AND SPHERICITY: THE UNDERSAMPLED REGIME. Xavier Mestre 1, Pascal Vallet 2
EXTENDED GLRT DETECTORS OF CORRELATION AND SPHERICITY: THE UNDERSAMPLED REGIME Xavier Mestre, Pascal Vallet 2 Centre Tecnològic de Telecomunicacions de Catalunya, Castelldefels, Barcelona (Spain) 2 Institut
More informationECE521 week 3: 23/26 January 2017
ECE521 week 3: 23/26 January 2017 Outline Probabilistic interpretation of linear regression - Maximum likelihood estimation (MLE) - Maximum a posteriori (MAP) estimation Bias-variance trade-off Linear
More informationBayesian Paradigm. Maximum A Posteriori Estimation
Bayesian Paradigm Maximum A Posteriori Estimation Simple acquisition model noise + degradation Constraint minimization or Equivalent formulation Constraint minimization Lagrangian (unconstraint minimization)
More informationSignals and Spectra - Review
Signals and Spectra - Review SIGNALS DETERMINISTIC No uncertainty w.r.t. the value of a signal at any time Modeled by mathematical epressions RANDOM some degree of uncertainty before the signal occurs
More informationJournal of Statistical Research 2007, Vol. 41, No. 1, pp Bangladesh
Journal of Statistical Research 007, Vol. 4, No., pp. 5 Bangladesh ISSN 056-4 X ESTIMATION OF AUTOREGRESSIVE COEFFICIENT IN AN ARMA(, ) MODEL WITH VAGUE INFORMATION ON THE MA COMPONENT M. Ould Haye School
More informationDOA Estimation using MUSIC and Root MUSIC Methods
DOA Estimation using MUSIC and Root MUSIC Methods EE602 Statistical signal Processing 4/13/2009 Presented By: Chhavipreet Singh(Y515) Siddharth Sahoo(Y5827447) 2 Table of Contents 1 Introduction... 3 2
More informationLINEAR MODELS FOR CLASSIFICATION. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception
LINEAR MODELS FOR CLASSIFICATION Classification: Problem Statement 2 In regression, we are modeling the relationship between a continuous input variable x and a continuous target variable t. In classification,
More informationSubject CS1 Actuarial Statistics 1 Core Principles
Institute of Actuaries of India Subject CS1 Actuarial Statistics 1 Core Principles For 2019 Examinations Aim The aim of the Actuarial Statistics 1 subject is to provide a grounding in mathematical and
More informationInternational Biometric Society is collaborating with JSTOR to digitize, preserve and extend access to Biometrics.
400: A Method for Combining Non-Independent, One-Sided Tests of Significance Author(s): Morton B. Brown Reviewed work(s): Source: Biometrics, Vol. 31, No. 4 (Dec., 1975), pp. 987-992 Published by: International
More informationSTA414/2104 Statistical Methods for Machine Learning II
STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements
More informationStat 5102 Final Exam May 14, 2015
Stat 5102 Final Exam May 14, 2015 Name Student ID The exam is closed book and closed notes. You may use three 8 1 11 2 sheets of paper with formulas, etc. You may also use the handouts on brand name distributions
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationBayesian Decision Theory
Bayesian Decision Theory Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2017 CS 551, Fall 2017 c 2017, Selim Aksoy (Bilkent University) 1 / 46 Bayesian
More informationLinear Models in Statistics
Linear Models in Statistics ALVIN C. RENCHER Department of Statistics Brigham Young University Provo, Utah A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane
More informationINTRODUCTION TO DESIGN AND ANALYSIS OF EXPERIMENTS
GEORGE W. COBB Mount Holyoke College INTRODUCTION TO DESIGN AND ANALYSIS OF EXPERIMENTS Springer CONTENTS To the Instructor Sample Exam Questions To the Student Acknowledgments xv xxi xxvii xxix 1. INTRODUCTION
More informationFurther Results on Model Structure Validation for Closed Loop System Identification
Advances in Wireless Communications and etworks 7; 3(5: 57-66 http://www.sciencepublishinggroup.com/j/awcn doi:.648/j.awcn.735. Further esults on Model Structure Validation for Closed Loop System Identification
More informationAdvanced Statistical Methods. Lecture 6
Advanced Statistical Methods Lecture 6 Convergence distribution of M.-H. MCMC We denote the PDF estimated by the MCMC as. It has the property Convergence distribution After some time, the distribution
More informationModulation & Coding for the Gaussian Channel
Modulation & Coding for the Gaussian Channel Trivandrum School on Communication, Coding & Networking January 27 30, 2017 Lakshmi Prasad Natarajan Dept. of Electrical Engineering Indian Institute of Technology
More informationSRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS
UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided
More informationSTUDIES OF NPL S CLOCK ENSEMBLE ALGORITHM
43 rd Annual Precise Time and Time Interval (PTTI) Systems and Applications Meeting STUDIES OF NPL S CLOCK ENSEMBLE ALGORITHM Setnam L. Shemar, John A. Davis, and Peter B. Whibberley National Physical
More informationLinear Regression In God we trust, all others bring data. William Edwards Deming
Linear Regression ddebarr@uw.edu 2017-01-19 In God we trust, all others bring data. William Edwards Deming Course Outline 1. Introduction to Statistical Learning 2. Linear Regression 3. Classification
More informationWHITEPAPER: ACHIEVING THE CRAMER-RAO LOWER BOUND IN GPS TIME-OF-ARRIVAL ESTIMATION, A FREQUENCY DOMAIN WEIGHTED LEAST-SQUARES ESTIMATOR APPROACH
WHITEPAPER: ACHIEVING THE CRAMER-RAO LOWER BOUND IN GPS TIME-OF-ARRIVAL ESTIMATION, A FREQUENCY DOMAIN WEIGHTED LEAST-SQUARES ESTIMATOR APPROACH KENNETH M PESYNA, JR AND TODD E HUMPHREYS THE UNIVERSITY
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationAlgebraic Derivation of the Oscillation Condition of High Q Quartz Crystal Oscillators
Algebraic Deriation of the Oscillation Condition of High Q Quartz Crystal Oscillators NICOLAS RATIER Institut FEMTO ST, CNRS UMR 67 Département LPMO a. de l Obseratoire, 50 Besançon FRANCE nicolas.ratier@femto-st.fr
More informationApproximating Bayesian Posterior Means Using Multivariate Gaussian Quadrature
Approximating Bayesian Posterior Means Using Multivariate Gaussian Quadrature John A.L. Cranfield Paul V. Preckel Songquan Liu Presented at Western Agricultural Economics Association 1997 Annual Meeting
More informationLecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis
Lecture 3 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,
More informationModel Comparison. Course on Bayesian Inference, WTCN, UCL, February Model Comparison. Bayes rule for models. Linear Models. AIC and BIC.
Course on Bayesian Inference, WTCN, UCL, February 2013 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented
More informationAN ANOMALY CLOCK DETECTION ALGORITHM FOR A ROBUST CLOCK ENSEMBLE
4 st Annual Precise Time and Time Interval (PTTI) Meeting AN ANOMALY CLOCK DETECTION ALGORITHM FOR A ROBUST CLOCK ENSEMBLE Qinghua Wang and Pascal Rochat SpectraTime Vauseyon 9, Neuchâtel, Switzerland
More informationStart-Up Acceleration of Quartz Crystal Oscillator Using Active Inductance Double Resonance and Embedded Triggering Circuit
Journal of Sensor Technology, 05, 5, 5-7 Published Online March 05 in SciRes http://wwwscirporg/journal/jst http://dxdoiorg/0436/jst055003 Start-Up Acceleration of Quartz Crystal Oscillator Using Active
More informationMachine Learning Lecture 2
Machine Perceptual Learning and Sensory Summer Augmented 15 Computing Many slides adapted from B. Schiele Machine Learning Lecture 2 Probability Density Estimation 16.04.2015 Bastian Leibe RWTH Aachen
More information