Indiana University, Fall 2014 P309 Intermediate Physics Lab. Lecture 1: Experimental UncertainBes

Size: px
Start display at page:

Download "Indiana University, Fall 2014 P309 Intermediate Physics Lab. Lecture 1: Experimental UncertainBes"

Transcription

1 Indiana University, Fall 2014 P309 Intermediate Physics Lab Lecture 1: Experimental UncertainBes Reading: Bevington & Robinson, Chapters 1-3 Handouts from hmp://physics.indiana.edu/~courses/p309/f14/ Experimental UncertainBes Basic StaBsBcs

2 ScienBfic Method Essen%al goal of experimental physics: Precise & accurate measurement of quanbbes describing the natural universe Compare with models ( theories ) to idenbfy those that most accurately represent reality (or reject those that fail to do so) Cri%cal step in the process: Do measurement and theory agree? How do we answer this quesbon? à QuanBfy the uncertainty in the accuracy of the measurement (as well as that of the theory predicbon)

3 Example: measuring g Theory: Do these agree? If uncertainty is 0.5 m/s 2, then yes! Experiment: If uncertainty is 0.05 m/s 2, then no! Experimenter has responsibility to provide a quanbtabve esbmate of the experimental uncertainty!!

4 Terminology SomeBmes (/o`en) you will hear the uncertainty in a measurement being referred to as the error on the measurement. This is an imprecise shorthand. Real errors (as in mistakes) in measurements should be corrected for, if they are known. Uncertainty reflects the nobon that not all errors can be determined & corrected for. We characterize the degree of our lack of knowledge of just how wrong our measurement is likely to be, and express this quanbtabvely via something called the uncertainty, which describes a specific range of possible errors. SBll, people use error and uncertainty interchangeably, so don t get too hung up on this shorthand.

5 Two Categories of Measurement Uncertainty StaBsBcal uncertainbes: Due to random variabons (noise) in the measurement process. If you repeat a measurement many Bmes, this noise will average to zero. SystemaBc uncertainbes: Due to limitabons of the methods or apparatus being used to make the measurement. They affect all measurements the same way, and hence do not average out with repeated measurements.

6 Example Suppose you use a stop watch that reads to 1/100 th of a second to measure some Bme interval. From one trial to the next your reac1on may be different, resulbng in variabon in measured Bme. This would be a source of random error; averaging over mulbple trials would reduce the size of the sta+s+cal uncertainty associated with this source of error. You ll never be able to know the 1me to much be:er than 0.01 s, which is the limitabon of the watch. This is a systema+c uncertainty. Your reac1on 1me may be systema1cally slow, meaning that averaging over mulbple trials will sbll leave a measurement error. If you knew what this was you would correct for it. But if not, you are le` with another systema+c uncertainty. By the way, the purpose of calibra+on is to control exactly this sort of systemabc uncertainty.

7 How to EsBmate UncertainBes Assessing systemabc uncertainbes can be a bit of an art. It relies on the experimenter s judgment and ability to calibrate or cross- check the accuracy of the instrumentabon or method. Assessing systemabc uncertainbes (and designing experiments that are most immune to idenbfiable dominant sources or symptoms of error) o`en calls for creabvity and ingenuity. On the other hand, stabsbcal uncertainbes can be treated according to precise mathemabcal formulabons.

8 Treatment of Random Errors Suppose you are measuring a quanbty µ using a process that is subject to random noise: This distribubon can be characterized by its central value (the mean) and its width (the standard deviabon). You would report the mean as the best esbmate of the true value of µ; and the stabsbcal uncertainty would be related to the standard deviabon.

9 StaBsBcal Uncertainty CompuBng the mean : and variance The mean gives a good approximabon to µ, and s (the r.m.s., or standard, deviabon) approximates well the width σ, i.e., the single measurement uncertainty. Can compute the uncertainty on the mean: Thus report result as:

10 How to answer: Do measurement and theory agree? With an esbmate of expt l uncertainty in hand, one can answer: What is the likelihood that my measurement is a fluctuabon of the true value as predicted by theory? In principle, need probability density funcbon for such fluctuabons in most (but not all) cases, sufficient to assume Gaussian stabsbcs

11 PropagaBon of Errors Suppose want to infer value for quanbty y that is a funcbon y(x 1,x 2,x 3, ) of several independent (uncorrelated) measurements x 1,x 2,x 3, w/ uncertainbes σ 1,σ 2,σ 3, What is the overall uncertainty in y? (see Bevington, chap. 3) But use common sense: For complicated fcn s, somebmes easier to shi` input values by their errors one- by- one by hand to evaluate the above terms. Also useful to commit certain rules to memory: Sums & Differences: errors add in quadrature Products & QuoBents: per cent errors add in quadrature

The Mysteries of Quantum Mechanics

The Mysteries of Quantum Mechanics The Mysteries of Quantum Mechanics Class 4: History and the Quantum Atom Steve Bryson www.stevepur.com/quantum QuesBons? Class Outline 1) IntroducBon: ParBcles vs. Waves 2) Quantum Wave picture, uncertainty

More information

Uncertainty and Bias UIUC, 403 Advanced Physics Laboratory, Fall 2014

Uncertainty and Bias UIUC, 403 Advanced Physics Laboratory, Fall 2014 Uncertainty and Bias UIUC, 403 Advanced Physics Laboratory, Fall 2014 Liang Yang* There are three kinds of lies: lies, damned lies and statistics. Benjamin Disraeli If your experiment needs statistics,

More information

STA 4273H: Sta-s-cal Machine Learning

STA 4273H: Sta-s-cal Machine Learning STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! h0p://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 1 EvaluaBon

More information

STA 4273H: Sta-s-cal Machine Learning

STA 4273H: Sta-s-cal Machine Learning STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! h0p://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 1 EvaluaBon

More information

ComputaBonal Physics. StaBsBcal Data Analysis - Fundamental Concepts. Korea University Eunil Won

ComputaBonal Physics. StaBsBcal Data Analysis - Fundamental Concepts. Korea University Eunil Won ComputaBonal Physics StaBsBcal Data Analysis - Fundamental Concepts Korea University Eunil Won Before I start We are entering into scienbfic compubng era and in general this is a huge area. So I would

More information

The Banning of NHSTP in Basic and Applied Social Psychology. Abel Rodríguez Applied MathemaBcs and StaBsBcs University of California, Santa Cruz

The Banning of NHSTP in Basic and Applied Social Psychology. Abel Rodríguez Applied MathemaBcs and StaBsBcs University of California, Santa Cruz The Banning of NHSTP in Basic and Applied Social Psychology Abel Rodríguez Applied MathemaBcs and StaBsBcs University of California, Santa Cruz Background 2015 BASP editorial banned null hypothesis significance

More information

BRIDGE CIRCUITS EXPERIMENT 5: DC AND AC BRIDGE CIRCUITS 10/2/13

BRIDGE CIRCUITS EXPERIMENT 5: DC AND AC BRIDGE CIRCUITS 10/2/13 EXPERIMENT 5: DC AND AC BRIDGE CIRCUITS 0//3 This experiment demonstrates the use of the Wheatstone Bridge for precise resistance measurements and the use of error propagation to determine the uncertainty

More information

One sided tests. An example of a two sided alternative is what we ve been using for our two sample tests:

One sided tests. An example of a two sided alternative is what we ve been using for our two sample tests: One sided tests So far all of our tests have been two sided. While this may be a bit easier to understand, this is often not the best way to do a hypothesis test. One simple thing that we can do to get

More information

Hadronic Calorimetry Preliminary Discussion

Hadronic Calorimetry Preliminary Discussion Hadronic Calorimetry Preliminary Discussion C. Welke UCSD HEP Lecture 1 Contents DetecBng ParBcles ParBcle Overview Calorimetry HCAL Cartoon Showering EM Hadronic Measurement Summary UCSD HEP Lecture 2

More information

Sta$s$cal Op$miza$on for Big Data. Zhaoran Wang and Han Liu (Joint work with Tong Zhang)

Sta$s$cal Op$miza$on for Big Data. Zhaoran Wang and Han Liu (Joint work with Tong Zhang) Sta$s$cal Op$miza$on for Big Data Zhaoran Wang and Han Liu (Joint work with Tong Zhang) Big Data Movement Big Data = Massive Data- size + High Dimensional + Complex Structural + Highly Noisy Big Data give

More information

Learning from Atmospheric Neutrinos in the IceCube Deep Core Detector

Learning from Atmospheric Neutrinos in the IceCube Deep Core Detector Learning from Atmospheric Neutrinos in the IceCube Deep Core Detector Irina Mocioiu Pennsylvania State University Miami 2010 IceCube Deep Core mobvabon: look for neutrinos from galacbc sources, dark mager

More information

Bayesian Structure Modeling. SPFLODD December 1, 2011

Bayesian Structure Modeling. SPFLODD December 1, 2011 Bayesian Structure Modeling SPFLODD December 1, 2011 Outline Defining Bayesian Parametric Bayesian models Latent Dirichlet allocabon (Blei et al., 2003) Bayesian HMM (Goldwater and Griffiths, 2007) A limle

More information

The diameter of a proton is of the order of magnitude of. A m. B m. C m. D m.

The diameter of a proton is of the order of magnitude of. A m. B m. C m. D m. The diameter of a proton is of the order of magnitude of A. 10 12 m. B. 10 15 m. C. 10 18 m. D. 10 21 m. Which of the following is the best esbmate, to one significant digit, of the quanbty: A. 1.5 B.

More information

Physics 509: Error Propagation, and the Meaning of Error Bars. Scott Oser Lecture #10

Physics 509: Error Propagation, and the Meaning of Error Bars. Scott Oser Lecture #10 Physics 509: Error Propagation, and the Meaning of Error Bars Scott Oser Lecture #10 1 What is an error bar? Someone hands you a plot like this. What do the error bars indicate? Answer: you can never be

More information

Hypothesis testing I. - In particular, we are talking about statistical hypotheses. [get everyone s finger length!] n =

Hypothesis testing I. - In particular, we are talking about statistical hypotheses. [get everyone s finger length!] n = Hypothesis testing I I. What is hypothesis testing? [Note we re temporarily bouncing around in the book a lot! Things will settle down again in a week or so] - Exactly what it says. We develop a hypothesis,

More information

Quantum Mechanics I. Physics Prof. Claudia Ra6 Lecture Notes 1 (based on CT, SecBon 1)

Quantum Mechanics I. Physics Prof. Claudia Ra6 Lecture Notes 1 (based on CT, SecBon 1) Quantum Mechanics I Physics 6315 Prof. Claudia Ra6 cra6@uh.edu Lecture Notes 1 (based on CT, SecBon 1) Introduction Classical Mechanics, first quanbfied by Newton, describes and explains the mobon of macroscopic

More information

Appendix C: Accuracy, Precision, and Uncertainty

Appendix C: Accuracy, Precision, and Uncertainty Appendix C: Accuracy, Precision, and Uncertainty How tall are you? How old are you? When you answered these everyday questions, you probably did it in round numbers such as "five foot, six inches" or "nineteen

More information

Business Statistics. Lecture 9: Simple Regression

Business Statistics. Lecture 9: Simple Regression Business Statistics Lecture 9: Simple Regression 1 On to Model Building! Up to now, class was about descriptive and inferential statistics Numerical and graphical summaries of data Confidence intervals

More information

Measurement and Uncertainty

Measurement and Uncertainty Measurement and Uncertainty Michael Gold Physics 307L September 16, 2006 Michael Gold (Physics 307L) Measurement and Uncertainty September 16, 2006 1 / 9 Goal of Experiment Measure a parameter: statistical

More information

Lecture 10. Lidar Simulation and Error Analysis Overview (2)

Lecture 10. Lidar Simulation and Error Analysis Overview (2) Lecture 10. Lidar Simulation and Error Analysis Overview () Introduction Accuracy versus Precision Classification of Measurement Errors Accuracy in lidar measurements Precision in lidar measurements General

More information

Modern Methods of Data Analysis - WS 07/08

Modern Methods of Data Analysis - WS 07/08 Modern Methods of Data Analysis Lecture VIa (19.11.07) Contents: Uncertainties (II): Re: error propagation Correlated uncertainties Systematic uncertainties Re: Error Propagation (I) x = Vi,j and µi known

More information

Quan%ta%on with XPRESS. and. ASAPRa%o

Quan%ta%on with XPRESS. and. ASAPRa%o Quan%ta%on with XPRESS and ASAPRa%o 1 Pep%de and Protein Quan%ta%on Raw Mass Spec Data Pep%de Iden%fica%on Pep%de Valida%on Quan%ta%on Protein Assignment Protein List msconvert X!Tandem SpectraST SEQUEST*

More information

STATISTICS OF OBSERVATIONS & SAMPLING THEORY. Parent Distributions

STATISTICS OF OBSERVATIONS & SAMPLING THEORY. Parent Distributions ASTR 511/O Connell Lec 6 1 STATISTICS OF OBSERVATIONS & SAMPLING THEORY References: Bevington Data Reduction & Error Analysis for the Physical Sciences LLM: Appendix B Warning: the introductory literature

More information

PHY 101L - Experiments in Mechanics

PHY 101L - Experiments in Mechanics PHY 101L - Experiments in Mechanics introduction to error analysis What is Error? In everyday usage, the word error usually refers to a mistake of some kind. However, within the laboratory, error takes

More information

Introduction to Error Analysis

Introduction to Error Analysis Introduction to Error Analysis Part 1: the Basics Andrei Gritsan based on lectures by Petar Maksimović February 1, 2010 Overview Definitions Reporting results and rounding Accuracy vs precision systematic

More information

Introduction to Bayesian Statistics and Markov Chain Monte Carlo Estimation. EPSY 905: Multivariate Analysis Spring 2016 Lecture #10: April 6, 2016

Introduction to Bayesian Statistics and Markov Chain Monte Carlo Estimation. EPSY 905: Multivariate Analysis Spring 2016 Lecture #10: April 6, 2016 Introduction to Bayesian Statistics and Markov Chain Monte Carlo Estimation EPSY 905: Multivariate Analysis Spring 2016 Lecture #10: April 6, 2016 EPSY 905: Intro to Bayesian and MCMC Today s Class An

More information

Anthropic Principle. The Perfect Cosmological Principle: all large regions and *mes in the universe are stabsbcally idenbcal.

Anthropic Principle. The Perfect Cosmological Principle: all large regions and *mes in the universe are stabsbcally idenbcal. Anthropic Principle Although our situabon is not necessarily central, it is inevitably privileged to some extent. Brandon Carter in a symposium honoring Copernicus 500 birthday, 1973 The Perfect Cosmological

More information

Causal Viscous Hydrodynamics for RelaBvisBc Systems with MulB Components and MulB Conserved Currents

Causal Viscous Hydrodynamics for RelaBvisBc Systems with MulB Components and MulB Conserved Currents Reference: AM and T. Hirano, arxiv:1003:3087 Causal Viscous Hydrodynamics for RelaBvisBc Systems with MulB Components and MulB Conserved Currents Akihiko Monnai Department of Physics, The University of

More information

Revealing and Understanding the Low- mass End of the Stellar IMF. K. L. Luhman (Penn State)

Revealing and Understanding the Low- mass End of the Stellar IMF. K. L. Luhman (Penn State) Revealing and Understanding the Low- mass End of the Stellar IMF K. L. Luhman (Penn State) BasBan, Covey, & Meyer 2010 The field Open clusters Star- forming regions Outline See also: BasBan, Covey, & Meyer

More information

Visit The Chemical Sta/s/cian! h2p://chemicalsta/s/cian.wordpress.com/ PREDICTUM INC. 2NY3

Visit The Chemical Sta/s/cian! h2p://chemicalsta/s/cian.wordpress.com/ PREDICTUM INC.   2NY3 Visit The Chemical Sta/s/cian! h2p://chemicalsta/s/cian.wordpress.com/ PREDICTUM IC. WWW.PREDICTUM.COM 23 Follow Me On Twi2er @chemstateric! PREDICTUM IC. WWW.PREDICTUM.COM 23 I am a new guest blogger

More information

Introduction to Bayesian Learning. Machine Learning Fall 2018

Introduction to Bayesian Learning. Machine Learning Fall 2018 Introduction to Bayesian Learning Machine Learning Fall 2018 1 What we have seen so far What does it mean to learn? Mistake-driven learning Learning by counting (and bounding) number of mistakes PAC learnability

More information

ATLAS H(125) difermion results. Elizaveta Shabalina II. Physikalisches Ins/tut, Universität Gö9ngen on behalf of the ATLAS collabora/on

ATLAS H(125) difermion results. Elizaveta Shabalina II. Physikalisches Ins/tut, Universität Gö9ngen on behalf of the ATLAS collabora/on ATLAS H(125) difermion results Elizaveta Shabalina II. Physikalisches Ins/tut, Universität Gö9ngen on behalf of the ATLAS collabora/on Introduction - I Higgs discovery and measurements of its properbes

More information

Measurement And Uncertainty

Measurement And Uncertainty Measurement And Uncertainty Based on Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Results, NIST Technical Note 1297, 1994 Edition PHYS 407 1 Measurement approximates or

More information

Introduction to Survey Analysis!

Introduction to Survey Analysis! Introduction to Survey Analysis! Professor Ron Fricker! Naval Postgraduate School! Monterey, California! Reading Assignment:! 2/22/13 None! 1 Goals for this Lecture! Introduction to analysis for surveys!

More information

Measurement Uncertainties

Measurement Uncertainties Measurement Uncertainties Introduction We all intuitively know that no experimental measurement can be "perfect''. It is possible to make this idea quantitative. It can be stated this way: the result of

More information

Extra Topic: DISTRIBUTIONS OF FUNCTIONS OF RANDOM VARIABLES

Extra Topic: DISTRIBUTIONS OF FUNCTIONS OF RANDOM VARIABLES Extra Topic: DISTRIBUTIONS OF FUNCTIONS OF RANDOM VARIABLES A little in Montgomery and Runger text in Section 5-5. Previously in Section 5-4 Linear Functions of Random Variables, we saw that we could find

More information

Lecture 11: Extrema. Nathan Pflueger. 2 October 2013

Lecture 11: Extrema. Nathan Pflueger. 2 October 2013 Lecture 11: Extrema Nathan Pflueger 2 October 201 1 Introduction In this lecture we begin to consider the notion of extrema of functions on chosen intervals. This discussion will continue in the lectures

More information

Take the measurement of a person's height as an example. Assuming that her height has been determined to be 5' 8", how accurate is our result?

Take the measurement of a person's height as an example. Assuming that her height has been determined to be 5' 8, how accurate is our result? Error Analysis Introduction The knowledge we have of the physical world is obtained by doing experiments and making measurements. It is important to understand how to express such data and how to analyze

More information

EM Waves in Media. What happens when an EM wave travels through our model material?

EM Waves in Media. What happens when an EM wave travels through our model material? EM Waves in Media We can model a material as made of atoms which have a charged electron bound to a nucleus by a spring. We model the nuclei as being fixed to a grid (because they are heavy, they don t

More information

Physics 140. Sound. Chapter 12

Physics 140. Sound. Chapter 12 Physics 140 Sound Chapter 12 Sound waves Sound is composed of longitudinal pressure waves. wave propagabon Compression Compression Compression è when parbcles come together RarefacBon RarefacBon RarefacBon

More information

Statistical Methods in Particle Physics

Statistical Methods in Particle Physics Statistical Methods in Particle Physics Lecture 11 January 7, 2013 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline How to communicate the statistical uncertainty

More information

Flowchart. (b) (c) (d)

Flowchart. (b) (c) (d) Flowchart (c) (b) (d) This workflow consists of the following steps: alpha diversity (microbial community evenness and richness) d1) Generate rarefied OTU tables (mulbple_rarefacbons.py) d2) Compute measures

More information

SPH3U1 Lesson 03 Introduction. 6.1 Expressing Error in Measurement

SPH3U1 Lesson 03 Introduction. 6.1 Expressing Error in Measurement SIGNIFICANT DIGITS AND SCIENTIFIC NOTATION LEARNING GOALS Students will: 6 ERROR Describe the difference between precision and accuracy Be able to compare values quantitatively Understand and describe

More information

CS173 Strong Induction and Functions. Tandy Warnow

CS173 Strong Induction and Functions. Tandy Warnow CS173 Strong Induction and Functions Tandy Warnow CS 173 Introduction to Strong Induction (also Functions) Tandy Warnow Preview of the class today What are functions? Weak induction Strong induction A

More information

Data Analysis, Standard Error, and Confidence Limits E80 Spring 2015 Notes

Data Analysis, Standard Error, and Confidence Limits E80 Spring 2015 Notes Data Analysis Standard Error and Confidence Limits E80 Spring 05 otes We Believe in the Truth We frequently assume (believe) when making measurements of something (like the mass of a rocket motor) that

More information

Experiment 0 ~ Introduction to Statistics and Excel Tutorial. Introduction to Statistics, Error and Measurement

Experiment 0 ~ Introduction to Statistics and Excel Tutorial. Introduction to Statistics, Error and Measurement Experiment 0 ~ Introduction to Statistics and Excel Tutorial Many of you already went through the introduction to laboratory practice and excel tutorial in Physics 1011. For that reason, we aren t going

More information

Data Analysis, Standard Error, and Confidence Limits E80 Spring 2012 Notes

Data Analysis, Standard Error, and Confidence Limits E80 Spring 2012 Notes Data Analysis Standard Error and Confidence Limits E80 Spring 0 otes We Believe in the Truth We frequently assume (believe) when making measurements of something (like the mass of a rocket motor) that

More information

One-sample categorical data: approximate inference

One-sample categorical data: approximate inference One-sample categorical data: approximate inference Patrick Breheny October 6 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/25 Introduction It is relatively easy to think about the distribution

More information

Econ 325: Introduction to Empirical Economics

Econ 325: Introduction to Empirical Economics Econ 325: Introduction to Empirical Economics Chapter 9 Hypothesis Testing: Single Population Ch. 9-1 9.1 What is a Hypothesis? A hypothesis is a claim (assumption) about a population parameter: population

More information

Moon Phases. The moon phases grow from right to le2 in the Northern hemisphere. Moon on the right, ge7ng bigger every night (waxing)

Moon Phases. The moon phases grow from right to le2 in the Northern hemisphere. Moon on the right, ge7ng bigger every night (waxing) Moon Phases The moon phases grow from right to le2 in the Northern hemisphere. Moon on the right, ge7ng bigger every night (waxing) Moon Phases When the moon is waning, it is fading to the le2 unbl there

More information

Week 11 Sample Means, CLT, Correlation

Week 11 Sample Means, CLT, Correlation Week 11 Sample Means, CLT, Correlation Slides by Suraj Rampure Fall 2017 Administrative Notes Complete the mid semester survey on Piazza by Nov. 8! If 85% of the class fills it out, everyone will get a

More information

Statistical Modeling and Analysis of Scientific Inquiry: The Basics of Hypothesis Testing

Statistical Modeling and Analysis of Scientific Inquiry: The Basics of Hypothesis Testing Statistical Modeling and Analysis of Scientific Inquiry: The Basics of Hypothesis Testing So, What is Statistics? Theory and techniques for learning from data How to collect How to analyze How to interpret

More information

Errors: What they are, and how to deal with them

Errors: What they are, and how to deal with them Errors: What they are, and how to deal with them A series of three lectures plus exercises, by Alan Usher Room 111, a.usher@ex.ac.uk Synopsis 1) Introduction ) Rules for quoting errors 3) Combining errors

More information

Appendix B: Accuracy, Precision and Uncertainty

Appendix B: Accuracy, Precision and Uncertainty Appendix B: Accuracy, Precision and Uncertainty How tall are you? How old are you? When you answered these everyday questions, you probably did it in round numbers such as "five foot, six inches" or "nineteen

More information

Confidence Intervals and Hypothesis Tests

Confidence Intervals and Hypothesis Tests Confidence Intervals and Hypothesis Tests STA 281 Fall 2011 1 Background The central limit theorem provides a very powerful tool for determining the distribution of sample means for large sample sizes.

More information

The classifier. Theorem. where the min is over all possible classifiers. To calculate the Bayes classifier/bayes risk, we need to know

The classifier. Theorem. where the min is over all possible classifiers. To calculate the Bayes classifier/bayes risk, we need to know The Bayes classifier Theorem The classifier satisfies where the min is over all possible classifiers. To calculate the Bayes classifier/bayes risk, we need to know Alternatively, since the maximum it is

More information

The classifier. Linear discriminant analysis (LDA) Example. Challenges for LDA

The classifier. Linear discriminant analysis (LDA) Example. Challenges for LDA The Bayes classifier Linear discriminant analysis (LDA) Theorem The classifier satisfies In linear discriminant analysis (LDA), we make the (strong) assumption that where the min is over all possible classifiers.

More information

ERROR ANALYSIS ACTIVITY 1: STATISTICAL MEASUREMENT UNCERTAINTY AND ERROR BARS

ERROR ANALYSIS ACTIVITY 1: STATISTICAL MEASUREMENT UNCERTAINTY AND ERROR BARS ERROR ANALYSIS ACTIVITY 1: STATISTICAL MEASUREMENT UNCERTAINTY AND ERROR BARS LEARNING GOALS At the end of this activity you will be able 1. to explain the merits of different ways to estimate the statistical

More information

Freely Falling Object

Freely Falling Object Younghee Kwon PHYS 2125 Freely Falling Object Short Abstract: The purpose of this lab is to analyze one dimensional motion by looking at freely falling objects and determine the acceleration of gravity

More information

Radial selec*on issues for primordial non- Gaussianity detec*on

Radial selec*on issues for primordial non- Gaussianity detec*on Radial selec*on issues for primordial non- Gaussianity detec*on Carlos Cunha NG at KICP, University of Chicago April 20, 2012 Radial issues Decoupled from angular selecbon: One average N(z) for all (simplest

More information

Error Analysis. V. Lorenz L. Yang, M. Grosse Perdekamp, D. Hertzog, R. Clegg PHYS403 Spring 2016

Error Analysis. V. Lorenz L. Yang, M. Grosse Perdekamp, D. Hertzog, R. Clegg PHYS403 Spring 2016 Error Analysis V. Lorenz L. Yang, M. Grosse Perdekamp, D. Hertzog, R. Clegg PHYS403 Spring 2016 Reporting measurement results Always include uncertainty estimates in your results Have the correct number

More information

DS-GA 1002 Lecture notes 11 Fall Bayesian statistics

DS-GA 1002 Lecture notes 11 Fall Bayesian statistics DS-GA 100 Lecture notes 11 Fall 016 Bayesian statistics In the frequentist paradigm we model the data as realizations from a distribution that depends on deterministic parameters. In contrast, in Bayesian

More information

2. A Basic Statistical Toolbox

2. A Basic Statistical Toolbox . A Basic Statistical Toolbo Statistics is a mathematical science pertaining to the collection, analysis, interpretation, and presentation of data. Wikipedia definition Mathematical statistics: concerned

More information

Lecture 1. ABC of Probability

Lecture 1. ABC of Probability Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability

More information

Two-sample inference: Continuous Data

Two-sample inference: Continuous Data Two-sample inference: Continuous Data November 5 Diarrhea Diarrhea is a major health problem for babies, especially in underdeveloped countries Diarrhea leads to dehydration, which results in millions

More information

Lecture 32. Lidar Error and Sensitivity Analysis

Lecture 32. Lidar Error and Sensitivity Analysis Lecture 3. Lidar Error and Sensitivity Analysis Introduction Accuracy in lidar measurements Precision in lidar measurements Error analysis for Na Doppler lidar Sensitivity analysis Summary 1 Errors vs.

More information

Announcements. Unit 3: Foundations for inference Lecture 3: Decision errors, significance levels, sample size, and power.

Announcements. Unit 3: Foundations for inference Lecture 3: Decision errors, significance levels, sample size, and power. Announcements Announcements Unit 3: Foundations for inference Lecture 3:, significance levels, sample size, and power Statistics 101 Mine Çetinkaya-Rundel October 1, 2013 Project proposal due 5pm on Friday,

More information

Lecture 2e Row Echelon Form (pages 73-74)

Lecture 2e Row Echelon Form (pages 73-74) Lecture 2e Row Echelon Form (pages 73-74) At the end of Lecture 2a I said that we would develop an algorithm for solving a system of linear equations, and now that we have our matrix notation, we can proceed

More information

Probability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics

Probability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics Probability Rules MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Introduction Probability is a measure of the likelihood of the occurrence of a certain behavior

More information

Introducing Proof 1. hsn.uk.net. Contents

Introducing Proof 1. hsn.uk.net. Contents Contents 1 1 Introduction 1 What is proof? 1 Statements, Definitions and Euler Diagrams 1 Statements 1 Definitions Our first proof Euler diagrams 4 3 Logical Connectives 5 Negation 6 Conjunction 7 Disjunction

More information

2. An Introduction to Moving Average Models and ARMA Models

2. An Introduction to Moving Average Models and ARMA Models . An Introduction to Moving Average Models and ARMA Models.1 White Noise. The MA(1) model.3 The MA(q) model..4 Estimation and forecasting of MA models..5 ARMA(p,q) models. The Moving Average (MA) models

More information

Lecture 24: Weighted and Generalized Least Squares

Lecture 24: Weighted and Generalized Least Squares Lecture 24: Weighted and Generalized Least Squares 1 Weighted Least Squares When we use ordinary least squares to estimate linear regression, we minimize the mean squared error: MSE(b) = 1 n (Y i X i β)

More information

- a value calculated or derived from the data.

- a value calculated or derived from the data. Descriptive statistics: Note: I'm assuming you know some basics. If you don't, please read chapter 1 on your own. It's pretty easy material, and it gives you a good background as to why we need statistics.

More information

Probability. We will now begin to explore issues of uncertainty and randomness and how they affect our view of nature.

Probability. We will now begin to explore issues of uncertainty and randomness and how they affect our view of nature. Probability We will now begin to explore issues of uncertainty and randomness and how they affect our view of nature. We will explore in lab the differences between accuracy and precision, and the role

More information

Astro 109 Lecture 2: An Insider s View of Science. September 5, 2014

Astro 109 Lecture 2: An Insider s View of Science. September 5, 2014 Astro 109 Lecture 2: An Insider s View of Science September 5, 2014 ConstellaBon of the day: Cepheus This is a circumpolar constellabon: it is close to the north celesbal pole, and therefore visible at

More information

Statistics for Data Analysis. Niklaus Berger. PSI Practical Course Physics Institute, University of Heidelberg

Statistics for Data Analysis. Niklaus Berger. PSI Practical Course Physics Institute, University of Heidelberg Statistics for Data Analysis PSI Practical Course 2014 Niklaus Berger Physics Institute, University of Heidelberg Overview You are going to perform a data analysis: Compare measured distributions to theoretical

More information

Introduction to Statistics and Data Analysis

Introduction to Statistics and Data Analysis Introduction to Statistics and Data Analysis RSI 2005 Staff July 15, 2005 Variation and Statistics Good experimental technique often requires repeated measurements of the same quantity These repeatedly

More information

My data doesn t look like that..

My data doesn t look like that.. Testing assumptions My data doesn t look like that.. We have made a big deal about testing model assumptions each week. Bill Pine Testing assumptions Testing assumptions We have made a big deal about testing

More information

1 Measurement Uncertainties

1 Measurement Uncertainties 1 Measurement Uncertainties (Adapted stolen, really from work by Amin Jaziri) 1.1 Introduction No measurement can be perfectly certain. No measuring device is infinitely sensitive or infinitely precise.

More information

March 19 - Solving Linear Systems

March 19 - Solving Linear Systems March 19 - Solving Linear Systems Welcome to linear algebra! Linear algebra is the study of vectors, vector spaces, and maps between vector spaces. It has applications across data analysis, computer graphics,

More information

Error analysis for the physical sciences A course reader for phys 1140 Scott Pinegar and Markus Raschke Department of Physics, University of Colorado

Error analysis for the physical sciences A course reader for phys 1140 Scott Pinegar and Markus Raschke Department of Physics, University of Colorado Error analysis for the physical sciences A course reader for phys 1140 Scott Pinegar and Markus Raschke Department of Physics, University of Colorado Version 1.0 (September 9, 2012) 1 Part 1 (chapter 1

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate

More information

What Every Programmer Should Know About Floating-Point Arithmetic DRAFT. Last updated: November 3, Abstract

What Every Programmer Should Know About Floating-Point Arithmetic DRAFT. Last updated: November 3, Abstract What Every Programmer Should Know About Floating-Point Arithmetic Last updated: November 3, 2014 Abstract The article provides simple answers to the common recurring questions of novice programmers about

More information

Visual matching: distance measures

Visual matching: distance measures Visual matching: distance measures Metric and non-metric distances: what distance to use It is generally assumed that visual data may be thought of as vectors (e.g. histograms) that can be compared for

More information

Beyond p values and significance. "Accepting the null hypothesis" Power Utility of a result. Cohen Empirical Methods CS650

Beyond p values and significance. Accepting the null hypothesis Power Utility of a result. Cohen Empirical Methods CS650 Beyond p values and significance "Accepting the null hypothesis" Power Utility of a result Showing that things are NOT different Example: Oates and Heeringa wanted to show that their grammar induction

More information

Lecture 5. G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1

Lecture 5. G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1 Lecture 5 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,

More information

CSC 2541: Bayesian Methods for Machine Learning

CSC 2541: Bayesian Methods for Machine Learning CSC 2541: Bayesian Methods for Machine Learning Radford M. Neal, University of Toronto, 2011 Lecture 10 Alternatives to Monte Carlo Computation Since about 1990, Markov chain Monte Carlo has been the dominant

More information

Physics 509: Propagating Systematic Uncertainties. Scott Oser Lecture #12

Physics 509: Propagating Systematic Uncertainties. Scott Oser Lecture #12 Physics 509: Propagating Systematic Uncertainties Scott Oser Lecture #1 1 Additive offset model Suppose we take N measurements from a distribution, and wish to estimate the true mean of the underlying

More information

Descriptive Statistics (And a little bit on rounding and significant digits)

Descriptive Statistics (And a little bit on rounding and significant digits) Descriptive Statistics (And a little bit on rounding and significant digits) Now that we know what our data look like, we d like to be able to describe it numerically. In other words, how can we represent

More information

Naïve Bayes Lecture 17

Naïve Bayes Lecture 17 Naïve Bayes Lecture 17 David Sontag New York University Slides adapted from Luke Zettlemoyer, Carlos Guestrin, Dan Klein, and Mehryar Mohri Bayesian Learning Use Bayes rule! Data Likelihood Prior Posterior

More information

Preliminary Statistics. Lecture 5: Hypothesis Testing

Preliminary Statistics. Lecture 5: Hypothesis Testing Preliminary Statistics Lecture 5: Hypothesis Testing Rory Macqueen (rm43@soas.ac.uk), September 2015 Outline Elements/Terminology of Hypothesis Testing Types of Errors Procedure of Testing Significance

More information

Sta$s$cal Significance Tes$ng In Theory and In Prac$ce

Sta$s$cal Significance Tes$ng In Theory and In Prac$ce Sta$s$cal Significance Tes$ng In Theory and In Prac$ce Ben Cartere8e University of Delaware h8p://ir.cis.udel.edu/ictir13tutorial Hypotheses and Experiments Hypothesis: Using an SVM for classifica$on will

More information

1 Measurement Uncertainties

1 Measurement Uncertainties 1 Measurement Uncertainties (Adapted stolen, really from work by Amin Jaziri) 1.1 Introduction No measurement can be perfectly certain. No measuring device is infinitely sensitive or infinitely precise.

More information

Review. One-way ANOVA, I. What s coming up. Multiple comparisons

Review. One-way ANOVA, I. What s coming up. Multiple comparisons Review One-way ANOVA, I 9.07 /15/00 Earlier in this class, we talked about twosample z- and t-tests for the difference between two conditions of an independent variable Does a trial drug work better than

More information

Introduction to Experiment: Part 1

Introduction to Experiment: Part 1 Introduction to Experiment: Part 1 Nate Saffold nas2173@columbia.edu Office Hours: Mondays 5-6PM Pupin 1216 INTRO TO EXPERIMENTAL PHYS-LAB 1493/1494/2699 General Announcements Labs will commence February

More information

(1) Introduction to Bayesian statistics

(1) Introduction to Bayesian statistics Spring, 2018 A motivating example Student 1 will write down a number and then flip a coin If the flip is heads, they will honestly tell student 2 if the number is even or odd If the flip is tails, they

More information

arxiv:astro-ph/ v1 20 Oct 2003

arxiv:astro-ph/ v1 20 Oct 2003 χ 2 and Linear Fits Andrew Gould (Dept. of Astronomy, Ohio State University) Abstract arxiv:astro-ph/0310577 v1 20 Oct 2003 The mathematics of linear fits is presented in covariant form. Topics include:

More information

Advanced Introduction to Machine Learning CMU-10715

Advanced Introduction to Machine Learning CMU-10715 Advanced Introduction to Machine Learning CMU-10715 Gaussian Processes Barnabás Póczos http://www.gaussianprocess.org/ 2 Some of these slides in the intro are taken from D. Lizotte, R. Parr, C. Guesterin

More information

4th IMPRS Astronomy Summer School Drawing Astrophysical Inferences from Data Sets

4th IMPRS Astronomy Summer School Drawing Astrophysical Inferences from Data Sets 4th IMPRS Astronomy Summer School Drawing Astrophysical Inferences from Data Sets William H. Press The University of Texas at Austin Lecture 6 IMPRS Summer School 2009, Prof. William H. Press 1 Mixture

More information

Objective Experiments Glossary of Statistical Terms

Objective Experiments Glossary of Statistical Terms Objective Experiments Glossary of Statistical Terms This glossary is intended to provide friendly definitions for terms used commonly in engineering and science. It is not intended to be absolutely precise.

More information