ik () uk () Today s menu Last lecture Some definitions Repeatability of sensing elements

Size: px
Start display at page:

Download "ik () uk () Today s menu Last lecture Some definitions Repeatability of sensing elements"

Transcription

1 Last lecture Overview of the elements of measurement systems. Sensing elements. Signal conditioning elements. Signal processing elements. Data presentation elements. Static characteristics of measurement systems. Range, span, resolution. Straight line vs. non-linearities. Sensitivity. Environmental effects, wear and aging. Hysteresis. Error bands. Today s menu Statistical characteristics: Accuracy. Repeatability. Tolerance. Uncertainty analysis (in the steady state). 1 2 Some definitions Accuracy How close are we, on average, to the true value of the measured quantity? Repeatability How much does the measured value vary around its average over time. Let s start by looking at repeatability of single sensing elements. Repeatability of sensing elements Recall the voltage and current measurements from last lecture: ik () R uk () 3 4

2 Measuring the voltage times, we obtained the following distribution Sample distribution Estimated Gaussian PDF Some comments on the sensing element (voltage meter) in this example: The mean value of the measured value is equal to the true voltage. Conclusion: The sensing element is accurate. The variance around the mean value is very high. This means the voltage meter suffers from a large lack of repeatability. Probability u 5 6 The most common cause of the variation in output O is random fluctuations with time in the environmental inputs I M and I I. If the coupling constants, K M and K I are non-zero, this causes variations in the output O. By making reasonable assumptions about the probability density functions of the inputs, I,I M,I I, we can find (or at least approximate) the probability density function of the output O. Very often, the probability density function of the inputs can be assumed to be the Normal probability distribution or the Gaussian distribution, i.e. p(x) = 1 ] [ σ 2π exp (x x)2, 2σ 2 where x is the mean or expected value (center of the distribution) and σ is the standard deviation (spread of the distribution). 7 8

3 General Gaussian distribution ( x =0,σ =1). Recall the general equation for the output of a measurement system O = KI + a + N(I)+K M I M I + K I I I. P σ,σ = P 2σ,2σ = P 3σ,3σ = σ σ 2σ 2σ 3σ 3σ p(x)dx p(x)dx p(x)dx P(x) 3σ 2σ σ 0 σ 2σ 3σ x A small deviation in the output O can be approximated as ΔO = ( ) ( ) O O ΔI + ΔI M + I I M ( O I I ) ΔI I which means ΔO is approximated by a linear combination of the deviations of the inputs, I,I M,I I It can be shown that, if y is a linear combination of the independent variables x 1,x 2,x 3, i.e. y = a 1 x 1 + a 2 x 2 + a 3 x 3, and the if x 1,x 2,x 3 have normal distributions with standard deviations σ 1,σ 2,σ 3, respectively, then the output will also have a normal distribution, with standard deviation σ = a 2 1 σ2 1 + a2 2 σ2 2 + a2 3 σ2 3. That is, a linear combination of Gaussian variables is also Gaussian, with standard deviation as the equation above. We can now express the standard deviation of the output of a system element in terms of the standard deviations of the input, as σ O = ( O I ) 2 ( ) 2 O σi 2 + σi 2 I M + M ( O I I The mean (or expected value) of the output is given by: Ō = KĪ + a + N(Ī)+K M Ī M Ī + KĪ I, and the corresponding probability density function is: p(o) = ] 1 (O Ō)2 exp [ σ O 2π 2σO 2. ) 2 σ 2 I I

4 Some comments In some cases the standard deviation of the inputs are known or can be estimated. In other cases, the standard deviation of the output can be estimated by repeated experiments. The decomposition of the output s variance into contributions from the different inputs, gives a detailed understanding of where to put the effort in order to minimize the deviation. Tolerance A manufacturer of some sensing elements, for example resistors, can state that the resistor: Has a resistance R 0 = 100 Ω with a tolerance of ±0.15 Ω. This means he has to reject all components with resistance outside the interval Ω <R 0 < Ω. OR he could state that all components lie in that interval, with some probability (typically about 99 %). The user can now choose to either calibrate each component or, more realistically, use the manufacturer s tolerance to estimate the resulting deviation of his/her system Accuracy Accuracy is quantified using the measurement error Err = measured value true value. A system is said to be perfectly accurate if Err =0, or, in the presence of deviation of its elements, it is said to be unbiased if Err = E{Err} = Err p(err)derr =0. Accuracy (cont d...) Comments on the equations in the book In the book, the word mean (as in average) is used as equal to the expected value. This is not true! The expected value of a variable x is defined as μ x = E{x} = xp(x)dx, while the average (or as it s often named, the sample mean) is x = 1 N N x n, n=1 where N is the number of observations

5 Accuracy (cont d...) Comments on the equations in the book (cont d...) If the errors are Gaussian, then the sample mean is in fact an unbiased consistent estimate of the true mean, that is lim N 1 N N x n = μ x. n=1 Another, more important, error in the book concerns the standard deviation... Accuracy (cont d...) Comments on the equations in the book (cont d...) Strictly speaking, the variance σx 2 of a random variable x is defined as σx 2 = E{(x μ x ) 2 } = while the book defines it as σ 2 x = 1 N N (x n x) 2. n=1 (x μ x ) 2 p(x)dx, Accuracy (cont d...) Comments on the equations in the book (cont d...) Example A temperature measurement system If the true mean μ x is unknown and replaced with the sample mean, then the sample variance is an estimate of the true variance, given by s 2 = 1 N 1 N (x n x) 2. n=1 For small N, the equation in the book gives biased estimates of the variance. For very large N and Gaussian noise, the results are the same. T o C R T o T i ma M C True temperature Platinum resistance temperature detector Current transmitter Recorder Measured temperature 19 20

6 Example (cont d...) Determining the overall uncertainty Work flow Find the model equations for each of the system elements (usually specified by the manufacturer). Find the nominal values (mean values) of the model quantities. Find the individual standard deviations (or tolerance measures) for the model quantities. Calculate the overall mean and standard deviation of each system element. Combine all system elements to obtain an estimate of the total accuracy and standard deviation. This is sometimes referred to as the total uncertainty of the system. Example (cont d...) Model equations for the temperature measurement system The resistance temperature detector: ( R T = R 0 1+αT + βt 2 ). The current transmitter: i = KR T + K M R T ΔT a + K I ΔT a + a, where ΔT a is a deviation in ambient temperature from 20 C. The recorder: T M = Ki + a Example (cont d...) Going through the calculations we see that estimated temperature has a bias of 0.05 C (at T = 117 C) and a standard deviation σ TM =0.49 C. A 2σ interval contains approximately 95 % of all measurements. Modeling using error bands In situations where element non-linearity, hysteresis, an environmental effects are small, they can simply be represented by a uniform error distribution, or error band. Measured temperature, T M True temperature, T Estimated temperature 2σ interval 23 In a system of N such elements, the overall error distribution will approach the Normal distribution (by the central limit theorem). In these cases, the calculations of the error propagation simplifies. See pages in the book for details. 24

7 Error reduction techniques For different types of elements and effects, different error reduction techniques can be applied. These techniques will be covered later in the course, when we go through specific sensing elements. Read section 3.3 in the text book on your own. Summary Repeatability, accuracy, and tolerance of sensing elements. Variance and mean of system quantities. Uncertainty analysis of measurement systems. Error bands and confidence intervals. All this for systems in the steady state Next lecture Dynamic characteristics of measurement systems. First and second order elements. Identification of dynamics: Step responses. Sinusoidal responses. Dynamic errors. Dynamic compensation. Recommended exercises , 3.2, Also, implement 3.8 in MATLAB and plot as a function of the force, with a 2σ interval

8 Questions? 29

Module 1: Introduction to Experimental Techniques Lecture 6: Uncertainty analysis. The Lecture Contains: Uncertainity Analysis

Module 1: Introduction to Experimental Techniques Lecture 6: Uncertainty analysis. The Lecture Contains: Uncertainity Analysis The Lecture Contains: Uncertainity Analysis Error Propagation Analysis of Scatter Table A1: Normal Distribution Table A2: Student's-t Distribution file:///g /optical_measurement/lecture6/6_1.htm[5/7/2012

More information

Lecture Notes 5 Convergence and Limit Theorems. Convergence with Probability 1. Convergence in Mean Square. Convergence in Probability, WLLN

Lecture Notes 5 Convergence and Limit Theorems. Convergence with Probability 1. Convergence in Mean Square. Convergence in Probability, WLLN Lecture Notes 5 Convergence and Limit Theorems Motivation Convergence with Probability Convergence in Mean Square Convergence in Probability, WLLN Convergence in Distribution, CLT EE 278: Convergence and

More information

Instrument types and performance characteristics

Instrument types and performance characteristics 2 Instrument types and performance characteristics 2.1 Review of instrument types Instruments can be subdivided into separate classes according to several criteria. These subclassifications are useful

More information

ME EXAM #1 Tuesday, October 7, :30 7:30 pm PHYS 112 and 114

ME EXAM #1 Tuesday, October 7, :30 7:30 pm PHYS 112 and 114 ME 36500 EXAM # Tuesday, October 7, 04 6:30 7:30 pm PHYS and 4 Division: Chiu(0:30) / Shelton(:30) / Bae(:30) (circle one) HW ID: Name: Solution Instructions () This is a closed book examination, but you

More information

Lecture Notes on the Gaussian Distribution

Lecture Notes on the Gaussian Distribution Lecture Notes on the Gaussian Distribution Hairong Qi The Gaussian distribution is also referred to as the normal distribution or the bell curve distribution for its bell-shaped density curve. There s

More information

Advanced Signal Processing Introduction to Estimation Theory

Advanced Signal Processing Introduction to Estimation Theory Advanced Signal Processing Introduction to Estimation Theory Danilo Mandic, room 813, ext: 46271 Department of Electrical and Electronic Engineering Imperial College London, UK d.mandic@imperial.ac.uk,

More information

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics)

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Probability quantifies randomness and uncertainty How do I estimate the normalization and logarithmic slope of a X ray continuum, assuming

More information

ENGR352 Problem Set 02

ENGR352 Problem Set 02 engr352/engr352p02 September 13, 2018) ENGR352 Problem Set 02 Transfer function of an estimator 1. Using Eq. (1.1.4-27) from the text, find the correct value of r ss (the result given in the text is incorrect).

More information

Infinite Horizon LQ. Given continuous-time state equation. Find the control function u(t) to minimize

Infinite Horizon LQ. Given continuous-time state equation. Find the control function u(t) to minimize Infinite Horizon LQ Given continuous-time state equation x = Ax + Bu Find the control function ut) to minimize J = 1 " # [ x T t)qxt) + u T t)rut)] dt 2 0 Q $ 0, R > 0 and symmetric Solution is obtained

More information

Lecture 8: Signal Detection and Noise Assumption

Lecture 8: Signal Detection and Noise Assumption ECE 830 Fall 0 Statistical Signal Processing instructor: R. Nowak Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(0, σ I n n and S = [s, s,..., s n ] T

More information

Temperature measurement

Temperature measurement Luleå University of Technology Johan Carlson Last revision: July 22, 2009 Measurement Technology and Uncertainty Analysis - E7021E Lab 3 Temperature measurement Introduction In this lab you are given a

More information

Introduction to Error Analysis

Introduction to Error Analysis Introduction to Error Analysis Part 1: the Basics Andrei Gritsan based on lectures by Petar Maksimović February 1, 2010 Overview Definitions Reporting results and rounding Accuracy vs precision systematic

More information

System Identification

System Identification System Identification Arun K. Tangirala Department of Chemical Engineering IIT Madras July 27, 2013 Module 3 Lecture 1 Arun K. Tangirala System Identification July 27, 2013 1 Objectives of this Module

More information

Control Engineering BDA30703

Control Engineering BDA30703 Control Engineering BDA30703 Lecture 3: Performance characteristics of an instrument Prepared by: Ramhuzaini bin Abd. Rahman Expected Outcomes At the end of this lecture, students should be able to; 1)

More information

IEOR 165 Lecture 7 1 Bias-Variance Tradeoff

IEOR 165 Lecture 7 1 Bias-Variance Tradeoff IEOR 165 Lecture 7 Bias-Variance Tradeoff 1 Bias-Variance Tradeoff Consider the case of parametric regression with β R, and suppose we would like to analyze the error of the estimate ˆβ in comparison to

More information

Chapter 1 - Basic Concepts. Measurement System Components. Sensor - Transducer. Signal-conditioning. Output. Feedback-control

Chapter 1 - Basic Concepts. Measurement System Components. Sensor - Transducer. Signal-conditioning. Output. Feedback-control Chapter 1 - Basic Concepts Measurement System Components Sensor - Transducer Signal-conditioning Output Feedback-control MeasurementSystemConcepts.doc 8/27/2008 12:03 PM Page 1 Example: Sensor/ Transducer

More information

Lecture 4 Propagation of errors

Lecture 4 Propagation of errors Introduction Lecture 4 Propagation of errors Example: we measure the current (I and resistance (R of a resistor. Ohm's law: V = IR If we know the uncertainties (e.g. standard deviations in I and R, what

More information

Coverage: through class #7 material (updated June 14, 2017) Terminology/miscellaneous. for a linear instrument:

Coverage: through class #7 material (updated June 14, 2017) Terminology/miscellaneous. for a linear instrument: Boston University ME 310: Summer 017 Course otes to-date Prof. C. Farny DISCLAIMER: This document is meant to serve as a reference and an overview, and not an exclusive study guide for the course. Coverage:

More information

Problem Set 2. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 30

Problem Set 2. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 30 Problem Set 2 MAS 622J/1.126J: Pattern Recognition and Analysis Due: 5:00 p.m. on September 30 [Note: All instructions to plot data or write a program should be carried out using Matlab. In order to maintain

More information

Terminology Suppose we have N observations {x(n)} N 1. Estimators as Random Variables. {x(n)} N 1

Terminology Suppose we have N observations {x(n)} N 1. Estimators as Random Variables. {x(n)} N 1 Estimation Theory Overview Properties Bias, Variance, and Mean Square Error Cramér-Rao lower bound Maximum likelihood Consistency Confidence intervals Properties of the mean estimator Properties of the

More information

Chapter 5 continued. Chapter 5 sections

Chapter 5 continued. Chapter 5 sections Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions

More information

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance The Kalman Filter Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading s.l.dance@reading.ac.uk July

More information

COMPSCI 240: Reasoning Under Uncertainty

COMPSCI 240: Reasoning Under Uncertainty COMPSCI 240: Reasoning Under Uncertainty Andrew Lan and Nic Herndon University of Massachusetts at Amherst Spring 2019 Lecture 20: Central limit theorem & The strong law of large numbers Markov and Chebyshev

More information

Nonconvex penalties: Signal-to-noise ratio and algorithms

Nonconvex penalties: Signal-to-noise ratio and algorithms Nonconvex penalties: Signal-to-noise ratio and algorithms Patrick Breheny March 21 Patrick Breheny High-Dimensional Data Analysis (BIOS 7600) 1/22 Introduction In today s lecture, we will return to nonconvex

More information

Modern Methods of Data Analysis - WS 07/08

Modern Methods of Data Analysis - WS 07/08 Modern Methods of Data Analysis Lecture VIc (19.11.07) Contents: Maximum Likelihood Fit Maximum Likelihood (I) Assume N measurements of a random variable Assume them to be independent and distributed according

More information

Temperature Sensors & Measurement

Temperature Sensors & Measurement Temperature Sensors & Measurement E80 Spring 2014 Contents Why measure temperature? Characteristics of interest Types of temperature sensors 1. Thermistor 2. RTD Sensor 3. Thermocouple 4. Integrated Silicon

More information

AE2160 Introduction to Experimental Methods in Aerospace

AE2160 Introduction to Experimental Methods in Aerospace AE160 Introduction to Experimental Methods in Aerospace Uncertainty Analysis C.V. Di Leo (Adapted from slides by J.M. Seitzman, J.J. Rimoli) 1 Accuracy and Precision Accuracy is defined as the difference

More information

CSCI5654 (Linear Programming, Fall 2013) Lectures Lectures 10,11 Slide# 1

CSCI5654 (Linear Programming, Fall 2013) Lectures Lectures 10,11 Slide# 1 CSCI5654 (Linear Programming, Fall 2013) Lectures 10-12 Lectures 10,11 Slide# 1 Today s Lecture 1. Introduction to norms: L 1,L 2,L. 2. Casting absolute value and max operators. 3. Norm minimization problems.

More information

Estimators as Random Variables

Estimators as Random Variables Estimation Theory Overview Properties Bias, Variance, and Mean Square Error Cramér-Rao lower bound Maimum likelihood Consistency Confidence intervals Properties of the mean estimator Introduction Up until

More information

Temperature Sensing. How does the temperature sensor work and how can it be used to control the temperature of a refrigerator?

Temperature Sensing. How does the temperature sensor work and how can it be used to control the temperature of a refrigerator? Temperature Sensing How does the temperature sensor work and how can it be used to control the temperature of a refrigerator? Temperature Sensing page: 1 of 22 Contents Initial Problem Statement 2 Narrative

More information

Understanding the Differences between LS Algorithms and Sequential Filters

Understanding the Differences between LS Algorithms and Sequential Filters Understanding the Differences between LS Algorithms and Sequential Filters In order to perform meaningful comparisons between outputs from a least squares (LS) orbit determination algorithm and orbit determination

More information

Review. December 4 th, Review

Review. December 4 th, Review December 4 th, 2017 Att. Final exam: Course evaluation Friday, 12/14/2018, 10:30am 12:30pm Gore Hall 115 Overview Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 6: Statistics and Sampling Distributions Chapter

More information

Trial version. Temperature Sensing. How does the temperature sensor work and how can it be used to control the temperature of a refrigerator?

Trial version. Temperature Sensing. How does the temperature sensor work and how can it be used to control the temperature of a refrigerator? Temperature Sensing How does the temperature sensor work and how can it be used to control the temperature of a refrigerator? Temperature Sensing page: 1 of 13 Contents Initial Problem Statement 2 Narrative

More information

4/3/2019. Advanced Measurement Systems and Sensors. Dr. Ibrahim Al-Naimi. Chapter one. Introduction to Measurement Systems

4/3/2019. Advanced Measurement Systems and Sensors. Dr. Ibrahim Al-Naimi. Chapter one. Introduction to Measurement Systems Advanced Measurement Systems and Sensors Dr. Ibrahim Al-Naimi Chapter one Introduction to Measurement Systems 1 Outlines Control and measurement systems Transducer/sensor definition and classifications

More information

Mathematical statistics

Mathematical statistics October 4 th, 2018 Lecture 12: Information Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter

More information

BRIDGE CIRCUITS EXPERIMENT 5: DC AND AC BRIDGE CIRCUITS 10/2/13

BRIDGE CIRCUITS EXPERIMENT 5: DC AND AC BRIDGE CIRCUITS 10/2/13 EXPERIMENT 5: DC AND AC BRIDGE CIRCUITS 0//3 This experiment demonstrates the use of the Wheatstone Bridge for precise resistance measurements and the use of error propagation to determine the uncertainty

More information

Welcome. Functionality and application of RTD Temperature Probes and Thermocouples. Dipl.-Ing. Manfred Schleicher

Welcome. Functionality and application of RTD Temperature Probes and Thermocouples. Dipl.-Ing. Manfred Schleicher Welcome Functionality and application of RTD Temperature Probes and Thermocouples Dipl.-Ing. Manfred Schleicher This presentation informs about the basics of RTD Temperature Probes and thermocouples Functionality

More information

Statistical inference

Statistical inference Statistical inference Contents 1. Main definitions 2. Estimation 3. Testing L. Trapani MSc Induction - Statistical inference 1 1 Introduction: definition and preliminary theory In this chapter, we shall

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Dealing with uncertainty

Dealing with uncertainty Appendix A Dealing with uncertainty A.1 Overview An uncertainty is always a positive number δx > 0. If you measure x with a device that has a precision of u, thenδx is at least as large as u. Fractional

More information

Identification of ARX, OE, FIR models with the least squares method

Identification of ARX, OE, FIR models with the least squares method Identification of ARX, OE, FIR models with the least squares method CHEM-E7145 Advanced Process Control Methods Lecture 2 Contents Identification of ARX model with the least squares minimizing the equation

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental

More information

Essentials of expressing measurement uncertainty

Essentials of expressing measurement uncertainty Essentials of expressing measurement uncertainty This is a brief summary of the method of evaluating and expressing uncertainty in measurement adopted widely by U.S. industry, companies in other countries,

More information

Why, What, Who, When, Where, and How

Why, What, Who, When, Where, and How www.osram.com Basics of Uncertainty Estimation Why, What, Who, When, Where, and How Light is OSRAM Why 1. To provide users of data with a quantification of expected variation. Regulation requirements 3.

More information

Lecture 7: Chapter 7. Sums of Random Variables and Long-Term Averages

Lecture 7: Chapter 7. Sums of Random Variables and Long-Term Averages Lecture 7: Chapter 7. Sums of Random Variables and Long-Term Averages ELEC206 Probability and Random Processes, Fall 2014 Gil-Jin Jang gjang@knu.ac.kr School of EE, KNU page 1 / 15 Chapter 7. Sums of Random

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

INC 331 Industrial Process Measurement. Instrument Characteristics

INC 331 Industrial Process Measurement. Instrument Characteristics INC 331 Industrial Process Measurement Instrument Characteristics Introduction Measurement is the experimental process of acquiring any quantitative information. When doing a measurement, we compare the

More information

01 Probability Theory and Statistics Review

01 Probability Theory and Statistics Review NAVARCH/EECS 568, ROB 530 - Winter 2018 01 Probability Theory and Statistics Review Maani Ghaffari January 08, 2018 Last Time: Bayes Filters Given: Stream of observations z 1:t and action data u 1:t Sensor/measurement

More information

HIGH CURRENT BRIDGE DRIVER and 4-20mA Transmitter

HIGH CURRENT BRIDGE DRIVER and 4-20mA Transmitter XTR1 HIGH CURRENT RIDGE DRIVER and 4-2mA Transmitter FEATURES SENSOR EXCITATION OF 1W VARIALE EXCITATION VOLTAGE: 1.V to.v SINGLE SUPPLY: 11.4V to 3VDC INRUSH CURRENT LIMITING 4-2mA TRANSMITTER APPLICATIONS

More information

Dealing with uncertainty

Dealing with uncertainty Appendix A Dealing with uncertainty A.1 Overview An uncertainty is always a positive number δx > 0. If you measure x with a device that has a precision of u, thenδx is at least as large as u. Fractional

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

Systems Approaches to Estimation Problems in Thin Film Processing

Systems Approaches to Estimation Problems in Thin Film Processing Systems Approaches to Estimation Problems in Thin Film Processing Tyrone Vincent tvincent@mines.edu October 20, 2008 T. Vincent (IMPACT) Systems Approaches to Estimation October 20, 2008 1 / 45 Acknowledgements

More information

COURSE OF Prepared By: MUHAMMAD MOEEN SULTAN Department of Mechanical Engineering UET Lahore, KSK Campus

COURSE OF Prepared By: MUHAMMAD MOEEN SULTAN Department of Mechanical Engineering UET Lahore, KSK Campus COURSE OF Active and passive instruments Null-type and deflection-type instruments Analogue and digital instruments In active instruments, the external power source is usually required to produce an output

More information

EL1820 Modeling of Dynamical Systems

EL1820 Modeling of Dynamical Systems EL1820 Modeling of Dynamical Systems Lecture 10 - System identification as a model building tool Experiment design Examination and prefiltering of data Model structure selection Model validation Lecture

More information

EE 3CL4: Introduction to Control Systems Lab 4: Lead Compensation

EE 3CL4: Introduction to Control Systems Lab 4: Lead Compensation EE 3CL4: Introduction to Control Systems Lab 4: Lead Compensation Tim Davidson Ext. 27352 davidson@mcmaster.ca Objective To use the root locus technique to design a lead compensator for a marginally-stable

More information

Modern Methods of Data Analysis - WS 07/08

Modern Methods of Data Analysis - WS 07/08 Modern Methods of Data Analysis Lecture VII (26.11.07) Contents: Maximum Likelihood (II) Exercise: Quality of Estimators Assume hight of students is Gaussian distributed. You measure the size of N students.

More information

Lecture 17: The Exponential and Some Related Distributions

Lecture 17: The Exponential and Some Related Distributions Lecture 7: The Exponential and Some Related Distributions. Definition Definition: A continuous random variable X is said to have the exponential distribution with parameter if the density of X is e x if

More information

Winter 2019 Math 106 Topics in Applied Mathematics. Lecture 1: Introduction

Winter 2019 Math 106 Topics in Applied Mathematics. Lecture 1: Introduction Winter 2019 Math 106 Topics in Applied Mathematics Data-driven Uncertainty Quantification Yoonsang Lee (yoonsang.lee@dartmouth.edu) Lecture 1: Introduction 19 Winter M106 Class: MWF 12:50-1:55 pm @ 200

More information

Circuit Theorems Overview Linearity Superposition Source Transformation Thévenin and Norton Equivalents Maximum Power Transfer

Circuit Theorems Overview Linearity Superposition Source Transformation Thévenin and Norton Equivalents Maximum Power Transfer Circuit Theorems Overview Linearity Superposition Source Transformation Thévenin and Norton Equivalents Maximum Power Transfer J. McNames Portland State University ECE 221 Circuit Theorems Ver. 1.36 1

More information

Measurement And Uncertainty

Measurement And Uncertainty Measurement And Uncertainty Based on Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Results, NIST Technical Note 1297, 1994 Edition PHYS 407 1 Measurement approximates or

More information

9/2/2010. Wildlife Management is a very quantitative field of study. throughout this course and throughout your career.

9/2/2010. Wildlife Management is a very quantitative field of study. throughout this course and throughout your career. Introduction to Data and Analysis Wildlife Management is a very quantitative field of study Results from studies will be used throughout this course and throughout your career. Sampling design influences

More information

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver Stochastic Signals Overview Definitions Second order statistics Stationarity and ergodicity Random signal variability Power spectral density Linear systems with stationary inputs Random signal memory Correlation

More information

Chapter 4. Probability and Statistics. Probability and Statistics

Chapter 4. Probability and Statistics. Probability and Statistics Chapter 4 Probability and Statistics Figliola and Beasley, (999) Probability and Statistics Engineering measurements taken repeatedly under seemingly ideal conditions will normally show variability. Measurement

More information

Probability and Statistical Decision Theory

Probability and Statistical Decision Theory Tufts COMP 135: Introduction to Machine Learning https://www.cs.tufts.edu/comp/135/2019s/ Probability and Statistical Decision Theory Many slides attributable to: Erik Sudderth (UCI) Prof. Mike Hughes

More information

Statistics notes. A clear statistical framework formulates the logic of what we are doing and why. It allows us to make precise statements.

Statistics notes. A clear statistical framework formulates the logic of what we are doing and why. It allows us to make precise statements. Statistics notes Introductory comments These notes provide a summary or cheat sheet covering some basic statistical recipes and methods. These will be discussed in more detail in the lectures! What is

More information

University of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout 2:. The Multivariate Gaussian & Decision Boundaries

University of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout 2:. The Multivariate Gaussian & Decision Boundaries University of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout :. The Multivariate Gaussian & Decision Boundaries..15.1.5 1 8 6 6 8 1 Mark Gales mjfg@eng.cam.ac.uk Lent

More information

Parameter estimation! and! forecasting! Cristiano Porciani! AIfA, Uni-Bonn!

Parameter estimation! and! forecasting! Cristiano Porciani! AIfA, Uni-Bonn! Parameter estimation! and! forecasting! Cristiano Porciani! AIfA, Uni-Bonn! Questions?! C. Porciani! Estimation & forecasting! 2! Cosmological parameters! A branch of modern cosmological research focuses

More information

COS Lecture 16 Autonomous Robot Navigation

COS Lecture 16 Autonomous Robot Navigation COS 495 - Lecture 16 Autonomous Robot Navigation Instructor: Chris Clark Semester: Fall 011 1 Figures courtesy of Siegwart & Nourbakhsh Control Structure Prior Knowledge Operator Commands Localization

More information

STATISTICS OF OBSERVATIONS & SAMPLING THEORY. Parent Distributions

STATISTICS OF OBSERVATIONS & SAMPLING THEORY. Parent Distributions ASTR 511/O Connell Lec 6 1 STATISTICS OF OBSERVATIONS & SAMPLING THEORY References: Bevington Data Reduction & Error Analysis for the Physical Sciences LLM: Appendix B Warning: the introductory literature

More information

Statistics, Probability Distributions & Error Propagation. James R. Graham

Statistics, Probability Distributions & Error Propagation. James R. Graham Statistics, Probability Distributions & Error Propagation James R. Graham Sample & Parent Populations Make measurements x x In general do not expect x = x But as you take more and more measurements a pattern

More information

Application Note AN37. Noise Histogram Analysis. by John Lis

Application Note AN37. Noise Histogram Analysis. by John Lis AN37 Application Note Noise Histogram Analysis by John Lis NOISELESS, IDEAL CONVERTER OFFSET ERROR σ RMS NOISE HISTOGRAM OF SAMPLES PROBABILITY DISTRIBUTION FUNCTION X PEAK-TO-PEAK NOISE Crystal Semiconductor

More information

Vectors To begin, let us describe an element of the state space as a point with numerical coordinates, that is x 1. x 2. x =

Vectors To begin, let us describe an element of the state space as a point with numerical coordinates, that is x 1. x 2. x = Linear Algebra Review Vectors To begin, let us describe an element of the state space as a point with numerical coordinates, that is x 1 x x = 2. x n Vectors of up to three dimensions are easy to diagram.

More information

Data Analysis, Standard Error, and Confidence Limits E80 Spring 2015 Notes

Data Analysis, Standard Error, and Confidence Limits E80 Spring 2015 Notes Data Analysis Standard Error and Confidence Limits E80 Spring 05 otes We Believe in the Truth We frequently assume (believe) when making measurements of something (like the mass of a rocket motor) that

More information

Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1)

Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1) Advanced Research Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1) Intelligence for Embedded Systems Ph. D. and Master Course Manuel Roveri Politecnico di Milano,

More information

Exercise 1: Thermistor Characteristics

Exercise 1: Thermistor Characteristics Exercise 1: Thermistor Characteristics EXERCISE OBJECTIVE When you have completed this exercise, you will be able to describe and demonstrate the characteristics of thermistors. DISCUSSION A thermistor

More information

Brief Review on Estimation Theory

Brief Review on Estimation Theory Brief Review on Estimation Theory K. Abed-Meraim ENST PARIS, Signal and Image Processing Dept. abed@tsi.enst.fr This presentation is essentially based on the course BASTA by E. Moulines Brief review on

More information

Linear Classification: Perceptron

Linear Classification: Perceptron Linear Classification: Perceptron Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong 1 / 18 Y Tao Linear Classification: Perceptron In this lecture, we will consider

More information

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu

More information

Today s menu. Last lecture. Measurement of volume flow rate. Measurement of volume flow rate (cont d...) Differential pressure flow meters

Today s menu. Last lecture. Measurement of volume flow rate. Measurement of volume flow rate (cont d...) Differential pressure flow meters Last lecture Analog-to-digital conversion (Ch. 1.1). Introduction to flow measurement systems (Ch. 12.1). Today s menu Measurement of volume flow rate Differential pressure flowmeters Mechanical flowmeters

More information

Uncertainty Analysis of Experimental Data and Dimensional Measurements

Uncertainty Analysis of Experimental Data and Dimensional Measurements Uncertainty Analysis of Experimental Data and Dimensional Measurements Introduction The primary objective of this experiment is to introduce analysis of measurement uncertainty and experimental error.

More information

PROCESS CONTROL (IT62) SEMESTER: VI BRANCH: INSTRUMENTATION TECHNOLOGY

PROCESS CONTROL (IT62) SEMESTER: VI BRANCH: INSTRUMENTATION TECHNOLOGY PROCESS CONTROL (IT62) SEMESTER: VI BRANCH: INSTRUMENTATION TECHNOLOGY by, Dr. Mallikarjun S. Holi Professor & Head Department of Biomedical Engineering Bapuji Institute of Engineering & Technology Davangere-577004

More information

Computer Intensive Methods in Mathematical Statistics

Computer Intensive Methods in Mathematical Statistics Computer Intensive Methods in Mathematical Statistics Department of mathematics KTH Royal Institute of Technology jimmyol@kth.se Lecture 2 Random number generation 27 March 2014 Computer Intensive Methods

More information

Statistics. Lent Term 2015 Prof. Mark Thomson. 2: The Gaussian Limit

Statistics. Lent Term 2015 Prof. Mark Thomson. 2: The Gaussian Limit Statistics Lent Term 2015 Prof. Mark Thomson Lecture 2 : The Gaussian Limit Prof. M.A. Thomson Lent Term 2015 29 Lecture Lecture Lecture Lecture 1: Back to basics Introduction, Probability distribution

More information

Course on Inverse Problems

Course on Inverse Problems California Institute of Technology Division of Geological and Planetary Sciences March 26 - May 25, 2007 Course on Inverse Problems Albert Tarantola Institut de Physique du Globe de Paris Lesson XVI CONCLUSION

More information

EIE 240 Electrical and Electronic Measurements Class 2: January 16, 2015 Werapon Chiracharit. Measurement

EIE 240 Electrical and Electronic Measurements Class 2: January 16, 2015 Werapon Chiracharit. Measurement EIE 240 Electrical and Electronic Measurements Class 2: January 16, 2015 Werapon Chiracharit Measurement Measurement is to determine the value or size of some quantity, e.g. a voltage or a current. Analogue

More information

Course on Inverse Problems Albert Tarantola

Course on Inverse Problems Albert Tarantola California Institute of Technology Division of Geological and Planetary Sciences March 26 - May 25, 27 Course on Inverse Problems Albert Tarantola Institut de Physique du Globe de Paris CONCLUSION OF THE

More information

Electronic Supplementary Information (ESI)

Electronic Supplementary Information (ESI) Electronic Supplementary Material (ESI) for Nanoscale. This journal is The Royal Society of Chemistry 2015 Electronic Supplementary Information (ESI) Thermal Conductivity Measurements of High and Low Thermal

More information

Notes Errors and Noise PHYS 3600, Northeastern University, Don Heiman, 6/9/ Accuracy versus Precision. 2. Errors

Notes Errors and Noise PHYS 3600, Northeastern University, Don Heiman, 6/9/ Accuracy versus Precision. 2. Errors Notes Errors and Noise PHYS 3600, Northeastern University, Don Heiman, 6/9/2011 1. Accuracy versus Precision 1.1 Precision how exact is a measurement, or how fine is the scale (# of significant figures).

More information

Lecture 3. - all digits that are certain plus one which contains some uncertainty are said to be significant figures

Lecture 3. - all digits that are certain plus one which contains some uncertainty are said to be significant figures Lecture 3 SIGNIFICANT FIGURES e.g. - all digits that are certain plus one which contains some uncertainty are said to be significant figures 10.07 ml 0.1007 L 4 significant figures 0.10070 L 5 significant

More information

Statistics: Learning models from data

Statistics: Learning models from data DS-GA 1002 Lecture notes 5 October 19, 2015 Statistics: Learning models from data Learning models from data that are assumed to be generated probabilistically from a certain unknown distribution is a crucial

More information

Math 362, Problem set 1

Math 362, Problem set 1 Math 6, roblem set Due //. (4..8) Determine the mean variance of the mean X of a rom sample of size 9 from a distribution having pdf f(x) = 4x, < x

More information

Mathematical statistics

Mathematical statistics October 18 th, 2018 Lecture 16: Midterm review Countdown to mid-term exam: 7 days Week 1 Chapter 1: Probability review Week 2 Week 4 Week 7 Chapter 6: Statistics Chapter 7: Point Estimation Chapter 8:

More information

APPENDIX A: DEALING WITH UNCERTAINTY

APPENDIX A: DEALING WITH UNCERTAINTY APPENDIX A: DEALING WITH UNCERTAINTY 1. OVERVIEW An uncertainty is always a positive number δx > 0. If the uncertainty of x is 5%, then δx =.05x. If the uncertainty in x is δx, then the fractional uncertainty

More information

Ensemble Data Assimilation and Uncertainty Quantification

Ensemble Data Assimilation and Uncertainty Quantification Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY PHYSICS DEPARTMENT

MASSACHUSETTS INSTITUTE OF TECHNOLOGY PHYSICS DEPARTMENT G. Clark 7oct96 1 MASSACHUSETTS INSTITUTE OF TECHNOLOGY PHYSICS DEPARTMENT 8.13/8.14 Junior Laboratory STATISTICS AND ERROR ESTIMATION The purpose of this note is to explain the application of statistics

More information

Monte Carlo Simulations

Monte Carlo Simulations Monte Carlo Simulations What are Monte Carlo Simulations and why ones them? Pseudo Random Number generators Creating a realization of a general PDF The Bootstrap approach A real life example: LOFAR simulations

More information

ECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else

ECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else ECE 450 Homework #3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3 4 5

More information

The Gaussian distribution

The Gaussian distribution The Gaussian distribution Probability density function: A continuous probability density function, px), satisfies the following properties:. The probability that x is between two points a and b b P a

More information

2.1 Lecture 5: Probability spaces, Interpretation of probabilities, Random variables

2.1 Lecture 5: Probability spaces, Interpretation of probabilities, Random variables Chapter 2 Kinetic Theory 2.1 Lecture 5: Probability spaces, Interpretation of probabilities, Random variables In the previous lectures the theory of thermodynamics was formulated as a purely phenomenological

More information

ST495: Survival Analysis: Hypothesis testing and confidence intervals

ST495: Survival Analysis: Hypothesis testing and confidence intervals ST495: Survival Analysis: Hypothesis testing and confidence intervals Eric B. Laber Department of Statistics, North Carolina State University April 3, 2014 I remember that one fateful day when Coach took

More information