Least Squares Fitting (LSQF) with a complicated function Theexampleswehavelookedatsofarhavebeenlinearintheparameters

Similar documents
The Poisson Process Properties of the Poisson Process

Solution set Stat 471/Spring 06. Homework 2

Density estimation III. Linear regression.

Chapter 8. Simple Linear Regression

Determination of Antoine Equation Parameters. December 4, 2012 PreFEED Corporation Yoshio Kumagae. Introduction

14. Poisson Processes

(1) Cov(, ) E[( E( ))( E( ))]

The ray paths and travel times for multiple layers can be computed using ray-tracing, as demonstrated in Lab 3.

Midterm Exam. Tuesday, September hour, 15 minutes

The Linear Regression Of Weighted Segments

Cyclone. Anti-cyclone

FORCED VIBRATION of MDOF SYSTEMS

Fault Tolerant Computing. Fault Tolerant Computing CS 530 Probabilistic methods: overview

Density estimation III.

Density estimation III.

Linear Regression Linear Regression with Shrinkage

COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION

AML710 CAD LECTURE 12 CUBIC SPLINE CURVES. Cubic Splines Matrix formulation Normalised cubic splines Alternate end conditions Parabolic blending

Chapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1)

Density estimation. Density estimations. CS 2750 Machine Learning. Lecture 5. Milos Hauskrecht 5329 Sennott Square

Least squares and motion. Nuno Vasconcelos ECE Department, UCSD

FALL HOMEWORK NO. 6 - SOLUTION Problem 1.: Use the Storage-Indication Method to route the Input hydrograph tabulated below.

EE 6885 Statistical Pattern Recognition

Continuous Time Markov Chains

Real-Time Systems. Example: scheduling using EDF. Feasibility analysis for EDF. Example: scheduling using EDF

Lecture 3 Topic 2: Distributions, hypothesis testing, and sample size determination

Comparison of the Bayesian and Maximum Likelihood Estimation for Weibull Distribution

8. Queueing systems lect08.ppt S Introduction to Teletraffic Theory - Fall

QR factorization. Let P 1, P 2, P n-1, be matrices such that Pn 1Pn 2... PPA

Final Exam Applied Econometrics

4. THE DENSITY MATRIX

Fundamentals of Speech Recognition Suggested Project The Hidden Markov Model

( ) ( ) Weibull Distribution: k ti. u u. Suppose t 1, t 2, t n are times to failure of a group of n mechanisms. The likelihood function is

-distributed random variables consisting of n samples each. Determine the asymptotic confidence intervals for

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 12 Dec. 2016, Page No.

Partial Molar Properties of solutions

Suppose we have observed values t 1, t 2, t n of a random variable T.

Mathematical Formulation

RATIO ESTIMATORS USING CHARACTERISTICS OF POISSON DISTRIBUTION WITH APPLICATION TO EARTHQUAKE DATA

Solution. The straightforward approach is surprisingly difficult because one has to be careful about the limits.

i 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01

Moments of Order Statistics from Nonidentically Distributed Three Parameters Beta typei and Erlang Truncated Exponential Variables

Interval Estimation. Consider a random variable X with a mean of X. Let X be distributed as X X

Some Probability Inequalities for Quadratic Forms of Negatively Dependent Subgaussian Random Variables

The Mean Residual Lifetime of (n k + 1)-out-of-n Systems in Discrete Setting

CS344: Introduction to Artificial Intelligence

Key words: Fractional difference equation, oscillatory solutions,

EE 6885 Statistical Pattern Recognition

Solution of Impulsive Differential Equations with Boundary Conditions in Terms of Integral Equations

PubH 7440 Spring 2010 Midterm 2 April

Upper Bound For Matrix Operators On Some Sequence Spaces

Big O Notation for Time Complexity of Algorithms

Pricing of CDO s Based on the Multivariate Wang Transform*

For the plane motion of a rigid body, an additional equation is needed to specify the state of rotation of the body.

Efficient Estimators for Population Variance using Auxiliary Information

Quantum Mechanics II Lecture 11 Time-dependent perturbation theory. Time-dependent perturbation theory (degenerate or non-degenerate starting state)

Modeling and Predicting Sequences: HMM and (may be) CRF. Amr Ahmed Feb 25

Quantitative Portfolio Theory & Performance Analysis

θ = θ Π Π Parametric counting process models θ θ θ Log-likelihood: Consider counting processes: Score functions:

Competitive Facility Location Problem with Demands Depending on the Facilities

NOTE ON SIMPLE AND LOGARITHMIC RETURN

Asymptotic Behavior of Solutions of Nonlinear Delay Differential Equations With Impulse

Use of Non-Conventional Measures of Dispersion for Improved Estimation of Population Mean

Assessing Normality. Assessing Normality. Assessing Normality. Assessing Normality. Normal Probability Plot for Normal Distribution.

The Signal, Variable System, and Transformation: A Personal Perspective

Photon Statistics. photons/s. Light beam stream of photons Difference with classical waves relies on different statistical properties

Pricing Asian Options with Fourier Convolution

Regression Approach to Parameter Estimation of an Exponential Software Reliability Model

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!

Extremal graph theory II: K t and K t,t

Mathematical Statistics. Chapter VIII Sampling Distributions and the Central Limit Theorem

Solving Non-Linear Rational Expectations Models: Approximations based on Taylor Expansions

Learning of Graphical Models Parameter Estimation and Structure Learning

ε. Therefore, the estimate

Anouncements. Conjugate Gradients. Steepest Descent. Outline. Steepest Descent. Steepest Descent

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

As evident from the full-sample-model, we continue to assume that individual errors are identically and

STK3100 and STK4100 Autumn 2017

VARIATIONAL ITERATION METHOD FOR DELAY DIFFERENTIAL-ALGEBRAIC EQUATIONS. Hunan , China,

EMA5001 Lecture 3 Steady State & Nonsteady State Diffusion - Fick s 2 nd Law & Solutions

Lecture VI Regression

CSE 5526: Introduction to Neural Networks Linear Regression

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

Mixed Integral Equation of Contact Problem in Position and Time

Brownian Motion and Stochastic Calculus. Brownian Motion and Stochastic Calculus

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5

IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS

OLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17

CHAPTER 6. d. With success = observation greater than 10, x = # of successes = 4, and

Machine Learning. Introduction to Regression. Lecture 3, September 19, Reading: Chap. 3, CB

Multiple Choice Test. Chapter Adequacy of Models for Regression

Section l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1

Survival Prediction Based on Compound Covariate under Cox Proportional Hazard Models

Fresnel Dragging Explained

Statistics: Part 1 Parameter Estimation

Centroids Method of Composite Areas

Optimal Eye Movement Strategies in Visual Search (Supplement)

Pure Math 30: Explained!

Kernel-based Methods and Support Vector Machines

Transcription:

Leas Squares Fg LSQF wh a complcaed fuco Theeampleswehavelookedasofarhavebeelearheparameers ha we have bee rg o deerme e.g. slope, ercep. For he case where he fuco s lear he parameers we ca fd a aalc soluo usg e.g. mar verso for a sragh le he mar s. However, we ofe ecouer he case where he fuco s o-lear some of he parameers, e.g. he fuco lab 5: / A, B, C,,, Ae B C Ths fuco s lear A, B,C, bu o-lear σ ad μ. Oher eamples of fucos wh a o-lear parameer are: / A / A Ae For mos o-lear fucos we cao wre dow a soluo for he parameers a closed form usg, for eample, he echques of lear algebra.e. marces. Usuall o-lear problems are solved umercall o a compuer. Somemes b a chage of varables we ca ur a o-lear problem o a lear oe. We wll do hs Lab 6 whe he lfeme of Ba37 s measured. R. Kass/Sp5 P3700/Lecure 8

Deermao of a Lfeme Lab 6 The amou of a radoacve subsace as a fuco of me s gve b: 0 e / = he amou of he subsace prese a me. 0 = amou of he subsace a he begg of he eperme = 0. = he lfeme of he subsace. We ca ur hs o-lear problem o a lear oe b a chage of varables Take he aural log of boh sdes of he above epoeal equao: =l =l 0 -/=C+D ow a lear problem he parameers C ad D! I fac s jus a sragh le! = -/D To measure he lfeme Lab 6 we frs f for D he slope & he rasform D o =-/D. R. Kass/Sp5 P3700/Lecure 8

Lfeme Daa 3 4 5 6 7 8 9 0 0 5 30 45 60 75 90 05 0 35 06 80 98 75 74 73 49 38 37 = l 4.663 4.38 4.585 4.37 4.304 4.90 3.89 3.638 3.6 3.09 D 0 560.4 40.773675 0645 675 / D 96.80 secods The ercep s gve b: C = 4.77 = l 0 or 0 = 7.9 = 4.7746 + -0.0033 R= 0.9358 5 0.0033 4.5 l[ Y ] 4 3.5 3-0 0 0 40 60 80 00 0 40 me, R. Kass/Sp5 P3700/Lecure 8 3

Fd he values 0 ad akg o accou he uceraes he daa pos. Weghed formulas are Talor P98 ad Prob. 8.9 w =/ The ucera he umber of radoacve decas s govered b Posso sascs. The umber of cous a b s assumed o be he average of a Posso dsrbuo: = = Varace The varace of = l ca be calculaed usg propagao of errors: The slope & ercep from a sragh le f ha cludes uceraes he daa pos: / l / / / l l =4 75 ad = 0 00903 l l If all he 's are he same =4.75 ad = -0.00903 = -/ = -/0.00903 = 0.7 sec To calculae he error o he lfeme τ, we frs mus calculae he error o he slope, β: : he he epressos are decal o he uweghed case. 3 0.005 / / 0.0 3340 684700 65 65 3 6 R. Kass/Sp5 P3700/Lecure 8 4 The epermeall deermed lfeme s: = 0.7 ±.3 sec. 3. 0 9.03 / / 3

Leas Squares Fg-Epoeal Eample We ca calculae he o see how good he daa fs a epoeal deca dsrbuo: For hs problem: l 0 =4.75 0 =.73 ad = 0.7 sec / 0e 0 / 0 0 / 0e e 5.6 Posso appromao Mahemaca Calculao: Do[{csq=csq+c[]-a*Ep[-[]/au]^/a*Ep[-[]/au]},{,,0}] Pr["The ch sq per dof s ",csq/8] v=-cdf[chsquaredsrbuo[8],csq]; Pr["The ch sq prob. s ",00*v,"%"] 8 DOF sce we calculaed 0 & from he 0 daa pos The ch sq per dof s.96 The ch sq prob. s 4.9 % Ths s o such a good f sce he probabl s ol ~4.9%. R. Kass/Sp5 P3700/Lecure 8 5

The Error o he Mea Error o he mea revew from Lecure 4 Queso: If we have a se of measuremes of he same qua: Q f f m m f m q Wha's he bes wa o combe hese measuremes? How o calculae he varace oce we combe he measuremes? Assumg Gaussa sascs, he Mamum Lkelhood Mehod sas combe he... measuremes as: / / weghed average If all he varaces = = 3.. are he same: uweghed average The varace of he weghed average ca be calculaed usg propagao of errors: / / Ad he dervaves are: 4 / / / / R. Kass/Sp5 P3700/Lecure 8 6 =error he weghed mea

If all he varaces are he same: / The error he mea ges smaller as he umber of measuremes creases. Do' cofuse he error he mea wh he sadard devao of he dsrbuo! If we make more measuremes: The sadard devao of he gaussa dsrbuo remas he same, BUT he error he mea decreases Lecure 4 Eample: Two epermes measure he mass of he proo: Eperme measures m p=950±5 MeV Eperme measures m p =936±5 MeV Usg jus he average of he wo epermes we fd: m p =950+936/=943MeV p Usg he weghed average of he wo epermes we fd: m p =950/5 +936/5 //5 +/5 =937 MeV ad he varace: =//5 +/5 =4MeV =4.9 =5 MeV Sce eperme was more precse ha eperme we would epec he fal resul o be closer o eperme s value. m p =937±5 MeV R. Kass/Sp5 P3700/Lecure 8 7