Linear Regression. Hsiao-Lung Chan Dept Electrical Engineering Chang Gung University, Taiwan

Similar documents
Linear Regression. Hsiao-Lung Chan Dept Electrical Engineering Chang Gung University, Taiwan

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

Line Fitting and Regression

Correlation and Simple Linear Regression

residual. (Note that usually in descriptions of regression analysis, upper-case

Example: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger

ENGI 3423 Simple Linear Regression Page 12-01

Probability and. Lecture 13: and Correlation

Statistics MINITAB - Lab 5

Statistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018

Simple Linear Regression

Chapter 13 Student Lecture Notes 13-1

Objectives of Multiple Regression

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

STA302/1001-Fall 2008 Midterm Test October 21, 2008

Linear Regression with One Regressor

Module 7. Lecture 7: Statistical parameter estimation

PGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation

Lecture Notes Types of economic variables

Mathematics HL and Further mathematics HL Formula booklet

ESS Line Fitting

Lecture 8: Linear Regression

Chapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:

Simple Linear Regression

Econometric Methods. Review of Estimation

Multiple Choice Test. Chapter Adequacy of Models for Regression

IFYMB002 Mathematics Business Appendix C Formula Booklet

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

Chapter 5 Elementary Statistics, Empirical Probability Distributions, and More on Simulation

Mean is only appropriate for interval or ratio scales, not ordinal or nominal.

Simple Linear Regression - Scalar Form

Data Processing Techniques

Special Instructions / Useful Data

Simple Linear Regression and Correlation.

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Analyzing Two-Dimensional Data. Analyzing Two-Dimensional Data

Lecture 1: Introduction to Regression

Correlation and Regression Analysis

ORF 245 Fundamentals of Statistics Chapter 14 Least Squares Regression


Generative classification models

Law of Large Numbers

A Study of the Reproducibility of Measurements with HUR Leg Extension/Curl Research Line

Maximum Likelihood Estimation

Simple Linear Regression and Correlation. Applied Statistics and Probability for Engineers. Chapter 11 Simple Linear Regression and Correlation

Parameter, Statistic and Random Samples

: At least two means differ SST

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Midterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes

r y Simple Linear Regression How To Study Relation Between Two Quantitative Variables? Scatter Plot Pearson s Sample Correlation Correlation

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

Multiple Linear Regression Analysis

Lecture 1: Introduction to Regression

Continuous Distributions

CHAPTER VI Statistical Analysis of Experimental Data

X ε ) = 0, or equivalently, lim

Functions of Random Variables

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Lecture 3 Probability review (cont d)

Previous lecture. Lecture 8. Learning outcomes of this lecture. Today. Statistical test and Scales of measurement. Correlation

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.

Chapter 5 Properties of a Random Sample

Simple Linear Regression. How To Study Relation Between Two Quantitative Variables? Scatter Plot. Pearson s Sample Correlation.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

MMJ 1113 FINITE ELEMENT METHOD Introduction to PART I

Lecture Notes 2. The ability to manipulate matrices is critical in economics.

Given a table of data poins of an unknown or complicated function f : we want to find a (simpler) function p s.t. px (

CS 2750 Machine Learning. Lecture 8. Linear regression. CS 2750 Machine Learning. Linear regression. is a linear combination of input components x

Summary of the lecture in Biostatistics

Analysis of Variance with Weibull Data

Transforming Numerical Methods Education for the STEM Undergraduate Torque (N-m)

Module 7: Probability and Statistics

Chapter 5. Curve fitting

STK3100 and STK4100 Autumn 2018

INTERNATIONAL BACCALAUREATE ORGANIZATION GROUP 5 MATHEMATICS FORMULAE AND STATISTICAL TABLES

CS5620 Intro to Computer Graphics

Lecture 1 Review of Fundamental Statistical Concepts

4. Standard Regression Model and Spatial Dependence Tests

Chapter 8: Statistical Analysis of Simulated Data

Confidence Intervals for Double Exponential Distribution: A Simulation Approach

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1

b. There appears to be a positive relationship between X and Y; that is, as X increases, so does Y.

CHAPTER 8 REGRESSION AND CORRELATION

Quantitative analysis requires : sound knowledge of chemistry : possibility of interferences WHY do we need to use STATISTICS in Anal. Chem.?

2SLS Estimates ECON In this case, begin with the assumption that E[ i

Summarizing Bivariate Data. Correlation. Scatter Plot. Pearson s Sample Correlation. Summarizing Bivariate Data SBD - 1

The expected value of a sum of random variables,, is the sum of the expected values:

Median as a Weighted Arithmetic Mean of All Sample Observations

Chapter 4: Elements of Statistics

Descriptive Statistics

Lecture 3. Sampling, sampling distributions, and parameter estimation

Linear Calibration Is It so Simple?

STK3100 and STK4100 Autumn 2017

Algorithms behind the Correlation Setting Window

C. Statistics. X = n geometric the n th root of the product of numerical data ln X GM = or ln GM = X 2. X n X 1

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION

Statistics: Unlocking the Power of Data Lock 5

Transcription:

Lear Regresso Hsao-Lug Cha Dept Electrcal Egeerg Chag Gug Uverst, Tawa chahl@mal.cgu.edu.tw

Curve fttg Least-squares regresso Data ehbt a sgfcat degree of error or scatter A curve for the tred of the data Iterpolato Data are ver precse Ft a curve passg drectl through each pot Lear terpolato Curvlear terpolato

Wd tuel epermet Measure how the force of ar resstace depeds o veloct Force versus wd veloct for a object suspeded a wd tuel 3

Basc statstcs Arthmetc mea Varace s Coeffcet of varato c.v. s 00% Meda, the mdpot of a group of data Mode, the value that occurs most frequetl / mea) var) degrees of freedom: s kow ad - of the values are specfed cv=std)/mea)*00; quatfg the spread of data meda) mod) 4

Normal dstrbuto Gaussa dstrbuto) hst) bs=0; hst,bs) bs=6.4:0.:6.8; hst,bs) [couts ceter]=hst ); 5

Radom umber Geerates a sequece of umbers that are uforml dstrbuted betwee 0 ad r = radm, ); % m-b- matr of radom umbers Geerate a uform dstrbuto o aother terval ruform = low + up low) * radm, ); % low = the lower boud, up = the upper boud Geerate a ormal dstrbuto wth a dfferet mea m) ad stadard devato s) rormal = m + s * radm, ); 6

Geeratg uform radom values of drag freefallg bugee jumper If the tal veloct s zero, the dowward veloct s t=4; m=68.; g=9.8; % parameters cd=0.5; % drag coeffcets cdm=cd-0.05; cdma=cd+0.05; r=rad000,); cdrad=cdm+cdma-cdm)*r; subplot,,) hstcdrad), ttle'a) Dstrbuto of drag'), label'cd kg/m)') vrad=sqrtg*m./cdrad).*tahsqrtg*cdrad/m)*t); subplot,,) hstvrad), ttle'b) Dstrbuto of veloct'), label'v m/s)') 7

Lear least-squares regresso f ) a 0 a 0 a a Best for least-squares regresso meas mmzg the sum of the squares of the estmate resduals. S a S a r r S r e 0 0 a 0 a a a 0 a 8

M-fle of curve fttg b lear regresso fucto [a, r] = lregr,) % = depedet varable, = depedet varable % output: a) = slope, a)=tercept % r = coeffcet of determato = legth); = :); = :); % covert to colum vectors s = sum); s = sum); s = sum.*); s = sum.*); s = sum.*); a) = *s s*s)/*s s^); a) = s/ a)*s/; r = *s s*s)/sqrt*s s^)/sqrt*s s^))^; % create plot of data ad best ft le p = lspacem),ma),); p = a)*p+a); plot,,'o',p,p) grd o 9

Quatfcato of error of lear regresso Lear regresso wth small ad large resdual errors How to quatf the goodess of regresso ft? 0

Quatfcato of error of lear regresso cot.) Sum of the squares of the resduals betwee data pots ad regresso le Sum of the squares of the resduals betwee data pots ad mea

Quatfcato of error of lear regresso cot.) Spread of the data aroud the mea Spread of the data aroud the best-ft le

Quatfcato of error of lear regresso cot.) Coeffcet of determato Alteratve defto of correlato coeffcet 3 ) ) ) ) / ) / ) ) / ) ) ) ) ) a

Quatfcato of error of lear regresso cot.) Stadard error of the estmate stadard devato for the regresso / desgates that the error s for a predcted value of correspodg to a partcular value of. Dvde b because two data-derved estmates a 0 ad a were used to compute Sr lost two degrees of freedom) 4

Learzato of olear relatoshps epoetal model power equato saturato-growthrate equato l = l α + β log = log α + β log / = /α 3 + β 3 /α 3 / 5

MATLAB bult- fucto polft Fts a least-squares th -order polomal to data p = polft,, ); Eample = [0 0 30 40 50 60 70 80]; = [5 70 380 550 60 0 830 450]; a = polft,,); polval, computg a value usg the coeffcets = polvalp, ); 6

Referece Steve C. Chapra "Appled Numercal Methods wth MATLA B", 3rd ed., McGraw Hll, 0. 7