Simple Linear Regression - Scalar Form

Similar documents
STA302/1001-Fall 2008 Midterm Test October 21, 2008

Chapter 13 Student Lecture Notes 13-1

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

Chapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:

ENGI 3423 Simple Linear Regression Page 12-01

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Linear Regression with One Regressor

Statistics MINITAB - Lab 5

Summary of the lecture in Biostatistics

Simple Linear Regression

Probability and. Lecture 13: and Correlation

Midterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes

Simple Linear Regression

residual. (Note that usually in descriptions of regression analysis, upper-case

i 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

: At least two means differ SST

Lecture Notes Types of economic variables

Midterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes

Lecture 8: Linear Regression

Statistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018

Example: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger

Correlation and Simple Linear Regression

Chapter Two. An Introduction to Regression ( )

Econometric Methods. Review of Estimation


UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1

Handout #8. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model

Uncertainty, Data, and Judgment

Objectives of Multiple Regression

Special Instructions / Useful Data

CHAPTER 2. = y ˆ β x (.1022) So we can write

ε. Therefore, the estimate

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Multiple Linear Regression Analysis

Simple Linear Regression and Correlation.

ESS Line Fitting

Lecture 2: Linear Least Squares Regression

REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION

b. There appears to be a positive relationship between X and Y; that is, as X increases, so does Y.

Continuous Distributions

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.

Simple Linear Regression and Correlation. Applied Statistics and Probability for Engineers. Chapter 11 Simple Linear Regression and Correlation

Chapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance

4. Standard Regression Model and Spatial Dependence Tests

Reaction Time VS. Drug Percentage Subject Amount of Drug Times % Reaction Time in Seconds 1 Mary John Carl Sara William 5 4

Regression. Linear Regression. A Simple Data Display. A Batch of Data. The Mean is 220. A Value of 474. STAT Handout Module 15 1 st of June 2009

Mean is only appropriate for interval or ratio scales, not ordinal or nominal.

Applied Statistics and Probability for Engineers, 5 th edition February 23, b) y ˆ = (85) =

STA 105-M BASIC STATISTICS (This is a multiple choice paper.)

Logistic regression (continued)

Chapter 2 Simple Linear Regression

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

Statistics: Unlocking the Power of Data Lock 5

Linear Regression. Can height information be used to predict weight of an individual? How long should you wait till next eruption?

Lecture 1 Review of Fundamental Statistical Concepts

Functions of Random Variables

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.

Multiple Choice Test. Chapter Adequacy of Models for Regression

Handout #6. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1

UNIVERSITY OF TORONTO AT SCARBOROUGH. Sample Exam STAC67. Duration - 3 hours

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

Lecture 1: Introduction to Regression

Summarizing Bivariate Data. Correlation. Scatter Plot. Pearson s Sample Correlation. Summarizing Bivariate Data SBD - 1

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

Lecture 1: Introduction to Regression

CLASS NOTES. for. PBAF 528: Quantitative Methods II SPRING Instructor: Jean Swanson. Daniel J. Evans School of Public Affairs

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

Lecture Notes 2. The ability to manipulate matrices is critical in economics.

Simple Linear Regression Analysis

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

Correlation and Regression Analysis

Previous lecture. Lecture 8. Learning outcomes of this lecture. Today. Statistical test and Scales of measurement. Correlation

Linear Regression Siana Halim

Homework Solution (#5)

Chapter 4 Multiple Random Variables

Chapter 3 Multiple Linear Regression Model

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Chapter 2 Supplemental Text Material

ENGI 4421 Propagation of Error Page 8-01

Topic 4: Simple Correlation and Regression Analysis

Example. Row Hydrogen Carbon

"It is the mark of a truly intelligent person to be moved by statistics." George Bernard Shaw

COV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic.

2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen.

Chapter 8. Inferences about More Than Two Population Central Values

r y Simple Linear Regression How To Study Relation Between Two Quantitative Variables? Scatter Plot Pearson s Sample Correlation Correlation

Lecture 3. Sampling, sampling distributions, and parameter estimation

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

UNIVERSITY OF EAST ANGLIA. Main Series UG Examination

ln( weekly earn) age age

STK3100 and STK4100 Autumn 2017

STK3100 and STK4100 Autumn 2018

CHAPTER 8 REGRESSION AND CORRELATION

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

Transcription:

Smple Lear Regresso - Scalar Form Q.. Model Y X,..., p..a. Derve the ormal equatos that mmze Q. p..b. Solve for the ordary least squares estmators, p..c. Derve E, V, E, V, COV, p..d. Derve the mea ad varace of Y X ad ad COV Y, e e Y Y Q.. A electrcal cotractor fts a smple lear regresso model, relatg cost to wre a house (Y, dollars) to the sze of the house (X, ft ). She fts a model, based o a sample of =6 houses ad obtas the followg results. Y 5..X s 6 X X 4 X p..a. Compute the estmated stadard errors of p..b. Compute a 95% Cofdece Iterval for ad p..c. Compute a 95% Cofdece Iterval for the mea of all homes wth X = p..d. Compute a 95% Predcto Iterval for her brother--laws house wth X = Q.3. A researcher s terested the relatoshp betwee the educato level ad salares rural coutes the U.S. He obtas the percetage of adults over 5 wth a college educato each couty (X) ad the per capta come of the couty (Y, $s). He obtas the followg summary statstcs, based o a sample of = 3 coutes. X X 7.45 X X Y Y 658.37 Y Y 654.86 X 4.9 Y 35.83 p.3.a. Compute least squares estmates of ad p.3.b. Show that Y Y Y Y X X Y Y X X p.3.c. Use p.3.b. to compute a ubased estmate of

Q.4. Cosder the regresso through the org model: p.4.a. Derve the least squares estmator of p.4.b. Derve the mea ad varace of the least squres estmator. Y X ~ NID,,..., Y p.4.c. Cosder the estmator ~ X. Derve ts mea ad varace. p.4.d. Whch estmator has the smallest varace? Why? Q.5. For the smple lear regresso model wth a tercept, show that Y Y Q.6. For smple regresso, we get: X X Y ad Y Y COV, Y??? SXX Q.7. For a smple lear regresso model, derve COV, completg the followg parts: p.7.a. Wrte a Y ad by statg explctly what the a ad b values (fuctos) are p.7.b. Usg rules of Covaraces of lear fuctos of radom varables to derve COV, p.7.c. Researchers the U.S. ft regressos of relatoshp betwee vscosty (Y) ad temperature (X) degrees Fahrehet, whle foreg researchers work wth temperature degrees Celsus. The temperatures for the expermetal rus are gve below. Gve the COV, (they use the same uts for Y): Ru # 3 4 5 6 X(F) 5 5 4 4 3 3 X(C) -5-5 - - -5-5 for each set of researchers as a fucto of COV, Fahrehet = Celsus =

Q.8. For the smple regresso model (scalar form): Y X,..., ~ NID, we get: X X Y, Y Y, Y X SXX p.8.a. Derve p.8.b. Derve,, E E Y E,, COV,,, COV, V V Y Y V Q.9. A Austra study cosdered Breath Alcohol Elmato Rates (X, mg/l/hr*) ad Blood Alcohol Elmato Rates (Y, g/l/hr*) a sample of = 7 adult females. The sample meas, stadard devatos ad correlatos are gve below. Complete the followg table for the smple lear regresso relatg Blood Elmato Rate (Y) to Breath Elmato Rate (X). X 8.674 Y 7.885 s.65 s 3.6787 r.8786 Regresso Statstcs R Square Resdual Std Error Observatos X Y XY ANOVA Regresso Resdual Total df SS MS F F(.5) Itercept X Coeffcetsadard Erro t Stat t(.5) Q.. For the smple regresso model (scalar form): Y X X,..., ~ NID, p..a. Derve least squares estmators of ad. p..b. Derve E, E, V, V, COV,

Q.. Cosder the cetered (wth respect to the depedet varable) model scalar form: Y X X,..., ~ NID, p..a. Obta the ormal equatos ad the least squares estmated for the parameters ad. p..b. Derve COV, Ht: COV ay, bjyj ab jcov Y, Yj j j Q.. A lear regresso was ru o a set of data, based o a smple lear regresso. You are gve oly the followg partal formato: ANOVA df SS MS F P-value Regresso Resdual 5 44. Total Coeffcetstadard Erro t Stat P-value Itercept 93.89 5.6 5.9. X -.65.3-3.3. p..a. Compute a 95% Cofdece Iterval for : p..b. Gve the F-statstc ad rejecto for testg H : = vs H A: at sgfcace level. (Ht: thk of coecto betwee t- ad F-tests) p..c. Compute the coeffcet of determato, R. Q.3. A smple lear regresso model s to be ft, relatg Mea Aual Temperature (Y, F) to Year 957 (X). That s, the org s 957. The data are for the years 957-4 ( = 58). The sample meas ad sums of squares ad cross-products are gve below for Model. X 8.5 Y 68.759 X X Y Y 559.683 X X 654.5 Y Y 83.436 p.3.a. Compute the least squares estmates of ad, ad wrte out the predcted equato.

p.3.b. Y Y 64.699 Use ths to obta a ubased estmate of. p.3.c. Obta a 95% Cofdece Iterval for (the amout, o average, that mea temperature creases per year). p.3.d. For the year 4, the (observed) average temperature was 67.65. Obta the predcted temperature ad the resdual for that year. Q.4. Derve the two ormal equatos by mmzg Q wth respect to ad. X X Q.5. The ftted value for Yj ca be wrtte as Y j X j X Y SS XX p.5.a. Gve COV Yj, Y j p.5.b. Gve COV k, j Y Y k j Q.6. Derve EMSR ad EMSE Q.7. A smple lear regresso model s ft relatg farway accuracy (Y, percet) to average drve dstace (X, yards) for a radom sample of = professoal wome golfers from the 9 seaso. p.7.a. Complete the followg table cells.

Regresso Statstcs R Square Observatos ANOVA Source df SS MS F F(.5) Regresso 8.7 8.7 Resdual #N/A #N/A Total 47.5 #N/A #N/A #N/A Parameter Coeffcets Stadard Error t Stat t(.5) Itercept 3.57 9.55 4.45 drve -.5.8 p.7.b. What s your cocluso regardg the test of H : H A :? Reject H / Fal to Reject H p.7.c. Gve the sample correlato, r, betwee Y ad X. Q.8. A smple lear regresso model s ft, relatg plat growth over year (y) to amout of fertlzer provded (x). Twety fve plats are selected, 5 each assged to each of the fertlzer levels (, 5, 8,, 4). The results of the model ft are gve below: Model (Costat) x a. Depedet Varable: y Ustadardzed Coeffcets Coeffcets a B Std. Error t Sg. 8.64.8 4.764..57.98 5.386. p.8.a. Ca we coclude that there s a assocato betwee fertlzer ad plat growth at the.5 sgfcace level? Why (be very specfc). p.8.b. Gve the estmated mea growth amog plats recevg uts of fertlzer. p.8.c. The estmated stadard error of the estmated mea at uts s. ( 8) 5 45. 46 Gve a 95% CI for the mea at uts of fertlzer.

Q.9. A study was coducted to relate weght ga chckes (Y) to the amout of the amo acd lyse gested by the chcke (X). A smple lear regresso s ft to the data. ANOVA df SS MS F P-value Regresso 7.7 7.7 3.79. Resdual 8 9..4 Total 9 36.8 Coeffcets Stadard Error t Stat P-value Itercept.48.637 9.876. lyse(x) 36.899 7.564 4.8774. p.9.a. Gve the ftted equato, ad the predcted value for X=. p.9.b. Gve a 95% Cofdece Iterval for the MEAN weght ga of all chckes wth X=. (Note: the mea of X s.6 ad SXX=.) p.9.c. What proporto of the varato weght ga s explaed by lyse take? Q.. A researcher reports that the correlato betwee legth (ches) ad weght (pouds) of a sample of 6 male adults of a speces s r=.4. p..a. Test whether she ca coclude there s a POSITIVE correlato the populato of all adult males of ths speces: H : = H A: > o Test Statstc: o Rejecto Rego (=.5): o Coclude: Postve Assocato or No Postve Assocato p..b. A colleague from Europe trasforms the data from legth ches to cetmeters ( ch=.54 cm) ad weght from pouds to klograms ( poud=. kg). What s the colleague s estmate of the correlato? Q.. A smple lear regresso s to be ft, relatg fuel effcecy (Y gallos/ mles) to cars weght (X, pouds), based o a sample of =45 cars. You are gve the followg formato: ( X X ) 36936 X X ( Y Y) 3385 ( Y Y) 6.5 X 739 Y 3.4 Y Y.835 Compute the followg quattes: p..a. p..b. p..c. Resdual Std. Devato se

p..d. Estmate of mea effcecy for all cars of x*= pouds p..e. 95% Cofdece Iterval for all cars of x*= pouds Lower Boud = Upper Boud = p..f. Regresso Sum of Squares SSR = p..g. Proporto of Varato Effcecy Explaed by Weght Q.. A regresso model was ft, relatg reveues (Y) to total cost of producto ad dstrbuto (X) for a radom sample of =3 RKO flms from the 93s (the total cost raged from 79 to 53): Y Y X S X X Y X S 3 685. 6637 55.3.9 xx e 467 p..a. Obta a 95% Cofdece Iterval for the mea reveues for all moves wth total costs of x * = 685. Note:.495 3 6637 SE 95%CI : y p..b. Obta a 95% Predcto Iterval for tomorrow s ew flm that had total costs of x * = y SE 95%PI : y Q.3. A researcher s terested the correlato betwee heght (X) ad weght (Y) amog year old male chldre. He selects a radom sample of = 8 male -year olds from a school dstrct, ad teds o testg H: = versus HA:, where s the populato correlato coeffcet. Hs sample correlato s r X X Y Y X X Y Y.6 Test H: = versus HA: : Test Statstc = Rejecto Rego: Q.4. A study was coducted to determe the effects of daly temperature (X, C) o Electrcty Cosumpto (Y, s of Wh) a expermetal house over a perod of = 3 days. Cosder the followg model: E Y X SSR 594. SSE 4.4 TSS 835.4 SXX 58.5 X 7. Y 3.79.936X

p.4.a. What proporto of the varato Electrcty cosumpto s explaed by daly temperature (X)? p.4.b. Compute the resdual stadard devato, se p.4.c. Obta the estmated mea electrcty cosumpto whe x * = 7. degrees, ad the 95% Cofdece Iterval. Estmated Mea: 95% CI: p.4.d. Compute a 95% Cofdece Iterval for Q.5. For the smple regresso model (scalar form): Y X,..., ~ NID, we get: X X Y, Y Y, Y X SXX p.5.a. Derve p.5.b. Derve,, E E Y E,, COV,,, COV, V V Y Y V Q.6. For the smple regresso model (scalar form): Y X X,..., ~ NID, p.6.a. Derve least squares estmators of ad. p.6.b. Derve E, E, V, V, COV,