Comparison of Regression Lines
|
|
- Maud Adams
- 6 years ago
- Views:
Transcription
1 STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence Intervals... 9 Observed versus Predcted Resdual Plots Unusual Resduals Influental Ponts Save Results Calculatons Summary The Comparson of Regresson Lnes procedure s desgned to compare the regresson lnes relatng Y and X at two or more levels of a categorcal factor. Tests are performed to determne whether there are sgnfcant dfferences between the ntercepts and the slopes at the dfferent levels of that factor. The regresson lnes are plotted, unusual resduals are dentfed, and predctons are made usng the fttng model. Sample StatFolo: compare reg.sgp 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 1
2 STATGRAPHICS Rev. 9/13/2013 Sample Data: The fle soap.sgd contans data on the amount of scrap produced by two producton lnes as a functon of the speed at whch those lnes are run. The data, from Neter et al. (1996), s shown below: Lne Scrap Speed It s desred to determne whether the relatonshp between Scrap (Y) and Speed (X) s dfferent for the two Lnes by StatPont Technologes, Inc. Comparson of Regresson Lnes - 2
3 Data Input The data nput dalog box requests the names of the nput varables: STATGRAPHICS Rev. 9/13/2013 Dependent Varable: numerc column contanng the n values of Y. Independent Varable: numerc column contanng the n values of X. Level Codes: numerc or nonnumerc columns dentfyng the level of the categorcal factor. A separate ntercept and slope wll be estmated for each unque value n ths column. Select: subset selecton by StatPont Technologes, Inc. Comparson of Regresson Lnes - 3
4 Analyss Summary The Analyss Summary shows nformaton about the ftted model. Comparson of Regresson Lnes - Scrap vs. Speed Dependent varable: Scrap Independent varable: Speed Level codes: Lne Number of complete cases: 27 Number of regresson lnes: 2 Multple Regresson Analyss Standard T Parameter Estmate Error Statstc P-Value CONSTANT Speed Lne= Speed*Lne= Coeffcents Lne Intercept Slope Analyss of Varance Source Sum of Squares Df Mean Square F-Rato P-Value Model d Resdual d Total (Corr.) d R-Squared = percent R-Squared (adjusted for d.f.) = percent Standard Error of Est. = Mean absolute error = Durbn-Watson statstc = (P=0.2120) Lag 1 resdual autocorrelaton = STATGRAPHICS Rev. 9/13/2013 Resdual Analyss Estmaton n 27 MSE MAE MAPE ME E-14 MPE Valdaton Included n the output are: Data Summary: a summary of the nput data. In the example, there are a total of n = 27 observatons. The categorcal factor contans m = 2 levels. Coeffcents: the estmated coeffcents, standard errors, t-statstcs, and P values. The general equaton for the model s Y = X + 2 I I 1 X + 4 I I 2 X + + 2m-2 I m-1 + 2m-1 I m-1 X (1) where I 1, I 2,..., I m-1 are ndcator varables for the categorcal factors, where I j = 1 f the categorcal factor s at ts (j+1)-st level and 0 otherwse. The terms nvolvng only the ndcator varables allow the ntercepts to vary amongst levels of the categorcal factor, whle 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 4
5 STATGRAPHICS Rev. 9/13/2013 the terms contanng the cross-products of the ndcator varables wth X allow the slopes to vary. The t-statstc tests the null hypothess that the correspondng model parameter equals 0, versus the alternatve hypothess that t does not equal 0. Small P-Values (less than 0.05 f operatng at the 5% sgnfcance level) ndcate that a model coeffcent s sgnfcantly dfferent from 0. Analyss of Varance: decomposton of the varablty of the dependent varable Y nto a model sum of squares and a resdual or error sum of squares. The resdual sum of squares s further parttoned nto a lack-of-ft component and a pure error component. Of partcular nterest s the F-test and the assocated P-value. The F-test on the Model lne tests the statstcal sgnfcance of the ftted model. A small P-Value (less than 0.05 f operatng at the 5% sgnfcance level) ndcates that a sgnfcant relatonshp of the form specfed exsts between Y and X. Statstcs: summary statstcs for the ftted model, ncludng: R-squared - represents the percentage of the varablty n Y whch has been explaned by the ftted regresson model, rangng from 0% to 100%. For the sample data, the regresson has accounted for about 94.5% of the varablty amongst the observed amounts of Scrap. Adjusted R-Squared the R-squared statstc, adjusted for the number of coeffcents n the model. Ths value s often used to compare models wth dfferent numbers of coeffcents. Standard Error of Est. the estmated standard devaton of the resduals (the devatons around the model). Ths value s used to create predcton lmts for new observatons. Mean Absolute Error the average absolute value of the resduals. Durbn-Watson Statstc a measure of seral correlaton n the resduals. If the resduals vary randomly, ths value should be close to 2. A small P-value ndcates a non-random pattern n the resduals. For data recorded over tme, a small P-value could ndcate that some trend over tme has not been accounted for. Lag 1 Resdual Autocorrelaton the estmated correlaton between consecutve resduals, on a scale of 1 to 1. Values far from 0 ndcate that sgnfcant structure remans unaccounted for by the model. Resdual Analyss f a subset of the rows n the datasheet have been excluded from the analyss usng the Select feld on the data nput dalog box, the ftted model s used to make predctons of the Y values for those rows. Ths table shows statstcs on the predcton errors, defned by e y yˆ (2) Included are the mean squared error (MSE), the mean absolute error (MAE), the mean absolute percentage error (MAPE), the mean error (ME), and the mean percentage error (MPE). Ths valdaton statstcs can be compared to the statstcs for the ftted model to determne how well that model predcts observatons outsde of the data used to ft t by StatPont Technologes, Inc. Comparson of Regresson Lnes - 5
6 Scrap For the sample data, the ftted model s STATGRAPHICS Rev. 9/13/2013 Scrap = *Speed *(Lne=2) *Speed*(Lne=2) where Lne=2 takes the value 1 for lne #2 and 0 for lne #1. To see that ths corresponds to 2 separate regresson lnes, the model can be wrtten separately for each lne: Lne #1: Scrap = *Speed Lne #2: Scrap = ( ) + ( )*Speed The thrd and fourth coeffcents n the full model represent the dfference n the ntercepts and slopes between the two lnes. Plot of Ftted Model Ths Plot of Ftted Model pane shows the two regresson lnes: Plot of Ftted Model Lne Speed There s a notceable offset between the lnes, wth lne #1 producng more scrap at all speeds. In addton, the slope for lne #2 s somewhat greater than for lne #1. Condtonal Sums of Squares The Condtonal Sums of Squares pane dsplays an analyss of varance table that may be used to determne whether the ntercepts and the slopes of the lnes are sgnfcantly dfferent: Further ANOVA for Varables n the Order Ftted Source Sum of Squares Df Mean Square F-Rato P-Value Speed Intercepts Slopes Model Of prmary nterest are the F-tests and P-values for the Intercepts and Slopes. 1. The F-test for Slopes tests the hypotheses: 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 6
7 STATGRAPHICS Rev. 9/13/2013 Null Hypothess: slopes of the lnes are all equal Alt. Hypothess: slopes of the lnes are not all equal If the P-Value s small (less than 0.05 f operatng at the 5% sgnfcance level), then the slopes of the lnes vary sgnfcant amongst the levels of the categorcal factor. 2. The F-test for Intercepts tests the hypotheses: Null Hypothess: ntercepts of the lnes are all equal Alt. Hypothess: ntercepts of the lnes are not all equal If the P-Value s small (less than 0.05 f operatng at the 5% sgnfcance level), then the ntercepts of the lnes vary sgnfcant amongst the levels of the categorcal factor. In the sample data, the large P-value for Slopes ndcates that the slope of lne #1 and lne #2 are not sgnfcantly dfferent. However, the ntercepts of the two lnes are sgnfcantly dfferent. Analyss Optons Assume Equal Intercepts: select ths opton to ft a model wth equal ntercepts at all levels of the categorcal factor. Assume Equal Slopes: select ths opton to ft a model wth equal slopes at all levels of the categorcal factor. Example Fttng Parallel Regresson Lnes Selectng Assume Equal Slopes forces the regresson lnes to be parallel: 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 7
8 Scrap STATGRAPHICS Rev. 9/13/2013 Plot of Ftted Model Lne Speed Ths s accomplshed by removng the terms n the model that contan cross-products between the ndcator varables and X. In the current example, the new model s: Scrap = *Speed *(Lne=2) The last coeffcent n the model ndcates that lne #2 produces unts less scrap on average than lne #1. Forecasts The model can be used to predct Y at selected values of X. Forecasts 95.00% 95.00% Speed Predcted Predcton Lmts Confdence Lmts Lne Scrap Lower Upper Lower Upper Included n the table are: X - the value of the ndependent varable at whch the predcton s to be made. Predcted Y - the predcted value of the dependent varable usng the ftted model. Predcton lmts - predcton lmts for new observatons Confdence lmts - confdence lmts for the mean value of Y. For example, the predcted Scrap for Lne #1 at Speed = 200 s approxmately 327. New observatons from that lne can be expected to be between 282 and 372 wth 95% confdence. On 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 8
9 STATGRAPHICS Rev. 9/13/2013 average, the scrap from that lne at that speed s estmated to be somewhere between 315 and 338. Pane Optons Confdence Level: confdence percentage for the ntervals. Forecast at X: up to 10 values of X at whch to make predctons. Confdence Intervals The Confdence Intervals pane shows the potental estmaton error assocated wth each coeffcent n the model. 95.0% confdence ntervals for coeffcent estmates Standard Parameter Estmate Error Lower Lmt Upper Lmt CONSTANT Speed Lne= Pane Optons Confdence Level: percentage level for the nterval or bound by StatPont Technologes, Inc. Comparson of Regresson Lnes - 9
10 observed STATGRAPHICS Rev. 9/13/2013 Observed versus Predcted The Observed versus Predcted plot shows the observed values of Y on the vertcal axs and the predcted values Yˆ on the horzontal axs. Plot of Scrap Lne predcted If the model fts well, the ponts should be randomly scattered around the dagonal lne. It s sometmes possble to see curvature n ths plot, whch would ndcate the need for a curvlnear model rather than a lnear model. Any change n varablty from low values of Y to hgh values of Y mght also ndcate the need to transform the dependent varable before fttng a model to the data. Resdual Plots As wth all statstcal models, t s good practce to examne the resduals. In a regresson, the resduals are defned by e y yˆ (3).e., the resduals are the dfferences between the observed data values and the ftted model. The Comparson of Regresson Lnes procedure varous type of resdual plots, dependng on Pane Optons by StatPont Technologes, Inc. Comparson of Regresson Lnes - 10
11 percentage Studentzed resdual STATGRAPHICS Rev. 9/13/2013 Scatterplot versus X Ths plot s helpful n vsualzng any need for a curvlnear model. Resdual Plot predcted Scrap Lne 1 2 Normal Probablty Plot Ths plot can be used to determne whether or not the devatons around the lne follow a normal dstrbuton, whch s the assumpton used to form the predcton ntervals. Normal Probablty Plot for Scrap Studentzed resdual If the devatons follow a normal dstrbuton, they should fall approxmately along a straght lne by StatPont Technologes, Inc. Comparson of Regresson Lnes - 11
12 autocorrelaton STATGRAPHICS Rev. 9/13/2013 Resdual Autocorrelatons Ths plot calculates the autocorrelaton between resduals as a functon of the number of rows between them n the datasheet. 1 Resdual Autocorrelatons for Scrap lag It s only relevant f the data have been collected sequentally. Any bars extendng beyond the probablty lmts would ndcate sgnfcant dependence between resduals separated by the ndcated lag, whch would volate the assumpton of ndependence made when fttng the regresson model. Pane Optons Plot: the type of resduals to plot: 1. Resduals the resduals from the least squares ft. 2. Studentzed resduals the dfference between the observed values y and the predcted values ŷ when the model s ft usng all observatons except the -th, dvded by the estmated standard error. These resduals are sometmes called externally deleted 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 12
13 STATGRAPHICS Rev. 9/13/2013 resduals, snce they measure how far each value s from the ftted model when that model s ft usng all of the data except the pont beng consdered. Ths s mportant, snce a large outler mght otherwse affect the model so much that t would not appear to be unusually far away from the lne. Type: the type of plot to be created. A Scatterplot s used to test for curvature. A Normal Probablty Plot s used to determne whether the model resduals come from a normal dstrbuton. An Autocorrelaton Functon s used to test for dependence between consecutve resduals. Plot Versus: for a Scatterplot, the quantty to plot on the horzontal axs. Number of Lags: for an Autocorrelaton Functon, the maxmum number of lags. For small data sets, the number of lags plotted may be less than ths value. Confdence Level: for an Autocorrelaton Functon, the level used to create the probablty lmts. Unusual Resduals Once the model has been ft, t s useful to study the resduals to determne whether any outlers exst that should be removed from the data. The Unusual Resduals pane lsts all observatons that have Studentzed resduals of 2.0 or greater n absolute value. Unusual Resduals Predcted Studentzed Row Y Y Resdual Resdual Studentzed resduals greater than 3 n absolute value correspond to ponts more than 3 standard devatons from the ftted model, whch s a rare event for a normal dstrbuton. Note: Ponts can be removed from the ft whle examnng the Plot of the Ftted Model by clckng on a pont and then pressng the Exclude/Include button on the analyss toolbar. Excluded ponts are marked wth an X. Influental Ponts In fttng a regresson model, all observatons do not have an equal nfluence on the parameter estmates n the ftted model. In a smple regresson, ponts located at very low or very hgh values of X have greater nfluence than those located nearer to the mean of X. The Influental Ponts pane dsplays any observatons that have hgh nfluence on the ftted model: Influental Ponts Mahalanobs Cook's Row Leverage Dstance DFITS Dstance Average leverage of sngle data pont = Ponts are placed on ths lst for one of the followng reasons: 2013 by StatPont Technologes, Inc. Comparson of Regresson Lnes - 13
14 STATGRAPHICS Rev. 9/13/2013 Leverage measures how dstant an observaton s from the mean of all n observatons n the space of the ndependent varables. The hgher the leverage, the greater the mpact of the pont on the ftted values ŷ. Ponts are placed on the lst f ther leverage s more than 3 tmes that of an average data pont. Mahalanobs Dstance measures the dstance of a pont from the center of the collecton of ponts n the multvarate space of the ndependent varables. Snce ths dstance s related to leverage, t s not used to select ponts for the table. DFITS measures the dfference between the predcted values ŷ when the model s ft wth and wthout the -th data pont. Ponts are placed on the lst f the absolute value of DFITS exceeds 2 p / n, where p s the number of coeffcents n the ftted model. Save Results The followng results may be saved to the datasheet: 1. Predcted Values the predcted value of Y correspondng to each of the n observatons. 2. Standard Errors of Predctons - the standard errors for the n predcted values. 3. Lower Lmts for Predctons the lower predcton lmts for each predcted value. 4. Upper Lmts for Predctons the upper predcton lmts for each predcted value. 5. Standard Errors of Means - the standard errors for the mean value of Y at each of the n values of X. 6. Lower Lmts for Forecast Means the lower confdence lmts for the mean value of Y at each of the n values of X. 7. Upper Lmts for Forecast Means the upper confdence lmts for the mean value of Y at each of the n values of X. 8. Resduals the n resduals. 9. Studentzed Resduals the n Studentzed resduals. 10. Leverages the leverage values correspondng to the n values of X. 11. DFITS Statstcs the value of the DFITS statstc correspondng to the n values of X. 12. Mahalanobs Dstances the Mahalanobs dstance correspondng to the n values of X. 13. Coeffcents the estmated model coeffcents. Calculatons Detals on the calculatons n ths procedure may be found n the Multple Regresson documentaton by StatPont Technologes, Inc. Comparson of Regresson Lnes - 14
Negative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationGeneral Linear Models
General Lnear Models Revsed: 10/10/2017 Summary... 2 Analyss Summary... 6 Analyss Optons... 10 Model Coeffcents... 11 Scatterplot... 14 Table of Means... 15 Means Plot... 16 Interacton Plot... 19 Multple
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More information[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.
PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationY = β 0 + β 1 X 1 + β 2 X β k X k + ε
Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationChapter 14 Simple Linear Regression Page 1. Introduction to regression analysis 14-2
Chapter 4 Smple Lnear Regresson Page. Introducton to regresson analyss 4- The Regresson Equaton. Lnear Functons 4-4 3. Estmaton and nterpretaton of model parameters 4-6 4. Inference on the model parameters
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More information18. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III US Domestc Beers: Calores vs. % Alcohol Ftted Values and Resduals To each observed x, there corresponds a y-value on the ftted lne, y ˆ ˆ = α + x. The are called ftted values.
More information28. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationBiostatistics 360 F&t Tests and Intervals in Regression 1
Bostatstcs 360 F&t Tests and Intervals n Regresson ORIGIN Model: Y = X + Corrected Sums of Squares: X X bar where: s the y ntercept of the regresson lne (translaton) s the slope of the regresson lne (scalng
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationChap 10: Diagnostics, p384
Chap 10: Dagnostcs, p384 Multcollnearty 10.5 p406 Defnton Multcollnearty exsts when two or more ndependent varables used n regresson are moderately or hghly correlated. - when multcollnearty exsts, regresson
More informationChapter 15 Student Lecture Notes 15-1
Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationANOVA. The Observations y ij
ANOVA Stands for ANalyss Of VArance But t s a test of dfferences n means The dea: The Observatons y j Treatment group = 1 = 2 = k y 11 y 21 y k,1 y 12 y 22 y k,2 y 1, n1 y 2, n2 y k, nk means: m 1 m 2
More informationLearning Objectives for Chapter 11
Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationRegression. The Simple Linear Regression Model
Regresson Smple Lnear Regresson Model Least Squares Method Coeffcent of Determnaton Model Assumptons Testng for Sgnfcance Usng the Estmated Regresson Equaton for Estmaton and Predcton Resdual Analss: Valdatng
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationAny of 27 linear and nonlinear models may be fit. The output parallels that of the Simple Regression procedure.
STATGRAPHICS Rev. 9/13/213 Calibration Models Summary... 1 Data Input... 3 Analysis Summary... 5 Analysis Options... 7 Plot of Fitted Model... 9 Predicted Values... 1 Confidence Intervals... 11 Observed
More informationis the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors
Multple Lnear and Polynomal Regresson wth Statstcal Analyss Gven a set of data of measured (or observed) values of a dependent varable: y versus n ndependent varables x 1, x, x n, multple lnear regresson
More informationRegression Analysis. Regression Analysis
Regresson Analyss Smple Regresson Multvarate Regresson Stepwse Regresson Replcaton and Predcton Error 1 Regresson Analyss In general, we "ft" a model by mnmzng a metrc that represents the error. n mn (y
More informationANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.
ANSWERS CHAPTER 9 THINK IT OVER thnk t over TIO 9.: χ 2 k = ( f e ) = 0 e Breakng the equaton down: the test statstc for the ch-squared dstrbuton s equal to the sum over all categores of the expected frequency
More informationx yi In chapter 14, we want to perform inference (i.e. calculate confidence intervals and perform tests of significance) in this setting.
The Practce of Statstcs, nd ed. Chapter 14 Inference for Regresson Introducton In chapter 3 we used a least-squares regresson lne (LSRL) to represent a lnear relatonshp etween two quanttatve explanator
More information7.1. Single classification analysis of variance (ANOVA) Why not use multiple 2-sample 2. When to use ANOVA
Sngle classfcaton analyss of varance (ANOVA) When to use ANOVA ANOVA models and parttonng sums of squares ANOVA: hypothess testng ANOVA: assumptons A non-parametrc alternatve: Kruskal-Walls ANOVA Power
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationCorrelation and Regression
Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationUnit 10: Simple Linear Regression and Correlation
Unt 10: Smple Lnear Regresson and Correlaton Statstcs 571: Statstcal Methods Ramón V. León 6/28/2004 Unt 10 - Stat 571 - Ramón V. León 1 Introductory Remarks Regresson analyss s a method for studyng the
More information17 - LINEAR REGRESSION II
Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationDO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes
25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationCathy Walker March 5, 2010
Cathy Walker March 5, 010 Part : Problem Set 1. What s the level of measurement for the followng varables? a) SAT scores b) Number of tests or quzzes n statstcal course c) Acres of land devoted to corn
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)
More informationNonlinear Regression. Summary. Sample StatFolio: nonlinear reg.sgp
Nonlinear Regression Summary... 1 Analysis Summary... 4 Plot of Fitted Model... 6 Response Surface Plots... 7 Analysis Options... 10 Reports... 11 Correlation Matrix... 12 Observed versus Predicted...
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationThe SAS program I used to obtain the analyses for my answers is given below.
Homework 1 Answer sheet Page 1 The SAS program I used to obtan the analyses for my answers s gven below. dm'log;clear;output;clear'; *************************************************************; *** EXST7034
More informationNumber of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k
ANOVA Model and Matrx Computatons Notaton The followng notaton s used throughout ths chapter unless otherwse stated: N F CN Y Z j w W Number of cases Number of factors Number of covarates Number of levels
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationTopic- 11 The Analysis of Variance
Topc- 11 The Analyss of Varance Expermental Desgn The samplng plan or expermental desgn determnes the way that a sample s selected. In an observatonal study, the expermenter observes data that already
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationPHYS 450 Spring semester Lecture 02: Dealing with Experimental Uncertainties. Ron Reifenberger Birck Nanotechnology Center Purdue University
PHYS 45 Sprng semester 7 Lecture : Dealng wth Expermental Uncertantes Ron Refenberger Brck anotechnology Center Purdue Unversty Lecture Introductory Comments Expermental errors (really expermental uncertantes)
More informationMethods of Detecting Outliers in A Regression Analysis Model.
Methods of Detectng Outlers n A Regresson Analyss Model. Ogu, A. I. *, Inyama, S. C+, Achugamonu, P. C++ *Department of Statstcs, Imo State Unversty,Owerr +Department of Mathematcs, Federal Unversty of
More informationBiostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li
Bostatstcs Chapter 11 Smple Lnear Correlaton and Regresson Jng L jng.l@sjtu.edu.cn http://cbb.sjtu.edu.cn/~jngl/courses/2018fall/b372/ Dept of Bonformatcs & Bostatstcs, SJTU Recall eat chocolate Cell 175,
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationChapter 5 Multilevel Models
Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level
More informationSPANC -- SPlitpole ANalysis Code User Manual
Functonal Descrpton of Code SPANC -- SPltpole ANalyss Code User Manual Author: Dale Vsser Date: 14 January 00 Spanc s a code created by Dale Vsser for easer calbratons of poston spectra from magnetc spectrometer
More informationChapter 10. What is Regression Analysis? Simple Linear Regression Analysis. Examples
Chapter 10 Smple Lnear Regresson Analyss What s Regresson Analyss? A statstcal technque that descrbes the relatonshp between a dependent varable and one or more ndependent varables. Examples Consder the
More informationSIMPLE LINEAR REGRESSION and CORRELATION
Expermental Desgn and Statstcal Methods Workshop SIMPLE LINEAR REGRESSION and CORRELATION Jesús Pedrafta Arlla jesus.pedrafta@uab.cat Departament de Cènca Anmal dels Alments Items Correlaton: degree of
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationF statistic = s2 1 s 2 ( F for Fisher )
Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationStatistical Evaluation of WATFLOOD
tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)
ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston
More informationChapter 6. Supplemental Text Material
Chapter 6. Supplemental Text Materal S6-. actor Effect Estmates are Least Squares Estmates We have gven heurstc or ntutve explanatons of how the estmates of the factor effects are obtaned n the textboo.
More informationIntroduction to Generalized Linear Models
INTRODUCTION TO STATISTICAL MODELLING TRINITY 00 Introducton to Generalzed Lnear Models I. Motvaton In ths lecture we extend the deas of lnear regresson to the more general dea of a generalzed lnear model
More informationDiagnostics in Poisson Regression. Models - Residual Analysis
Dagnostcs n Posson Regresson Models - Resdual Analyss 1 Outlne Dagnostcs n Posson Regresson Models - Resdual Analyss Example 3: Recall of Stressful Events contnued 2 Resdual Analyss Resduals represent
More informationSIMPLE LINEAR REGRESSION
Smple Lnear Regresson and Correlaton Introducton Prevousl, our attenton has been focused on one varable whch we desgnated b x. Frequentl, t s desrable to learn somethng about the relatonshp between two
More informationActivity #13: Simple Linear Regression. actgpa.sav; beer.sav;
ctvty #3: Smple Lnear Regresson Resources: actgpa.sav; beer.sav; http://mathworld.wolfram.com/leastfttng.html In the last actvty, we learned how to quantfy the strength of the lnear relatonshp between
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More information