SIMPLE LINEAR REGRESSION
|
|
- Ira Andrews
- 5 years ago
- Views:
Transcription
1 Smple Lnear Regresson and Correlaton Introducton Prevousl, our attenton has been focused on one varable whch we desgnated b x. Frequentl, t s desrable to learn somethng about the relatonshp between two (or more) varables. For example, we mght be nterested n studng the relatonshp between o cholesterol level and age, o blood pressure and age, o heght and weght o the amount of exercse and heart rate; o the concentraton of an njected drug and heart rate o the consumpton level of some nutrent and weght gan. The nature and strength of the relatonshps between two varables ma be examned b regresson and correlaton analses, two related statstcal technques that serve dfferent purposes. Regresson s used to dscover the probable form of the relatonshp between two varables x and b fndng an approprate equaton. The ultmate objectves when ths method of analss s emploed usuall s to predct or estmate the value of one varable correspondng to a gven value of another varable.e. to predct or estmate the value of for a gven value of x. Correlaton analss, on the other hand, s concerned wth measurng how strong s the relatonshp between two varables x and.e. the degree of the correlaton between the two varables. SIMPLE LINEAR REGRESSION In smple lnear the varable x s usuall referred to as the ndependent varable, snce frequentl t s controlled b the nvestgator; that s; values of x ma be selected b the nvestgator and, correspondng to each preselected value of x, one -or more- value of s obtaned. The other varable,, accordngl, s called the dependent varable, and we speak of the regresson of on x. In the above examples, the nvestgator could control, the age but not the cholesterol level, the weght but not heght, the concentraton of njected drug but not the heart rate.. and so on. We assume that for each value of x, there s a whole populaton of values whch s normall dstrbuted and all of the populatons have equal varances. In smple lnear regresson the object of the researcher s nterest s the regresson equaton that descrbes the true relatonshp between the dependent varable and the ndependent varable x. Scatter dagram A frst step that s usuall useful n studng the relatonshp between two varables s to prepare a scatter dagram of the data. The ponts are plotted b assgnng values of the ndependent varable x to the horzontal axs and values of the dependent varable to the vertcal axs. The pattern made b the ponts plotted on the scatter dagram usuall suggests the basc nature and the strength of the relatonshp between two varables. 11
2 Example Relatonshp between and optcal denst Optcal denst Optcal denst In our example, we can see, n general, that as the ncreases the optcal denst also ncreases so that the have a postve relatonshp. The least-square lne We can also see that the ponts seem to be scattered around an nvsble lne whch would descrbe the relatonshp between x and. These mpressons suggest that the relatonshp between ponts n the two varables ma be descrbed b a straght lne crossng the -axs near the orgn and makng approxmatel a 45 degree angle wth the x-axs. Thnkng Challenge It looks as ths lne would be eas to draw b hand, but t s doubtful that the lnes drawn b an two people would be exactl the same. In other words, for ever person drawng such a lne b ee, or freehand, we would expect a dfferent lne. Whch lne best descrbes relatonshp between the varables? What s needed for obtanng the desred lne? Optcal denst.4. Optcal denst
3 Answer If the scatter dagram has a lnear trend, we need a mathematcal wa to obtan the best lne through the data. We need to emplo a method known as the method of least squares for obtanng the desred lne, and the resultng lne s called the least-square lne. The reason for callng the method b ths name wll be explaned n the dscusson that follow. Equaton for straght lne (Lnear Equaton) Now, recall from algebra that the general equaton for straght lne s gven b = a + bx Where s a value on the vertcal axs, and x s a value on the horzontal axs, a s the pont where the lne crosses the vertcal axs, and referred to as -ntercept. b shows the amount b whch changes for each unt change n x and referred to as the slope of the lne. = a + bx b = slope Change n Change n x a = ntercept x To draw a lne based on the equaton, we need the numercal values of the constants a and b. Gven these constants, we ma substtute varous values of x nto the equaton to obtan correspondng values of. = a + bx The resultng ponts ma then be plotted. Computaton Fndng the b-value ( )( ) n x ( x ) n x x b = ( )( ) ( 9)( 84) ( 49) (49)(3.4) b = =
4 Fndng the -ntercept (x) a= bx where = mean of values and x = mean of x values 3.4 = = x = = a = 378 (.958)( 5.444) = -837 Optcal denst () x x Total Σ x = 49 Σ = 3.4 Σ x = 84 Σ = Σ x = 18. Mean x = = 378 Alternatvel a b x = n The equaton for the least squares lne s: = a + bx = x =.958x Note that we use the smbol because ths value s computed from the equaton and s not an observed value of. Now, we can substtute varous values of x nto the equaton to obtan correspondng values of. The resultng ponts ma be plotted. 113
5 Example: Predctng for a gven x usng the regresson equaton Choose a value for x (wthn the range of x values). x = 6.8 Substtute the selected x n the regresson equaton. = Determne correspondng value of. =.958x =.465 Accordng to the equaton, a of 6.8 would has a.465 optcal denst. Drawng the least-squares lne Snce an two such coordnates determne a straght lne, we ma select an two values n the range of x, compute two correspondng values, locate them on a graph, and connect them wth a straght lne to obtan the lne correspondng the equaton. The followng pont wll alwas be on the least squares lne: ( x, ) Use and 378, the averages of the x s and the s, respectvel. Tr x = 4, Compute: =.957(4) = 965 Sketchng the Lne Usng the Ponts (5.444, 378) and (4, 965) Optcal denst =.957x Now what we have obtaned s what s called the best lne for descrbng the relatonshp between our two varables. B what crteron t s consdered best? Before the crteron s stated, let us examne the fgure obtaned. Note that the least squares lne does not pass through most of the observed ponts that are plotted on the scatter dagram. In other words, the observed ponts devate from the lne b varng amounts. 114
6 Optcal denst Devaton Devaton Devaton The lne that we have drawn s best n ths sense: The sum of the squared vertcal devatons of the observed data ponts ( ) from the least square lne s smaller than the sum of the squared vertcal devatons of the observed data ponts from an other lne. In other words, f we square the vertcal dstance from the observed pont ( ) to the least-squares lne and add these squared values for all ponts, the resultng total wll be smaller than the smlarl computed total for an other lne that can be drawn through the ponts. For ths reason the lne we have drawn s called the least-squares lne. Evaluaton the strength of the regresson equaton One wa to evaluate the strength of the regresson equaton n descrbng the relatonshp between two varables s to compare the scatter of the ponts about the regresson lne wth the scatter about, the mean of the values of. To do that, draw through the ponts a lne that ntersects the -axs at and s parallel to the x-axs, b dong so, we ma obtan a vsual mpresson of the relatve magntudes of the scatter of the ponts about ths lne and the regresson lne. Ths has been done n the next Fgure..6 It appears from the Fgure that =.957x the scatter of the ponts about the regresson lne s much less than the scatter of ponts about lne. But, the stuaton ma not be alwas ths cleat-cut, so some sort of calculaton to evaluate the strength of the regresson equaton s necessar, that s,.5.4. = 378 the coeffcent of determnaton r. Optcal denst 115
7 The logc behnd the computaton of "coeffcent of determnaton". We begn b consderng the pont correspondng to an observed value,, and b measurng ts vertcal dstance from the ( ) lne. We call ths total devaton. If we measure the vertcal dstance from the regresson lne to the lne, we obtan, whch s called the explaned devaton, snce t shows b how much the total devaton s reduced when the regresson lne s ftted to the ponts. Fnall, we measure the vertcal dstance of the observed pont from the regresson lne to obtan, whch s called the unexplaned devaton, snce t represents the porton of the total devaton not explaned or accounted for b the ntroducton of the regresson lne..6 =.957x Optcal denst.5.4. Unexplaned devaton Explaned devaton = 378 Total devaton ( ) It seen then, that the total devaton for a partcularl, s equal to the sum of the explaned and unexplaned devatons ( ) = + total explaned unexplaned = + devaton devaton devaton If we measure these devatons for each value of and, square each devaton, and add up the squared devatons, we have ( ) = + total sum explaned sum unexplaned sum = + of squares ( SST) of squares ( SSR) of squares ( SSE) We ma express the relatonshp between the three sums of squares as SST = SSR + SSE 116
8 It s ntutvel appealng to speculate that f a regresson equaton does a good job of descrbng the relatonshp between two varables, the explaned sum of squares should consttute a large proporton of the total sum of squares. The next fgure llustratng that the explaned devaton consttute a small proporton of the total devaton, as compared wth the prevous fgure.6.5 Unexplaned devaton Optcal denst.4. Explaned devaton = 378 Total devaton ( ) It would be of nterest then, to determne the magntude of ths proporton b computng the rato of the explaned sum of squares to the total sum of squares. Ths s exactl what s done n evaluatng a regresson equaton based on sample data, and the result s called the sample coeffcent of determnaton, r. In other words, Optcal denst ( ) ( ) r Explaned sum of squares SSR 5773 = = = = =.9784 Total sum of squares SST 6136 ( ) X X X X X SST = SSE = SSR = =
9 .6.5 =.957 x R =.9784 Optcal denst Thus, the coeffcent of determnaton measures the closeness of ft of the regresson equaton to observed values of. Interpretaton of r If r =.9784 Approxmatel 98 percent of the varaton n Optcal denst () s explaned b the lnear relatonshp wth x, change. Less than three percent s explaned b other causes. From the table, we see that when the quanttes, the vertcal dstances of observed values of from the equaton, are small, the unexplaned sum of squares (SSE) s small. Ths leads to a large explaned sum of squares that leads n turn, to a large value of r. Ths s llustrated n the fgures In ths fgure, we see, that the observatons all le close to the regresson lne, and we would expect r to be large. Small unexplaned devaton Large explaned devaton x 118
10 In ths fgure, we see, that the observatons wdel scattered about the regresson lne, and we would expect r to be small. Large unexplaned devaton Small explaned devaton In ths fgure, we see, that all the observatons fall on the regresson lne, and we would expect the largest value of r whch equal to 1. x Explaned devaton = total devaton In ths fgure, we see, that the regresson lne and the lne drawn through concde, and we would expect the lowest value of r whch s close to. x Explaned devaton = x 119
11 Coeffcent of Determnaton Examples Y r = 1 r = 1 Y r = 1 Y X r =.8 Y r = X X X CORRELATION Correlaton coeffcent r 1. Measures the strength of the lnear relatonshp between the two varables represented as x and.. Coeffcent of correlaton use values range from -1 to +1 An alternatve formula for computng the coeffcent of correlaton, r r = Computaton Table r = Coeffcent of Determnaton n x ( x )( ) ( ) ( ) n x x n (x) Optcal denst () x x x = 49 = 3.4 x = 18. x = 84 =
12 r ( )( ) ( )( ) = ( 9)( 84) ( 49) ( 9)( 1.188) ( 3.4) = r =.989 r. 99 Coeffcent of Correlaton Values.9891 The statstc r has the followng propertes: 1. r measures the extent of lnear assocaton between two varables.. r has value between 1 and r = 1 f and onl f all the observatons are on a straght lne wth postve slope. 4. r = 1 f and onl f all observatons are on a straght lne wth negatve slope. 5. r tends to be close to zero f there s no lnear assocaton between x and. Perfect Negatve Correlaton No Correlaton Perfect Postve Correlaton Increasng degree of negatve correlaton Increasng degree of postve correlaton Coeffcent of Correlaton Examples Although there s no fxed rule or nterpretaton of the strength of a correlaton, we wll sa that the correlaton s Strong f r.8 Moderate f.5 r.8 Weak f r.5 We wll also add the words postve or negatve to ndcate the tpe of correlaton. Warnng The correlaton coeffcent (r) measures the strength of the relatonshp between two varables. Just because two varables are related does not mpl that there s a cause-andeffect relatonshp between them. 11
13 Fgure Scatter plots llustratng how the correlaton coeffcent, r, s a measure of the lnear assocaton between two varables. 1
14 Spearman rank correlaton Spearman s rank correlaton s a nonparametrc correlaton coeffcent test. To perform ths procedure, we frst arrange the x values from smallest (rank = 1) to largest (rank = n); let R be the rank of value x. Smlarl, we arrange the values from smallest to largest and assgn a rank from 1 to n for each value; let S be the rank of value. Fnd the dfference between R S, and then square t. The last step s to calculate the Spearman's correlaton coeffcent rho ( ρ ) from 6 ( R S ) ρ = 1 n( n 1) The Spearman rank correlaton ma be used for qualtatve varables whch can be ordered. For example, a varable whch gves an opnon about somethng. Then answer choces such as dslke ver much, dslke, no opnon, lke, and lke ver much have a logcal order to them as the are lsted. An example of a qualtatve varable whch cannot be ordered s ee color whch has values such as blue, green, and brown. There s no wa to logcall order such categores and so we could not use the rankng procedure for them. Note that Pearson correlaton s not approprate n ether of these cases. Example Consder agan the data of the above Example. The next Table contans the prelmnar calculatons necessar to fnd the Spearman rank correlaton. From the Table we fnd that 6 ( R S ) ρ = 1 n n 1 ( ) 6(17) 76 = 1 = 1 = = ( 4) 336 whch s not as the same as what s obtaned for the Pearson correlaton. Ths dfference s due to the presence of extreme observatons. When such extreme values are few or not found, the results of the two tests wll be ver close to each other. Age SBP x Rank R Rank S R-S (R-S)
Chapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationx yi In chapter 14, we want to perform inference (i.e. calculate confidence intervals and perform tests of significance) in this setting.
The Practce of Statstcs, nd ed. Chapter 14 Inference for Regresson Introducton In chapter 3 we used a least-squares regresson lne (LSRL) to represent a lnear relatonshp etween two quanttatve explanator
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More information[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.
PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationLinear Correlation. Many research issues are pursued with nonexperimental studies that seek to establish relationships among 2 or more variables
Lnear Correlaton Many research ssues are pursued wth nonexpermental studes that seek to establsh relatonshps among or more varables E.g., correlates of ntellgence; relaton between SAT and GPA; relaton
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationScatter Plot x
Construct a scatter plot usng excel for the gven data. Determne whether there s a postve lnear correlaton, negatve lnear correlaton, or no lnear correlaton. Complete the table and fnd the correlaton coeffcent
More informationLearning Objectives for Chapter 11
Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)
More informationMeasuring the Strength of Association
Stat 3000 Statstcs for Scentsts and Engneers Measurng the Strength of Assocaton Note that the slope s one measure of the lnear assocaton between two contnuous varables t tells ou how much the average of
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationAPPENDIX 2 FITTING A STRAIGHT LINE TO OBSERVATIONS
Unversty of Oulu Student Laboratory n Physcs Laboratory Exercses n Physcs 1 1 APPEDIX FITTIG A STRAIGHT LIE TO OBSERVATIOS In the physcal measurements we often make a seres of measurements of the dependent
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More information28. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More information18. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III US Domestc Beers: Calores vs. % Alcohol Ftted Values and Resduals To each observed x, there corresponds a y-value on the ftted lne, y ˆ ˆ = α + x. The are called ftted values.
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationBiostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li
Bostatstcs Chapter 11 Smple Lnear Correlaton and Regresson Jng L jng.l@sjtu.edu.cn http://cbb.sjtu.edu.cn/~jngl/courses/2018fall/b372/ Dept of Bonformatcs & Bostatstcs, SJTU Recall eat chocolate Cell 175,
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationStatistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )
Ismor Fscher, 8//008 Stat 54 / -8.3 Summary Statstcs Measures of Center and Spread Dstrbuton of dscrete contnuous POPULATION Random Varable, numercal True center =??? True spread =???? parameters ( populaton
More informationSociology 301. Bivariate Regression. Clarification. Regression. Liying Luo Last exam (Exam #4) is on May 17, in class.
Socology 30 Bvarate Regresson Lyng Luo 04.28 Clarfcaton Last exam (Exam #4) s on May 7, n class. No exam n the fnal exam week (May 24). Regresson Regresson Analyss: the procedure for esjmajng and tesjng
More informationLECTURE 9 CANONICAL CORRELATION ANALYSIS
LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationMathematics Intersection of Lines
a place of mnd F A C U L T Y O F E D U C A T I O N Department of Currculum and Pedagog Mathematcs Intersecton of Lnes Scence and Mathematcs Educaton Research Group Supported b UBC Teachng and Learnng Enhancement
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationCorrelation and Regression
Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationThe topics in this section concern with the second course objective. Correlation is a linear relation between two random variables.
4.1 Correlaton The topcs n ths secton concern wth the second course objectve. Correlaton s a lnear relaton between two random varables. Note that the term relaton used n ths secton means connecton or relatonshp
More informationCORRELATION AND REGRESSION
CHAPTER 18 CORRELATION AND REGRESSION After readng ths chapter, students wll be able to understand: LEARNING OBJECTIVES The meanng of bvarate data and technques of preparaton of bvarate dstrbuton; The
More informationSystematic Error Illustration of Bias. Sources of Systematic Errors. Effects of Systematic Errors 9/23/2009. Instrument Errors Method Errors Personal
9/3/009 Sstematc Error Illustraton of Bas Sources of Sstematc Errors Instrument Errors Method Errors Personal Prejudce Preconceved noton of true value umber bas Prefer 0/5 Small over large Even over odd
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationCORRELATION AND REGRESSION
CHAPTER 18 After readng ths chapter, students wll be able to understand: LEARNING OBJECTIVES The meanng of bvarate data and technques of preparaton of bvarate dstrbuton; The concept of correlaton between
More informationStatistical Evaluation of WATFLOOD
tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationIII. Econometric Methodology Regression Analysis
Page Econ07 Appled Econometrcs Topc : An Overvew of Regresson Analyss (Studenmund, Chapter ) I. The Nature and Scope of Econometrcs. Lot s of defntons of econometrcs. Nobel Prze Commttee Paul Samuelson,
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More informationSTAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).
(out of 15 ponts) STAT 3340 Assgnment 1 solutons (10) (10) 1. Fnd the equaton of the lne whch passes through the ponts (1,1) and (4,5). β 1 = (5 1)/(4 1) = 4/3 equaton for the lne s y y 0 = β 1 (x x 0
More informationGravitational Acceleration: A case of constant acceleration (approx. 2 hr.) (6/7/11)
Gravtatonal Acceleraton: A case of constant acceleraton (approx. hr.) (6/7/11) Introducton The gravtatonal force s one of the fundamental forces of nature. Under the nfluence of ths force all objects havng
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationBIO Lab 2: TWO-LEVEL NORMAL MODELS with school children popularity data
Lab : TWO-LEVEL NORMAL MODELS wth school chldren popularty data Purpose: Introduce basc two-level models for normally dstrbuted responses usng STATA. In partcular, we dscuss Random ntercept models wthout
More informationSection 8.3 Polar Form of Complex Numbers
80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the
More informationT E C O L O T E R E S E A R C H, I N C.
T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference
More informationRockefeller College University at Albany
Rockefeller College Unverst at Alban PAD 705 Handout: Maxmum Lkelhood Estmaton Orgnal b Davd A. Wse John F. Kenned School of Government, Harvard Unverst Modfcatons b R. Karl Rethemeer Up to ths pont n
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationLaboratory 3: Method of Least Squares
Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth
More information17 - LINEAR REGRESSION II
Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationChemometrics. Unit 2: Regression Analysis
Chemometrcs Unt : Regresson Analyss The problem of predctng the average value of one varable n terms of the known values of other varables s the problem of regresson. In carryng out a regresson analyss
More informationY = β 0 + β 1 X 1 + β 2 X β k X k + ε
Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationIntroduction to Analysis of Variance (ANOVA) Part 1
Introducton to Analss of Varance (ANOVA) Part 1 Sngle factor The logc of Analss of Varance Is the varance explaned b the model >> than the resdual varance In regresson models Varance explaned b regresson
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationDefinition. Measures of Dispersion. Measures of Dispersion. Definition. The Range. Measures of Dispersion 3/24/2014
Measures of Dsperson Defenton Range Interquartle Range Varance and Standard Devaton Defnton Measures of dsperson are descrptve statstcs that descrbe how smlar a set of scores are to each other The more
More informationWeek3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity
Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle
More informationLaboratory 1c: Method of Least Squares
Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More informationReduced slides. Introduction to Analysis of Variance (ANOVA) Part 1. Single factor
Reduced sldes Introducton to Analss of Varance (ANOVA) Part 1 Sngle factor 1 The logc of Analss of Varance Is the varance explaned b the model >> than the resdual varance In regresson models Varance explaned
More informationProperties of Least Squares
Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures
More informationQ1: Calculate the mean, median, sample variance, and standard deviation of 25, 40, 05, 70, 05, 40, 70.
Q1: Calculate the mean, medan, sample varance, and standard devaton of 5, 40, 05, 70, 05, 40, 70. Q: The frequenc dstrbuton for a data set s gven below. Measurements 0 1 3 4 Frequenc 3 5 8 3 1 a) What
More informationχ x B E (c) Figure 2.1.1: (a) a material particle in a body, (b) a place in space, (c) a configuration of the body
Secton.. Moton.. The Materal Body and Moton hyscal materals n the real world are modeled usng an abstract mathematcal entty called a body. Ths body conssts of an nfnte number of materal partcles. Shown
More information